Vehicle-mounted sensing and displaying system
Through the on-board perception and display system, 360° panoramic images are generated and projected using UWB and AVM technology, which solves the problem that the vehicle's surrounding environment cannot be fully inspected before starting, and realizes no blind spots and convenient environmental inspections, improving user safety Feeling and operational convenience.
Patent Information
- Application Number
- CN202323502710.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-21
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2033-12-21
AI Technical Summary
The prior art is difficult to achieve a comprehensive and blind spot inspection of the vehicle's surrounding environment before starting the vehicle, and there are problems of blind spots in the field of vision and dependence on equipment startup.
A vehicle-mounted perception and display system is designed, including UWB components, AVM components and projection components. UWB technology is used to perform centimeter-level positioning between users and vehicles. The AVM components generate a 360° panoramic image and project it on the window glass through the projection components. , realize environmental inspection without dead corners.
Before the vehicle starts, users can easily and without blind spots to view the environment around the vehicle through the projected image on the window glass, avoid blind spots, and improve inspection efficiency and safety.
Smart Images

Figure CN222474090U_ABST
Abstract
Description
Technical Field
[0001] The utility model belongs to the technical field of vehicle components, and in particular relates to a vehicle-mounted sensing and display system. Background Art
[0002] For car users, the design and structure of almost all vehicles leave blind spots around the vehicle, so it is very necessary to check the surrounding environment of the vehicle before starting the vehicle. Regarding checking the surrounding environment of the vehicle: if it only relies on visual inspection by the user, not only does it require the user to develop the habit of checking the vehicle before starting the vehicle, but it is also impossible to check the environment on multiple sides around the vehicle at the same time, and there are still hidden dangers; if the current existing driving recorder is used, the user needs to enter and start the vehicle before turning on the driving recorder for inspection, and it is impossible to check the surrounding environment of the vehicle before starting the vehicle. All of the above bring inconvenience to car users to check the surrounding environment of the vehicle before starting the vehicle. Utility Model Content
[0003] The utility model aims to provide a vehicle-mounted sensing and display system, so that the vehicle user can check the problems of the vehicle's surrounding environment before starting the vehicle.
[0004] In order to achieve the above-mentioned purpose, the solution of the utility model is: an in-vehicle sensing and display system, including a control module, a sensing module and a display module:
[0005] The perception module includes UWB component and AVM component. The UWB component is used to detect the distance between the user and the vehicle and the user's position relative to the vehicle. The AVM component detects the vehicle's surrounding environment through camera and generates a panoramic image.
[0006] The display module includes a projection component, which projects all or part of the panoramic image generated by the AVM component onto a window glass of the vehicle close to the user;
[0007] The control module is used to obtain the data of the UWB component and the AVM component, and output the image data to be projected to the projection component.
[0008] The working principle and beneficial effects of this solution are: using the UWB technology of the UWB component to locate the distance and relative position between the user and the vehicle at the centimeter level, the control module obtains the data of the UWB component, and then determines the distance and direction of the user approaching the vehicle, and starts the AVM component. Currently, the AVM component usually includes a camera and an image processing program, which can generate a 360° panoramic image around the vehicle. The panoramic image is projected in whole or in part onto the window glass on the side close to the user through the projection component, so that the user can view and know the surrounding environment of the vehicle smoothly without blind spots before starting the vehicle (without entering the vehicle or opening the door), avoiding blind spots, which is very convenient.
[0009] Optionally, the control module further includes an image recognition component for identifying objects in the image generated by the AVM and marking them on the image, so that the car user can more intuitively and conveniently identify objects in the 360° panoramic image around the vehicle, or when objects such as children and animals are identified around the vehicle, an alarm message is generated to notify the user.
[0010] Optionally, the projection assembly includes a plurality of projection devices, which are respectively directed toward the front windshield, rear windshield and side windows of the vehicle. The plurality of projection devices are arranged in a distributed manner, so as to facilitate projection on windows in different directions one by one or simultaneously.
[0011] Optionally, the projection device includes a laser projection device and a photoluminescent layer. The projection device adopts photoluminescent technology. Compared with HUD or LED display technology, the projection technology based on photoluminescent technology can enable the window to produce images with higher pixels, higher brightness and higher contrast while maintaining higher transparency.
[0012] Optionally, the control module is connected to a wireless communication component, and the wireless communication component is used to transmit information between the perception module, the display module and the control module or to communicate with an information terminal outside the vehicle. It is convenient for the perception module, the display module and the control module to transmit information to each other through the wireless communication component, or to communicate with a wifi information terminal, a 5G information terminal and other devices outside the vehicle through the wireless communication component to obtain Internet of Vehicles information, and it is convenient to display information other than the image generated by the AVM component through the projection device.
[0013] Optionally, it also includes a global positioning system module, the control module obtains the vehicle's current global positioning position information from the global positioning system module, obtains 3D street view image information of the vehicle's location through the wireless communication component, and outputs the 3D street view image information to the projection device.
[0014] Optionally, the UWB component is integrated with a vehicle key or a mobile phone to form a mutual sensing system. Vehicle keys and mobile phones are personal items carried by car users. By detecting the vehicle key or mobile phone integrated with the UWB component, it is basically equivalent to detecting the user, which facilitates a more accurate low assessment of the distance and relative position between the user and the vehicle.
[0015] Optionally, an information interaction system is also included, and the information interaction system includes one or more of a voice interaction system, a gesture or body visual recognition system, an infrared tracking system or a touch screen system.
[0016] Optionally, the laser projection device includes a monochromatic light projection device or a trichromatic light projection device. The monochromatic light projection device can project a monochromatic image, and the trichromatic light projection device can project a color image.
[0017] Optionally, the perception module also includes one or more of a detection radar, a gyroscope, a temperature sensor, a humidity sensor, and an air quality detector. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 This is a control logic diagram of a vehicle-mounted sensing and display system in an embodiment of the utility model;
[0019] Figure 2 This is a working schematic diagram of a vehicle-mounted sensing and display system in an embodiment of the utility model;
[0020] Figure 3 This is a control logic diagram of a vehicle-mounted sensing and display system in another embodiment of the present utility model. DETAILED DESCRIPTION
[0021] The following is further described in detail through specific implementation methods:
[0022] The symbols in the drawings of the specification include: vehicle 1 , panoramic image 2 , driver 3 , photoluminescent layer 4 .
[0023] Example
[0024] This embodiment is basically Figure 1 , Figure 2 Shown: A vehicle-mounted sensing and display system, including a control module, a sensing module and a display module:
[0025] The perception module includes a UWB component for detecting the distance between the user and the vehicle 1 and the user's position relative to the vehicle 1. In this embodiment, the UWB component is integrated with the vehicle 1 key, and in another embodiment, the UWB component is integrated with the mobile phone. UWB is an accurate and real-time ranging and positioning technology, with ranging and positioning accuracy to the centimeter level, and a secure timestamp is added to UWB, so that the perception module has the ability to prevent relay attacks, greatly improving the security of the vehicle 1 key.
[0026] In this embodiment, the AVM component is a 360° surround view system, which collects images of the environment around the vehicle 1 (around the vehicle 1 and under the chassis) through multiple cameras around the vehicle 1, on the top of the vehicle 1 and on the bottom of the vehicle 1, and stitches the images into a panoramic image 2 through an image stitching algorithm. The panoramic image 2 is output to the projection component via the on-board computer and is imaged on the photoluminescent layer 4.
[0027] The display module includes a projection assembly. In this embodiment, the vehicle 1 is a three-compartment sedan, which includes a front windshield, a rear windshield, and four side windows on the front and rear doors on both sides. Therefore, in this embodiment, the projection assembly includes six projection devices. The projection device includes a laser projection device and a photoluminescent layer 4. The laser projection device is a three-color laser projector. In this embodiment, the photoluminescent layer 4 is a double-layer transparent film coated with a photoluminescent material. The photoluminescent material is sandwiched between two layers of the double-layer transparent film. The photoluminescent material includes three layers, and each layer emits one of the three primary colors of light after being stimulated. The photoluminescent material is essentially a fluorescent material. Under the irradiation of ultraviolet light (200-400nm), the fluorescent material presents various colors of visible light (400-800nm) depending on the type and content of the metal and activator in the material. The thickness of each layer is micrometer level, and the light transmittance of the photoluminescent layer 4 can be guaranteed to be above 85%. Six laser projectors are embedded in the roof of the vehicle 1, respectively illuminating the six windows of the vehicle 1, namely the front windshield, rear windshield and side windows. In this embodiment, six double-layer transparent films are respectively attached to the six windows of the vehicle 1; in another embodiment, each window of the vehicle 1 is double-layer glass, and the photoluminescent layer 4 is sandwiched between the double-layer glass. The projection device is directed toward the front windshield, rear windshield and side windows of the vehicle 1 respectively.
[0028] The control module, which is a vehicle-mounted computer in this embodiment, is used to obtain data from the UWB component and the AVM component, and output the image data to be projected to the projection component.
[0029] Take the left-hand drive vehicle 1 as an example. Driver 3 approaches vehicle 1 from the rear to the front of the vehicle 20 meters away from the left side of vehicle 1. When the UWB component detects the 10-20 meter range close to vehicle 1, the positioning and ranging functions of the UWB component are turned on. When driver 3 walks into the range of 3-10 meters, the panoramic image 2 is first projected onto the side window glass of the left rear door. When driver 3 walks into the range of 1-3 meters, the panoramic image 2 moves from the side window glass of the left rear door to the side window glass of the cab according to the walking speed of driver 3, until driver 3 walks into the range of 1 meter, and the panoramic image 2 moves to the side window glass of the cab. Before entering vehicle 1, driver 3 can check the environment around vehicle 1 through the image projected on the window glass.
[0030] In another embodiment, the projected image is a cropped panoramic image 2: the driver 3 gets on the vehicle from the left side, and can visually check the environment on the left side of the vehicle 1 during the getting on process, so the left part of the panoramic image 2 is cropped, and the remaining image area becomes smaller. The remaining image can be enlarged during projection, which is more convenient for the driver 3 to view.
[0031] In another embodiment, as shown in the attached Figure 3As shown, the control module also includes an image recognition component, which includes a GPU chip and a memory loaded with an image recognition AI computer program, which is used to identify objects in the AVM-generated image and mark them on the image: for example, marking cats, dogs, children, steps, etc.
[0032] In another embodiment, as shown in the attached Figure 3 As shown, the control module is connected to the wireless communication component, which is a 5G communication module. The wireless communication component communicates with the information terminal outside the vehicle (the 5G mobile phone of the driver 3), and obtains information such as weather information, stock information of interest, schedule information, temperature and humidity in the vehicle, and air quality in the vehicle according to the driver 3's preference settings, and projects it onto the window glass through the projection component.
[0033] In another embodiment, as shown in the attached Figure 3 As shown, it also includes a global positioning system module, such as a GPS system module. The control module obtains the current global positioning position information of the vehicle 1 from the GPS system module, obtains the 3D street view image information of the location of the vehicle 1 through the wireless communication component, and then combines the 3D model of the vehicle 1 and renders it into the 3D street view image, and outputs the information that the 3D model of the vehicle 1 is located in the 3D street view image to the projection device. This allows the driver 3 to view the environment around the vehicle 1 in 3D, which is more intuitive and convenient. In addition, the global positioning system module can be used to enable the vehicle 1 to realize functions such as automatic driving and automatic parking.
[0034] In another embodiment, an information interaction system is also included. In this embodiment, the information interaction system includes a voice interaction system and a gesture visual recognition system. The voice interaction system mainly includes a microphone, and the gesture visual recognition system mainly includes a gesture recognition camera. The microphone and the gesture recognition camera are respectively installed in groups on the window frames above the side window glass. The interaction with the driver 3 is achieved by recognizing the voice and gestures of the driver 3.
[0035] The contents not described in detail in this specification belong to the prior art known to those skilled in the art. For those skilled in the art, several modifications and improvements can be made without departing from the structure of the utility model, which should also be regarded as the protection scope of the utility model, and these will not affect the effect of the implementation of the utility model and the practicality of the patent. The protection scope required by this application shall be based on the content of its claims, and the specific implementation methods and other records in the specification can be used to interpret the content of the claims.
Claims
1. A vehicle-mounted sensing and display system, characterized in that: Including control module, perception module and display module: The perception module includes UWB component and AVM component. The UWB component is used to detect the distance between the user and the vehicle and the user's position relative to the vehicle. The AVM component detects the vehicle's surrounding environment through camera and generates a panoramic image. The display module includes a projection component, which projects all or part of the panoramic image generated by the AVM component onto a window glass of the vehicle close to the user; The control module is used to obtain the data of the UWB component and the AVM component, and output the image data to be projected to the projection component.
2. The vehicle-mounted sensing and display system according to claim 1, characterized in that: The control module also includes an image recognition component for identifying objects in the AVM-generated image and marking them on the image.
3. The vehicle-mounted sensing and display system according to claim 1, characterized in that: The projection assembly comprises a plurality of projection devices, which are respectively directed toward the front windshield, the rear windshield and the side windows of the vehicle.
4. The vehicle-mounted sensing and display system according to claim 3, characterized in that: The projection device includes a laser projection device and a photoluminescent layer.
5. The vehicle-mounted sensing and display system according to claim 4, characterized in that: The control module is connected to the wireless communication component, which is used to transmit information between the perception module, the display module and the control module or to communicate with an information terminal outside the vehicle.
6. The vehicle-mounted sensing and display system according to claim 5, characterized in that: It also includes a global positioning system module. The control module obtains the vehicle's current global positioning position information from the global positioning system module, obtains 3D street view image information of the vehicle's position through a wireless communication component, and outputs the 3D street view image information to the projection device.
7. The vehicle-mounted sensing and display system according to claim 1, characterized in that: The UWB component is integrated with a vehicle key or a mobile phone to form a mutual sensing system.
8. The vehicle-mounted sensing and display system according to claim 1, characterized in that: It also includes an information interaction system, which includes one or more of a voice interaction system, a gesture or body visual recognition system, an infrared tracking system or a touch screen system.
9. The vehicle-mounted sensing and display system according to claim 4, characterized in that: The laser projection device includes a monochromatic light projection device or a trichromatic light projection device.
10. The vehicle-mounted sensing and display system according to claim 1, characterized in that: The perception module also includes one or more of a detection radar, a gyroscope, a temperature sensor, a humidity sensor, and an air quality detector.