An off-vehicle interaction projection control method, device, equipment and storage medium

Abstract

This application discloses a method, device, equipment, and storage medium for controlling vehicle-exterior interactive projection, relating to the field of intelligent vehicle-exterior interaction technology. The method includes: acquiring the movement trajectory data of the target authorized user, environmental perception data of the side and rear area of ​​the target vehicle, and the current state data of the target vehicle; determining the target interactive scene from candidate interactive scenes based on preset scene priority rules; determining the target projection content based on the mapping relationship between the candidate interactive scenes and projection content templates; generating projection driving instructions based on the target projection content, and sending the projection driving instructions to the B-pillar matrix projection lights of the target vehicle via the vehicle controller local area network bus, causing the B-pillar matrix projection lights to execute the projection driving instructions. This solution, through the fusion of multi-source perception data, determines the target interactive scene and ultimately generates personalized projection content matching the scene, improving the accuracy of vehicle interactive scene recognition and user experience.

Description

Technical Field

[0001] This application relates to the field of vehicle control technology, and more particularly to the field of intelligent vehicle external interaction technology, specifically to a vehicle external interactive projection control method, device, equipment, and storage medium. Background Technology

[0002] With the rapid development of vehicle intelligence technology, vehicle-to-everything (V2X) interaction, as an important component of the intelligent vehicle-human-machine interaction system, aims to achieve information transmission and emotional connection with people outside the vehicle through various media such as light, projection, and sound.

[0003] Existing technologies typically turn on the headlights when the driver approaches the vehicle, providing basic lighting or projecting a preset logo. They cannot dynamically adjust based on the user's location, vehicle status, or environment, resulting in limited functionality and a lack of dynamic interaction capabilities. Summary of the Invention

[0004] This application provides a method, device, equipment, and storage medium for controlling vehicle-exterior interactive projection, in order to improve the accuracy of vehicle interaction scene recognition and user experience.

[0005] According to one aspect of this application, an external interactive projection control method is provided, the method comprising: Acquire the movement trajectory data of the target authorized user, the environmental perception data of the area to the side and rear of the target vehicle, and the current status data of the target vehicle; Based on preset scenario priority rules, a target interaction scenario is determined from candidate interaction scenarios according to the movement trajectory data, the environmental perception data, and the current status data; wherein, the candidate interaction scenarios include at least a welcoming scenario, a security warning scenario, and a status indication scenario; Based on the mapping relationship between candidate interaction scenarios and projection content templates, the target projection content is determined according to the target interaction scenario; Based on the target projection content, a projection drive command is generated and sent to the B-pillar matrix projection lights of the target vehicle via the vehicle controller local area network bus, so that the B-pillar matrix projection lights execute the projection drive command.

[0006] According to another aspect of this application, an external interactive projection control device is provided, the device comprising: The data acquisition module is used to acquire the movement trajectory data of the target authorized user, the environmental perception data of the area to the side and rear of the target vehicle, and the current status data of the target vehicle. The target interaction scenario determination module is used to determine the target interaction scenario from candidate interaction scenarios based on preset scenario priority rules, the movement trajectory data, the environmental perception data, and the current state data; wherein, the candidate interaction scenarios include at least a welcoming scenario, a security warning scenario, and a status indication scenario; The target projection content determination module is used to determine the target projection content based on the mapping relationship between candidate interaction scenarios and projection content templates, according to the target interaction scenario. The projection instruction execution module is used to generate a projection drive instruction based on the target projection content, and send the projection drive instruction to the B-pillar matrix projection light of the target vehicle through the vehicle controller local area network bus, so that the B-pillar matrix projection light executes the projection drive instruction.

[0007] According to another aspect of this application, an electronic device is provided, the electronic device comprising: One or more processors; Memory, used to store one or more programs; When one or more programs are executed by one or more processors, the one or more processors implement any of the vehicle exterior interactive projection control methods provided in the embodiments of this application.

[0008] According to another aspect of this application, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements any of the vehicle-exterior interactive projection control methods provided in the embodiments of this application.

[0009] According to another aspect of this application, a computer program product is provided, including a computer program that, when executed by a processor, implements any of the vehicle exterior interactive projection control methods provided in the embodiments of this application.

[0010] This application acquires the movement trajectory data of the target authorized user, environmental perception data of the area behind and to the side of the target vehicle, and the current status data of the target vehicle. Based on preset scene priority rules, it determines the target interaction scene from candidate interaction scenes according to the movement trajectory data, environmental perception data, and current status data. The candidate interaction scenes include at least a welcome scene, a safety warning scene, and a status indication scene. Based on the mapping relationship between the candidate interaction scenes and the projection content template, it determines the target projection content according to the target interaction scene. Based on the target projection content, it generates a projection drive command and sends it to the B-pillar matrix projection lights of the target vehicle via the vehicle controller local area network bus, causing the B-pillar matrix projection lights to execute the projection drive command. This solution, through multi-source perception data fusion, can accurately identify the intention of the target authorized user, assess environmental risks, and determine the vehicle status, thereby determining the target interaction scene and ultimately generating personalized projection content matching the scene. This represents a fundamental leap from "passive lighting" to "active intelligent interaction," greatly enriching the functional dimensions, achieving accurate, real-time, and safe external vehicle interaction, and improving the accuracy of vehicle interaction scene recognition and user experience. Attached Figure Description

[0011] Figure 1 This is a flowchart of an external interactive projection control method provided in Embodiment 1 of this application; Figure 2 This is a flowchart of an external interactive projection control method provided according to Embodiment 2 of this application; Figure 3 This is a schematic diagram of the structure of an external interactive projection control device according to Embodiment 3 of this application; Figure 4 This is a schematic diagram of the structure of an electronic device that implements the vehicle-exterior interactive projection control method of Embodiment 4 of this application. Detailed Implementation

[0012] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0013] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0014] Furthermore, it should be noted that the information collected in the technical solution of this application is information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data all comply with the relevant laws, regulations and standards of the relevant countries and regions, necessary confidentiality measures have been taken, and they do not violate public order and good morals. Corresponding operation portals are provided for users to choose to authorize or refuse.

[0015] Example 1 Figure 1 This is a flowchart of an external vehicle interactive projection control method according to Embodiment 1 of this application. This embodiment is applicable to intelligent external vehicle interaction based on multi-source sensing data and B-pillar matrix projection lights. It can be executed by an external vehicle interactive projection control device, which can be implemented in hardware and / or software. This external vehicle interactive projection control device can be configured in a computer device, such as a server. Figure 1 As shown, the method includes: S110. Obtain the movement trajectory data of the target authorized user, the environmental perception data of the area to the side and rear of the target vehicle, and the current status data of the target vehicle.

[0016] The movement trajectory data may include the target authorized user's two-dimensional coordinates, movement speed, movement direction, acceleration, trajectory curvature, and other trajectory data, which can be acquired in real time through an ultra-wideband (UWB) locator. The area behind the target vehicle is a fan-shaped blind spot extending backward from the vehicle's B-pillar. This can be preset according to actual conditions, and this application embodiment does not specifically limit it. For example, a fan-shaped blind spot extending 45° backward from the vehicle's B-pillar, 3 meters laterally and 10 meters longitudinally. Environmental perception data is the surrounding dynamic environmental information obtained through multi-sensor fusion, which can be acquired through cameras and millimeter-wave radar installed on the side and rear of the target vehicle. Environmental perception data may include the type of moving target, the position of the moving target, the speed of the moving target, and collision time data. The moving target is an object with relative motion within the perception area, which may include pedestrians, as well as traffic participants such as bicycles, electric bicycles, and motor vehicles. Current status data is the operating parameters and status information reported in real time by each electronic control unit of the target vehicle, which may include door lock status data, charging status data, remaining battery power data, and driving mode data.

[0017] Specifically, multi-source sensing data can be collected and processed in parallel or synchronously, enabling real-time tracking of the two-dimensional coordinates (X, Y) and movement trajectory of authorized users via UWB locators. Cameras and radar installed on the sides and rear of the vehicle can identify and track moving targets (such as pedestrians and bicycles) in the area behind and to calculate their relative speed and distance. Current vehicle status, such as door lock status, charging status, remaining battery power, and current driving mode, can be obtained from the vehicle's CAN (Controller Area Network) bus. Through deep integration of UWB high-precision positioning, onboard cameras (for pedestrian or vehicle identification), and radar (for moving objects), context-aware intelligent external vehicle interaction is achieved.

[0018] Optionally, before acquiring the movement trajectory data of the target authorized user, the environmental perception data of the area to the side and rear of the target vehicle, and the current status data of the target vehicle, the method further includes: controlling the target vehicle to enter the working mode from the sleep mode when the target vehicle is detected to be in an unlocked state or when an authorized device carrying an ultra-wideband tag is detected to be within a preset distance range by an ultra-wideband locator installed on the B-pillar of the target vehicle.

[0019] Specifically, when the vehicle unlocks or detects an authorized smart key or UWB device entering a preset range (e.g., 7-10 meters), the target vehicle is controlled to switch from sleep mode to working mode. This achieves a balance between low-power operation and rapid response, ensuring immediate detection of authorized user proximity while minimizing static energy consumption, extending vehicle standby time, and providing a reliable readiness state for subsequent precise external interactions.

[0020] S120. Based on preset scenario priority rules, determine the target interaction scenario from candidate interaction scenarios according to the movement trajectory data, the environmental perception data, and the current status data; wherein, the candidate interaction scenarios include at least a welcoming scenario, a security warning scenario, and a status indication scenario.

[0021] The preset scenario priority rules are a set of pre-defined rules used to arbitrate the execution priority order when multiple candidate scenarios are simultaneously met. Specifically, candidate interaction scenarios may include welcome scenarios, safety warning scenarios, status indication scenarios, vehicle location scenarios, and entertainment scenarios. The welcome scenario provides welcome light effects and personalized information via ground projection when the user approaches the vehicle, creating a sense of ceremony. The safety warning scenario projects warning information to alert the user and oncoming vehicles when a door opening collision risk is detected. The status indication scenario projects key information, such as information related to charging status, when the vehicle is in a special state. The vehicle location scenario helps users quickly locate their vehicle in parking lots. The entertainment scenario provides ground-based interactive games or ambient lighting effects after parking.

[0022] S130. Based on the mapping relationship between candidate interaction scenarios and projection content templates, determine the target projection content according to the target interaction scenario.

[0023] Optionally, the step of determining the target projection content based on the mapping relationship between candidate interaction scenarios and projection content templates, according to the target interaction scenario, includes: if the target interaction scenario is a welcoming scenario, then calling the welcoming scenario content template to generate projection content containing a dynamic welcoming light carpet graphic and personalized information; if the target interaction scenario is a safety warning scenario, then calling the safety warning scenario content template to generate projection content containing a high-contrast warning icon and dynamic text prompts; if the target interaction scenario is a status indication scenario, then calling the status indication scenario content template to generate projection content containing a battery status icon, battery percentage number, charging progress bar, and remaining time text.

[0024] The welcome scene content template is a parametric graphic resource package pre-stored in memory, which may include basic light carpet graphics, etc. The dynamic welcome light carpet graphics are a ribbon-like light effect animation extending from the B-pillar to the ground, with a sense of flow and extension. Personalized information is customized content read from the user account, including the car owner's nickname, welcome message, and exclusive patterns. The safety warning scene content template is a pre-stored warning resource package, containing multi-level warning icons, a dynamic text library, etc. High-contrast warning icons are graphic symbols using highly saturated colors (red or yellow), simple outlines, and large sizes to ensure clear visibility under various lighting conditions.

[0025] Specifically, if the target interaction scenario is a welcome scene, a dynamic welcome light carpet is projected, with the light effect extending outwards from the lower B-pillar. Personalized information such as the car owner's nickname and a welcome message can be overlaid, and the flow speed of the light effect can be synchronized with the user's walking speed. If the target interaction scenario is a safety warning scene, a high-contrast, conspicuous warning area, such as a flashing red exclamation mark, a bicycle icon, or the text "Caution: Safety" is immediately projected onto the ground to the side and rear to warn oncoming vehicles or pedestrians. If the target interaction scenario is a status indicator scene, a clear battery icon and information such as battery percentage and estimated remaining time are projected onto the ground near the charging port for easy viewing by the user from a distance.

[0026] S140. Based on the target projection content, generate a projection drive command and send the projection drive command to the B-pillar matrix projection light of the target vehicle through the vehicle controller local area network bus, so that the B-pillar matrix projection light executes the projection drive command.

[0027] The B-pillar is a vertical pillar (extending from the roof to the floor) located between the front and rear doors in the vehicle's body structure. A B-pillar matrix projection light is a miniature projection device installed on the B-pillar, primarily used to project images or information onto the ground or the area around the vehicle body.

[0028] Optionally, the projection driving command is used as follows: the driving chip within the B-pillar matrix projection lamp parses the projection driving command to obtain dot matrix data, brightness parameters, timing parameters, and geometric correction parameters; the driving chip within the B-pillar matrix projection lamp generates a row scanning signal based on the timing parameters, generates a column data signal based on the dot matrix data and the brightness parameters, and drives the matrix light-emitting diode array to scan based on the row scanning signal and the column data signal to obtain an initial optical image; the optical module within the B-pillar matrix projection lamp performs trapezoidal distortion correction and focal length adjustment processing on the optical path of the initial optical image based on the geometric correction parameters, and projects the processed beam onto the ground to form a projected image.

[0029] The projection drive commands are a set of digital commands controlling the operation of the B-pillar matrix projector. The driver chip, integrated within the B-pillar matrix projector, is the core control unit responsible for command parsing and execution control. Dot matrix data is a digital matrix describing the on / off state and grayscale levels of the projected image pixels. Brightness parameters are quantified values ​​controlling the overall or partial luminous intensity of the LED (Light Emitting Diode) array. Timing parameters are time-series data controlling the scanning refresh rate of the LED array. Geometric correction parameters are correction coefficients used to compensate for geometric distortion and focus deviation caused by the oblique projection of the B-pillar. The optical module, installed inside the B-pillar matrix projector, consists of multiple sets of optical lenses and mechanical adjustment mechanisms. It is used to collimate, homogenize, focus, and geometrically correct the light emitted from the matrix LED array, and project the corrected beam onto a designated ground area.

[0030] The projection drive command is sent to the B-pillar matrix projection light of the target vehicle through the vehicle controller LAN bus, so that the B-pillar matrix projection light executes the projection drive command, realizing high brightness, high definition and low latency dynamic projection output, ensuring that the interactive content is accurately presented on the ground, and improving the intuitiveness, real-time performance and user experience of the external interaction.

[0031] This application embodiment acquires the movement trajectory data of the target authorized user, environmental perception data of the area behind and to the side of the target vehicle, and the current status data of the target vehicle. Based on preset scene priority rules, a target interaction scene is determined from candidate interaction scenes according to the movement trajectory data, environmental perception data, and current status data. The candidate interaction scenes include at least a welcome scene, a safety warning scene, and a status indication scene. Based on the mapping relationship between the candidate interaction scenes and the projection content template, the target projection content is determined according to the target interaction scene. Based on the target projection content, a projection drive command is generated and sent to the B-pillar matrix projection lights of the target vehicle via the vehicle controller local area network bus, causing the B-pillar matrix projection lights to execute the projection drive command. This solution, through multi-source perception data fusion, can accurately identify the intention of the target authorized user, assess environmental risks, and determine the vehicle status, thereby determining the target interaction scene and ultimately generating personalized projection content matching the scene. This achieves accurate, real-time, and safe external vehicle interaction, improving the accuracy of vehicle interaction scene recognition and user experience.

[0032] Example 2 Figure 2This is a flowchart of an external interactive projection control method according to Embodiment 2 of this application. Based on the technical solutions of the above embodiments, this embodiment refines the process of "determining the target interactive scene from candidate interactive scenes based on preset scene priority rules, according to the movement trajectory data, the environmental perception data, and the current state data" into "determining whether the triggering conditions corresponding to the candidate interactive scene are met based on the movement trajectory data, the environmental perception data, and the current state data; prioritizing the candidate interactive scenes that meet the triggering conditions according to preset scene priority rules, and taking the candidate interactive scene with the highest priority as the target interactive scene; wherein, the preset scene priority rules are: the priority of safety warning scenes is higher than that of status indication scenes, and the priority of status indication scenes is higher than that of welcoming scenes." It should be noted that for parts not detailed in this embodiment, please refer to the relevant descriptions in other embodiments. Figure 2 As shown, the method includes: S210. Obtain the movement trajectory data of the target authorized user, the environmental perception data of the area to the side and rear of the target vehicle, and the current status data of the target vehicle.

[0033] S220. Based on the movement trajectory data, the environmental perception data, and the current state data, determine whether the triggering conditions corresponding to the candidate interaction scenario are met; wherein, the candidate interaction scenario includes at least a welcoming scenario, a security warning scenario, and a status indication scenario.

[0034] Optionally, determining whether the triggering conditions corresponding to the candidate interaction scenario are met based on the movement trajectory data, the environmental perception data, and the current state data includes at least one of the following: if, based on the movement trajectory data, it is determined that the target authorized user is within a preset distance range and the azimuth angle is directly facing the B-pillar area of ​​the target vehicle, then the welcoming scenario triggering conditions are met; if, based on the environmental perception data and the current state data, it is determined that there is a moving target in the side and rear area of ​​the target vehicle and the target vehicle is in a door open state, then the safety warning scenario triggering conditions are met; if, based on the current state data, it is determined that the target vehicle is in a charging connection state, then the status indication scenario triggering conditions are met.

[0035] Specifically, based on the fused perception data, the system determines the appropriate interaction scenario to trigger. If the user is within 3-5 meters and directly facing the B-pillar, the welcome scene trigger condition is met. If a moving target is present in the area to the side and rear of the vehicle and any door handle is opened, the safety warning scene trigger condition is met. If the vehicle is charging, the status indication scene trigger condition is met. This scenario triggering mechanism achieves precise delivery of the welcome service through spatial geometric constraints (distance and azimuth), proactive prevention of safety warnings through risk-action coupling judgment (moving target and door opening), and seamless push of information services through automatic status perception (charging connection detection). Together, these elements construct a three-dimensional value system encompassing experience, safety, and efficiency, thereby improving the user experience.

[0036] S230. According to the preset scenario priority rules, the candidate interaction scenarios that meet the triggering conditions are sorted by priority, and the candidate interaction scenario with the highest priority is taken as the target interaction scenario; wherein, the preset scenario priority rules are: the priority of the security warning scenario is higher than that of the status indication scenario, and the priority of the status indication scenario is higher than that of the welcoming scenario.

[0037] Among these scenarios, safety warnings involve personal safety and require immediate response. Status indication scenarios are mainly used to inform drivers of vehicle status; they are important but not urgent. Welcome scenarios primarily aim to improve user experience and can be delayed in execution.

[0038] S240. Based on the mapping relationship between candidate interaction scenarios and projection content templates, determine the target projection content according to the target interaction scenario.

[0039] S250. Based on the target projection content, generate a projection drive command and send the projection drive command to the B-pillar matrix projection light of the target vehicle through the vehicle controller local area network bus, so that the B-pillar matrix projection light executes the projection drive command.

[0040] Specifically, the generated target projection content is converted into specific projection drive commands (which may include graphic content, brightness, flashing frequency, etc.), and sent to the B-pillar matrix projection light via the CAN bus. The driver chip inside the projection light parses the commands and controls the optical module and matrix LEDs to complete the projection. The projection effect will last for a period of time (such as the welcome light effect ending after the user gets into the vehicle), or automatically turn off after the triggering conditions disappear (such as when the safety risk is eliminated). Subsequently, if no other tasks are detected, it will re-enter a low-power sleep mode to save energy. In addition, when the optical module overheats, communication times out, or sensor data is detected, a fault code will be recorded and the user will be alerted via the instrument panel.

[0041] This application embodiment acquires the movement trajectory data of the target authorized user, environmental perception data of the area behind and to the side of the target vehicle, and the current status data of the target vehicle. Based on preset scene priority rules, a target interaction scene is determined from candidate interaction scenes according to the movement trajectory data, environmental perception data, and current status data. The candidate interaction scenes include at least a welcome scene, a safety warning scene, and a status indication scene. Based on the mapping relationship between the candidate interaction scenes and the projection content template, the target projection content is determined according to the target interaction scene. Based on the target projection content, a projection drive command is generated and sent to the B-pillar matrix projection lights of the target vehicle via the vehicle controller local area network bus, causing the B-pillar matrix projection lights to execute the projection drive command. This solution, through multi-source perception data fusion, can accurately identify the intention of the target authorized user, assess environmental risks, and determine the vehicle status, thereby determining the target interaction scene and ultimately generating personalized projection content matching the scene. This achieves accurate, real-time, and safe external vehicle interaction, improving the accuracy of vehicle interaction scene recognition and user experience.

[0042] Example 3 Figure 3 This is a structural schematic diagram of an external vehicle interactive projection control device according to Embodiment 3 of this application. This embodiment is applicable to intelligent external vehicle interaction based on multi-source sensing data and B-pillar matrix projection lights. The external vehicle interactive projection control device can be implemented in hardware and / or software, and can be configured in a computer device, such as a server. Figure 3 As shown, the device includes: The data acquisition module 310 is used to acquire the movement trajectory data of the target authorized user, the environmental perception data of the area behind the target vehicle, and the current status data of the target vehicle. The target interaction scenario determination module 320 is used to determine a target interaction scenario from candidate interaction scenarios based on a preset scenario priority rule, according to the movement trajectory data, the environmental perception data, and the current state data; wherein, the candidate interaction scenarios include at least a welcoming scenario, a security warning scenario, and a status indication scenario; The target projection content determination module 330 is used to determine the target projection content based on the mapping relationship between the candidate interaction scene and the projection content template, according to the target interaction scene. The projection instruction execution module 340 is used to generate a projection drive instruction based on the target projection content, and send the projection drive instruction to the B-pillar matrix projection light of the target vehicle through the vehicle controller local area network bus, so that the B-pillar matrix projection light executes the projection drive instruction.

[0043] Optionally, the target interaction scenario determination module 320 includes: The trigger condition judgment unit is used to determine whether the trigger condition corresponding to the candidate interaction scenario is met based on the movement trajectory data, the environmental perception data and the current state data. The target interaction scenario determination unit is used to prioritize candidate interaction scenarios that meet the triggering conditions according to preset scenario priority rules, and to take the candidate interaction scenario with the highest priority as the target interaction scenario. The preset scenario priority rule is as follows: the priority of the safety warning scenario is higher than that of the status indication scenario, and the priority of the status indication scenario is higher than that of the welcoming scenario.

[0044] Optional, the trigger condition judgment unit is specifically used for: If, based on the movement trajectory data, it is determined that the target authorized user is within a preset distance range and the azimuth angle is directly facing the B-pillar area of ​​the target vehicle, then the welcoming scene triggering conditions are met. If, based on the environmental perception data and the current state data, it is determined that there is a moving target in the area behind the target vehicle and the target vehicle is in the open door state, then the safety warning scenario triggering conditions are met. If, based on the current status data, it is determined that the target vehicle is in a charging connection state, then the status indication scenario triggering condition is met.

[0045] Optionally, the target projection content determination module 330 includes: The welcoming projection content determination unit is used to call the welcoming scene content template and generate projection content containing dynamic welcoming light carpet graphics and personalized information if the target interactive scene is a welcoming scene. The safety warning projection content determination unit is used to call the safety warning scene content template and generate projection content containing high-contrast warning icons and dynamic text prompts if the target interaction scene is a safety warning scene. The status indicator projection content determination unit is used to call the status indicator scene content template and generate projection content including battery status icon, battery percentage number, charging progress bar and remaining time text if the target interaction scene is a status indicator scene.

[0046] Optionally, the projection driving command is used for the following: The projection driving command is parsed by the driving chip inside the B-pillar matrix projection lamp to obtain dot matrix data, brightness parameters, timing parameters and geometric correction parameters. The driving chip inside the B-pillar matrix projection lamp generates a row scanning signal based on the timing parameters, generates a column data signal based on the dot matrix data and the brightness parameters, and drives the matrix light-emitting diode array to scan based on the row scanning signal and the column data signal to obtain an initial optical image. The optical module within the B-pillar matrix projection lamp performs trapezoidal distortion correction and focal length adjustment on the optical path of the initial optical image according to the geometric correction parameters, and projects the processed beam onto the ground to form a projected image.

[0047] The device further includes: The vehicle mode switching module is used to control the target vehicle to switch from sleep mode to working mode before acquiring the target authorized user's movement trajectory data, the environmental perception data of the area behind the target vehicle, and the current status data of the target vehicle, and when the target vehicle is detected to be in an unlocked state or when an authorized device carrying an ultra-wideband tag is detected to be within a preset distance range by an ultra-wideband locator installed on the B-pillar of the target vehicle.

[0048] This application embodiment acquires the movement trajectory data of the target authorized user, environmental perception data of the area behind and to the side of the target vehicle, and the current status data of the target vehicle. Based on preset scene priority rules, a target interaction scene is determined from candidate interaction scenes according to the movement trajectory data, environmental perception data, and current status data. The candidate interaction scenes include at least a welcome scene, a safety warning scene, and a status indication scene. Based on the mapping relationship between the candidate interaction scenes and the projection content template, the target projection content is determined according to the target interaction scene. Based on the target projection content, a projection drive command is generated and sent to the B-pillar matrix projection lights of the target vehicle via the vehicle controller local area network bus, causing the B-pillar matrix projection lights to execute the projection drive command. This solution, through multi-source perception data fusion, can accurately identify the intention of the target authorized user, assess environmental risks, and determine the vehicle status, thereby determining the target interaction scene and ultimately generating personalized projection content matching the scene. This achieves accurate, real-time, and safe external vehicle interaction, improving the accuracy of vehicle interaction scene recognition and user experience.

[0049] The vehicle exterior interactive projection control device provided in this application embodiment can execute the vehicle exterior interactive projection control method provided in any embodiment of this application, and has the corresponding functional modules and beneficial effects for executing each vehicle exterior interactive projection control method.

[0050] According to embodiments of this application, this application also provides an electronic device, a readable storage medium, and a computer program product.

[0051] Example 4 Figure 4This is a schematic diagram of the structure of an electronic device 410 implementing the vehicle-to-everything (V2X) interactive projection control method according to embodiments of this application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present application described and / or claimed herein.

[0052] like Figure 4 As shown, the electronic device 410 includes at least one processor 411 and a memory, such as a read-only memory (ROM) 412 or a random access memory (RAM) 413, communicatively connected to the at least one processor 411. The memory stores computer programs executable by the at least one processor. The processor 411 can perform various appropriate actions and processes based on the computer program stored in the ROM 412 or loaded from storage unit 418 into the RAM 413. The RAM 413 may also store various programs and data required for the operation of the electronic device 410. The processor 411, ROM 412, and RAM 413 are interconnected via a bus 414. An input / output (I / O) interface 415 is also connected to the bus 414.

[0053] Multiple components in electronic device 410 are connected to I / O interface 415, including: input unit 416, such as keyboard, mouse, etc.; output unit 417, such as various types of displays, speakers, etc.; storage unit 418, such as disk, optical disk, etc.; and communication unit 419, such as network card, modem, wireless transceiver, etc. Communication unit 419 allows electronic device 410 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0054] Processor 411 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 411 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 411 performs the various methods and processes described above, such as the vehicle exterior interactive projection control method.

[0055] In some embodiments, the vehicle exterior interactive projection control method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 418. In some embodiments, part or all of the computer program may be loaded into and / or installed on electronic device 410 via ROM 412 and / or communication unit 419. When the computer program is loaded into RAM 413 and executed by processor 411, one or more steps of the vehicle exterior interactive projection control method described above may be performed. Alternatively, in other embodiments, processor 411 may be configured as the vehicle exterior interactive projection control method by any other suitable means (e.g., by means of firmware).

[0056] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0057] Computer programs used to implement the methods of this application may be written in any combination of one or more programming languages. These computer programs may be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable vehicle-to-everything (V2X) interactive projection control device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0058] In the context of this application, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0059] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0060] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0061] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0062] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this application can be achieved, and this is not limited herein.

[0063] The specific embodiments described above do not constitute a limitation on the scope of protection of this application. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A method for controlling interactive projection outside a vehicle, characterized in that, include: Acquire the movement trajectory data of the target authorized user, the environmental perception data of the area to the side and rear of the target vehicle, and the current status data of the target vehicle; Based on preset scenario priority rules, a target interaction scenario is determined from candidate interaction scenarios according to the movement trajectory data, the environmental perception data, and the current status data; wherein, the candidate interaction scenarios include at least a welcoming scenario, a security warning scenario, and a status indication scenario; Based on the mapping relationship between candidate interaction scenarios and projection content templates, the target projection content is determined according to the target interaction scenario; Based on the target projection content, a projection drive command is generated and sent to the B-pillar matrix projection lights of the target vehicle via the vehicle controller local area network bus, so that the B-pillar matrix projection lights execute the projection drive command.

2. The method according to claim 1, characterized in that, The step of determining the target interaction scenario from candidate interaction scenarios based on preset scenario priority rules, according to the movement trajectory data, the environmental perception data, and the current state data, includes: Based on the movement trajectory data, the environmental perception data, and the current state data, determine whether the triggering conditions corresponding to the candidate interaction scenario are met. Based on the preset scenario priority rules, candidate interaction scenarios that meet the triggering conditions are prioritized, and the candidate interaction scenario with the highest priority is taken as the target interaction scenario. The preset scenario priority rule is as follows: the priority of the safety warning scenario is higher than that of the status indication scenario, and the priority of the status indication scenario is higher than that of the welcoming scenario.

3. The method according to claim 2, characterized in that, The step of determining whether the triggering conditions corresponding to the candidate interaction scenario are met based on the movement trajectory data, the environmental perception data, and the current state data includes at least one of the following: If, based on the movement trajectory data, it is determined that the target authorized user is within a preset distance range and the azimuth angle is directly facing the B-pillar area of ​​the target vehicle, then the welcoming scene triggering conditions are met. If, based on the environmental perception data and the current state data, it is determined that there is a moving target in the area behind the target vehicle and the target vehicle is in the open door state, then the safety warning scenario triggering conditions are met. If, based on the current status data, it is determined that the target vehicle is in a charging connection state, then the status indication scenario triggering condition is met.

4. The method according to claim 1, characterized in that, The process of determining the target projection content based on the mapping relationship between candidate interaction scenarios and projection content templates, according to the target interaction scenario, includes: If the target interactive scene is a welcoming scene, then the welcoming scene content template is called to generate projection content containing dynamic welcoming light carpet graphics and personalized information. If the target interaction scenario is a security warning scenario, then the security warning scenario content template is called to generate projection content containing high-contrast warning icons and dynamic text prompts; If the target interaction scenario is a status indication scenario, then the status indication scenario content template is invoked to generate projection content containing a battery status icon, a battery percentage number, a charging progress bar, and remaining time text.

5. The method according to claim 1, characterized in that, The projection driving command is used for the following: The projection driving command is parsed by the driving chip inside the B-pillar matrix projection lamp to obtain dot matrix data, brightness parameters, timing parameters and geometric correction parameters. The driving chip inside the B-pillar matrix projection lamp generates a row scanning signal based on the timing parameters, generates a column data signal based on the dot matrix data and the brightness parameters, and drives the matrix light-emitting diode array to scan based on the row scanning signal and the column data signal to obtain an initial optical image. The optical module within the B-pillar matrix projection lamp performs trapezoidal distortion correction and focal length adjustment on the optical path of the initial optical image according to the geometric correction parameters, and projects the processed beam onto the ground to form a projected image.

6. The method according to claim 1, characterized in that, Before acquiring the movement trajectory data of the target authorized user, the environmental perception data of the area behind and to the side of the target vehicle, and the current state data of the target vehicle, the method further includes: If the target vehicle is detected to be unlocked or if an authorized device carrying an ultra-wideband tag is detected to be within a preset distance range by an ultra-wideband locator installed on the B-pillar of the target vehicle, the target vehicle is controlled to enter working mode from sleep mode.

7. An external interactive projection control device, characterized in that, include: The data acquisition module is used to acquire the movement trajectory data of the target authorized user, the environmental perception data of the area to the side and rear of the target vehicle, and the current status data of the target vehicle. The target interaction scenario determination module is used to determine the target interaction scenario from candidate interaction scenarios based on preset scenario priority rules, the movement trajectory data, the environmental perception data, and the current state data; wherein, the candidate interaction scenarios include at least a welcoming scenario, a security warning scenario, and a status indication scenario; The target projection content determination module is used to determine the target projection content based on the mapping relationship between candidate interaction scenarios and projection content templates, according to the target interaction scenario. The projection instruction execution module is used to generate a projection drive instruction based on the target projection content, and send the projection drive instruction to the B-pillar matrix projection light of the target vehicle through the vehicle controller local area network bus, so that the B-pillar matrix projection light executes the projection drive instruction.

8. An electronic device, characterized in that, include: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the vehicle exterior interactive projection control method as described in any one of claims 1-6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the vehicle exterior interactive projection control method as described in any one of claims 1-6.

10. A computer program product comprising a computer program that, when executed by a processor, implements the vehicle exterior interactive projection control method according to any one of claims 1-6.

Images