A holographic projection control method and device, a storage medium and a vehicle

Abstract

This application provides a holographic projection control method, device, storage medium, and vehicle, belonging to the field of vehicle control technology. The embodiments of this application, by acquiring the window height, door opening, and / or other vehicle position information on both sides of the cockpit, can determine a target adjustment strategy for either side of the cockpit based on that side's window height, door opening, and / or position information, and then adjust the holographic projection image on that side according to the target adjustment strategy. By comprehensively considering the influence of windows, doors, and other vehicles on the holographic projection image, this application can achieve adaptive adjustment of the holographic projection image, thereby ensuring that users can effectively observe the holographic projection image in various scenarios and effectively improving the user's observation experience.

Description

Technical Field

[0001] This application relates to the field of vehicle control technology, and in particular to a holographic projection control method, device, storage medium, and vehicle. Background Technology

[0002] Traditional rearview mirrors are located outside the vehicle. Although some vehicles are equipped with an automatic folding function after the engine is turned off, they still have many drawbacks, such as: they are still easy to scratch when passing other vehicles or parking, and the mirror surface becomes dirty in rainy or snowy weather, making it difficult for users to see the contents of the mirror while driving, thus creating safety hazards.

[0003] With the development of vehicle intelligence, some vehicles are equipped with holographic projection devices to replace traditional rearview mirrors. Holographic projection devices are usually placed in the position of the exterior rearview mirrors. By collecting video data from both sides of the vehicle, they project holographic images onto the rearview mirrors to provide real-time feedback on the field of vision behind the vehicle.

[0004] However, the relevant technologies usually project holographic images onto a fixed area relative to the car door, making it impossible to adjust the projection of the holographic images, resulting in a poor viewing experience for users. Summary of the Invention

[0005] This application provides a holographic projection control method, device, storage medium, and vehicle to solve the problem that related technologies cannot adjust holographic projection images, resulting in a poor user viewing experience.

[0006] To solve the above problems, this application adopts the following technical solution: In a first aspect, embodiments of this application provide a holographic projection control method, the method comprising: Obtain information on the height of the windows on both sides of the cockpit, the opening of the doors, and / or the position of other vehicles; For any one of the two sides of the cockpit, a target adjustment strategy is determined based on the window height, door opening and / or position information of that side. According to the target adjustment strategy, the holographic projection image on that side is adjusted; the holographic projection image is an image projected onto the outside of the door on that side and used to present the rear view on that side.

[0007] In one embodiment of this application, the step of determining a target adjustment strategy for a particular side based on the door opening degree and / or position information includes: Based on the location information of the other vehicles, determine the intervention distance of the other vehicles entering the holographic projection image on this side; Based on the intervention distance and the door opening, a target adjustment strategy for that side is determined.

[0008] In one embodiment of this application, the step of determining the target adjustment strategy on that side based on the intervention distance and the door opening includes: If the intervention distance is greater than a first distance threshold, the target adjustment strategy on that side is determined to be the first adjustment strategy; the first adjustment strategy is used to indicate the reduction and / or movement of the holographic projection image; If the intervention distance is less than or equal to the first distance threshold and the door opening is greater than the first opening threshold, the target adjustment strategy on that side is determined to be the second adjustment strategy; the second adjustment strategy is used to indicate magnification and / or movement of the holographic projection image.

[0009] In one embodiment of this application, the first adjustment strategy includes a first adjustment sub-strategy and a first in-vehicle projection sub-strategy; the step of determining the target adjustment strategy on that side as the first adjustment strategy when the intervention distance is greater than the first distance threshold includes: When the intervention distance is greater than the first distance threshold and less than the second distance threshold, the target adjustment strategy on that side is determined to be the first adjustment sub-strategy; the first adjustment sub-strategy is used to indicate that the holographic projection image is reduced by a first preset factor and moved a first preset distance toward the vehicle body, the first preset factor and the first preset distance increase with the increase of the intervention distance; If the intervention distance is greater than or equal to the second distance threshold, the target adjustment strategy for that side is determined to be the first in-vehicle projection sub-strategy; the first in-vehicle projection sub-strategy is used to indicate that the holographic projection image is projected onto the first preset projection area inside the door.

[0010] In one embodiment of this application, the second adjustment strategy includes a second adjustment sub-strategy and a second in-vehicle projection sub-strategy; the step of determining the target adjustment strategy on this side as the second adjustment strategy when the intervention distance is less than or equal to the first distance threshold and the door opening is greater than the first opening threshold includes: When the door opening is greater than the first opening threshold and less than the second opening threshold, the target adjustment strategy for that side is determined to be the second adjustment sub-strategy; the second adjustment sub-strategy is used to indicate that the holographic projection image is magnified by a second preset factor and moved a second preset distance toward the vehicle body, the second preset factor and the second preset distance increase with the increase of the door opening; If the door opening is greater than or equal to the second opening threshold, the target adjustment strategy for that side is determined to be the second in-vehicle projection sub-strategy; the second in-vehicle projection sub-strategy is used to indicate that the holographic projection image is projected onto the second preset projection area inside the door.

[0011] In one embodiment of this application, the step of determining a target adjustment strategy for a particular side based on the height of that side window includes: If the height of the window on that side is less than the corresponding height threshold on that side, the target adjustment strategy is determined to be the third adjustment strategy; the third adjustment strategy is used to indicate a reduction in the brightness of the holographic projection image on that side.

[0012] In one embodiment of this application, the method further includes: Determine the driver's eye coordinates; For either side of the cockpit, based on the eye coordinates and the imaging coordinates of the holographic projection image of that side, the coordinates of the intersection point of the line connecting the eye coordinates and the imaging coordinates with the window are determined; and based on the intersection point coordinates, the corresponding height threshold for that side is determined.

[0013] Secondly, based on the same inventive concept, embodiments of this application provide a holographic projection control device, the device comprising: The acquisition module is used to acquire the window height, door opening and / or other vehicle position information on both sides of the cockpit; The determination module is used to determine the target adjustment strategy for any one of the two sides of the cockpit based on the window height, door opening and / or position information of that side. The adjustment module is used to adjust the holographic projection image on that side according to the target adjustment strategy; the holographic projection image is an image projected onto the outside of the door on that side and used to present the rear view on that side.

[0014] In one embodiment of this application, the determining module includes: The intervention distance determination submodule is used to determine the intervention distance of the other vehicles entering the holographic projection image on this side based on the location information of the other vehicles; The adjustment strategy determination submodule is used to determine the target adjustment strategy for this side based on the intervention distance and the door opening.

[0015] In one embodiment of this application, the adjustment strategy determination submodule includes: The first strategy determination unit is used to determine the target adjustment strategy on this side as the first adjustment strategy when the intervention distance is greater than the first distance threshold; the first adjustment strategy is used to indicate the reduction and / or movement of the holographic projection image; The second strategy determination unit is used to determine the target adjustment strategy on this side as the second adjustment strategy when the intervention distance is less than or equal to the first distance threshold and the door opening is greater than the first opening threshold; the second adjustment strategy is used to indicate the magnification and / or movement of the holographic projection image.

[0016] In one embodiment of this application, the first strategy determination unit includes: The first strategy determination subunit is used to determine the target adjustment strategy on this side as the first adjustment sub-strategy when the intervention distance is greater than the first distance threshold and less than the second distance threshold; the first adjustment sub-strategy is used to indicate that the holographic projection image is reduced by a first preset factor and moved a first preset distance toward the vehicle body, wherein the first preset factor and the first preset distance increase with the increase of the intervention distance; The second strategy determination subunit is used to determine the target adjustment strategy on this side as the first in-vehicle projection sub-strategy when the intervention distance is greater than or equal to the second distance threshold; the first in-vehicle projection sub-strategy is used to indicate that the holographic projection image is projected onto the first preset projection area on the inside of the door.

[0017] In one embodiment of this application, the second strategy determination unit includes: The third strategy determination subunit is used to determine the target adjustment strategy on this side as the second adjustment sub-strategy when the door opening is greater than the first opening threshold and less than the second opening threshold. The second adjustment sub-strategy is used to indicate that the holographic projection image is magnified by a second preset factor and moved a second preset distance toward the vehicle body. The second preset factor and the second preset distance increase as the door opening increases. The fourth strategy determination subunit is used to determine the target adjustment strategy for that side as the second in-vehicle projection sub-strategy when the door opening is greater than or equal to the second opening threshold; the second in-vehicle projection sub-strategy is used to indicate that the holographic projection image is projected onto the second preset projection area inside the door.

[0018] In one embodiment of this application, the determining module further includes: The third strategy determination submodule is used to determine the target adjustment strategy as the third adjustment strategy when the height of the window on this side is less than the corresponding height threshold on this side; the third adjustment strategy is used to indicate the reduction of the brightness of the holographic projection image on this side.

[0019] In one embodiment of this application, the holographic projection control device further includes: The eye coordinate determination module is used to determine the driver's eye coordinates; The height threshold determination module is used to determine the coordinates of the intersection point of the line connecting the eye coordinates and the imaging coordinates with the window for any one side of the cockpit, based on the eye coordinates and the imaging coordinates of the holographic projection image of that side; and to determine the corresponding height threshold for that side based on the intersection point coordinates.

[0020] Thirdly, based on the same inventive concept, embodiments of this application provide a storage medium storing machine-executable instructions, which, when executed by a processor, implement the holographic projection control method proposed in the first aspect of this application.

[0021] Fourthly, based on the same inventive concept, embodiments of this application provide a vehicle including a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the holographic projection control method proposed in the first aspect of this application.

[0022] Compared with the prior art, this application has the following advantages: This application provides a holographic projection control method that, by acquiring the window height, door opening, and / or other vehicle position information on both sides of the cockpit, can determine a target adjustment strategy for either side of the cockpit based on that side's window height, door opening, and / or position information. Then, the holographic projection image on that side is adjusted according to the target adjustment strategy. This application embodiment, by comprehensively considering the influence of windows, doors, and other vehicles on the holographic projection image, can achieve adaptive adjustment of the holographic projection image, thereby ensuring that users can effectively observe the holographic projection image in various scenarios and effectively improving the user's viewing experience. Attached Figure Description

[0023] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 This is a flowchart of the steps of a holographic projection control method in one embodiment of this application.

[0025] Figure 2 This is a schematic diagram illustrating the interference of other vehicles with the left-side holographic projection image in one embodiment of this application.

[0026] Figure 3 This is a schematic diagram of the functional modules of a holographic projection control device according to an embodiment of this application.

[0027] Figure 4 This is a structural schematic diagram of a vehicle according to one embodiment of this application. Detailed Implementation

[0028] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0029] It should be noted that the working principle of the holographic projection device is as follows: the external camera collects video data from both sides of the vehicle and transmits it to the controller. After the controller analyzes and processes the video data, it obtains the projection data and transmits the projection data to the projection mechanism for projection. Finally, the corresponding holographic projection image is presented at the rearview mirror position.

[0030] In related technologies, the imaging effect of holographic projection images is usually processed, such as image distortion processing and illumination processing. After generating the holographic projection image, it is usually projected onto an area that is fixed relative to the car door.

[0031] The inventors of this application have discovered that, in certain specific scenarios, drivers cannot effectively observe holographic projection images in vehicles. For example, lowering the window height causes the driver to look directly at the holographic projection image, resulting in glare; or, after the door is opened, the distance between the holographic projection image and the user increases, adversely affecting the observation effect; or, when other vehicles are too close to the holographic projection image of this vehicle, they interfere with the holographic imaging effect, preventing the driver from observing the complete rearview mirror content.

[0032] To address the issue that related technologies cannot automatically adjust holographic projection images, resulting in a poor user viewing experience, this application aims to provide a holographic projection control method. By comprehensively considering the influence of car windows, doors, and other vehicles on the holographic projection image, it can achieve adaptive adjustment of the holographic projection image, thereby ensuring that users can effectively observe the holographic projection image in various scenarios and effectively improve the user viewing experience.

[0033] Reference Figure 1 This application illustrates a holographic projection control method, which may include the following steps: S101: Obtain information on the height of the windows on both sides of the cockpit, the opening of the doors, and / or the position of other vehicles.

[0034] It should be noted that the executing entity in this embodiment can be a computing service device with data processing, network communication, and program execution functions, or an electronic device with the above functions such as an ECU (Electronic Control Unit), a BCM (Body Control Module), or a VCU (Vehicle Control Unit). This embodiment will use a VCU as the executing entity for explanation. It should also be noted that this embodiment does not impose specific limitations on the executing entity of the vehicle.

[0035] In this embodiment, the VCU will automatically activate the holographic projection function when it detects that the vehicle meets preset holographic projection conditions, thereby controlling the automatic opening of the holographic projections on both sides of the cockpit. The holographic projection conditions can be: the vehicle is unlocked, any door is open, and someone is inside the vehicle. In other words, after the user unlocks the vehicle and enters, the VCU will automatically activate the holographic projection function to generate holographic projection images in real time at the rearview mirror positions on both sides of the cockpit, thus conveniently and quickly providing the driver or passengers with a view of the rear of the vehicle and reducing user operation. It should be noted that the VCU will automatically deactivate the holographic projection function when it detects that the vehicle meets preset projection deactivation conditions. These conditions can be: the vehicle is locked or no one is inside the vehicle.

[0036] In this embodiment, after the VCU detects that the holographic projection function has been successfully activated, it will acquire the window height, door opening and / or other vehicle position information on both sides of the cockpit to determine whether the holographic projection images on both sides of the cockpit need to be adjusted.

[0037] S102: For either side of the cockpit, determine the target adjustment strategy for that side based on the window height, door opening and / or position information of that side.

[0038] It should be noted that the two sides of the cockpit refer to the driver's left and right sides, respectively. That is, after the VCU detects that the holographic projection function has been successfully activated, it will acquire the corresponding window height, door opening, and / or other vehicle position information for the left and right sides of the cockpit, respectively, to make targeted adjustments to the holographic projection images on both sides of the cockpit, so that the driver can effectively observe the holographic projection images on both sides of the cockpit. This implementation will describe the adjustment strategy for one side only; it should be noted that the other side uses the same adjustment strategy, and its specific implementation will not be described again.

[0039] In this embodiment, for either the left or right side of the cockpit, the VCU will analyze and process the window height, door opening, and / or other vehicle position information on that side to determine the current scene of the vehicle. For example, whether the window obstructs the driver's view, whether the door is open, or whether other vehicles will affect the holographic projection image of the vehicle. Then, based on the current scene of the vehicle, a corresponding target adjustment strategy is matched to specifically eliminate or reduce the impact of windows, doors, and other vehicles on the observation effect of the holographic projection image.

[0040] S103: Adjust the holographic projection image on this side according to the target adjustment strategy.

[0041] It should be noted that the holographic projection image is an image projected outside the car door to present the rear view, specifically including a left holographic projection image for presenting the left rear view and a right holographic projection image for presenting the right rear view.

[0042] In this embodiment, after determining the target adjustment strategies corresponding to the left and right sides of the cockpit, the VCU will generate a first adjustment signal for the left holographic projection image and a second adjustment signal for the right holographic projection image. The first adjustment signal is then sent to the first holographic projection device located on the left side, causing the first holographic projection device to adjust the left holographic projection image in response to the first adjustment signal; and the second adjustment signal is sent to the second holographic projection device located on the right side, causing the second holographic projection device to adjust the right holographic projection image in response to the second adjustment signal.

[0043] In practical implementation, the holographic projection image can be adjusted by changing brightness, moving, and / or scaling. For example, if the window height is insufficient to obscure the holographic projection image, the brightness can be reduced. If a door is detected to be open, the holographic projection image will move away from the driver as the door moves; therefore, it can be adjusted by enlarging the image and / or moving it closer to the vehicle to allow the driver to better observe it. If other vehicles are detected to be too close to the holographic projection image, the image can be adjusted by shrinking it and / or moving it closer to the vehicle to prevent other vehicles from interfering with the holographic imaging effect.

[0044] This application embodiment, by comprehensively considering the influence of car windows, car doors and other vehicles on the holographic projection image, can achieve adaptive adjustment of the holographic projection image, thereby ensuring that users can effectively observe the holographic projection image in various scenarios and effectively improve the user's observation experience.

[0045] In one feasible implementation, the step of determining the target adjustment strategy for that side based on the door opening degree and / or position information in S102 may specifically include the following sub-steps: S102-1: Based on the location information of other vehicles, determine the intervention distance of other vehicles entering the holographic projection image on this side.

[0046] It should be noted that "other vehicles" refers to vehicles located on the left or right side of the vehicle, which can be one or more. Taking the left side of the cockpit as an example, the position information of other vehicles on the left side refers to the position information of at least one vehicle on the left side that is closest to the outline of the vehicle in the left holographic projection image.

[0047] In practical implementation, the vehicle closest to the holographic projection image among other vehicles can be identified as the target vehicle. Then, based on the target vehicle's position information, the intervention distance for other vehicles entering the holographic projection image on that side can be determined. The greater the intervention distance, the stronger the interference effect of other vehicles on the holographic projection image.

[0048] In this embodiment, refer to Figure 2 This diagram illustrates the interference of other vehicles with the left-side holographic projection image. "External vehicle" represents the target vehicle among the other vehicles, "image" represents the left-side holographic projection image, and the arrows indicate the interference distance of the external vehicle entering the left-side holographic projection image.

[0049] In the specific implementation, continue to refer to Figure 2 Taking the external vehicle as being to the left of the vehicle as an example, the horizontal relative distance L1 between the external vehicle and the left edge of the vehicle can first be detected by sensors installed outside the vehicle. The horizontal distance between the left edge of the left holographic projection image and the left edge of the vehicle can then be determined as a preset distance L0. This preset distance L0 is a known distance that is used by default when generating the holographic projection image. The intervention distance L = L0 - L1 can then be calculated. When L < 0, it indicates that the external vehicle has not entered the left holographic projection image; when L = 0, it indicates that the edge of the external vehicle coincides with the edge of the left holographic projection image; when L > 0, it indicates that the external vehicle has entered the left holographic projection image.

[0050] S102-2: Determine the target adjustment strategy for this side based on the intervention distance and door opening.

[0051] In this embodiment, by calculating the interference distance of other vehicles entering the holographic projection image on this side, the magnitude of the influence of other vehicles on the holographic projection image can be determined more accurately. Then, combined with the door opening, a suitable target adjustment strategy can be matched for the holographic projection images on both sides of the cockpit.

[0052] In one feasible implementation, S102-2 may specifically include the following sub-steps: S102-2-1: When the intervention distance is greater than the first distance threshold, the target adjustment strategy on that side is determined to be the first adjustment strategy.

[0053] It's important to note that opening a car door is generally a driver's voluntary act, and the door typically opens only when the vehicle is stationary. In static scenarios, the risk is low, and the impact on the driver is relatively minimal. External vehicle intervention, however, occurs in both static and dynamic scenarios. Dynamic scenarios, especially those involving driving, have a greater impact on driving safety. In these situations, the driver needs to constantly check the rearview mirror. Therefore, the impact of external vehicle intervention on the driver is usually greater than the impact of the door opening. In other words, when both door-related interference and external vehicle intervention are present, the intervention distance takes precedence over the door opening degree.

[0054] In this embodiment, considering that when the intervention distance is less than or equal to the first distance threshold, the interference of other vehicles on the holographic projection image of this vehicle is minimal and has virtually no impact on the driver's perception, the holographic projection image will not be adjusted and will remain unchanged if no door is open. Alternatively, if a door is open, the holographic projection image will be adjusted according to the subsequent second adjustment strategy. However, when the intervention distance is detected to be greater than the first distance threshold, other vehicles will affect the driver's perception of the holographic projection image. Therefore, to eliminate or reduce the impact of external vehicle interference, the VCU will adjust the holographic projection image according to the first adjustment strategy regardless of whether a door is open. It should be noted that the first adjustment strategy is used to indicate the reduction and / or movement of the holographic projection image.

[0055] In this embodiment, considering that the greater the intervention distance, the greater the impact on the driver, different control logics are configured for different intervention distances. Specifically, the first adjustment strategy may include a first adjustment sub-strategy and a first in-vehicle projection sub-strategy.

[0056] In a specific implementation, if the intervention distance is greater than a first distance threshold but less than a second distance threshold, the target adjustment strategy for that side can be determined as the first adjustment sub-strategy. The first adjustment sub-strategy is used to instruct the holographic projection image to be reduced by a first preset factor and moved a first preset distance toward the vehicle body. The first preset factor and the first preset distance increase as the intervention distance increases.

[0057] For example, a third distance threshold can be set between the first and second distance thresholds, i.e., the first distance threshold < the third distance threshold < the second distance threshold; then, when the first distance threshold < the intervention distance ≤ the third distance threshold, the first preset multiplier is determined to be 0.3 times and the first preset distance is 0.5 cm; when the third distance threshold < the intervention distance < the second distance threshold, the first preset multiplier is determined to be 0.5 times and the first preset distance is 0.7 cm. It should be noted that more distance thresholds can be set between the first and second distance thresholds according to actual needs; this embodiment does not impose a specific limitation on the number of distance thresholds. In another example, a first linear mapping relationship between the intervention distance and a first preset multiple, and a second linear mapping relationship between the intervention distance and the first preset distance can be constructed respectively. Then, based on the current intervention distance, the corresponding target first preset multiple is matched through the first linear mapping relationship, and the corresponding target first preset distance is matched through the second linear mapping relationship. The holographic projection image is then scaled down according to the target first preset multiple, and moved according to the target first preset distance. By constructing linear mapping relationships between the intervention distance and the first preset multiple and the first preset distance respectively, appropriate first preset multiples and first preset distances can be matched more accurately, improving the driver's observation experience.

[0058] In a practical implementation, if the intervention distance is greater than or equal to a second distance threshold, the target adjustment strategy for that side can be determined as a first in-vehicle projection sub-strategy. The first in-vehicle projection sub-strategy is used to instruct the holographic projection image to be projected onto a first preset projection area on the inside of the vehicle door.

[0059] In this embodiment, considering that even shrinking and moving the holographic projection image will not achieve a good observation effect when the intervention distance is too large, the VCU will shut down the first or second holographic projection device located outside the vehicle when the intervention distance is ≥ the second distance threshold. Then, the holographic projection image will be projected onto the first preset projection area via the in-vehicle projection device located inside the vehicle, so that the driver can still obtain a rear view. Simultaneously, when automatically switching holographic projection images, the driver can be prompted via voice or instrument panel. The in-vehicle projection device can be located inside the door or in other locations within the driver's cabin. Correspondingly, the first preset projection area can be located inside the door or in other areas within the driver's cabin that are convenient for the driver to observe. Preferably, considering that the door is usually closed at this time, the first preset projection area can be set inside the door for easy driver observation.

[0060] S102-2-2: When the intervention distance is less than or equal to the first distance threshold and the door opening is greater than the first opening threshold, the target adjustment strategy on this side is determined to be the second adjustment strategy.

[0061] In this embodiment, when the intervention distance is less than or equal to a first distance threshold, the impact of the door opening needs to be considered. Specifically, considering that when the door opening is less than or equal to the first opening threshold, the door's interference with the holographic projection image is minimal and has virtually no impact on the driver's perception, the holographic projection image will not be adjusted and will remain unchanged. However, when the door opening is detected to be greater than the first opening threshold, the door will affect the driver's perception of the holographic projection image. Therefore, to eliminate or reduce the impact, the VCU will adjust the holographic projection image according to a second adjustment strategy. It should be noted that the first adjustment strategy is used to indicate magnification and / or movement of the holographic projection image.

[0062] In this embodiment, considering that the larger the door opening, the greater the impact on the driver, different control logic is configured for different door openings. Specifically, the second adjustment strategy may include a second adjustment sub-strategy and a second in-vehicle projection sub-strategy.

[0063] In a practical implementation, if the door opening is greater than a first opening threshold but less than a second opening threshold, the target adjustment strategy for that side can be determined as a second adjustment sub-strategy. The second adjustment sub-strategy is used to instruct the holographic projection image to be magnified by a second preset factor and moved a second preset distance toward the vehicle body. The second preset factor and the second preset distance increase as the door opening increases.

[0064] For example, a third opening threshold can be set between the first opening threshold and the second opening threshold, i.e., the first opening threshold < the third opening threshold < the second opening threshold; then, when the first opening threshold < the door opening ≤ the third distance threshold, the second preset multiple is determined to be 0.3 times and the second preset distance is 0.5 cm; when the third opening threshold < the door opening < the second distance threshold, the second preset multiple is determined to be 0.5 times and the second preset distance is 0.7 cm. It should be noted that more distance thresholds can be set between the first opening threshold and the second opening threshold according to actual needs, and this embodiment does not impose a specific limitation on the number of distance thresholds.

[0065] In another example, a third linear mapping relationship between the door opening and a second preset multiple, and a fourth linear mapping relationship between the door opening and a second preset distance can be constructed separately. Then, based on the current door opening, the corresponding target second preset multiple is matched using the third linear mapping relationship, and the corresponding target second preset distance is matched using the fourth linear mapping relationship. The holographic projection image is then magnified according to the target second preset multiple and moved according to the target second preset distance. By constructing linear mapping relationships between the door opening and the second preset multiple and the second preset distance separately, suitable second preset multiples and distances can be matched more accurately, improving the driver's viewing experience.

[0066] In a specific implementation, if the door opening is greater than or equal to the second opening threshold, the target adjustment strategy for that side can be determined as the second in-vehicle projection sub-strategy. The second in-vehicle projection sub-strategy is used to indicate that the holographic projection image is projected onto the second preset projection area inside the door.

[0067] In this embodiment, considering that even magnification and movement of the holographic projection image will not achieve a good observation effect when the door opening is too large, the VCU will shut down either the first or second holographic projection device located outside the vehicle when the door opening is ≥ the second opening threshold. Then, the holographic projection image will be projected onto the second preset projection area via the in-vehicle projection device located inside the vehicle, allowing the driver to still have a rear view. Simultaneously, when automatically switching holographic projection images, the driver can be prompted via voice or instrument panel. The in-vehicle projection device can be located inside the door or in other locations within the driver's cabin. Correspondingly, the second preset projection area can be located inside the door or in other areas within the driver's cabin that are convenient for the driver to observe. Preferably, considering that the door is currently open and projecting onto the inside of the door would affect the observation effect, the first preset projection area can be set in a position on the center console that does not interfere with the driver's operation, facilitating driver observation.

[0068] In one feasible implementation, the step of determining the target adjustment strategy for that side based on the window height on that side in S102 may specifically include the following sub-steps: S102-3: If the height of the window on this side is less than the corresponding height threshold on this side, the target adjustment strategy is determined to be the third adjustment strategy; the third adjustment strategy is used to indicate the reduction of the brightness of the holographic projection image on this side.

[0069] In this embodiment, considering that drivers usually view holographic projection images through the car window, and that lowering the car window causes the driver to look directly at the holographic projection image, resulting in glare, the VCU will monitor the height of the windows on both sides of the cockpit in real time to eliminate the impact of the car window on the driver's perception. If the window is detected to be closed or lowered to a certain height, the brightness of the holographic projection image will be automatically adjusted.

[0070] In the specific implementation, considering the difference in the driver's line of sight to the left and right holographic projection images, different height thresholds will be set for the windows on both sides of the cockpit. Specifically, a left-side height threshold will be set for the left window, and a right-side height threshold will be set for the right window. The height threshold corresponding to the window closer to the driver will be higher than the height threshold corresponding to the window farther from the driver. For example, with the cockpit located on the left side of the vehicle, the left-side height threshold for the left window will be higher than the right-side height threshold for the right window. It should be noted that window height refers to the distance from the upper edge of the window glass to the lower edge of the window.

[0071] In this embodiment, by monitoring the height of the windows on both sides of the cockpit, a third adjustment strategy can be automatically executed when the height of the window on that side is less than the corresponding height threshold. This automatically reduces the brightness of the holographic projection image, effectively eliminating the impact of the windows on the driver's perception and thus avoiding glare that could affect the driver's perception and driving safety.

[0072] It should be noted that the third adjustment strategy can be executed simultaneously with the first or second adjustment strategy. That is, when scaling and / or moving the holographic projection image, the brightness of the holographic projection image can be adjusted synchronously based on the height of the car window.

[0073] In one feasible implementation, the holographic projection control method may further include the following steps: S301: Determine the driver's eye coordinates.

[0074] In this embodiment, considering that the maximum window height at which drivers of different heights can directly view the holographic projection image is different for the same vehicle, the appropriate height threshold will be determined for drivers of different heights by identifying the driver's eye coordinates.

[0075] In practical implementation, an in-vehicle camera can be used to identify the driver's eyes. After identifying the driver's two eyes, a spatial coordinate system is established, and the coordinates of the driver's left eye (first eye) and right eye (second eye) are determined within this system. The midpoint of the line connecting the first and second eye coordinates is then used as the driver's eye coordinates. The spatial coordinate system is a pre-selected system with a preset origin and a preset direction.

[0076] S302: For either side of the cockpit, based on the eye coordinates and the imaging coordinates of the holographic projection image of that side, determine the coordinates of the intersection point between the line connecting the eye coordinates and the imaging coordinates and the window; and based on the intersection point coordinates, determine the corresponding height threshold for that side.

[0077] In this embodiment, since the imaging coordinates of the holographic projection images on both sides of the cockpit and the position information of the window plane are known quantities in the spatial coordinate system, after determining the driver's eye coordinates, the eye coordinates and imaging coordinates can be connected to obtain a connecting line. The intersection point of this connecting line with the car window and the coordinate information of this intersection point can then be obtained. Finally, based on the coordinates of the intersection point, the vertical distance from the lower edge of the window is calculated, and this vertical distance is the corresponding height threshold. It should be noted that the imaging coordinates of the holographic projection image can be selected from the coordinates of the center point of the holographic projection image. For example, when the holographic projection image is rectangular, the imaging coordinates can be calculated using the coordinates of the four vertices of the holographic projection image; when the holographic projection image is circular, the imaging coordinates are the coordinates of the center of the holographic projection image.

[0078] In this embodiment, by calculating the intersection of the human eye's line of sight and the vehicle window, the height thresholds on both sides of the cockpit can be accurately obtained, thereby meeting the brightness adjustment needs of drivers of different heights, making it more intelligent and user-friendly.

[0079] In one feasible implementation, the holographic projection control method may further include the following steps: S401: In response to an adjustment command triggered by the pilot for either side of the cockpit, adjust the holographic projection image on that side.

[0080] In this embodiment, the driver can also actively control the opening and closing of the holographic projection image via voice or the vehicle's infotainment display screen; at the same time, the driver can also actively adjust the projection parameters of the holographic projection image, which may include, but are not limited to, magnification factor, reduction factor, elevation factor, descent factor, left shift factor, and right shift factor. In other words, the driver can actively adjust the magnification and reduction imaging effect of the holographic projection image as well as the elevation, descent, left shift, and right shift imaging position.

[0081] In this embodiment, after the driver adjusts the projection parameters of the holographic projection image, the VCU records the current projection parameters of the holographic projection images on both sides of the cockpit. Then, after the holographic projection image is automatically turned off or actively turned off by the driver, the VCU stores the driver's corresponding current projection parameters. Thus, when the holographic projection function is restarted, suitable holographic projection parameters can be matched for the driver, avoiding the need for the driver to readjust the projection parameters.

[0082] In this embodiment, in order to enable the same vehicle to meet the brightness adjustment needs of different drivers, when each driver uses the holographic projection function for the first time, the driver's biometric information will be identified to record the driver's corresponding identity, and the identity will be associated with the driver's corresponding holographic projection parameters, so that the holographic projection parameters corresponding to each driver can be independent of each other and do not affect each other.

[0083] It should be noted that biometric information can be voice information, fingerprint information, facial recognition information and / or iris recognition information, and each driver's biometric information corresponds to a unique identity.

[0084] For example, during a family road trip, driver A initially takes the lead. After recognizing driver A, the VCU automatically adjusts the parameters of the holographic projection image to holographic projection parameter A. After a period of driving, driver B takes the lead. At this point, the VCU obtains the current driver's biometric information and detects that the current driver has changed to driver B. It then automatically adjusts the parameters of the holographic projection image from holographic projection parameter A to the holographic projection parameter B corresponding to driver B.

[0085] Secondly, based on the same inventive concept, and referring to... Figure 3 This application provides a holographic projection control device 300, which includes: The acquisition module 301 is used to acquire the window height, door opening and / or other vehicle position information on both sides of the cockpit.

[0086] The determination module 302 is used to determine a target adjustment strategy for either side of the cockpit based on the window height, door opening and / or position information of that side.

[0087] The adjustment module 303 is used to adjust the holographic projection image on that side according to the target adjustment strategy; the holographic projection image is an image projected onto the outside of the door on that side and used to present the rear view on that side.

[0088] In one embodiment of this application, the determining module 302 includes: The intervention distance determination submodule is used to determine the intervention distance of other vehicles entering the holographic projection image on this side based on the location information of other vehicles.

[0089] The adjustment strategy determination submodule is used to determine the target adjustment strategy for this side based on the intervention distance and door opening.

[0090] In one embodiment of this application, the adjustment strategy determination submodule includes: The first strategy determination unit is used to determine the target adjustment strategy on this side as the first adjustment strategy when the intervention distance is greater than the first distance threshold; the first adjustment strategy is used to indicate the reduction and / or movement of the holographic projection image.

[0091] The second strategy determination unit is used to determine the target adjustment strategy on this side as the second adjustment strategy when the intervention distance is less than or equal to the first distance threshold and the door opening is greater than the first opening threshold; the second adjustment strategy is used to indicate the magnification and / or movement of the holographic projection image.

[0092] In one embodiment of this application, the first strategy determination unit includes: The first strategy determination sub-unit is used to determine the target adjustment strategy on that side as the first adjustment sub-strategy when the intervention distance is greater than a first distance threshold and less than a second distance threshold. The first adjustment sub-strategy is used to instruct the holographic projection image to be reduced by a first preset factor and moved a first preset distance toward the vehicle body. The first preset factor and the first preset distance increase with the increase of the intervention distance.

[0093] The second strategy determination subunit is used to determine the target adjustment strategy on this side as the first in-vehicle projection sub-strategy when the intervention distance is greater than or equal to the second distance threshold; the first in-vehicle projection sub-strategy is used to indicate that the holographic projection image is projected onto the first preset projection area on the inside of the door.

[0094] In one embodiment of this application, the second strategy determination unit includes: The third strategy determination subunit is used to determine the target adjustment strategy for that side as the second adjustment sub-strategy when the door opening is greater than a first opening threshold and less than a second opening threshold. The second adjustment sub-strategy is used to instruct the holographic projection image to be magnified by a second preset factor and moved a second preset distance toward the vehicle body. The second preset factor and the second preset distance increase as the door opening increases.

[0095] The fourth strategy determination subunit is used to determine the target adjustment strategy for this side as the second in-vehicle projection sub-strategy when the door opening is greater than or equal to the second opening threshold. The second in-vehicle projection sub-strategy is used to indicate that the holographic projection image is projected onto the second preset projection area inside the door.

[0096] In one embodiment of this application, the determining module 302 further includes: The third strategy determination submodule is used to determine the target adjustment strategy as the third adjustment strategy when the height of the window on this side is less than the corresponding height threshold on this side; the third adjustment strategy is used to indicate the reduction of the brightness of the holographic projection image on this side.

[0097] In one embodiment of this application, the holographic projection control device 300 further includes: The eye coordinate determination module is used to determine the driver's eye coordinates.

[0098] The height threshold determination module is used to determine the coordinates of the intersection point between the line connecting the eye coordinates and the imaging coordinates and the window, based on the eye coordinates and the imaging coordinates of the holographic projection image of that side, for any one side of the cockpit; and to determine the corresponding height threshold for that side based on the intersection point coordinates.

[0099] It should be noted that the specific implementation of the holographic projection control device 300 in this application embodiment refers to the specific implementation of the holographic projection control method proposed in the first aspect of the above-mentioned application embodiment, and will not be repeated here.

[0100] Thirdly, based on the same inventive concept, embodiments of this application provide a storage medium storing machine-executable instructions, which, when executed by a processor, implement the holographic projection control method proposed in the first aspect of this application.

[0101] It should be noted that the specific implementation of the storage medium in the embodiments of this application refers to the specific implementation of the holographic projection control method proposed in the first aspect of this application, and will not be repeated here.

[0102] Fourthly, based on the same inventive concept, referring to Figure 4 This application provides a vehicle 400, which includes a processor 401 and a memory 402. The memory 402 stores machine-executable instructions that can be executed by the processor 401. The processor 401 is used to execute the machine-executable instructions to implement the holographic projection control method proposed in the first aspect of this application.

[0103] It should be noted that the specific implementation of the vehicle 400 in this application embodiment refers to the specific implementation of the holographic projection control method proposed in the first aspect of this application, and will not be repeated here.

[0104] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, apparatus, or computer program products. Therefore, embodiments of the present invention can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, embodiments of the present invention can take the form of computer program products implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0105] Embodiments of the present invention are described with reference to flowchart illustrations and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0106] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0107] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal equipment, causing a series of operational steps to be performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable terminal equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0108] Although preferred embodiments of the present invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of the embodiments of the present invention.

[0109] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes the element.

[0110] The above provides a detailed description of the holographic projection control method, device, storage medium, and vehicle provided by the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A holographic projection control method, characterized in that, The method includes: Acquire information on the height of the windows on both sides of the cockpit, the opening of the doors, and the position of other vehicles; For any one of the two sides of the cockpit, a target adjustment strategy is determined based on the window height, door opening and position information of that side. The holographic projection image on that side is adjusted according to the target adjustment strategy. The step of determining the target adjustment strategy for that side based on the window height includes: Determine the driver's eye coordinates; For either side of the cockpit, based on the eye coordinates and the imaging coordinates of the holographic projection image of that side, determine the coordinates of the intersection point between the line connecting the eye coordinates and the imaging coordinates and the window; and based on the intersection point coordinates, determine the corresponding height threshold for that side. If the height of the window on that side is less than the height threshold corresponding to that side, the target adjustment strategy is determined to be the third adjustment strategy; the third adjustment strategy is used to indicate a reduction in the brightness of the holographic projection image on that side; The steps for determining the target adjustment strategy for that side based on the door opening and position information include: Based on the location information of the other vehicles, determine the intervention distance of the other vehicles entering the holographic projection image on this side; Based on the intervention distance and the door opening, determine the target adjustment strategy for this side; The step of determining the target adjustment strategy on this side based on the intervention distance and the door opening includes: If the intervention distance is greater than a first distance threshold, the target adjustment strategy on that side is determined to be the first adjustment strategy; the first adjustment strategy is used to indicate the reduction and / or movement of the holographic projection image; If the intervention distance is less than or equal to the first distance threshold and the door opening is greater than the first opening threshold, the target adjustment strategy on that side is determined to be the second adjustment strategy; the second adjustment strategy is used to indicate magnification and / or movement of the holographic projection image.

2. The holographic projection control method according to claim 1, characterized in that, The first adjustment strategy includes a first adjustment sub-strategy and a first in-vehicle projection sub-strategy; The step of determining the target adjustment strategy on that side as the first adjustment strategy when the intervention distance is greater than the first distance threshold includes: When the intervention distance is greater than the first distance threshold and less than the second distance threshold, the target adjustment strategy on that side is determined to be the first adjustment sub-strategy; the first adjustment sub-strategy is used to indicate that the holographic projection image is reduced by a first preset factor and moved a first preset distance toward the vehicle body, the first preset factor and the first preset distance increase with the increase of the intervention distance; If the intervention distance is greater than or equal to the second distance threshold, the target adjustment strategy for that side is determined to be the first in-vehicle projection sub-strategy; the first in-vehicle projection sub-strategy is used to indicate that the holographic projection image is projected onto the first preset projection area inside the door.

3. The holographic projection control method according to claim 1, characterized in that, The second adjustment strategy includes a second adjustment sub-strategy and a second in-vehicle projection sub-strategy; the step of determining the target adjustment strategy for this side as the second adjustment strategy when the intervention distance is less than or equal to the first distance threshold and the door opening is greater than the first opening threshold includes: When the door opening is greater than the first opening threshold and less than the second opening threshold, the target adjustment strategy for that side is determined to be the second adjustment sub-strategy; the second adjustment sub-strategy is used to indicate that the holographic projection image is magnified by a second preset factor and moved a second preset distance toward the vehicle body, the second preset factor and the second preset distance increase with the increase of the door opening; If the door opening is greater than or equal to the second opening threshold, the target adjustment strategy for that side is determined to be the second in-vehicle projection sub-strategy; the second in-vehicle projection sub-strategy is used to indicate that the holographic projection image is projected onto the second preset projection area inside the door.

4. A holographic projection control device, characterized in that, The device includes: The acquisition module is used to acquire the window height, door opening, and other vehicle position information on both sides of the cockpit. The determination module is used to determine the target adjustment strategy for either side of the cockpit based on the window height, door opening and position information of that side. The adjustment module is used to adjust the holographic projection image on this side according to the target adjustment strategy; The determining module further includes: The third strategy determination submodule is used to determine the target adjustment strategy as the third adjustment strategy when the height of the window on this side is less than the corresponding height threshold on this side; the third adjustment strategy is used to indicate the reduction of the brightness of the holographic projection image on this side; The holographic projection control device also includes: The eye coordinate determination module is used to determine the driver's eye coordinates; The height threshold determination module is used to determine the coordinates of the intersection point between the line connecting the eye coordinates and the imaging coordinates of the holographic projection image on either side of the cockpit and the window, based on the eye coordinates and the imaging coordinates of the holographic projection image on that side; and to determine the corresponding height threshold on that side based on the intersection point coordinates. The determining module includes: The intervention distance determination submodule is used to determine the intervention distance of the other vehicles entering the holographic projection image on this side based on the location information of the other vehicles; The adjustment strategy determination submodule is used to determine the target adjustment strategy for this side based on the intervention distance and the door opening. The adjustment strategy determination submodule includes: The first strategy determination unit is used to determine the target adjustment strategy on this side as the first adjustment strategy when the intervention distance is greater than the first distance threshold; the first adjustment strategy is used to indicate the reduction and / or movement of the holographic projection image; The second strategy determination unit is used to determine the target adjustment strategy on this side as the second adjustment strategy when the intervention distance is less than or equal to the first distance threshold and the door opening is greater than the first opening threshold; the second adjustment strategy is used to indicate the magnification and / or movement of the holographic projection image.

5. A storage medium, characterized in that, The storage medium stores machine-executable instructions, which, when executed by a processor, implement the holographic projection control method as described in any one of claims 1-3.

6. A vehicle, characterized in that, It includes a processor and a memory, the memory storing machine-executable instructions that can be executed by the processor, the processor executing the machine-executable instructions to implement the holographic projection control method as described in any one of claims 1-3.

Images