A vehicle a-pillar see-through display method, device and storage medium
Patent Information
- Application Number
- CN202410356254.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-27
- Publication Date
- 2026-09-11
- Estimated Expiration
- 2044-03-27
AI Technical Summary
[0003]本发明的主要目的是提供一种车辆A柱透视显示方法、装置及存储介质,旨在解决现有技术中驾驶员眼睛视野范围较小并且显示屏固定于A柱而导致驾驶员的眼睛无法有效聚焦于显示屏的技术问题
[0014]Unlike existing technologies, this application provides a method for providing perspective display of a vehicle's A-pillar. First, the driver's line of sight is obtained. Then, a target display device is determined from a first display device and a second display device based on the driver's line of sight. Next, it is determined whether the target display device is at the driver's optimal viewing position based on the driver's line of sight. If the target display device is not at the driver's optimal viewing position, but its adjustment range can cover the optimal viewing position, the target display device is moved to the optimal viewing position and an image of the A-pillar blind spot is displayed. In other words, when the driver observes the A-pillar blind spot scene, the position of the target display device can be adjusted according to the driver's line of sight to adapt to different drivers' eye focusing ranges. This caters to the usage needs of different drivers and improves the perspective display effect of the vehicle's A-pillar.
Smart Images

Figure CN118046834B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of automotive auxiliary technology, specifically to a method, device, and storage medium for a vehicle A-pillar perspective display. Background Technology
[0002] The A-pillar is the pillar between the windshield and the front door of a vehicle. The A-pillar provides greater stability and rigidity to the vehicle body, playing a crucial role in protecting the safety of passengers. However, its presence also creates a blind spot, posing a safety hazard. Currently, a perspective effect is typically achieved by projecting the external scene onto a display screen on the A-pillar, thus expanding the driver's field of vision. However, for drivers with eye conditions that result in a narrow field of vision, even with the external scene projected onto the A-pillar display screen, their eyes cannot effectively focus on the screen due to their limited field of vision and the screen's fixed position on the A-pillar. This leads to a poor perspective display effect, failing to meet the needs of different users. Summary of the Invention
[0003] The main objective of this invention is to provide a method, device, and storage medium for vehicle A-pillar perspective display, aiming to solve the technical problem in the prior art where the driver's field of vision is small and the display screen is fixed to the A-pillar, causing the driver's eyes to be unable to effectively focus on the display screen.
[0004] To achieve the above objectives, in a first aspect, this application provides a method for displaying a vehicle's A-pillar through perspective, applied to a vehicle. The vehicle includes a first A-pillar, a second A-pillar, a first display device disposed on the first A-pillar, and a second display device disposed on the second A-pillar. Both the first and second display devices are adjustable. The method includes: Obtain the driver's line of sight; The target display device is determined from the first display device and the second display device according to the driver's line of sight, wherein the target display device is the display device on the A-pillar corresponding to the driver's line of sight. Determine whether the target display device is in the driver's optimal viewing position based on the driver's line of sight. If it is determined that the target display device is not in the driver's optimal viewing position, it is then determined whether the adjustment range of the target display device can cover the optimal viewing position. Determine that the adjustment range of the target display device can cover the optimal viewing position, control the target display device to move to the optimal viewing position and display the A-pillar blind spot scene image.
[0005] Furthermore, after determining whether the adjustment range of the target display device can cover the optimal viewing angle position, the method further includes: If the adjustment range of the target display device is determined to be insufficient to cover the optimal viewing position, a perspective image of the A-pillar blind spot scene is displayed at the optimal viewing position using virtual reality technology.
[0006] Furthermore, the vehicle also includes a first camera device and a second camera device mounted on the rearview mirror. Controlling the target display device to move to the optimal viewing position and display the A-pillar blind spot scene image includes: The target camera is determined from the first camera and the second camera based on the driver's line of sight, wherein the target camera is the camera on the rearview mirror corresponding to the driver's line of sight. The shooting angle of the target camera device is adjusted according to the driver's line of sight to obtain a target road image of the A-pillar blind spot scene; Control the target display device to move to the optimal viewing position and display the target road image on the target display device.
[0007] Furthermore, the vehicle also includes a first camera device and a second camera device mounted on the rearview mirror, wherein displaying a perspective image of the A-pillar blind spot scene at the optimal viewing position using virtual reality technology includes: The target camera is determined from the first camera and the second camera based on the driver's line of sight, wherein the target camera is the camera on the rearview mirror corresponding to the driver's line of sight. The shooting angle of the target camera device is adjusted according to the driver's line of sight to obtain a target road image of the A-pillar blind spot scene; The target road image is processed using virtual reality to display a perspective image of the A-pillar blind spot scene at the optimal viewing position, wherein the perspective image is a virtual perspective image of the target road image.
[0008] Furthermore, after determining that the adjustment range of the target display device cannot cover the optimal viewing position, and displaying a perspective image of the A-pillar blind spot scene at the optimal viewing position using virtual reality technology, the method further includes: Determine whether the target display device overlaps with the optimal viewing position in the direction of movement of the display device; If it is determined that the target display device and the optimal viewing position overlap in the direction of movement of the display device, the target display device is controlled to move away from the optimal viewing position so that the target display device and the optimal viewing position do not overlap in the direction of movement of the display device.
[0009] Furthermore, obtaining the driver's line of sight includes: Obtain the eye position and head posture of the driver of the vehicle; The driver's line of sight is obtained based on the eye position and head posture.
[0010] Furthermore, determining whether the target display device is in the driver's optimal viewing position based on the driver's line of sight includes: The eye field of view range pre-input by the vehicle driver is obtained, wherein the eye field of view range includes the left-right or up-down eye field of view range. The optimal viewing angle range is determined based on the driver's line of sight and eye field of view. When it is determined that the target display device is within the optimal viewing angle range, it is determined that the target display device is at the driver's optimal viewing angle position; When it is determined that the target display device is not within the optimal viewing angle range, it is determined that the target display device is not in the driver's optimal viewing angle position.
[0011] Furthermore, determining whether the adjustment range of the target display device can cover the optimal viewing angle position includes: The eye field of view range pre-input by the vehicle driver is obtained, wherein the eye field of view range includes the left-right or up-down eye field of view range. The optimal viewing angle range is determined based on the driver's line of sight and eye field of view. When the target display device can be fully moved to the optimal viewing angle range, it is determined that the adjustment range of the target display device can cover the optimal viewing angle position. When the target display device cannot be fully moved to the optimal viewing angle range, it is determined that the adjustment range of the target display device cannot cover the optimal viewing angle position.
[0012] Secondly, this application also provides an apparatus, including a memory and a processor, wherein the memory is used to store program code and the processor is used to call the program code to execute the method as described in the first aspect.
[0013] Thirdly, this application also provides a storage medium storing a computer program thereon, which, when executed by a processor, performs the steps of the method described in the first aspect.
[0014] Unlike existing technologies, this application provides a method for providing perspective display of a vehicle's A-pillar. First, the driver's line of sight is obtained. Then, a target display device is determined from a first display device and a second display device based on the driver's line of sight. Next, it is determined whether the target display device is at the driver's optimal viewing position based on the driver's line of sight. If the target display device is not at the driver's optimal viewing position, but its adjustment range can cover the optimal viewing position, the target display device is moved to the optimal viewing position and an image of the A-pillar blind spot is displayed. In other words, when the driver observes the A-pillar blind spot scene, the position of the target display device can be adjusted according to the driver's line of sight to adapt to different drivers' eye focusing ranges. This caters to the usage needs of different drivers and improves the perspective display effect of the vehicle's A-pillar. Attached Figure Description
[0015] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the structures shown in these drawings without creative effort.
[0016] Figure 1 This is a flowchart illustrating the vehicle A-pillar perspective display method in some embodiments of this application; Figure 2 This is a schematic diagram illustrating the application environment of the vehicle A-pillar perspective display method in some embodiments of this application; Figure 3 This is a schematic diagram of the driver's line of sight in some embodiments of this application; Figure 4 This is a schematic diagram of the hardware structure of the device in some embodiments of this application.
[0017] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0018] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present invention.
[0019] It should be noted that all directional indications (such as up, down, left, right, front, back, etc.) in the embodiments of the present invention are only used to explain the relative positional relationship and movement of each component in a certain specific posture (as shown in the figure). If the specific posture changes, the directional indication will also change accordingly.
[0020] Furthermore, the use of terms such as "first" and "second" in this invention is for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the term "and / or" throughout the text includes three solutions; taking A and / or B as an example, it includes technical solution A, technical solution B, and a technical solution that simultaneously satisfies A and B. Furthermore, the technical solutions of various embodiments can be combined with each other, but this must be based on the ability of a person skilled in the art to implement them. When the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed by this invention.
[0021] The A-pillar is the pillar between the windshield and the front door of a vehicle. The A-pillar provides greater stability and rigidity to the vehicle body, playing a crucial role in protecting the safety of passengers. However, its presence also creates a blind spot, posing a safety hazard. Currently, a perspective effect is typically achieved by projecting the external scene onto a display screen on the A-pillar, thus expanding the driver's field of vision. However, for drivers with eye conditions that result in a narrow field of vision, even with the external scene projected onto the A-pillar display screen, their eyes cannot effectively focus on the screen due to their limited field of vision and the screen's fixed position on the A-pillar. This leads to a poor perspective display effect, failing to meet the needs of different users.
[0022] For example, such as Figure 3 As shown, when the driver's line of sight ( Figure 3 As shown in the center line of sight P), when the display device is fixed at the edge of the first A-pillar and the display device is fixed at the middle position of the first A-pillar, if the driver's left and right field of vision is small ( Figure 3 As shown in the middle range S), the driver's line of sight can only observe a part of the display area of the display device, making it impossible for the driver to effectively obtain the road scene in the A-pillar blind spot, thus causing the A-pillar blind spot perspective to fail.
[0023] To address the aforementioned issues, this application proposes a vehicle A-pillar perspective display method, applied to a vehicle 200. The vehicle includes a first A-pillar 210, a second A-pillar 220, a first display device disposed on the first A-pillar 210, and a second display device disposed on the second A-pillar 220. Both the first and second display devices are located inside the vehicle and have both a fixed state and an adjustable state. The fixed state means the position of the display device cannot be adjusted or moved, while the adjustable state means the position of the display device can be moved as needed by a controller. In one embodiment of this application, both the first and second display devices are set to an adjustable state (able to be adjusted left and right as well as up and down) to adjust the position of the display devices according to user needs. However, the movement and adjustment of the first and second display devices are limited. The movement of the display devices is affected by the vehicle's interior structure and rearview mirrors. For example, when the display device moves to a position close to the rearview mirror, it will affect the driver's observation of the rearview mirror. Therefore, both the first and second display devices have corresponding adjustment ranges. Movement of the display devices within these adjustment ranges does not affect the display of the A-pillar blind spot scene or the function of other vehicle components (such as the rearview mirror).
[0024] like Figure 1-2 As shown, the following will mainly describe the specific steps of a method for displaying the A-pillar of a vehicle using perspective. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than here. Please refer to the appendix. Figure 1 The method includes the following steps: S100, Obtain the driver's line of sight; In one embodiment, step S100: obtaining the driver's line of sight direction includes: S110. Obtain the eye position and head posture of the driver of the vehicle; S220. Based on the eye position and the head posture, obtain the driver's line of sight direction.
[0025] In some implementations, the vehicle may include a DMS (Dual Eye Monitoring System) that can acquire the driver's eye coordinates and head posture, and determine whether the driver is looking at the first A-pillar or the second A-pillar based on the eye position and the head posture.
[0026] In some implementations, the processor in the vehicle can also obtain a more specific gaze direction of the driver based on the eye position and the head pose, according to a preset gaze tracking algorithm or model, such as DCF algorithm, KCF algorithm, LCT algorithm, MDNet algorithm, convolutional neural network, convolutional regression network, etc.
[0027] For example, after the vehicle starts, the in-vehicle camera obtains the three-dimensional coordinates of the driver's eyes based on the driver's facial features. The x-axis represents the left-right coordinate, the y-axis represents the height coordinate, and the z-axis represents the front-back coordinate. The x-axis, y-axis, and z-axis coordinates of the center of the eyebrows are calculated based on the median of the x-axis coordinates of the eyes, and the three-dimensional coordinates are transmitted to the processor. The system provides a standard three-dimensional coordinate of the center of the eyebrows when the driver is driving as a reference and a reference line of sight under the three-dimensional coordinates of the center of the eyebrows. When the driver turns his head, the system obtains the actual three-dimensional coordinates of the center of the eyebrows and obtains the driver's specific line of sight based on the reference three-dimensional coordinates of the center of the eyebrows and the reference line of sight, that is, the angle between the real-time line of sight and the reference line of sight.
[0028] S200. Determine a target display device from the first display device and the second display device according to the driver's line of sight, wherein the target display device is the display device on the A-pillar corresponding to the driver's line of sight. It is understandable that when the driver's line of sight is directed towards the first A-pillar, it means that the driver wants to know the blind spot of the first A-pillar. At this time, the first display device is used as the target display device to display the blind spot of the A-pillar. The position of the first display device can be adjusted as needed.
[0029] Similarly, when the driver's gaze is directed toward the second A-pillar, it means the driver wants to know the blind spot of the second A-pillar. At this time, the second display device is used as the target display device to display the blind spot of the A-pillar. The position of the second display device can be adjusted if necessary.
[0030] S300. Determine whether the target display device is in the driver's optimal viewing position based on the driver's line of sight, wherein the plane of the optimal viewing position is parallel to the display interface of the target display device; The optimal viewing position refers to the viewing position that meets the driver's visual field requirements and does not cause fatigue. Therefore, the optimal viewing position is a concept of a viewing range.
[0031] In one embodiment, step S300: determining whether the target display device is in the driver's optimal viewing position based on the driver's line of sight includes: S310. Obtain the eye field of view range pre-input by the vehicle driver, wherein the eye field of view range includes the left-right or up-down eye field of view range. S320. Determine the optimal viewing angle range based on the driver's line of sight and eye field of view. S330. When the target display device is within the optimal viewing angle range, it is determined that the target display device is at the driver's optimal viewing angle position; S340. When the target display device is not within the optimal viewing angle range, it is determined that the target display device is not in the driver's optimal viewing angle position.
[0032] Specifically, such as Figure 3 As shown, taking the left-right visual field as an example, for a normal user, the left-right visual field range can reach 150-180°. This means that when looking forward, the user can simultaneously see a scene within a range of 75-90° to the left and 75-90° to the right. However, for drivers with eye diseases, their visual field range is greatly reduced; in severe cases, the left-right visual field range may only be 30-40°. Therefore, for normal drivers, the optimal visual field range is larger (150-180°), while for non-normal drivers, the optimal visual field range is smaller (30-40°).
[0033] In this embodiment, the vehicle driver can first input their own field of vision range in advance, and then the system determines the optimal field of vision range based on the driver's line of sight and field of vision range. The optimal field of vision range is the angle that extends to the left and right of the driver's line of sight, extending by half the driver's field of vision range. Figure 3 As shown in the range S), after obtaining the driver's optimal viewing angle range, it can be determined whether the initial position of the target display device is within the driver's optimal viewing angle range. That is, when the initial position of the target display device is within the driver's optimal viewing angle range, such as... Figure 3 As shown in Figure B, if the driver can fully observe the target display device at this time, it is determined that the target display device is in the driver's optimal viewing position. If the initial position of the target display device is not within the driver's optimal viewing range, such as... Figure 3 As shown in Figure A, if the driver cannot fully observe the target display device, it is determined that the target display device is not in the driver's optimal viewing position. Thus, by pre-collecting the eye viewing range of different drivers to accurately determine whether the target display device is within the driver's optimal viewing range, an adjustment strategy for the target display device is triggered, and the accuracy of the target display device's adjustment is improved.
[0034] S400: Determine that the target display device is not in the driver's optimal viewing position, and determine whether the adjustment range of the target display device can cover the optimal viewing position; When the initial position of the target display device is not within the driver's optimal viewing angle range, the driver cannot fully observe the target display device. Therefore, it is necessary to continue to determine whether the adjustment range of the target display device can cover the optimal viewing angle position. In other words, it is necessary to determine whether the target display device can be adjusted to move to the optimal viewing angle position so that the driver can fully observe the target display device.
[0035] In one embodiment, step S400: determining whether the adjustment range of the target display device can cover the optimal viewing angle position includes: S410. Obtain the eye field of view range pre-input by the vehicle driver, wherein the eye field of view range includes the left-right or up-down eye field of view range. S410. Determine the optimal viewing angle range based on the driver's line of sight and eye field of view. S410. When the target display device can be fully moved to the optimal viewing angle range, it is determined that the adjustment range of the target display device can cover the optimal viewing angle position. S410. When the target display device cannot be fully moved to the optimal viewing angle range, it is determined that the adjustment range of the target display device cannot cover the optimal viewing angle position.
[0036] In this embodiment of the application, the vehicle driver can also pre-input their own eye field of view range, and then the system determines the optimal eye field of view range based on the driver's line of sight and eye field of view range. The optimal eye field of view range is the angle that extends to the left and right sides of the driver's line of sight range by half of the driver's eye field of view range. Figure 3 As shown in Figure S), after obtaining the driver's optimal viewing angle range, it can be determined whether the adjustment range of the target display device can cover the optimal viewing angle position. That is, when the adjustment position of the target display device can be completely moved to the optimal viewing angle range, such as... Figure 3 As shown in Figure C, if the driver can fully observe the target display device, then it is determined that the adjustment range of the target display device covers the optimal viewing angle position. If the adjustment position of the target display device cannot be fully moved within the optimal viewing angle range, the driver cannot fully observe the target display device, and therefore it is determined that the adjustment range of the target display device does not cover the optimal viewing angle position. Thus, by pre-collecting the eye viewing angle ranges of different drivers to accurately determine whether the adjustment range of the target display device can cover the optimal viewing angle position, the accuracy of the target display device adjustment is improved.
[0037] S500: Determine that the adjustment range of the target display device can cover the optimal viewing position, control the target display device to move to the optimal viewing position and display the A-pillar blind spot scene image.
[0038] like Figure 3As shown in C, when it is determined that the adjustment range of the target display device can cover the optimal viewing position, it is necessary to control the target display device to move to the optimal viewing position and display the A-pillar blind spot scene image, so as to eliminate the A-pillar blind spot by displaying the A-pillar blind spot scene image at the optimal viewing position that the driver can observe through the target display device.
[0039] Due to factors such as driver height, posture, and the distance to obstacles, the image displayed on the device screen may differ significantly in shape and size from what the human eye sees. To achieve a "transparent" effect, it is necessary to dynamically adjust the screen display based on the driver's line of sight, reducing the impact of factors such as driver posture and obstacle distance.
[0040] In one embodiment, the vehicle further includes a first camera device 230 and a second camera device 240 disposed on the rearview mirror. Controlling the target display device to move to the optimal viewing position and display the A-pillar blind spot scene image includes: The target camera is determined from the first camera and the second camera based on the driver's line of sight, wherein the target camera is the camera on the rearview mirror corresponding to the driver's line of sight. The shooting angle of the target camera device is adjusted according to the driver's line of sight to obtain a target road image of the A-pillar blind spot scene; Control the target display device to move to the optimal viewing position and display the target road image on the target display device.
[0041] Specifically, in this embodiment, the shooting angle of the corresponding camera device is adjusted according to the driver's line of sight, so that the blind spot display screen follows the driver's perspective and is seamlessly connected with the in-vehicle display screen, which is more in line with the observation scenario and further improves the A-pillar perspective display effect.
[0042] In other embodiments, when the initial position of the target display device is not at the driver's optimal viewing angle, and the adjustment range cannot cover the optimal viewing angle, a perspective image of the A-pillar blind spot scene is displayed at the optimal viewing angle using virtual reality technology. This perspective image is obtained by accurately capturing a target road image using a camera and then processing it using virtual reality; furthermore, the camera's shooting angle can be adjusted according to the driver's line of sight. Thus, when the movement range of the target display device is limited, preventing the A-pillar blind spot scene from being effectively displayed on the in-vehicle screen, using virtual reality technology to display the perspective of the A-pillar blind spot scene not only ensures the perspective display effect of the A-pillar but also does not obstruct the driver's view of the rearview mirror.
[0043] In another embodiment, after determining that the adjustment range of the target display device cannot cover the optimal viewing position, and displaying a perspective image of the A-pillar blind spot scene at the optimal viewing position using virtual reality technology, the method further includes: Determine whether the target display device overlaps with the optimal viewing position in the direction of movement of the display device; If it is determined that the target display device and the optimal viewing position overlap in the direction of movement of the display device, the target display device is controlled to move away from the optimal viewing position so that the target display device and the optimal viewing position do not overlap in the direction of movement of the display device.
[0044] Specifically, when the initial position of the target display device is not at the driver's optimal viewing position, and the adjustment range cannot cover the optimal viewing position, it is necessary to further determine whether the target display device overlaps with the optimal viewing position in the direction of movement of the display device. If the two overlap, and if the perspective image of the A-pillar blind spot scene is directly displayed at the optimal viewing position, then the perspective image of the A-pillar blind spot scene will be partially projected onto the target display device, thereby affecting the perspective display effect of the A-pillar blind spot scene. Therefore, in this embodiment, after determining that the target display device overlaps with the optimal viewing position in the direction of movement of the display device, the target display device is controlled to move away from the optimal viewing position so that the target display device and the optimal viewing position do not overlap in the direction of movement of the display device, thereby avoiding the display device from affecting the perspective display effect of the perspective image.
[0045] Based on this, the vehicle A-pillar perspective display method of this application allows the position of the target display device to be adjusted according to the driver's line of sight when the driver observes the blind spot scene of the A-pillar, so as to adapt to the different eye focus ranges of different drivers. In this way, the usage needs of different drivers can be taken into account, and the perspective display effect of the vehicle A-pillar can be improved. At the same time, when it is determined that the position adjustment of the target display device cannot meet the needs, the perspective image of the blind spot scene of the A-pillar is displayed at the best viewing position through virtual reality technology, thus further improving the perspective display effect of the vehicle A-pillar.
[0046] This application also provides an apparatus, please refer to the appendix. Figure 4 , Figure 4 The diagram below shows the hardware structure of an apparatus provided in some embodiments of this application. The apparatus includes a memory 110 and a processor 120. The memory 110 is used to store program code, and the processor 120 is used to call the program code to execute the method described above.
[0047] The processor 120 provides computing and control capabilities to control the device to perform corresponding tasks. For example, the control device executes the vehicle A-pillar perspective display method in any of the above method embodiments. The method includes: acquiring the driver's line of sight; determining a target display device from the first and second display devices based on the driver's line of sight, wherein the target display device is a display device on the A-pillar corresponding to the driver's line of sight; determining whether the target display device is at the driver's optimal viewing position based on the driver's line of sight; determining that the target display device is not at the driver's optimal viewing position, and determining whether the adjustment range of the target display device can cover the optimal viewing position; determining that the adjustment range of the target display device cannot cover the optimal viewing position, and displaying a perspective image of the A-pillar blind spot scene at the optimal viewing position using virtual reality technology.
[0048] The processor 120 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), a hardware chip, or any combination thereof; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The aforementioned PLD can be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.
[0049] The memory 110, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as the program instructions / modules corresponding to the vehicle A-pillar perspective display method in the embodiments of this application. The processor 120 can implement the vehicle A-pillar perspective display method in any of the above method embodiments by running the non-transitory software programs, instructions, and modules stored in the memory 110.
[0050] Specifically, memory 110 may include volatile memory (VM), such as random access memory (RAM); memory 110 may also include non-volatile memory (NVM), such as read-only memory (ROM), flash memory, hard disk drive (HDD), solid-state drive (SSD), or other non-transitory solid-state storage devices; memory 110 may also include combinations of the above types of memory.
[0051] In summary, the device of this application adopts the technical solution of any of the above-described embodiments of the vehicle A-pillar perspective display method. Therefore, it has at least the beneficial effects brought about by the technical solutions of the above embodiments, which will not be elaborated here.
[0052] This application also provides a computer-readable storage medium, such as a memory including program code, which can be executed by a processor to complete the vehicle A-pillar perspective display method described above. For example, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CDROM), magnetic tape, floppy disk, or optical data storage device, etc.
[0053] This application also provides a computer program product comprising one or more lines of program code stored in a computer-readable storage medium. The processor of an electronic device reads the program code from the computer-readable storage medium and executes the program code to complete the steps of the vehicle A-pillar perspective display method provided in the above embodiments.
[0054] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware, or by a program or program code related to hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.
[0055] It should be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.
[0056] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented using software and a general-purpose hardware platform, or of course, using hardware. Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.
[0057] The above description is merely a preferred embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural transformations made using the contents of the present invention's specification and drawings under the inventive concept of the present invention, or direct / indirect applications in other related technical fields, are included within the patent protection scope of the present invention.
Claims
1. A method for displaying the perspective of a vehicle's A-pillar, applied to vehicles, characterized in that... The vehicle includes a first A-pillar, a second A-pillar, a first display device disposed on the first A-pillar, and a second display device disposed on the second A-pillar. Both the first and second display devices are adjustable. The method includes: Obtain the driver's line of sight; The target display device is determined from the first display device and the second display device according to the driver's line of sight, wherein the target display device is the display device on the A-pillar corresponding to the driver's line of sight. The driver's line of sight is used to determine whether the target display device is in the driver's optimal viewing position, wherein the plane of the optimal viewing position is parallel to the display interface of the target display device. If it is determined that the target display device is not in the driver's optimal viewing position, it is then determined whether the adjustment range of the target display device can cover the optimal viewing position. Determine that the adjustment range of the target display device can cover the optimal viewing position, control the target display device to move to the optimal viewing position and display the A-pillar blind spot scene image; If it is determined that the adjustment range of the target display device cannot cover the optimal viewing position, a perspective image of the A-pillar blind spot scene is displayed at the optimal viewing position using virtual reality technology; Determine whether the target display device overlaps with the optimal viewing position in the direction of movement of the display device; If it is determined that the target display device and the optimal viewing position overlap in the direction of movement of the display device, the target display device is controlled to move away from the optimal viewing position so that the target display device and the optimal viewing position do not overlap in the direction of movement of the display device.
2. The vehicle A-pillar perspective display method as described in claim 1, characterized in that, The vehicle also includes a first camera device and a second camera device mounted on the rearview mirror. Controlling the target display device to move to the optimal viewing position and display the A-pillar blind spot scene image includes: The target camera is determined from the first camera and the second camera based on the driver's line of sight, wherein the target camera is the camera on the rearview mirror corresponding to the driver's line of sight. The shooting angle of the target camera device is adjusted according to the driver's line of sight to obtain a target road image of the A-pillar blind spot scene; Control the target display device to move to the optimal viewing position and display the target road image on the target display device.
3. The vehicle A-pillar perspective display method as described in claim 1, characterized in that, The vehicle also includes a first camera device and a second camera device mounted on the rearview mirror. The method of displaying a perspective image of the A-pillar blind spot scene at the optimal viewing position using virtual reality technology includes: The target camera is determined from the first camera and the second camera based on the driver's line of sight, wherein the target camera is the camera on the rearview mirror corresponding to the driver's line of sight. The shooting angle of the target camera device is adjusted according to the driver's line of sight to obtain a target road image of the A-pillar blind spot scene; The target road image is processed using virtual reality to display a perspective image of the A-pillar blind spot scene at the optimal viewing position, wherein the perspective image is a virtual perspective image of the target road image.
4. The vehicle A-pillar perspective display method as described in any one of claims 1-3, characterized in that, The step of obtaining the driver's line of sight includes: Obtain the eye position and head posture of the driver of the vehicle; The driver's line of sight is obtained based on the eye position and head posture.
5. The vehicle A-pillar perspective display method as described in claim 1, characterized in that, The step of determining whether the target display device is in the driver's optimal viewing position based on the driver's line of sight includes: The eye field of view range pre-input by the vehicle driver is obtained, wherein the eye field of view range includes the left-right or up-down eye field of view range. The optimal viewing angle range is determined based on the driver's line of sight and eye field of view. When the target display device is within the optimal viewing angle range, it is determined that the target display device is at the driver's optimal viewing angle position; When the target display device is not within the optimal viewing angle range, it is determined that the target display device is not in the driver's optimal viewing angle position.
6. The vehicle A-pillar perspective display method as described in claim 1, characterized in that, The determination of whether the adjustment range of the target display device can cover the optimal viewing angle position includes: The eye field of view range pre-input by the vehicle driver is obtained, wherein the eye field of view range includes the left-right or up-down eye field of view range. The optimal viewing angle range is determined based on the driver's line of sight and eye field of view. When the target display device can be fully moved to the optimal viewing angle range, it is determined that the adjustment range of the target display device can cover the optimal viewing angle position. When the target display device cannot be fully moved to the optimal viewing angle range, it is determined that the adjustment range of the target display device cannot cover the optimal viewing angle position.
7. A vehicle A-pillar perspective display device, characterized in that, The method includes a memory and a processor, wherein the memory is used to store program code and the processor is used to call the program code to perform the method as described in any one of claims 1 to 6.
8. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it performs the steps of the method as described in any one of claims 1-6.
Citation Information
Patent Citations
External rearview mirror system for eliminating visual barrier of car driver
CN102431499A
Display device and method for blind area of vehicle A-pillar
CN108556738A