Display method and related apparatus

Abstract

A display method and a related apparatus, which are applied to the technical field of display imaging. The display method comprises: when a first target is located outside a spatial region range between an observation point and a second display layer, displaying first information on a first display layer, wherein the first information is used for indicating related information about the first target; and when the first target is located within the spatial region range between the observation point and the second display layer, displaying second information on the second display layer, wherein the second information comprises three-dimensional information corresponding to the first target. In the method, vehicle information and real-scene information can be displayed in a layered manner, and augmented reality display from the vehicle information to the real-scene information can be achieved by means of a first display layer to a second display layer, such that information strongly correlated to a driver can be more effectively presented to a user during the traveling of a vehicle, thereby improving the information display efficiency.

Description

Display method and related devices Technical Field

[0001] This application relates to the field of display imaging technology, and in particular to a display method and related apparatus. Background Technology

[0002] With the development of the intelligent vehicle market, intelligent optical displays such as augmented reality head-up displays (AR-HUD) are increasingly becoming core components.

[0003] In AR-HUD technology, the field of view (FOV) and virtual image distance (VID) are important parameters affecting the imaging effect of AR-HUD display technology. The larger the FOV and VID, the larger the display area of ​​the AR-HUD, the higher the degree of integration between digital information and the display scene, and the better the driver's experience.

[0004] Currently, how to more effectively present vehicle information and real-world information to users is a technical problem that needs to be solved in this field. Summary of the Invention

[0005] This application provides a display method and related apparatus that can more effectively present vehicle information and real-scene information to users, thereby improving information display efficiency.

[0006] In a first aspect, embodiments of this application provide a display method applied to a display device, wherein the display area of ​​the display device includes at least a first display layer and a second display layer. The display method includes:

[0007] If the first target is located outside the spatial region between the observation point and the second display layer, first information is displayed on the first display layer. The first information is used to indicate relevant information about the first target.

[0008] When the first target is located within the spatial region between the observation point and the second display layer, second information is displayed on the second display layer. The second information includes the three-dimensional information corresponding to the first target.

[0009] This application provides a display method that can display different information about a first target on different display layers based on the relative positional relationship between the first target and the spatial region between the observation point and the second display layer. Through this layered display method, vehicle information and real-scene information can be displayed in layers. The augmented reality display of vehicle information to real-scene information is achieved by moving from the first display layer to the second display layer. This allows for more effective presentation of information highly relevant to the driver to the user during vehicle operation, improving information display efficiency and enhancing user cognitive efficiency, thus ensuring driving safety.

[0010] Optionally, the first display layer and the second display layer can be understood as different display layers in the FOV (field of view) of the display device.

[0011] Optionally, the first target can be understood as a target to be monitored (i.e., a target to be displayed) that has already been screened. For example, the first target is an object outside the vehicle that is related to driving behavior, such as static obstacles, dynamic obstacles, road-related infrastructure, etc. The driver can monitor the first target through the display device to understand the surrounding road conditions, such as traffic lights, speed limit signs, obstacles, etc. in the infrastructure.

[0012] Alternatively, the observation point can be understood as a point in the driver's pupil or an area of ​​the eye box where the displayed content can be observed.

[0013] Optionally, the spatial region between the observation point and the second display layer can be understood as a cone-shaped (cone, triangular pyramid, square pyramid, etc.) spatial region formed by the observation point as the vertex and the second display layer as the base, or it can be a spatial region of other shapes. This application embodiment does not limit this.

[0014] Optionally, the relative positional relationship between the first target and the spatial region between the observation point and the second display layer can be determined in two main ways: Method 1: If the first target is directly in front of the observation point, the distance between the first target and the observation point is used to determine whether the first target is within the spatial region between the observation point and the second display layer; Method 2: If the first target is not directly in front of the observation point, the first target is determined to be within the FOV of the display device to determine whether the first target is within the spatial region between the observation point and the second display layer.

[0015] Optionally, the first information is used to indicate relevant information about the first target, which may be two-dimensional information corresponding to the first target or three-dimensional information corresponding to the first target. This application embodiment does not limit this.

[0016] Optionally, the second information includes three-dimensional information corresponding to the first target, specifically including information that precisely matches the real information of the first target, thereby achieving the effect of three-dimensional stereoscopic enhancement of the real information of the first target.

[0017] In one possible implementation, the first display layer and the second display layer are divided based on the line-of-sight distance. The first display layer is the display layer formed at a first line-of-sight distance in front of the observation point, and the second display layer is the display layer formed at a second line-of-sight distance in front of the observation point. The second line-of-sight distance is greater than the first line-of-sight distance.

[0018] In this embodiment, the first and second display layers are divided based on line-of-sight distance. By using a layered display method with different line-of-sight distances, relevant information about a first target beyond the line-of-sight distance during vehicle movement can be displayed in advance on the first display layer, serving as a pre-warning to the driver. Only when the first target enters the spatial area between the observation point and the second display layer is the corresponding three-dimensional information of the first target displayed on the second display layer. By displaying at different line-of-sight distances from the first to the second display layers, augmented reality display of the first target can be achieved, improving information display efficiency and providing early warnings to the user, thus ensuring driving safety.

[0019] Optionally, the first and second display layers can also be divided based on the position of the display area. For example, the first display layer may be located to the left of the display area, and the second display layer may be located to the right of the display area. Or, for example, the first display layer may be located below the display area, and the second display layer may be located above the display area, and so on. This embodiment of the application does not impose any limitations on this. By using a layered display method with different area positions, vehicle information and real-scene information can be displayed in layers, presenting them to the user more clearly and improving information display efficiency.

[0020] In one possible implementation, the above display method may also include, but is not limited to, the following steps:

[0021] When the first target is located within the spatial region between the first display layer and the second display layer, third information is displayed, which includes transition information between the first information and the second information.

[0022] In this embodiment, when the first target is located within the spatial region between the first display layer and the second display layer, transition information between the first information and the second information can also be displayed. By displaying this transition information, the process of information flowing from the first display layer to the second display layer for augmented reality display can be made more seamless, effectively improving the continuity of information display, reducing cognitive load, improving user cognitive efficiency, and ensuring driving safety.

[0023] Optionally, the space between the first display layer and the second display layer can be understood as a frustum (truncated cone, triangular truncated cone, quadrangular truncated cone, etc.) formed by the first display layer as the upper bottom surface and the second display layer as the lower bottom surface, or it can be a space region of other shapes. This application embodiment does not limit this.

[0024] In one possible implementation, the above display method may also include, but is not limited to, the following steps:

[0025] If the first target is located within the spatial region between the observation point and the second display layer, the display of the first information is canceled.

[0026] In this embodiment, by canceling the display of the first information in a timely manner, the visual effect of information flowing from the first display layer to the second display layer for augmented reality display can be improved, interference with the display of the second information on the second display layer can be reduced, interference with the display of resident element information on the first display layer can be reduced, the display density of resident element information on the first display layer can be reduced, the user's reaction time can be shortened, and driving safety can be improved.

[0027] In one possible implementation, the above display method may also include, but is not limited to, the following steps:

[0028] If the first target is located within the spatial region between the observation point and the first display layer, the display of the third information is cancelled.

[0029] In this embodiment, by canceling the display of third information in a timely manner, the visual effect of information flowing from the first display layer to the second display layer for augmented reality display can be improved, interference with the display of second information on the second display layer can be reduced, as can interference with the display of permanent element information on the first display layer. It can also reduce the display density of the display area, shorten the user's reaction time, and improve driving safety.

[0030] In one possible implementation, the above display method may also include, but is not limited to, the following steps:

[0031] When the second information is displayed on the second display layer, the pose of the second information displayed on the second display layer is updated based on the positional change between the first target and the observation point.

[0032] In this embodiment, while the second information is displayed on the second display layer, the vehicle's position changes during its journey, and the position between the first target and the observation point also changes accordingly, such as changes in distance or direction. Therefore, the pose of the second information displayed on the second display layer can be updated based on this position change, for example, by adjusting the size and orientation of the second information displayed on the second display layer. Through this embodiment, vehicle information and real-scene information can be presented to the user more effectively, improving information display efficiency.

[0033] In one possible implementation, the display device is disposed on the first vehicle, and the display method may further include, but is not limited to, the following steps:

[0034] The fourth information, which includes the status information of the first vehicle, is displayed on the first display layer.

[0035] In this embodiment, the status information of the first vehicle includes, but is not limited to, the vehicle's speed, fuel level, battery level, entertainment system, driving status, and lighting information. By displaying the above information on the first display layer, richer vehicle status information can be presented to the user, improving the user's cognitive efficiency.

[0036] In one possible implementation, the above display method may also include, but is not limited to, the following steps:

[0037] If the display area of ​​the first information conflicts with the display area of ​​the fourth information, the first information shall be displayed first in the first display layer.

[0038] In this embodiment, within a limited display area, the display density of resident element information in the first display layer can be appropriately reduced, and information related to the first target can be displayed first in the first display layer. During vehicle operation, information strongly related to the driver can be presented to the user more effectively, thus ensuring driving safety.

[0039] In one possible implementation, the display area of ​​the above-described display device further includes a third display layer; the above-described display method may also include, but is not limited to, the following steps:

[0040] The third display layer displays the 3D information corresponding to the second target, and the category of the first target is different from that of the second target.

[0041] In this embodiment, the display area of ​​the display device includes multiple display layers, which can be displayed on different display layers according to different categories of the target, thereby improving information display efficiency, enhancing user cognitive efficiency, and ensuring driving safety.

[0042] Optionally, the third display layer can be understood as another display layer in the FOV forward space of the display device that is different from the first and second display layers.

[0043] Optionally, the second target can be understood as other targets to be monitored (i.e. targets to be displayed) that have been filtered and are different from the first target.

[0044] In one possible implementation, the first display layer, the second display layer, and the third display layer are divided based on the line-of-sight distance. The first display layer is a display layer formed at a first line-of-sight distance in front of the observation point, the second display layer is a display layer formed at a second line-of-sight distance in front of the observation point, and the third display layer is a display layer formed at a third line-of-sight distance in front of the observation point. The third line-of-sight distance is greater than the second line-of-sight distance, and the second line-of-sight distance is greater than the first line-of-sight distance.

[0045] In this embodiment, the first, second, and third display layers are divided based on line-of-sight distance. By using a layered display method with different line-of-sight distances, for first and second targets beyond the line-of-sight distance during vehicle movement, relevant information about the first and second targets can be displayed in advance on the first display layer, serving as a pre-emptive warning to the driver. Only when the second target enters the spatial area between the observation point and the third display layer is its corresponding 3D information displayed on the third display layer. Similarly, when the first target enters the spatial area between the observation point and the second display layer, its corresponding 3D information is displayed on the second display layer. By displaying targets at different line-of-sight distances through the first, second, and third display layers, augmented reality display of targets beyond the line-of-sight distance can be achieved. This also provides early warnings to the user, ensuring driving safety. Furthermore, displaying different types of targets on different display layers improves information display efficiency.

[0046] Optionally, the first, second, and third display layers can also be divided based on the position of the display area. For example, the first display layer may be located on the left side of the display area, the second display layer in the middle, and the third display layer on the right side. Or, for another example, the first display layer may be located below the display area, the second display layer in the middle, and the third display layer above, and so on. This embodiment does not impose any limitations on this. By using a layered display method with different area positions, vehicle information and real-world information can be displayed in layers, and different categories of targets can also be displayed in layers, presenting them more clearly to the user and improving information display efficiency.

[0047] In one possible implementation, the first objective mentioned above includes any one or more of the following: obstacles, traffic lights, traffic signs, and road vehicles.

[0048] In this embodiment, obstacles include, but are not limited to, static obstacles (such as fences, water barriers, temporarily parked vehicles, etc.) and dynamic obstacles (such as pedestrians, animals, moving vehicles, etc.), traffic lights include, but are not limited to, traffic lights, hazard warning lights, etc., traffic signs include, but are not limited to, speed limit signs, no-entry signs, dedicated lane signs, etc., and road vehicles include, but are not limited to, vehicles that are moving, temporarily parked, or blocking the road.

[0049] In one possible implementation, the relevant information of the first target includes any one or more of the following: risk information of the first target, attribute information of the first target, and location information of the first target.

[0050] In this embodiment, risk information can be understood as the collision risk between obstacles and vehicles, attribute information can be understood as traffic light color, sign number, etc., and location information can be understood as information that can indicate the target location, such as arrow indication information.

[0051] In one possible implementation, the display device includes at least one of the following:

[0052] Augmented Reality Head-Up Display (AR-HUD), vehicle headlight module, and in-vehicle projector.

[0053] In this embodiment, the above-mentioned display device can display images in various ways, including but not limited to projection, light projection, and display screen. The displayed image can be a real image or a virtual image, and this application embodiment does not limit this.

[0054] Secondly, embodiments of this application provide a display device including a unit for performing the method as described in any of the first aspects.

[0055] In one possible design, the device includes:

[0056] The display unit is used to display first information on the first display layer when the first target is located outside the spatial region between the observation point and the second display layer. The first information is used to indicate relevant information about the first target.

[0057] The display unit is also used to display second information on the second display layer when the first target is located in the spatial region between the observation point and the second display layer. The second information includes the three-dimensional information corresponding to the first target.

[0058] In one possible implementation, the device further includes:

[0059] The communication unit is used to receive the location information of the first target.

[0060] The steps performed by the display unit and communication unit described in the second aspect and any possible implementation can be referred to the corresponding implementations in the first aspect.

[0061] For the technical effects of the second aspect and any possible implementation, please refer to the description of the technical effects corresponding to the first aspect and the corresponding implementation.

[0062] Optionally, in the display device described in the second aspect above and any possible embodiment:

[0063] In one implementation, the display device is a display apparatus. When the display device is a display apparatus, the communication unit can be a transceiver or an input / output interface; the display unit can be at least one processor. Optionally, the transceiver can be a transceiver circuit. Optionally, the input / output interface can be an input / output circuit.

[0064] In another implementation, the display device is a chip (system) or circuit used in a display device. When the display device is a chip (system) or circuit used in a display device, the communication unit can be a communication interface (input / output interface), interface circuit, output circuit, input circuit, pin, or related circuit on the chip (system) or circuit; the display unit can be at least one processor, processing circuit, or logic circuit.

[0065] Thirdly, embodiments of this application provide a display device including a processor. The processor is coupled to a memory and can be used to execute instructions in the memory to implement the methods described in the first aspect and any of the possible implementations. Optionally, the display device further includes a memory. Optionally, the display device further includes a communication interface, and the processor is coupled to the communication interface.

[0066] Fourthly, embodiments of this application provide a chip, including: logic circuitry and a communication interface. The communication interface is used to receive or send information; the logic circuitry is used to receive or send information through the communication interface, causing the chip to execute the methods described in the first aspect and any of the possible implementations.

[0067] Fifthly, embodiments of this application provide a computer-readable storage medium for storing a computer program (also referred to as code or instructions); when the computer program is run on a computer, the methods described in the first aspect and any possible implementation are implemented.

[0068] Sixthly, embodiments of this application provide a computer program product, the computer program product comprising: a computer program (also referred to as code or instructions); and, when the computer program is run, causing a computer to perform the methods described in the first aspect and any possible implementation thereof.

[0069] In a seventh aspect, embodiments of this application provide a display system including a display device and a sensing unit for performing the methods described in the first aspect and any possible implementation thereof. The sensing unit is used to sense a first target.

[0070] Eighthly, embodiments of this application provide a terminal, which includes at least one display device as described in the second aspect, or the display device as described in the third aspect, or the display system as described in the seventh aspect.

[0071] Optionally, the terminal also includes a windshield through which the light emitted from the display device or display system passes to form a virtual image in front of the terminal.

[0072] Optionally, the terminal can be a means of transportation, such as a car, truck, aircraft, drone, slow transport vehicle, spacecraft, or ship, or any other possible means of transportation used in any possible scenario. This application embodiment does not limit this.

[0073] Optionally, the terminal is used to implement the method described in the first aspect and any possible implementation.

[0074] Furthermore, in the process of performing the method described in the first aspect and any possible implementation above, the processes related to sending and / or receiving information in the above methods can be understood as the process of the processor outputting information, and / or the process of the processor receiving input information. When outputting information, the processor can output the information to a transceiver (or communication interface, or transmitting module) so that the transceiver can transmit it. After the information is output by the processor, it may need to undergo other processing before reaching the transceiver. Similarly, when the processor receives input information, the transceiver (or communication interface, or transmitting module) receives the information and inputs it to the processor. Furthermore, after the transceiver receives the information, the information may need to undergo other processing before being input to the processor.

[0075] Based on the above principles, for example, the information sent mentioned in the aforementioned method can be understood as information output by the processor. Similarly, the information received can be understood as information received by the processor from input.

[0076] Optionally, unless otherwise specified, or unless they contradict their actual function or internal logic in the relevant description, the operations of the processor, such as transmitting, sending, and receiving, can be more generally understood as processor output and receiving, input, and other operations.

[0077] Optionally, in performing the methods described in the first aspect and any possible implementation above, the processor may be a processor specifically designed to perform these methods, or it may be a processor that performs these methods by executing computer instructions stored in memory, such as a general-purpose processor. The memory may be a non-transitory memory, such as read-only memory (ROM), which may be integrated with the processor on the same chip or disposed on different chips. This application does not limit the type of memory or the arrangement of the memory and processor.

[0078] In one possible implementation, at least one of the aforementioned memories is located outside the device.

[0079] In yet another possible implementation, at least one of the aforementioned memories is located within the device.

[0080] In another possible implementation, a portion of the memory of the at least one memory is located inside the device, while another portion is located outside the device.

[0081] In this application, the processor and memory may also be integrated into a single device, that is, the processor and memory can be integrated together. Attached Figure Description

[0082] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0083] Figure 1 is a schematic diagram of a field of view provided in an embodiment of this application;

[0084] Figure 2 is a schematic diagram of a virtual image distance provided in an embodiment of this application;

[0085] Figure 3 is a schematic diagram of an application scenario of a display device in the automotive field provided by an embodiment of this application;

[0086] Figure 4 is a schematic diagram from another perspective of an application scenario of a display device in the automotive field provided by an embodiment of this application;

[0087] Figure 5 is a schematic diagram of an image projection onto a driver's eye in the automotive field using a display device provided in an embodiment of this application;

[0088] Figure 6 is a flowchart illustrating a display method provided in an embodiment of this application;

[0089] Figure 7 is a schematic diagram of a layered display provided in an embodiment of this application;

[0090] Figures 8A to 8E are schematic diagrams showing a driving scenario provided by an embodiment of this application;

[0091] Figures 9A to 9E are schematic diagrams showing another driving scenario provided by the embodiments of this application;

[0092] Figures 10A to 10E are schematic diagrams showing another driving scenario provided by an embodiment of this application;

[0093] Figures 11A to 11D are schematic diagrams showing another driving scenario provided by an embodiment of this application;

[0094] Figure 12 is a schematic diagram of a display device provided in an embodiment of this application;

[0095] Figure 13 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0096] Figure 14 is a schematic diagram of the structure of a chip provided in an embodiment of this application. Detailed Implementation

[0097] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described below with reference to the accompanying drawings.

[0098] The terms "first" and "second," etc., used in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0099] The term "embodiment" as used herein means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that, unless otherwise specified or logically conflicting, the terminology and / or descriptions between the various embodiments of this application are consistent and can be mutually referenced, and technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0100] It should be understood that in this application, "at least one (item)" means one or more, "more than one" means two or more, "at least two (items)" means two or three or more, and "and / or" is used to describe the relationship between related objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0101] It should be noted that, in this application, "instruction" can include direct instruction, indirect instruction, explicit instruction, and implicit instruction. When describing a certain instruction information for the purpose of instructing A, it can be understood that the instruction information carries A, directly instructs A, or indirectly instructs A.

[0102] In this application, the information indicated by the instruction information is called the information to be instructed. In specific implementations, there are many ways to indicate the information to be instructed, such as, but not limited to, directly indicating the information to be instructed, such as the information to be instructed itself or its index. It can also indirectly indicate the information to be instructed by indicating other information, where there is a correlation between the other information and the information to be instructed. It can also indicate only a part of the information to be instructed, while the other parts are known or pre-agreed upon. For example, the instruction of specific information can be achieved by using a pre-agreed (e.g., protocol-defined) arrangement of various information, thereby reducing instruction overhead to some extent. The information to be instructed can be sent as a whole or divided into multiple sub-information units, and the sending period and / or timing of these sub-information units can be the same or different. This application does not limit the specific sending method. The sending period and / or timing of these sub-information units can be predefined, for example, according to a protocol, or configured by the transmitting device by sending configuration information to the receiving device.

[0103] It should be noted that in this application, "send" can be understood as "output" and "receive" can be understood as "input". "Send information to A", where "to A" simply indicates the direction of information transmission, and A is the destination, does not limit "send information to A" to a direct transmission over the air interface. "Send information to A" includes sending information directly to A, as well as sending information indirectly to A through a transmitter. Therefore, "send information to A" can also be understood as "outputting information destined for A". Similarly, "receive information from A" indicates that the source of the information is A, including receiving information directly from A, as well as receiving information indirectly from A through a receiver. Therefore, "receive information from A" can also be understood as "inputting information from A".

[0104] To more clearly describe the solution of this application, some terms used in the embodiments of this application will be explained below.

[0105] A head-up display (HUD), also known as a head-up display system, is a multi-functional instrument panel centered on the driver and operated blindly. The HUD projects vehicle instrument information (such as speed, RPM, temperature, fuel level, etc.) and navigation information into the driver's field of vision. The driver can see this information directly in front of them without needing to look down at the instrument panel or central control display below the steering wheel, thus improving braking reaction time in emergency situations and enhancing driving safety and convenience.

[0106] Augmented reality head-up display (AR-HUD) is a combination of holographic augmented reality (AR) technology and head-up display (HUD) functionality. Through computational processing, it overlays acquired image information onto the real three-dimensional environment in front of the driving route. It can integrate information such as distance, speed, and navigation into the real-world view obtained by the driver. The combination of computational data and display scene makes digital information richer and more intuitive, improving the driving experience and driving safety.

[0107] The field of view (FOV), also known as the field of view, refers to the maximum solid angle between the edge of the displayed image and the image acquisition center. For example, in optical measurement equipment, the image acquisition center is the center of the lens of the optical measurement equipment. The target image measured by the optical measurement equipment can pass through the lens, and the angle formed by the two edges that present the largest range through the lens is the field of view. Similarly, in display devices, the field of view is the angle between the two edges of the image displayed on the imaging mechanism of the display device and the center point of the display device's lens, usually the two edge points with the largest distance. In the field of head-up displays, the image acquisition center is the pupil of the human body. In the display field, FOV generally includes the vertical field of view, the horizontal field of view, and the diagonal field of view. Referring to Figure 1, point O in Figure 1 is the image acquisition center, the quadrilateral enclosed by ABCD is the display imaging, the angle between the lines OA and OB can be the horizontal field of view, the angle between the lines OB and OC can be the vertical field of view, and the angle between the lines OA and OC can be the diagonal field of view. It should be noted that, unless otherwise specified, the default field of view is generally the horizontal field of view and the vertical field of view.

[0108] Virtual image distance (VID), also known as virtual image distance, refers to the distance from the displayed virtual image to the image acquisition center. In the field of head-up displays (HUDs), the image acquisition center is the human pupil. Referring to Figure 2, in a HUD system, the virtual image distance is the straight-line distance between the human pupil and the virtual image.

[0109] Figure 3 illustrates a schematic diagram of an application scenario of a display device 100 provided in this application in the automotive field. Figure 4 illustrates another perspective of an application scenario of a display device 100 provided in this application in the automotive field. Figure 5 illustrates an imaging schematic diagram of a display device 100 provided in this application projecting an image into the driver's eyes in the automotive field, showing the virtual image information that the display device 100 in Figures 3 and 4 can see by projecting the image into the driver's eyes.

[0110] As shown in Figures 3 to 5, when the driver looks out of the car through the windshield 200, they can see a virtual image with a certain depth of field (i.e., the distance of the clear image within the range before and after the focal point of the image). Information acquisition modules, such as cameras and infrared sensors, acquire information about the road ahead, including distance to the vehicle in front, the speed of the vehicle in front, and other road information. This digital information is projected onto an image closely integrated with the surrounding environment. This digital information includes: vehicle speed, navigation information (road directions), vehicle gear, cruise control, distance to the vehicle in front, speed of the vehicle in front, engine speed, battery level, remaining driving range, and infotainment system information. This allows the driver to access necessary information without shifting their gaze while driving, avoiding the driving risks that might arise from neglecting road conditions while looking down at the instrument panel or central control screen.

[0111] To achieve the aforementioned display, the vehicle needs to be equipped with a head-up display (HUD) system. This HUD system may include a display device 100 and optical elements. The display device 100 can project images, and the optical elements may include the vehicle's windshield 200, a reflective film attached to the windshield 200, or a separate screen within the vehicle's cabin. The optical elements can reflect and / or refract the image projected by the display device 100 before projecting it into the driver's eyes, allowing the driver to obtain a virtual information image in front of the windshield 200. Optionally, the display device 100 has one or more interfaces through which current and / or image signals are obtained from the vehicle's central control system or in-vehicle infotainment system. The current signals are used to power the electrical components in the display device 100, and the image signals are used to provide the displayed image.

[0112] In the automotive industry, the display device 100 that enables enhanced head-up display functionality is typically located on the center console of the vehicle. Referring to Figures 3, 4, and 5, the display device 100 can be installed within the center console and positioned in front of the steering wheel (aligned with the direction of travel of the vehicle).

[0113] It should be noted that the vehicles described in this application are all exemplified as automobiles and should not be considered as limitations on the embodiments of this application. The vehicle can be a traditional gasoline-powered vehicle, or a new energy vehicle such as a pure electric vehicle or a hybrid vehicle. The vehicle can be any of different types of automobiles, such as sedans, trucks, buses, and sport utility vehicles (SUVs), or it can be a land transportation device for carrying passengers or goods, such as a tricycle, motorcycle, or train. Alternatively, the display device of this application can also be applied to other types of transportation vehicles such as airplanes and ships.

[0114] In the field of head-up displays (HUDs), the field of view (FOV) can be 15 × 5 degrees. Here, 15 degrees refers to the horizontal FOV, as shown in Figure 1, which is the angle between lines OA and OB; 5 degrees refers to the vertical FOV, which is the angle between lines OB and OC. Typically, the size of a person's retina is limited, and the FOV of both eyes is generally between 90 and 120 degrees (which can be either horizontal or vertical). Through binocular parallax, the human eye can perceive the 3D state of objects. Increasing the FOV of the display device improves the fit between virtual and real images, increases the coverage area of ​​the virtual image, and correspondingly improves the driver's visual experience.

[0115] In the field of head-up displays (HUDs), the visual distance (VID) can be 7.5 meters. Referring to Figure 2, VID represents the distance between the image at the front of the vehicle and the driver's eyes. Increasing the VID of the display device improves the depth of the virtual image relative to the driver's field of vision, resulting in a higher degree of fit between the virtual image and the distant real-world image, and a more realistic stereoscopic effect. Furthermore, the increased VID reduces the need for frequent zooming when viewing displayed and virtual image information, improving driver comfort and consequently increasing driving safety.

[0116] In AR-HUD technology, FOV and VID are important parameters affecting the imaging effect of AR-HUD display technology. The larger the FOV and VID, the larger the display area of ​​the AR-HUD, the higher the degree of integration between digital information and the display scene, and the better the driver's experience.

[0117] Currently, some real-world information in intelligent driving scenarios exceeds the display area of ​​the HUD and cannot be displayed in a timely and intuitive manner through AR-HUD. When faced with this type of real-world information, drivers need to frequently check the corresponding locations on the navigation map and in the real world, resulting in low information display efficiency, high cognitive load, and impacting driving safety.

[0118] Therefore, how to present vehicle information and real-world information to users more effectively is a technical problem that needs to be solved in this field.

[0119] In view of this, embodiments of this application provide a display method and related apparatus, relating to the field of display imaging technology, which can more effectively present vehicle information and real-scene information to users and improve information display efficiency.

[0120] The display method and related devices provided in this application will now be described in conjunction with the accompanying drawings.

[0121] Please refer to Figure 6, which is a schematic flowchart of a display method provided in an embodiment of this application. This display method is applied in the field of display imaging technology, including but not limited to AR-HUD displays.

[0122] Specifically, this display method is applied to a display device, the display area of ​​which includes at least a first display layer and a second display layer, and the display method includes, but is not limited to, the following steps:

[0123] S601: When the first target is located outside the spatial region between the observation point and the second display layer, the display device displays the first information on the first display layer.

[0124] S602: When the first target is located within the spatial region between the observation point and the second display layer, the display device displays second information on the second display layer.

[0125] It is understood that the display device in the embodiments of this application may be a device equipped with a processor / chip that can execute computer execution instructions, or it may be a processor / chip that can execute computer execution instructions. Optionally, the display device may be an electronic device, or a processor / chip within an electronic device, or it may be the display device shown in Figures 3 to 5 above, used to execute the display method in the embodiments of this application, so as to more effectively present vehicle information and real-scene information to the user and improve information display efficiency.

[0126] Optionally, the display device may specifically include, but is not limited to, any one or more of the following: augmented reality head-up display (AR-HUD), vehicle headlight module, and vehicle-mounted projector. It is understood that the above-mentioned display device can display images through various means, including but not limited to projection, light projection, and display screens. The displayed image can be a real image or a virtual image, and this application embodiment does not impose any limitations on this.

[0127] Optionally, the display device and display method in the embodiments of this application can be applied to, but are not limited to, vehicle systems. The vehicle equipped with the vehicle system is an intelligent driving vehicle and can be replaced by a terminal device. The terminal device can be, but is not limited to, vehicles such as commercial vehicles, passenger cars, trains, industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), robots, etc. The embodiments of this application do not specifically limit this.

[0128] Optionally, the first target mentioned above can be understood as the target to be monitored (i.e. the target to be displayed) that has already been screened.

[0129] For example, the first target may include, but is not limited to, any one or more of the following: obstacles, traffic lights, traffic signs, and road vehicles.

[0130] Obstacles include, but are not limited to, static obstacles (such as fences, water-filled barriers, and temporarily parked vehicles) and dynamic obstacles (such as pedestrians, animals, and moving vehicles). Traffic lights include, but are not limited to, traffic lights and hazard warning lights. Traffic signs include, but are not limited to, speed limit signs, no-entry signs, and lane marking signs. Road vehicles include, but are not limited to, vehicles traveling, temporarily parked, or obstructing traffic on the road.

[0131] Optionally, the vehicle can collect one or more candidate targets through sensors, such as cameras and radar, and provide them to the intelligent driving system or other recognition system. Based on screening criteria, such as collision risk and traffic light warning conditions, the intelligent driving system or other recognition system determines one or more targets to be monitored from multiple candidate targets and displays them on a display device.

[0132] Optionally, the aforementioned first information is used to indicate relevant information about the first target.

[0133] Optionally, the relevant information of the first target can be two-dimensional information corresponding to the first target or three-dimensional information corresponding to the first target. This application embodiment does not limit this.

[0134] For example, the relevant information of the first target may include, but is not limited to, any one or more of the following: risk information of the first target, attribute information of the first target, and location information of the first target.

[0135] Among them, risk information can be understood as the collision risk between obstacles and vehicles, attribute information can be understood as traffic light colors, sign numbers, etc., and location information can be understood as information that can indicate the location of the target, such as arrow pointing information.

[0136] Optionally, the second information mentioned above includes the three-dimensional information corresponding to the first target.

[0137] Optionally, the three-dimensional information corresponding to the first target may specifically include information that precisely matches the real information of the first target, thereby achieving the effect of three-dimensional stereoscopic enhancement of the real information of the first target.

[0138] Alternatively, the aforementioned observation point can be understood as a point in the driver's pupil or an area of ​​the eye box where the displayed content can be observed.

[0139] Optionally, the first display layer and the second display layer can be understood as different display layers in the FOV forward space of the display device.

[0140] Optionally, the first display layer and the second display layer can be any regular or irregular shape such as rectangle, circle, triangle, rhombus, trapezoid, etc., and the embodiments of this application do not limit this.

[0141] Optionally, the spatial region between the observation point and the second display layer can be understood as a cone-shaped (cone, triangular pyramid, square pyramid, etc.) spatial region formed by the observation point as the vertex and the second display layer as the base, or it can be a spatial region of other shapes. This application embodiment does not limit this.

[0142] Optionally, the relative positional relationship between the first target and the spatial region between the observation point and the second display layer can be determined by means of, but not limited to, the following two methods:

[0143] Method 1: If the first target is directly in front of the observation point, then determine whether the first target is within the spatial region between the observation point and the second display layer by measuring the distance between the first target and the observation point.

[0144] Method 2: If the first target is not directly in front of the observation point, then determine whether the first target is within the spatial region between the observation point and the second display layer by judging whether the first target is within the FOV of the display device.

[0145] For details, please refer to Figure 7, which is a schematic diagram of a layered display provided in an embodiment of this application.

[0146] As shown in Figure 7, the display device on vehicle 701 uses the driver's pupil as the observation point O. Along the dashed lines containing points O, A1, and A2; points O, B1, and B2; points O, C1, and C2; and points O, D1, and D2, the image passes through the windshield of vehicle 701 and is projected onto the front of vehicle 701, forming a spatial area defined by point O and the aforementioned four dashed lines. This spatial area can be considered the display area of ​​the display device. When the driver looks out through the windshield of vehicle 701, they can see display content with a certain depth of field (i.e., the distance of the clear image presented within the range before and after the image focal point) within this display area. Within this display area, A1, B1, C1, and D1 constitute the first display layer, and A2, B2, C2, and D2 constitute the second display layer.

[0147] It is understood that the rectangular display layer shown in Figure 7 is only for illustrative purposes and should not be construed as limiting the embodiments of this application. In fact, the display layer formed by the display device can also be any regular or irregular shape such as a circle, triangle, rhombus, trapezoid, etc. The embodiments of this application do not impose any restrictions on this.

[0148] As can be seen from Figure 7, the spatial region between the observation point O and the second display layer (A2, B2, C2, D2) can be understood as a four-pyramidal spatial region formed by the observation point O as the vertex and the second display layer (A2, B2, C2, D2) as the base, along the dotted line.

[0149] It is understood that the four-pyramidal spatial region shown in Figure 7 is only an illustrative example and should not be construed as limiting the embodiments of this application. In fact, the spatial region between the observation point and the display layer can also be any regular or irregular shaped spatial region such as a cone or a triangular pyramid, and the embodiments of this application do not limit this.

[0150] As can also be seen from Figure 7, the relative positional relationship between the first target and the spatial region between observation point O and the second display layer (A2, B2, C2, D2) can be determined by methods including but not limited to the following two:

[0151] Method 1:

[0152] If the first target (e.g., traffic light 703, vehicle 702, pedestrian 705 in Figure 7) is directly in front of observation point O, then the distance between the first target and observation point O is used to determine whether the first target is within the spatial region between observation point O and the second display layer (A2, B2, C2, D2).

[0153] It can be seen that vehicle 702 and pedestrian 705 are outside the spatial area between observation point O and the second display layer (A2, B2, C2, D2), while traffic light 703 is within the spatial area between observation point O and the second display layer (A2, B2, C2, D2).

[0154] Method 2:

[0155] If the first target (e.g., pedestrian 704 in Figure 7) is not directly in front of the observation point O, then the first target is determined to be within the spatial region between the observation point O and the second display layer (A2, B2, C2, D2) by determining whether the first target is within the FOV of the display device.

[0156] It can be seen that pedestrian 704 is outside the FOV of the display device, and therefore outside the spatial range between observation point O and the second display layer (A2, B2, C2, D2).

[0157] Optionally, the two judgment methods shown above can be determined by the display device itself based on the relative positional relationship between the first target and the spatial region between the observation point O and the second display layer (A2, B2, C2, D2), or by the intelligent assisted driving system or other controllers, and then the judgment result is output to the display device. This application embodiment does not limit this.

[0158] It should be understood that the above-described methods one and two are merely two examples to illustrate the relative positional relationship between the first target and the observation point O to the second display layer (A2, B2, C2, D2), and should not be used to limit the embodiments of this application.

[0159] It should be understood that any new embodiments obtained by reasonable modifications or additions to the above-mentioned methods one and two are all within the protection scope of the embodiments of this application.

[0160] In summary, the display method in this application embodiment can display different information of the first target on different display layers according to the relative positional relationship between the first target and the spatial region between the observation point and the second display layer.

[0161] By using the layered display method described above, vehicle information and real-world information can be displayed in layers. By moving from the first display layer to the second display layer, the augmented reality display of vehicle information and real-world information can be achieved. This allows for more effective presentation of information that is highly relevant to the driver to the user during vehicle operation, improving information display efficiency and enhancing the user's cognitive efficiency, thus ensuring driving safety.

[0162] In one possible embodiment, the first display layer and the second display layer can be divided based on different dimensions, which can be specifically described in the following cases.

[0163] Scenario 1:

[0164] The first and second display layers are divided based on viewing distance.

[0165] The first display layer is formed at the first line of sight in front of the observation point, and the second display layer is formed at the second line of sight in front of the observation point. The second line of sight is greater than the first line of sight, as shown in Figure 7 above.

[0166] It is understood that the viewing distance is the distance from the observation point to the display layer. It can be the distance from the observation point to the center point of the display layer, or the maximum distance from the observation point to any point in the display layer. The specific distance can be determined according to different driving scenarios, and this application embodiment does not limit it. Optionally, in the field of head-up displays, this viewing distance can refer to the description of virtual image distance above, and will not be repeated here.

[0167] It is understandable that by using a layered display method with different viewing distances, the relevant information of the first target beyond the line of sight during vehicle movement can be displayed in advance on the first display layer, which serves as a pre-warning to the driver. The three-dimensional information of the first target will then be displayed on the second display layer when the first target enters the spatial area between the observation point and the second display layer.

[0168] Therefore, by displaying different viewing distances from the first display layer to the second display layer, the augmented reality display of the first target can be achieved, improving information display efficiency. At the same time, it can also provide early warnings to users and ensure driving safety.

[0169] Scenario 2:

[0170] The first and second display layers are divided based on the location of the display area.

[0171] For example, the first display layer is located on the left side of the display area, and the second display layer is located on the right side of the display area.

[0172] For example, the first display layer may be located below the display area, and the second display layer may be located above the display area, etc. The embodiments of this application do not limit this.

[0173] Understandably, by displaying vehicle information and real-world information in layers according to different locations, the information can be presented to the user more clearly, thus improving information display efficiency.

[0174] It should be understood that the accompanying drawings and embodiments in this application are described using Case 1 as an example to illustrate the display method. The display method corresponding to Case 2 is similar to that corresponding to Case 1, so it will not be described again.

[0175] It should be understood that the above two scenarios are merely examples to illustrate the division between the first and second display layers, and should not be construed as limiting the embodiments of this application.

[0176] It should be understood that any new embodiments obtained by reasonable modifications or additions to the above-described situations one and two are all within the protection scope of the embodiments of this application.

[0177] In one possible embodiment, the above display method may also include, but is not limited to, the following steps:

[0178] When the first target is located within the spatial region between the first display layer and the second display layer, the display device displays third information.

[0179] The third information includes the transition information between the first information and the second information.

[0180] Optionally, the third information may be displayed in the form of gradient transition, distortion, path animation, collage animation, etc., and this application embodiment does not limit this.

[0181] Optionally, the display time of the third information should be between the display time of the first information and the display time of the second information.

[0182] Optionally, the space between the first display layer and the second display layer can be understood as a frustum (truncated cone, triangular truncated cone, quadrangular truncated cone, etc.) formed by the first display layer as the upper bottom surface and the second display layer as the lower bottom surface, or it can be a space region of other shapes. This application embodiment does not limit this.

[0183] Specifically, as can be seen from Figure 7 above, the spatial region between the first display layer (A1, B1, C1, D1) and the second display layer (A2, B2, C2, D2) can be understood as a truncated quadrangular spatial region formed along the dotted line with the first display layer (A1, B1, C1, D1) as the upper base and the second display layer (A2, B2, C2, D2) as the lower base.

[0184] It is understood that the quadrangular frustum space region shown in Figure 7 is only an illustrative example and should not be construed as limiting the embodiments of this application. In fact, the space region between the first display layer and the second display layer can also be any regular or irregular shaped space region such as a frustum or a triangular frustum, and the embodiments of this application do not impose any restrictions on this.

[0185] Optionally, the method for determining the relative positional relationship between the first target and the spatial region between the first display layer and the second display layer can be found in the above description of the method for determining the relative positional relationship between the first target and the spatial region between the observation point and the second display layer, and will not be repeated here.

[0186] It is understandable that by displaying this third information, the process of information flowing from the first display layer to the second display layer for augmented reality display can be made more coherent, effectively improving the continuity of information display, reducing cognitive load, improving the user's cognitive efficiency, and ensuring driving safety.

[0187] In one possible embodiment, the above display method may also include, but is not limited to, the following steps:

[0188] If the first target is located within the spatial region between the observation point and the second display layer, the display device cancels the display of the first information.

[0189] Optionally, canceling the display of the first information and displaying the second information in the second display layer are not sequential in terms of execution time.

[0190] For example, you can first cancel the display of the first information, and then display the second information on the second display layer.

[0191] For example, you can first display the second information on the second display layer, and then cancel the display of the first information.

[0192] For example, canceling the display of the first information and displaying the second information on the second display layer can be done simultaneously, and this application embodiment does not limit this.

[0193] It is understandable that by canceling the display of the first information in a timely manner, the visual effect of information flowing from the first display layer to the second display layer for augmented reality display can be improved, interference with the display of the second information on the second display layer can be reduced, as can interference with the display of resident element information on the first display layer. It can also reduce the display density of resident element information on the first display layer, shorten the user's reaction time, and improve driving safety.

[0194] In one possible embodiment, the above display method may also include, but is not limited to, the following steps:

[0195] If the first target is located within the spatial region between the observation point and the first display layer, the display device cancels the display of the third information.

[0196] Optionally, the spatial region between the observation point and the first display layer can be understood as a cone (cone, triangular pyramid, square pyramid, etc.) spatial region formed by the observation point as the vertex and the first display layer as the base, or it can be a spatial region of other shapes. This application embodiment does not limit this.

[0197] Specifically, as can be seen from Figure 7 above, the spatial region between the observation point O and the first display layer (A1, B1, C1, D1) can be understood as a four-pyramidal spatial region formed by the observation point O as the vertex and the first display layer (A1, B1, C1, D1) as the base, along the dotted line.

[0198] It is understood that the four-pyramidal spatial region shown in Figure 7 is only an illustrative example and should not be construed as limiting the embodiments of this application. In fact, the spatial region between the observation point and the display layer can also be any regular or irregular shaped spatial region such as a cone or a triangular pyramid, and the embodiments of this application do not limit this.

[0199] Optionally, the method for determining the relative positional relationship between the first target and the spatial region between the observation point and the first display layer can be found in the above description of the method for determining the relative positional relationship between the first target and the spatial region between the observation point and the second display layer, and will not be repeated here.

[0200] It is understandable that by canceling the display of third information in a timely manner, the visual effect of information flowing from the first display layer to the second display layer for augmented reality display can be improved, interference with the display of second information on the second display layer and interference with the display of permanent element information on the first display layer can be reduced, the display density of the display area can be reduced, the user's reaction time can be shortened, and driving safety can be improved.

[0201] In one possible embodiment, the above display method may also include, but is not limited to, the following steps:

[0202] When the second information is displayed on the second display layer, the display device updates the pose of the second information displayed on the second display layer based on the positional change between the first target and the observation point.

[0203] It is understandable that while the second information is displayed on the second display layer, the position of the vehicle will change during the driving process, and the position between the first target and the observation point will also change accordingly, such as changes in distance or direction. Therefore, the pose of the second information displayed on the second display layer can be updated based on this position change, such as adjusting the size and orientation of the second information displayed on the second display layer.

[0204] Through the embodiments of this application, the pose of the second information displayed on the second display layer can be adjusted in a timely manner as the vehicle moves and the position of the first target changes with the observation point, so as to present vehicle information and real-scene information to the user more effectively and improve information display efficiency.

[0205] In one possible embodiment, the display device is disposed on the first vehicle, and the display method may further include, but is not limited to, the following steps:

[0206] The display device displays the fourth information on the first display layer.

[0207] The fourth piece of information includes the status information of the first vehicle.

[0208] Optionally, the status information of the first vehicle includes, but is not limited to, the vehicle speed, fuel level, battery level, entertainment system, driving status, and lighting information of the first vehicle.

[0209] Through the embodiments of this application, the above information can be displayed on the first display layer, thereby presenting users with richer vehicle status information and improving users' cognitive efficiency.

[0210] Optionally, if the display area of ​​the first information conflicts with the display area of ​​the fourth information, the display device shall prioritize displaying the first information on the first display layer.

[0211] Understandably, within a limited display area, the display density of resident element information on the first display layer can be appropriately reduced, and information related to the primary target can be prioritized for display on the first display layer. This allows for more effective presentation of information strongly relevant to the driver to the user during vehicle operation, thus ensuring driving safety.

[0212] In one possible embodiment, the display area of ​​the above-described display device further includes a third display layer, and the above-described display method may also include, but is not limited to, the following steps:

[0213] The display device displays the three-dimensional information corresponding to the second target on the third display layer.

[0214] The category of the first objective is different from that of the second objective.

[0215] It is understandable that the display area of ​​the display device includes multiple display layers, which can be displayed on different display layers according to different categories of targets, thereby improving information display efficiency, enhancing user cognitive efficiency, and ensuring driving safety.

[0216] Optionally, the third display layer can be understood as another display layer in the FOV forward space of the display device that is different from the first and second display layers.

[0217] Optionally, the second target can be understood as other targets to be monitored (i.e. targets to be displayed) that have been filtered and are different from the first target.

[0218] Optionally, the first display layer, the second display layer, and the third display layer can be divided based on different dimensions, which can be explained in the following ways.

[0219] Scenario 1:

[0220] The first, second, and third display layers are divided based on viewing distance.

[0221] The first display layer is formed at the first line of sight in front of the observation point, the second display layer is formed at the second line of sight in front of the observation point, and the third display layer is formed at the third line of sight in front of the observation point. The third line of sight is greater than the second line of sight, and the second line of sight is greater than the first line of sight.

[0222] It is understandable that by using a layered display method with different viewing distances, relevant information about the first and second targets beyond the line of sight during vehicle movement can be displayed in advance on the first display layer, serving as a pre-warning to the driver. The third display layer will then display the corresponding three-dimensional information of the second target when the second target enters the spatial area between the observation point and the third display layer. Similarly, the second display layer will display the corresponding three-dimensional information of the first target when the first target enters the spatial area between the observation point and the second display layer.

[0223] Therefore, by displaying different viewing distances through the first, second, and third display layers, augmented reality displays of targets beyond visual range can be achieved. At the same time, it can also provide early warnings to users, ensuring driving safety. Furthermore, displaying different types of targets on corresponding display layers can improve information display efficiency.

[0224] Scenario 2:

[0225] The first display layer, the second display layer, and the third display layer are divided based on the location of the display area.

[0226] For example, the first display layer is located on the left side of the display area, the second display layer is located in the middle of the display area, and the third display layer is located on the right side of the display area.

[0227] For example, the first display layer may be located below the display area, the second display layer may be located in the middle of the display area, the third display layer may be located above the display area, and so on. This application does not limit this.

[0228] Understandably, by displaying information in layers based on different locations, vehicle information and real-world data can be presented in layers, and different categories of targets can also be displayed in layers, presenting information to users more clearly and improving information display efficiency.

[0229] It should be understood that the above scenarios one to three are merely two examples illustrating the division of the first display layer, the second display layer, and the third display layer, and should not be construed as limiting the embodiments of this application.

[0230] It should be understood that any new embodiments obtained by reasonable modifications or additions to the above-described situations one through three are all within the protection scope of the embodiments of this application.

[0231] The display method described above will be illustrated below using different driving scenarios.

[0232] Scene 1:

[0233] Road obstacles are displayed.

[0234] For details, please refer to Figures 8A to 8E, which are schematic diagrams showing a driving scenario provided by an embodiment of this application.

[0235] It is understood that the display area of ​​the display device in this embodiment includes at least a first display layer and a second display layer. The first display layer is formed at a first viewing distance in front of the observation point, and the second display layer is formed at a second viewing distance in front of the observation point, where the second viewing distance is greater than the first viewing distance. This observation point is the pupil of the driver.

[0236] As shown in Figure 8A, when the vehicle is driving normally on the road, the display device displays the vehicle's speed information (59 km / h) on the first display layer. Optionally, other status information of the vehicle can also be displayed on the first display layer at this time. For details, please refer to the fourth information above, which will not be repeated here.

[0237] As shown in Figure 8B, when the vehicle's perception system or driver assistance system detects an obstacle at a distance on the road (see the first target mentioned above), or when the perception module in the vehicle's display system detects an obstacle at a distance on the road (see the first target mentioned above), and the obstacle is located outside the spatial area between the observation point and the second display layer, the display device displays a warning message 801 on the first display layer. Optionally, the warning message 801 may include relevant information about the obstacle to indicate a collision risk. The icon corresponding to the warning message 801 may be a two-dimensional planar icon or a three-dimensional stereo icon. The warning message 801 may also use different colors to indicate different collision risk levels. Optionally, the specific details of the warning message 801 can be found in the first information mentioned above, and will not be repeated here.

[0238] As shown in Figure 8C, the vehicle will decelerate. As the vehicle continues to move forward until the obstacle is within the spatial area between the observation point and the second display layer, the display device will cancel the display of prompt information 801. Furthermore, when the obstacle is within the spatial area between the first and second display layers, the display device will display animation information 802. Optionally, the animation information 802 can be specifically referred to in the third information above, and will not be repeated here. Also, when the obstacle is within the spatial area between the observation point and the second display layer, the display device will display obstacle information 803 on the second display layer. Optionally, the obstacle information 803 can be specifically referred to in the second information above, and will not be repeated here.

[0239] As shown in Figures 8D and 8E, as the vehicle continues to move forward, the position between the obstacle and the observation point changes. The display device updates the obstacle information 803 to its pose displayed on the second display layer. It can be seen that in Figures 8C, 8D, and 8E, the size and orientation of the obstacle information 803 displayed on the second display layer change accordingly. Furthermore, when the obstacle is located within the spatial region between the observation point and the first display layer, the display device cancels the display of animation information 802.

[0240] Through the embodiments of this application, vehicle information and real-scene information can be displayed in layers. The augmented reality display of vehicle information to real-scene information can be achieved by connecting the first display layer to the second display layer. At the same time, it can also provide early warnings to users for obstacles beyond the line of sight, ensuring driving safety.

[0241] Furthermore, the display of animated information 802 makes the process of information flowing from the first display layer to the second display layer for augmented reality display more coherent. This allows for more effective presentation of information that is highly relevant to the driver to the user during vehicle operation, improving information display efficiency, reducing cognitive load, enhancing the user's cognitive efficiency, and ensuring driving safety.

[0242] Scene 2:

[0243] Road traffic signs are displayed.

[0244] For details, please refer to Figures 9A to 9E, which are schematic diagrams showing another driving scenario provided by the embodiments of this application.

[0245] It is understood that the display area of ​​the display device in this embodiment includes at least a first display layer and a second display layer. The first display layer is formed at a first viewing distance in front of the observation point, and the second display layer is formed at a second viewing distance in front of the observation point, where the second viewing distance is greater than the first viewing distance. This observation point is the pupil of the driver.

[0246] As shown in Figure 9A, when the vehicle is driving normally on the road, the display device displays the vehicle's speed information (89 km / h) on the first display layer. Optionally, other status information of the vehicle can also be displayed on the first display layer at this time. For details, please refer to the fourth information above, which will not be repeated here.

[0247] As shown in Figure 9B, when the vehicle's perception system or driver assistance system detects a traffic sign at a distance on the road (see the first target mentioned above), or when the perception module in the vehicle's display system detects a traffic sign at a distance on the road (see the first target mentioned above), and the traffic sign is located outside the spatial area between the observation point and the second display layer, the display device displays prompt information 901 on the first display layer. Optionally, the prompt information 901 may include relevant information about the traffic sign, used to indicate the attribute information of the traffic sign, such as speed limit, right turn, etc. The icon corresponding to the prompt information 901 can be a two-dimensional planar icon or a three-dimensional stereo icon. The prompt information 901 can also use different colors to indicate different attribute categories. Optionally, the specific details of the prompt information 901 can be found in the first information mentioned above, and will not be repeated here.

[0248] As shown in Figure 9C, the vehicle will slow down under the guidance of prompt information 901, preparing to turn right at a speed limit of 80 km / h. As the vehicle continues forward until the traffic sign is within the spatial area between the observation point and the second display layer, the display device will cancel the display of prompt information 901. Furthermore, when the traffic sign is within the spatial area between the first and second display layers, the display device displays animation information 902. Optionally, the details of this animation information 902 can be found in the third information above, and will not be repeated here. Also, when the traffic sign is within the spatial area between the observation point and the second display layer, the display device displays traffic sign information 903 on the second display layer. Optionally, the details of this traffic sign information 903 can be found in the second information above, and will not be repeated here.

[0249] As shown in Figures 9D and 9E, as the vehicle continues to move forward, the position between the traffic sign and the observation point changes. The display device updates the position of the traffic sign information 903 displayed on the second display layer. It can be seen that in Figures 9C, 9D, and 9E, the size and orientation of the traffic sign information 903 displayed on the second display layer change accordingly. Furthermore, when the traffic sign is located within the spatial area between the observation point and the first display layer, the display device cancels the display of animation information 902.

[0250] Through the embodiments of this application, vehicle information and real-scene information can be displayed in layers. The augmented reality display of vehicle information to real-scene information can be achieved by connecting the first display layer to the second display layer. At the same time, it can also provide users with advance warnings for traffic signs beyond the line of sight, ensuring driving safety.

[0251] Furthermore, the display of animated information 902 makes the process of information flowing from the first display layer to the second display layer for augmented reality display more coherent. This allows for more effective presentation of information that is highly relevant to the driver to the user while the vehicle is in motion, improving information display efficiency, reducing cognitive load, enhancing the user's cognitive efficiency, and ensuring driving safety.

[0252] Scene 3:

[0253] Road traffic light display.

[0254] For details, please refer to Figures 10A to 10E, which are schematic diagrams showing another driving scenario provided by the embodiments of this application.

[0255] It is understood that the display area of ​​the display device in this embodiment includes at least a first display layer and a second display layer. The first display layer is formed at a first viewing distance in front of the observation point, and the second display layer is formed at a second viewing distance in front of the observation point, where the second viewing distance is greater than the first viewing distance. This observation point is the pupil of the driver.

[0256] As shown in Figure 10A, when the vehicle is driving normally on the road, the display device displays the vehicle's speed information (15 km / h) on the first display layer. Optionally, other status information of the vehicle can also be displayed on the first display layer at this time. For details, please refer to the fourth information above, which will not be repeated here.

[0257] As shown in Figure 10B, when the vehicle's perception system or driver assistance system detects a traffic light in the distance on the road (see the first target mentioned above), or when the perception module in the vehicle's display system detects a traffic light in the distance on the road (see the first target mentioned above), and the traffic light is located outside the spatial area between the observation point and the second display layer, the display device displays prompt information 1001 on the first display layer. Optionally, the prompt information 1001 may include relevant information about the traffic light, indicating its color. The icon corresponding to the prompt information 1001 may be a two-dimensional planar icon or a three-dimensional icon. The prompt information 1001 may also indicate different traffic light states using different colors. Optionally, the specific details of the prompt information 1001 can be found in the first information mentioned above, and will not be repeated here.

[0258] As shown in Figure 10C, the vehicle will decelerate to 0 speed under the instruction of prompt information 1001 (traffic light is yellow). Before the speed reaches 0, the vehicle continues to move forward until the traffic light is within the spatial area between the observation point and the second display layer, at which point the display device cancels the display of prompt information 1001. Furthermore, when the traffic light is within the spatial area between the first and second display layers, the display device displays animation information 1002. Optionally, the animation information 1002 can be specifically referred to in the third information above, and will not be repeated here. Also, when the traffic light is within the spatial area between the observation point and the second display layer, the display device displays traffic light information 1003 on the second display layer. Optionally, the traffic light information 1003 can be specifically referred to in the second information above, and will not be repeated here.

[0259] As shown in Figures 10D and 10E, as time progresses, the traffic light changes from yellow to red, and the display device updates the color of the traffic light information 1003 displayed on the second display layer. Optionally, the display device can also update the previously displayed vehicle speed information to parking status information (as shown in "A" in Figures 10D and 10E). Optionally, the display device can also display vehicle status information such as music (lyrics) on the first display layer. Furthermore, when the traffic light is within the spatial area between the observation point and the first display layer, the display device cancels the display of animation information 1002.

[0260] Through the embodiments of this application, vehicle information and real-scene information can be displayed in layers. The augmented reality display of vehicle information to real-scene information can be achieved by connecting the first display layer to the second display layer. At the same time, users can be given advance warnings for traffic lights beyond the line of sight, ensuring driving safety.

[0261] Furthermore, the display of animated information 1002 makes the process of information flowing from the first display layer to the second display layer for augmented reality display more coherent. This allows for more effective presentation of information that is highly relevant to the driver to the user during vehicle operation, improving information display efficiency, reducing cognitive load, enhancing the user's cognitive efficiency, and ensuring driving safety.

[0262] Scene 4:

[0263] Side and rear overtaking display.

[0264] For details, please refer to Figures 11A to 11D, which are schematic diagrams showing another driving scenario provided by the embodiments of this application.

[0265] It is understood that the display area of ​​the display device in this embodiment includes at least a first display layer and a second display layer. The first display layer is formed at a first viewing distance in front of the observation point, and the second display layer is formed at a second viewing distance in front of the observation point, where the second viewing distance is greater than the first viewing distance. This observation point is the pupil of the driver.

[0266] As shown in Figure 11A, when the vehicle is driving normally on the road, the display device displays the vehicle's speed information (58 km / h) on the first display layer. Optionally, other status information of the vehicle can also be displayed on the first display layer at this time. For details, please refer to the fourth information above, which will not be repeated here.

[0267] As shown in Figure 11B, when the vehicle's perception system or driver assistance system detects that there is a vehicle (such as a fire truck, ambulance, etc., referred to here as another vehicle) performing an emergency task on the left rear of the vehicle on the road intending to overtake (see the first target mentioned above for details), or when the perception module in the vehicle's display system detects that there is a vehicle (such as a fire truck, ambulance, etc., referred to here as another vehicle) performing an emergency task on the left rear of the vehicle on the road intending to overtake (see the first target mentioned above for details), and the other vehicle is located outside the spatial area between the observation point and the second display layer, the display device displays prompt information 1101 on the first display layer. Optionally, the prompt information 1101 may include relevant information about the other vehicle, used to indicate that the other vehicle intends to overtake and its location and direction. For example, the arrow in Figure 11B points from left to right, indicating that the other vehicle intends to overtake from the left side of the vehicle. The icon corresponding to the prompt information 1101 can be a two-dimensional planar icon or a three-dimensional icon. The prompt information 1101 can also use different colors to indicate different levels of overtaking intent. Optionally, the specific details of the prompt information 1101 can be found in the first information above, and will not be repeated here.

[0268] As shown in Figure 11C, the vehicle will slow down and yield to the other vehicle under the instruction of prompt information 1101. The vehicle will continue to move forward at a slow speed until the other vehicle overtakes it and changes lanes ahead of it in its lane. The other vehicle completes the overtaking maneuver, and the vehicle remains centered in its lane. During the entire overtaking process, when the other vehicle is within the spatial area between the observation point and the second display layer, the display device cancels the display of prompt information 1101. Furthermore, when the other vehicle is within the spatial area between the first and second display layers, the display device displays animation information 1102. Optionally, the animation information 1102 can be specifically referred to in the third information above, and will not be repeated here. Also, when the other vehicle is within the spatial area between the observation point and the second display layer, the display device displays information 1103 of the other vehicle on the second display layer. Optionally, the information 1103 of the other vehicle can be specifically referred to in the second information above, and will not be repeated here.

[0269] As shown in Figure 11D, as the other vehicle continues to travel at high speed, the distance between the observer and the other vehicle gradually increases. The distance between the other vehicle and the observation point is greater than the second line of sight but less than the third line of sight. At this point, the display device cancels the display of animation information 902. Optionally, the display area of ​​the display device may also include a third display layer, which is a display layer formed at the third line of sight in front of the observation point, where the third line of sight is greater than the second line of sight. The display device may display the information 1103 of the other vehicle on the third display layer until the other vehicle leaves the display area of ​​the display device, at which point the display device cancels the display of the information 1103 of the other vehicle.

[0270] Through the embodiments of this application, vehicle information and real-scene information can be displayed in layers. The augmented reality display of vehicle information to real-scene information can be achieved by connecting the first display layer to the second display layer. At the same time, users can be given advance warnings for vehicles with beyond the viewing angle to ensure driving safety.

[0271] Furthermore, the display of animated information 1102 makes the process of information flowing from the first display layer to the second display layer for augmented reality display more coherent. This allows for more effective presentation of information that is highly relevant to the driver to the user during vehicle operation, improving information display efficiency, reducing cognitive load, enhancing the user's cognitive efficiency, and ensuring driving safety.

[0272] It should be understood that the above scenarios one to four are merely examples to illustrate the display methods in the embodiments of this application, and should not be construed as limiting the embodiments of this application.

[0273] It should be understood that any new embodiments obtained by reasonable modifications or additions to the above-described scenarios one through four are all within the protection scope of the embodiments of this application.

[0274] The methods of the embodiments of this application have been described in detail above. The following provides an apparatus for implementing any one of the methods in the embodiments of this application. For example, an apparatus is provided that includes a unit (or means) for implementing the steps performed by the device in any of the above methods.

[0275] Please refer to Figure 12, which is a schematic diagram of the structure of a display device provided in an embodiment of this application.

[0276] As shown in Figure 12, the display device 120 may include a communication unit 1201 and a display unit 1202. The communication unit 1201 and the display unit 1202 may be software, hardware, or a combination of software and hardware.

[0277] The communication unit 1201 can implement sending and / or receiving functions, and can also be described as a transceiver unit. The communication unit 1201 can also be a unit integrating an acquisition unit and a sending unit, wherein the acquisition unit is used to implement the receiving function, and the sending unit is used to implement the sending function. Optionally, the communication unit 1201 can be used to receive information sent by other devices, and can also be used to send information to other devices.

[0278] In one possible design, the display device 120 may correspond to the display device in the method embodiment shown in FIG. 6 above. For example, the display device 120 may be an electronic device or a chip within an electronic device. The display device 120 may include units for performing the operations performed by the display device in the method embodiment shown in FIG. 6 above, and each unit in the display device 120 is for implementing the operations performed by the display device in the method embodiment shown in FIG. 6 above. The descriptions of each unit are as follows:

[0279] Display unit 1202 is used to display first information on the first display layer when the first target is located outside the spatial region between the observation point and the second display layer. The first information is used to indicate relevant information about the first target.

[0280] The display unit 1202 is also used to display second information on the second display layer when the first target is located in the spatial region between the observation point and the second display layer. The second information includes the three-dimensional information corresponding to the first target.

[0281] In one possible implementation, the device further includes a communication unit 1201.

[0282] The display unit 1202 is specifically used to obtain the location information of the first target through the communication unit 1201.

[0283] Regarding the communication unit 1201 and display unit 1202 described in this design, the steps performed can be referred to the implementation method corresponding to the display device in the method embodiment shown in FIG6 above.

[0284] Regarding the technical effects of the implementation methods performed by the communication unit 1201 and the display unit 1202 described in this design, please refer to the description of the technical effects corresponding to the method embodiment shown in FIG6 above.

[0285] According to embodiments of this application, the various units in the device shown in FIG12 can be individually or entirely merged into one or more other units, or some of the units can be further divided into multiple functionally smaller units. This achieves the same operation without affecting the technical effect of the embodiments of this application. The above units are based on logical function division. In practical applications, the function of one unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of this application, the electronic device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented collaboratively by multiple units.

[0286] It should be noted that the implementation of each unit can also refer to the corresponding description of the method embodiment shown in Figure 6 above.

[0287] The display device 120 described in Figure 12 can present vehicle information and real-world information to the user more effectively, thereby improving information display efficiency.

[0288] If the above-mentioned display device 120 can be an electronic device, please refer to the structural schematic diagram of the electronic device shown in FIG13.

[0289] It should be understood that the electronic device 130 shown in FIG13 is only an example. The electronic device in the embodiments of this application may also include other components, or include components with functions similar to the various components in FIG13, or may not be intended to include all the components in FIG13.

[0290] Electronic device 130 includes a transceiver interface 1301 and at least one processor 1302.

[0291] The electronic device 130 can correspond to a display device. The transceiver interface 1301 is used to transmit and receive signals, and at least one processor 1302 executes program instructions, causing the electronic device 130 to implement the corresponding flow of the method executed by the corresponding device in the above method embodiment.

[0292] In one possible design, the electronic device 130 may correspond to the display device in the method embodiment shown in FIG. 6 above. For example, the electronic device 130 may be a display device or a chip within the display device. The electronic device 130 may include components for performing the operations performed by the display device in the above method embodiment, and each component in the electronic device 130 is specifically designed to implement the operations performed by the display device in the above method embodiment. Specifically, it may be as follows:

[0293] The processor 1302 is configured to display first information on the first display layer when the first target is located outside the spatial region between the observation point and the second display layer. The first information is used to indicate relevant information about the first target.

[0294] The processor 1302 is also configured to display second information on the second display layer when the first target is located within the spatial region between the observation point and the second display layer. The second information includes three-dimensional information corresponding to the first target.

[0295] In one possible implementation, the device also includes a transceiver interface 1301.

[0296] The processor 1302 is specifically used to obtain the location information of the first target through the transceiver interface 1301.

[0297] Regarding the transceiver interface 1301 and at least one processor 1302 described in this design, the steps performed can be referred to the implementation corresponding to the display device in the method embodiment shown in FIG6 above.

[0298] For the technical effects of the implementation methods performed by the transceiver interface 1301 and at least one processor 1302 described in this design, please refer to the description of the technical effects corresponding to the method embodiment shown in FIG6 above.

[0299] In the electronic device 130 described in Figure 13, vehicle information and real-world information can be presented to the user more effectively, improving information display efficiency.

[0300] If the above-mentioned display device 120 can be a chip or a chip system, please refer to the schematic diagram of the chip structure shown in FIG14.

[0301] As shown in Figure 14, chip 140 includes processor 1401 and interface 1402. The number of processors 1401 can be one or more, and the number of interfaces 1402 can be multiple. It should be noted that the functions of processor 1401 and interface 1402 can be implemented through hardware design, software design, or a combination of both; no restrictions are placed here.

[0302] Optionally, chip 140 may also include memory 1403 for storing necessary program instructions and data.

[0303] In this application, processor 1401 can be used to call the implementation program of the display method provided in one or more embodiments of this application on a display device from memory 1403, and execute the instructions included in the program. Interface 1402 can be used to output the execution result of processor 1401. In this application, interface 1402 can be specifically used to output various messages or information of processor 1401.

[0304] The display methods provided by one or more embodiments of this application can be referred to the various embodiments shown in FIG6 above, and will not be repeated here.

[0305] The processor in this application embodiment can be a central processing unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0306] The memory in this application embodiment is used to provide storage space, in which data such as operating system and computer programs can be stored. The memory includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM).

[0307] According to the method provided in the embodiments of this application, the embodiments of this application also provide a computer-readable storage medium storing a computer program. When the computer program is run on one or more processors, it can implement the method shown in FIG6.

[0308] According to the method provided in the embodiments of this application, the embodiments of this application also provide a computer program product, which includes a computer program. When the computer program runs on a processor, it can implement the method shown in FIG6.

[0309] This application also provides a display system, which includes a display device and a sensing unit for performing the method shown in FIG6 above. The sensing unit is used to sense a first target.

[0310] This application embodiment also provides a terminal, which includes at least one display device 120, or electronic device 130, or chip 140.

[0311] Optionally, the terminal also includes a windshield, through which the light emitted from the display device 120, electronic device 130, chip 140, or the aforementioned display system passes and forms a virtual image in front of the terminal.

[0312] Optionally, the terminal can be a means of transportation, such as a car, truck, aircraft, drone, slow transport vehicle, spacecraft, or ship, or any other possible means of transportation used in any possible scenario. This application embodiment does not limit this.

[0313] Optionally, the terminal is used to implement the method shown in Figure 6 above.

[0314] This application also provides a processing apparatus, including a processor and an interface; the processor is used to execute the method in any of the above method embodiments.

[0315] It should be understood that the above-described processing device can be a chip. The units in the various device embodiments and the electronic devices in the method embodiments correspond completely, with corresponding modules or units executing corresponding steps. For example, the communication unit (transceiver) executes the receiving or sending steps in the method embodiments, while other steps besides sending and receiving can be executed by the processing unit (processor). The specific functions of each unit can be found in the corresponding method embodiments. There can be one or more processors.

[0316] It is understood that in the embodiments of this application, the electronic device may perform some or all of the steps in the embodiments of this application. These steps or operations are merely examples, and the embodiments of this application may also perform other operations or variations thereof. Furthermore, the steps may be performed in different orders as presented in the embodiments of this application, and it is not necessarily necessary to perform all the operations in the embodiments of this application.

[0317] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0318] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0319] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0320] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the contributing part, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0321] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.

Claims

1. A display method, characterized in that, Applied to a display device, wherein the display area of ​​the display device includes at least a first display layer and a second display layer; the display method includes: When the first target is located outside the spatial region between the observation point and the second display layer, first information is displayed on the first display layer, and the first information is used to indicate relevant information about the first target; When the first target is located within the spatial region between the observation point and the second display layer, second information is displayed on the second display layer, and the second information includes the three-dimensional information corresponding to the first target.

2. The display method according to claim 1, characterized in that, The first display layer and the second display layer are divided based on the line of sight. The first display layer is the display layer formed at a first line of sight in front of the observation point, and the second display layer is the display layer formed at a second line of sight in front of the observation point. The second line of sight is greater than the first line of sight.

3. The display method according to claim 1 or 2, characterized in that, The display method further includes: When the first target is located within the spatial region between the first display layer and the second display layer, third information is displayed, the third information including transition information between the first information and the second information.

4. The display method according to any one of claims 1 to 3, characterized in that, The display method further includes: If the first target is located within the spatial region between the observation point and the second display layer, the display of the first information is canceled.

5. The display method according to claim 3, characterized in that, The display method further includes: If the first target is located within the spatial region between the observation point and the first display layer, the display of the third information is canceled.

6. The display method according to any one of claims 1 to 5, characterized in that, The display method further includes: When the second information is displayed on the second display layer, the pose of the second information displayed on the second display layer is updated based on the positional change between the first target and the observation point.

7. The display method according to any one of claims 1 to 6, characterized in that, The display device is mounted on the first vehicle, and the display method further includes: The fourth information, which includes the status information of the first vehicle, is displayed on the first display layer.

8. The display method according to claim 7, characterized in that, The display method further includes: If the display area of ​​the first information conflicts with the display area of ​​the fourth information, the first information shall be displayed first in the first display layer.

9. The display method according to any one of claims 1 to 8, characterized in that, The display area of ​​the display device further includes a third display layer; the display method further includes: The third display layer displays three-dimensional information corresponding to the second target, and the category of the first target is different from that of the second target.

10. The display method according to claim 9, characterized in that, The first display layer, the second display layer, and the third display layer are divided based on the line-of-sight distance. The first display layer is formed at a first line-of-sight distance in front of the observation point, the second display layer is formed at a second line-of-sight distance in front of the observation point, and the third display layer is formed at a third line-of-sight distance in front of the observation point. The third line-of-sight distance is greater than the second line-of-sight distance, and the second line-of-sight distance is greater than the first line-of-sight distance.

11. The display method according to any one of claims 1 to 10, characterized in that, The first target includes one or more of the following: obstacles, traffic lights, traffic signs, and road vehicles.

12. The display method according to any one of claims 1 to 11, characterized in that, The relevant information of the first target includes one or more of the following: risk information of the first target, attribute information of the first target, and location information of the first target.

13. The display method according to any one of claims 1 to 12, characterized in that, The display device includes at least one of the following: Augmented Reality Head-Up Display (AR-HUD), vehicle headlight module, and in-vehicle projector.

14. A display device, characterized in that, Includes units for performing the method as described in any one of claims 1 to 13.

15. A display device, characterized in that, Includes a processor for performing the method as described in any one of claims 1 to 13.

16. A chip, characterized in that, It includes logic circuits and interfaces, wherein the logic circuits and the interfaces are coupled; The interface is used for inputting and / or outputting information, and the logic circuit is used for performing the method as described in any one of claims 1 to 13.

17. A terminal, characterized in that, This includes the display device as described in claim 14, or the display device as described in claim 15.

18. The terminal according to claim 17, characterized in that, The terminal also includes a windshield; The light emitted from the display device passes through the windshield and forms a virtual image in front of the terminal.

19. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, which, when executed, performs the method as described in any one of claims 1 to 13.

20. A computer program product, characterized in that, The computer program product includes a computer program, which, when executed, performs the method as described in any one of claims 1 to 13.

21. A display system, characterized in that, It includes a display device and a sensing unit for performing the method as described in any one of claims 1 to 13, the sensing unit being used to sense the first target.

Images