Display method and related device

Abstract

The application discloses a display method and related device, which are applied to the field of display imaging technology. The display method is applied to a display device of a first terminal, and the display device is used for displaying information on a first display layer and a second display layer. The display method comprises the following steps: acquiring scene information of the first terminal, and determining a first target in an environment where the first terminal is located according to the scene information of the first terminal. In the case that the first target is located outside a space region range from an observation point to the second display layer, first identification information and first indication information are displayed on the first display layer, the first identification information comprises identification information of the first target, and the first indication information is used for pointing to the first target and performing linkage display following the first target. The method can timely and effectively present the related information of the first target to a user, more effectively present terminal information and environment perception information of the terminal to the user, improve information display efficiency, meanwhile, the cognitive efficiency of the user can be improved, and the driving safety of the terminal is ensured.

Description

Technical Field

[0001] The present application relates to the technical field of display imaging, and in particular to a display method and related apparatus. Background Art

[0002] With the development of the smart vehicle market, smart optical displays such as head up display (HUD) are increasingly becoming core components.

[0003] In HUD technology, field of view (FOV) and virtual image distance (VID) are important parameters that affect the imaging effect of HUD display technology. The larger the FOV and VID, the larger the display frame of the HUD, the higher the degree of integration between digital information and the display scene, and the better the experience of the driver.

[0004] At present, how to present vehicle information and real-scene information to users more effectively is a technical problem to be solved in the art. Summary of the Invention

[0005] Embodiments of the present application provide a display method and related apparatus, which can present vehicle information and real-scene information to users more effectively, and improve information display efficiency.

[0006] In a first aspect, embodiments of the present application provide a display method, which is applied to a display apparatus of a first terminal, and the display apparatus is configured to display information on a first display layer and a second display layer. The display method includes: acquiring scene information of the first terminal, and determining a first target in the environment where the first terminal is located according to the scene information of the first terminal. In a case that the first target is located outside the spatial region range between the observation point and the second display layer, displaying first identification information and first indication information on the first display layer, where the first identification information includes identification information of the first target, and the first indication information is used to point to the first target and perform linked display following the first target.

[0007] In the embodiments of the present application, a display method is provided. The display method can display information having a linkage relationship with the first target on the corresponding display layer according to the relative positional relationship between the first target and the spatial region between the observation point and the second display layer. Through the above-mentioned manner of performing linked display by combining the scene information and the first target, the relevant information of the first target can be presented to the user in a timely and effective manner, so that the terminal information and the environment perception information of the terminal can be presented to the user more effectively, the information display efficiency is improved, the user's cognitive efficiency can also be enhanced at the same time, and the driving safety of the terminal is guaranteed.

[0008] Optionally, the scene information of the first terminal includes the terminal information of the first terminal and / or the environmental perception information of the first terminal. Optionally, the first target can be understood as a target to be monitored (i.e., a target to be displayed) that has been filtered, such as obstacles, traffic facilities, traffic participants, etc. Optionally, the observation point can be understood as a certain observation point in the eye box area of ​​the driver on the first terminal, or an observation point that can observe the displayed content. Optionally, the spatial region between the observation point and the second display layer can be understood as a pyramidal (cone, triangular pyramid, square pyramid, etc.) spatial region formed with the observation point as the vertex and the second display layer as the base, or it can be a spatial region of other shapes. This application embodiment does not limit this.

[0009] In one possible implementation, the first display layer and the second display layer are divided based on the line-of-sight distance. The first display layer is the display layer formed at a first line-of-sight distance in front of the observation point, and the second display layer is the display layer formed at a second line-of-sight distance in front of the observation point. The second line-of-sight distance is greater than the first line-of-sight distance.

[0010] In this embodiment, the first and second display layers are divided based on viewing distance. The first display layer can be understood as a near-focus layer, and the second display layer can be understood as a far-focus layer. By using a layered display method with different viewing distances and combining scene information to enable the different display layers to be displayed in conjunction with the first target, augmented reality display of terminal information and the terminal's environmental perception information can be achieved, improving information display efficiency. At the same time, it can also enhance the user's cognitive efficiency and ensure the terminal's driving safety.

[0011] Optionally, the first and second display layers can also be divided based on the position of the display area of ​​the display device. For example, the first display layer may be located to the left of the display area, and the second display layer may be located to the right of the display area. Or, for example, the first display layer may be located below the display area, and the second display layer may be located above the display area, etc. This application embodiment does not impose any limitations on this. By using a layered display method with different area positions, terminal information and the terminal's environmental awareness information can be displayed in layers, presenting them more clearly to the user and improving information display efficiency.

[0012] In one possible implementation, the above display method may also perform the following steps, including but not limited to: when the first target is located within the spatial region between the observation point and the second display layer, cancel the first identification information displayed on the first display layer.

[0013] In this embodiment, when the first target enters the FOV corresponding to the second display layer, the first identification information displayed on the first display layer can be canceled to reduce the user's cognitive load and improve information display efficiency. Furthermore, the first indicator information on the first display layer can point to the first target and follow it in a linked display, presenting relevant information about the first target to the user in a timely and effective manner, improving the user's cognitive efficiency and ensuring the terminal's driving safety.

[0014] In one possible implementation, the above display method may also perform the following steps, including but not limited to: when the first target is located in the spatial region between the observation point and the second display layer, displaying second indication information on the second display layer, the second indication information being used to follow the first identification information to the first target or the second identification information for linked display, the second identification information being associated with the first identification information.

[0015] In this embodiment, when the first target enters the FOV corresponding to the second display layer, second indicator information can be displayed on the second display layer. This second indicator information enables a linked display from the first identification information to the first target or the second identification information. This can be understood as switching the first identification information displayed on the first display layer to the second display layer through a strong linkage. Optionally, this strong linkage can be understood as the first identification information displayed on the first display layer triggering an animation effect, and the second identification information or the first target displayed on the second display layer directly receiving the animation effect. Furthermore, the first identification information and the second identification information / first target are interconnected through directly and closely mapped continuous animation effects. Through this embodiment, the first identification information displayed on the first display layer can be switched to the second display layer through a strong linkage, making the process of information flowing from the first display layer to the second display layer for augmented reality display more coherent, effectively improving the continuity of information display, reducing cognitive load, improving user cognitive efficiency, and ensuring driving safety.

[0016] In one possible implementation, the above display method may also perform the following steps, including but not limited to: displaying second identification information on a second display layer, the second identification information being associated with the first identification information.

[0017] In this embodiment, when the first target enters the FOV corresponding to the second display layer, the first identification information displayed on the first display layer can be canceled, and correspondingly, second identification information can be displayed on the second display layer. This second identification information is associated with the first identification information; it can be understood that the relevant information canceled from display on the first display layer is switched to display on the second display layer through a weak linkage. Optionally, this weak linkage can be understood as the first identification information displayed on the first display layer emitting a motion effect, and the second identification information displayed on the second display layer indirectly receiving the motion effect, with the color, size, and motion trend of the first and second identification information interconnected. Through this embodiment, not only can the first identification information be canceled from display on the first display layer to reduce the user's cognitive load, but the relevant information canceled from display on the first display layer can also be switched to display on the second display layer through a weak linkage, so that the relevant information of the first target is presented to the user more clearly and effectively, improving information display efficiency and enhancing the user's cognitive efficiency, thus ensuring the terminal's driving safety.

[0018] In one possible implementation, the second identification information described above is used to indicate the first target.

[0019] In this embodiment, the second identification information is used to indicate the first target. Specifically, it can be displayed directly at the location of the first target, or it can be displayed at other locations related to the first target. This embodiment does not limit this.

[0020] In one possible implementation, before displaying the second instruction information on the second display layer, the above display method may also perform the following steps, including but not limited to: canceling the first instruction information displayed on the first display layer.

[0021] In this embodiment, before switching the relevant information that has been canceled from display on the first display layer to the second display layer through strong linkage, weak linkage, or other linkage methods, the first instruction information displayed on the first display layer can also be canceled to reduce the user's cognitive load and improve information display efficiency.

[0022] In one possible implementation, the second indication information includes one or more of the following display elements: waves, light carpet, halo, and aura.

[0023] In this embodiment, the second instruction information can be presented through any one or more of the aforementioned display elements. Optionally, the second instruction information can also be displayed through gradient transitions, distortion, path animation, collage animation, etc., and this application embodiment does not impose any limitations on this. By displaying the second instruction information, the process of information flowing from the first display layer to the second display layer for augmented reality display can be made more coherent, effectively improving the continuity of information display, reducing cognitive load, improving the user's cognitive efficiency, and ensuring the driving safety of the terminal.

[0024] In one possible implementation, the first objective includes any one or more of the following: obstacles, traffic facilities, and traffic participants.

[0025] In this embodiment, obstacles include, but are not limited to, static obstacles (such as fences, water-filled barriers, temporarily parked vehicles, etc.) and dynamic obstacles (such as pedestrians, animals, and moving vehicles). Traffic facilities include, but are not limited to, traffic lights and traffic signs, wherein traffic lights include, but are not limited to, red and green lights and hazard warning lights, and traffic signs include, but are not limited to, speed limit signs, no-entry signs, and dedicated lane signs. Traffic participants include, but are not limited to, road vehicles, pedestrians, and pets, and road vehicles include, but are not limited to, vehicles that are moving, temporarily parked, or blocking the road.

[0026] In one possible implementation, the display device includes at least one of the following: a head-up display (HUD), a vehicle headlight module, and a vehicle-mounted projector.

[0027] In this embodiment, the above-mentioned display device can display images in various ways, including but not limited to projection, light projection, and display screen. The displayed image can be a real image or a virtual image, and this application embodiment does not limit this.

[0028] In one possible implementation, the display device is a HUD, and the second display layer is superimposed on the real scene where the first terminal is located. The HUD is used to form a virtual image on the first display layer and the second display layer.

[0029] Secondly, embodiments of this application provide a display device including a unit for performing the method as described in any of the first aspects.

[0030] In one possible design, the device includes:

[0031] The processing unit is used to acquire scene information from the first terminal.

[0032] The processing unit is also used to determine the first target in the environment where the first terminal is located based on the scene information of the first terminal.

[0033] The processing unit is further configured to instruct the display unit to display first identification information and first instruction information on the first display layer when the first target is located outside the spatial area between the observation point and the second display layer. The first identification information includes the identification information of the first target, and the first instruction information is used to point to the first target and follow the first target for linkage display.

[0034] In one possible implementation, the device further includes a communication unit.

[0035] The processing unit is used to obtain scene information of the first terminal through the communication unit.

[0036] In one possible implementation, the device further includes a display unit.

[0037] The display unit is used to display first identification information and first instruction information on the first display layer.

[0038] Regarding the processing unit and communication unit described in the second aspect and any possible implementation, the steps performed thereon can be referred to the corresponding implementations in the first aspect.

[0039] For the technical effects of the second aspect and any possible implementation, please refer to the description of the technical effects corresponding to the first aspect and the corresponding implementation.

[0040] Optionally, in the display device described in the second aspect above and any possible embodiment:

[0041] In one implementation, the display device is a display apparatus. When the display device is a display apparatus, the communication unit can be a transceiver or an input / output interface; the processing unit can be at least one processor. Optionally, the transceiver can be a transceiver circuit. Optionally, the input / output interface can be an input / output circuit.

[0042] In another implementation, the display device is a chip (system) or circuit used in a display device. When the display device is a chip (system) or circuit used in a display device, the communication unit can be a communication interface (input / output interface), interface circuit, output circuit, input circuit, pin, or related circuit on the chip (system) or circuit; the processing unit can be at least one processor, processing circuit, or logic circuit.

[0043] Thirdly, embodiments of this application provide a display device including a processor. The processor is coupled to a memory and can be used to execute instructions in the memory to implement the methods described in the first aspect and any of the possible implementations. Optionally, the display device further includes a memory. Optionally, the display device further includes a communication interface, and the processor is coupled to the communication interface.

[0044] Fourthly, embodiments of this application provide a chip, including: logic circuitry and a communication interface. The communication interface is used to receive or send information; the logic circuitry is used to receive or send information through the communication interface, causing the chip to execute the methods described in the first aspect and any of the possible implementations.

[0045] Fifthly, embodiments of this application provide a computer-readable storage medium for storing a computer program (also referred to as code or instructions); when the computer program is run on a computer, the methods described in the first aspect and any possible implementation are implemented.

[0046] Sixthly, embodiments of this application provide a computer program product, the computer program product comprising: a computer program (also referred to as code or instructions); and, when the computer program is run, causing a computer to perform the methods described in the first aspect and any possible implementation thereof.

[0047] In a seventh aspect, embodiments of this application provide a display system including a display device and a sensing unit for performing the methods described in the first aspect and any possible implementation thereof. The sensing unit is used to sense the environment in which a first terminal is located.

[0048] Eighthly, embodiments of this application provide a terminal, which includes at least one display device as described in the second aspect, or the display device as described in the third aspect, or the chip as described in the fourth aspect, or the display system as described in the seventh aspect.

[0049] Optionally, the terminal further includes a light-transmitting component, through which the light emitted from the display device or display system forms a virtual image in front of the terminal. For example, the light-transmitting component may be a windshield.

[0050] Optionally, the terminal can be a means of transportation, such as a car, truck, aircraft, drone, slow transport vehicle, spacecraft, or ship, or any other possible means of transportation used in any possible scenario. This application embodiment does not limit this.

[0051] Optionally, the terminal is used to implement the method described in the first aspect and any possible implementation.

[0052] Furthermore, in the process of performing the method described in the first aspect and any possible implementation above, the processes related to sending and / or receiving information in the above methods can be understood as the process of the processor outputting information, and / or the process of the processor receiving input information. When outputting information, the processor can output the information to a transceiver (or communication interface, or transmitting module) so that the transceiver can transmit it. After the information is output by the processor, it may need to undergo other processing before reaching the transceiver. Similarly, when the processor receives input information, the transceiver (or communication interface, or transmitting module) receives the information and inputs it to the processor. Furthermore, after the transceiver receives the information, the information may need to undergo other processing before being input to the processor.

[0053] Based on the above principles, for example, the information sent mentioned in the aforementioned method can be understood as information output by the processor. Similarly, the information received can be understood as information received by the processor from input.

[0054] Optionally, unless otherwise specified, or unless they contradict their actual function or internal logic in the relevant description, the operations of the processor, such as transmitting, sending, and receiving, can be more generally understood as processor output and receiving, input, and other operations.

[0055] Optionally, in performing the methods described in the first aspect and any possible implementation above, the processor may be a processor specifically designed to perform these methods, or it may be a processor that performs these methods by executing computer instructions stored in memory, such as a general-purpose processor. The memory may be a non-transitory memory, such as read-only memory (ROM), which may be integrated with the processor on the same chip or disposed on different chips. This application does not limit the type of memory or the arrangement of the memory and processor.

[0056] In one possible implementation, at least one of the aforementioned memories is located outside the device.

[0057] In yet another possible implementation, at least one of the aforementioned memories is located within the device.

[0058] In another possible implementation, a portion of the memory of the at least one memory is located inside the device, while another portion is located outside the device.

[0059] In this application, the processor and memory may also be integrated into a single device, that is, the processor and memory can be integrated together. Attached Figure Description

[0060] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0061] Figure 1 A schematic diagram of a field of view provided for an embodiment of this application;

[0062] Figure 2 A schematic diagram illustrating a virtual image distance provided in an embodiment of this application;

[0063] Figure 3 A schematic diagram illustrating an application scenario of a display device in the automotive field, provided as an embodiment of this application;

[0064] Figure 4 This is a schematic diagram illustrating another perspective on the application scenario of a display device in the automotive field, as provided in an embodiment of this application.

[0065] Figure 5 An imaging schematic diagram illustrating how a display device, as provided in this application, projects an image onto a driver's eye in the automotive field;

[0066] Figure 6 A schematic flowchart illustrating a display method provided in an embodiment of this application;

[0067] Figure 7 A schematic diagram of a display architecture provided in an embodiment of this application;

[0068] Figure 8 A schematic diagram illustrating a layered display provided in an embodiment of this application;

[0069] Figures 9A to 9C A schematic diagram of a dual-focus strong linkage display provided in an embodiment of this application;

[0070] Figures 10A to 10D A schematic diagram of a dual-focus weak linkage display provided in an embodiment of this application;

[0071] Figures 11A to 11E A schematic diagram illustrating dual-focus strong linkage and weak linkage display provided in the embodiments of this application;

[0072] Figure 12 This is a schematic diagram of the structure of a display device provided in an embodiment of this application;

[0073] Figure 13 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0074] Figure 14 This is a schematic diagram of the structure of a chip provided in an embodiment of this application. Detailed Implementation

[0075] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described below with reference to the accompanying drawings.

[0076] The terms "first" and "second," etc., used in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0077] The term "embodiment" as used herein means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that, unless otherwise specified or logically conflicting, the terminology and / or descriptions between the various embodiments of this application are consistent and can be mutually referenced, and technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0078] It should be understood that in this application, "at least one (item)" means one or more, "more than one" means two or more, "at least two (items)" means two or three or more, and "and / or" is used to describe the relationship between related objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0079] It should be noted that, in this application, "instruction" can include direct instruction, indirect instruction, explicit instruction, and implicit instruction. When describing a certain instruction information for the purpose of instructing A, it can be understood that the instruction information carries A, directly instructs A, or indirectly instructs A.

[0080] In this application, the information indicated by the instruction information is called the information to be instructed. In specific implementations, there are many ways to indicate the information to be instructed, such as, but not limited to, directly indicating the information to be instructed, such as the information to be instructed itself or its index. It can also indirectly indicate the information to be instructed by indicating other information, where there is a correlation between the other information and the information to be instructed. It can also indicate only a part of the information to be instructed, while the other parts are known or pre-agreed upon. For example, the instruction of specific information can be achieved by using a pre-agreed (e.g., protocol-defined) arrangement of various information, thereby reducing instruction overhead to some extent. The information to be instructed can be sent as a whole or divided into multiple sub-information units, and the sending period and / or timing of these sub-information units can be the same or different. This application does not limit the specific sending method. The sending period and / or timing of these sub-information units can be predefined, for example, according to a protocol, or configured by the transmitting device by sending configuration information to the receiving device.

[0081] It should be noted that in this application, "send" can be understood as "output" and "receive" can be understood as "input". "Send information to A", where "to A" simply indicates the direction of information transmission, and A is the destination, does not limit "send information to A" to a direct transmission over the air interface. "Send information to A" includes sending information directly to A, as well as sending information indirectly to A through a transmitter. Therefore, "send information to A" can also be understood as "outputting information destined for A". Similarly, "receive information from A" indicates that the source of the information is A, including receiving information directly from A, as well as receiving information indirectly from A through a receiver. Therefore, "receive information from A" can also be understood as "inputting information from A".

[0082] To more clearly describe the solution of this application, some terms used in the embodiments of this application will be explained below.

[0083] Head-up display (HUD): Also known as a head-up display system, it refers to a multi-functional instrument panel centered on the driver and operated blindly. The HUD projects vehicle instrument information (such as speed, RPM, temperature, fuel level, etc.) and navigation information into the driver's field of vision. The driver can see the vehicle's instrument and navigation information directly in front of them without needing to look down at the instrument panel or central control display below the steering wheel. This improves braking reaction time in emergency situations and enhances driving safety and convenience.

[0084] Augmented reality head-up display (AR-HUD): This is a combination of holographic augmented reality (AR) technology and head-up display (HUD) functionality. Through computational processing, it overlays the acquired image information onto the real three-dimensional environment in front of the driving route. It can integrate information such as distance, speed, and navigation into the real-world view obtained by the driver. The combination of computational data and display scene makes digital information richer and more intuitive, improving the driving experience and driving safety.

[0085] Field of view (FOV): Also known as the field of view, it refers to the maximum solid angle between the edge of the displayed image and the image acquisition center. For example, in optical measurement equipment, the image acquisition center is the center of the lens of the optical measurement equipment. The target image measured by the optical measurement equipment can pass through the lens, and the angle formed by the two edges that present the largest range through the lens is the field of view. Similarly, in display devices, the field of view is the angle between the two edges of the image displayed on the imaging mechanism and the center point of the display device's lens, usually the two edge points with the largest distance. In the field of head-up displays, the image acquisition center is the human pupil. In the display field, FOV generally includes the vertical field of view, the horizontal field of view, and the diagonal field of view. Optionally, see [link to relevant documentation]. Figure 1 , Figure 1 A schematic diagram of a field of view provided for an embodiment of this application, as shown below. Figure 1 As shown, Figure 1 Point O in the diagram is the image acquisition center, the quadrilateral enclosed by ABCD is the display image, the angle between lines OA and OB can be the horizontal field of view, the angle between lines OB and OC can be the vertical field of view, and the angle between lines OA and OC can be the diagonal field of view. It should be noted that, unless otherwise specified, the default field of view is generally the horizontal and vertical field of view.

[0086] Virtual image distance (VID): Also known as virtual image distance, it refers to the distance from the displayed virtual image to the image acquisition center. In the field of head-up displays, the image acquisition center is the pupil of the human body. Optionally, please refer to [further details]. Figure 2 , Figure 2 A schematic diagram of a virtual image distance provided in an embodiment of this application is shown below. Figure 2 As shown, in a head-up display system, the virtual image distance is the straight-line distance between the human pupil and the virtual image.

[0087] Please see Figures 3 to 5 , Figure 3 This illustration shows an application scenario of a display device 100 provided in this application in the automotive field. Figure 4 This illustration shows another perspective on the application scenario of a display device 100 provided in this application embodiment in the automotive field. Figure 5 This illustration shows an imaging schematic diagram of a display device 100 according to an embodiment of this application, which projects an image onto the driver's eye in the automotive field. Figure 3 and Figure 4 The display device 100 projects an image into the driver's eyes, allowing the driver to see virtual image information.

[0088] Depend on Figures 3 to 5 As can be seen, when the driver looks out through the windshield 200, they can see a virtual image with a certain depth of field (i.e., the distance of the clear image within the range before and after the focal point of the image). Information acquisition modules, such as cameras and infrared sensors, acquire information about the road ahead, including distance to the vehicle in front, the speed of the vehicle in front, and other road information. This digital information is projected onto an image closely integrated with the surrounding environment. This digital information includes: vehicle speed, navigation information (road directions), vehicle gear, cruise control, distance to the vehicle in front, speed of the vehicle in front, engine speed, battery level, remaining driving range, and infotainment system information. This allows the driver to access necessary information without shifting their gaze while driving, avoiding the driving risks that might arise from neglecting road conditions while looking down at the instrument panel or central control screen.

[0089] To achieve the aforementioned display, the vehicle needs to be equipped with a head-up display (HUD) system. The HUD system may include a display device 100 and optical elements. The display device 100 can project images, and the optical elements may include the vehicle's windshield 200, a reflective film attached to the windshield 200, or a separate screen installed in the vehicle's cabin. The optical elements can reflect and / or refract the image projected by the display device 100 and project it into the driver's eyes, allowing the driver to obtain a virtual information image in front of the windshield 200. Optionally, the display device 100 has one or more interfaces through which current and / or image signals are obtained from the vehicle's central control system or vehicle infotainment system. The current signals are used to power the electrical components in the display device 100, and the image signals are used to provide the displayed image.

[0090] In the automotive industry, over 100 head-up display (HUD) devices are located on the center console. (See also...) Figure 3 , Figure 4 , Figure 5 As shown, the display device 100 can be installed in the center console and located in front of the steering wheel (in the direction of the car's travel).

[0091] In some embodiments, based on imaging technologies such as holographic optical element (HOE), HUD can also display images directly on the windshield or other devices, allowing the driver to obtain a real image superimposed on a real scene image. Through enhanced display or naked-eye 3D technology, the driver can obtain a visual experience with stereoscopic depth and perspective.

[0092] It should be noted that the vehicles used in the embodiments of this application are all exemplified as automobiles and should not be considered as limitations on the embodiments of this application. The vehicle can be a traditional gasoline-powered vehicle, or a new energy vehicle such as a pure electric vehicle or a hybrid vehicle. The vehicle can be any of different types of automobiles, such as sedans, trucks, passenger buses, and sport utility vehicles (SUVs), or it can be a land transportation device for carrying people or goods, such as a tricycle, motorcycle, or train. Alternatively, the display device of this application can also be applied to other types of transportation vehicles such as airplanes and ships.

[0093] In the field of head-up displays, the field of view can be 15×5 degrees. Here, 15 degrees refers to a horizontal field of view of 15 degrees. (See [reference needed]). Figure 1As shown, the angle between lines OA and OB can be considered; 5 degrees refers to the vertical field of view, which can be the angle between lines OB and OC. Normally, the size of a person's retina is limited, and the field of view (FOV) of both eyes is generally between 90 and 120 degrees (which can be either horizontal or vertical). Through binocular parallax, the human eye can perceive the 3D state of objects. Increasing the FOV of a display device improves the fit between virtual and real images, increases the coverage area of ​​the virtual image, and correspondingly improves the driver's visual experience.

[0094] In the field of head-up displays (HUDs), the viewing distance (VID) can be 7.5 meters. (See also...) Figure 2 As shown, VID (Visual ID) represents the distance between the image of the front of the vehicle and the driver's eyes. Increasing the VID of the display device improves the depth of the virtual image relative to the driver's field of vision, resulting in a higher degree of fit between the virtual image and the distant real-world image, and a more realistic 3D effect. Furthermore, the increased VID reduces the need for frequent zooming when viewing displayed and virtual image information, improving driver comfort and consequently increasing driving safety.

[0095] In HUD technology, FOV and VID are important parameters affecting the imaging effect of HUD display technology. The larger the FOV and VID, the larger the display area of ​​the HUD, the higher the degree of integration between digital information and the display scene, and the better the driver's experience.

[0096] Currently, some real-world information in intelligent driving scenarios exceeds the display area of ​​the HUD and cannot be displayed in a timely and intuitive manner. When faced with this type of real-world information, drivers need to frequently check the corresponding locations on the navigation map and in the real world, resulting in low information display efficiency, high cognitive load, and impacting driving safety.

[0097] Therefore, how to present vehicle information and real-world information to users more effectively is a technical problem that needs to be solved in this field.

[0098] In view of this, embodiments of this application provide a display method and related apparatus, relating to the field of display imaging technology, which can more effectively present vehicle information and real-scene information to users and improve information display efficiency.

[0099] The display method and related devices provided in this application will now be described in conjunction with the accompanying drawings.

[0100] Please see Figure 6 , Figure 6 This is a schematic flowchart illustrating a display method provided in an embodiment of this application. This display method is applied in the field of display imaging technology, including but not limited to HUD displays.

[0101] Specifically, this display method is applied to a display device for displaying information on a first display layer and a second display layer. The display method includes, but is not limited to, the following steps:

[0102] S601: The display device acquires scene information from the first terminal.

[0103] Optionally, the scene information of the first terminal includes, but is not limited to, the terminal information of the first terminal and / or the environmental perception information of the first terminal.

[0104] Optionally, taking a vehicle as the first terminal as an example, the terminal information of the first terminal may include, but is not limited to: the vehicle's motion status (e.g., whether the vehicle is in a parked state or in a driving state), the vehicle's driving speed, the vehicle's battery level and / or fuel level, the vehicle's lighting information (e.g., whether the low beam headlights, high beam headlights, turn signals, side marker lights, fog lights, etc. are turned on), whether the vehicle is in intelligent driving state, etc.

[0105] Optionally, taking a vehicle as an example, the environmental perception information of the first terminal includes, but is not limited to: obstacles in the environment where the vehicle is located, traffic facilities (such as traffic lights and traffic signs), traffic participants (such as road vehicles and pedestrians), weather conditions, etc.

[0106] Optionally, the display device can be... Figure 7 The display architecture shown obtains scene information from the first terminal. Figure 7 This is a schematic diagram of a display architecture provided in an embodiment of this application.

[0107] like Figure 7 As shown, the display architecture includes, but is not limited to, a display device and a display control device. The display control device acquires navigation information from, but is not limited to, a navigation module; perception information from perception modules such as cameras, lidar, and millimeter-wave radar; and terminal information from the cockpit domain controller. Based on this acquired information, it adjusts the parameters of the display device to control its display.

[0108] Accordingly, the display device acquires scene information (including but not limited to the aforementioned types of information) from the first terminal through the display control device. Optionally, the terminal information of the first terminal may come from the aforementioned navigation module and cockpit domain controller, and the environmental perception information of the first terminal may come from the aforementioned camera, lidar, millimeter-wave radar, and other perception modules. The display device includes, but is not limited to, a control module, an image generation module, and optical elements. The control module controls the image generation module to generate image information based on the scene information of the first terminal, and controls the generated image information to be processed by optical elements to form a real or virtual image.

[0109] It is understood that the display device in the embodiments of this application may be a device equipped with a processor / chip that can execute computer execution instructions, or it may be a processor / chip that can execute computer execution instructions. Optionally, the display device may be an electronic device, or it may be a processor / chip within an electronic device, or it may be one of the above-mentioned... Figures 3 to 5 The display device in the present application is used to execute the display method in the embodiments of the present application, so as to present vehicle information and real-scene information to the user more effectively and improve information display efficiency.

[0110] Optionally, the display device may specifically include, but is not limited to, any one or more of the following: a head-up display (HUD), a vehicle headlight module, and a vehicle-mounted projector. It is understood that the above-mentioned display device can display images through various means, including but not limited to projection, light projection, and a display screen. The displayed image can be a real image or a virtual image, and this application embodiment does not impose any limitations on this.

[0111] Optionally, the display device and display method in the embodiments of this application can be applied to, but are not limited to, vehicle systems. The vehicle equipped with the vehicle system is an intelligent driving vehicle and can be replaced by a terminal device. The terminal device can be, but is not limited to, vehicles such as commercial vehicles, passenger cars, trains, industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), robots, etc. The embodiments of this application do not specifically limit this.

[0112] S602: The display device determines the first target in the environment where the first terminal is located based on the scene information of the first terminal.

[0113] Optionally, the first target can be understood as a target to be monitored (i.e., a target to be displayed) that has already been screened. Optionally, the first target may include, but is not limited to, any one or more of the following: obstacles, traffic facilities, and traffic participants.

[0114] For example, obstacles include, but are not limited to, static obstacles (such as fences, water-filled barriers, temporarily parked vehicles, etc.) and dynamic obstacles (such as pedestrians, animals, moving vehicles, etc.).

[0115] For example, traffic facilities include, but are not limited to, traffic lights and traffic signs. Traffic lights include, but are not limited to, red and green lights and hazard warning lights, while traffic signs include, but are not limited to, speed limit signs, no-entry signs, and dedicated lane signs.

[0116] For example, traffic participants include, but are not limited to, road vehicles, pedestrians, pets, etc., and road vehicles include, but are not limited to, vehicles that are traveling, temporarily parked, or blocking the road.

[0117] Optionally, the first terminal can collect one or more candidate targets through sensors, such as cameras, radar, and other sensing devices, and provide them to the intelligent driving system or other recognition system. Based on screening conditions, such as collision risk, traffic light warning conditions, etc., the intelligent driving system or other recognition system determines one or more targets to be monitored from multiple candidate targets and displays them on a display device.

[0118] S603: When the first target is located outside the spatial area between the observation point and the second display layer, the display device displays the first identification information and the first instruction information on the first display layer.

[0119] Optionally, the aforementioned observation point can be understood as a point in the driver's pupil or an area of ​​the eye box on the first terminal where the displayed content can be observed.

[0120] Optionally, the specific details of the first display layer and the second display layer can be found in [reference needed]. Figure 8 , Figure 8 This is a schematic diagram of a layered display provided in an embodiment of this application.

[0121] like Figure 8 As shown, the display device on vehicle 801 uses the driver's pupil as the observation point O. Along the dashed lines containing points O, A1, and A2; points O, B1, and B2; points O, C1, and C2; and points O, D1, and D2, the image passes through the windshield of vehicle 801 and is projected onto the area in front of vehicle 801, forming a spatial region defined by point O and the aforementioned four dashed lines. This spatial region can be considered the display area of ​​the display device. When the driver looks out through the windshield of vehicle 801, they can see display content with a certain depth of field (i.e., the distance of the clear image presented within the range before and after the image focal point) within this display area. This display content is superimposed on the real-world image (such as car 802, pedestrian 805, and traffic light 803). Within this display area, A1, B1, C1, and D1 constitute the first display layer, and A2, B2, C2, and D2 constitute the second display layer.

[0122] It is understood that the solid lines connecting A1, B1, C1, and D1, and the solid lines connecting A2, B2, C2, and D2 are only for illustration of a display layer and are not actually displayed. They should not be used to limit the embodiments of this application.

[0123] It is understandable that the first and second display layers in the aforementioned spatial region can be the location where the displayed content is imaged, or the location where the displayed content is perceived from the driver's perspective. For example, if the display device is a HUD based on virtual image display technology, the first display layer is the location where virtual image 1 is imaged, also known as the focal plane or imaging plane, and the second display layer is the location where virtual image 2 is imaged. As another example, if the display device is a HUD based on real image display technology, the first display layer is the location where displayed content 1 is carried on a real-world image as perceived by the driver, and the second display layer is the location where displayed content 2 is carried on a real-world image.

[0124] Understandable Figure 8 The rectangular display layer shown is for illustrative purposes only and should not be construed as limiting the embodiments of this application. In fact, the display layer formed by the display device can also be any regular or irregular shape such as a circle, triangle, rhombus, or trapezoid, and the embodiments of this application do not impose any restrictions on this.

[0125] Depend on Figure 8 It can be seen that the spatial region between the observation point O and the second display layer (A2, B2, C2, D2) can be understood as a four-pyramidal spatial region formed by the observation point O as the vertex and the second display layer (A2, B2, C2, D2) as the base, along the dotted line.

[0126] Understandable Figure 8 The four-pyramidal spatial region shown is only an illustrative example and should not be construed as limiting the embodiments of this application. In fact, the spatial region between the observation point and the display layer can also be any regular or irregular shaped spatial region such as a cone or a triangular pyramid, and the embodiments of this application do not impose any restrictions on this.

[0127] Understandable Figure 8 The first display layer (A1, B1, C1, D1) and the second display layer (A2, B2, C2, D2) shown are two parallel display surfaces. The relative spatial positions of the first display layer and the second display layer should not be used to limit the embodiments of this application. In fact, the first display layer and the second display layer can also be located on the same plane without being limited to the display area, located on different planes and parallel to each other, or located on different planes and intersecting.

[0128] Depend on Figure 8It can also be seen that, based on the relative positional relationship between the first target and the second display layer (A2, B2, C2, D2) and the first display layer (A1, B1, C1, D1), the distance between the first target and the observation point can be determined, thereby determining the information displayed on the first display layer and / or the second display layer. For example, if vehicle 806 and pedestrian 804 are outside the FOV of the display device, warning information can be displayed on the first display layer. This warning information is used to point to vehicle 806 and pedestrian 804 and is displayed in conjunction with vehicle 806 and pedestrian 804. Traffic light 803 is located within the spatial area between observation point O and the second display layer (A2, B2, C2, D2), and also within the spatial area between the first display layer (A1, B1, C1, D1) and the second display layer (A2, B2, C2, D2). Therefore, relevant information linked to traffic light 803 can be directly displayed on the second display layer (A2, B2, C2, D2). When vehicle 802 and pedestrian 805 are within the FOV of the display device and at a relatively far distance, warning information can be displayed on the first display layer. This warning information is used to point to vehicle 802 and pedestrian 805 and is displayed in conjunction with vehicle 802 and pedestrian 805.

[0129] Optionally, the relative positional relationship between the spatial regions of the first target and the second display layer (A2, B2, C2, D2) and the first display layer (A1, B1, C1, D1) can be determined by the display device itself, or by the intelligent assisted driving system, or by other controllers, and then the determination result is output to the display device. This application embodiment does not limit this.

[0130] The aforementioned first identification information includes the identification information of the first target, and the first indication information is used to point to the first target and follow the first target for linkage display.

[0131] Optionally, the identification information of the first target can be two-dimensional information corresponding to the first target or three-dimensional information corresponding to the first target. This application embodiment does not limit this.

[0132] For example, the identification information of the first target can be used to identify the risk information of the first target (e.g., the collision risk between the first target and the first terminal), the attribute information of the first target (e.g., the type of the first target, the state of the first target, etc.), and the location information of the first target (e.g., the distance of the first target relative to the first terminal).

[0133] Optionally, the first indication information pointing to the first target and displaying in conjunction with the first target can be achieved through two-dimensional information or three-dimensional information, and this application embodiment does not limit this.

[0134] For example, the first instruction information points to the first target and follows the first target in a linked display. For instance, an arrow can point to the first target and move accordingly as the position of the first target changes, so as to follow the first target in a linked display. This achieves accurate alignment with the real-world information of the first target and timely and effectively presents the risk information, attribute information, and location information of the first target to the user. Even if the risk target has not yet entered the user's field of vision, the risk target can be provided to the user in advance through the identification information. The instruction information can also follow the movement of the risk target in real time, improving the user's attention and focus, and enhancing driving safety.

[0135] In summary, the display method in this application embodiment displays information that is linked to the first target on the corresponding display layer according to the relative positional relationship between the first target and the spatial region between the observation point and the second display layer.

[0136] By combining scene information with the first target for linked display, relevant information about the first target (such as risk information, type information, location information, and motion status information) can be presented to the user in a timely and effective manner. This enables the terminal information and environmental perception information to be presented to the user more effectively, improving information display efficiency and enhancing the user's cognitive efficiency, thus ensuring the terminal's driving safety.

[0137] In one possible embodiment, the first display layer and the second display layer can be divided based on different dimensions, which can be specifically described in the following cases.

[0138] Scenario 1:

[0139] The first and second display layers are divided based on viewing distance.

[0140] The first display layer is formed at the first line of sight in front of the observation point, and the second display layer is formed at the second line of sight in front of the observation point. The second line of sight is greater than the first line of sight, as detailed above. Figure 8 As shown.

[0141] It is understandable that the first display layer can be understood as the near-focus layer, and the second display layer can be understood as the far-focus layer.

[0142] It is understood that the viewing distance is the distance from the observation point to the display layer. This distance can be the distance from the observation point to the center point of the display layer, or the maximum distance from the observation point to any point within the display layer. The specific distance can be determined depending on different driving scenarios, and this application embodiment does not impose any limitations on this. Optionally, in the field of head-up displays, this viewing distance can refer to the description of the virtual image distance above, and will not be repeated here. Optionally, the aforementioned observation point can be understood as the driver's pupil in the vehicle or a certain observation point within the eye-box area where the displayed content can be observed.

[0143] It is understandable that by using layered display methods with different viewing distances and adjusting the display status of the display layers at different viewing distances in conjunction with scene information, it is possible to achieve augmented reality display of terminal information and terminal environmental perception information, improve information display efficiency, enhance user cognitive efficiency, and ensure the driving safety of the terminal.

[0144] Scenario 2:

[0145] The first and second display layers are divided based on the location of the display area.

[0146] For example, the first display layer is located on the left side of the display area, and the second display layer is located on the right side of the display area.

[0147] For example, the first display layer may be located below the display area, and the second display layer may be located above the display area, etc. The embodiments of this application do not limit this.

[0148] Understandably, by displaying terminal information and its environmental awareness information in different areas, the terminal information and environmental awareness information can be displayed in layers, presenting them to the user more clearly and improving information display efficiency.

[0149] It should be understood that the accompanying drawings and embodiments in this application are described using Case 1 as an example to illustrate the display method. The display method corresponding to Case 2 is similar to that corresponding to Case 1, so it will not be described again.

[0150] Scenario 3:

[0151] The first display layer is used to display non-real-scene overlay information, and the second display layer is used to display real-scene overlay information.

[0152] It should be understood that the above scenarios one, two, and three are merely three examples to illustrate the division of the first and second display layers, and should not be construed as limiting the embodiments of this application.

[0153] It should be understood that any new embodiments obtained by reasonable modifications, combinations or additions to the above-mentioned situations one, two and three are all within the protection scope of the embodiments of this application.

[0154] Through the embodiments of this application, the first display layer and the second display layer can be divided based on multiple dimensions such as viewing distance, position, and real-scene overlay information, which can adapt to different display scenarios, making the layout of the displayed content more reasonable and providing users with a better visual experience. For example, the division based on viewing distance is suitable for scenarios with different focal plane imaging; the division based on display area is applied to scenarios with a large FOV; and the division based on real-scene overlay information is applied to scenarios with different imaging properties.

[0155] In one possible embodiment, the above display method may also perform the following steps, including but not limited to:

[0156] When the first target is located within the spatial region between the observation point and the second display layer, the display device cancels the first identification information displayed on the first display layer.

[0157] Understandably, when the first target enters the FOV corresponding to the second display layer, the first identification information displayed on the first display layer can be canceled. As the actual risk target enters the user's field of vision, canceling the risk target's identification information allows the user to know that the risk target has moved from outside the field of vision to a position closer to the vehicle, avoiding information interference and confusion, thereby reducing the user's cognitive load and improving information display efficiency.

[0158] In addition, the first indicator information of the first display layer can be used to point to the first target and follow the first target for linkage display, so as to present the relevant information of the first target (such as the risk information, type information, location information, motion status information, etc. of the first target) to the user in a timely and effective manner, improve the user's cognitive efficiency, and ensure the driving safety of the terminal.

[0159] In one possible embodiment, the above display method may also perform the following steps, including but not limited to:

[0160] If the first target is located within the spatial region between the observation point and the second display layer, the second indication information is displayed on the second display layer.

[0161] The second indication information is used to follow the first identification information to the first target or the second identification information for linked display, and the second identification information is associated with the first identification information.

[0162] Optionally, the second identification information is used to indicate the first target. Specifically, it can be displayed directly at the location of the first target, or it can be displayed at other locations related to the first target. This application embodiment does not limit this.

[0163] Optionally, the second indication information may include one or more of the following display elements: waves, light carpets, halos, rings, light arcs, etc., which are not limited in this application embodiment.

[0164] Optionally, the second instruction information can also be displayed in the form of gradient transition, distortion, path animation, collage animation, etc., and the embodiments of this application do not limit this.

[0165] It is understandable that when the first target enters the FOV corresponding to the second display layer, the second indicator information can be displayed on the second display layer. Through the second indicator information, the linkage display from the first identification information to the first target or the second identification information can be realized. It can be understood that the first identification information displayed on the first display layer is switched to the second display layer through a strong linkage.

[0166] Optionally, this strong linkage can be understood as the first identification information displayed on the first display layer triggering the motion effect, the second identification information displayed on the second display layer or the first target directly receiving the motion effect, and the first identification information and the second identification information / first target generating an interconnection relationship through continuous motion effects that are directly and closely mapped.

[0167] Through the embodiments of this application, the first identification information displayed on the first display layer can be switched to the second display layer through a strong linkage, so that the process of information flowing from the first display layer to the second display layer for augmented reality display is more coherent, effectively improving the coherence of information display. By associating virtual identification information outside the field of vision corresponding to the same risk target with actual objects within the field of vision through the second indication information, or associating virtual identification information outside the field of vision corresponding to the same risk target with virtual identification information within the field of vision, it is possible to improve the user's attention and focus, reduce cognitive load, improve the user's cognitive efficiency, and ensure driving safety.

[0168] In one possible embodiment, the above display method may also perform the following steps, including but not limited to:

[0169] The display device displays the second identification information on the second display layer.

[0170] The second identification information is associated with the first identification information.

[0171] Optionally, the second identification information is used to indicate the first target. Specifically, it can be displayed directly at the location of the first target, or it can be displayed at other locations related to the first target. This embodiment does not limit this.

[0172] It is understandable that when the first target enters the FOV corresponding to the second display layer, the first identification information displayed on the first display layer can be canceled, and correspondingly, the second identification information can also be displayed on the second display layer. Moreover, the second identification information is associated with the first identification information. It can be understood that the relevant information canceled from displaying on the first display layer is switched to display on the second display layer through a weak linkage.

[0173] Optionally, this weak linkage can be understood as the first identification information displayed on the first display layer emitting a motion effect, and the second identification information displayed on the second display layer indirectly receiving the motion effect, and the color, size, motion trend, etc. of the first identification information and the second identification information are interconnected.

[0174] Through the embodiments of this application, not only can the display of the first identification information on the first display layer be cancelled to reduce the user's cognitive load, but the relevant information cancelled from the first display layer can also be switched to the second display layer for display through a weak linkage, so that the relevant information of the first target (such as the risk information, type information, location information, motion status information, etc. of the first target) can be presented to the user more clearly and timely, thereby improving information display efficiency and enhancing the user's cognitive efficiency, and ensuring the driving safety of the terminal.

[0175] In one possible embodiment, before displaying the second indication information on the second display layer, the above display method may further perform the following steps, including but not limited to:

[0176] The display device cancels the first instruction information displayed on the first display layer.

[0177] It is understandable that before switching the relevant information that has been removed from the first display layer to the second display layer through strong linkage, weak linkage, or other linkage methods, the first instruction information displayed on the first display layer can also be removed to reduce the user's cognitive load and improve information display efficiency.

[0178] The following is combined Figures 9A to 9C The driving scenario shown serves as an example of the "weak linkage display between the first and second display layers" in the display method described above.

[0179] like Figures 9A to 9C As shown, in the display area of ​​the aforementioned display device, A1, B1, C1, and D1 constitute the first display layer (which can be understood as a near-focus layer). For details, please refer to the above... Figure 8 The explanation of the first display layer (A1, B1, C1, D1) is as follows. The second display layer (which can be understood as the telephoto layer) is composed of A2, B2, C2, and D2. Please refer to the above for details. Figure 8 Explanation of the second display layer (A2, B2, C2, D2) in the image.

[0180] exist Figure 9AIn the process, the vehicle's display device acquires scene information about the vehicle and determines, based on this information, that an obstacle 901 exists in the environment where the vehicle is located, and that the obstacle 901 is located outside the spatial area between the observation point and the second display layer (A2, B2, C2, D2). At this time, the display device displays first identification information 902 and first indication information 903 on the first display layer (A1, B1, C1, D1). The first identification information 902 indicates that there is an obstacle 901 ahead and that there is a risk of collision with the vehicle. The first indication information 903 consists of a light arc and a small arrow. The small arrow in the first indication information 903 is used to point to the obstacle 901 and follows the obstacle 901 in a linked display. It can be understood that as the vehicle moves forward, the distance and position of the obstacle 901 relative to the vehicle also change, and correspondingly, the direction of the small arrow in the first indication information 903 also changes, always pointing to the obstacle 901.

[0181] exist Figure 9B The vehicle continues to move forward until obstacle 901 is located within the spatial area between the observation point and the second display layer (A2, B2, C2, D2). At this point, the display device stops displaying the first identification information 902 on the first display layer (A1, B1, C1, D1). Instead, the display device displays the second identification information 904 on the second display layer (A2, B2, C2, D2), which appears next to obstacle 901. This second identification information 904 is associated with the first identification information 902. It can be understood that the first identification information 902 displayed on the first display layer (A1, B1, C1, D1) emits a motion effect when it fades out, and the second identification information 904 displayed on the second display layer (A2, B2, C2, D2) receives the motion effect when it appears out. Furthermore, the color, size, and movement trend of the first identification information 902 and the second identification information 904 are interconnected. By using a weak linkage display method between the first display layer (A1, B1, C1, D1) and the second display layer (A2, B2, C2, D2), not only can the display of the first identification information 902 on the first display layer (A1, B1, C1, D1) be cancelled to reduce the user's cognitive load, but the relevant information cancelled from displaying on the first display layer (A1, B1, C1, D1) can also be switched to display on the second display layer (A2, B2, C2, D2) through a weak linkage. This allows the relevant information of obstacle 901 (such as the risk information, type information, location information, and movement status information of obstacle 901) to be presented to the user more clearly and timely, improving information display efficiency and user cognitive efficiency, thus ensuring the driving safety of the terminal. Furthermore, as the vehicle moves forward, the distance and position of obstacle 901 relative to the vehicle also change, and correspondingly, the direction of the small arrow in the first indicator information 903 also changes, always pointing towards obstacle 901.

[0182] exist Figure 9C The vehicle continues to move forward until obstacle 901 leaves the FOV of the display device. During this process, as the vehicle moves forward, the distance and orientation of obstacle 901 relative to the vehicle also change, and correspondingly, the direction of the small arrow in the first indication information 903 also changes, always pointing towards obstacle 901. Optionally, after obstacle 901 leaves the FOV of the display device, the display of the first indication information 903 and the second identification information 904 is canceled.

[0183] From the above Figures 9A to 9C It can be seen that by combining scene information with the linked display of obstacle 901, relevant information about obstacle 901 (such as obstacle 901's risk information, type information, location information, and motion status information) can be presented to the user in a timely and effective manner. This enables the terminal information and the terminal's environmental perception information to be presented to the user more effectively, improving information display efficiency and enhancing the user's cognitive efficiency, thus ensuring the terminal's driving safety.

[0184] The following is combined Figures 10A to 10D The driving scenario shown serves as an example of the "strong linkage display between the first display layer and the second display layer" in the display method described above.

[0185] like Figures 10A to 10D As shown, in the display area of ​​the aforementioned display device, A1, B1, C1, and D1 constitute the first display layer (which can be understood as a near-focus layer). For details, please refer to the above... Figure 8 The explanation of the first display layer (A1, B1, C1, D1) is as follows. The second display layer (which can be understood as the telephoto layer) is composed of A2, B2, C2, and D2. Please refer to the above for details. Figure 8 Explanation of the second display layer (A2, B2, C2, D2) in the image.

[0186] exist Figure 10AIn the process, the vehicle's display device acquires scene information about the vehicle and, based on this information, determines that a vehicle 1001 is present in the environment to the left rear of the vehicle, intending to overtake, and that vehicle 1001 is outside the spatial area between the observation point and the second display layer (A2, B2, C2, D2). At this time, the display device displays first identification information 1002 and first indication information 1003 on the first display layer (A1, B1, C1, D1). First identification information 1002 indicates that there is a risk of collision between vehicle 1001 to the vehicle to the left rear. First indication information 1003 includes a light arc, which is located inside the speed ring near vehicle 1001 and is displayed in conjunction with vehicle 1001. This can be understood as the distance and position of vehicle 1001 relative to the vehicle changing as vehicle 1001 overtakes, and correspondingly, the position of the light arc in first indication information 1003 changes along the inside of the speed ring, always remaining close to vehicle 1001. Optionally, the display device may also display MOP line 1005 to guide the vehicle to travel along MOP line 1005.

[0187] exist Figure 10B and Figure 10CIn the process, vehicle 1001 continues to overtake other vehicles until it is located within the spatial area between the observation point and the second display layer (A2, B2, C2, D2). At this time, the display device cancels the display of the first identification information 1002 on the first display layer (A1, B1, C1, D1). Instead, the display device displays the second instruction information 1004 on the second display layer (A2, B2, C2, D2). This second instruction information 1004 is used to follow the first identification information 1002 to vehicle 1001 along the inner side of the MOP line 1005 for a linked display. It can be understood that the first identification information 1002 displayed on the first display layer (A1, B1, C1, D1) triggers the motion effect, and the second instruction information 1004 displayed on the second display layer (A2, B2, C2, D2) directly receives the motion effect. Furthermore, the first identification information 1002 and the second instruction information 1004 are interconnected through continuous motion effects with direct and close mapping. By switching the first identification information 1002 displayed on the first display layer (A1, B1, C1, D1) to the second display layer (A2, B2, C2, D2) via a strong linkage, the process of information flowing from the first display layer (A1, B1, C1, D1) to the second display layer (A2, B2, C2, D2) for augmented reality display is made more coherent. This effectively improves the continuity of information display, reduces cognitive load, and allows for clearer and more timely presentation of relevant information about vehicle 1001 (such as risk information, location information, and motion status information of vehicle 1001) to the user, improving information display efficiency and user cognitive efficiency, thus ensuring driving safety. Furthermore, as vehicle 1001 moves forward to overtake other vehicles, the distance and position of vehicle 1001 relative to its own vehicle also change. Correspondingly, the position of the light arc in the first indication information 1003 along the inner side of the driving speed ring also changes, always remaining close to vehicle 1001.

[0188] exist Figure 10D During this process, vehicle 1001 continues to move forward, overtaking other vehicles, until it leaves the field of view (FOV) of the display device. As vehicle 1001 moves forward, its distance and position relative to itself change, and correspondingly, the second instruction information 1004 is displayed in conjunction with vehicle 1001 along the inner side of the MOP line 1005. Optionally, as vehicle 1001 moves forward, the display device can also cancel the first instruction information 1003 displayed on the first display layer (A1, B1, C1, D1) to reduce the user's cognitive load and improve information display efficiency.

[0189] From the above Figures 10A to 10DIt can be seen that by combining scene information with the display of vehicle 1001, relevant information of vehicle 1001 (such as risk information, location information, and motion status information of vehicle 1001) can be presented to the user in a timely and effective manner. This enables the terminal information and the terminal's environmental perception information to be presented to the user more effectively, improving information display efficiency and enhancing the user's cognitive efficiency, thus ensuring the terminal's driving safety.

[0190] The following is combined Figures 11A to 11E The driving scenario shown serves as an example to illustrate the "combined display of weak and strong linkage between the first and second display layers" in the display method described above.

[0191] like Figures 11A to 11E As shown, in the display area of ​​the aforementioned display device, A1, B1, C1, and D1 constitute the first display layer (which can be understood as a near-focus layer). For details, please refer to the above... Figure 8 The explanation of the first display layer (A1, B1, C1, D1) is as follows. The second display layer (which can be understood as the telephoto layer) is composed of A2, B2, C2, and D2. Please refer to the above for details. Figure 8 Explanation of the second display layer (A2, B2, C2, D2) in the image.

[0192] exist Figure 11A In the process, the vehicle's display device acquires scene information about the vehicle and determines a left turn at the upcoming intersection based on this information. This intersection is located outside the spatial area between the observation point and the second display layer (A2, B2, C2, D2). At this time, the display device displays signage information 1101 and instruction information 1102 on the first display layer (A1, B1, C1, D1). Signage information 1101 indicates that a left turn is possible ahead. Instruction information 1102 includes a section of a light pole. The length of the light pole in instruction information 1102 represents the distance to the intersection and is displayed in conjunction with this distance. This can be understood as the distance between the vehicle and the intersection changes as the vehicle moves forward, and correspondingly, the length of the light pole in instruction information 1102 also changes; the shorter the light pole, the closer the vehicle is to the intersection.

[0193] exist Figure 11BThe vehicle continues to travel forward until the intersection falls within the spatial area between the observation point and the second display layer (A2, B2, C2, D2). At this point, the display device cancels the display of signage information 1101 on the first display layer (A1, B1, C1, D1). Instead, the display device displays signage information 1103 on the second display layer (A2, B2, C2, D2), which is displayed in the left-turn lane. Signage information 1103 is associated with signage information 1101. It can be understood that signage information 1101 displayed on the first display layer (A1, B1, C1, D1) emits a motion effect when fading out, and signage information 1103 displayed on the second display layer (A2, B2, C2, D2) receives the motion effect when fading out. Furthermore, signage information 1101 and signage information 1103 are interconnected in terms of color, size, and motion trend. By using a weak linkage display method between the first display layer (A1, B1, C1, D1) and the second display layer (A2, B2, C2, D2), not only can the display of signage information 1101 on the first display layer (A1, B1, C1, D1) be cancelled to reduce the user's cognitive load, but the relevant information cancelled from the first display layer (A1, B1, C1, D1) can also be switched to the second display layer (A2, B2, C2, D2) through weak linkage. This allows for a clearer, more timely, and effective presentation of information related to left turns at intersections (such as risk information, type information, and distance information), improving information display efficiency and enhancing user cognitive efficiency, thus ensuring the terminal's driving safety. Furthermore, as the vehicle moves forward, the distance to the intersection relative to the vehicle changes; correspondingly, the length of the light pole in the instruction information 1102 also shortens, indicating that the vehicle is getting closer to the intersection.

[0194] exist Figure 11C The vehicle continues to move forward until it approaches the intersection. During this process, as the vehicle moves forward, the distance between the vehicle and the intersection changes, and correspondingly, the length of the light pole in indicator information 1102 shortens, indicating that the vehicle is getting closer to the intersection. Optionally, indicator information 1102 can be de-displayed after approaching the intersection.

[0195] From the above Figures 10A to 10C It can be seen that by combining scene information with the display of intersection turning information, relevant information about intersection turning (such as risk information, type information, distance information, etc.) can be presented to users in a timely and effective manner. This enables the terminal information and the terminal's environmental perception information to be presented to users more effectively, improving information display efficiency and enhancing users' cognitive efficiency, thus ensuring the terminal's driving safety.

[0196] exist Figure 11D and Figure 11EAs the vehicle continues to move forward until it approaches the intersection, the display device shows signage information 1104 on the first display layer (A1, B1, C1, D1) to indicate the turn signal at the intersection. Simultaneously, the display device shows instruction information 1105 on the second display layer (A2, B2, C2, D2). This instruction information 1105 is used to follow the signage information 1104 along the MOP line to the left-turn lane for a synchronized display. This can be understood as the signage information 1104 displayed on the first display layer (A1, B1, C1, D1) triggering an animation effect, and the instruction information 1105 displayed on the second display layer (A2, B2, C2, D2) directly receiving the animation effect. Furthermore, the signage information 1104 and the instruction information 1105 are interconnected through directly and closely mapped continuous animation effects. By switching the signage information 1104 displayed on the first display layer (A1, B1, C1, D1) to the second display layer (A2, B2, C2, D2) through a strong linkage, the process of information flowing from the first display layer (A1, B1, C1, D1) to the second display layer (A2, B2, C2, D2) for augmented reality display is made more coherent, effectively improving the continuity of information display, reducing cognitive load, and also presenting relevant information about intersection turns (such as risk information about intersection turns, navigation guidance information, etc.) to users more clearly and timely, improving information display efficiency, while also improving users' cognitive efficiency and ensuring driving safety.

[0197] From the above Figures 11D to 11E It can be seen that by combining scene information with the turning lane for linked display, relevant information about intersection turning (such as risk information and navigation guidance information) can be presented to users in a timely and effective manner. This enables the terminal information and the terminal's environmental perception information to be presented to users more effectively, improving information display efficiency and enhancing users' cognitive efficiency, thus ensuring the terminal's driving safety.

[0198] The methods of the embodiments of this application have been described in detail above. The following provides an apparatus for implementing any one of the methods in the embodiments of this application. For example, an apparatus is provided that includes a unit (or means) for implementing the steps performed by the device in any of the above methods.

[0199] Please see Figure 12 , Figure 12 This is a schematic diagram of the structure of a display device provided in an embodiment of this application.

[0200] like Figure 12 As shown, the display device 120 may include a communication unit 1201 and a processing unit 1202. The communication unit 1201 and the processing unit 1202 may be software, hardware, or a combination of software and hardware. Optionally, the display device 120 may further include a display unit 1203.

[0201] The communication unit 1201 can implement sending and / or receiving functions, and can also be described as a transceiver unit. The communication unit 1201 can also be a unit integrating an acquisition unit and a sending unit, wherein the acquisition unit is used to implement the receiving function, and the sending unit is used to implement the sending function. Optionally, the communication unit 1201 can be used to receive information sent by other devices, and can also be used to send information to other devices.

[0202] In one possible design, the display device 120 may correspond to the above. Figure 6 The display device in the illustrated method embodiment, such as display device 120, can be an electronic device or a chip within an electronic device. The display device 120 may include components for performing the above-described... Figure 6 The unit in the method embodiment shown is the one that performs the operation by the display device, and each unit in the display device 120 is respectively for implementing the above-described operation. Figure 6 The operation performed by the display device in the illustrated method embodiment is described below:

[0203] The processing unit 1202 is used to acquire scene information of the first terminal.

[0204] The processing unit 1202 is also used to determine the first target in the environment where the first terminal is located based on the scene information of the first terminal.

[0205] The processing unit 1202 is further configured to, when the first target is located outside the spatial region between the observation point and the second display layer, instruct the display unit to display first identification information and first instruction information on the first display layer. The first identification information includes the identification information of the first target, and the first instruction information is used to point to the first target and follow the first target for linkage display.

[0206] In one possible implementation, the device further includes a communication unit 1201.

[0207] The processing unit 1202 is used to obtain scene information of the first terminal through the communication unit 1201.

[0208] In one possible implementation, the device further includes a display unit 1203.

[0209] Display unit 1203 is used to display first identification information and first instruction information on the first display layer.

[0210] The steps performed by the communication unit 1201 and processing unit 1202 described in this design can be referred to the steps corresponding to the above. Figure 6 The implementation method shown corresponds to the display device in the method embodiment.

[0211] Regarding the technical effects brought about by the implementation methods performed by the communication unit 1201 and processing unit 1202 described in this design, please refer to the corresponding methods described above. Figure 6 The technical effects of the illustrated method embodiments are described below.

[0212] According to the embodiments of this application, Figure 12 The various units in the illustrated device can be individually or entirely combined into one or more other units, or some of the units can be further divided into multiple functionally smaller units. This achieves the same operation without affecting the technical effects of the embodiments of this application. The above-mentioned units are based on logical function division. In practical applications, the function of one unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of this application, the electronic device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented collaboratively by multiple units.

[0213] It should be noted that the implementation of each unit can also refer to the above. Figure 6 The corresponding description of the method embodiments shown.

[0214] exist Figure 12 The described display device 120 can present vehicle information and real-world information to the user more effectively, thereby improving information display efficiency.

[0215] For cases where the aforementioned display device 120 can be an electronic device, please refer to [reference needed]. Figure 13 The diagram shows the structure of the electronic device.

[0216] It should be understood that Figure 13 The illustrated electronic device 130 is merely an example; the electronic device in this embodiment may also include other components, or include components related to... Figure 13 Components with similar functions, or not necessarily including Figure 13 All components.

[0217] Electronic device 130 includes a transceiver interface 1301 and at least one processor 1302.

[0218] The electronic device 130 can correspond to a display device. The transceiver interface 1301 is used to transmit and receive signals, and at least one processor 1302 executes program instructions, causing the electronic device 130 to implement the corresponding flow of the method executed by the corresponding device in the above method embodiment.

[0219] In one possible design, the electronic device 130 may correspond to the above. Figure 6The display device in the illustrated method embodiment, such as the electronic device 130, can be a display device itself or a chip within the display device. The electronic device 130 may include components for performing the operations performed by the display device in the above method embodiment, and each component in the electronic device 130 is specifically designed to implement the operations performed by the display device in the above method embodiment. Specifically, it can be as follows:

[0220] Processor 1302 is used to acquire scene information of the first terminal.

[0221] The processor 1302 is also used to determine the first target in the environment where the first terminal is located based on the scene information of the first terminal.

[0222] The processor 1302 is further configured to instruct the display unit to display first identification information and first indication information on the first display layer when the first target is located outside the spatial area between the observation point and the second display layer. The first identification information includes the identification information of the first target, and the first indication information is used to point to the first target and follow the first target for linkage display.

[0223] In one possible implementation, the device also includes a transceiver interface 1301.

[0224] The processor 1302 is specifically used to obtain scene information of the first terminal through the transceiver interface 1301.

[0225] In one possible implementation, the device also includes a display.

[0226] The processor 1302 is used to control the display to display first identification information and first indication information on the first display layer.

[0227] Regarding the transceiver interface 1301 and at least one processor 1302 described in this design, the steps performed can be referred to the corresponding steps described above. Figure 6 The implementation method shown corresponds to the display device in the method embodiment.

[0228] Regarding the technical effects of the transceiver interface 1301 and the implementation methods performed by at least one processor 1302 described in this design, please refer to the corresponding descriptions above. Figure 6 The technical effects of the illustrated method embodiments are described below.

[0229] exist Figure 13 The described electronic device 130 can present vehicle information and real-world information to the user more effectively, improving information display efficiency.

[0230] For cases where the aforementioned display device 120 can be a chip or a chip system, please refer to [reference needed]. Figure 14 The diagram shows the structure of the chip.

[0231] like Figure 14 As shown, chip 140 includes processor 1401 and interface 1402. The number of processors 1401 can be one or more, and the number of interfaces 1402 can be multiple. It should be noted that the functions of processor 1401 and interface 1402 can be implemented through hardware design, software design, or a combination of both; no restrictions are placed here.

[0232] Optionally, chip 140 may also include memory 1403 for storing necessary program instructions and data.

[0233] In this application, processor 1401 can be used to call the implementation program of the display method provided in one or more embodiments of this application on a display device from memory 1403, and execute the instructions included in the program. Interface 1402 can be used to output the execution result of processor 1401. In this application, interface 1402 can be specifically used to output various messages or information of processor 1401.

[0234] The display method provided by one or more embodiments of this application can be referred to the foregoing. Figure 6 The various embodiments shown are not described in detail here.

[0235] The processor in this application embodiment can be a central processing unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0236] The memory in this application embodiment is used to provide storage space, in which data such as operating system and computer programs can be stored. The memory includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM).

[0237] According to the method provided in the embodiments of this application, the embodiments of this application also provide a computer-readable storage medium storing a computer program. When the computer program is run on one or more processors, it can implement the above-mentioned... Figure 6 The method shown.

[0238] According to the method provided in the embodiments of this application, the embodiments of this application also provide a computer program product, which includes a computer program. When the computer program runs on a processor, it can achieve the above-mentioned... Figure 6 The method shown.

[0239] This application embodiment also provides a display system, the display system including components for performing the above-described... Figure 6 The method shown includes a display device and a sensing unit. The sensing unit is used to sense the environment in which the first terminal is located.

[0240] This application also provides a terminal, which includes at least one display device 120, or electronic device 130, or chip 140, or the above-described display system.

[0241] Optionally, the terminal further includes a light-transmitting component, through which the light emitted from the display device 120, electronic device 130, chip 140, or the aforementioned display system forms a virtual image in front of the terminal. For example, the light-transmitting component may be a windshield.

[0242] Optionally, the terminal can be a means of transportation, such as a car, truck, aircraft, drone, slow transport vehicle, spacecraft, or ship, or any other possible means of transportation used in any possible scenario. This application embodiment does not limit this.

[0243] Optionally, the terminal is used to implement the above. Figure 6 The method shown.

[0244] This application also provides a processing apparatus, including a processor and an interface; the processor is used to execute the method in any of the above method embodiments.

[0245] It should be understood that the above-described processing device can be a chip. The units in the various device embodiments and the electronic devices in the method embodiments correspond completely, with corresponding modules or units executing corresponding steps. For example, the communication unit (transceiver) executes the receiving or sending steps in the method embodiments, while other steps besides sending and receiving can be executed by the processing unit (processor). The specific functions of each unit can be found in the corresponding method embodiments. There can be one or more processors.

[0246] It is understood that in the embodiments of this application, the electronic device may perform some or all of the steps in the embodiments of this application. These steps or operations are merely examples, and the embodiments of this application may also perform other operations or variations thereof. Furthermore, the steps may be performed in different orders as presented in the embodiments of this application, and it is not necessarily necessary to perform all the operations in the embodiments of this application.

[0247] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0248] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0249] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0250] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the contributing part, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0251] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.

Claims

1. A display method, characterized in that, A display device applied to a first terminal, the display device being used to display information on a first display layer and a second display layer, the first display layer and the second display layer being divided based on viewing distance, the first display layer being a display layer formed at a first viewing distance in front of the observation point, and the second display layer being a display layer formed at a second viewing distance in front of the observation point, the second viewing distance being greater than the first viewing distance; the display method includes: Obtain scene information from the first terminal; Based on the scene information of the first terminal, determine the first target in the environment where the first terminal is located; When the first target is located outside the spatial region between the observation point and the second display layer, first identification information and first indication information are displayed on the first display layer. The first identification information includes the identification information of the first target, and the first indication information is used to point to the first target and follow the first target for linkage display. When the first target is located within the spatial region between the observation point and the second display layer, second indication information is displayed on the second display layer. The second indication information is used to follow the first identification information to the first target or the second identification information for linkage display. The second identification information is associated with the first identification information.

2. The display method according to claim 1, characterized in that, The display method further includes: If the first target is located within the spatial region between the observation point and the second display layer, the first identification information displayed on the first display layer is canceled.

3. The display method according to claim 1 or 2, characterized in that, The display method further includes: The second identification information is displayed on the second display layer, and the second identification information is associated with the first identification information.

4. The display method according to claim 1 or 2, characterized in that, The second identification information is used to indicate the first target.

5. The display method according to claim 1 or 2, characterized in that, Before displaying the second indication information on the second display layer, the display method further includes: Cancel the first instruction information displayed on the first display layer.

6. The display method according to claim 1 or 2, characterized in that, The second indication information includes one or more of the following display elements: wave, light carpet, halo, and aura.

7. The display method according to claim 1 or 2, characterized in that, The first target includes one or more of the following: obstacles, traffic facilities, and traffic participants.

8. The display method according to claim 1 or 2, characterized in that, The display device includes at least one of the following: Head-up display (HUD), headlight module, in-vehicle projector.

9. The display method according to claim 8, characterized in that, The display device is a HUD, and the second display layer is superimposed on the real scene where the first terminal is located. The HUD is used to form a virtual image on the first display layer and the second display layer.

10. A display device, characterized in that, Includes a unit for performing the method as described in any one of claims 1 to 9.

11. A display device, characterized in that, Includes a processor for performing the method as described in any one of claims 1 to 9.

12. A chip, characterized in that, It includes logic circuits and interfaces, wherein the logic circuits and the interfaces are coupled; The interface is used for inputting and / or outputting information, and the logic circuit is used for performing the method as described in any one of claims 1 to 9.

13. A terminal, characterized in that, Includes the display device as claimed in claim 10, or the display device as claimed in claim 11, or the chip as claimed in claim 12.

14. The terminal according to claim 13, characterized in that, The terminal also includes a light-transmitting component; The light emitted from the display device passes through the light-transmitting component and forms a virtual image in front of the terminal.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, which, when executed, performs the method as described in any one of claims 1 to 9.

16. A computer program product, characterized in that, The computer program product includes a computer program, which, when executed, performs the method as described in any one of claims 1 to 9.

17. A display system, characterized in that, It includes a display device and a sensing unit for performing the method as described in any one of claims 1 to 9, the sensing unit being used to sense the environment in which the first terminal is located.

Images