Display method and device, storage medium, electronic device, and vehicle

Abstract

The present disclosure provides a display method and device, storage medium, electronic device and vehicle, wherein the display method comprises: displaying an indicator related to driving information, at least part of the indicator being suspended from a first reference object; and displaying an association symbol for associating the indicator with an object, the object comprising at least one of the first reference object and a second reference object. The present disclosure associates the suspended indicator with the object through the association symbol, improves the indication effect of the suspended indicator on the user, and thus improves the user experience.

Description

Technical Field

[0001] This disclosure provides a display method and apparatus, a storage medium, an electronic device, and a vehicle. Background Technology

[0002] Head-up display (HUD) technology can prevent drivers from looking down at the instrument panel or other displays while driving, thus improving driving safety and providing a better driving experience. As a result, it has received increasing attention in recent years and has great application potential in in-vehicle intelligent displays. Summary of the Invention

[0003] This disclosure provides a display method and apparatus, a storage medium, an electronic device, and a vehicle, which can improve the user experience.

[0004] In a first aspect, at least one embodiment of this disclosure provides a display method, comprising: displaying an indicator related to driving information, wherein at least a portion of the indicator is suspended above a first reference object; and displaying an association symbol that associates the indicator with an object, wherein the object includes at least one of the following: the first reference object and a second reference object.

[0005] Secondly, at least one embodiment of this disclosure also provides a display device, comprising: a first display module configured to display an indicator related to driving information, wherein at least a portion of the indicator is suspended above a first reference object; and a second display module configured to display an association symbol that associates the indicator with an object, wherein the object includes at least one of the following: the first reference object and the second reference object.

[0006] Thirdly, at least one embodiment of this disclosure also provides a computer-readable storage medium comprising a stored program, wherein the program, when executed, performs the method described in the first aspect above.

[0007] Fourthly, at least one embodiment of this disclosure also provides an electronic device, including the display device described in the second aspect or the storage medium described in the third aspect.

[0008] Fifthly, at least one embodiment of this disclosure also provides a vehicle including the display device described in the second aspect, the storage medium described in the third aspect, or the electronic device described in the fourth aspect.

[0009] In some embodiments, based on any of the first to fifth aspects described above, the indicator is completely suspended above the first reference object.

[0010] In some embodiments, based on any of the first to fifth aspects described above, the first reference object includes a driving surface related to the driving information; and / or, the second reference object includes a reference object related to the driving information.

[0011] In some embodiments, based on any of the first to fifth aspects described above, the indicator is associated with the object through at least one of the shape relationship, projection relationship, color relationship, size relationship, and custom relationship between the association symbol and the indicator; and / or, the indicator is associated with the object through the pointing relationship between the association symbol and the object.

[0012] In some embodiments, based on any of the first to fifth aspects described above, the shape relationship between the association symbol and the indicator includes making the association symbol and the indicator have the same or similar shapes; and / or wherein, when the indicator is associated with the object through a pointing relationship between the association symbol and the object, the association symbol is displayed as including a pointing symbol between the indicator and the second reference object.

[0013] In some embodiments, based on any of the first to fifth aspects described above, the similar or identical shapes include at least one of the following: arrows, triangles, circles, ellipses, polygons with more than 4 sides, and similar shapes to these shapes.

[0014] In some embodiments, the portion that is attached to the first reference object, and / or the mapping symbol of the indicator relative to the first reference object, and / or a brightness symbol having brightness and / or a brightness symbol for indicating information related to driving information.

[0015] In some embodiments, the mapper is determined based on the vertical or oblique projection of the indicator onto the first reference object; or, the mapper is determined based on the projection of the indicator onto the first reference object according to real-world projection relationships.

[0016] In some embodiments, based on any of the first to fifth aspects described above, the method further includes: obtaining parameters of a light source in the real world, and obtaining the real-world projection relationship based on the parameters; and / or obtaining the positional relationship between a real object and its shadow in the real world to obtain the real-world projection relationship.

[0017] In some embodiments, based on any of the first to fifth aspects described above, the method further includes: determining a symbol associated with the second reference object from a preset set of indicators based on the type of the second reference object, such that the indicator is displayed to include the symbol.

[0018] In some embodiments, based on any of the first to fifth aspects described above, the driving information includes at least one of the following: driving direction information; steering angle information; driving point of interest information; driving navigation point information.

[0019] In some embodiments, based on any of the first to fifth aspects described above, the indicator includes a plurality of sub-indicators, which are spaced apart along the travel route when the indicator is used to indicate a travel route.

[0020] In some embodiments, based on any of the first to fifth aspects described above, when the indicator is used to indicate a travel route, the method further includes: determining a navigation point; determining whether the relationship between the current travel position and the navigation point satisfies the indication condition for the indicator to indicate the navigation point; wherein, if the relationship satisfies the indication condition, the navigation point is indicated by at least a portion of the indicator.

[0021] In some embodiments, the association symbol includes a luminance symbol, which is displayed as a halo at at least a portion of the outline of the association symbol; and / or, the luminance of the luminance symbol may be displayed in relation to the brightness and / or temperature of the real environment; and / or, the degree of change of information related to driving information is indicated by the variation of the luminance symbol.

[0022] In some embodiments, the electronic device includes a head-up display or a smart wearable device.

[0023] In the above-described embodiments provided in this disclosure, by displaying indicators related to driving information and associating the indicators with objects, the guiding effect of the indicators on the user is improved, thereby enhancing the user experience. Attached Figure Description

[0024] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with the description thereof, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0025] Figure 1 This is a hardware structure block diagram of the display device of the display method disclosed herein;

[0026] Figure 2 This is a flowchart of the display method according to this disclosure;

[0027] Figure 3 This is a schematic diagram of the display content of the display device according to the present disclosure;

[0028] Figure 4This is a schematic diagram of the indicator and corresponding shadow image of the display device according to the present disclosure;

[0029] Figure 5 This is a schematic diagram (a) illustrating the display effect of the display device according to the present disclosure;

[0030] Figure 6 This is a schematic diagram (II) illustrating the display effect of the display device according to this disclosure;

[0031] Figure 7 This is a schematic diagram (iii) illustrating the display effect of the display device according to this disclosure;

[0032] Figure 8 This is a schematic diagram (IV) illustrating the display effect of the display device according to this disclosure;

[0033] Figure 9 This is a schematic diagram (a) of a steering indicator assembly according to the present disclosure;

[0034] Figure 10 This is a schematic diagram (II) of a steering indicator assembly according to the present disclosure;

[0035] Figure 11 This is a schematic diagram (iii) of a combination of steering indicators according to this disclosure;

[0036] Figure 12 This is a schematic diagram (iv) of the combination of steering indicators according to this disclosure;

[0037] Figure 13 This is a schematic diagram (V) of the combination of steering indicators according to this disclosure;

[0038] Figure 14 This is a schematic diagram (VI) of a combination of steering indicators according to this disclosure;

[0039] Figure 15 This is a schematic diagram (VII) of a combination of steering indicators according to this disclosure;

[0040] Figure 16 This is a structural block diagram of a display device according to the present disclosure. Detailed Implementation

[0041] To enable those skilled in the art to better understand the present disclosure, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments in this disclosure, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this disclosure.

[0042] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0043] The inventors of this disclosure discovered in their research that, in some cases, the displayed indicators are not very effective in guiding users, and users cannot obtain relevant guidance information from the displayed indicators, thus reducing the user experience.

[0044] In order to improve the guiding effect of indicators on users, at least one embodiment of this disclosure provides a display method and apparatus, a storage medium, an electronic device, and a vehicle.

[0045] To better understand the technical solutions of this disclosure, the technical terms in the embodiments of this disclosure will be explained.

[0046] The eyebox area refers to the area where the observer's (e.g., user, passenger, and / or other user) eyes are located and can see the image formed by the head-up display device. The observer can see the image formed by the head-up display device from different positions within the eyebox area.

[0047] Head-up displays, also known as head-up displays, can be used in vehicles, such as cars, airplanes, or ships.

[0048] In a first aspect, at least one of the present disclosure provides a display method comprising: displaying an indicator related to driving information, wherein at least a portion of the indicator is suspended above a first reference object; and displaying an association symbol that associates the indicator with an object, wherein the object includes at least one of the following: the first reference object, a reference object.

[0049] Secondly, at least one embodiment of this disclosure also provides a display device, including a first display module configured to display an indicator related to driving information, wherein at least a portion of the indicator is suspended above a first reference object; and a second display module configured to display an association symbol that associates the indicator with an object, wherein the object includes at least one of the following: the first reference object and the second reference object.

[0050] In the above-described embodiments provided in this disclosure, by displaying a floating indicator related to driving information and an association symbol that associates the floating indicator with an object, the guiding effect of the floating indicator on the user is improved, thereby enhancing the user experience.

[0051] The method embodiments provided in at least one embodiment of this disclosure can be executed in a display device or a similar computing device.

[0052] Taking a display device as an example, Figure 1 This is a hardware structure block diagram of a display device for a display method provided in at least one embodiment of this disclosure. For example... Figure 1 As shown, the display device includes a transmission device 106 for communication and an input / output device 108. For example, the transmission device 106 can enable communication between the current display device and a user's mobile terminal, server, or other electronic devices in a vehicle.

[0053] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the display method in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thereby implementing the above-described method. The memory 104 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the display device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0054] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the display device's communication provider. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module used for wireless communication with the Internet.

[0055] Figure 2 This is a flowchart of a display method provided according to at least one embodiment of the present disclosure. Figure 2 As shown, the display method includes the following steps:

[0056] S202, Displaying an indicator related to driving information, wherein at least a portion of the indicator is suspended above a first reference object;

[0057] S204, displaying an association symbol that associates an indicator with an object, wherein the object includes at least one of the following: a first reference object, a second reference object;

[0058] In this embodiment of the disclosure, by displaying indicators related to driving information and associating the indicators with objects, the guiding effect of the indicators on the user is improved, thereby enhancing the user experience.

[0059] In some embodiments, the indicator can be understood as a visualized virtual object, including two-dimensional patterns and three-dimensional icons; for example, when the indicator is a two-dimensional pattern, it can be set to any shape, such as a geometric shape, like any one of a circle, ellipse, square, triangle, or hexagon. When the indicator is a three-dimensional icon, it can be set as a 3D arrow.

[0060] For example, the statement that at least a portion of the indicator is suspended above the first reference object can be understood as the indicator being displayed above the first reference object, and the indicator being at least partially attached to the first reference object.

[0061] In some embodiments, the indicator is completely suspended above the first reference object. For example, when the indicator is completely suspended above the first reference object, the user sees the indicator as spaced apart from and above the first reference object.

[0062] For example, in some embodiments, when the first reference point is, for example, a road, the indicator is completely suspended above the road.

[0063] For example, in some embodiments, a virtual image of the indicator can be displayed through an imaging window so that the user can see the first reference object and the indicator through the imaging window, thereby achieving a visually intuitive viewing effect of the virtual image from the user's perspective. For example, the bottom of the indicator can be aligned with the top of the first reference object. For example, if the first reference object is a road and the indicator is a three-dimensional arrow, the three-dimensional arrow can be displayed directly on the road so that at least a portion of the indicator is suspended above the first reference object.

[0064] In some embodiments, the first reference object includes a driving surface related to the driving information (e.g., the driving surface may include one of the following: ground or water); and / or, the second reference object includes a reference object related to the driving information.

[0065] In some embodiments, an indicator is associated with an object by at least one of the shape relationship, projection relationship, color relationship, size relationship, and custom relationship between the associate and the indicator; and / or, an indicator is associated with an object by the pointing relationship between the associate and the object.

[0066] In some embodiments, the shape relationship between the associate and the indicator includes making the associate and the indicator have the same or similar shapes; and / or, wherein when the indicator is associated with an object through a pointing relationship between the associate and the object, the associate is displayed as including a pointing between the indicator and a second reference.

[0067] In some embodiments, similar or identical shapes include at least one of the following: arrows, triangles, circles, ellipses, polygons with more than 4 sides, and similar shapes to these shapes.

[0068] For example, the term "same shape" can be understood as either completely identical or approximately identical. For example, approximately identical and similar shapes are determined based on whether the user can identify the association between the indicator and the object. For example, approximately identical shapes can include similar shapes, such as triangles similar to triangles. For example, shape similarity can be determined based on whether they belong to the same shape family; for example, shape families can be categorized as circle families, polygon families, and arrow families. For example, the circle family includes at least one of circles, ellipses, and eggs. For example, the polygon family includes triangle families, quadrilateral families, or other numbers of polygon families.

[0069] For example, when the above association symbol is a triangle, and / or when the above indicator is a triangle or a triangle-like symbol, the above indicator is associated with the above object.

[0070] For example, the above associations can be pointing arrows or pointing lines to indicate objects.

[0071] In some embodiments, the association may include a portion that aligns with a first reference object.

[0072] In some embodiments, the association may further include: a mapping of the indicator relative to the first reference.

[0073] For example, "relative to the first reference" can be understood as: there is a relative relationship between the indicator and the mapper relative to the first reference.

[0074] In some embodiments, the association may further include: a luminance symbol having a brightness and / or a luminance symbol for indicating information related to driving information.

[0075] For example, "having brightness" can be understood as brightness different from the brightness of the position outside the brightness symbol and / or brightness higher than the brightness of the position outside the brightness symbol.

[0076] For example, a mapper is displayed in a way that allows the user to identify its association with an indicator. For example, a mapper may be aligned with or spaced from a first reference object. For example, the user can identify the association between a mapper and an indicator through at least one of the following: shape relationship, color relationship, size relationship, projection relationship, and user-defined relationship. For example, a shape relationship may include the mapper and indicator having the same or similar shapes, and / or a color relationship may include the mapper and indicator having the same or similar colors, and / or a size relationship may include the size of at least a portion of the indicator and the associated symbol satisfying a preset condition, and / or a projection relationship may include orthographic or oblique projection. For example, shape similarity can be determined based on whether they belong to the same shape series; for example, shape series may be categorized into circle series, polygon series, and arrow series. For example, the circle series includes at least one of circles, ellipses, and eggs. For example, the polygon series includes triangle series, quadrilateral series, or other numbers of polygon series.

[0077] For example, an association symbol can be a mapper, or it can include mappers and other symbols. Other symbols can include pointers, which are displayed to allow the user to identify the directional relationship between the pointer and an object. Pointers can be displayed as arrow pointers, line pointers, or other symbols. For example, an arrow pointer can be displayed pointing to an object (e.g., from a pointer to a mapper closer to the object than the pointer) or pointing to a pointer (e.g., from a mapper closer to the object than the pointer to the pointer). Line pointers can be displayed as a line connecting an object or mapper to a pointer, or as a straight line or curve between an object or mapper and an object; the line can be continuous or discontinuous. For example, as... Figure 7 As shown, the indicator includes a box indicating CITY BANK, the association includes a mapper that is flush with the ground and a dashed line between the indicator and the mapper, and the mapper is close to the horizontal dimension of the box.

[0078] For example, based on any embodiment of this disclosure, the association symbol can be displayed as including a mapping symbol but excluding a pointer symbol. For example, as Figure 5 As shown, the associations that are attached to the ground and the indicators that are suspended above the ground are similar in shape to triangles, which allows users to recognize that the indicators are associated with the ground.

[0079] In some embodiments, the mapper is determined based on the vertical or oblique projection of the indicator onto the first reference object; or, the mapper is determined based on the projection of the indicator onto the first reference object according to real-world projection relationships.

[0080] For example, the projection onto the first reference object can be the projection itself, or it can be a shape obtained from the projection itself. For example, a shape obtained from the projection itself can be displayed as having a similar shape or approximate size to the projection itself, and the degree of similarity in shape or size can enable the user to recognize that the projection is associated with the indicator.

[0081] For example, the above-mentioned mapping symbol includes a shadow pattern corresponding to the indicator. In some embodiments, the shadow pattern is hollow at the position corresponding to the indicator.

[0082] For example, the aforementioned association symbol may include a brightness symbol. For example, the brightness symbol is used to display a halo at the outline of at least a portion of the association symbol (e.g., a mapping symbol). For example, as the distance between the halo and the outline of the association symbol increases, the brightness of the halo gradually decreases or increases. For example, the brightness of the brightness symbol may be displayed in relation to the brightness and / or temperature of the real environment. For example, the brightness of the brightness symbol may vary with changes in the brightness and / or temperature of the real environment; and / or, the brightness of the brightness symbol is used to indicate the brightness and / or temperature level of the real environment.

[0083] For example, the display frequency and brightness of the halo can be set to provide dynamic lighting effects for the associated symbols.

[0084] For example, the degree of change in driving-related information can be indicated by the changes in brightness indicators (e.g., the frequency of change, such as the display frequency of the brightness indicator, the brightness variation frequency of the brightness indicator, or other variation frequencies). Driving-related information can be preset information or user-defined information. Preset information could include the distance between the vehicle and a first reference point, a second reference point, or a navigation point of interest (e.g., other vehicles, obstacles, points of interest, or navigation points).

[0085] For example, the aforementioned association can be placed between the aforementioned indicator and the aforementioned object.

[0086] In some embodiments, when an association symbol for associating an indicator with a second reference object is displayed, the association symbol is shown as a line image between the indicator and the second reference object.

[0087] In some embodiments, the display method further includes: determining a symbol associated with the second reference object from a preset set of indicators based on the type of the second reference object, and displaying the indicator as including the symbol.

[0088] For example, driving information includes at least one of the following: direction of travel information; steering angle information; point of interest information; navigation point information.

[0089] For example, the aforementioned direction of travel indicates at least one of the vehicle's forward, reverse, and turning directions during its journey. For example, the aforementioned steering angle indicates the angle at which the vehicle's steering wheel can turn. For example, the aforementioned point of interest (POI) can be a building, shop, park, bus stop, subway station, or obstacle (such as a pedestrian, vehicle, or other object) along the journey. For example, the aforementioned navigation point can be a location that may affect the vehicle's route, direction of travel, or turning angle during travel. For example, a navigation point can be an intersection, a passenger pick-up point, or a destination.

[0090] For example, when the above indicators indicate driving information, users can determine any one of the following based on the driving information: direction of travel, steering angle, point of interest, and navigation point information of the current driving route.

[0091] In some embodiments, the indicator includes multiple sub-indicators; the indicator is used to indicate the route, and the multiple sub-indicators are spaced apart along the route.

[0092] For example, when an indicator is used to indicate a route, a navigation point can be determined; it can be determined whether the relationship between the current location and the navigation point satisfies the indication condition for the indicator to indicate the navigation point; for example, if the relationship satisfies the indication condition, the navigation point can be indicated by at least a part of the indicator.

[0093] For example, a route can include a forward route, a backward route, and a turning route.

[0094] For example, the first reference object and / or the second reference object can be a fixed object, such as a road, a road sign on the road, or a building.

[0095] For example, the first reference object can be selected manually or automatically. Alternatively, if automatic selection is enabled, the first reference object can be selected based on its volume, architectural condition, and coverage area. For instance, the first reference object can be selected from a pool of potential reference objects.

[0096] In some embodiments, the first reference object can be selected based on its volume. When selecting the first reference object based on its volume, the reference object with the largest volume can be used as the first reference object. For example, if the reference objects to be selected include reference object A and reference object B, where reference object A has a volume of 20m³... 3 The volume of reference object B is 100m³. 3 Then, reference object B will be used as the first reference object mentioned above.

[0097] In some embodiments, the first reference object can be selected based on the coverage range of the aforementioned reference objects to be selected. When selecting the first reference object based on the coverage range of the aforementioned reference objects to be selected, the reference object with the largest coverage range can be used as the first reference object. For example, if it is determined that the reference objects to be selected include reference object C and reference object D, wherein the coverage range of reference object C is 10m... 2 The coverage area of ​​reference object D is 1m. 2 Then, reference C will be used as the first reference mentioned above.

[0098] In some embodiments, the first reference object can be selected based on the construction status of the aforementioned reference object to be selected. For example, if it is determined that the reference objects to be selected include reference object E and reference object F, wherein the construction status of reference object E is under construction and the construction status of reference object F is completed, then reference object F can be used as the first reference object.

[0099] For example, the technical solution for selecting the second reference object is similar to the technical solution for the first reference object, therefore, this disclosure will not elaborate on it here.

[0100] For example, the size, shape, orientation, and display intensity of the aforementioned indicator and the aforementioned shadow image follow or are consistent with the shadow image of a first or second reference object in the real world. The shadow image generated in this way is very realistic to the user and can improve the user's viewing experience.

[0101] In some embodiments, when generating an association symbol for associating an indicator with a first reference, there is a projection relationship between the association symbol and the indicator.

[0102] In some embodiments, when generating an association symbol for associating an indicator with a first reference object, the association symbol is displayed as a shadow image of the indicator on the first reference object.

[0103] In some embodiments, obtaining the projection relationship includes at least one of the following: determining the projection relationship by means of the light source parameters of the light source corresponding to the vehicle; or determining the projection relationship based on the positional relationship between the shadows of the second reference object and the second reference object.

[0104] In some embodiments, parameters of a light source in the real world can be obtained, and a real-world projection relationship can be obtained based on the parameters; and / or, the positional relationship between a real object and its shadow in the real world can be obtained to obtain a real-world projection relationship.

[0105] For example, the aforementioned light source can be understood as an artificial light source, that is, the light-emitting device carried by the vehicle itself, such as vehicle headlights, or a natural light source during the journey, such as sunlight.

[0106] In some embodiments, the artificial light source may be selected to be located in front of the vehicle. For example, the distance between the selected artificial light source in front of the vehicle and the vehicle in front is close to the imaging distance of the HUD. "Close" can be understood as the distance difference between the distance between the artificial light source and the vehicle in front and the imaging distance of the HUD being within a preset range.

[0107] For example, the aforementioned means of transportation are man-made tools used for transportation or mobility. For instance, means of transportation can include, but are not limited to, any of the following: airplanes, ships, automobiles, and aircraft.

[0108] In some embodiments, after obtaining the projection relationship, the method further includes: storing the obtained projection relationship in the processor of the display device or the processor of the vehicle.

[0109] In some embodiments, the display method further includes: when the second reference is another vehicle within the target area, determining the shape of a target vehicle from a set of vehicle shapes and adjusting the shape of the indicator to the shape of the target vehicle; when the second reference is a living organism within the target area, determining the shape of a target living organism from a set of living organism shapes and adjusting the shape of the indicator to the shape of the target living organism.

[0110] For example, the target area mentioned above can be understood as the area of ​​the environment in front of the user when driving a vehicle. For example, if the vehicle is an airplane, the target area could be the cloud cover in front of the airplane; or, if the vehicle is a car, the target area could be the road in front of the user.

[0111] For example, the above-mentioned vehicle shape can be understood as the external appearance of the vehicle. For example, the vehicle shape can include any one of the shapes of an airplane, a ship, a car, and an aircraft, and this disclosure does not limit it.

[0112] For example, the aforementioned target organism shape can be understood as the external appearance of the target organism. For example, the target organism shape can be an animal shape and / or a plant shape, and this disclosure does not limit this. In the case where the aforementioned target organism shape is a plant shape, the aforementioned target organism shape can include any of trees and flowers, and this disclosure does not limit this.

[0113] In some embodiments, the display method further includes: when there are multiple indicators, combining the multiple indicators to obtain multiple combined indicators; and displaying the multiple combined indicators.

[0114] The display method of this disclosure will be further described below with reference to the following embodiments.

[0115] In some embodiments, when using a display device to display a UI (User Interface) image (e.g., the aforementioned indicator), a shadow image corresponding to the UI image (e.g., the aforementioned association symbol) may also be displayed. Through the projection relationship between the UI image and the aforementioned first reference object, the shadow image corresponding to the UI image can be displayed in a realistic environment, thereby enhancing the correlation between the UI image and the first reference object.

[0116] The display device described above needs to be explained next. For example, the display device can be a head-up display (HUD). The HUD emits light information through its own light source, which is reflected by a reflector to a projection mirror, and then reflected by the projection mirror to an imaging window. The human eye can see the formed virtual image through the imaging window, giving the impression that the virtual image is floating in the real environment in front of them.

[0117] For example, the position of the virtual image (equivalent to the aforementioned indicator) displayed by the head-up display can be adjusted by changing the angle of the projection lens. For example, the projection lens can be a curved mirror.

[0118] In some embodiments, the above-mentioned real environment can be understood as the environment in which the first reference object is located.

[0119] For example, the UI image described above can be used to display driving information. When the driving vehicle is a vehicle, the driving information may include any one of vehicle speed information, navigation information, fault information, and driving assistance information. This disclosure does not limit this information.

[0120] In some embodiments, vehicle speed information is a basic information that the head-up display device can display. Currently, the coverage and number of speed limit cameras have greatly increased. The head-up display device can provide real-time feedback on the vehicle's driving speed, reducing traffic incidents caused by speeding.

[0121] In some embodiments, displaying real-time road navigation information via a head-up display device can reduce traffic risks caused by users looking down at navigation routes.

[0122] For example, when driver assistance information is displayed via a head-up display, the number of times the user needs to look at the instrument panel can be reduced, thus improving driving safety. For instance, driver assistance information may include any one of the following: speed limit display information, lane keeping information, and cruise control information.

[0123] In some embodiments, the UI image displayed on the head-up display device can be synchronized with the vehicle's driving status, such as the vehicle's direction of travel or tilt angle, etc. Figure 5 The indicator in the text can not only indicate the direction of travel of the vehicle, but also change the direction of the arrow in sync with the degree of the turn when the vehicle turns.

[0124] For example, the technical details relating to the first reference object, the UI image, the projection relationship, and the shadow image are well known in the art and will not be explained further herein.

[0125] Next, taking the image displayed on the head-up display as the UI image during vehicle guidance as an example, the above display method will be explained in the following steps:

[0126] Step 1: Generate the UI image to be displayed using the head-up display device.

[0127] In some embodiments, taking a vehicle as an example, combined with Figure 3 Provide a description of the UI image to be displayed. Figure 3 This is a schematic diagram illustrating the display content of the head-up display device according to this disclosure. For example... Figure 3 As shown, Figure 3 The UI image includes a driving indicator with three triangular icons, which are used to indicate the direction of the vehicle's movement.

[0128] Step 2: Generate the shadow image corresponding to the UI image using the head-up display device.

[0129] In some embodiments, a shadow image corresponding to a UI image can be generated using projection relationships. For example, projection relationships can be obtained in various ways. For instance, projection relationships can be determined by light source parameters in the real world, or obtained by the positional relationship between a real object in the real world and its shadow. Then, the shadow image corresponding to the UI image under this projection relationship can be obtained based on the projection relationship. This disclosure does not limit this.

[0130] For example, light source parameters may include the geographical location of the light source, the angle at which the light source emits light, the time at which the light source emits light, and the date on which the light source emits light; this disclosure does not limit these parameters.

[0131] In some embodiments, the technical solution for determining projection relationships through light source parameters in the real world may include: determining a reference frame for the light source in the real world by the geographical location of the light source and the angle at which the light source emits light; or generating a shadow image of the UI image based on the determined position of the light source in the real world.

[0132] Only two methods of projection relationship are listed here. The embodiments below also provide a method for determining the projection relationship: obtaining the projection relationship based on relevant parameters when the light source is located above the vehicle.

[0133] For example, the projection relationship can be a variable relationship that changes in real time with the change of parameters, or it can be a fixed relationship that is set manually.

[0134] In some embodiments, when the projection relationship is a fixed relationship set by humans, the projection relationship can be obtained based on relevant parameters when the light source is located above the vehicle, and this projection relationship can be pre-stored in the processor.

[0135] For example, the processor could be a processor for a head-up display device and / or a processor for a vehicle.

[0136] In some embodiments, after confirming that the above parameters are correct, the processor can calculate the shadow image using a shadow algorithm. For example, a shadow algorithm can be understood as an algorithm that calculates and projects a three-dimensional geometric object in space onto a plane to form the shadow of that object.

[0137] For example, the above-mentioned shadow algorithms may include shadow mapping algorithms, shadow volume algorithms, and soft shadow algorithms, and this disclosure does not limit them.

[0138] For example, a shadow image corresponding to each UI image can be generated based on parameters such as the imaging distance of the UI image (e.g., the distance between the UI image and the user), the position parameters of the UI image displayed on the head-up display device, and the position of the user's eyes, combined with the projection relationship mentioned above.

[0139] In some embodiments, it can be combined Figure 4 The display method of this disclosure will be described. Figure 4 This is a schematic diagram of the indicator and corresponding shadow image of the display device according to this disclosure. For example... Figure 4 As shown, one of the indicators in the display device is provided, along with a corresponding association, such as a shadow image. For example, the association may also include a brightness symbol (e.g., a halo, which can be of any shape) to enhance the display effect or to indicate information related to driving information. For example, the shape may include regular geometric shapes, such as circles and squares, or it may include irregular shapes.

[0140] Step 3: Associat the indicator with the real world using the aforementioned association symbols (which include, for example, mapping symbols (e.g., shadow images) and / or brightness symbols and / or pointing symbols).

[0141] In some embodiments, AR (Augmented Reality) technology is used to overlay shadow images onto roads, increasing the relevance of the images to the real world.

[0142] For example, information about the real environment ahead can be collected by a data acquisition device on a vehicle and sent to a processor so that the processor can establish a coordinate system, calculate the positional relationship between the UI screen of the head-up display device and the road in the coordinate system, and then transmit it to the head-up display device for display.

[0143] For example, the coordinate system mentioned above could be a vehicle coordinate system with the vehicle as the base point.

[0144] For example, information about the actual environment ahead could be lane markings.

[0145] For example, the data collection devices on vehicles may include environmental sensors and vehicle body sensors, and this disclosure does not limit this.

[0146] Figure 5 This is a schematic diagram (a) illustrating the display effect of the display device according to this disclosure. For example... Figure 5 As shown, the UI image associated with the first reference object is a driving indicator.

[0147] In some embodiments, when using a head-up display device to display a UI (User Interface) image (such as the indicator described above), a connecting image for indicating a second reference object may also be displayed. The connecting image is used to connect the UI image and the second reference object, which can enhance the correlation between the UI image and the second reference object, thereby improving the user experience.

[0148] For example, UI images can be displayed as flat images or as three-dimensional images. For example, such as Figure 4 and Figure 5 As shown, a UI image is provided that is displayed in the form of a stereoscopic image.

[0149] For example, during operation, the relationship between the UI image and the first reference object can change, and the display effect of the UI image can also change; and / or the display effect of the UI image can also change. For example, the UI image can turn, take off, and / or land.

[0150] Next, in conjunction with the appendix Figure 6 -Appendix Figure 8 The display effect of the display device disclosed herein will be described.

[0151] Figure 6 This is a schematic diagram (II) illustrating the display effect of the display device according to this disclosure. For example... Figure 6 As shown, Figure 6 The UI image associated with the first reference object is the POI indicator. For example, using "CITY BANK" as the POI indicator, in the attached... Figure 6 -Appendix Figure 8 The document provides three examples of POI indicators.

[0152] For example, the POI indicator can be used to indicate the first reference point set for the target object.

[0153] In one exemplary embodiment, such as Figure 6 As shown, the POI indicator is set to indicate the intersection ahead.

[0154] In one exemplary embodiment, such as Figure 7 As shown, the POI indicator is set to indicate traffic signs on the road ahead.

[0155] In one exemplary embodiment, such as Figure 6 As shown, the POI indicator is set to indicate the destination ahead.

[0156] For example, a ground-related indicator can also be a destination indicator, and this disclosure does not limit this.

[0157] In some embodiments, there may be multiple indicators during driving, and these multiple indicators can be combined to form a turn indicator when turning. The combined turn indicator also has a corresponding shadow image.

[0158] In some embodiments, it may be combined with appendix Figure 9-15 The combined steering indicator is explained.

[0159] Figure 9 This is a schematic diagram (a) of a turn indicator assembly according to this disclosure. For example... Figure 9 As shown, Figure 9 It includes 6 indicators, for example, the indicators are in the shape of triangles, and the order of the indicators from largest to smallest indicates the direction of the vehicle's movement.

[0160] Figure 10 This is a schematic diagram (II) of a steering indicator assembly according to the present disclosure. Figure 10 It provides an indicator for turning, such as Figure 10 As shown, Figure 10 It includes six indicators, for example, the smallest indicator is used to indicate that the vehicle is turning right, and at least one indicator also displays a corresponding shadow image below it.

[0161] Figure 11 A schematic diagram (III) of the combination of steering indicators according to this disclosure. Figure 11 A combination indicator is provided for turning, such as Figure 11 As shown, Figure 11 It includes 6 indicators, for example, 2 of the smallest indicators are combined to form a combination indicator for indicating that the vehicle is turning right, and at least one indicator also displays a corresponding shadow image below it.

[0162] Figure 12 This is a schematic diagram (IV) of a combination of steering indicators according to this disclosure. Figure 12 A combination indicator is provided for turning, such as Figure 12 As shown, Figure 12 It includes six indicators, for example, three of the smallest indicators are combined to form a combination indicator for indicating that the vehicle is turning right, and at least one indicator also displays a corresponding shadow image below it.

[0163] Figure 13 This is a schematic diagram (V) of a combination of steering indicators according to this disclosure. Figure 13 A combination indicator is provided for turning, such as Figure 13 As shown, Figure 13 It includes 6 indicators, for example, 4 of the smallest indicators are combined to form a combination indicator for indicating that the vehicle is turning right, and at least one indicator also displays a corresponding shadow image below it.

[0164] Figure 14 This is a schematic diagram (VI) of a combination of steering indicators according to this disclosure. Figure 14 A combination indicator is provided for turning, such as Figure 14 As shown, Figure 14 It includes 6 indicators, for example, 5 of the smallest indicators are combined to form a combination indicator for indicating that the vehicle is turning right, and at least one indicator also displays a corresponding shadow image below it.

[0165] Figure 15 This is a schematic diagram (VII) of a combination of steering indicators according to this disclosure. Figure 15 A combination indicator is provided for turning, such as Figure 15 As shown, Figure 15 It includes 6 indicators, for example, all 6 smallest indicators are combined into a combined indicator to indicate that the vehicle is turning right, and at least one indicator also displays a corresponding shadow image below it.

[0166] For example, in the above appendix Figure 9-15 In the embodiments described above, the present disclosure does not limit the content, shape, and color of the generated association symbol.

[0167] In some embodiments, as shown in the appendix Figure 9-15 As shown, attached Figure 9 Regular indicators (such as unshaded indicators) can be replaced with shaded indicators. This is especially important when approaching a road turn, as shown in the attached diagram. Figure 10-15 As shown, the turn indicator formed by combining multiple indicators is also shaded to enhance the sense of connection.

[0168] Through the above embodiments, combined with the appendix Figure 9-15 The display device in the image can show realistic projection relationships, enhancing the connection between the image and the real world.

[0169] By adopting the technical solutions in the above embodiments, the driving risks caused by users looking down at the instrument panel during driving can be reduced, the driving safety factor can be improved, and a better driving experience can also be brought.

[0170] Figure 16 This is a structural block diagram of a display device provided according to at least one embodiment of the present disclosure, such as... Figure 16 As shown, the display device includes:

[0171] The first display module 1602 is configured to display indicators related to driving information, wherein at least a portion of the indicators is suspended above a first reference object;

[0172] The second display module 1604 is configured to display an association symbol that associates an indicator with an object, wherein the object includes at least one of the following: a first reference object and a second reference object.

[0173] At least one embodiment of this disclosure also provides an electronic device, including a head-up display device or a smart wearable device.

[0174] For example, smart wearable devices could be electronic helmets or electronic glasses.

[0175] At least one embodiment of this disclosure also provides a means of transportation, including the storage medium and electronic device described above.

[0176] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this disclosure.

[0177] In some embodiments of this disclosure, the storage medium described above may be configured to store a computer program for performing the following steps:

[0178] S1, displaying an indicator related to driving information, wherein at least a portion of the indicator is suspended above a first reference object;

[0179] S2 displays an association symbol that associates the indicator with an object, wherein the object includes at least one of the following: a first reference object and a second reference object.

[0180] In some embodiments, the computer-readable storage medium may include, but is not limited to, various media capable of storing computer programs, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0181] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.

[0182] Embodiments of this disclosure also provide an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0183] In some embodiments, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0184] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.

[0185] It is obvious to those skilled in the art that the modules or steps of this disclosure described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. They can be implemented using computer-executable program code, and thus can be stored in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those presented herein, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, this disclosure is not limited to any particular combination of hardware and software.

[0186] The above description is merely a preferred embodiment of this disclosure and is not intended to limit this disclosure. Various modifications and variations can be made to this disclosure by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A display method, wherein, include: Displays indicators related to driving information, wherein at least a portion of the indicators is suspended above a first reference object; Display an association symbol that associates the indicator with an object, wherein the object includes at least one of the following: the first reference object and the second reference object; The association symbol includes: a portion that is attached to the first reference object, and / or a mapping symbol of the indicator relative to the first reference object, and / or a brightness symbol having brightness and / or a brightness symbol for indicating information related to driving information, and / or the mapping symbol and a pointing symbol, the pointing symbol being displayed to identify the pointing relationship between the indicator and the object, the mapping symbol being displayed to identify the mapping symbol being associated with the indicator, and the mapping symbol being attached to or spaced from the first reference object; The mapping symbol is determined based on the vertical or oblique projection of the indicator onto the first reference object; or, the mapping symbol is determined based on the projection of the indicator onto the first reference object according to a real-world projection relationship, wherein obtaining the projection relationship includes at least one of the following: determining the projection relationship through the light source parameters of the light source corresponding to the vehicle; determining the projection relationship based on the positional relationship between the second reference object and the shadow of the second reference object.

2. The display method according to claim 1, wherein, The indicator is completely suspended above the first reference object.

3. The display method according to claim 1, wherein, The first reference object includes a driving surface related to the driving information; and / or, the second reference object includes a reference object related to the driving information.

4. The display method according to claim 1, wherein, The indicator is associated with the object through at least one of the shape relationship, projection relationship, color relationship, size relationship, and custom relationship between the associated symbol and the indicator; and / or, the indicator is associated with the object through the pointing relationship between the associated symbol and the object.

5. The display method according to claim 4, wherein, The shape relationship between the association symbol and the indicator includes making the association symbol and the indicator have the same shape; and / or Specifically, when the indicator is associated with the object through the pointing relationship between the association symbol and the object, the association symbol is displayed as a pointing symbol that includes the pointer between the indicator and the second reference object.

6. The display method according to claim 5, wherein, The same shape includes at least one of the following: arrow, triangle, circle, ellipse, or polygon with more than 4 sides.

7. The display method according to claim 6, wherein, The mapping symbol is determined based on the vertical or oblique projection of the indicator onto the first reference object; or, the mapping symbol is determined based on the projection of the indicator onto the first reference object according to real-world projection relationships.

8. The display method according to claim 7, wherein, Also includes: Obtain the parameters of the light source in the real world, and obtain the real-world projection relationship based on the parameters; And / or, obtain the positional relationship between real objects in the real world and their shadows to obtain the real-world projection relationship.

9. The display method according to claim 1, wherein, The method further includes: Based on the type of the second reference object, a symbol related to the second reference object is determined from a preset set of indicators, and the indicator is displayed to include the symbol.

10. The display method according to any one of claims 1-9, wherein, The driving information includes at least one of the following: direction of travel information; steering angle information; point of interest information; navigation point information.

11. The display method according to claim 1, wherein, The indicator includes multiple sub-indicators; the indicator is used to indicate the route, and the multiple sub-indicators are spaced apart along the route.

12. The display method according to claim 1, wherein, The indicator is used to indicate the route, and the method further includes: Determine navigation points; Determine whether the relationship between the current travel position and the navigation point satisfies the indication condition for the indicator to point to the navigation point; Wherein, when the relationship satisfies the indication condition, the driving navigation point is indicated by at least a portion of the indicator.

13. The display method according to any one of claims 1-6 and 7-9, wherein, The association symbol includes a luminance symbol, which is displayed as a halo at at least a portion of the outline of the association symbol; and / or, the luminance of the luminance symbol may be displayed in relation to the brightness and / or temperature of the real environment; and / or, the degree of change of information related to driving information is indicated by the variation of the luminance symbol.

14. A display device, wherein, include: A first display module is configured to display indicators related to driving information, wherein at least a portion of the indicators is suspended above a first reference object; The second display module is configured to display an association symbol that associates the indicator with an object, wherein the object includes at least one of the following: the first reference object and the second reference object; The association symbol includes: a portion that is attached to the first reference object, and / or a mapping symbol of the indicator relative to the first reference object, and / or a brightness symbol having brightness and / or a brightness symbol for indicating information related to driving information, and / or the mapping symbol and a pointing symbol, the pointing symbol being displayed to identify the pointing relationship between the indicator and the object, the mapping symbol being displayed to identify the mapping symbol being associated with the indicator, and the mapping symbol being attached to or spaced from the first reference object; The mapping symbol is determined based on the vertical or oblique projection of the indicator onto the first reference object; or, the mapping symbol is determined based on the projection of the indicator onto the first reference object according to a real-world projection relationship, wherein obtaining the projection relationship includes at least one of the following: determining the projection relationship through the light source parameters of the light source corresponding to the vehicle; determining the projection relationship based on the positional relationship between the second reference object and the shadow of the second reference object.

15. A computer-readable storage medium, wherein, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method described in any one of claims 1 to 13.

16. An electronic device comprising a display device as claimed in claim 14 or a storage medium as claimed in claim 15.

17. The electronic device according to claim 16, wherein, The electronic device includes a head-up display or a smart wearable device.

18. A means of transportation, wherein, This includes the display device as described in claim 14, the storage medium as described in claim 15, or the electronic device as described in claim 16 or 17.

Images