A display method and related product
Patent Information
- Application Number
- CN202511039152.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-25
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2045-07-25
AI Technical Summary
[0003]当前HUD的显示区域中显示的信息数量多,例如终端的状态信息、终端对实景环境的感知信息、仪表类信息等,每个信息独立显示,且每个信息的显示占据一定的显示空间,导致显示区域内的信息密度大,用户的认知效率低,灵活性较差
Smart Images

Figure CN121404008B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of display imaging technology, and in particular to a display method and related products. Background Technology
[0002] With the development of intelligent driving technology, intelligent optical displays such as head-up displays (HUDs) are increasingly becoming core components.
[0003] The current HUD displays a large amount of information, such as terminal status information, terminal perception of the real-world environment, and instrument information. Each piece of information is displayed independently and occupies a certain amount of display space, resulting in high information density in the display area, low user cognitive efficiency, and poor flexibility. Summary of the Invention
[0004] This application provides a display method and related products that can centrally and effectively present navigation information, terminal information, and real-world environment information to users, thereby improving information transmission efficiency, driving comfort, and driving safety.
[0005] Firstly, embodiments of this application provide a display method. This display method is applied to a display device. The display method can be executed by the display device. Exemplarily, the display method can also be executed by a control device of the display device, or by a unit or module in the control device, such as a computing module or chip. For ease of description, some embodiments use a display device as an exemplary execution subject, but in specific implementations, the subject executing the method can be other devices or modules. The display method includes, but is not limited to, the following steps: The display device acquires scene information from a first terminal, which includes one or more of navigation information, terminal information, or sensory information. Based on the scene information, the display device displays a first pattern at a target display position. The first pattern includes at least a line pattern, the display style of which is related to the scene information. The target display position is used to display at least two of the navigation information, terminal information, or sensory information. In this embodiment, a display method is provided that displays a first pattern at a fixed position. The first pattern includes a line pattern. By using a fixed display position and display form, a stable visual anchor point is formed, eliminating the need for users to repeatedly adapt to changes in the interface layout and reducing the cognitive load on users during information recognition. Especially in scenarios where the first terminal is a vehicle, this method ensures that the driver's attention remains focused on the road environment, improving driving safety. The line pattern uses less display space, improving the utilization of display space and reducing the impact on the driver's field of vision. Through the display styles corresponding to the scene information within the line pattern, the driver can obtain the corresponding scene information simply by relying on the display style. This simplifies information transmission, improves information transmission efficiency, and enhances the flexibility of information display. It also displays different scene information at the target display location, with rich information types, improving the adaptability of the display device to information transmission in different scenarios.
[0006] To enhance the stability of visual anchor points, in addition to fixing the display position, other attributes of the first pattern can also be fixed, such as display area, display shape, and other attributes besides the display style. In one optional embodiment, one or more of the display position, display area, display length, and display shape of the line pattern in the first pattern are fixed. By displaying fixed and stable line patterns with attributes other than display style, the display effect of the line patterns is improved, the user's learning cost is reduced, and the driving safety of the terminal is ensured.
[0007] The aforementioned fixed display means that the values of the line pattern's attributes are fixed, or the variations in their differences are fixed. For example, a fixed display area for the line pattern means that displaying the line pattern within a fixed display area is considered a fixed display area. Similarly, a fixed display length for the line pattern means that the length of the line pattern is fixed, or that variations in length within a certain threshold range are also considered a fixed display length.
[0008] In one optional implementation, the display form of the linear pattern includes, but is not limited to, straight lines, broken lines, curves, stripes, blocks, triangles, or circles. Based on the visual encoding characteristics of different forms, differentiated expressions are provided for diverse information. For example, curved shapes are suitable for expressing navigation paths, and block structures are suitable for segmented display of terminal information (such as battery life information), thereby improving the intuitiveness and accuracy of information transmission.
[0009] Optionally, the display form of the linear pattern is obtained by splicing the above forms together.
[0010] In one optional implementation, the target display position includes any one or more positions within the field of view of the display device installed on the first terminal: bottom of the frame, top of the frame, one side of the frame, both sides of the frame, edge of the frame, and center of the frame. Displaying the first pattern at the bottom of the frame avoids obscuring other information displayed by the display device (such as AR light carpet) and utilizes the peripheral vision area at the lower edge of the driver's field of vision to achieve uninterrupted parallel operation of information assistance prompts and primary vision observation. Displaying the first pattern at the top of the frame allows the first pattern to blend with the environment. In some implementations, the first pattern can be mapped to some environmental elements (such as other vehicles) for accurate display. Displaying the first pattern on one side of the frame (e.g., the left or right side of the frame) allows the first pattern, especially a linear pattern, to be mapped to some environmental elements (such as lane lines) in some implementations. This achieves environmental blending while also serving as lane line indication and enhancing the richness of information delivery through display style. Displaying the first pattern on both sides of the image (e.g., the left and right sides, top and bottom) allows for real-time, multi-dimensional information delivery, meeting user information needs and laying the foundation for displaying multi-dimensional scene information in complex scenarios. Displaying the first pattern at the edges of the image (e.g., around the edges or borders) provides supplementary information prompts and avoids interference with the primary viewpoint. Displaying the first pattern in the center of the image improves the efficiency of transmitting critical information, such as alarm messages in high-risk scenarios, and serves to separate information displayed on the device, ensuring a clean and organized display.
[0011] For example, the display device is a HUD based on virtual image display technology.
[0012] For example, the target display position includes the bottom of the image. The first pattern is located below the navigation information displayed on the display device. Optionally, the navigation information includes, but is not limited to: trip information (e.g., trips already traveled, trips not yet traveled), road congestion status (e.g., whether the current road segment or a previously untraveled road segment is congested), map information, driving guidance information (e.g., AR light carpet indicating driving direction), road information (e.g., how many lanes the current road contains, and the corresponding lane lines), lane information (e.g., the current lane is a left-turn lane, a straight lane, etc.), destination information (e.g., arrival time at the destination, location of the destination), distance information (e.g., distance to the nearest intersection, or distance to the destination), or intersection signage information (e.g., signs of intersections). Displaying the first pattern below the navigation information displayed on the display device avoids interfering with the transmission of navigation information. In some implementations, a line-shaped pattern is used to display and distinguish it from the already displayed navigation information to assist users in making trip decisions, improve user cognitive efficiency, and ensure driving safety.
[0013] The display area of the display device is limited. Considering the simplicity of the display screen, the navigation information displayed by the display device may not be comprehensive. Optionally, the missing navigation information can be supplemented by line patterns to improve the coherence of information display, reduce cognitive load, and improve the user's cognitive efficiency.
[0014] In one possible implementation, the first pattern is located below the navigation information and attribute information of the first terminal displayed on the display device. "Below" here may include directly below and / or to the side below. This avoids interference from the display device with the navigation information and attribute information of the first terminal displayed on the display device.
[0015] Optionally, the attribute information includes, but is not limited to: vehicle speed information, speed limit information, driving mode, current time, gear information, vehicle status information, or road condition information. For example, speed limit information includes, but is not limited to: road speed limits, speed limits in intelligent driving mode, or speed limits in cruise control mode. Driving modes include, but are not limited to: Navigate on Autopilot (NOA). Vehicle status information includes, but is not limited to: warning icons or warning lines when too close to an object, and road condition information includes, but is not limited to: 3D modeled road conditions, modeled display information of other vehicles, or lane line information.
[0016] In one optional implementation, the target display position of the linear pattern is mapped to the edge of the first terminal covered by the field of view of the display device. Optionally, taking a vehicle as an example, the edge of the first terminal includes the edge of the hood facing the road ahead. By aligning the linear pattern with physical features such as the edge of the first terminal, the virtual display elements and the real vehicle body structure achieve visual synergy, avoiding spatial misalignment caused by the "floating" feeling of the displayed content and enhancing the spatial consistency of the AR fusion scene.
[0017] In one optional implementation, the target display position includes the center of the image, with the navigation information displayed by the display device located on one side of the target display position, and the attribute information of the first terminal displayed by the display device located on the other side of the target display position. By using the linear pattern in the center of the image as a visual divider, the navigation information and vehicle attribute information are placed in the upper and lower or left and right areas respectively, forming a Z-shaped information flow that conforms to human reading habits, thus optimizing the visual effect of displaying multi-dimensional information in parallel.
[0018] For example, navigation information is located above the line pattern, and attribute information is located below the line pattern.
[0019] The display device may be a device installed on the first terminal, used to display scene information to the user of the first terminal. The scene information of the first terminal is used to indicate information that may be obtained or configured in various scenes applicable to the first terminal.
[0020] For example, the first terminal is a mobile terminal such as a vehicle, mobile phone, or tablet computer, and its applicable scenarios include navigation scenarios, with corresponding scenario information including navigation information. In this embodiment, the navigation information is information used to instruct and guide the movement of the first terminal, and can also be referred to as route information, location information, spatial geographic location information, GPS information, etc.
[0021] In some cases, the navigation information is the navigation information of the first terminal. In other cases, the navigation information is the navigation information of the second terminal, which is a terminal traveling the same route as the first terminal.
[0022] Terminal information is used to indicate information that may be acquired, stored, and displayed within the first terminal. For example, terminal information includes, but is not limited to, parameter information or mode information of the first terminal.
[0023] Optionally, taking a vehicle as the first terminal as an example, the parameter information includes, but is not limited to: motion status information (e.g., whether the vehicle is in a parked state or in a driving state), range information, battery level information, fuel level information, vehicle speed information, accelerator pedal travel information, power output information, vehicle lighting information (e.g., whether low beam headlights, high beam headlights, turn signals, side marker lights, fog lights, etc. are turned on), volume information, mileage information, maintenance time information, etc.
[0024] Optionally, taking a vehicle as the first terminal as an example, the mode information of the first terminal includes, but is not limited to: intelligent driving mode, interactive mode (such as the mode of voice dialogue with the vehicle system), snow mode, off-road mode, rest mode, camping mode, etc.
[0025] Optionally, the terminal information includes entertainment domain information, which includes, but is not limited to: voice information, text information, music information, video information, etc.
[0026] For example, the first terminal is a vehicle, mobile phone, tablet computer, or other terminal equipped with sensing devices. The applicable scenarios include sensing scenarios, and the corresponding scenario information includes the sensing information of the first terminal. The sensing information is the information obtained by the first terminal from sensing the internal and external environment. For instance, a vehicle uses sensing devices to sense the in-vehicle environment and / or the external environment, or a mobile phone uses its configured sensing devices to sense the internal and external environment.
[0027] In one possible implementation, the sensing information of the first terminal is information related to environmental elements perceived by the sensing device. Environmental elements include, but are not limited to: road participants (e.g., road vehicles, pedestrians), obstacles, traffic infrastructure (e.g., traffic lights, traffic signs), weather, temperature, humidity, brightness, or air quality.
[0028] In this embodiment, the display style of the linear pattern is used to convey scene information to the user in at least two dimensions. Optionally, the scene information includes at least three dimensions. The first dimension includes navigation information from external sources (such as cloud servers, roadside devices, or other terminals). The second dimension includes information about the terminal itself, such as the terminal information mentioned above (which may include parameter information, mode information, and entertainment domain information). The third dimension includes information from sensing devices, such as the sensing information mentioned above. In an optional implementation, the display style of the linear pattern is related to at least two of the navigation information, the terminal information of the first terminal, or the sensing information of the first terminal. The display style of the linear pattern can be adjusted based on different scene information.
[0029] The following section provides an example of how to illustrate display styles and their relationship with scene information.
[0030] In one alternative implementation, the display style is associated with at least one of the following factors: color, transparency, flickering effect, wave effect, halo effect, aura effect, shadow effect, and graphic topology.
[0031] In one optional implementation, the scene information of the first terminal includes navigation information, and the display style of the line pattern is related to the navigation information. By integrating multi-dimensional navigation information (such as congestion status, lane guidance, and destination distance) through the line pattern, the traditionally scattered navigation elements are unified into a single visual channel, eliminating the problems of high learning costs and cognitive fragmentation caused by information fragmentation, and improving the consistency of driving decisions.
[0032] Considering Navigation information The information contained within may be diverse; the following example illustrates the display style corresponding to trip information in navigation information. Trip information indicates the journey from the starting point to the destination. Optionally, trip information includes the journey already traveled and / or the journey to be traveled. The line pattern includes a first part and / or a second part. The display style of the first part is a first display style, and the display style of the second part is a second display style. The first display style indicates the first journey already traveled by the first terminal, and the second display style indicates the second journey to be traveled by the first terminal. For example, the first display style is associated with gray, and the second display style is associated with green. By differentiating the display styles of the first and second journeys, the user's understanding of the overall journey is enhanced.
[0033] In scenarios where a linear pattern display style is used to display travel information, the first terminal may be in motion, and consequently, the first travel and the second travel will change. Optionally, the above method may also include, but is not limited to, the following steps: adjusting the first display style and / or the second display style based on the travel changes of the first terminal. For example, adjusting the display style includes adjusting the size of the display style on the linear pattern.
[0034] In the above embodiments, the linear pattern display style can display more information. To ensure consistency in the types of information displayed, in scenarios where the linear pattern display style is used to display trip information, related information such as road congestion, waypoint information, and road characteristics can be displayed simultaneously. In an optional embodiment, the second part includes one or more third parts, which are used to indicate congested road sections in the second trip. The display style of the third part is a third display style, which is used to indicate the congestion status of the congested road sections. Based on navigation data, congestion markers (such as red blocks) are embedded within the travel segment, and the congestion status of the corresponding road is conveyed to the user through a dual display of color and shape, achieving early warning of road condition risks and visual prediction of route planning without affecting the display of trip information.
[0035] In some cases, the second display style includes a third display style. For example, the third display style is associated with red, and the third part is displayed in red to indicate that the corresponding part is in a congested state.
[0036] In some cases, the second display style includes multiple third display styles, each associated with a different color, such as red for very congested areas and yellow for moderately congested areas.
[0037] Road property information is used to indicate the nature of the road, such as an internal road, expressway, national highway, etc. In an optional embodiment, the first part and / or the second part further includes a fourth part, which is displayed in a fourth display style to indicate the road property. For example, different road properties correspond to roads in the traveled journey and / or the journey to be traveled. For instance, the display style corresponding to internal roads is associated with blue.
[0038] In one optional implementation, the first and / or second portion further includes a fifth portion, which indicates the waypoints of the first terminal. The fifth portion is displayed in a fifth display style, which indicates the type of waypoint. The types of waypoints include, but are not limited to: user-inputted points of interest, refueling points (such as gas stations, charging stations, and battery swapping stations), service areas, toll stations, etc.
[0039] In some cases, waypoints are points of interest input by the user. The above method also includes, but is not limited to, the following operations: the display device receives the input waypoint information; the display device displays the target location in the linear pattern, in a fifth display style, where the target location is related to the geographical location of the waypoint.
[0040] In other cases, where the waypoints are not user-inputted and are special types of locations (such as charging points, service areas, toll stations, etc.), the method also includes, but is not limited to, the following operations: the display device shows the target location in the linear pattern, displaying the fifth part in a fifth display style, where the target location is related to the geographical location of the waypoint. By dynamically generating waypoint markers (such as charging station icons) corresponding to the geographical location in the linear pattern, discrete information is integrated into the continuous travel axis, conveying spatial cognitive information that integrates location and distance.
[0041] In the above embodiments, by displaying travel information in a linear pattern while simultaneously displaying related information, the information display density and the user's information reception efficiency are improved through the display of a series of related information. Similarly, by displaying scene information in a linear pattern while simultaneously displaying related information, information associated with that scene can be added.
[0042] The above mainly describes the display style corresponding to the navigation information. The following section discusses the display... Terminal Information The display style will be explained.
[0043] When the parameter information includes numerical values, the parameter information is conveyed to the user by displaying the corresponding numerical values. In an optional implementation, the terminal information includes parameter information. The linear pattern includes a sixth part and / or a seventh part. The display style of the sixth part is a sixth display style, and the display style of the seventh part is a seventh display style. The sixth display style is used to indicate the current value of the target parameter in the parameter information, and the seventh display style is used to indicate the target value of the target parameter, which includes a maximum value and / or a safe value. For example, the safe value is a preset value; taking battery power as an example, the safe value of battery power is 90%-95%, thereby extending the battery's lifespan.
[0044] In some possible implementations, the parameter information of the first terminal includes battery life information, the sixth display style is used to indicate the current battery life of the first terminal, and the seventh display style is used to indicate the target battery life of the first terminal. This allows users to have a clear understanding of the battery life of the first terminal and reduces battery anxiety.
[0045] Optionally, the range information is used to indicate the range capability of the first terminal. Taking a vehicle as an example, if the first terminal is a vehicle that uses fuel for refueling, the range information includes fuel level information. If the first terminal is a pure electric vehicle, the range information includes battery level information. If the first terminal is a vehicle that can be refueled using both batteries and fuel, such as a range-extended vehicle, the range information includes fuel level information and / or battery level information, or the range information is a comprehensive range information obtained based on fuel level information and battery level information.
[0046] In some other possible implementations, the parameter information of the first terminal includes battery level and / or fuel level. The sixth display style is used to indicate the current battery level and / or fuel level of the first terminal, and the seventh display style is used to indicate the target range of the first terminal. By using a combined display method (the sixth display style in the first part displays the current battery level and / or fuel level, and the seventh display style in the second part displays the target range), the user can clearly perceive the current values of battery level and fuel level, improving the simplicity of the display screen.
[0047] In some other possible implementations, the parameter information of the first terminal includes battery level and / or fuel level. A sixth display style indicates the current battery level and / or target battery level, and a seventh display style indicates the current fuel level and / or target fuel level. This separate display method (battery level and fuel level displayed separately) improves information transmission efficiency. Abstract parameters such as range and battery level are transformed into proportionally filled line charts (e.g., a green segment for current range and a gray segment for target range), using visual proportions instead of numerical readings to lower the cognitive barrier to parameter monitoring.
[0048] Considering that the aforementioned parameter information, similar to navigation information, is a variable value and can change in real time, the display device can adjust the display style of the line pattern when the parameter information changes. For example, when the current battery life decreases, the display scale of the sixth display style can be reduced.
[0049] In one alternative implementation, the above method includes, but is not limited to, the following operation: the display device adjusts the display style of the line pattern based on the scene information of the first terminal.
[0050] In certain special scenarios, such as situations that may affect the normal operation of the first terminal, information that could potentially affect the normal operation of the first terminal is displayed in a specific way to alert the user. For example, the above method includes, but is not limited to, the following operations: when the current value of the target parameter is lower than a first threshold, the display device adjusts the sixth and / or seventh display styles to an eighth display style. The target parameter includes one or more of the following: remaining range information, battery level information, or fuel level information. When the parameter is lower than a safety threshold (e.g., battery level < 20%), the display style is automatically switched (e.g., flashing red), triggering driver alertness through a visual highlighting mechanism (e.g., switching display styles).
[0051] Furthermore, the above method includes, but is not limited to, the following operations: when the display style corresponding to the navigation information is displayed, and the current value of the target parameter is lower than the first threshold, the fifth part is displayed in the fifth display style. Simultaneously with the switching of the display style, the navigation system can automatically add and recommend supplementary stations, forming a closed-loop decision support system.
[0052] In one optional embodiment, the above method includes, but is not limited to, the following operation: when the mode corresponding to the mode information of the first terminal is enabled, the display device adjusts the display style of the line pattern to the ninth display style. Unlike the segmented display style corresponding to the parameter information, the mode information of the first terminal is generally displayed in a single-line style.
[0053] For example, the mode information includes an intelligent driving mode, and the ninth display style is associated with at least one of the following factors: a halo effect and blue. Optionally, the ninth display style is matched with a display style corresponding to the intelligent driving mode displayed on other display devices. Matching means that at least one factor is the same. When intelligent driving is activated, the blue and halo dynamic effects are superimposed, utilizing the edge visual perception characteristics to achieve a "zero cognitive burden" status cues, allowing the driver to confirm the system's operating status without shifting their gaze.
[0054] In one optional implementation, the above method includes, but is not limited to, the following operations: when the first terminal outputs recommendation information, the display style of the line pattern is adjusted to the ninth display style, and the recommendation information is used to recommend entering the intelligent driving mode. Optionally, the first terminal can output recommendation information in various ways, such as voice recommendation, graphic recommendation, etc. By coordinating the output of recommendation information, the efficiency of information transmission is improved.
[0055] In one alternative implementation, the mode information includes a snow mode, and the ninth display style is at least associated with yellow. A dedicated visual style (such as yellow highlight) is matched based on the activated driving mode (e.g., snow mode), enhancing the driver's perception of the current vehicle status through color contrast and avoiding the risk that linear patterns may be difficult to perceive due to changes in ambient color.
[0056] In one optional implementation, the mode information includes an interaction mode, and the ninth display style is associated with at least one of a halo effect and a wave effect. Exemplarily, the interaction mode includes modes activated by operations such as voice interaction, button interaction, and click operation interaction. When the interaction mode includes voice interaction, the wave effect fluctuates with the volume of the sound output or voice input in the interaction mode, and / or, the display area of the ninth display style is associated with the occupant's seat at the time of voice input. By driving the fluctuation effect of the linear pattern through sound wave amplitude, the voice interaction process is transformed into visual feedback, enhancing the sense of presence in human-computer dialogue, and the location of the fluctuation source marks the occupant's seat, assisting the driver in quickly locating the sound source.
[0057] In one alternative embodiment, the above method includes, but is not limited to, the following operations: the display device is based on Perception information Adjust the display style of the line pattern to the tenth display style.
[0058] For example, environmental elements include road users and / or obstacles, and the perceived information includes alarm information used to alert road users and / or obstacles. In some cases, the alarm information is information acquired by the sensing device, such as image data or point cloud data including road users and / or obstacles. In other cases, the alarm information is information determined based on the information acquired by the sensing device; for example, when the controller of the first terminal acquires image data including road users and / or obstacles, it determines that there is a safety risk and generates alarm information accordingly.
[0059] When the perceived information includes warning information, the tenth display style is associated with at least one of the following factors: red, halo effect, and flashing effect. In addition to warning information that alerts road users and / or obstacles, there are other warning information that alerts to dangerous scenarios, such as warnings that the distance to a target object (such as an obstacle or vehicle in front) is too close, that the steering wheel has been disengaged, that there is a risk of rear-end collision, that a large vehicle is passing by, or that there is a risk of collision.
[0060] Considering the limited number of line patterns and the rich and complex scene information, which may exist and change simultaneously, in one optional implementation, priorities are assigned to different scene information, with different priorities for different scene information. The above method includes, but is not limited to, the following operation: the display device prioritizes displaying line patterns using the display style corresponding to the scene information with higher priority.
[0061] For example, prioritizing the safe operation of the first terminal, the display style corresponding to the alarm information has the highest priority. The perceived information includes alarm information, and the alarm information has a higher priority than other scene information besides alarm information. When a risky scene is perceived, it immediately switches to a high-alert style (such as flashing red), utilizing the human instinctive alertness to red light and dynamic stimuli to trigger a physiological stress response in the shortest possible time, shortening the delay in handling danger.
[0062] Considering the degree of assistance various scenario information provides to users of the first terminal, in one optional implementation, taking a vehicle as the first terminal, the priority of alarm information in the scenario information is higher than that of interactive mode, which in turn is higher than that of intelligent driving mode, which is higher than that of navigation information, which is higher than that of parameter information. First, alarm information has the highest priority in relation to driving safety. Second, considering the short and quick nature of interactive mode, the display style corresponding to interactive mode has a higher priority than other scenario information besides alarm information. Third, considering that intelligent driving mode mainly relies on the first terminal for autonomous driving, the display style corresponding to intelligent driving mode is displayed first, under alarm information and interactive mode. Fourth, the display style corresponding to parameter information can be displayed normally unless there is an indication that the current parameter value is too low. Finally, navigation information is mainly used to prompt users with information such as trip details and location. In intelligent driving mode, the display style corresponding to navigation information can be reduced or not displayed at all; when intelligent driving mode is not enabled, the display style corresponding to navigation information can be displayed first.
[0063] By pre-setting scene priorities (alarm information > interactive mode information > intelligent driving mode information > navigation information > parameter information), it ensures that highly urgent information always takes center stage, resolves display conflicts when multiple pieces of information are displayed in parallel, and guarantees the reliability of critical information transmission.
[0064] Optionally, in a specific scenario, even if the priority of the scenario information is set, the associated information in that specific scenario will still be displayed.
[0065] In one alternative implementation, the above method includes, but is not limited to, the following operations: the display device determines the priority of scene information based on the user's historical operations, and the historical operations are used to determine the display style of the line pattern.
[0066] By dynamically optimizing scene priority weights based on historical operation data, the display strategy continuously adapts to individual driver preferences, achieving an intelligent evolution from "system preset" to "personalized customization".
[0067] The above primarily addresses the solution where line patterns can only describe a single type of scene information. The following primarily addresses the solution where line patterns can describe scene information across different dimensions. For example, simultaneously displaying the display style corresponding to navigation information and the display style corresponding to parameter information, or simultaneously displaying the display style corresponding to alarm information and the display style corresponding to navigation information.
[0068] Considering the urgency of displaying low-priority scenario information in specific situations, which can meet the user's information needs for the current scenario, in one optional implementation, the scenario information is used to indicate an application scenario, which includes one or more of the following: low battery range scenario, congestion scenario, risk scenario, or intelligent driving scenario. The above method includes, but is not limited to, the following operation: when the scenario information is used to indicate multiple application scenarios, the display device displays a linear pattern using some or all of the factors in the display style corresponding to each of the multiple application scenarios.
[0069] For example, low range scenarios are associated with one or more of the following: range information, battery level information, or fuel level information. Congested traffic scenarios are associated with navigation information. Risk scenarios are associated with risk warnings and / or alerts, which alert the driver to driver fatigue or loss of control. Intelligent driving scenarios are associated with intelligent driving modes.
[0070] The above-described implementation method, which splices together display styles, is an example of describing different scenario information through display styles. For instance, when both congestion and intelligent driving scenarios exist simultaneously, the linear pattern can be all elements of a congestion line or only some elements of an intelligent driving scenario, such as a congestion line + a blue halo. The same principle applies to other scenarios. In composite scenarios (such as intelligent driving activated on congested roads), the characteristic styles of both scenarios are integrated (congestion red + intelligent driving blue halo), simultaneously conveying multiple contextual information through a single visual element. This breaks through the capacity limitations of traditional single information channels and further improves information transmission efficiency.
[0071] In one optional implementation, the aforementioned application scenarios are assigned priorities. For example, risk scenarios have the highest priority, and the remaining application scenarios are arranged from highest to lowest priority as follows: low battery range scenarios, congestion scenarios, and intelligent driving scenarios. The method includes, but is not limited to, the following operations: when the scenario information is used to indicate multiple application scenarios, the display device displays all factors in the display style corresponding to the application scenario with the highest priority, based on the priority of the multiple application scenarios; or, the display device displays all factors in the display style corresponding to the application scenario with the highest priority and some factors in the display style corresponding to the application scenario with the lowest priority.
[0072] The above implementation methods represent the splicing, switching, and simultaneous display of display styles, all of which are examples of describing different scene information through display styles. This improves the feasibility and logic of displaying multi-dimensional information through linear patterns. Display styles are dynamically synthesized based on scene priorities (e.g., high-priority full elements + low-priority outlines), maximizing information density within a limited display space while ensuring the visual integrity of core elements.
[0073] In the above implementation of priority-related methods, the corresponding priority can be adjusted based on the user's operation.
[0074] In one optional implementation, the application scenario includes a risk scenario, and the above method includes, but is not limited to, the following operations: the display device displays a linear pattern in an eleventh display style based on the location of the risk, and the eleventh display style is related to the location of the risk. A local warning is triggered on the side corresponding to the linear pattern based on the risk's orientation (e.g., an obstacle on the left), (e.g., displaying the corresponding display style on the left side of the linear pattern), transforming the abstract risk warning into a spatial orientation indicator, allowing the driver to directly lock onto the direction of the threat and improving the accuracy of hazard avoidance operations.
[0075] In one optional embodiment, the linear pattern includes a plurality of eighth parts, each of which corresponds to a different twelfth display style, and each twelfth display style is used to describe different scene information. Displaying the linear pattern according to the scene information of the first terminal includes, but is not limited to, the following operations: the display device displays the eighth parts corresponding to different twelfth display styles according to the scene information.
[0076] The above implementation method is an example of describing different scene information through display styles. The display style of the linear pattern is mainly obtained by splicing together all the factors of the display styles corresponding to different scene information. By dividing the display into independent display segments to present different scene information (such as the first segment of battery life percentage and the last segment of navigation progress), multiple information can be carried in parallel by a single linear pattern, avoiding cognitive interruption caused by information switching.
[0077] In one alternative implementation, the above method includes, but is not limited to, the following operations: The display device receives a first operation input from the user. Based on the first operation, the display device adjusts the display parameters of the line pattern, including one or more of the following: display style, target display position, display area, display length, and display shape. This allows the driver to manually adjust the position or shape of the line pattern to meet individual differences in visual acuity, and is particularly suitable for the ergonomic adaptation of special driving groups (such as those with color blindness or height abnormalities).
[0078] In one alternative embodiment, the display device in the first terminal includes at least one of the following: a head-up display (HUD), a display screen, a vehicle headlight module, and a vehicle-mounted projector.
[0079] Secondly, embodiments of this application provide a display device for performing the method as described in any of the first aspects.
[0080] In one possible design, the display device includes at least an acquisition unit and a display unit. The acquisition unit is used to acquire scene information of the first terminal, which includes one or more of navigation information, terminal information of the first terminal, or perception information of the first terminal.
[0081] The display unit is used to display a first pattern at a target display position based on the scene information of the first terminal. The first pattern includes at least a line pattern, and the display style of the line pattern is related to the scene information. The target display position is used to display at least two of the following: navigation information, terminal information of the first terminal, or perception information of the first terminal.
[0082] The steps performed by the acquisition unit and display unit described in the second aspect and any possible implementation can be referred to the corresponding implementations in the first aspect.
[0083] For the technical effects of the second aspect and any possible implementation, please refer to the description of the technical effects corresponding to the first aspect and the corresponding implementation.
[0084] Optionally, in the display device described in the second aspect above and any possible embodiment: In one implementation, the display device is a display apparatus. When the display device is a display apparatus, the communication unit can be a transceiver or an input / output interface; the processing unit can be at least one processor. Optionally, the transceiver can be a transceiver circuit. Optionally, the input / output interface can be an input / output circuit.
[0085] In another implementation, the display device is a chip (system) or circuit used in a display device. When the display device is a chip (system) or circuit used in a display device, the acquisition unit can be a communication interface (input / output interface), interface circuit, output circuit, input circuit, pin, or related circuit on the chip (system) or circuit; the processing unit can be at least one processor, processing circuit, or logic circuit; and the display unit can be an optical display module, such as an image imaging unit or an image magnification unit.
[0086] Thirdly, embodiments of this application provide a display device including a processor. The processor is coupled to a memory and can be used to execute instructions in the memory to implement the methods described in the first aspect and any of the possible implementations. Optionally, the display device further includes a memory. Optionally, the display device further includes a communication interface, and the processor is coupled to the communication interface.
[0087] Fourthly, embodiments of this application provide a chip, including: logic circuitry and a communication interface. The communication interface is used to receive or send information; the logic circuitry is used to receive or send information through the communication interface, causing the chip to execute the methods described in the first aspect and any of the possible implementations.
[0088] Fifthly, embodiments of this application provide a computer-readable storage medium for storing a computer program (also referred to as code or instructions); when the computer program is run on a computer, the methods described in the first aspect and any possible implementation are implemented.
[0089] In a sixth aspect, embodiments of this application provide a computer program product, the computer program product comprising: a computer program (also referred to as code or instructions); and, when the computer program is run, causing a computer to perform the methods described in the first aspect and any of the possible implementations.
[0090] In a seventh aspect, embodiments of this application provide a terminal, which includes at least one display device as described in the second aspect, or the display device as described in the third aspect, or the chip as described in the fourth aspect.
[0091] Optionally, the terminal further includes a light-transmitting component, through which the light emitted from the display device or display system forms a virtual image in front of the terminal. For example, the light-transmitting component may be a windshield.
[0092] Optionally, the terminal can be a means of transportation, such as a car, truck, aircraft, drone, slow transport vehicle, spacecraft, or ship, or any other possible means of transportation used in any possible scenario. This application embodiment does not limit this.
[0093] Optionally, the terminal is used to implement the method described in the first aspect and any possible implementation.
[0094] Furthermore, in the process of performing the method described in the first aspect and any possible implementation above, the processes related to sending and / or receiving information in the above methods can be understood as the process of the processor outputting information, and / or the process of the processor receiving input information. When outputting information, the processor can output the information to a transceiver (or communication interface, or transmitting module) so that the transceiver can transmit it. After the information is output by the processor, it may need to undergo other processing before reaching the transceiver. Similarly, when the processor receives input information, the transceiver (or communication interface, or transmitting module) receives the information and inputs it to the processor. Furthermore, after the transceiver receives the information, the information may need to undergo other processing before being input to the processor.
[0095] Based on the above principles, for example, the information sent mentioned in the aforementioned method can be understood as information output by the processor. Similarly, the information received can be understood as information received by the processor from input.
[0096] Optionally, unless otherwise specified, or unless they contradict their actual function or internal logic in the relevant description, the operations of the processor, such as transmitting, sending, and receiving, can be more generally understood as processor output and receiving, input, and other operations.
[0097] Optionally, in performing the methods described in the first aspect and any possible implementation above, the processor may be a processor specifically designed to perform these methods, or it may be a processor that performs these methods by executing computer instructions stored in memory, such as a general-purpose processor. The memory may be a non-transitory memory, such as read-only memory (ROM), which may be integrated with the processor on the same chip or disposed on different chips. This application does not limit the type of memory or the arrangement of the memory and processor.
[0098] In one possible implementation, at least one of the aforementioned memories is located outside the device.
[0099] In yet another possible implementation, at least one of the aforementioned memories is located within the device.
[0100] In another possible implementation, a portion of the memory of the at least one memory is located inside the device, while another portion is located outside the device.
[0101] In this application, the processor and memory may also be integrated into a single device, that is, the processor and memory can be integrated together. Attached Figure Description
[0102] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0103] Figure 1 A schematic diagram of a field of view provided for an embodiment of this application; Figure 2 A schematic diagram illustrating a virtual image distance provided in an embodiment of this application; Figure 3 A schematic diagram illustrating an application scenario of a display device in the automotive field, provided as an embodiment of this application; Figure 4 This is a schematic diagram illustrating another perspective on the application scenario of a display device in the automotive field, as provided in an embodiment of this application. Figure 5 An imaging schematic diagram illustrating how a display device, as provided in this application, projects an image onto a driver's eye in the automotive field; Figure 6 An exemplary schematic diagram of a display screen of a display device is shown; Figure 7 An exemplary schematic diagram of the display screen of yet another display device is shown; Figure 8 Schematic diagrams of two line patterns provided in embodiments of this application; Figure 9 An exemplary schematic diagram of the display screen of yet another display device is shown; Figure 10 A schematic diagram of a linear pattern provided in an embodiment of this application; Figure 11 A schematic diagram of yet another linear pattern provided in an embodiment of this application; Figure 12 An exemplary schematic diagram of the display screen of yet another display device is shown; Figure 13 An exemplary schematic diagram of the display screen of yet another display device is shown; Figure 14 An exemplary schematic diagram of the display screen of yet another display device is shown; Figure 15 An exemplary schematic diagram of the display screen of yet another display device is shown; Figure 16 An exemplary schematic diagram of the display screen of yet another display device is shown; Figure 17 An exemplary schematic diagram of the display screen of yet another display device is shown; Figure 18 An exemplary schematic diagram of the display screen of yet another display device is shown; Figure 19 A schematic flowchart illustrating a display method provided in an embodiment of this application; Figure 20 A schematic diagram of a display architecture provided in an embodiment of this application; Figure 21 A schematic diagram of yet another linear pattern provided in an embodiment of this application; Figure 22 A schematic diagram illustrating an application scenario of a linear pattern provided in an embodiment of this application; Figure 23 A schematic diagram illustrating an application scenario of a linear pattern provided in an embodiment of this application; Figure 24 This is a schematic diagram of the structure of a display device provided in an embodiment of this application; Figure 25 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application; Figure 26 This is a schematic diagram of the structure of a chip provided in an embodiment of this application. Detailed Implementation
[0104] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described below with reference to the accompanying drawings.
[0105] The terms "first" and "second," etc., used in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.
[0106] The term "embodiment" as used herein means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that, unless otherwise specified or logically conflicting, the terminology and / or descriptions between the various embodiments of this application are consistent and can be mutually referenced, and technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.
[0107] It should be understood that in this application, "at least one (item)" means one or more, "more than one" means two or more, "at least two (items)" means two or three or more, and "and / or" is used to describe the relationship between related objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.
[0108] It should be noted that, in this application, "instruction" can include direct instruction, indirect instruction, explicit instruction, and implicit instruction. When describing a certain instruction information for the purpose of instructing A, it can be understood that the instruction information carries A, directly instructs A, or indirectly instructs A.
[0109] In this application, the information indicated by the instruction information is called the information to be instructed. In specific implementations, there are many ways to indicate the information to be instructed, such as, but not limited to, directly indicating the information to be instructed, such as the information to be instructed itself or its index. It can also indirectly indicate the information to be instructed by indicating other information, where there is a correlation between the other information and the information to be instructed. It can also indicate only a part of the information to be instructed, while the other parts are known or pre-agreed upon. For example, the instruction of specific information can be achieved by using a pre-agreed (e.g., protocol-defined) arrangement of various information, thereby reducing instruction overhead to some extent. The information to be instructed can be sent as a whole or divided into multiple sub-information units, and the sending period and / or timing of these sub-information units can be the same or different. This application does not limit the specific sending method. The sending period and / or timing of these sub-information units can be predefined, for example, according to a protocol, or configured by the transmitting device by sending configuration information to the receiving device.
[0110] It should be noted that in this application, "send" can be understood as "output" and "receive" can be understood as "input". "Send information to A", where "to A" simply indicates the direction of information transmission, and A is the destination, does not limit "send information to A" to a direct transmission over the air interface. "Send information to A" includes sending information directly to A, as well as sending information indirectly to A through a transmitter. Therefore, "send information to A" can also be understood as "outputting information destined for A". Similarly, "receive information from A" indicates that the source of the information is A, including receiving information directly from A, as well as receiving information indirectly from A through a receiver. Therefore, "receive information from A" can also be understood as "inputting information from A".
[0111] To more clearly describe the solution of this application, some terms used in the embodiments of this application will be explained below.
[0112] Head-up display (HUD): Also known as a head-up display system, it refers to a multi-functional instrument panel centered on the driver and operated blindly. The HUD projects vehicle instrument information (such as speed, RPM, temperature, fuel level, etc.) and navigation information into the driver's field of vision. The driver can see the vehicle's instrument and navigation information directly in front of them without needing to look down at the instrument panel or central control display below the steering wheel. This improves braking reaction time in emergency situations and enhances driving safety and convenience.
[0113] Augmented reality head-up display (AR-HUD) is a combination of holographic augmented reality (AR) technology and head-up display (HUD) functionality. Through computational processing, it overlays acquired image information onto the real three-dimensional environment in front of the driving route. It can integrate information such as distance, speed, and navigation into the real-world view obtained by the driver. The combination of computational data and display scene makes digital information richer and more intuitive, improving the driving experience and driving safety.
[0114] Field of view (FOV): Also known as the field of view, it refers to the maximum solid angle between the edge of the displayed image and the image acquisition center. For example, in optical measurement equipment, the image acquisition center is the center of the lens of the optical measurement equipment. The target image measured by the optical measurement equipment can pass through the lens, and the angle formed by the two edges that present the largest range through the lens is the field of view. Similarly, in display devices, the field of view is the angle between the two edges of the image displayed on the imaging mechanism and the center point of the display device's lens, usually the two edge points with the largest distance. In the field of head-up displays, the image acquisition center is the human pupil. In the display field, FOV generally includes the vertical field of view, the horizontal field of view, and the diagonal field of view. Optionally, see [link to relevant documentation]. Figure 1 , Figure 1 A schematic diagram of a field of view provided for an embodiment of this application, as shown below. Figure 1 As shown, Figure 1 Point O in the diagram is the image acquisition center, the quadrilateral enclosed by ABCD is the display image, the angle between lines OA and OB can be the horizontal field of view, the angle between lines OB and OC can be the vertical field of view, and the angle between lines OA and OC can be the diagonal field of view. It should be noted that, unless otherwise specified, the default field of view is generally the horizontal and vertical field of view.
[0115] Virtual image distance (VID): Also known as virtual image distance, it refers to the distance from the displayed virtual image to the image acquisition center. In the field of head-up displays, the image acquisition center is the pupil of the human body. Optionally, please refer to [link to relevant documentation]. Figure 2 , Figure 2 This is a schematic diagram of a virtual image distance provided in an embodiment of this application, as shown below. Figure 2 As shown, in a head-up display system, the virtual image distance is the straight-line distance between the human pupil and the virtual image.
[0116] Please see Figures 3 to 5 , Figure 3 This illustration shows an application scenario of a display device 100 provided in this application in the automotive field. Figure 4This illustration shows another perspective on the application scenario of a display device 100 provided in this application embodiment in the automotive field. Figure 5 This illustration shows an imaging schematic diagram of a display device 100 according to an embodiment of this application, which projects an image onto the driver's eye in the automotive field. Figure 3 and Figure 4 The display device 100 projects an image into the driver's eyes, enabling the driver to see virtual image information. This virtual image information includes a first pattern.
[0117] Depend on Figures 3 to 5 As can be seen, when the driver looks out through the windshield 200 degrees, they can see a virtual image with a certain depth of field (i.e., the distance of the clear image within the range before and after the focal point of the image). This is achieved by using sensing devices such as cameras and infrared sensors to acquire information about the road ahead, including distance to the vehicle in front, the speed of the vehicle in front, and other road information. This digital information is then projected onto an image closely integrated with the surrounding environment. The digital information can be divided into navigation information and attribute information. Attribute information may include: vehicle speed, gear position, cruise control, distance to the vehicle in front, speed of the vehicle in front, engine speed, battery level, remaining driving range, and infotainment system information. This allows the driver to access necessary information without shifting their gaze while driving, avoiding the driving risks that might arise from looking down at the instrument panel or center console screen while driving and neglecting road conditions.
[0118] To achieve the aforementioned display, the vehicle needs to be equipped with a head-up display (HUD) system. The HUD system may include a display device 100 and optical elements. The display device 100 can project images, and the optical elements may include the vehicle's windshield 200, a reflective film attached to the windshield 200, or a separate screen located within the vehicle's cabin. The optical elements can reflect and / or refract the image projected by the display device 100 and project it into the driver's eyes, allowing the driver to obtain a virtual information image in front of the windshield 200. Optionally, the display device 100 has one or more interfaces through which current and / or image signals are obtained from the vehicle's central control system or in-vehicle infotainment system. The current signals are used to power the electrical components in the display device 100, and the image signals are used to provide the displayed image.
[0119] In the automotive industry, over 100 head-up display (HUD) devices are located on the center console. (See also...) Figure 3 , Figure 4 , Figure 5 As shown, the display device 100 can be installed in the center console and located in front of the steering wheel (in the direction of the car's travel).
[0120] In some embodiments, based on imaging technologies such as holographic optical element (HOE), HUD can also display images directly on the windshield or other devices, allowing the driver to obtain a real image superimposed on a real scene image. Through enhanced display or naked-eye 3D technology, the driver can obtain a visual experience with stereoscopic depth and a sense of depth.
[0121] It should be noted that the vehicles used in the embodiments of this application are all illustrative examples of automobiles and should not be considered as limitations on the embodiments of this application. Vehicles can be traditional gasoline-powered vehicles, or new energy vehicles such as pure electric vehicles and hybrid vehicles. Vehicles can be any of different types of automobiles, such as sedans, trucks, passenger buses, and sport utility vehicles (SUVs), or land transportation devices for carrying passengers or goods, such as tricycles, motorcycles, and trains. Alternatively, the display device of this application can also be applied to other types of transportation vehicles such as airplanes and ships.
[0122] In the field of head-up displays, the field of view can be 15×5 degrees. Here, 15 degrees refers to a horizontal field of view of 15 degrees. (See [reference needed]). Figure 1 As shown, the angle between lines OA and OB can be considered; 5 degrees refers to the vertical field of view, which can be the angle between lines OB and OC. Typically, the size of a person's retina is limited, and the field of view (FOV) for both eyes is generally between 90 and 120 degrees (which can be either the horizontal or vertical field of view). Through binocular parallax, the human eye can perceive the 3D state of objects. Increasing the FOV of a display device improves the fit between virtual and real images, increases the coverage area of the virtual image, and correspondingly improves the driver's visual experience.
[0123] In the field of head-up displays (HUDs), the viewing distance (VID) can be 7.5 meters. (See also...) Figure 2 As shown, VID (Visual ID) represents the distance between the image of the front of the vehicle and the driver's eyes. Increasing the VID of the display device improves the depth of the virtual image relative to the driver's field of vision, resulting in a higher degree of fit between the virtual image and the distant real-world image, and a more realistic 3D effect. Furthermore, the increased VID reduces the need for frequent zooming when viewing displayed and virtual image information, improving driver comfort and consequently increasing driving safety.
[0124] In HUD technology, FOV and VID are important parameters affecting the imaging effect of HUD display technology. The larger the FOV and VID, the larger the display area of the HUD, the higher the degree of integration between digital information and the display scene, and the better the driver's experience.
[0125] Currently, HUDs have limited display area, while the amount and types of information displayed within the display area are numerous, such as terminal status information, terminal perception information of the real scene environment, instrument information, etc. Each piece of information is displayed independently, and each piece of information occupies a certain display space, resulting in high information density in the display area and low cognitive efficiency for users.
[0126] Therefore, how to deliver information to users in a more effective manner is a technical problem that needs to be solved in this field.
[0127] In view of this, embodiments of this application provide a display method and related products, relating to the field of display imaging technology, which can centrally and effectively present navigation information, terminal information and real-world environment information to users, thereby improving information transmission efficiency, driving comfort and driving safety.
[0128] The following describes the application scenarios involved in the embodiments of this application and the display screen of the display device in such scenarios. The following mainly uses a vehicle as the first terminal and a HUD as the display device as an example for illustrative purposes.
[0129] Please see Figure 6 , Figure 6 An exemplary schematic diagram of a display screen of a display device is shown.
[0130] like Figure 6 As shown in (a), (b), and (c), the display device displays the screen according to the display area. The screen includes navigation information (arrows shown in the figure), attribute information of the first terminal, and a first pattern. The attribute information includes vehicle speed information (34 km / h shown in the figure), and the first pattern is displayed at the target display position. The target display position is the area enclosed by the dashed box of the first pattern shown in the figure.
[0131] exist Figure 6 In (a) of the above, the first pattern includes only line patterns, which exist in a straight line (or strip) display form. The target display position of the first pattern is located at the bottom of the display device's field of view. Furthermore, the target display position of the first pattern is located below the navigation information and attribute information of the first terminal displayed on the display device.
[0132] exist Figure 6In (b), the first pattern is a broken line shape, composed of multiple line patterns spliced together, each line pattern existing in a straight line (or strip) display form. The target display position of the first pattern is located in the center of the display device's field of view. Furthermore, the target display position of the first pattern is located below the navigation information displayed on the display device and above the attribute information of the first terminal displayed on the display device.
[0133] exist Figure 6 In (c), the first pattern is a broken line shape, composed of multiple line patterns pieced together, each line pattern existing in a straight line (or strip) display form. The target display position of the first pattern is located at the bottom of the display device's field of view. Furthermore, the target display position of the first pattern is located below the navigation information and attribute information of the first terminal displayed on the display device.
[0134] In addition to the display form of line patterns Figure 6 The straight lines (or stripes) shown in the diagram can also be other shapes, which are not all shown here. The target display position of the first pattern, besides... Figure 6 In addition to the bottom and center of the canvas as shown in the diagram, other positions can also be included, such as the top, one side, both sides, or the edge of the canvas, which will be discussed later.
[0135] Optionally, the first pattern may include other patterns besides the aforementioned linear pattern, such as circular patterns, triangular patterns, etc., and this application embodiment does not limit this.
[0136] The following provides an illustrative explanation of the scene information that line patterns can present, the corresponding display styles of scene information, and application scenarios.
[0137] Optionally, the scene information includes at least three dimensions. The first dimension includes navigation information from external sources (such as cloud servers, roadside devices, or other terminals). The second dimension includes information from the terminal itself, such as the terminal information mentioned above (which may include parameter information, mode information, and entertainment domain information). The third dimension includes information from sensing devices, such as the sensing information mentioned above.
[0138] The following provides illustrative examples of the display styles corresponding to the scene information in the three dimensions mentioned above.
[0139] First, we will introduce the display style and application scenarios corresponding to the first dimension of navigation information. (See also...) Figure 7 , Figure 7 An exemplary schematic diagram of the display screen of yet another display device is shown.
[0140] like Figure 7As shown, the display device displays an image according to the display area. The image includes attribute information and a first pattern. The attribute information includes vehicle speed information. Figure 7 In the first pattern, only line pattern A is included. Line pattern A exists in a straight line / strip display form, and its display form, display position, and display area are fixed. The target display position of the first pattern is located below the navigation information and attribute information.
[0141] Figure 7 The corresponding display device's screen can be applied to scenarios where navigation is enabled on the first terminal. Considering that navigation information only displays relevant information for the current road segment and lacks global display capabilities, therefore, through... Figure 7 The line chart A in the diagram displays trip information to give users a comprehensive overview of their journey. Trip information indicates the distance traveled from the origin to the destination. Optionally, trip information includes the distance already traveled and / or the distance yet to be traveled.
[0142] exist Figure 7 In the diagram, the linear pattern comprises a first part and a second part. The first part is displayed in a first display style, and the second part is displayed in a second display style. The first display style indicates the first distance traveled by the first terminal, and the second display style indicates the second distance traveled by the first terminal. For example, the first display style is associated with gray, and the second display style is associated with green.
[0143] In scenarios where a linear pattern display style is used to display travel information, the first terminal may be in motion, and consequently, the first travel and the second travel will change. Therefore, the first display style and / or the second display style can be adjusted based on the changes in the travel of the first terminal. For example, adjusting the display style includes adjusting the size of the display style on the linear pattern.
[0144] In the above embodiments, the linear pattern display style can show more information. To ensure consistency in the types of information displayed, when the linear pattern display style is used to display travel information, it can simultaneously display related information such as road congestion conditions, waypoint information, and road type information. Please refer to [link to relevant documentation]. Figure 8 , Figure 8 This is a schematic diagram of two line patterns provided in the embodiments of this application. Figure 8The linear pattern B in the diagram includes a first part and a second part. The second part includes a third part, which indicates congested sections of the second route. The third part is displayed in a third display style, distinct from the second display style, to indicate the congestion level of the congested section. In some cases, the second display style includes the third display style; for example, the third display style is associated with red, and the third part is displayed in red to indicate that the corresponding section is congested. In other cases, the second display style includes multiple third display styles, each associated with a different color, such as red for very congested areas and yellow for moderately congested areas.
[0145] Road property information is used to indicate the nature of a road, such as an internal road, expressway, or national highway. In an optional embodiment, the first and / or second part further includes a fourth part (not shown in the figure), which is displayed in a fourth display style to indicate the road property. For example, different road properties correspond to roads in the traveled journey and / or the journey to be traveled. For instance, the display style corresponding to an internal road is associated with blue. Road property information is conveyed by displaying the various parts of the linear pattern in different colors.
[0146] like Figure 8 As shown in the line pattern C, the second part also includes a fifth part, which is used to indicate the waypoint of the first terminal. The display style of the fifth part is the fifth display style, which is used to indicate the type of waypoint. Figure 8 In the middle, the fifth display style is associated with a triangle. The types of waypoints include, but are not limited to: user-inputted points of interest, refueling points (such as gas stations, charging stations, and battery swapping stations), service areas, and toll booths.
[0147] Secondly, the display styles and application scenarios corresponding to the second dimension of terminal information are introduced. Please refer to [link / reference]. Figure 9 , Figure 9 This is an example illustration of a display screen from another display device. Terminal information includes, but is not limited to: parameter information, mode information, Figure 9 This mainly corresponds to the battery life information in the parameter information.
[0148] like Figure 9 As shown, the display device displays an image according to the display area. The image includes attribute information and a first pattern. The attribute information includes vehicle speed information. Figure 9 In the first pattern, only the line pattern D is included. The line pattern D exists in a straight line / strip display form, and the display form, display position, and display area of the line pattern D are fixed. For example, Figure 9The corresponding display screen is applied to the scenario where navigation is not enabled after the first terminal form is used. Before navigation is enabled, the linear pattern D is used to display the remaining battery information, hereinafter referred to as the remaining battery line. The linear pattern includes a sixth part and a seventh part. The display style of the sixth part is the sixth display style, and the display style of the seventh part is the seventh display style. The sixth display style indicates the current value of the remaining battery information, and the seventh display style indicates the target value of the remaining battery information. The target value includes the maximum value and / or a safe value. For example, the safe value is a preset value. Taking the battery level information in the remaining battery information as an example, the sixth display style indicates the current battery level, and the seventh display style indicates the safe battery level. The safe battery level is 90%-95%.
[0149] It should be noted that, in Figure 9 In the diagram, the seventh part is only a portion of the line pattern D. The display style of the seventh part can be used to indicate the maximum battery life information. In fact, the entire line pattern represents the maximum battery life. However, from the perspective of the display screen, the display style corresponding to the maximum battery life is covered by the display style of the current battery life. This design conveys to the user that the entire line pattern represents the maximum battery life. However, from the perspective of the display device, the display style of the seventh part can be different from the display style of the sixth part to convey that the entire line pattern represents the maximum battery life. This will not be elaborated on further.
[0150] In the case where the first terminal is a vehicle that can be recharged by both battery and fuel, the parameter information of the first terminal includes battery level information and / or fuel level information. The sixth display style is used to indicate the current battery level and / or current fuel level of the first terminal, and the seventh display style is used to indicate the target range of the first terminal. In the case where the sixth display style is used to indicate the current battery level and current fuel level of the first terminal, the sixth display style corresponding to the current battery level is different from the sixth display style corresponding to the current fuel level. Therefore, the sixth display style in the sixth part can include two display styles.
[0151] Please see Figure 10 , Figure 10 This is a schematic diagram of a linear pattern provided in an embodiment of this application. Figure 10 The line pattern E shown in the diagram includes a sixth and a seventh section. The sixth section, corresponding to the sixth display style, is used to display the current battery level and fuel level. Figure 10 As can be seen, the sixth display style corresponding to the current battery level overlaps with the sixth display style corresponding to the current fuel level, conveying the remaining battery information to the user in a manner similar to two overlapping progress bars.
[0152] In some possible implementations, the parameter information of the first terminal includes battery level and / or fuel level information; the sixth display style is used to indicate the current battery level and / or target battery level of the first terminal; and the seventh display style is used to indicate the current fuel level and / or target fuel level of the first terminal. Please refer to [link to relevant documentation]. Figure 11 , Figure 11 The sixth display style of the sixth part of the line pattern F is used to indicate the current battery level and target battery level of the first terminal, and the seventh display style of the seventh part is used to indicate the current fuel level and target fuel level of the first terminal. The sixth display style for indicating the current battery level and the sixth display style for indicating the target battery level are displayed differently. The seventh display style is similar and will not be described further here.
[0153] Considering that the aforementioned parameter information, similar to navigation information, is a variable value and can change in real time, the display device can adjust the display style of the line pattern when the parameter information changes. For example, when the current battery life decreases, the display scale of the sixth display style can be reduced.
[0154] Please see Figure 12 , Figure 12 An exemplary schematic diagram of the display screen of yet another display device is shown. Figure 12 This mainly corresponds to the mode information in the parameter information.
[0155] Taking intelligent driving mode as an example, when intelligent driving mode is activated, the display style of the line pattern is adjusted to the ninth display style. Unlike the segmented display style corresponding to parameter information, the mode information of the first terminal is generally displayed in the style of a single line.
[0156] Optionally, the ninth display style of the line pattern is associated with at least one of the factors of halo effect and blue. Figure 12 The ninth display style of the linear pattern G shown in the diagram is associated with a halo effect. Optionally, the halo effect flashes for a period of time after the intelligent driving mode is activated to remind the driver that the intelligent driving mode has been activated.
[0157] Optionally, the ninth display style is matched with the display styles corresponding to the intelligent driving mode displayed on other display devices. Matching means that at least one factor is the same.
[0158] In one alternative implementation, the mode information includes an interactive mode, and the ninth display style corresponding to the interactive mode is associated with at least one of the halo effect and wave effect. See also... Figure 13 , Figure 13 An exemplary schematic diagram of the display screen of yet another display device is shown. Figure 13 This mainly corresponds to the interaction mode in the mode information. Figure 13The ninth display style corresponding to the line pattern H in the diagram is associated with halo and wave effects. For example, the interaction modes include modes initiated by voice interaction, button interaction, click operation interaction, etc. When the interaction mode includes voice interaction, the wave effect fluctuates with the volume of the sound output or voice input in the interaction mode, and / or, the display area of the ninth display style is related to the occupant's seat at the time of voice input.
[0159] For example, if the first terminal includes front seats and rear seats, and the passenger seat for voice input is located in the rear seat, then the display area of the ninth display style is below the linear pattern (such as linear pattern H). Similarly, if the passenger seat for voice input is located in the rear seat, then the display area of the ninth display style is above the linear pattern (such as linear pattern H). As another example, if the front seats and rear seats each include two seats, and the passenger seat for voice input is located in the rear seat, then the display area of the ninth display style is in the upper right corner of the linear pattern (such as linear pattern H).
[0160] In one optional implementation, the display style corresponding to the perceived information is the tenth display style. The perceived information of the first terminal is the information related to environmental elements perceived by the sensing device, including but not limited to: road participants (e.g., road vehicles, pedestrians), obstacles, traffic infrastructure (e.g., traffic lights, traffic signs), weather, temperature, humidity, brightness, or air quality.
[0161] For example, environmental elements include road users and / or obstacles, and perception information includes alarm information used to alert road users and / or obstacles. See also Figure 14 , Figure 14 An exemplary schematic diagram of the display screen of yet another display device is shown. Figure 14 This mainly corresponds to alarm information in the perception information. Figure 14 The tenth display style of the linear pattern G in the image is associated with red, halo effects, and flashing effects. By working in conjunction with warning symbols in the display area, it improves the driver's perception of risky scenarios.
[0162] In some situations, in addition to warnings to road users and / or obstacles, there are other risk warnings indicating potential hazards. These include warnings for situations such as being too close to a target object (e.g., an obstacle or vehicle ahead), detecting a loss of control over the steering wheel, a potential rear-end collision, or encountering a large vehicle or other collision. Each risk warning has a corresponding display style. In some cases, the risk warning is displayed in the tenth display style. In other cases, the display style differs from the tenth display style; for example, the display style for detecting a loss of control over the steering wheel is associated with a yellow color and a flashing effect.
[0163] The display styles in the examples above mainly correspond to single-dimensional scene information. The following examples illustrate display styles corresponding to scene information of different dimensions. For instance, in complex scenes, by displaying a single line pattern with display styles corresponding to scene information of different dimensions, multiple dimensions of scene information can be displayed simultaneously.
[0164] Please see Figure 15 , Figure 15 An exemplary schematic diagram of the display screen of yet another display device is shown. Figure 15 This mainly corresponds to trip information and alarm information. The display styles of the linear pattern H include a first display style, a second display style, a third display style, and a tenth display style (at least related to the halo effect). Among them, the linear pattern H displays trip information and road congestion status through the first, second, and third display styles, and displays alarm information through the tenth display style.
[0165] Furthermore, as can be seen from the linear pattern H, the first display style and the third display style are in contact or partially overlap, which indicates that the current location of the first terminal is in a congested road section. In this scenario, the information corresponding to the congested road section is just as important as the alarm information. Therefore, by associating all factors of the trip information and road congestion with some factors of the alarm information (such as the halo effect), the trip information and alarm information can be displayed simultaneously.
[0166] Reference Figure 15 By displaying line patterns that associate some or all factors of scene information in one dimension with a display style that associates some or all factors of scene information in another dimension, scene information in two dimensions can be displayed simultaneously.
[0167] For example, when low battery life scenarios and risk scenarios occur simultaneously, battery life information and alarm information can be displayed simultaneously by using all factors associated with the display style corresponding to battery life information and some factors in the display style corresponding to alarm information.
[0168] For example, when both low range scenarios and intelligent driving scenarios occur simultaneously, range information and mode information can be displayed simultaneously by using all factors associated with the display style corresponding to the range information and some factors (such as a blue halo effect) in the display style corresponding to the intelligent driving mode.
[0169] In addition to splicing together display styles using a single line pattern to convey scene information in different dimensions, at least two line patterns can also be used to display scene information in different dimensions.
[0170] See Figure 16 , Figure 16 An exemplary schematic diagram of the display screen of yet another display device is shown. Figure 16 This mainly corresponds to trip information and alarm information. Figure 16 In the diagram, the display style of line pattern 1 (such as the first display style and the second display style) is used to display navigation information, and the display style of line pattern 2 (such as the tenth display style) is used to display alarm information.
[0171] Optionally, before a risk scenario occurs, the display device displays navigation information only in the display style of line pattern 1 (such as the first display style and the second display style). After a risk scenario occurs, the display device adds the display of line pattern 2 to achieve simultaneous display of scene information in two dimensions.
[0172] Figure 16 In the example, both line patterns 1 and 2 are displayed at the bottom of the image. In some cases, they are combined... Figure 17 The line pattern 1 and line pattern 2 can also be displayed on opposite sides of the image.
[0173] It should be understood that the above Figure 16 and Figure 17 The number of linear patterns in the example is only for illustration purposes; in some cases, such as... Figure 18 ,exist Figure 18 In the display, the display device shows scene information in three dimensions through line patterns 3, 4, and 5. Line pattern 3 is used to display terminal information (such as...). Figure 18 The diagram in the center indicates battery life information; line icon 4 is used to display navigation information (such as...). Figure 18 The diagram in the middle shows travel information; the line pattern 5 is used to display sensory information (such as...). Figure 18 The diagram shows the distance information to the obstacle.
[0174] It should be noted that the distribution of display styles corresponding to the three dimensions of scene information is an example. In some cases, the display positions of line pattern 3, line pattern 4 and line pattern 5 can be adjusted based on user operation or user habits.
[0175] Please see Figure 19 , Figure 19 This is a flowchart illustrating a display method provided in an embodiment of this application. This display method is applied in the field of display imaging technology, including but not limited to HUD displays. The display method is applied to a display device, for example, executed by a control device, computing device, or computing system within the display device, or executed by a module within the control device, computing device, or computing system. This module may include software modules and / or hardware modules. The following description uses a display device as the executing entity.
[0176] For ease of description, the steps are described in the order of S1901 to S1902. However, this application embodiment does not limit the order of execution, execution time, or number of executions of one or more of the above steps. Steps S1901 to S1902 are as follows: S1901: The display device acquires scene information from the first terminal.
[0177] The scene information of the first terminal includes one or more of the following: navigation information, terminal information of the first terminal, or perception information of the first terminal.
[0178] The scenario information of the first terminal is used to indicate the information that may be obtained or configured in the various scenarios to which the first terminal is applicable.
[0179] For example, the first terminal is a mobile terminal such as a vehicle, mobile phone, or tablet computer, and its applicable scenarios include map navigation, augmented reality navigation, etc., with corresponding scenario information including navigation information. In this embodiment, the navigation information is information used to instruct and guide the movement of the first terminal, and can also be referred to as route information, location information, spatial geographic location information, GPS information, etc.
[0180] Navigation information may come from map providers, other terminals (such as second terminals), or cloud servers, and this application embodiment does not limit this.
[0181] In some cases, the navigation information is from a first terminal. In other cases, the navigation information is from a second terminal that is traveling the same route as the first terminal. For example, in a scenario where a convoy (including both the first and second terminals) is moving, the first terminal can use the navigation information sent by the second terminal for navigation.
[0182] Terminal information is used to indicate information that may be acquired, stored, and displayed within the first terminal. For example, terminal information includes, but is not limited to, parameter information or mode information of the first terminal.
[0183] Optionally, taking a vehicle as the first terminal as an example, the parameter information includes, but is not limited to: motion status information (e.g., whether the vehicle is in a parked state or in a driving state), range information, battery level information, fuel level information, vehicle speed information, accelerator pedal travel information, power output information, vehicle lighting information (e.g., whether low beam headlights, high beam headlights, turn signals, side marker lights, fog lights, etc. are turned on), volume information, mileage information, maintenance time information, etc.
[0184] Optionally, taking a vehicle as the first terminal as an example, the mode information of the first terminal includes, but is not limited to: intelligent driving mode, interactive mode (such as the mode of voice dialogue with the vehicle system), snow mode, off-road mode, rest mode, camping mode, etc.
[0185] Optionally, the terminal information includes entertainment domain information, which includes, but is not limited to: voice information, text information, music information, video information, etc.
[0186] For example, the first terminal is a vehicle, mobile phone, tablet computer, or other terminal equipped with sensing devices. The applicable scenarios include sensing scenarios, and the corresponding scenario information includes the sensing information of the first terminal. The sensing information is the information obtained by the first terminal from sensing the internal and external environment. For instance, a vehicle uses sensing devices to sense the in-vehicle environment and / or the external environment, or a mobile phone uses its configured sensing devices to sense the internal and external environment.
[0187] In one possible implementation, the sensing information of the first terminal is information related to environmental elements perceived by the sensing device. Environmental elements include, but are not limited to: road participants (e.g., road vehicles, pedestrians), obstacles, traffic infrastructure (e.g., traffic lights, traffic signs), weather, temperature, humidity, brightness, or air quality.
[0188] Optionally, the display device can be... Figure 20 The display architecture shown obtains scene information from the first terminal. Figure 20 This is a schematic diagram of a display architecture provided in an embodiment of this application.
[0189] like Figure 20 As shown, the display architecture includes, but is not limited to, a display device and a display control device. The display control device acquires navigation information from, but is not limited to, a navigation module, perception information from sensing devices such as cameras, lidar, and millimeter-wave radar, and terminal information from the cockpit domain controller, in order to enable the display device to display information.
[0190] Accordingly, the display device acquires scene information (including but not limited to the aforementioned types of information) from the first terminal through the display control device. Optionally, the terminal information of the first terminal may come from the aforementioned navigation module and cockpit domain controller, and the perception information of the first terminal may come from the aforementioned camera, lidar, millimeter-wave radar, and other perception modules. The display device includes, but is not limited to, a control device, an image generation module, and optical elements. The control device controls the image generation module to generate image information (including a first pattern) based on the scene information of the first terminal, and controls the generated image information to pass through the optical elements to form a real or virtual image.
[0191] It is understood that the display device in the embodiments of this application may be a device equipped with a processor / chip that can execute computer execution instructions, or it may be a processor / chip that can execute computer execution instructions. Optionally, the display device may be an electronic device, or it may be a processor / chip within an electronic device, or it may be one of the above-mentioned... Figures 3 to 5The display device in the present application is used to execute the display method in the embodiments of the present application, so as to present vehicle information and real-scene information to the user more effectively and improve information display efficiency.
[0192] Optionally, the display device may specifically include, but is not limited to, any one or more of the following: a head-up display (HUD), a vehicle headlight module, and a vehicle-mounted projector. It is understood that the above-mentioned display device can display images through various means, including but not limited to projection, light projection, and a display screen. The displayed image can be a real image or a virtual image, and this application embodiment does not impose any limitations on this.
[0193] Optionally, the display device and display method in the embodiments of this application can be applied to, but are not limited to, vehicle systems. The vehicle equipped with the vehicle system is an intelligent driving vehicle and can be replaced by a terminal device. The terminal device can be, but is not limited to, vehicles such as commercial vehicles, passenger cars, trains, etc., industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), robots, etc. The embodiments of this application do not specifically limit this.
[0194] S1902: The display device displays the first pattern at the target display position based on the scene information of the first terminal.
[0195] The first pattern includes at least a line pattern, the display style of which is related to the scene information, and the target display position is used to display at least two of the following: navigation information, terminal information of the first terminal, or perception information of the first terminal.
[0196] The target display position can be understood as the target display area, which is dedicated to displaying the first pattern.
[0197] Optionally, the first pattern may include other patterns besides line patterns, and this application does not limit this.
[0198] To enhance the stability of visual anchor points, in addition to fixing the display position, other attributes of the first pattern can also be fixed, such as display area, display shape, and other attributes besides the display style. In one optional embodiment, any one or more of the display position, display area, display length, and display shape of the line pattern in the first pattern are fixed. Displaying fixed and stable line patterns with attributes other than display style improves the display effect of the line patterns, reduces the user's learning cost, and ensures the driving safety of the terminal.
[0199] The aforementioned fixed display means that the values of the line pattern's attributes are fixed, or the variations in their differences are fixed. For example, a fixed display area for the line pattern means that displaying the line pattern within a fixed display area is considered a fixed display area. Similarly, a fixed display length for the line pattern means that the length of the line pattern is fixed, or that variations in length within a certain threshold range are also considered a fixed display length.
[0200] For example, the display position of the line pattern may be slightly adjusted in different scenarios. For instance, in some scenarios, the display position of the line pattern may be adjusted to attract the user's attention, but if the difference between before and after the adjustment is less than a distance threshold, it is still considered that the display position of the line pattern is fixed. The same applies to display area, display length, and display form.
[0201] In one alternative embodiment, the display form of the linear pattern includes, but is not limited to, straight lines, broken lines, curves, stripes, blocks, triangles, or circles. See also Figure 21 , Figure 21 This is a schematic diagram of yet another linear pattern provided in an embodiment of this application. Figure 21 The linear pattern 6 in the image is composed of multiple block patterns. It still appears as strips or lines in the user's field of vision, so it can also be called a linear pattern.
[0202] Optionally, the display form of the linear pattern is obtained by splicing the above forms together.
[0203] In one alternative implementation, the target display position includes any one or more positions within the field of view of the display device mounted on the first terminal: bottom of the frame, top of the frame, one side of the frame, both sides of the frame, edge of the frame, and center of the frame.
[0204] The first pattern is displayed at the bottom of the image to avoid obscuring other information displayed on the device (such as the AR light carpet), while utilizing the peripheral vision area at the lower edge of the driver's field of vision to achieve uninterrupted parallel operation of information assistance prompts and primary field of vision observation. See details. Figure 6 (a) Figure 6 (c) Figures 7 to 16 , Figure 18 The position of the line pattern shown in the diagram.
[0205] Displaying the first pattern at the top of the image allows it to blend with the environment. In some implementations, the first pattern can be mapped to certain environmental elements (such as other vehicles) for accurate display.
[0206] The first pattern is displayed on one side of the image (e.g., the left or right side of the image). In some implementations, the first pattern, especially the line pattern, can also be mapped to some environmental elements (such as lane lines). This achieves environmental integration while serving as a lane line indicator and also enhances the richness of information transmission through display style.
[0207] See Figure 17 The first pattern is displayed on both sides of the image (e.g., the left and right sides of the image, the top and bottom sides of the image), and multi-dimensional information is transmitted in real time, which meets the user's information needs and lays the foundation for multi-dimensional scene information display in complex scenes.
[0208] Displaying the first pattern at the edge of the image (e.g., around the edges or borders of the image) provides supplementary information and avoids interfering with the observation of the main viewpoint.
[0209] Displaying the first pattern in the center of the image improves the efficiency of transmitting key information, such as the display of alarm information in risky scenarios, and serves to separate the information displayed on the display device in different dimensions, ensuring a clean display.
[0210] For example, the target display location includes the bottom of the image. The first pattern is located below the navigation information displayed on the display device. See also Figure 6 (a) Figure 6 (b) Figure 6 (c) Figures 7 to 16 , Figure 18 The position of the line pattern shown in the diagram.
[0211] Optionally, navigation information includes, but is not limited to: trip information (e.g., trips already traveled, trips yet to be traveled), road congestion information (e.g., whether the current road segment or previously untraveled road segment is congested), map information, driving guidance information (e.g., AR light carpet indicating driving direction), road information (e.g., how many lanes the current road contains, and the corresponding lane lines), lane information (e.g., whether the current lane is a left-turn lane, a straight lane, etc.), destination information (e.g., arrival time at the destination, location of the destination), distance information (e.g., distance to the nearest intersection, or distance to the destination), or intersection signage information (e.g., signs at intersections). A first pattern is displayed below the navigation information shown on the display device to avoid interfering with the transmission of navigation information. In some implementations, a line-shaped pattern is used to display and differentiate from the already displayed navigation information to assist users in making trip decisions, improve user cognitive efficiency, and ensure driving safety.
[0212] The display area of the display device is limited. Considering the simplicity of the display screen, the navigation information displayed by the display device may not be comprehensive. Optionally, the missing navigation information can be supplemented by line patterns to improve the coherence of information display, reduce cognitive load, and improve the user's cognitive efficiency.
[0213] In one possible implementation, see [link to relevant documentation]. Figure 6 (a) Figure 6 (c) Figures 7 to 16 , Figure 18 The diagram illustrates the display position of the linear pattern. The first pattern is located below the navigation information and attribute information of the first terminal displayed on the display device. "Below" here may include directly below and / or to the side.
[0214] Optionally, the attribute information includes, but is not limited to: vehicle speed information, speed limit information, driving mode, current time, gear information, vehicle status information, or road condition information. For example, speed limit information includes, but is not limited to: road speed limits, speed limits in intelligent driving mode, or speed limits in cruise control mode. Driving modes include, but are not limited to: Navigate on Autopilot (NOA). Vehicle status information includes, but is not limited to: warning icons or warning lines when too close to an object, and road condition information includes, but is not limited to: 3D modeled road conditions, modeled display information of other vehicles, or lane line information.
[0215] In one alternative embodiment, the target display position of the linear pattern maps to the edge of the first terminal covered by the field of view of the display device. See also Figure 22 , Figure 22 This is a schematic diagram illustrating an application scenario of a linear pattern provided in an embodiment of this application. Figure 22 In this design, the first terminal is a vehicle, and its edges include the edge of the front of the vehicle facing the road. A linear pattern 7 maps to this edge. This means that from the driver's perspective, the linear pattern 7 aligns with the edge of the front of the vehicle facing the road. By aligning the linear pattern with the physical features of the first terminal, such as its edges, the virtual display elements visually coordinate with the real vehicle structure, avoiding spatial misalignment caused by a "floating" effect and enhancing the spatial consistency of the AR fusion scene.
[0216] In one alternative implementation, see [link to implementation details]. Figure 6In (b), the target display position of the first pattern includes the center of the image, the navigation information displayed by the display device is located on one side of the target display position, and the attribute information of the first terminal displayed by the display device is located on the other side of the target display position. By using the linear pattern in the center of the image as a visual divider, the navigation information and vehicle attribute information are placed in the upper and lower or left and right areas respectively, forming a Z-shaped information flow that conforms to human reading habits, thus optimizing the visual effect of parallel display of multi-dimensional information.
[0217] In this embodiment, the display style of the linear pattern is used to convey scene information in at least two dimensions to the user. Optionally, the scene information includes at least three dimensions. The first dimension includes navigation information from external sources (such as cloud servers, roadside devices, or other terminals). The second dimension includes information about the terminal itself, such as the terminal information mentioned above (which may include parameter information, mode information, and entertainment domain information). The third dimension includes information from sensing devices, such as the sensing information mentioned above. In an optional implementation, the display style of the linear pattern is related to at least two of the navigation information, the terminal information of the first terminal, or the sensing information of the first terminal. The display style of the linear pattern can be adjusted based on different scene information to convey scene information in at least two dimensions to the user.
[0218] The following section provides an example of how to illustrate display styles and their relationship with scene information.
[0219] In one alternative implementation, the display style is associated with at least one of the following factors: color, transparency, flickering effect, wave effect, halo effect, aura effect, shadow effect, and graphic topology.
[0220] The display styles corresponding to the three dimensions of scene information will be explained separately below.
[0221] First, we will provide an example of the display style and application scenarios corresponding to the first dimension of scene information, namely navigation information.
[0222] Considering Navigation information The information contained herein may be diverse; the following example illustrates the display style corresponding to trip information in navigation information. Trip information indicates the journey from the origin to the destination. Optionally, trip information includes the journey already traveled and / or the journey to be traveled. The line pattern includes a first part and / or a second part. For more information on the display style corresponding to navigation information, please refer to [link to relevant documentation]. Figure 7 , Figure 8 and Figure 9 And related explanations, which will not be repeated here.
[0223] In one alternative implementation, the first and / or second portion further includes a fifth portion, which indicates a waypoint of the first terminal. In some cases, the waypoint is a point of interest input by the user. The display device receives the input waypoint information. The display device displays the fifth portion in a fifth display style at the target location in the linear pattern, the target location being related to the geographical location of the waypoint.
[0224] In other cases, the waypoints are not user-inputted and are special types of locations (such as charging points, service areas, toll stations, etc.). The display device shows the target location in the linear pattern, displaying the fifth part in the fifth display style. The target location is related to the geographical location of the waypoint. By dynamically generating waypoint markers (such as charging station icons) corresponding to the geographical location in the linear pattern, discrete information is integrated into the continuous travel axis, conveying spatial cognitive information that integrates location and distance.
[0225] In the above embodiments, by displaying travel information in a linear pattern while simultaneously displaying related information, the information display density and the user's information reception efficiency are improved through the display of a series of related information. Similarly, by displaying scene information in a linear pattern while simultaneously displaying related information, information associated with that scene can be added.
[0226] Secondly, the display style and application scenarios corresponding to the terminal information in the second dimension are illustrated by example.
[0227] When the parameter information includes numerical values, the parameter information is conveyed to the user by displaying the corresponding numerical values. In one optional implementation, the terminal information includes parameter information. The line pattern includes a sixth part and / or a seventh part. The display style of the sixth part is a sixth display style, and the display style of the seventh part is a seventh display style. The sixth display style is used to indicate the current value of the target parameter in the parameter information, and the seventh display style is used to indicate the target value of the target parameter, which includes a maximum value and / or a safe value. In some possible implementations, the parameter information of the first terminal includes battery life information, the sixth display style is used to indicate the current battery life of the first terminal, and the seventh display style is used to indicate the target battery life of the first terminal. This allows the user to have a clear perception of the battery life of the first terminal, reducing battery anxiety.
[0228] The following provides examples illustrating the display styles for vehicle speed, accelerator pedal travel, power output, volume, mileage, and maintenance time information in the parameter information.
[0229] Optionally, the range information is used to indicate the range capability of the first terminal. Taking a vehicle as an example, if the first terminal is a vehicle that uses fuel for refueling, the range information includes fuel level information. If the first terminal is a pure electric vehicle, the range information includes battery level information. If the first terminal is a vehicle that can be refueled using both batteries and fuel, such as a range-extended vehicle, the range information includes fuel level information and / or battery level information, or the range information is a comprehensive range information obtained based on fuel level information and battery level information.
[0230] For details on the implementation of parameter information, including range, battery level, and fuel level, please refer to [link / reference]. Figure 9 , Figure 10 and Figure 11 And related explanations, which will not be repeated here.
[0231] In one alternative implementation, the display device adjusts the display style of the line pattern based on scene information of the first terminal.
[0232] In certain special scenarios, such as situations that may affect the normal operation of the first terminal, information that could potentially affect the normal operation of the first terminal is displayed in a specific way to alert the user. For example, if the current value of a target parameter is lower than a first threshold, the display device adjusts the sixth and / or seventh display styles to an eighth display style. The target parameter includes one or more of the following: remaining range information, battery level information, or fuel level information. When the parameter falls below a safety threshold (e.g., battery level < 20%), the display style automatically switches (e.g., flashing red), triggering driver alertness through a visual highlighting mechanism (e.g., switching display styles).
[0233] Furthermore, when the display style corresponding to the navigation information is displayed, and the current value of the target parameter is lower than the first threshold, the fifth part is displayed using the fifth display style. Simultaneously with the switching of display styles, the navigation system can automatically add and recommend supplementary stations, forming a closed-loop decision support system.
[0234] In one possible implementation, the parameter information includes vehicle speed information; correspondingly, a sixth display style is used to display the current vehicle speed, and a seventh display style is used to display the target vehicle speed. For example, the target vehicle speed includes a safe speed, such as a road speed limit.
[0235] In another possible implementation, the parameter information includes accelerator pedal travel information. Accordingly, the sixth display style is used to display the current accelerator pedal travel, and the seventh display style is used to display the maximum accelerator pedal travel.
[0236] In another possible implementation, the parameter information includes power output information, such as motor output power. Accordingly, the sixth display style is used to display the current motor output power, and the seventh display style is used to display the maximum motor output power.
[0237] In another possible implementation, the parameter information includes volume information; correspondingly, the sixth display style is used to display the current volume, and the seventh display style is used to display the maximum volume.
[0238] In another possible implementation, the parameter information includes mileage information. Accordingly, the sixth display style is used to display the current mileage, and the seventh display style is used to display the safe mileage. In this implementation, if the sixth display style covers the seventh display style, it indicates that the vehicle needs rest or maintenance, thus improving driving safety.
[0239] In another possible implementation, the parameter information includes maintenance time information. Accordingly, the sixth display style is used to display the current date, and the seventh display style is used to display the target date. In this implementation, if the sixth display style overrides the seventh display style, it indicates that the vehicle needs rest or maintenance, thus improving driving safety.
[0240] In one optional embodiment, when the mode corresponding to the mode information of the first terminal is enabled, the display device adjusts the display style of the line pattern to the ninth display style. Unlike the segmented display style corresponding to the parameter information, the mode information of the first terminal is generally displayed as a single line.
[0241] Taking a vehicle as the first terminal as an example, the mode information of the first terminal includes, but is not limited to: intelligent driving mode, interactive mode (such as the mode of voice dialogue with the vehicle system), snow mode, off-road mode, sport mode, nap mode, camping mode, etc. The display styles corresponding to intelligent driving mode, interactive mode (such as the mode of voice dialogue with the vehicle system), snow mode, off-road mode, sport mode, nap mode, and camping mode are illustrated below.
[0242] In one possible implementation, the mode information includes an intelligent driving mode, and the ninth display style is associated with at least one of the following factors: a halo effect and blue. Optionally, the ninth display style is matched with a display style corresponding to the intelligent driving mode displayed on other display devices. Matching means that at least one factor is the same. See details below. Figure 12 And related explanations, which will not be repeated here.
[0243] In one optional implementation, when the first terminal outputs recommendation information, the display style of the line pattern is adjusted to the ninth display style, and the recommendation information is used to recommend entering the intelligent driving mode. Optionally, the first terminal can output recommendation information in various ways, such as voice recommendation, graphic recommendation, etc. By coordinating the output of recommendation information, the efficiency of information transmission is improved.
[0244] In another possible implementation, the mode information includes a snow mode, and the ninth display style is at least associated with yellow. A unique visual style (such as yellow highlight) is matched based on the activated driving mode (e.g., snow mode), enhancing the driver's perception of the current vehicle status through color contrast and avoiding the risk that linear patterns may be difficult to perceive due to changes in ambient color.
[0245] In another possible implementation, the mode information includes the interaction mode, and the ninth display style is associated with at least one of the halo effect and wave effect. See details... Figure 13 And related explanations, which will not be repeated here.
[0246] In another possible implementation, the mode information includes an off-road mode, and the ninth display style is associated with at least a contrasting color of blue or yellow.
[0247] In another possible implementation, the mode information includes the motion mode, and the ninth display style is at least associated with the halo effect. See also Figure 23 , Figure 23 This is a schematic diagram illustrating an application scenario of a linear pattern provided in an embodiment of this application. Figure 23 In the middle, the ninth display style of the line pattern 8 is associated with the motion effect. Optionally, the ninth display style may also include a display style corresponding to vehicle speed information, so as to realize the simultaneous display of information related to the motion mode and improve information transmission efficiency.
[0248] In another possible implementation, the mode information includes a nap mode, and the ninth display style is associated with at least a green, halo effect. Optionally, the ninth display style may also be used to display information related to the internal environment, such as internal temperature and internal air quality.
[0249] In another possible implementation, the mode information includes a camping mode, and the ninth display style is at least associated with a halo effect.
[0250] Finally, an example is provided to illustrate the display style and application scenarios corresponding to the third dimension of terminal information.
[0251] In one alternative implementation, the display device adjusts the display style of the line pattern to a tenth display style based on the perceived information.
[0252] For example, environmental elements include road users and / or obstacles, and the perceived information includes alarm information used to alert road users and / or obstacles. In some cases, the alarm information is information acquired by the sensing device, such as image data or point cloud data including road users and / or obstacles. In other cases, the alarm information is information determined based on the information acquired by the sensing device; for example, when the controller of the first terminal acquires image data including road users and / or obstacles, it determines that there is a safety risk and generates alarm information accordingly.
[0253] When the perceived information includes warning information, the tenth display style is associated with at least one of the following factors: red, halo effect, and flashing effect. In addition to warning information that alerts road users and / or obstacles, there are other warning information that alerts to dangerous scenarios, such as warnings that the distance to a target object (such as an obstacle or vehicle in front) is too close, that the steering wheel has been disengaged, that there is a risk of rear-end collision, that a large vehicle is passing by, or that there is a risk of collision.
[0254] Optionally, the display device displays a line pattern in an eleventh display style based on the position of the environmental element relative to the first terminal, the eleventh display style being related to the position of the environmental element relative to the first terminal.
[0255] In one alternative embodiment, environmental elements include ambient temperature and / or air quality, whereby the ambient temperature includes both internal and external ambient temperatures, and the air quality includes both internal and external air quality. Exemplarily, the linear pattern includes a ninth portion and a tenth portion, the display style of which is used to display the internal ambient temperature, and the display style of which is used to display the external ambient temperature. More exemplaryly, the display style of which is used to display the internal air quality, and the display style of which is used to display the external air quality.
[0256] Considering the limited number of line patterns and the rich and complex scene information that may exist and change simultaneously, in one optional implementation, priority (or first priority) is assigned to each scene information, with different scene information having different priorities. The display device prioritizes displaying the line patterns using the display style corresponding to the scene information with the highest priority.
[0257] For example, prioritizing the safe operation of the first terminal, the display style corresponding to the alarm information has the highest priority. The perceived information includes alarm information, and the alarm information has a higher priority than other scene information besides alarm information. When a risky scene is perceived, it immediately switches to a high-alert style (such as flashing red), utilizing the human instinctive alertness to red light and dynamic stimuli to trigger a physiological stress response in the shortest possible time, shortening the delay in handling danger.
[0258] Considering the degree of assistance various scenario information provides to users of the first terminal, in one optional implementation, taking a vehicle as the first terminal, the priority of alarm information in the scenario information is higher than that of interactive mode, which in turn is higher than that of intelligent driving mode, which is higher than that of navigation information, which is higher than that of parameter information. First, alarm information has the highest priority in relation to driving safety. Second, considering the short and quick nature of interactive mode, the display style corresponding to interactive mode has a higher priority than other scenario information besides alarm information. Third, considering that intelligent driving mode mainly relies on the first terminal for autonomous driving, the display style corresponding to intelligent driving mode is displayed first, under alarm information and interactive mode. Fourth, the display style corresponding to parameter information can be displayed normally unless there is an indication that the current parameter value is too low. Finally, navigation information is mainly used to prompt users with information such as trip details and location. In intelligent driving mode, the display style corresponding to navigation information can be reduced or not displayed at all; when intelligent driving mode is not enabled, the display style corresponding to navigation information can be displayed first.
[0259] By pre-setting scene priorities (alarm information > interactive mode information > intelligent driving mode information > navigation information > parameter information), it ensures that highly urgent information always takes center stage, resolves display conflicts when multiple pieces of information are displayed in parallel, and guarantees the reliability of critical information transmission.
[0260] The following example illustrates a scenario switching case, based on the priority settings described above.
[0261] In this case, the first terminal is a vehicle, and the user of the first terminal performed the following operations on the first terminal: Operation 1, start the vehicle; Operation 2, shift to D gear and start the vehicle; Operation 3, start navigation and set the destination; Operation 4, activate intelligent driving mode; Operation 5, interact with the first terminal via voice.
[0262] After performing the above operations, the display style of the line pattern in the first pattern displayed by the display device changes to display the corresponding scene information. The following is an explanation in the order of operations.
[0263] Operation 1: The user starts the vehicle by opening the car door or other operations. Correspondingly, the line pattern is used to display the remaining range information.
[0264] Operation 2: The user shifts to D gear and starts the vehicle. At this time, the line pattern display style is still used to display the remaining range information.
[0265] In step 3, the user starts navigation and sets a destination. At this time, the user needs to know the navigation information. Therefore, the line icon display style is used for navigation information (such as trip information, traffic congestion, etc.).
[0266] Operation 4: The user activates the intelligent driving mode. At this time, the vehicle's driving is controlled by the vehicle itself, and the display style of the navigation information is replaced by the display style corresponding to the intelligent driving mode.
[0267] Operation 5: During intelligent driving, the user interacts with the first terminal via voice. Considering the short and quick nature of the interaction mode, the display style corresponding to the intelligent driving mode is replaced by the display style corresponding to the interaction mode during the interaction. After the interaction ends, the line icon switches back to the display style of the intelligent driving mode.
[0268] If a user triggers an alarm while driving, in this implementation, the display style corresponding to navigation information, interactive mode, and intelligent driving mode will be replaced by the display style corresponding to the alarm.
[0269] Optionally, in specific scenarios, even if the priority of scenario information is set, the relevant information for that specific scenario will still be displayed. For example, in a low battery life scenario, users have a need for battery life information, so the line chart will still be displayed in the style corresponding to battery life information.
[0270] The priority of the aforementioned scene information is adjustable. In some cases, the priority of scene information is adjusted based on user operations. In other cases, the display device determines the priority of scene information based on the user's historical operations, which are used to determine the display style of the line pattern.
[0271] The above primarily addresses the solution where line patterns can only describe a single type of scene information. The following primarily addresses the solution where line patterns can describe different types of scene information. For example, simultaneously displaying the display style corresponding to navigation information and the display style corresponding to parameter information, or simultaneously displaying the display style corresponding to alarm information and the display style corresponding to navigation information.
[0272] Considering the urgency of displaying low-priority scenario information in specific scenarios to meet the user's information needs for the current situation, in one optional implementation, scenario information is used to indicate the application scenario, which includes one or more of the following: low range scenario, congestion scenario, risk scenario, or intelligent driving scenario. Especially in low range and congestion scenarios, the range information corresponding to the low range scenario and the road congestion information corresponding to the congestion scenario have relatively low priority. However, in application scenarios where the first terminal's range is below a preset threshold (e.g., current range is less than 20% of total range), or when the first terminal is in a congested road section, the display of the corresponding scenario information is urgent and needs to be conveyed to the user. Therefore, the parallel display of scenario information from at least two dimensions is considered.
[0273] Optionally, when the scene information is used to indicate multiple application scenarios, the display device displays a linear pattern using some or all of the elements in the display style corresponding to each of the multiple application scenarios.
[0274] For example, low range scenarios are associated with one or more of the following: range information, battery level information, or fuel level information. Congestion scenarios are associated with navigation information. Risk scenarios are associated with risk warning information and / or alert information, which is used to alert the driver to fatigue or loss of control of the steering wheel. Intelligent driving scenarios are associated with intelligent driving modes. The splicing of display styles represented by the above implementation methods is an example of describing different scenario information through display styles. For example, when congestion scenarios and intelligent driving scenarios coexist, the linear pattern can be all elements of the congestion line or some elements of the intelligent driving scenario, such as a congestion line + blue halo, and so on for other scenarios. In composite scenarios (such as intelligent driving activated in congested sections), the feature styles of both (congestion red + intelligent driving blue halo) are integrated, and multiple contextual information is simultaneously transmitted through a single visual element, breaking through the capacity limitation of traditional single information channels and further improving information transmission efficiency. Specific examples can be found in [link to specific examples]. Figure 15 And related explanations.
[0275] In one optional implementation, the aforementioned application scenarios are assigned priorities (or secondary priorities). For example, risk scenarios have the highest priority, and the remaining application scenarios are ranked from highest to lowest priority as follows: low battery range scenarios, congestion scenarios, and intelligent driving scenarios. When the scenario information is used to indicate multiple application scenarios, the display device displays all factors in the display style corresponding to the application scenario with the highest priority, based on the priorities of the multiple application scenarios. Alternatively, the display device displays all factors in the display style corresponding to the application scenario with the highest priority and some factors in the display style corresponding to the application scenario with the lowest priority.
[0276] The above implementation methods represent the splicing, switching, and simultaneous display of display styles, all of which are examples of describing different scene information through display styles. This improves the feasibility and logic of displaying multi-dimensional information through linear patterns. Display styles are dynamically synthesized based on scene priorities (e.g., high-priority full elements + low-priority outlines), maximizing information density within a limited display space while ensuring the visual integrity of core elements.
[0277] In the above implementation of priority, the corresponding priority (including first priority and / or second priority) can be adjusted based on the user's operation.
[0278] In one optional implementation, the application scenario includes a risk scenario. The display device displays a linear pattern in an eleventh display style based on the location of the risk, and the eleventh display style is related to the location of the risk. A local warning is triggered on the side corresponding to the linear pattern based on the risk's orientation (e.g., an obstacle on the left). This (e.g., displaying the corresponding display style on the left side of the linear pattern) transforms the abstract risk warning into a spatial orientation indicator, allowing the driver to directly pinpoint the direction of the threat and improving the accuracy of hazard avoidance maneuvers.
[0279] In one optional implementation, the linear pattern includes multiple eighth parts, each corresponding to a different twelfth display style, which is used to describe different scene information. The linear pattern is displayed according to the scene information of the first terminal, including but not limited to the following operations: the display device displays the eighth parts corresponding to different twelfth display styles according to the scene information. The above implementation is an example of describing different scene information through display styles. The display style of the linear pattern is mainly obtained by splicing together all the factors of the display styles corresponding to different scene information. By dividing the display into independent segments to present different scene information (such as the initial battery life percentage and the final navigation progress), multiple information can be carried in parallel by a single linear pattern, avoiding cognitive interruption caused by information switching.
[0280] Besides using a single line pattern to stitch together display styles and convey scene information from different dimensions, at least two line patterns can also be used to display scene information in different dimensions, each with its own display style. See also Figure 16 , Figure 17 and Figure 18 And related explanations, which will not be repeated here.
[0281] In one alternative implementation, the display device receives a first operation input by the user. Based on the first operation, the display device adjusts the display parameters of the line pattern, including one or more of the following: display style, target display position, display area, display length, and display shape. This allows the driver to manually adjust the position or shape of the line pattern to meet individualized visual acuity differences, especially adapting to the ergonomic needs of special driving groups (such as color blindness or height abnormalities).
[0282] Optionally, the display device receives a second operation input by the user. Based on the second operation, the display device adjusts the display parameters of the second pattern.
[0283] Optionally, in the case where the first pattern described above includes multiple line patterns, each corresponding to a different dimension of scene information, the display parameters also include the display distribution. This means that the user can adjust the distribution of the multiple line patterns through the first operation; for example, the scene information of a certain dimension located on the left side of the field of view can be moved to the right side of the field of view.
[0284] This application provides a display method that displays a first pattern, including a linear pattern, at a fixed position. The fixed display position and shape create a stable visual anchor point, eliminating the need for users to repeatedly adapt to changes in the interface layout and reducing the cognitive load on the user during information recognition. This is particularly beneficial in scenarios where the first terminal is a vehicle, ensuring the driver's attention remains focused on the road environment and improving driving safety. The linear pattern utilizes minimal display space, increasing its utilization and minimizing its impact on the driver's field of vision. By using display styles corresponding to scene information within the linear pattern, the driver can obtain the relevant scene information simply by observing the display style. This simplifies information transmission, improves efficiency, and enhances the flexibility of information display. Furthermore, displaying different scene information at the target display position provides a rich variety of information types, improving the adaptability of the display device to different scenarios.
[0285] The methods of the embodiments of this application have been described in detail above. The following provides an apparatus for implementing any one of the methods in the embodiments of this application. For example, an apparatus is provided that includes a unit (or means) for implementing the steps performed by the device in any of the above methods.
[0286] Please see Figure 24 , Figure 24 This is a schematic diagram of the structure of a display device provided in an embodiment of this application.
[0287] like Figure 24 As shown, the display device 240 may include an acquisition unit 2401 and a display unit 2402. The acquisition unit 2401 and the display unit 2402 may be software, hardware, or a combination of software and hardware.
[0288] The acquisition unit 2401 can implement sending and / or receiving functions, and can also be described as a transceiver unit. The acquisition unit 2401 can also be a unit integrating an acquisition unit and a sending unit, wherein the acquisition unit is used to implement the receiving function, and the sending unit is used to implement the sending function. Optionally, the acquisition unit 2401 can be used to receive information sent by other devices, and can also be used to send information to other devices.
[0289] In one possible design, the display device 240 may correspond to the above. Figure 19The display device in the illustrated method embodiment, such as display device 240, can be an electronic device or a chip within an electronic device. Display device 240 may include components for performing the above-described... Figure 19 The unit in the method embodiment shown is the one that performs the operation by the display device, and each unit in the display device 240 is respectively for implementing the above-described operation. Figure 6 The operation performed by the display device in the illustrated method embodiment is described below: The acquisition unit 2401 is used to acquire scene information of the first terminal, which includes one or more of navigation information, terminal information of the first terminal, or perception information of the first terminal.
[0290] Display unit 2402 is used to display a first pattern at a target display position based on scene information of the first terminal. The first pattern includes at least a line pattern, and the display style of the line pattern is related to the scene information. The target display position is used to display at least two of navigation information, terminal information of the first terminal, or perception information of the first terminal.
[0291] In one possible design, the display unit 2402 is used for displaying... Figures 6 to 18 , Figures 20 to 23 The displayed screen or line pattern shown.
[0292] The steps performed by the acquisition unit 2401 and the display unit 2402 described in this design can be referred to the steps corresponding to the above. Figure 19 The implementation method shown corresponds to the display device in the method embodiment.
[0293] Regarding the technical effects brought about by the implementation methods performed by the acquisition unit 2401 and display unit 2402 described in this design, please refer to the corresponding descriptions above. Figure 19 The technical effects of the illustrated method embodiments are described below.
[0294] According to the embodiments of this application, Figure 24 The various units in the illustrated device can be individually or entirely combined into one or more other units, or some of the units can be further divided into multiple functionally smaller units. This achieves the same operation without affecting the technical effects of the embodiments of this application. The above-mentioned units are based on logical function division. In practical applications, the function of one unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of this application, the electronic device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented collaboratively by multiple units.
[0295] It should be noted that the implementation of each unit can also refer to the above. Figure 19 The corresponding description of the method embodiments shown.
[0296] exist Figure 24 The described display device 240 can present scene information to the user more effectively, thereby improving information display efficiency.
[0297] For cases where the aforementioned display device 240 can be an electronic device, please refer to [reference needed]. Figure 25 The diagram shows the structure of the electronic device.
[0298] It should be understood that Figure 25 The illustrated electronic device 250 is merely an example; the electronic device in this embodiment may also include other components, or include components related to... Figure 25 Components with similar functions, or not necessarily including Figure 25 All components.
[0299] Electronic device 250 includes transceiver interface 2501 and at least one processor 2502.
[0300] The electronic device 250 can correspond to a display device. The transceiver interface 2501 is used for transmitting and receiving signals, and at least one processor 2502 executes program instructions, causing the electronic device 250 to implement the corresponding flow of the method executed by the corresponding device in the above method embodiment.
[0301] In one possible design, the electronic device 250 may correspond to the above. Figure 6 The display device in the illustrated method embodiment, such as the electronic device 250, can be a display device itself or a chip within the display device. The electronic device 250 may include components for performing the operations performed by the display device in the above method embodiment, and each component in the electronic device 250 is specifically designed to implement the operations performed by the display device in the above method embodiment. Specifically, it can be as follows: The processor 2502 is used to acquire scene information of the first terminal, wherein the scene information of the first terminal includes one or more of navigation information, terminal information of the first terminal, or perception information of the first terminal. The processor 2502 is further configured to display a first pattern at a target display location based on the scene information of the first terminal, the first pattern including at least a line pattern, the display style of the line pattern being related to the scene information, and the target display location being used to display at least two of the navigation information, the terminal information of the first terminal, or the perception information of the first terminal.
[0302] In one possible implementation, the electronic device further includes a transceiver interface 2501.
[0303] The processor 2502 is specifically used to obtain scene information of the first terminal through the transceiver interface 2501.
[0304] In one possible implementation, the device also includes a display.
[0305] The processor 2502 is configured to control the display to display a first pattern at a target display position based on the scene information of the first terminal. The first pattern includes at least a line pattern, and the display style of the line pattern is related to the scene information. The target display position is used to display at least two of the navigation information, the terminal information of the first terminal, or the perception information of the first terminal.
[0306] Regarding the transceiver interface 2501 and at least one processor 2502 described in this design, the steps performed can be referred to the corresponding steps described above. Figure 19 The implementation method shown corresponds to the display device in the method embodiment.
[0307] Regarding the technical effects of the transceiver interface 2501 and the implementation methods performed by at least one processor 2502 described in this design, please refer to the corresponding descriptions above. Figure 19 The technical effects of the illustrated method embodiments are described below.
[0308] exist Figure 25 The described electronic device 250 can present vehicle information and real-world information to the user more effectively, improving information display efficiency.
[0309] For cases where the aforementioned display device 240 can be a chip or a chip system, please refer to [reference needed]. Figure 26 The diagram shows the structure of the chip.
[0310] like Figure 26 As shown, chip 260 includes processor 2601 and interface 2602. The number of processors 2601 can be one or more, and the number of interfaces 2602 can be multiple. It should be noted that the functions of processor 2601 and interface 2602 can be implemented through hardware design, software design, or a combination of both; no restrictions are placed here.
[0311] Optionally, chip 260 may also include memory 2603 for storing necessary program instructions and data.
[0312] In this application, processor 2601 can be used to call the implementation program of the display method provided in one or more embodiments of this application on a display device from memory 2603, and execute the instructions included in the program. Interface 2602 can be used to output the execution result of processor 2601. In this application, interface 2602 can be specifically used to output various messages or information of processor 2601.
[0313] The display method provided by one or more embodiments of this application can be referred to the foregoing. Figure 19 The various embodiments shown are not described in detail here.
[0314] The processor in this application embodiment can be a central processing unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.
[0315] The memory in this application embodiment is used to provide storage space, in which data such as operating system and computer programs can be stored. The memory includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM).
[0316] According to the method provided in the embodiments of this application, the embodiments of this application also provide a computer-readable storage medium storing a computer program. When the computer program is run on one or more processors, it can implement the above-mentioned... Figure 6 The method shown.
[0317] According to the method provided in the embodiments of this application, the embodiments of this application also provide a computer program product, which includes a computer program. When the computer program runs on a processor, it can achieve the above-mentioned... Figure 19 The method shown.
[0318] This application embodiment also provides a display system, the display system including components for performing the above-described... Figure 19 The method shown includes a display device and a sensing unit. The sensing unit is used to sense the environment in which the first terminal is located.
[0319] This application embodiment also provides a terminal, which includes at least one display device 240, or electronic device 250, or chip 260, or the above-described display system.
[0320] Optionally, the terminal further includes a light-transmitting component, through which the light emitted from the display device 240, electronic device 250, chip 260, or the aforementioned display system passes to form a virtual image in front of the terminal. For example, the light-transmitting component may be a windshield.
[0321] Optionally, the terminal can be a means of transportation, such as a car, truck, aircraft, drone, slow transport vehicle, spacecraft, or ship, or any other possible means of transportation used in any possible scenario. This application embodiment does not limit this.
[0322] Optionally, the terminal is used to implement the above. Figure 19 The method shown.
[0323] This application also provides a processing apparatus, including a processor and an interface; the processor is used to execute the method in any of the above method embodiments.
[0324] It should be understood that the above-described processing device can be a chip. The units in the various device embodiments and the electronic devices in the method embodiments correspond completely, with corresponding modules or units executing corresponding steps. For example, the acquisition unit (transceiver) executes the receiving or sending steps in the method embodiments, while other steps besides sending and receiving can be executed by the processing unit (processor). The specific functions of each unit can be found in the corresponding method embodiments. There can be one or more processors.
[0325] It is understood that in the embodiments of this application, the electronic device may perform some or all of the steps in the embodiments of this application. These steps or operations are merely examples, and the embodiments of this application may also perform other operations or variations thereof. Furthermore, the steps may be performed in different orders as presented in the embodiments of this application, and it is not necessarily necessary to perform all the operations in the embodiments of this application.
[0326] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0327] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0328] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0329] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the contributing part, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0330] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.
Claims
1. A display method, characterized in that, The display method includes: Obtain scene information of the first terminal, wherein the scene information of the first terminal includes one or more of navigation information, terminal information of the first terminal, or perception information of the first terminal; Based on the scene information of the first terminal, a first pattern is displayed at the target display position. The first pattern includes at least a line pattern, and the display style of the line pattern is related to the scene information. The target display position is used to display at least two of the navigation information, the terminal information of the first terminal, or the perception information of the first terminal. The target display position of the line pattern is mapped to the edge of the first terminal covered by the field of view of the display device.
2. The method according to claim 1, characterized in that, The line pattern is displayed in a fixed manner, including its display position, display area, display length, and display form.
3. The method according to claim 1, characterized in that, The display form of the linear pattern includes one or more of the following: straight line, broken line, curved line, strip, block, triangle or circle.
4. The method according to claim 1, characterized in that, The target display position includes any one or more positions within the field of view of the display device installed on the first terminal: bottom of the frame, top of the frame, one side of the frame, both sides of the frame, edge of the frame, and center of the frame.
5. The method according to claim 4, characterized in that, The target display position includes the bottom of the image; the first pattern is located below the navigation information displayed by the display device.
6. The method according to claim 5, characterized in that, The navigation information includes one or more of the following: road congestion information, map information, driving guidance information, road information, lane information, destination information, distance information, or intersection sign information.
7. The method according to claim 5, characterized in that, The first pattern is located below the navigation information and the attribute information of the first terminal displayed on the display device.
8. The method according to claim 7, characterized in that, The attribute information includes one or more of the following: vehicle speed information, speed limit information, driving mode, current time, gear information, vehicle status information, or road status information.
9. The method according to claim 4, characterized in that, The target display position includes the center of the image, the navigation information displayed by the display device is located on one side of the target display position, and the attribute information of the first terminal displayed by the display device is located on the other side of the target display position.
10. The method according to claim 9, characterized in that, The navigation information is located above the linear pattern, and the attribute information is located below the linear pattern.
11. The method according to any one of claims 1-10, characterized in that, The method further includes: Based on the scene information of the first terminal, the display style of the line pattern is adjusted.
12. The method according to claim 11, characterized in that, The display style of the linear pattern is related to at least two of the navigation information, the terminal information of the first terminal, or the perception information of the first terminal.
13. The method according to claim 12, characterized in that, The scene information of the first terminal includes the navigation information, and the display style of the line pattern is related to the navigation information; The linear pattern includes a first part and / or a second part; the first part is displayed in a first display style, and the second part is displayed in a second display style. The first display style is used to indicate the first trip that the first terminal has traveled, and the second display style is used to indicate the second trip that the first terminal is about to travel.
14. The method according to claim 13, characterized in that, The second part includes one or more third parts, the third parts being used to indicate congested sections of the second journey, the third parts being displayed in a third display style, the third display style being used to indicate the congestion status of the congested sections.
15. The method according to claim 13, characterized in that, The first part and / or the second part also includes a fourth part, the fourth part being displayed in a fourth display style, which is used to indicate the nature of the road.
16. The method according to any one of claims 13-15, characterized in that, The first part and / or the second part further includes a fifth part, which is used to indicate the waypoint of the first terminal; the display style of the fifth part is a fifth display style, which is used to indicate the type of the waypoint; The method further includes: Receive input waypoint information; The target location in the linear pattern is displayed in a fifth display style, and the target location is related to the geographical location of the waypoint.
17. The method according to any one of claims 1-10, characterized in that, The terminal information includes one or both of the following: The parameter information or mode information of the first terminal; The parameter information includes one or more of the following: Range information, battery level information, fuel level information, vehicle speed information, accelerator pedal travel information, and power output information.
18. The method according to claim 17, characterized in that, The terminal information includes parameter information; the linear pattern includes a sixth part and / or a seventh part; The display style of the sixth part is the sixth display style, and the display style of the seventh part is the seventh display style. The sixth display style is used to indicate the current value of the target parameter in the parameter information, and the seventh display style is used to indicate the target value of the target parameter, which includes the maximum value and / or the safe value.
19. The method according to claim 18, characterized in that, The parameter information of the first terminal includes battery life information, the sixth display style is used to indicate the current battery life of the first terminal, and the seventh display style is used to indicate the target battery life of the first terminal.
20. The method according to claim 18, characterized in that, The parameter information of the first terminal includes battery information and / or fuel information. The sixth display style is used to indicate the current battery level and / or current fuel level of the first terminal, and the seventh display style is used to indicate the target range of the first terminal.
21. The method according to claim 18, characterized in that, The parameter information of the first terminal includes power information and / or fuel information. The sixth display style is used to indicate the current power and / or target power of the first terminal, and the seventh display style is used to indicate the current fuel and / or target fuel of the first terminal.
22. The method according to claim 18, characterized in that, The method further includes: If the current value of the target parameter is lower than the first threshold, the sixth display style and / or the seventh display style are adjusted to the eighth display style. The target parameter includes one or more of the following: range information, battery information, or fuel information.
23. The method according to claim 17, characterized in that, The mode information of the first terminal includes one or more of the following: Intelligent driving mode, interactive mode, snow mode, or off-road mode.
24. The method according to claim 23, characterized in that, The method further includes: When the mode corresponding to the mode information of the first terminal is enabled, the display style of the line pattern is adjusted to the ninth display style.
25. The method according to claim 24, characterized in that, The mode information includes intelligent driving mode, and the ninth display style is associated with at least one of the following factors: halo effect and blue.
26. The method according to claim 25, characterized in that, The method further includes: When outputting recommendation information, the display style of the line pattern is adjusted to the ninth display style, and the recommendation information is used to recommend entering the intelligent driving mode.
27. The method according to claim 24, characterized in that, The mode information includes a snow mode, and the ninth display style is at least associated with yellow.
28. The method according to claim 24, characterized in that, The mode information includes an interactive mode, and the ninth display style is associated with at least one of the halo effect and wave effect; The wave effect fluctuates with the volume of the sound output or voice input in interactive mode, and / or, The display area of the ninth display style is related to the passenger seat for voice input.
29. The method according to any one of claims 1-10, characterized in that, The sensing information of the first terminal is related information of environmental elements sensed by the sensing device, wherein the environmental elements include one or more of the following: Road users, obstacles, traffic infrastructure, weather, temperature, humidity, brightness, or air quality; The method further includes: Based on the perceived information, the display style of the linear pattern is adjusted to the tenth display style.
30. The method according to claim 29, characterized in that, The environmental elements include road users and / or obstacles, and the perception information includes alarm information, which is used to alert the road users and / or obstacles. The tenth display style is associated with at least one of the following factors: red, halo effect, and flashing effect.
31. The method according to any one of claims 1-10, characterized in that, Different scenarios have different priorities; the method also includes: Linear patterns are displayed using the display style corresponding to the scene information with higher priority.
32. The method according to claim 31, characterized in that, The method further includes: Based on the user's historical operations, the priority of the scene information is determined, and the historical operations are used to determine the display style of the line pattern.
33. The method according to claim 31, characterized in that, The scenario information is used to indicate the application scenario, which includes one or more of the following: low range scenario, congestion scenario, risk scenario, or intelligent driving scenario. The method further includes: When the scene information is used to indicate multiple application scenarios, a line pattern is displayed using some or all of the factors in the display style corresponding to each of the multiple application scenarios. The low range scenario is related to one or more of the following: range information, battery level information, or fuel level information. The congestion scenario is related to the navigation information; The risk scenarios are related to risk warning information and / or alarm information, and the risk warning information is used to remind the driver of fatigue or loss of control of the steering wheel; The intelligent driving scenario mentioned is related to the intelligent driving mode.
34. A display device, characterized in that, Includes units for performing the method as described in any one of claims 1-33.
35. An electronic device, characterized in that, Includes a processor for performing the method as described in any one of claims 1-33.
36. A chip, characterized in that, It includes logic circuits and interfaces, wherein the logic circuits and the interfaces are coupled; The interface is used for inputting and / or outputting information, and the logic circuit is used for performing the method as described in any one of claims 1-33.
37. A computer-readable storage medium containing computer instructions, characterized in that, When the computer instructions are executed on the processor, they cause the method as described in any one of claims 1-33 to be implemented.
38. A computer program product containing instructions, characterized in that, When the instruction is executed, it causes the method described in any one of claims 1-33 to be implemented.
39. A terminal, characterized in that, Includes a display device, wherein the display device is the display device as described in claim 34, or the electronic device as described in claim 35, or the chip as described in claim 36.
Citation Information
Patent Citations
Method and device for displaying vehicle parameters
CN104816634A