HUD-based offline image display method and system, medium, program product and terminal

Abstract

According to the off-line image display method and system based on the HUD, the medium, the program product and the terminal provided by the invention, by automatically downloading required data to the local database, personalized setting migration among cross-vehicle equipment is promoted, and it is ensured that a user can conveniently use the same configuration in different vehicles. Meanwhile, flexible switching between the online state and the offline state is supported, dependence on network signals is greatly reduced, driving safety and user experience are improved, and therefore the improvement of the intelligent level of the vehicle is promoted. The technical problem that a user cannot obtain HUD information in an offline state is solved, and the technical effect that display content can be customized in various network environments is achieved.

Description

Technical Field

[0001] The present application relates to the field of vehicle driving assistance systems, and in particular to an offline image display method, system, medium, program product and terminal based on HUD. Background Art

[0002] In the modern traffic environment, safe driving has become a topic that has received increasing attention. In order to solve the inconvenience of obtaining information during driving, head-up displays (HUD) are widely used in automobiles. The core of HUD technology is to project driving-related information, such as vehicle speed, navigation information, and real-time traffic conditions, into the driver's field of vision in the form of images or text, usually on the windshield or a transparent display screen. The purpose of this design is to enable the driver to obtain key information intuitively and quickly without looking down at the dashboard, thereby improving driving safety.

[0003] However, although HUD improves the efficiency of interaction with driving information, the technology still has certain limitations in actual driving scenarios. One major problem is that the function of HUD depends on the transmission of the vehicle's built-in information system and external environmental data. Especially in remote mountainous areas, tunnels, and areas with weak signals, GPS signals are often unstable or lost. In these areas, the vehicle system may not be able to obtain real-time traffic information and navigation data, resulting in the HUD being unable to display the required information normally. Specifically, HUD technology often relies on real-time data transmission from sensors and communication systems, such as GPS, radar, and vehicle networks. If these systems cannot receive accurate information, the content displayed by the HUD may become invalid or even mislead the driver. This technical defect not only affects the driving experience, but may also increase driving risks in some cases. For example, the loss of navigation instructions may cause the driver to be confused about the direction of travel, while the delay of information may lead to a longer reaction time. Summary of the invention

[0004] In view of the shortcomings of the prior art described above, the purpose of the present application is to provide a HUD-based offline image display method, system, medium, program product and terminal, which are used to solve the problem in the prior art that the HUD cannot obtain real-time traffic information and navigation data in areas with weak signals.

[0005] To achieve the above-mentioned purpose and other related purposes, the first aspect of the present application provides an offline image display method based on HUD, which is applied to a HUD microcontroller, and the method includes: checking the connection status between the vehicle control system and the network to generate a vehicle signal detection result; in response to the vehicle signal detection result being an online state, receiving real-time video information and first instruction information sent by the vehicle main control chip, and performing a HUD screen display operation on the real-time video information according to the first instruction information; in response to the vehicle signal detection result being not an online state, receiving the second instruction information sent by the vehicle main control chip, extracting the video from the local database based on the second instruction information to generate local video information, and performing the HUD screen display operation on the local video information.

[0006] In some embodiments of the first aspect of the present application, the process of the HUD screen display operation includes: performing image processing operations and HUD graphic element overlay operations on the real-time video information or the local video information to generate a HUD merged frame, and rendering the HUD merged frame to the HUD display screen for display.

[0007] In some embodiments of the first aspect of the present application, the process of performing a video extraction operation from a local database based on the second instruction information to generate local video information includes: parsing the second instruction to extract offline identification information and pre-offline video; searching for corresponding HUD video identification points from the local database based on the offline identification information; extracting post-offline video from the local database based on the HUD video identification points; and performing a video merging operation on the pre-offline video and the post-offline video to generate local video information.

[0008] In some embodiments of the first aspect of the present application, the process of performing the HUD screen display operation on the local video information includes: determining the corresponding splicing time point in the local video information based on the HUD video identification point; and performing the HUD screen display operation on the local video information from the splicing time point.

[0009] In some embodiments of the first aspect of the present application, the local database includes one or more of the following information: HUD traffic information, HUD map information, and a graphic element library.

[0010] In some embodiments of the first aspect of the present application, the process of the HUD screen display operation also includes: adjusting one or more information of the display graphic type, graphic layout and graphic color according to user-defined settings.

[0011] To achieve the above-mentioned purpose and other related purposes, the second aspect of the present application provides an offline image display system based on HUD, the system comprising a vehicle main control chip and a HUD microcontroller, the interaction process of the system comprising: the HUD microcontroller checks the connection status between the vehicle control system and the network to generate a vehicle signal detection result; in response to the vehicle signal detection result being an online state, the vehicle main control chip sends real-time video information and first instruction information to the HUD microcontroller, the HUD microcontroller receives the real-time video information and the first instruction information sent by the vehicle main control chip, and performs a HUD screen display operation on the real-time video information according to the first instruction information; in response to the vehicle signal detection result being not an online state, the vehicle main control chip sends a second instruction information to the HUD microcontroller, the HUD microcontroller receives the second instruction information sent by the vehicle main control chip, the HUD microcontroller extracts a video from a local database based on the second instruction information to generate local video information, and performs the HUD screen display operation on the local video information.

[0012] To achieve the above-mentioned purpose and other related purposes, the third aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the HUD-based offline image display method is implemented.

[0013] To achieve the above-mentioned purpose and other related purposes, the fourth aspect of the present application provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer implements the HUD-based offline image display method.

[0014] To achieve the above-mentioned purpose and other related purposes, the fifth aspect of the present application provides an electronic terminal, including a memory, a processor and a computer program stored in the memory; the processor executes the computer program to implement the HUD-based offline image display method.

[0015] As described above, the HUD-based offline image display method, system, medium, program product and terminal of the present application have the following beneficial effects: The present application significantly improves the user experience and vehicle intelligence level, allowing the driver to perform personalized head-up display settings in an offline state, thereby obtaining key information in any environment and reducing driving distractions. At the same time, the system can automatically download content to the local database according to user needs, which is convenient for migrating personalized settings between different vehicles. It supports automatic or manual switching between online and offline states, reduces dependence on network signals, ensures normal use even when the signal is poor, and enhances driving safety. In addition, the system's data management and update convenience enable users to easily obtain the latest features and reduce operating costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A flow chart of an embodiment of an offline image display method based on HUD of the present application is shown.

[0017] Figure 2 A schematic diagram of the interaction process of the online state in an embodiment of the HUD-based offline image display method of the present application is shown.

[0018] Figure 3 A schematic diagram of an online HUD image in an embodiment of an offline image display method based on HUD of the present application is shown.

[0019] Figure 4 A schematic diagram of the interaction process in the offline state in an embodiment of the HUD-based offline image display method of the present application is shown.

[0020] Figure 5 A schematic diagram of an offline HUD image in an embodiment of an offline image display method based on HUD of the present application is shown.

[0021] Figure 6 A structural schematic diagram of an embodiment of an offline image display system based on HUD of the present application is shown.

[0022] Figure 7 A schematic diagram of the interaction process of an embodiment of an offline image display system based on HUD of the present application is shown.

[0023] Figure 8 A structural schematic diagram of an embodiment of an offline image display terminal based on HUD of the present application is shown. DETAILED DESCRIPTION

[0024] The following describes the embodiments of the present application through specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0025] Before further describing the present invention in detail, the nouns and terms involved in the embodiments of the present invention are explained. The nouns and terms involved in the embodiments of the present invention are applicable to the following interpretations:

[0026] <1> HUD Head-up Display: HUD Head-up Display is a display technology that projects important information directly in front of the driver's line of sight. This technology allows the driver to drive without having to look down at the dashboard, thereby improving safety. Typical HUD content includes vehicle speed, navigation instructions, warning information and other driving-related data. This display method was originally used in the aviation field, but is now widely used in various types of transportation such as automobiles.

[0027] <2> HUD merged frames: HUD merged frames refer to the process of merging multiple data sources or image frames into one display frame in the head-up display system. This means that information from different sources, such as vehicle speed and navigation instructions, can be displayed simultaneously in the same view. Merged frames can improve the visualization of information, allowing drivers to obtain the required data more quickly without having to switch between different display pages.

[0028] <3> Offline identification information: Offline identification information generally refers to information tags that can be stored, identified or processed by the system without a network connection. This type of identification information is very important in some application scenarios. For example, in map navigation, offline mode allows users to access previously downloaded data and tags, including points of interest (POI) and routes, to ensure normal use in an off-network environment.

[0029] <4> Splicing time point: Splicing time point refers to determining the time nodes where different images or video clips are connected during the video or image splicing process. Splicing technology is usually used in video editing and special effects production to ensure smooth transitions between multiple video sources. Correct splicing time point setting helps eliminate visual gaps and improve the viewing experience.

[0030] <5> MCU system: MCU system (microcontroller unit system) is a control system used in embedded systems, usually in home appliances, cars and other smart devices. MCU is responsible for managing the operation of the system and interacting with other hardware components for data and control. Its design usually emphasizes low power consumption and high efficiency to extend the use time of the device.

[0031] <6> Car main control chip: Car main control chip refers to the core chip used for data processing and control in the car infotainment system. This chip integrates multiple functions, including audio processing, video decoding, navigation, vehicle communication, etc. The performance of the car main control chip directly affects the response speed and user experience of the vehicle infotainment system.

[0032] <7> HUD video markers: HUD video markers are markers set for specific video content or information in the head-up display system. These markers are used to help users quickly identify and understand the information displayed on the HUD, which may include important navigation instructions or safety warnings.

[0033] <8> B-tree index structure: B-tree index structure is a self-balancing data structure widely used in databases and file systems. The design of B-tree allows efficient insertion, deletion, and search operations because it ensures that the height of the tree is always kept at a low level. This structure achieves good performance by distributing data across multiple nodes, which can significantly reduce the complexity of calculation and storage, especially when processing large data sets.

[0034] <9> FFmpeg library: FFmpeg library is an open source multimedia processing framework that can realize audio and video recording, conversion and streaming media processing. FFmpeg supports multiple formats and codecs. It is a common tool for developing and processing audio and video data. It is suitable for streaming media applications, video editing, encoding and decoding tasks and other fields.

[0035] <10> H.264 encoding standard: H.264 encoding standard is a highly efficient video compression standard, widely used in Blu-ray discs, network video streams and other video storage and transmission methods. H.264 (also known as AVC, Advanced Video Coding) can provide high video quality at a relatively low bit rate. It is one of the main standards for modern digital video transmission and is suitable for a variety of scenarios.

[0036] <11> VP9 compression algorithm: VP9 is a video encoding format launched by Google, which aims to provide higher compression efficiency and video quality, especially for network video streaming. It is the successor of VP8 and can transmit high-quality video under lower bandwidth conditions, so it is widely used in video sharing platforms and streaming services.

[0037] <12> avformat_open_input() function: avformat_open_input() function is a key function in FFmpeg library, which is used to open the input media file and read its format information. This function returns a pointer to AVFormatContext, which contains detailed information about the input media file, such as duration, format, number of streams, etc. This is the first step in multimedia processing.

[0038] <13> Alpha channel: Alpha channel is an important part of image data, representing the transparency information of each pixel. By using the alpha channel, image overlay and synthesis effects can be achieved, so that the graphics and background have a good fusion, which is often used in graphic design and video editing.

[0039] <14> Point of Interest (POI): A point of interest (POI) is a specific location in a map or navigation system that a user may be interested in, such as a restaurant, store, or attraction. POIs usually contain information such as name, location, description, and contact information to help users more easily find the places or services they want to visit.

[0040] To facilitate understanding of the embodiments of the present application, first Figure 1 Detailed description. Figure 1 The flowchart of a HUD-based offline image display method in an embodiment of the present invention is shown. The HUD-based offline image display method in this embodiment mainly includes the following steps:

[0041] Step S11: Check the connection status between the vehicle control system and the network to generate a vehicle signal detection result.

[0042] In one embodiment of the present invention, the HUD microcontroller provides two connection status detection modes: manual mode and automatic mode, to enhance the user experience of signal detection. In manual mode, the user can freely set the network status of the vehicle computer to online or offline. When the user manually switches to offline status, the HUD microcontroller will stop frequent connection status detection, thereby avoiding frequent prompts to the user due to unstable network signals, and ensuring that the user's driving experience is not disturbed when the signal fluctuates. In this case, the HUD microcontroller will extract the video from the local database and execute the HUD microcontroller screen display operation of the local video information by receiving the second instruction information sent by the vehicle computer main control chip.

[0043] Furthermore, in automatic mode, the HUD microcontroller will automatically detect the network status periodically. If an online state is detected, the HUD microcontroller will receive the real-time video information and the first instruction information sent by the vehicle main control chip in real time, and perform the HUD microcontroller screen display operation based on this information; but if an offline state is detected, the HUD microcontroller will promptly prompt the user to inform that it is currently offline and switch to operations based on local data. This embodiment is intended to enhance the user experience, so that it has more control and choices when facing poor network conditions, thereby improving the overall adaptability and humanization of the system.

[0044] In one embodiment of the present invention, the HUD microcontroller supports operation in a completely offline state to enhance the user's privacy protection and data security. In this mode, the user can set the vehicle system to be offline, and the HUD microcontroller will extract driving-related information from the local database according to the second instruction information sent by the vehicle main control chip to perform the HUD microcontroller screen display operation. This includes vehicle status monitoring, real-time driving information, and navigation notifications, etc., without relying on network connection, allowing users to obtain important information under various driving conditions. In offline mode, the HUD microcontroller can still reflect the operating status of the vehicle in a timely manner and present relevant information according to user needs, thereby ensuring driving safety. This embodiment ensures that even in the case of poor or missing network, users can still easily obtain important driving data and information, thereby improving the overall driving experience.

[0045] In one embodiment of the present invention, in the vehicle control system, in order to improve the user experience and system adaptability, the HUD microcontroller supports the migration function of user habit data. During the user's use of the vehicle, the HUD microcontroller monitors and records the user's usage habits, including common navigation destinations, vehicle setting preferences, and common driving behaviors, and stores this information securely in a local database. When the user changes the vehicle, these habit data can be exported and migrated to the HUD microcontroller system of the new car through simple operations. In this way, the new car can be quickly adapted according to the user's usage habits after startup, and provide the user with a personalized HUD microcontroller display interface and functions, so that the user can immediately feel a familiar operating experience when driving a new car. At the same time, this function also enhances the personalization of the system. By migrating user habit information, it ensures the driving continuity and coherence between different vehicles, further improving the overall satisfaction and user experience.

[0046] Step S12: In response to the vehicle computer signal detection result being in an online state, receiving real-time video information and first instruction information sent by the vehicle computer main control chip, and performing a HUD screen display operation on the real-time video information according to the first instruction information.

[0047] In one embodiment of the present invention, real-time video information is collected through multiple cameras and sensors (such as lidar and millimeter-wave radar) of the vehicle, as well as cloud data that can be obtained online. At the same time, it also monitors the surrounding environment, identifies potential threats (such as pedestrians and obstacles), and provides real-time safety prompts to the driver. In addition, real-time video information combined with navigation function can realize augmented reality (AR) navigation, intuitively displaying the driving route and target location, so as to monitor driving behavior and environmental changes.

[0048] In one embodiment of the present invention, the first instruction information is sent by the vehicle main control chip, which is mainly used to instruct the HUD microcontroller on how to process and display real-time video information. Its functions include content display instructions, format and layout settings, and interaction instructions, so as to adjust the display content according to user needs and preferences. The specific content covers the definition of information priority (such as safety warning information takes precedence over navigation information), real-time data requirements (such as vehicle speed, current location, etc.), HUD display settings (such as display area layout and visual style), trigger conditions (such as updating information when road conditions change), and temporary information prompts (such as sudden traffic situation reminders). Through the first instruction information, the HUD system can achieve a personalized and intelligent user experience, flexibly respond to user needs, and enhance safety and ease of use.

[0049] Furthermore, the process of performing a HUD screen display operation on real-time video information according to the first instruction information includes: the HUD microcontroller receives the first instruction information, parses and extracts the instruction content therein, including information priority, display format and layout, etc.; then, extracts corresponding data from the real-time video stream, identifies key elements (such as speed, navigation instructions, safety warnings, etc.), and then processes and renders the extracted information according to the set format and layout to create a visual HUD screen; finally, the generated HUD screen is displayed in the driver's field of view to ensure the timeliness and readability of the information, thereby helping the driver to drive safely.

[0050] Figure 2 The following is a schematic diagram showing the interaction process between the HUD microcontroller and the vehicle computer main control chip in one embodiment of the present invention when the vehicle computer signal detection result is online. When the signal input is normal, the display scheme adopted by the system is completely based on the information provided by the vehicle computer main control chip, and the current state value is recorded in the HUD microcontroller for subsequent use. Figure 3 The figure shows a schematic diagram of the head-up display (HUD) image in the online state of this embodiment. In this screen, all the presented content comes from the input of the vehicle main control chip, and the HUD system is responsible for displaying real-time data, such as the current location, vehicle speed and other basic information.

[0051] Step S13: In response to the vehicle computer signal detection result being not in an online state, receiving a second instruction message sent by the vehicle computer main control chip, performing a video extraction operation from a local database based on the second instruction message to generate local video information, and performing the HUD screen display operation on the local video information.

[0052] In one embodiment of the present invention, a process of performing a video extraction operation from a local database based on the second instruction information to generate local video information includes: parsing the second instruction to extract offline identification information and pre-offline video; searching for corresponding HUD video identification points from the local database according to the offline identification information; extracting post-offline video from the local database according to the HUD video identification points; and performing a video merging operation on the pre-offline video and the post-offline video to generate local video information.

[0053] In one embodiment of the present invention, the HUD microcontroller receives the second instruction and uses a regular expression (Regex) to parse the instruction content of the second instruction to accurately extract the offline identification information and the identification of the video before offline. Specifically, the HUD microcontroller sets a regular pattern to match the offline identification field and extracts the actual offline identification from the instruction string. Subsequently, the HUD microcontroller uses the B-tree index structure to access the local database, and quickly searches for the HUD video identification point corresponding to the offline identification information through SQL query. In this process, the index structure used effectively shortens the query time and improves the efficiency of data acquisition.

[0054] Furthermore, after successfully acquiring the HUD video identification points, the HUD microcontroller uses dynamic memory management technology to dynamically allocate and release memory by calling Malloc and free functions to ensure efficient memory usage. Specifically, the HUD microcontroller adjusts the extraction buffer size according to the real-time load to cope with different amounts of video data. Subsequently, the HUD microcontroller uses the FFmpeg library to extract the video and calls commands to extract the offline video. Next, the HUD microcontroller uses the H.264 encoding standard and VP9 compression algorithm to merge the pre-offline video with the offline video to optimize the storage space of the video file while maintaining the video smoothness and clarity. Finally, the HUD microcontroller verifies the integrity of the merged video file, uses the MD5 checksum algorithm to ensure its correctness, and then saves the merged video to the specified path for subsequent quick call and display.

[0055] It should be explained that dynamic memory management technology refers to the ability to dynamically allocate and release memory as needed when the program is running, so as to optimize memory usage and improve the efficiency and stability of the program. In the specific implementation, the malloc() function used is used to dynamically allocate a memory block of a specified size, while the free() function is used to release the previously allocated memory block to avoid memory leaks. Next, the HUD microcontroller processes the video data through the FFmpeg library. FFmpeg is an open source multimedia framework that can perform functions such as encoding, decoding, conversion, editing and merging of video and audio. The avformat_open_input() function used is used to open the input media file, and the av_read_frame() function is used to read the media data packet. Subsequently, the HUD microcontroller uses the H.264 encoding standard and the VP9 compression algorithm for video merging. H.264 is an efficient video encoding format that can retain high image quality with a smaller file size, while VP9 is an open source video encoding format developed by Google that can provide better video quality at the same bit rate. Through this series of technologies, the HUD microcontroller achieves efficient video processing.

[0056] Figure 4 The mode of an embodiment of the present invention when the signal is weak or offline is shown. When the vehicle computer signal input fluctuates, the system will provide a display solution through the internal graphics library and command control. At this time, the map and graphics are stored offline, and the user can set the display content, graphic position and color by himself. Figure 5 The diagram shows the customer-defined interface in offline mode. All graphics in the screen are locally called. After the customer-defined interface content is completed, the system will display it according to the command information provided by the vehicle. In offline mode, the map in the red circle can be displayed in full screen to view the current location in case of emergencies.

[0057] In one embodiment of the present invention, the process of the HUD screen display operation includes: performing image processing operations and HUD graphic element overlay operations on the real-time video information or the local video information to generate a HUD merged frame, and rendering the HUD merged frame to the HUD display screen for display.

[0058] Furthermore, the process of performing the HUD screen display operation on the local video information includes: determining the corresponding splicing time point in the local video information according to the HUD video identification point; and performing the HUD screen display operation on the local video information from the splicing time point.

[0059] In this embodiment, the image processing operation includes the following steps: obtaining a real-time video stream from local video information and preprocessing it, including adjusting one or more parameters of brightness, contrast, and color balance to improve video quality. Subsequently, a denoising algorithm is used to remove noise from the image to improve clarity, and important features are identified through feature detection methods such as edge detection. Finally, the processed image frame is output. The image processing operation significantly improves the visibility of the video and ensures that the information in the actual HUD screen is clearer and more readable.

[0060] In this embodiment, the HUD graphic element overlay operation includes: obtaining the required graphic elements from a predefined HUD element library, and laying out the coordinate position of each element to avoid blocking important video content. Subsequently, layer overlay is achieved through Alpha channel processing, and the HUD elements are superimposed on the image-processed video frame. In addition, the content and status of the HUD elements are dynamically updated according to real-time data to adapt to real-time changes. This operation enhances the user experience and enables users to obtain key operation information in real time in the video. Among them, the Alpha channel represents the information channel of the transparency of each pixel in the image, and usually forms an RGBA image format together with the red, green, and blue channels. It is used to control the transparency and blending effects of the image to achieve layer overlay, gradient effects, and various visual effects.

[0061] In this embodiment, the HUD merged frame refers to the final image frame generated after image processing and HUD graphic element superposition. The HUD merged frame integrates the core video information and HUD elements to form a rich display screen. This frame not only contains the processed image data, but also has the ability to update in real time, becoming the output data source required by the HUD display screen. Through this merger, users can obtain video content and important information in the same picture, which improves the accessibility and practicality of information.

[0062] In this embodiment, the rendering process of the HUD merged frame first establishes a rendering context and configures the necessary graphics parameters. Subsequently, the data of the merged frame is uploaded to the graphics processing unit (GPU) through the graphics API, and the drawing instructions are called to render the merged frame to the HUD display. The display is updated at a set frame rate to ensure that the picture is smooth and reflects information in real time. This rendering process realizes the efficient combination of video content and HUD information, minimizes latency, and provides users with accurate and timely information feedback.

[0063] In one embodiment of the present invention, the local database includes one or more of the following information: HUD traffic information, HUD map information, and a graphic element library.

[0064] In this embodiment, the local database includes HUD traffic information, HUD map information, and graphic element library, etc., which are intended to enhance driving experience and safety. Among them, HUD traffic information includes real-time traffic flow, accident information, road closure or construction status, and traffic light status, helping users to quickly obtain road conditions and make reasonable driving decisions. HUD map information provides high-definition map data, dynamic navigation paths, and nearby points of interest (POIs) to ensure that users can obtain the optimal driving route in real time and improve navigation accuracy. The graphic element library contains various instruments, navigation indicator icons, warnings, and prompts, allowing users to intuitively monitor vehicle status and follow navigation prompts. The integration of this information enables the intelligent HUD system to provide users with accurate and smooth driving assistance, significantly improving the safety and efficiency of travel.

[0065] In an embodiment of the present invention, the process of the HUD screen display operation further includes: adjusting one or more information of the display graphic type, graphic layout and graphic color according to user-defined settings.

[0066] In this embodiment, the HUD screen display operation flexibly adjusts one or more information in the display graphic type, graphic layout and graphic color according to the user's personal preferences and needs to achieve a personalized driving experience. Specifically, users can choose different types of display graphics, such as classic dashboards, modern minimalist styles or dynamic 3D visual effects, to adapt to different aesthetic needs and information display habits. At the same time, the adjustment of the graphic layout also provides users with greater flexibility. Users can choose to place important information (such as speed, navigation prompts, etc.) in a more conspicuous position, or rearrange it up and down, left and right according to changes in their own driving perspective to enhance the visibility and readability of the information.

[0067] In addition, custom settings for graphic colors further enhance the personalized experience. Users can adjust the color scheme based on the lighting conditions of the day and their personal visual preferences, such as using higher contrast colors under strong light, or choosing soft dark tones when driving at night to reduce eye fatigue. For the color of warning information, users can also set it according to their preferences to ensure that it attracts enough attention at critical moments. Through these customized options, the HUD microcontroller improves the effectiveness of information communication and enhances the interaction between users and vehicles, making drivers more proactive and comfortable during driving. This personalized adjustment capability ensures that every user can enjoy the best driving experience and fully meet their needs in different situations.

[0068] In one embodiment of the present invention, the process of constructing a local database includes: downloading network data to the local database using an adaptive download strategy. The adaptive download strategy includes: user behavior analysis, network monitoring adjustment, and user download preferences. Specifically, in terms of user behavior analysis, a machine learning algorithm is used based on historical data analysis to record the user's driving history and frequently used routes, and to predict map data and points of interest (POI) that the user may need to download in the future, so as to automatically download relevant information when a network connection is available. Subsequently, in terms of key area priority setting, the HUD microcontroller sets a higher priority for areas that the user frequently visits (such as home and work), thereby ensuring that map data and updates for these key areas can be downloaded first.

[0069] In addition, in terms of network monitoring and dynamic adjustment, the HUD microcontroller monitors the current network in real time to dynamically adjust the download scale and rate to ensure efficient data acquisition when network conditions are good. In terms of download process optimization, data compression technology is used to effectively reduce the size of the download package, and an incremental update mechanism is used to download only the changed information, thereby increasing download speed and saving storage space.

[0070] Furthermore, when the user sets specific download preferences and time windows, in terms of user preference settings, the HUD microcontroller will update data at the time period that the user considers most appropriate based on these settings. In terms of network recovery strategy, when the network connection is interrupted, breakpoint resume technology is implemented to ensure that the download can be resumed from the interruption point, thereby maximizing the integrity of the data.

[0071] It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" represent examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0072] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, ab, ac, bc or abc, where a, b, c can be single or multiple.

[0073] Figure 6 : is a flowchart of the interaction process of the HUD-based offline image display system provided in the embodiment of the present application. Figure 6 As shown, the system vehicle main control chip 601 and the HUD microcontroller 602, the interaction process of the system includes:

[0074] The HUD microcontroller 602 checks the connection status between the vehicle control system and the network to generate a vehicle signal detection result.

[0075] In response to the vehicle computer signal detection result being online, the vehicle computer main control chip 601 sends real-time video information and first instruction information to the HUD microcontroller 602. The HUD microcontroller 602 receives the real-time video information and first instruction information sent by the vehicle computer main control chip 601, and performs HUD screen display operations on the real-time video information according to the first instruction information.

[0076] In response to the vehicle computer signal detection result being not online, the vehicle computer main control chip 601 sends a second instruction message to the HUD microcontroller 602, and the HUD microcontroller 602 receives the second instruction message sent by the vehicle computer main control chip 601. The HUD microcontroller 602 extracts the video from the local database based on the second instruction message to generate local video information, and performs the HUD screen display operation on the local video information.

[0077] In one embodiment of the present invention, the vehicle computer main control chip and the HUD microcontroller jointly perform signal detection to ensure real-time updating and accuracy of information. When the vehicle computer signal detection result is online, the vehicle computer main control chip will send real-time video information and first instruction information to the HUD microcontroller. After receiving this information, the HUD microcontroller performs the HUD screen display operation on the real-time video information according to the first instruction information to ensure that the user can obtain the latest online content in real time. If the vehicle computer signal detection result is not online, the vehicle computer main control chip will send a second instruction information to the HUD microcontroller, indicating that the system has switched to an offline state. After receiving the second instruction information, the HUD microcontroller will extract the corresponding video information from the local database based on the instruction to generate local video information and perform the HUD screen display operation.

[0078] In this embodiment, the coordinated work of the main control chip and the HUD microcontroller not only ensures timely detection of signals, but also provides key information about online and offline status. For example, when the system switches from online to offline, the main control chip will provide offline time point information, and the HUD microcontroller can use this time point to splice the real-time information when online with the local data when offline, and display it on the HUD interface in a timely manner. This ensures that users can obtain a coherent display experience when switching network status, avoiding information interruption, thereby improving the overall user experience and satisfaction.

[0079] Figure 7 The interactive schematic diagram of the HUD-based offline image display system in one embodiment of the present invention is shown. First, the vehicle computer main control chip sends the video input and current status information to the HUD microcontroller so that the video playback, map and intelligent driving information can be prepared and stored in the HUD microcontroller. In normal state, the system executes the online mode; in offline state, that is, when the signal is weak or disappears, the system will call the offline map and other related information according to the current location information for the user to continue to refer to. In addition, in addition to automatically judging the vehicle computer signal, the user can also manually switch between online and offline states through custom settings, so as to flexibly adjust the system's working mode according to actual needs.

[0080] It should be understood that the specific process of each module executing the above corresponding steps has been described in detail in the above method embodiment, and for the sake of brevity, it will not be repeated here.

[0081] It should also be understood that the division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional module in each embodiment of the present application may be integrated into a processor, or may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated modules may be implemented in the form of hardware or in the form of software functional modules.

[0082] Figure 8 is an electronic terminal provided in the embodiment of the present application. Figure 8 As shown, the electronic terminal includes: at least one processor 801, a memory 802, at least one network interface 803 and a user interface 805. The various components in the device are coupled together through a bus system 804. It can be understood that the bus system 804 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 804 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, Figure 8 In the specification, various buses are labeled as bus systems.

[0083] The user interface 805 may include a display, a keyboard, a mouse, a trackball, a click gun, keys, buttons, a touch pad or a touch screen.

[0084] It is understood that the memory 802 can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM). The memory described in the embodiments of the present invention is intended to include but is not limited to these and any other suitable categories of memory.

[0085] The memory 802 in the embodiment of the present invention is used to store various categories of data to support the operation of the electronic terminal 800. Examples of these data include: any executable program for operating on the electronic terminal 800, such as an operating system 8021 and an application 8022; the operating system 8021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application 8022 may include various applications, such as a media player (Media Player), a browser (Browser), etc., for implementing various application services. The offline image display method based on HUD provided in the embodiment of the present invention may be included in the application 8022.

[0086] The method disclosed in the above embodiment of the present invention can be applied to the processor 801, or implemented by the processor 801. The processor 801 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 801 or the instruction in the form of software. The above processor 801 may be a general processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 801 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiment of the present invention. The general processor 801 can be a microprocessor or any conventional processor, etc. In combination with the steps of the accessory optimization method provided in the embodiment of the present invention, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0087] In an exemplary embodiment, the electronic terminal 800 may be implemented by one or more application specific integrated circuits (ASIC), DSP, programmable logic device (PLD), complex programmable logic device (CPLD) to execute the aforementioned method.

[0088] According to the method provided in the embodiments of the present application, the present application also provides a computer program product, which includes: computer program code, when the computer program code is run on a computer, the computer executes the HUD-based offline image display method of any embodiment shown in the above embodiments.

[0089] According to the method provided in the embodiments of the present application, the present application also provides a computer-readable storage medium, which stores a program code. When the program code is run on a computer, the computer executes the HUD-based offline image display method of any one of the embodiments shown above.

[0090] The terms "component", "module", "system", etc. used in this specification are used to represent computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program and / or a computer. By way of illustration, both applications running on a computing device and a computing device can be components. One or more components may reside in a process and / or an execution thread, and a component may be located on a computer and / or distributed between two or more computers. In addition, these components may be executed from various computer-readable media having various data structures stored thereon. Components may, for example, communicate through local and / or remote processes according to signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system and / or a network, such as the Internet interacting with other systems through signals).

[0091] Those of ordinary skill in the art will appreciate that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0092] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0093] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0094] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0095] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0096] In the above embodiments, the functions of each functional unit can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions (programs). When loading and executing computer program instructions (programs) on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (Digital Subscriber Line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server, data center, etc. that contains one or more available media integrated. Available media may be magnetic media (e.g., floppy disks, hard disks, tapes), optical media (e.g., high-density digital video discs (DVDs), or semiconductor media (e.g., solid state disks (SSDs)).

[0097] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program codes.

[0098] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0099] In summary, the present application provides an offline image display method, system, medium, program product and terminal based on HUD, which promotes the migration of personalized settings across vehicle devices by automatically downloading the required data to the local database, ensuring that users can easily use the same configuration in different vehicles. At the same time, it supports flexible switching between online and offline states, greatly reduces dependence on network signals, improves driving safety and user experience, and thus promotes the improvement of vehicle intelligence. It solves the technical problem that users cannot obtain HUD information in offline state, and achieves the technical effect of being able to customize display content in various network environments. Therefore, the present application effectively overcomes the various shortcomings in the prior art and has a high industrial utilization value.

[0100] The above embodiments are merely illustrative of the principles and effects of the present application and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.

Claims

1. A HUD-based offline image display method, characterized in that: The method is applied to a HUD microcontroller, and the method comprises: Check the connection status between the vehicle control system and the network to generate vehicle signal detection results; In response to the vehicle computer signal detection result being in an online state, receiving real-time video information and first instruction information sent by the vehicle computer main control chip, and performing a HUD screen display operation on the real-time video information according to the first instruction information; In response to the vehicle computer signal detection result being not in an online state, second instruction information sent by the vehicle computer main control chip is received, a video extraction operation is performed from a local database based on the second instruction information to generate local video information, and the HUD screen display operation is performed on the local video information.

2. The HUD-based offline image display method according to claim 1, characterized in that: The process of the HUD screen display operation includes: performing image processing operations and HUD graphic element overlay operations on the real-time video information or the local video information to generate a HUD merged frame, and rendering the HUD merged frame to the HUD display screen for display.

3. The HUD-based offline image display method according to claim 2, characterized in that: The process of extracting a video from a local database based on the second instruction information to generate local video information includes: Parsing the second instruction to extract offline identification information and the video before offline; According to the offline identification information, searching the local database for the corresponding HUD video identification point; Extracting offline videos from the local database according to the HUD video identification points; A video merging operation is performed on the pre-offline video and the post-offline video to generate local video information.

4. The HUD-based offline image display method according to claim 3, characterized in that: The process of performing the HUD screen display operation on the local video information includes: Determine the corresponding splicing time point in the local video information according to the HUD video identification point; From the splicing time point onwards, a HUD screen display operation is performed on the local video information.

5. The HUD-based offline image display method according to claim 1, characterized in that: The local database includes one or more of the following information: HUD traffic information, HUD map information, and a graphic element library.

6. The HUD-based offline image display method according to claim 2, characterized in that: The process of the HUD screen display operation also includes: adjusting one or more information of the display graphic type, graphic layout and graphic color according to the user-defined settings.

7. An offline image display system based on HUD, characterized in that: The system includes a vehicle main control chip and a HUD microcontroller, and the interaction process of the system includes: The HUD microcontroller checks the connection status between the vehicle control system and the network to generate a vehicle signal detection result; In response to the vehicle computer signal detection result being in an online state, the vehicle computer main control chip sends real-time video information and first instruction information to the HUD microcontroller, the HUD microcontroller receives the real-time video information and the first instruction information sent by the vehicle computer main control chip, and performs a HUD screen display operation on the real-time video information according to the first instruction information; In response to the vehicle computer signal detection result being not online, the vehicle computer main control chip sends a second instruction message to the HUD microcontroller, the HUD microcontroller receives the second instruction message sent by the vehicle computer main control chip, and the HUD microcontroller extracts the video from the local database based on the second instruction message to generate local video information, and executes the HUD screen display operation on the local video information.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the HUD-based offline image display method according to any one of claims 1 to 6 is implemented.

9. A computer program product, characterized in that The computer program product includes computer program codes, and when the computer program codes are executed on a computer, the computer is enabled to implement the HUD-based offline image display method according to any one of claims 1 to 6.

10. An electronic terminal comprising a memory, a processor and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the HUD-based offline image display method according to any one of claims 1 to 6.

Images