Display control method, device, head-up display system and computer storage medium
By obtaining vehicle driving information and environmental data in the HUD system, filtering and superimposing navigation data and environmental data according to driving status, the problems of low information integration and insufficient navigation accuracy of the HUD system are solved, and more efficient information display and navigation guidance are achieved.
Patent Information
- Application Number
- CN202410860317.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-28
- Publication Date
- 2025-08-01
- Estimated Expiration
- 2044-06-28
AI Technical Summary
The existing HUD systems have low information integration in information display, insufficient navigation accuracy, and cannot effectively combine navigation data with environmental data for overlay display.
By obtaining the vehicle's driving information and environmental data, filtering navigation data and environmental data as target display data based on the driving status, and superimposing it with the real road, realizing intelligent integration and accurate navigation of information.
Improve the information integration and navigation accuracy of HUD display, and drivers can see navigation paths and environmental data more intuitively, reducing the need for distractions, and improving driving safety and experience.
Smart Images

Figure CN118636669B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure relate to the technical field of head-up display, and in particular, to a display control method, apparatus, head-up display system, and computer storage medium. Background Art
[0002] Head-Up Display (HUD) technology is an advanced in-vehicle display system that projects an image interface directly onto the windshield, providing a more intuitive and clear visual effect for the driver. Such a system is usually built into a vehicle, and the projection area position and range on the windshield vary for different models of HUD. Since the automotive windshield is usually curved, it is necessary to adjust a high-precision aspherical mirror according to the specific size and curvature of the windshield to achieve the best display effect.
[0003] With the continuous improvement and iteration of product hardware, current HUD systems are already able to provide a larger display size, thus being able to more comprehensively display relevant important information during driving.
[0004] However, on vehicles equipped with HUD, the display of navigation-related information is crucial. The current HUD display strategy is to display Advanced Driver Assistance Systems (ADAS) information and navigation functions in different modules respectively. This design results in a low degree of information integration during HUD display and insufficient navigation accuracy. Summary of the Invention
[0005] In view of this, embodiments of the present disclosure are expected to provide a display control method, apparatus, head-up display system, and computer storage medium; which can improve the information integration degree and navigation accuracy in HUD display.
[0006] The technical solution of the embodiments of the present disclosure is implemented as follows:
[0007] In a first aspect, embodiments of the present disclosure provide a display control method, including:
[0008] Obtain the driving information and environmental data of the vehicle;
[0009] According to the driving information, use at least one of the navigation data and the environmental data as target display data, and superimpose and display the driving information, the target display data, and the real road.
[0010] In some examples, the step of using at least one of the navigation data and the environmental data as target display data according to the driving information includes:
[0011] Filter out the data to be displayed from the navigation data according to the driving information;
[0012] According to the driving information, use at least one of the data to be displayed and the environmental data as the target display data.
[0013] In some examples, the filtering out of the data to be displayed from the navigation data according to the driving information includes:
[0014] Determine the driving state of the vehicle according to the driving information and the navigation data, where the driving state includes a first driving state and a second driving state, and the vehicle speed in the second driving state is greater than or equal to the vehicle speed in the first driving state;
[0015] When the vehicle is in the first driving state, use the road navigation data within the first preset range of the vehicle in the navigation data as the data to be displayed;
[0016] When the vehicle is in the second driving state, use the road navigation data within the second preset range of the vehicle in the navigation data as the data to be displayed;
[0017] Wherein, the second preset range is greater than the first preset range.
[0018] In some examples, determining the driving state of the vehicle according to the driving information and the navigation data includes:
[0019] Determine the road type where the vehicle is located according to the navigation data;
[0020] Determine the driving state of the vehicle according to the road type and the driving information.
[0021] In some examples, determining the driving state of the vehicle according to the road type and the driving information includes:
[0022] When the vehicle speed in the driving information is less than the first preset value and the road type is the first road type, determine the driving state as the first driving state; otherwise,
[0023] Determine the driving state as the second driving state.
[0024] In some examples, the using of at least one of the navigation data and the environmental data as the target display data according to the driving information includes:
[0025] When the driving state is the first driving state, use the data to be displayed and the environmental data as the target display data;
[0026] When the driving state is the second driving state, use the data to be displayed as the target display data.
[0027] In some examples, the method further includes:
[0028] When the navigation data is empty, the environment data is used as the target display data.
[0029] In some examples, the method further includes:
[0030] receiving a display switching instruction, and displaying the target display data corresponding to the second driving state superimposed on the real road in the first driving state; or
[0031] In the second driving state, the target display data corresponding to the first driving state is superimposed and displayed on the real road.
[0032] In some examples, determining the driving state of the vehicle based on the driving information and the navigation data includes:
[0033] When a preset function in the driving information is turned on, determining that the driving state is a first driving state;
[0034] The preset functions include one or more of turn signals, emergency braking and driving assistance functions.
[0035] In a second aspect, an embodiment of the present disclosure provides a display control device, comprising:
[0036] Acquisition module, which obtains the vehicle's driving information and environmental data;
[0037] The display module uses at least one of the navigation data and the environmental data as target display data according to the driving information, and displays the driving information, the target display data and the real road in a superimposed manner.
[0038] In a third aspect, an embodiment of the present disclosure provides a display control device, comprising: a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the display control method described in the first aspect.
[0039] In a fourth aspect, an embodiment of the present disclosure provides a computer storage medium, wherein the storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the display control method as described in the first aspect.
[0040] In a fifth aspect, an embodiment of the present disclosure provides a head-up display device, the head-up display device including a display control unit and a display unit;
[0041] Wherein, the display control unit is configured to obtain driving information and environmental data of the vehicle;
[0042] According to the driving information, use at least one of the navigation data and the environmental data as target display data, and superimpose and display the driving information, the target display data and the real road;
[0043] The display unit is configured to project the driving information and the target display data onto the windshield for display.
[0044] The embodiments of the present disclosure provide a display control method, a device, a head-up display system and a computer storage medium; on the one hand, according to the driving information, using at least one of the navigation data and the environmental data as target display data can determine the display image of the HUD according to the vehicle driving state, increasing the diversity of HUD display. On the second hand, superimposing and displaying the driving information, the target display data and the real road can provide more accurate navigation guidance. When the environmental data is superimposed and displayed, the driver can have a clearer understanding of the surrounding environment and make faster and more accurate responses in complex or dangerous situations. On the third hand, by superimposing the target display data on the real road, the driver can more intuitively see the navigation path and the environmental data, reducing the need to distract attention to view other display devices during driving. Description of the Drawings
[0045] Figure 1 It is a schematic diagram of the composition of a vehicle-mounted system provided by an embodiment of the present disclosure.
[0046] Figure 2 It is an exemplary top view of a vehicle provided by the present disclosure.
[0047] Figure 3 It is an exemplary perspective view from the driver's seat of a vehicle provided by the present disclosure.
[0048] Figure 4 It is a schematic diagram of the architecture of a head-up display device provided by the present disclosure.
[0049] Figure 5 It is a flowchart of a display control method provided by an embodiment of the present disclosure.
[0050] Figure 6 It is a schematic diagram of vehicle driving information provided by an embodiment of the present disclosure.
[0051] Figure 7 It is a schematic diagram of the first navigation data provided by an embodiment of the present disclosure.
[0052] Figure 8 It is a comparison schematic diagram of a first preset range and a second preset range provided by an embodiment of the present disclosure.
[0053] Figure 9Schematic diagram of road navigation data within a first preset range provided by an embodiment of the present disclosure.
[0054] Figure 10 Schematic diagram of road navigation data within a second preset range provided by an embodiment of the present disclosure.
[0055] Figure 11 Schematic diagram of a second type of navigation data provided by an embodiment of the present disclosure.
[0056] Figure 12 Schematic diagram of an environmental data provided by an embodiment of the present disclosure.
[0057] Figure 13 Schematic diagram of a third type of navigation data provided by an embodiment of the present disclosure.
[0058] Figure 14 Schematic diagram of another display control method provided by an embodiment of the present disclosure.
[0059] Figure 15 Schematic diagram of the structure of a display control device provided by an embodiment of the present disclosure.
[0060] Figure 16 Schematic diagram of the structure of a display control device provided by an embodiment of the present disclosure.
[0061] Through the above-mentioned drawings, specific embodiments of the present disclosure have been shown, and there will be more detailed descriptions hereinafter. These drawings and textual descriptions are not intended to limit the scope of the concept of the present disclosure in any way, but to illustrate the concept of the present disclosure to those skilled in the art by referring to specific embodiments. Detailed Description of the Specific Embodiments
[0062] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0063] As Figure 1 shown, the vehicle-mounted system 100 includes: a navigation subsystem 110, an environmental detection device group 120 for obtaining the environment where the vehicle is located during vehicle travel, a vehicle travel state detection device group 130, a data processing unit 140, a display control unit 150, and a display unit 160. The above-mentioned components or device groups are coupled together through a communication bus 12. In some examples, the communication bus 12 is used for connection communication between the above-mentioned components or device groups. It should be noted that Figure 1Only a part of the vehicle system 100 is shown, rather than all of the components of the vehicle system 100.
[0064] In Figure 1 the navigation subsystem 110 includes: a positioning device 111 and a map information storage device 112. Among them, the positioning device 111 can locate the position of the vehicle based on positioning systems such as the global positioning system (GPS), China's Beidou system, Russia's GLONASS system, Europe's Galileo system, Japan's Quasi-Zenith Satellite System (QZSS), India's Indian Regional Navigation Satellite System (IRNSS), etc., and obtain the position information of the vehicle. The map information storage device 112 stores map information, can obtain a navigation path to the destination according to the position information obtained from the positioning device 111, and display the position information and the navigation path in a map application.
[0065] In Figure 1 the environmental detection device group 120 may include a vehicle-mounted communication device 121, a radar 122, a laser rangefinder 123, and a camera 124. These devices can obtain environmental data representing the surrounding environmental conditions of the vehicle.
[0066] The vehicle-mounted communication device 121 can communicate wirelessly with one or more devices directly or via a communication network. These devices that can communicate with the vehicle-mounted communication device 121 can be other vehicles, roadside machines or roadside platforms, or mobile terminal devices used by the vehicle occupants. In some examples, the vehicle-mounted communication device 121 can use 3G cellular communication, such as code division multiple access (CDMA), EVDO, global system for mobile communications (GSM) / general packet radio service (GPRS), or 4G cellular communication, such as long term evolution (LTE), or 5G cellular communication. In some examples, the vehicle-mounted communication device 121 can also communicate with a wireless local area network (WLAN) using WiFi. In some embodiments, the vehicle-mounted communication device 121 can also communicate directly with devices using an infrared link, Bluetooth, or ZigBee. In some examples, the vehicle-mounted communication device 121 can also communicate with devices using other wireless protocols.
[0067] The radar 122 is used to sense objects in the surrounding environment of the vehicle, and can also be used to sense the speed and / or forward direction of these objects. In some examples, the radar 122 can use electromagnetic waves or lasers as the medium, and detect objects based on the time-of-flight (TOF) method or the phase-shift method, and detect the position of the detected object, the distance to the detected object, and the relative speed. In some examples, in order to be able to detect objects located in front of, behind, or on the side of the vehicle, the radar 122 can be configured at an appropriate position outside the vehicle.
[0068] The laser rangefinder 123 can use laser to sense objects in the environment where the vehicle is located. In some embodiments, the laser rangefinder 123 can include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components.
[0069] The camera 124 can be used to capture multiple images of the surrounding environment of the vehicle. The camera 124 can be a static camera or a video camera. In some examples, in order to obtain an external image of the vehicle, the camera 124 can be located at an appropriate position outside the vehicle. For example, in order to obtain an image in front of the vehicle, the camera 124 can be configured close to the front windshield inside the vehicle. Alternatively, the camera 124 can be configured around the front bumper or radiator grille. In some examples, in order to obtain an image behind the vehicle, the camera 124 can be configured close to the rear window glass inside the vehicle. Alternatively, the camera 124 can be configured around the rear bumper, trunk, or tailgate. In some examples, in order to obtain an image on the side of the vehicle, the camera 124 can be configured close to at least one of the side windows inside the vehicle. Alternatively, the camera 124 can be configured around the side mirror, fender, or door.
[0070] In Figure 1 the vehicle driving state detection device group 130 may include: a steering angle sensor 131 for detecting the steering angle of the vehicle, a vehicle speed sensor 132 for detecting the driving speed of the vehicle, and an acceleration sensor 133 for detecting the acceleration applied to the vehicle. In some examples, as shown by the dashed box, an inertial sensor 134 for detecting changes in the position and orientation of the vehicle based on inertial acceleration may also be included, and the inertial sensor 134 can be a combination of the acceleration sensor 133 and a gyroscope in the specific implementation process.
[0071] In Figure 1In [the above], the data processing unit 140 can be implemented as a computing system including a memory, a processor, an input / output interface, and a bus connecting these components. In some examples, the data processing unit 140 causes the processor to execute multiple commands through program instructions stored in the memory to process the data obtained by the navigation subsystem 110, the environmental detection device group 120, and the vehicle driving state detection device group 130. In some examples, the data processing unit 140 can also control the driving of the vehicle partially or entirely based on the processed data.
[0072] In Figure 1 [the above], as shown by the dashed box, the data processing unit 140, the display control unit 150, and the display unit 160 can be the main body of a Head Up Display (HUD) device 170. The display control unit 150 can process the received data to obtain display information to be displayed after receiving the data processed by the data processing unit 140, or after receiving the data obtained by the navigation subsystem 110, the environmental detection device group 120, and the vehicle driving state detection device group 130, and project the display information onto the windshield of the vehicle through the display unit 160 for display.
[0073] The Head Up Display (HUD) device projects the light of the display image output by the image source onto an imaging window (such as an imaging plate, windshield, etc.) through, for example, a reflective optical design to display vehicle status information such as vehicle speed and fuel level, as well as indication information such as navigation and danger warnings at an appropriate position in front of the driver. Thus, the driver can obtain relevant information such as vehicle speed and fuel level without deviating the line of sight from the road surface ahead, thereby improving the driving safety factor and driving experience.
[0074] Specifically, referring to Figure 2 and Figure 3 , the head-up display device can be installed on a vehicle, which includes a windshield 204 located at the front of the vehicle. The driver and passengers in the vehicle cabin 208 can see the front of the vehicle through the windshield 204.
[0075] In Figure 3 [the above], the windshield 204 is visually located above the vehicle instrument panel 206. The driver can turn the steering wheel 210 in the cabin 208 to steer the vehicle, such as changing lanes, merging, and parking the vehicle. In some embodiments, the steering wheel 210 can be retracted or omitted.
[0076] Referring to Figure 3 , the head-up display device 170 (see Figure 4)The display information 212 (e.g., virtual image) is projected onto a portion of the windshield 204 through one or more holes (e.g., hole 216) in the dashboard 206. Although Figure 4 an example size of the display information 212 is shown, the display information 212 can be presented over a larger or smaller area. Examples of the display information 212 include various vehicle information, such as the current vehicle speed, the current gear of the vehicle transmission, the engine speed, the direction of the vehicle, the current infotainment system settings, and / or other vehicle information. The head-up display device 170 provides information to the vehicle driver without the driver having to move their line of sight away from an object in front of the vehicle.
[0077] See Figure 4 the exemplary implementation architecture of the head-up display device 170 shown. Based on the data processed by the data processing unit 40, or the data 420 transmitted by the navigation subsystem 110, the environmental detection device group 20, and the vehicle driving state detection device group 30, the display control unit 150 generates a signal 42. The communication control circuit is disposed in the data processing unit 40 and transmits the display information to the display control unit 150.
[0078] Optionally, the display control unit 150 can obtain the driving information and environmental data of the vehicle from the in-vehicle computer. The current driving information can be obtained from the in-vehicle computer or a terminal connected to the in-vehicle computer. Then, based on the driving information, at least one of the navigation data and the environmental data is used as the target display data, and the target display data and the driving information are sent to the display unit together, and the display unit projects them onto the windshield for display.
[0079] The display unit 160 can include: a light source 161 and an optical path component 162. The light source 161 outputs light (e.g., virtual image) based on the signal 42 from the display control unit 150 for display on the windshield 204. For example, the light source 161 can include one or more lasers and output red, green, and blue light.
[0080] The display unit 160 is configured to receive the target display data and the driving information sent by the display control unit and project them onto the windshield.
[0081] The optical path component 162 can reflect the output of the light source 161 to the windshield 204 through the hole 216. A viewer (e.g., a driver) can view the display information 212 in the display area where the display information 212 is projected onto the windshield 204. In some examples, the optical path component 162 can include one or more mirrors (plane mirrors) and concave mirrors (magnifying glasses). The output of the light source 161 is folded back via the mirror and magnified by the concave mirror and then reflected to the windshield 204 to form a virtual image 40 that can be visually observed by the driver. The visual effect presented by the virtual image 40 is that the virtual image 40 is projected onto a projection plane 41 at a set distance in front of the vehicle, but passes through the projection plane 41 and the real environment remains visible. In some examples, the optical path component 162 can also be omitted, and the light source 161 can directly project the display information 212 onto the windshield 204 to form the virtual image 40 on the projection plane 41.
[0082] In the display control method in the related art, in a navigation scenario, the display control unit 150 directly projects the navigation data of the in-vehicle system or the terminal onto the windshield through the display unit 160. After receiving the navigation data, the display control unit 150 does not perform processing for calculation and directly projects it, and cannot superimpose the lanes in the navigation data on the real road for display, so the advantages of the HUD cannot be exerted. Further, when the existing display control unit 150 projects an image, it does not consider the environmental data transmitted by the driving assistance system in the vehicle and the driving information of the vehicle, resulting in poor navigation accuracy, and the user cannot directly obtain the environmental data transmitted by the driving assistance system of the vehicle on the HUD.
[0083] Based on this, the present disclosure first provides a display control method. Figure 5 The flowchart of the display control method is shown, which can be applied to the above-mentioned display control unit 150. Among them, the above-mentioned display control method can include step S510 to step S520.
[0084] In step S510, the driving information and environmental data of the vehicle are acquired.
[0085] In some example embodiments of the present disclosure, the display control unit can acquire the driving information and environmental data of the vehicle. Among them, referring to Figure 6 , the above-mentioned driving information includes vehicle speed, vehicle status, etc. The vehicle status can include whether the turn signal is turned on, whether the windshield wiper is turned on, whether the anti-lock braking system is turned on, whether the cruise control is turned on, etc. The specific content of the driving information can also be customized according to user needs and is not specifically limited in this example embodiment.
[0086] The environmental data can be captured by the vehicle's radar and detected and imaged by the driving assistance system. Specifically, the driving assistance system can perform road scene detection, understanding of the current road scene, traffic participant detection and classification, tracking and motion prediction, intention understanding, and risk assessment, etc., and use the results after execution as the above-mentioned environmental data. Specifically, road scene monitoring can include detecting road markings, traffic lights, traffic signs, etc. Understanding the current road scene, traffic participant detection and classification can include detecting pedestrians, bicycles, other vehicles, and classifying and identifying them. Tracking and motion prediction can include tracking the movement of traffic participants, analyzing the movement trend, and predicting the future state. Intention understanding can include judging the intentions and future actions of other traffic participants, such as turning, changing lanes, parking, etc. Risk assessment can include assessing potential traffic risks in the current scene, such as rear-end collisions, sudden braking, etc. Map positioning can include aligning sensor data with a high-precision map to accurately determine the position of the vehicle and the surrounding environment.
[0087] The display control unit can send an information acquisition instruction to the in-vehicle computer or a terminal communicatively connected to the in-vehicle computer to acquire the above-mentioned driving information and environmental data.
[0088] In step S520, according to the driving information, at least one of the navigation data and the environmental data is used as the target display data, and the driving information, the target display data, and the real road are superimposed and displayed.
[0089] In an exemplary embodiment of the present disclosure, the display control unit can first acquire navigation data. The navigation data can be acquired from the in-vehicle computer or a mobile terminal communicatively connected to the in-vehicle computer. The specific acquisition method is not specifically limited in this exemplary embodiment.
[0090] Among them, referring to Figure 7 , the above-mentioned navigation data can include the current position, departure position, target position of the vehicle, and road information between the departure position and the target position. And the navigation data includes road information captured by virtual cameras at different distances from the vehicle.
[0091] After obtaining the above-mentioned driving information, at least one of the environmental data and the navigation data can be used as the target display data based on the above-mentioned driving information. At least one of the environmental data and the navigation data can be used as the target display data based on the vehicle speed information in the driving information. Then, the above-mentioned target display data is superimposed and displayed with the real road.
[0092] In some examples, when the above-mentioned navigation data is empty, that is, when the vehicle does not turn on the navigation, the environmental data can be superimposed and displayed with the real road. When the navigation data is not empty, that is, after the user turns on the navigation data, the target display data can be determined according to the driving information.
[0093] The display control method provided by the embodiments of the present disclosure, on the one hand, takes at least one of the navigation data and the environmental data as the target display data according to the driving information, and can determine the display image of the HUD according to the vehicle driving state, increasing the diversity of HUD displays. On the second hand, the driving information, the target display data and the real road are superimposed and displayed, which can provide more accurate navigation guidance. When the environmental data is superimposed and displayed, the driver can have a clearer understanding of the surrounding environment and make faster and more accurate responses in complex or dangerous situations. On the third hand, by superimposing the target display data on the real road, the driver can more intuitively see the navigation path and environmental data, reducing the need to distract attention to view other display devices during driving.
[0094] In some exemplary embodiments, when acquiring the target display data, the display control unit 150 may first screen out the data to be displayed from the navigation data according to the driving information.
[0095] Specifically, the display control unit 150 may first determine the driving state of the vehicle according to the driving information and the navigation data. Among them, the driving state may include a first driving state and a second driving state. When acquiring the driving state, the road type where the vehicle is located may be first determined from the navigation data. The road type may include a first road type and a second road type. Among them, the first road type may be an urban road, and the second road type may be a non-urban road. Among them, the non-urban road may include highways, national roads, county roads, rural roads, etc., which will not be elaborated in this exemplary embodiment.
[0096] After obtaining the above road type, the driving state of the vehicle may be determined according to the road type and the driving information. Specifically, when the vehicle speed in the driving information is less than the first preset value and the road type is the first type of road, the driving state is determined as the first driving state; otherwise, the driving state is determined as the second driving state.
[0097] When the above driving state is the first driving state, the data to be displayed and the environmental data may be used as the target display data. When the driving state is the second driving state, the data to be displayed may be used as the above target display data.
[0098] Among them, the above first preset value may be 40 KM / h or 45 KM / h. The specific value may be customized according to user needs, or the specific value of the first preset value may be adjusted by receiving the adjustment operation of the user. Specifically, the user may adjust the first preset value through the in-vehicle system, and the in-vehicle system updates the adjusted first preset value to the display control unit 150.
[0099] In some examples, when obtaining the above-mentioned data to be displayed, when the driving state of the vehicle is the first driving state, that is, the vehicle speed is less than the first preset value, and when the vehicle is on an urban road where the traffic flow is usually large, in the urban road, the display control unit can determine that the current traffic flow is large and the vehicle speed is less than the first preset value, and the clarity of the environmental data obtained through the driving assistance system is relatively high. The data to be displayed and the environmental data are used as the above-mentioned target display data.
[0100] Since it is necessary to superimpose the navigation data on the real road, at this time, the road navigation data within the first preset range of the vehicle can be obtained from the navigation data as the data to be displayed.
[0101] When the driving state of the vehicle is the second driving state, that is, when the vehicle speed is greater than or equal to the first preset value, the road navigation data within the second preset range of the vehicle can be obtained from the navigation data as the data to be displayed, where the second preset range is greater than the above-mentioned first preset range.
[0102] Specifically, referring to Figure 8 As shown, the specific values of the first preset range 81 and the second preset range 82 can be customized based on user needs. Specifically, the first preset range 81 can be the range of all drivable lanes within the distance of the vehicle's traveling direction D1. This is not elaborated in this exemplary embodiment. The second preset range 82 can include the range within the distance of the vehicle's traveling direction D2, including the drivable lanes in the traveling direction and the oncoming lanes. The specific range setting can change based on the user's adjustment operation and is not elaborated in this example. Among them, D2 is greater than D1. D1 can be, for example, 500 meters, 750 meters, etc., and D2 can be 1000 meters, 1500 meters, etc. These distances are not elaborated in this exemplary embodiment.
[0103] It should be noted that compared with the first preset range 81, for the vehicle driver, the farthest road displayed in the second preset range 82 is farther from the vehicle driver and can be used as far-view navigation data, while the farthest road displayed in the first preset range 81 is closer to the vehicle driver and can be used as near-view navigation data. It can be understood that when switching from the first driving state to the second driving state, for the driver, it is a switch from near-view navigation data to far-view navigation data.
[0104] Specifically, referring to Figure 9 , the road navigation data within the first preset range is displayed in the first driving state. Referring to Figure 10 , the road navigation data within the second preset range is displayed in the second driving state.
[0105] In some examples, when determining the above driving state, when the user turns on the turn signal, brakes suddenly, and turns on the assisted driving function, it can be directly determined that the vehicle is in the first driving state.
[0106] In some examples, the display control unit 150 can receive a display switching instruction from the user and adjust the currently displayed content. That is, it can display the target display data corresponding to the second driving state when in the first driving state, or display the target display data corresponding to the first driving state when in the second driving state. The display switching instruction can be sent by the user through the vehicle computer, or can be directly sent to the display control unit by the user through voice control, or body control, etc., which will not be elaborated in this example.
[0107] In some examples, referring to Figure 11 , the navigation data can also include speed limit signs, turn signal lights, etc. The navigation data can also display the congestion situation of the road ahead. Specifically, different congestion situations of the road are represented by different colors. It is also possible to analyze the congestion status of each lane, obtain the congestion reasons, and predict the congestion time and distance.
[0108] In some examples, referring to Figure 12 , the environmental data can be obtained by the assisted driving system. For example, the assisted driving system can detect the distance between the vehicle and the vehicle in front or other obstacles. When the distance is less than the preset distance, the assisted driving system will generate an alarm signal and send it to the display control unit, and the display control unit will project the alarm information onto the windshield through the display unit.
[0109] In some examples, referring to Figure 13 , when the vehicle is driving on a mountain road, the navigation data can also include the vehicle information in the user's blind spot.
[0110] Next, referring to Figure 14 the above display control method will be described, which can include steps S1410 to S1470.
[0111] In step S1410, driving information and environmental data are obtained.
[0112] In step S1420, it is determined whether navigation is turned on; if not, step S1430 is executed, and if so, step S1440 is executed.
[0113] In step S1430, the environmental data is used as the target display data.
[0114] In step S1440, it is determined whether the driving state of the vehicle is the first driving state according to the driving information and the navigation data; if so, step S1450 is executed, and if not, step S1460 is executed.
[0115] In step S1450, the road navigation data within the first preset range of the vehicle is used as the data to be displayed, and the data to be displayed and the environmental data are used as the target display data.
[0116] In step S1460, the road navigation data within the second preset range of the vehicle is used as the data to be displayed, and the data to be displayed is used as the target display data.
[0117] In step S1470, the driving information, the target display data, and the real road are superimposed and displayed.
[0118] It should be noted that each step from step S1410 to step S1470 has been described in detail above, so it will not be elaborated here.
[0119] On the one hand, for the display control method provided by the embodiments of the present disclosure, according to the driving information, at least one of the navigation data and the environmental data is used as the target display data, and the display image of the HUD can be determined according to the vehicle driving state, increasing the diversity of the HUD display. On the second hand, superimposing and displaying the driving information, the target display data, and the real road can provide more accurate navigation guidance. When the environmental data is superimposed and displayed, the driver can have a clearer understanding of the surrounding environment and make faster and more accurate responses in complex or dangerous situations. On the third hand, by superimposing the target display data on the real road, the driver can more intuitively see the navigation path and environmental data, reducing the need to distract attention to view other display devices during driving. Further, under low-speed or urban road conditions, the navigation data and the environmental data are simultaneously displayed to help the driver better understand the surrounding environment and prevent potential dangers. Under high-speed driving conditions, the navigation data is preferentially displayed to reduce the interference of the environmental data, enabling the driver to focus more on road navigation. When the navigation data is unavailable, the system can automatically switch to the display of the environmental data to ensure that the display content is always relevant and useful. Intelligent selection of display data according to the vehicle's driving state and road type improves the adaptability and flexibility of the display content. By intelligently filtering and displaying the most relevant information, the cognitive load of the driver when processing a large amount of information is reduced. By providing display content that matches the driving state, the user experience and satisfaction of the driver are improved.
[0120] Further, the present disclosure also provides a display control device. Referring to Figure 15 As shown, the display control device 1500 may include an acquisition module 1510 and a display module 1520. Among them:
[0121] The acquisition module 1510 may be used to acquire the driving information and environmental data of the vehicle;
[0122] The display module 1520 can be used to take at least one of the navigation data and the environmental data as target display data according to the driving information, and superimpose and display the driving information, the target display data, and the real road.
[0123] In some examples, the display module 1520 can also be used to filter out the data to be displayed in the navigation data according to the driving information; and take at least one of the data to be displayed and the environmental data as the target display data according to the driving information.
[0124] In some examples, the display module 1520 can also be used to determine the driving state of the vehicle according to the driving information and the navigation data. The driving state includes a first driving state and a second driving state, and the vehicle speed in the second driving state is greater than or equal to the vehicle speed in the first driving state. When the vehicle is in the first driving state, the road navigation data within the first preset range of the vehicle in the navigation data is taken as the data to be displayed. When the vehicle is in the second driving state, the road navigation data within the second preset range of the vehicle in the navigation data is taken as the data to be displayed. Wherein, the second preset range is greater than the first preset range.
[0125] In some examples, the display module 1520 can also be used to determine the road type where the vehicle is located according to the navigation data; and determine the driving state of the vehicle according to the road type and the driving information.
[0126] In some examples, the display module 1520 can also be used to determine the driving state as the first driving state when the vehicle speed in the driving information is less than the first preset value and the road type is the first type of road; otherwise, determine the driving state as the second driving state.
[0127] In some examples, the display module 1520 can also be used to take the data to be displayed and the environmental data as the target display data when the driving state is the first driving state; and take the data to be displayed as the target display data when the driving state is the second driving state.
[0128] In some examples, the display control device 1500 can also be used to receive a display switching instruction, and in the first driving state, superimpose and display the target display data corresponding to the second driving state and the real road; or in the second driving state, superimpose and display the target display data corresponding to the first driving state and the real road.
[0129] In some examples, the display module 1520 can also be used to determine that the driving state is the first driving state when a preset function in the driving information is turned on. Wherein, the preset function includes one or more of a turn signal, an emergency brake, and a driving assistance function.
[0130] It should be understood that the above-described device embodiments are merely illustrative, and the devices of the present disclosure may also be implemented in other ways. For example, the division of units / modules in the above-described embodiments is merely a logical functional division, and actual implementations may employ other division methods. For example, multiple units, modules, or components may be combined or integrated into another system, or some features may be omitted or not implemented.
[0131] In addition, unless otherwise specified, the functional units / modules in the various embodiments of the present disclosure may be integrated into a single unit / module, each unit / module may exist physically separately, or two or more units / modules may be integrated together. The aforementioned integrated units / modules may be implemented in the form of hardware or software program modules.
[0132] If the integrated unit / module is implemented in hardware, the hardware may be digital circuits, analog circuits, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor may be any appropriate hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC. Unless otherwise specified, the storage unit may be any appropriate magnetic storage medium or magneto-optical storage medium, such as resistive random access memory (RRAM), dynamic random access memory (DRAM), static random access memory (SRAM), enhanced dynamic random access memory (EDRAM), high-bandwidth memory (HBM), hybrid memory cube (HMC), etc.
[0133] When the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present disclosure, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in various embodiments of the present disclosure. The aforementioned memory includes various media that can store program codes, such as USB flash drives, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), mobile hard disks, magnetic disks, or optical discs.
[0134] Please refer to Figure 16 , which shows a block diagram of the structure of a display control device provided by an exemplary embodiment of the present disclosure. In some examples, the display control device can be at least one of devices such as smart phones, smart watches, desktop computers, laptop computers, virtual reality terminals, augmented reality terminals, wireless terminals, and laptop portable computers. The display control device has a communication function and can access a wired network or a wireless network. The display control device can generally refer to one of multiple terminals. Those skilled in the art can know that the number of the above terminals can be more or less. It can be understood that the display control device undertakes the computing and processing work of the technical solution of the present disclosure. The embodiments of the present disclosure do not limit this.
[0135] As Figure 16 shown, the display control device 1600 may include: at least one processor 1610, a memory 1620, and a communication interface 1630.
[0136] The memory 1620 is used to store programs. Specifically, the program may include program codes, and the program codes include computer operation instructions.
[0137] The memory 1620 may contain a high-speed RAM memory and may also include a non-volatile memory, such as at least one disk memory.
[0138] The processor 1610 is configured to execute computer-executable instructions stored in the memory 1620 to implement the display control method described in the foregoing method embodiments. The processor 1610 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present disclosure.
[0139] The display control device 1600 may further include a communication interface 1630 through which communication interaction can be performed with an external device. In a specific implementation, if the communication interface 1630, the memory 1620, and the processor 1610 are independently implemented, the communication interface 1630, the memory 1620, and the processor 1610 may be interconnected through a bus and communicate with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.
[0140] Optionally, in a specific implementation, if the communication interface 1630, the memory 1620, and the processor 1610 are integrated on a single chip, the communication interface 1630, the memory 1620, and the processor 1610 may communicate through an internal interface.
[0141] The present disclosure also provides a computer-readable storage medium, which may include various media capable of storing program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disc. Specifically, the computer-readable storage medium stores program instructions for the display control method in the foregoing embodiments.
[0142] The embodiments of the present disclosure also provide a computer program product, which includes computer instructions stored in a computer-readable storage medium; the processor of the display control device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to enable the display control device to implement the display control method in the foregoing embodiments.
[0143] Those skilled in the art should be able to realize that in one or more of the above examples, the functions described in the embodiments of the present disclosure can be implemented by hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. The computer-readable medium includes computer storage media and communication media, where the communication media includes any medium that facilitates the transmission of a computer program from one place to another. The storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.
[0144] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as within the scope described in this specification.
[0145] After considering the specification and practicing the invention claimed herein, those skilled in the art will readily conceive of other embodiments of the present disclosure. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common general knowledge or conventional technical means in the technical field not claimed in the present disclosure.
[0146] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.
Claims
1. A display control method, characterized in that, Including: Obtain the driving information and environmental data of the vehicle; According to the driving information, use at least one of the navigation data and the environmental data as the target display data, and superimpose and display the driving information, the target display data and the real road; Among them, using at least one of the navigation data and the environmental data as the target display data includes: Determine the driving state of the vehicle according to the driving information and the navigation data, and filter out the data to be displayed from the navigation data according to the driving state; According to the driving information, use at least one of the data to be displayed and the environmental data as the target display data; Among them, the driving state includes a first driving state and a second driving state, and the vehicle speed in the second driving state is greater than or equal to the vehicle speed in the first driving state; According to the driving information, using at least one of the data to be displayed and the environmental data as the target display data includes: When the driving state is the first driving state, use the data to be displayed and the environmental data as the target display data; When the driving state is the second driving state, use the data to be displayed as the target display data; Among them, filtering out the data to be displayed from the navigation data according to the driving state includes: When the vehicle is in the first driving state, use the road navigation data within the first preset range of the vehicle in the navigation data as the data to be displayed; When the vehicle is in the second driving state, use the road navigation data within the second preset range of the vehicle in the navigation data as the data to be displayed; Among them, the second preset range is greater than the first preset range.
2. The method according to claim 1, wherein Determining the driving state of the vehicle according to the driving information and the navigation data includes: Determine the road type where the vehicle is located according to the navigation data; Determine the driving state of the vehicle according to the road type and the driving information.
3. The method according to claim 2, wherein Determining the driving state of the vehicle according to the road type and the driving information includes: When the vehicle speed in the driving information is less than the first preset value and the road type is the first road type, determine the driving state as the first driving state; otherwise, Determine the driving state as the second driving state.
4. The method according to claim 1, characterized in that, The method further includes: Receive a display switching instruction, and in the first driving state, superimpose and display the target display data corresponding to the second driving state on the real road; or In the second driving state, superimpose and display the target display data corresponding to the first driving state on the real road.
5. The method according to claim 1, characterized in that, Determining the driving state of the vehicle according to the driving information and the navigation data includes: When the preset function in the driving information is turned on, determine that the driving state is the first driving state; Among them, the preset function includes one or more of a turn signal, an emergency brake, and a driving assistance function.
6. A display control device, characterized in that, Including: An acquisition module that acquires the driving information and environmental data of the vehicle; A display module that, according to the driving information, uses at least one of the navigation data and the environmental data as the target display data, and superimposes and displays the driving information, the target display data and the real road; Among them, the display module further includes: Determine the driving state of the vehicle based on the driving information and the navigation data, and filter out the data to be displayed from the navigation data according to the driving state; Based on the driving information, use at least one of the data to be displayed and the environmental data as the target display data; Wherein, the driving state includes a first driving state and a second driving state, and the vehicle speed in the second driving state is greater than or equal to the vehicle speed in the first driving state; The step of using at least one of the data to be displayed and the environmental data as the target display data according to the driving information includes: When the driving state is the first driving state, use the data to be displayed and the environmental data as the target display data; When the driving state is the second driving state, use the data to be displayed as the target display data; Wherein, the step of filtering out the data to be displayed from the navigation data according to the driving state includes: When the vehicle is in the first driving state, use the road navigation data within the first preset range of the vehicle in the navigation data as the data to be displayed; When the vehicle is in the second driving state, use the road navigation data within the second preset range of the vehicle in the navigation data as the data to be displayed; Wherein, the second preset range is greater than the first preset range.
7. A display control device, characterized in that, The display control device includes: a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the display control method according to any one of claims 1 to 5.
8. A computer storage medium, characterized in that, The storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the display control method according to any one of claims 1 to 5.
9. A head-up display device, characterized in that, The head-up display device includes a display control unit and a display unit; Wherein, the display control unit is configured to obtain the driving information and environmental data of the vehicle; Based on the driving information, use at least one of the navigation data and the environmental data as the target display data, and superimpose and display the driving information, the target display data and the real road; Wherein, the step of using at least one of the navigation data and the environmental data as the target display data includes: Determine the driving state of the vehicle based on the driving information and the navigation data, and filter out the data to be displayed from the navigation data according to the driving state; Based on the driving information, use at least one of the data to be displayed and the environmental data as the target display data; The display unit is configured to project the driving information and the target display data onto the windshield for display; Wherein, the driving state includes a first driving state and a second driving state, and the vehicle speed in the second driving state is greater than or equal to the vehicle speed in the first driving state; The step of using at least one of the data to be displayed and the environmental data as the target display data according to the driving information includes: When the driving state is the first driving state, use the data to be displayed and the environmental data as the target display data; When the driving state is the second driving state, use the data to be displayed as the target display data; Among them, screening out the data to be displayed from the navigation data according to the driving state includes: When the vehicle is in the first driving state, using the road navigation data within the first preset range of the vehicle in the navigation data as the data to be displayed; When the vehicle is in the second driving state, using the road navigation data within the second preset range of the vehicle in the navigation data as the data to be displayed; Among them, the second preset range is larger than the first preset range.
Citation Information
Patent Citations
Vehicular display control device and vehicular display control method
CN112154077A
Head-up display method, electronic equipment and computer readable storage medium
CN117631284A
function-controlled head-up display with extended information display for a vehicle
DE102015215979B3
Systems and Methods for Displaying Navigational Information
US20150019127A1