Head-up display control method and device, electronic equipment and storage medium

Abstract

Embodiments of the present application disclose a head-up display control method and device, electronic equipment and a storage medium. The method is applied to a vehicle body controller integrated with a driver monitoring system and a head-up display system, and includes: detecting whether an image acquisition device in the driver monitoring system is faulty; if so, prompting a user to control a head-up display function in an entity button mode or a voice mode, and detecting whether a button display instruction sent through the entity button or a voice display instruction sent through a voice control system exists; and if so, controlling a head-up display circuit to perform head-up display through the button display instruction or the voice display instruction. The embodiments of the present application enrich the control mode of the head-up display position and reduce the hardware cost.

Description

Technical Field

[0001] Embodiments of the present application relate to vehicle control technology, and in particular to a head-up display control method, device, electronic device, and storage medium. Background Art

[0002] In the process of automobile intelligent development, head-up display is becoming a carrier for displaying more information and one of the most important ways to display in-vehicle information.

[0003] In the prior art, a head-up display needs to obtain a facial image through a camera and adjust the head-up display position according to the position of the human eyes in the facial image.

[0004] However, the control method of using a camera to capture the position of human eyes and adjust the head-up display position is single. Once the camera fails, the position of the head-up display cannot be effectively adjusted. In addition, the installation of the head-up display optical machine requires a lot of space and may require the expansion of the cab, which has high hardware costs. Summary of the Invention

[0005] The present application provides a head-up display control method, device, electronic device and storage medium to enrich the control methods of the head-up display position and reduce hardware costs.

[0006] In a first aspect, an embodiment of the present application provides a head-up display control method, which is applied to a vehicle body controller that integrates a driver monitoring system and a head-up display system. The head-up display control method includes:

[0007] Detect whether there is any fault in the image acquisition device of the driver monitoring system;

[0008] If so, prompt the user to control the head-up display function by physical button mode or voice mode, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system;

[0009] If so, the head-up display circuit is controlled to perform head-up display through key display instructions or voice display instructions.

[0010] In a second aspect, an embodiment of the present application further provides a head-up display control device, which is configured in a vehicle body controller that integrates a driver monitoring system and a head-up display system. The head-up display control device includes:

[0011] A fault detection module is used to detect whether there is a fault in the image acquisition device in the driver monitoring system;

[0012] a control command detection module for, if yes, prompting the user to control the head-up display function by physical button mode or voice mode, and detecting whether there is a button display command sent by a physical button or a voice display command sent by a voice control system;

[0013] The head-up display control module is used to control the head-up display circuit to perform head-up display through key display instructions or voice display instructions.

[0014] In a third aspect, an embodiment of the present application further provides an electronic device, the electronic device comprising:

[0015] one or more processors;

[0016] a storage device for storing one or more programs;

[0017] When one or more programs are executed by one or more processors, the one or more processors implement any one of the head-up display control methods provided in the embodiments of the present application.

[0018] In a fourth aspect, an embodiment of the present application further provides a storage medium comprising computer-executable instructions, which, when executed by a computer processor, are used to execute any one of the head-up display control methods provided in the embodiments of the present application.

[0019] The present application is applied to a vehicle body controller that integrates a driver monitoring system and a head-up display system to detect whether the image acquisition device in the driver monitoring system is faulty. The driver monitoring system and the head-up display system are integrated into the vehicle body controller, improving system integration and reusing the image acquisition device in the driver monitoring system to reduce hardware costs. If so, the user is prompted to control the head-up display function using physical buttons or voice commands, and the presence of a key display instruction sent via a physical button or a voice display instruction sent via a voice control system is detected. If so, the head-up display circuit is controlled to perform the head-up display using the key display instruction or voice display instruction. If the image acquisition device is faulty, the head-up display can be controlled using physical buttons or voice commands, effectively addressing image acquisition failures, enriching the control methods for the head-up display position, and ensuring driver safety. Therefore, the technical solution of the present application solves the problems of being unable to effectively adjust the head-up display position once a camera fails, and the high space requirements and hardware costs of installing the head-up display optical machine, thereby enriching the control methods for the head-up display position and reducing hardware costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a flow chart of a head-up display control method in Example 1 of the present application;

[0021] Figure 2 This is a flow chart of a head-up display control method in Example 2 of the present application;

[0022] Figure 3 This is a schematic structural diagram of a head-up display control device in Example 3 of the present application;

[0023] Figure 4 This is a structural diagram of an electronic device in Example 4 of the present application. DETAILED DESCRIPTION

[0024] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0025] It should be noted that the terms "first" and "second" in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0026] Example 1

[0027] Figure 1 This is a flowchart of a head-up display control method provided in Example 1 of the present application. This embodiment is applicable to situations where a head-up display is controlled. The method can be executed by a vehicle body controller device that integrates a driver monitoring system and a head-up display system. The device can be implemented using software and / or hardware and specifically configured in a commercial vehicle.

[0028] See also Figure 1 The head-up display control method shown is applied to a vehicle body controller that integrates a driver monitoring system and a head-up display system, and specifically includes the following steps:

[0029] S110 , detecting whether an image acquisition device in the driver monitoring system is faulty.

[0030] The body controller monitors the operating status of various vehicle systems in real time, performs fault diagnosis and protection, prevents escalation of faults, and stores fault information to facilitate diagnosis and repair by maintenance personnel. The driver monitoring system offers a wide range of functions, including support for fatigue and distracted driving detection, driver gaze detection, gesture recognition, facial recognition, and expression recognition. The driver monitoring system is equipped with an image acquisition device to capture the driver's facial image.

[0031] To position the head-up display within the driver's comfortable visual range, the display's position must be determined based on the driver's eye position. Therefore, an image acquisition device is required to capture the driver's eye position. This application integrates the head-up display control circuit with the fatigue monitoring control circuit in the driver monitoring system into a single device, integrating it into the vehicle body controller. This allows the image acquisition device in the driver monitoring system to be reused, reducing hardware modifications, reducing the space required in the cab for the head-up display optical machine, and lowering hardware costs.

[0032] For existing commercial vehicles, due to the narrow distance between the instrument panels, it is impossible to arrange a larger head-up display optical machine, resulting in the need to expand the cab space to install the head-up display optical machine, which increases the hardware cost. The present invention integrates the control system of the head-up display optical machine into the vehicle body controller and reuses the image acquisition equipment in the driver monitoring system, thereby greatly reducing the space required for the head-up display optical machine, reducing the space requirement for the cab, and further reducing or even eliminating the need to expand the cab, thereby reducing hardware costs.

[0033] Based on its own fault detection function, the body controller detects in real time whether there is a fault in the image acquisition device in the driver monitoring system. When the image acquisition device fails, it promptly notifies the driver to adopt other control methods to avoid affecting the driver's use of the head-up display system function.

[0034] S120: If yes, prompt the user to control the head-up display function by physical button mode or voice mode, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system.

[0035] If so, the image capture device is faulty. The user is prompted to use physical buttons or voice control of the heads-up display. This can be done through a voice prompt. For example, the voice prompt could be: "Hello, we are currently unable to capture your facial image. Please use physical buttons or voice control of the heads-up display."

[0036] Physical buttons can be placed on the steering wheel. Once the user becomes familiar with their location, they can be operated without shifting their gaze, minimizing the user's attention and vision, improving operational convenience and driving safety. Key display commands can be generated when a user presses a physical button to control the head-up display function. When a user presses a physical button, a corresponding hardwired signal is triggered and sent to the vehicle body controller. Different hardwired signals represent different key display commands. The vehicle body controller determines the corresponding key display command based on the received hardwired signal. Key display commands can include display on / off commands, display position adjustment commands, and content adjustment commands. Display on / off commands can be used to turn the head-up display function on and off. Display position adjustment commands can be used to control the display position of the head-up display. Exemplary display position adjustment commands may include down, up, left, and right commands. When the user continues pressing the physical button corresponding to a display position adjustment command, the head-up display position continuously moves in the corresponding direction, facilitating user adjustment of the display position. Content adjustment commands can be used to control the content displayed on the head-up display. Exemplary content adjustment commands may include alarm display commands and map display commands, though this application does not provide specific limitations. When the user presses the physical button related to the content adjustment instruction for the first time, the display content corresponding to the physical button is displayed. When the user presses the physical button for the second time, the display content corresponding to the physical button is deleted.

[0037] The voice control system can be a system that receives user voice information and generates voice display commands. Voice display commands can be commands generated by the captured voice to control the head-up display function. When the user speaks, the voice control system determines the corresponding voice display command based on the captured voice signal and sends it to the vehicle body controller. Voice display control commands can include display opening and closing commands, display position adjustment commands, and content adjustment commands. The functions of display opening and closing commands, display position adjustment commands, and content adjustment commands are the same as those of the physical buttons mentioned above and will not be repeated here.

[0038] After prompting the user to control the head-up display function using physical buttons or voice, the body control system detects in real time whether there are button display instructions sent through physical buttons or voice display instructions sent through the voice control system.

[0039] S130: If yes, control the head-up display circuit to perform head-up display through key display instructions or voice display instructions.

[0040] If so, it means that a key display command sent via a physical key or a voice display command sent via the voice control system has been detected. At this time, the body controller can use the key display command or voice display command to drive the head-up display control system to control the head-up display circuit output and implement the corresponding head-up display function.

[0041] It should be noted that the relevant information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for display, data for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data comply with relevant laws, regulations and standards in the relevant regions.

[0042] If not, that is, the button display command sent through the physical button and the voice display command sent through the voice control system are not detected, then there is no need to turn on the head-up display.

[0043] The technical solution of this embodiment, applied to a vehicle body controller that integrates a driver monitoring system and a head-up display system, detects whether the image acquisition device in the driver monitoring system is faulty. The driver monitoring system and the head-up display system are integrated into the vehicle body controller, improving system integration and reusing the image acquisition device in the driver monitoring system to reduce hardware costs. If so, the user is prompted to control the head-up display function using physical buttons or voice commands, and the presence of a key display instruction sent via a physical button or a voice display instruction sent via a voice control system is detected. If so, the head-up display circuit is controlled to perform the head-up display using the key display instruction or voice display instruction. If the image acquisition device is faulty, the head-up display can be controlled using physical buttons or voice commands, effectively addressing image acquisition failures, enriching the control methods for the head-up display position, and ensuring driver safety. Therefore, the technical solution of this application solves the problems of being unable to effectively adjust the head-up display position once a camera fails, and the high space requirements and hardware costs of installing the head-up display optical machine, thereby enriching the control methods for the head-up display position and reducing hardware costs.

[0044] Example 2

[0045] Figure 2 This is a flow chart of a head-up display control method provided in Example 2 of the present application. The technical solution of this embodiment is further refined on the basis of the above technical solution.

[0046] Furthermore, after detecting whether the image acquisition device of the driver monitoring system is faulty, it is added: "If not, obtain the driver's facial image captured by the image acquisition device of the driver monitoring system; determine whether to turn on the head-up display through the driver's facial image and the preset start-up information of the head-up display; if so, determine the eye position through the facial image, and determine the display position of the head-up display according to the eye position; control the head-up display system to display the display content to the display position" to realize automatic adjustment of the display position.

[0047] See also Figure 2 A head-up display control method shown includes:

[0048] S210: Detect whether there is a fault in the image acquisition device in the driver monitoring system.

[0049] S220: If not, obtain the driver's facial image captured by the image capture device of the driver monitoring system.

[0050] If not, that is, there is no fault in the image acquisition device in the driver monitoring system, then the driver's facial image can be acquired by the image acquisition device in the driver monitoring system.

[0051] S230: Determine whether to turn on the head-up display based on the driver's facial image and preset turn-on information of the head-up display.

[0052] The preset activation information may be information pre-set by the driver to control the activation of the head-up display. Exemplarily, the preset activation information may be a facial action. For example, the preset activation information may be a head shake. Optionally, the preset activation information may include identity verification information and activation action information. A preset number of user facial images and corresponding action information may be pre-recorded as the identity verification information and corresponding activation action information. After acquiring the driver's facial image, identity verification is first performed using the acquired facial image. After identity verification passes, the action is verified. If the activation action verification passes, the head-up display is activated; otherwise, the head-up display is not activated.

[0053] In an optional embodiment, after obtaining the driver's facial image captured by the image acquisition device of the driver monitoring system, it also includes: the driver monitoring system performs a fatigue driving analysis on the driver's facial image; if it is determined that the driver is driving fatigued, the driver's fatigue level is determined, and a target warning method is determined; the head-up display system is controlled to adjust the display method and display content according to the target warning method.

[0054] After the image acquisition device of the driver monitoring system captures the driver's facial image, the driver monitoring system performs a fatigue driving analysis on the driver's facial image. If it is determined that the driver is driving fatigued, the fatigue level can be determined according to the preset assessment methods of each fatigue level, and the target warning method can be determined according to the candidate warning methods pre-set for different fatigue levels. Exemplarily, the candidate warning method can be flashing fonts, adding a red background or changing the font color, which is not specifically limited in this application. The head-up display system is controlled to adjust the display method and display content according to the target warning method. For example, if the target warning method is to change the font color to red, the head-up display system is controlled to display red fonts.

[0055] The driver's facial image is analyzed for fatigue driving through the driver monitoring system; if the driver is determined to be driving fatigued, the driver's fatigue level is determined, and the target warning method is determined; the head-up display system is controlled to adjust the display method and display content according to the target warning method, and the driver can be reminded of fatigue driving through the head-up display, enriching the reminder methods for fatigue driving and ensuring driver safety.

[0056] In an optional embodiment, after acquiring the driver's facial image captured by the image acquisition device of the driver monitoring system, the method further includes: if alarm information is acquired, controlling the head-up display system to display the alarm information.

[0057] The body controller can obtain various alarm information in the vehicle. After integrating the head-up display system into the body controller, the body controller can control the head-up display system to display alarm information so that the driver can notice the alarm information in time without having to look down at other instrument panels. This not only improves the timeliness of seeing the alarm information, but also ensures the safety of the driver.

[0058] S240: If yes, determine the eyeball position through the facial image, and determine the display position of the head-up display according to the eyeball position.

[0059] If so, the HUD is activated. To ensure the driver can see the HUD content even after shifting their gaze, the HUD display position can be determined based on the driver's eye position, aligning the HUD display with the driver's gaze. The display position is then adjusted based on the driver's eye position, enabling a responsive display position. This ensures the driver can see the HUD from any position, improving the user experience. The eye position can be eye coordinate information.

[0060] In an optional embodiment, the eyeball position is determined through a facial image, and the display position of the head-up display is determined based on the eyeball position, including: identifying the eyeballs in the facial image and determining the eyeball coordinates in a preset human eye coordinate system; determining the display offset based on the eyeball coordinates and preset reference coordinates; and determining the display position of the head-up display based on the display offset and a preset position mapping formula.

[0061] The preset eye coordinate system can be a pre-established coordinate system for determining the eye position. The preset reference coordinates can be a pre-set position where the user is looking straight ahead, used to determine the display offset. For example, the eye position coordinates in a facial image corresponding to the user's most commonly used sitting posture can be collected as the preset reference coordinates. Different preset reference coordinates can be set for different users, or the preset reference coordinates can be obtained by collecting relevant data from a large number of users and taking an average value. This application does not impose specific limitations on this. The display offset can be the offset of the eye coordinates relative to the preset reference coordinates, used to determine the display position. The preset position mapping formula can be a formula for determining the display position based on the display offset. For example, the calculation process of the preset position mapping formula can be as follows: obtain the display reference coordinates that are pre-set corresponding to the preset reference coordinates; based on the scale of the eye coordinate system and the coordinate system of the display area, multiply the display offset by the scale to determine the offset of the display position; and add the display reference coordinates to the display position offset to obtain the coordinates of the display position.

[0062] After acquiring a facial image, the system uses a preset image recognition algorithm to identify the eyeballs in the facial image and maps them to a preset eye coordinate system to determine the eyeball coordinates. The offset of the eyeball coordinates relative to the preset reference coordinates is determined as the display offset. This display offset is input into a preset position mapping formula to determine the head-up display position.

[0063] By identifying the eyeballs in the facial image and determining the eyeball coordinates in the preset human eye coordinate system; determining the display offset based on the eyeball coordinates and the preset reference coordinates; determining the display position of the head-up display based on the display offset and the preset position mapping formula, and realizing the display position to follow the movement of the eyeball position through coordinate system conversion, the display position is convenient for the driver to view, thereby improving user experience and driving safety.

[0064] In an optional embodiment, after determining the display offset according to the eye coordinates and the preset reference coordinates, the method further includes: determining an offset angle according to the angular difference between the eye coordinates and the preset reference coordinates, and determining the display angle according to the offset angle.

[0065] When the HUD content is displayed at eye level, fonts may be blocked or overlapped when viewed from other angles, reducing the user's viewing experience and increasing driving safety risks. Therefore, when the driver views the HUD at a certain angle, the HUD content must be displayed at the same angle to ensure that the user can clearly see the displayed content.

[0066] The offset angle can be the angular difference between the eye coordinates and the preset reference coordinates, and is used to determine the display angle. The viewing angle of the human eye looking toward the head-up display area is determined based on the offset angle, and the viewing angle is determined as the display angle. After the display angle is determined, the head-up display system is controlled to display content at the display angle.

[0067] By determining the offset angle based on the angular difference between the eyeball coordinates and the preset reference coordinates, and determining the display angle based on the offset angle, the display angle of the display content relative to the display position can be adjusted according to the display angle. This allows the user to clearly see all the display content when looking at the head-up display at different angles, thereby improving the driver's viewing experience and enhancing driving safety.

[0068] S250: Control the head-up display system to display the display content at the display position.

[0069] The head-up display system is controlled to display corresponding display content according to the display position, so that the display content is displayed at the display position.

[0070] Optionally, after controlling the head-up display system to display the display content at the display position, the method further includes controlling the head-up display system to display the display content at the display angle according to the display angle.

[0071] The technical solution of this embodiment is as follows: if not, then obtain the driver's facial image captured by the image acquisition device of the driver monitoring system; determine whether the head-up display is turned on through the driver's facial image and the preset start-up information of the head-up display; if so, determine the eye position through the facial image, and determine the display position of the head-up display according to the eye position; control the head-up display system to display the display content to the display position, and adjust the display position according to the eye position so that the display position moves with the movement of the eye, so that the driver can see the display content of the head-up display in real time, thereby improving driving safety, and converting through the coordinate system is simple to implement, with low requirements on computing power, thereby improving the efficiency of display position determination, and thus improving the real-time performance of the head-up display tracking.

[0072] Example 3

[0073] Figure 3 FIG2 is a schematic diagram of the structure of a head-up display control device provided in Example 3 of the present application. This embodiment is applicable to the control of a head-up display and is configured in a vehicle body controller that integrates a driver monitoring system and a head-up display system. The specific structure of the head-up display control device is as follows:

[0074] A fault detection module 310 is used to detect whether there is a fault in the image acquisition device in the driver monitoring system;

[0075] a control instruction detection module 320 for, if yes, prompting the user to control the head-up display function by physical buttons or voice, and detecting whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system;

[0076] The head-up display control module 330 is configured to, if yes, control the head-up display circuit to perform head-up display through the key display instruction or voice display instruction.

[0077] The technical solution of this embodiment, applied to a vehicle body controller that integrates a driver monitoring system and a head-up display system, detects whether the image acquisition device in the driver monitoring system is faulty. The driver monitoring system and the head-up display system are integrated into the vehicle body controller, improving system integration and reusing the image acquisition device in the driver monitoring system to reduce hardware costs. If so, the user is prompted to control the head-up display function using physical buttons or voice commands, and the presence of a key display instruction sent via a physical button or a voice display instruction sent via a voice control system is detected. If so, the head-up display circuit is controlled to perform the head-up display using the key display instruction or voice display instruction. If the image acquisition device is faulty, the head-up display can be controlled using physical buttons or voice commands, effectively addressing image acquisition failures, enriching the control methods for the head-up display position, and ensuring driver safety. Therefore, the technical solution of this application solves the problems of being unable to effectively adjust the head-up display position once a camera fails, and the high space requirements and hardware costs of installing the head-up display optical machine, thereby enriching the control methods for the head-up display position and reducing hardware costs.

[0078] Optional head-up display control unit also includes:

[0079] a facial image acquisition module, for, if not, acquiring a facial image of the driver acquired by an image acquisition device of a driver monitoring system;

[0080] A head-up display activation determination module is used to determine whether to activate the head-up display based on the driver's facial image and the preset activation information of the head-up display;

[0081] A display position determination module, configured to, if yes, determine the eyeball position through the facial image, and determine the display position of the head-up display according to the eyeball position;

[0082] The head-up display system control module is used to control the head-up display system to display the display content at the display position.

[0083] Optionally, a display position determination module includes:

[0084] An eyeball coordinate determination unit, configured to identify the eyeballs in the facial image and determine the eyeball coordinates in a preset human eye coordinate system;

[0085] a display offset determination unit, configured to determine a display offset according to eyeball coordinates and preset reference coordinates;

[0086] The display position determining unit is used to determine the display position of the head-up display according to the display offset and a preset position mapping formula.

[0087] Optionally, the display position determination module further includes:

[0088] The display angle determining unit is used to determine an offset angle according to an angular difference between the eyeball coordinates and the preset reference coordinates, and to determine a display angle according to the offset angle.

[0089] Optional head-up display control unit also includes:

[0090] Fatigue driving analysis module, used by the driver monitoring system to analyze driver's facial images for fatigue driving;

[0091] a target warning mode determination module, configured to determine the driver's fatigue level and a target warning mode if the driver is determined to be driving fatigued;

[0092] The head-up display system adjustment module is used to control the head-up display system to adjust the display mode and display content according to the target warning mode.

[0093] Optional head-up display control unit also includes:

[0094] The alarm information display module is used to control the head-up display system to display the alarm information if the alarm information is obtained.

[0095] The head-up display control device provided in the embodiments of the present application can execute the head-up display control method provided in any embodiment of the present application, and has the corresponding functional modules and beneficial effects for executing the head-up display control method.

[0096] According to an embodiment of the present invention, the present invention further provides an electronic device, a readable storage medium and a computer program product.

[0097] Example 4

[0098] Figure 4 This is a structural diagram of an electronic device provided in Example 4 of the present application, such as Figure 4 As shown, the electronic device includes a processor 410, a memory 420, an input device 430, and an output device 440; the number of processors 410 in the electronic device can be one or more. Figure 4The processor 410 in the electronic device is taken as an example; the processor 410, the memory 420, the input device 430 and the output device 440 in the electronic device can be connected through a bus or other means, Figure 4 The processor 410 in the electronic device is taken as an example; the processor 410, the memory 420, the input device 430 and the output device 440 in the electronic device can be connected through a bus or other means,

[0099] The memory 420 is a kind of computer readable storage medium, and can be used to store software programs, computer executable programs and modules, such as program instructions / modules (for example, fault detection module 310, control instruction detection module 320 and head-up display control module 330) corresponding to the head-up display control method in the embodiment of the application. The processor 410 executes the software program, instruction and module stored in the memory 420, thereby performing various function applications and data processing of the electronic device, i.e. realizing the head-up display control method described above.

[0100] The memory 420 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system and application programs required by at least one function; the data storage area can store data created according to the use of the terminal and the like. In addition, the memory 420 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state memory device. In some examples, the memory 420 can further include a memory remotely arranged with respect to the processor 410, and these remote memories can be connected to the electronic device through a network. Examples of the above network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0101] The input device 430 can be used to receive input character information, and generate key signal input related to user settings and function control of the electronic device. The output device 440 can include a display device such as a display screen.

[0102] Embodiment five

[0103] The embodiment five of the application further provides a storage medium containing computer executable instructions, which are used to execute a head-up display control method when executed by a computer processor, applied to a vehicle body controller integrated with a driver monitoring system and a head-up display system, and the method comprises the following steps: detecting whether an image acquisition device in the driver monitoring system is faulty; if yes, prompting a user to control a head-up display function in an entity button mode or a voice mode, and detecting whether there is a key display instruction sent through an entity button or a voice display instruction sent through a voice control system; if yes, controlling a head-up display circuit to perform head-up display through the key display instruction or the voice display instruction.

[0104] Of course, the storage medium containing computer-executable instructions provided in an embodiment of the present application is not limited to the method operations described above, and can also execute related operations in the head-up display control method provided in any embodiment of the present application.

[0105] Through the above description of the implementation methods, those skilled in the art can clearly understand that the present application can be implemented with the help of software and necessary general-purpose hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions for enabling an electronic device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0106] It is worth noting that in the embodiment of the above-mentioned head-up display control device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application.

[0107] Note that the above are only preferred embodiments of the present application and the technical principles employed. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments and may include many other equivalent embodiments without departing from the scope of the present application. The scope of the present application is determined by the scope of the appended claims.

Claims

1. A head-up display control method, characterized in that: Used in body controllers that integrate driver monitoring systems and head-up display systems, including: Detect whether there is any fault in the image acquisition device of the driver monitoring system; If so, prompt the user to control the head-up display function by physical button mode or voice mode, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system; If so, the head-up display circuit is controlled to perform head-up display through the button display instruction or voice display instruction; After detecting whether the image acquisition device of the driver monitoring system is faulty, the method further includes: If not, obtaining a facial image of the driver captured by an image capture device of the driver monitoring system; determining whether to turn on the head-up display based on the driver's facial image and preset turn-on information of the head-up display; If so, determining the eye position through the facial image, and determining the display position of the head-up display according to the eye position; The head-up display system is controlled to display the display content at the display position.

2. The method according to claim 1, characterized in that Determining the eyeball position through the facial image, and determining the display position of the head-up display according to the eyeball position, includes: Identifying eyeballs in the facial image and determining eyeball coordinates in a preset human eye coordinate system; Determine the display offset according to the eyeball coordinates and the preset reference coordinates; The display position of the head-up display is determined according to the display offset and a preset position mapping formula.

3. The method according to claim 2, characterized in that After determining the display offset according to the eyeball coordinates and the preset reference coordinates, the method further includes: An offset angle is determined according to an angular difference between the eyeball coordinates and the preset reference coordinates, and a display angle is determined according to the offset angle.

4. The method according to claim 1, wherein After acquiring the driver's facial image acquired by the image acquisition device of the driver monitoring system, the method further includes: The driver monitoring system performs fatigue driving analysis on the driver's facial image; If it is determined that the driver is driving fatigued, the driver's fatigue level is determined and the target warning method is determined; The head-up display system is controlled to adjust the display mode and display content according to the target warning mode.

5. The method according to claim 1, wherein After acquiring the driver's facial image acquired by the image acquisition device of the driver monitoring system, the method further includes: If the alarm information is obtained, the head-up display system is controlled to display the alarm information.

6. A head-up display control device, characterized in that: Configured in the body controller that integrates the driver monitoring system and head-up display system, including: A fault detection module is used to detect whether there is a fault in the image acquisition device in the driver monitoring system; a control command detection module for, if yes, prompting the user to control the head-up display function by physical button mode or voice mode, and detecting whether there is a button display command sent by a physical button or a voice display command sent by a voice control system; A head-up display control module is used to control the head-up display circuit to perform head-up display through the button display instruction or voice display instruction if yes; The head-up display control device further includes: a facial image acquisition module, for, if not, acquiring a facial image of the driver acquired by an image acquisition device of a driver monitoring system; a head-up display activation determination module, configured to determine whether to activate the head-up display based on the driver's facial image and preset activation information of the head-up display; a display position determining module, configured to, if yes, determine the eyeball position through the facial image, and determine the display position of the head-up display according to the eyeball position; The head-up display system control module is used to control the head-up display system to display the display content at the display position.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the head-up display control method according to any one of claims 1 to 5 is implemented.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the head-up display control method according to any one of claims 1 to 5 is implemented.

9. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the head-up display control method according to any one of claims 1 to 5.

Images