Head-up display control method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses a head-up display control method and device, electronic equipment and a storage medium. The method is applied to a vehicle body controller integrated with a driver monitoring system and a head-up display system, and comprises the following steps: detecting whether an image acquisition device in the driver monitoring system has a fault or not; if yes, the user is prompted to control the head-up display function in an entity key mode or a voice mode, and whether a key display instruction sent through an entity key or a voice display instruction sent through a voice control system exists or not is detected; and if yes, controlling a head-up display circuit to perform head-up display through a key display instruction or a voice display instruction. According to the embodiment of the invention, the control mode of the head-up display position is enriched, and the hardware cost is reduced.

Description

Technical Field

[0001] Embodiments of the present application relate to vehicle control technology, and more particularly to a head-up display control method, device, electronic device, and storage medium. Background Art

[0002] In the process of automobile intelligent development, head-up display is becoming a carrier for displaying more information and one of the most important ways to display in-vehicle information.

[0003] In the prior art, the head-up display needs to obtain a facial image through a camera, and adjust the head-up display position according to the position of the human eyes in the facial image.

[0004] However, the head-up display position is adjusted by capturing the position of human eyes through a camera, and the control method is single. Once the camera fails, the position of the head-up display cannot be effectively adjusted. In addition, the installation of the head-up display optical machine requires a high space requirement, and the cab may need to be expanded, resulting in high hardware costs. Summary of the invention

[0005] The present application provides a head-up display control method, device, electronic device and storage medium to enrich the control methods of the head-up display position and reduce hardware costs.

[0006] In a first aspect, an embodiment of the present application provides a head-up display control method, which is applied to a vehicle body controller integrating a driver monitoring system and a head-up display system, and the head-up display control method includes:

[0007] Detect whether the image acquisition device in the driver monitoring system is faulty;

[0008] If yes, prompt the user to control the head-up display function by physical button mode or voice mode, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system;

[0009] If so, the head-up display circuit is controlled to perform head-up display through key display instructions or voice display instructions.

[0010] In a second aspect, an embodiment of the present application further provides a head-up display control device, which is configured in a vehicle body controller integrating a driver monitoring system and a head-up display system, and the head-up display control device includes:

[0011] A fault detection module, used to detect whether there is a fault in the image acquisition device in the driver monitoring system;

[0012] A control command detection module, for, if yes, prompting the user to control the head-up display function by physical button mode or voice mode, and detecting whether there is a button display command sent by a physical button or a voice display command sent by a voice control system;

[0013] The head-up display control module is used to control the head-up display circuit to perform head-up display through key display instructions or voice display instructions.

[0014] In a third aspect, an embodiment of the present application further provides an electronic device, the electronic device comprising:

[0015] one or more processors;

[0016] A storage device for storing one or more programs;

[0017] When one or more programs are executed by one or more processors, the one or more processors implement any head-up display control method provided in the embodiments of the present application.

[0018] In a fourth aspect, an embodiment of the present application further provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute any head-up display control method provided in the embodiment of the present application.

[0019] The present application is applied to a vehicle body controller that integrates a driver monitoring system and a head-up display system to detect whether there is a fault in the image acquisition device in the driver monitoring system; the driver monitoring system and the head-up display system are integrated into the vehicle body controller to improve the integration of the system, and the image acquisition device in the driver monitoring system is reused to reduce the hardware cost; if so, the user is prompted to control the head-up display function by physical buttons or voice, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system; if so, the head-up display circuit is controlled to perform head-up display through the button display instruction or the voice display instruction. In the case of a fault in the image acquisition device, the control of the head-up display can be sent by physical buttons or voice, effectively dealing with image acquisition faults, enriching the control method of the head-up display position, and ensuring the safety of the driver. Therefore, through the technical solution of the present application, once the camera fails, the position of the head-up display cannot be effectively adjusted, and the installation of the head-up display optical machine has a high space requirement and high hardware cost, and the control method of the head-up display position is enriched and the hardware cost is reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 is a flow chart of a head-up display control method in Embodiment 1 of the present application;

[0021] Figure 2 is a flow chart of a head-up display control method in Embodiment 2 of the present application;

[0022] Figure 3 It is a structural schematic diagram of a head-up display control device in Embodiment 3 of the present application;

[0023] Figure 4 It is a structural diagram of an electronic device in Embodiment 4 of the present application. DETAILED DESCRIPTION

[0024] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0025] It should be noted that the terms "first" and "second" etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0026] Embodiment 1

[0027] Figure 1 This is a flow chart of a head-up display control method provided in Example 1 of the present application. This embodiment is applicable to the situation of controlling the head-up display. The method can be executed by a body controller device that integrates a driver monitoring system and a head-up display system. The device can be implemented in software and / or hardware and is specifically configured in a commercial vehicle.

[0028] See also Figure 1 The head-up display control method shown is applied to a body controller integrating a driver monitoring system and a head-up display system, and specifically includes the following steps:

[0029] S110, detecting whether there is a fault in the image acquisition device in the driver monitoring system.

[0030] The body controller can be used to monitor the working status of each system of the car in real time, perform fault diagnosis and protection, prevent the expansion of faults and store fault information to facilitate maintenance personnel to diagnose and repair. The driver monitoring system has a wide range of functions, including support for fatigue driving detection, distracted driving detection, driver sight detection, gesture recognition, face recognition, and expression recognition. The driver monitoring system is equipped with an image acquisition device to capture the driver's facial image.

[0031] In order to make the head-up display in the driver's comfortable visual area, the position of the head-up display needs to be determined according to the driver's eye position, so the driver's eye position needs to be obtained through an image acquisition device. This application integrates the head-up display control circuit and the fatigue monitoring control circuit in the driver monitoring system into an integrated machine and integrates them into the body controller. The image acquisition device in the driver monitoring system can be reused, reducing the hardware modification, reducing the head-up display optical machine's space requirements in the cab, and reducing hardware costs.

[0032] For existing commercial vehicles, due to the narrow distance between the instrument panels, it is impossible to arrange a larger head-up display optical machine, which results in the need to expand the cab space to install the head-up display optical machine, which increases the hardware cost. The present invention integrates the control system of the head-up display optical machine into the vehicle body controller and reuses the image acquisition equipment in the driver monitoring system, thereby greatly reducing the space required for the head-up display optical machine, reducing the space requirement for the cab, and further reducing or even eliminating the need to expand the cab, thereby reducing hardware costs.

[0033] Based on its own fault detection function, the body controller detects in real time whether there is a fault in the image acquisition device in the driver monitoring system. When the image acquisition device fails, it promptly notifies the driver to take other control methods to avoid affecting the driver's use of the head-up display system function.

[0034] S120: If yes, prompt the user to control the head-up display function by physical button mode or voice mode, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system.

[0035] If yes, it means that the image acquisition device is faulty. The user is prompted to control the head-up display function by physical buttons or voice, and the user can be prompted to control the head-up display function by physical buttons or voice through voice broadcast. For example, the voice prompt can be: "Hello, your facial image cannot be collected at present, please control the head-up display by physical buttons or voice."

[0036] Physical buttons can be arranged on the steering wheel. After the user is familiar with the position of the physical buttons, they can operate without moving their sight, without taking up too much energy and sight of the user, thereby improving the convenience of operation and driving safety. The button display instruction can be an instruction generated after the user presses the physical button to control the head-up display function. When the user presses the physical button, the corresponding hard-wire signal is triggered and sent to the body controller. Different hard-wire signals represent different button display instructions. The body controller determines the corresponding button display instruction according to the acquired hard-wire signal. The button display instruction may include a display opening and closing instruction, a display position adjustment instruction, and a content adjustment instruction. The display opening and closing instruction may be used to control the opening and closing of the head-up display function. The display position adjustment instruction may be used to control the display position of the head-up display. Exemplarily, the display position adjustment instruction may include a downward instruction, an upward instruction, a left instruction, and a right instruction. When the user continues to press the physical button corresponding to the display position adjustment instruction, the head-up display position continues to move in the corresponding direction, so that the user can adjust the display position. The content adjustment instruction may be used to control the display content of the head-up display. Exemplarily, the content adjustment instruction may include an alarm display instruction and a map display instruction, etc., which are not specifically limited in this application. When the user presses the physical key related to the content adjustment instruction for the first time, the display content corresponding to the physical key is displayed, and when the user presses the physical key for the second time, the display content corresponding to the physical key is deleted.

[0037] The voice control system may be a system that receives user voice information and generates voice display instructions. The voice display instructions may be instructions for controlling the head-up display function generated by the acquired voice. When the user utters a voice, the voice control system determines the corresponding voice display instructions through the acquired voice signal and sends it to the body controller. The voice display control instructions may include display opening and closing instructions, display position adjustment instructions, and content adjustment instructions. The functions of the display opening and closing instructions, display position adjustment instructions, and content adjustment instructions are the same as those of the above-mentioned physical buttons and will not be repeated here.

[0038] After prompting the user to control the head-up display function by physical button mode or voice mode, the body control system detects in real time whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system.

[0039] S130: If yes, control the head-up display circuit to perform head-up display through key display instructions or voice display instructions.

[0040] If yes, that is, the key display command sent through the physical key or the voice display command sent through the voice control system is detected. At this time, the body controller can drive the head-up display control system to control the head-up display circuit output through the key display command or the voice display command to realize the corresponding head-up display function.

[0041] It should be noted that the relevant information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for display, data for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data comply with relevant laws, regulations and standards in relevant regions.

[0042] If not, that is, the button display command sent through the physical button and the voice display command sent through the voice control system are not detected. At this time, there is no need to turn on the head-up display.

[0043] The technical solution of this embodiment is applied to a vehicle body controller that integrates a driver monitoring system and a head-up display system to detect whether the image acquisition device in the driver monitoring system has a fault; the driver monitoring system and the head-up display system are integrated into the vehicle body controller to improve the system integration, and the image acquisition device in the driver monitoring system is reused to reduce the hardware cost; if so, the user is prompted to control the head-up display function by physical buttons or voice, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system; if so, the head-up display circuit is controlled to perform head-up display through the button display instruction or the voice display instruction. In the case of a fault in the image acquisition device, the control of the head-up display can be sent by physical buttons or voice, effectively dealing with image acquisition faults, enriching the control method of the head-up display position, and ensuring the safety of the driver. Therefore, through the technical solution of this application, once the camera fails, the position of the head-up display cannot be effectively adjusted, and the installation of the head-up display optical machine has a high space requirement and high hardware cost, and the control method of the head-up display position is enriched and the hardware cost is reduced.

[0044] Embodiment 2

[0045] Figure 2 This is a flow chart of a head-up display control method provided in Embodiment 2 of the present application. The technical solution of this embodiment is further refined on the basis of the above technical solution.

[0046] Furthermore, after detecting whether the image acquisition device of the driver monitoring system is faulty, add: "If not, obtain the driver's facial image acquired by the image acquisition device of the driver monitoring system; determine whether to turn on the head-up display through the driver's facial image and the preset start-up information of the head-up display; if so, determine the eye position through the facial image, and determine the display position of the head-up display according to the eye position; control the head-up display system to display the display content to the display position" to realize automatic adjustment of the display position.

[0047] See also Figure 2 A head-up display control method shown includes:

[0048] S210: Detect whether there is a fault in the image acquisition device in the driver monitoring system.

[0049] S220: If not, obtain the driver's facial image captured by the image capture device of the driver monitoring system.

[0050] If not, that is, there is no fault in the image acquisition device in the driver monitoring system, at this time, the driver's facial image of the driver can be acquired by the image acquisition device in the driver monitoring system.

[0051] S230: Determine whether to turn on the head-up display based on the driver's facial image and preset turn-on information of the head-up display.

[0052] The preset activation information may be information preset by the driver for controlling the activation of the head-up display. Exemplarily, the preset activation information may be a facial action. For example, the preset activation information may be shaking the head. Optionally, the preset activation information may include identity authentication information and activation action information. A preset number of user's facial images and corresponding action information may be pre-recorded as identity authentication information and corresponding activation action information. After acquiring the driver's facial image, identity authentication is first performed using the acquired facial image. After the identity authentication is passed, the action is verified. If the activation action verification passes, it is determined that the head-up display is activated. Otherwise, the head-up display is not activated.

[0053] In an optional embodiment, after acquiring the driver's facial image captured by the image acquisition device of the driver monitoring system, it also includes: the driver monitoring system performs a fatigue driving analysis on the driver's facial image; if it is determined that the driver is driving fatigued, the driver's fatigue level is determined, and a target warning method is determined; the head-up display system is controlled to adjust the display method and display content according to the target warning method.

[0054] After the image acquisition device of the driver monitoring system acquires the driver's facial image, the driver monitoring system performs a fatigue driving analysis on the driver's facial image. If it is determined that the driver is driving fatigued, the fatigue level can be determined according to the preset assessment methods of each fatigue level, and the target warning method can be determined according to the candidate warning methods pre-set for different fatigue levels. Exemplarily, the candidate warning methods can be flashing fonts, adding a red background, or changing the font color, which is not specifically limited in this application. The head-up display system is controlled to adjust the display mode and display content according to the target warning method. For example, if the target warning method is to change the font color to red, the head-up display system is controlled to display red fonts.

[0055] The driver's facial image is analyzed for fatigue driving through the driver monitoring system. If the driver is determined to be driving fatigued, the driver's fatigue level is determined and the target warning method is determined. The head-up display system is controlled to adjust the display method and content according to the target warning method. The driver can be reminded of fatigue driving through the head-up display, enriching the reminder methods for fatigue driving and ensuring driver safety.

[0056] In an optional embodiment, after acquiring the driver's facial image acquired by the image acquisition device of the driver monitoring system, the method further includes: if alarm information is acquired, controlling the head-up display system to display the alarm information.

[0057] The body controller can obtain various alarm information in the vehicle. After integrating the head-up display system into the body controller, the body controller can control the head-up display system to display the alarm information so that the driver can notice the alarm information in time without having to look down at other dashboards. This not only improves the timeliness of seeing the alarm information, but also ensures the driver's safety.

[0058] S240: If yes, determine the eyeball position through the facial image, and determine the display position of the head-up display according to the eyeball position.

[0059] If yes, the head-up display is turned on. In order to ensure that the driver can see the display content of the head-up display after moving his sight, the display position of the head-up display can be determined according to the driver's eye position, so that the display position of the head-up display is exactly the driver's sight position, and the display position is adjusted according to the eye position to achieve follow-up of the display position, ensuring that the driver can see the head-up display at all positions, thereby improving the user experience. The eye position can be eye coordinate information.

[0060] In an optional embodiment, the eye position is determined through a facial image, and the display position of the head-up display is determined based on the eye position, including: identifying the eye in the facial image, and determining the eye coordinates in a preset human eye coordinate system; determining the display offset based on the eye coordinates and preset reference coordinates; and determining the display position of the head-up display based on the display offset and a preset position mapping formula.

[0061] The preset human eye coordinate system may be a pre-established coordinate system for determining the position of the eyeball. The preset reference coordinate may be a preset position of the user looking straight ahead, which is used to determine the display offset. Exemplarily, the position coordinates of the eyeball in the facial image corresponding to the user's most commonly used sitting posture may be collected as the preset reference coordinates. Different preset reference coordinates may be set for different users, or the average value may be taken as the preset reference coordinate by collecting relevant data of a large number of users, which is not specifically limited in this application. The display offset may be the offset of the eyeball coordinate relative to the preset reference coordinate, which is used to determine the display position. The preset position mapping formula may be a formula for determining the display position according to the display offset. Exemplarily, the calculation process of the preset position mapping formula may be as follows: obtaining the display reference coordinates corresponding to the preset reference coordinates, multiplying the display offset by the scale according to the human eye coordinate system and the coordinate system of the display area, determining the offset of the display position, adding the display reference coordinates to the offset of the display position, and obtaining the coordinates of the display position.

[0062] After acquiring the facial image, the eyeballs in the facial image are identified by a preset image recognition algorithm, and the identified eyeballs are mapped to a preset human eye coordinate system to determine the eyeball coordinates. The offset of the eyeball coordinates relative to the preset reference coordinates is determined as the display offset. The display offset is input into the preset position mapping formula to obtain the display position of the head-up display.

[0063] By identifying the eyeballs in the facial image and determining the eyeball coordinates in the preset human eye coordinate system; determining the display offset based on the eyeball coordinates and the preset reference coordinates; determining the display position of the head-up display based on the display offset and the preset position mapping formula, and realizing the follow-up of the display position as the eyeball position moves through the coordinate system conversion, the display position is convenient for the driver to watch, thereby improving the user experience and driving safety.

[0064] In an optional embodiment, after determining the display offset according to the eyeball coordinates and the preset reference coordinates, the method further includes: determining an offset angle according to the angle difference between the eyeball coordinates and the preset reference coordinates, and determining a display angle according to the offset angle.

[0065] When the head-up display content is displayed at a horizontal angle, and the user views it at other angles, fonts may be blocked or overlapped, which reduces the user's viewing experience and increases driving safety risks. Therefore, when the driver views the head-up display at a certain angle, the head-up display content needs to be displayed at the same angle to ensure that the user can clearly see the displayed content.

[0066] The offset angle may be an angle difference between the eyeball coordinates and the preset reference coordinates, and is used to determine the display angle. The viewing angle of the human eye looking at the head-up display area is determined according to the offset angle, and the viewing angle is determined as the display angle. After the display angle is determined, the head-up display system is controlled to display the display content at the display angle.

[0067] By determining the offset angle according to the angular difference between the eyeball coordinates and the preset reference coordinates, and determining the display angle according to the offset angle, the display angle of the display content relative to the display position can be adjusted according to the display angle, so that the user can clearly see all the display content when looking at the head-up display at different angles, thereby improving the driver's viewing experience and improving driving safety.

[0068] S250. Control the head-up display system to display the display content at the display position.

[0069] The head-up display system is controlled to display corresponding display content according to the display position, so that the display content is displayed at the display position.

[0070] Optionally, after controlling the head-up display system to display the display content at the display position, the method further includes, according to the display angle, controlling the head-up display system to display the display content at the display angle.

[0071] The technical solution of this embodiment is as follows: if not, then obtaining the driver's facial image captured by the image acquisition device of the driver monitoring system; determining whether the head-up display is turned on through the driver's facial image and the preset start-up information of the head-up display; if so, determining the eye position through the facial image, and determining the display position of the head-up display according to the eye position; controlling the head-up display system to display the display content to the display position, by adjusting the display position according to the eye position, so that the display position moves with the movement of the eye, the driver can see the display content of the head-up display in real time, thereby improving driving safety, and converting through the coordinate system is simple to implement, with low requirements on computing power, thereby improving the efficiency of display position determination, and thus improving the real-time tracking of the head-up display.

[0072] Embodiment 3

[0073] Figure 3 The figure shows a schematic diagram of the structure of a head-up display control device provided in the third embodiment of the present application. This embodiment is applicable to the case of controlling the head-up display and is configured in a vehicle body controller integrating a driver monitoring system and a head-up display system. The specific structure of the head-up display control device is as follows:

[0074] A fault detection module 310 is used to detect whether there is a fault in the image acquisition device in the driver monitoring system;

[0075] A control instruction detection module 320 is used to prompt the user to control the head-up display function by physical button mode or voice mode, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system;

[0076] The head-up display control module 330 is used to control the head-up display circuit to perform head-up display through the button display instruction or voice display instruction.

[0077] The technical solution of this embodiment is applied to a vehicle body controller that integrates a driver monitoring system and a head-up display system to detect whether the image acquisition device in the driver monitoring system has a fault; the driver monitoring system and the head-up display system are integrated into the vehicle body controller to improve the system integration, and the image acquisition device in the driver monitoring system is reused to reduce the hardware cost; if so, the user is prompted to control the head-up display function by physical buttons or voice, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system; if so, the head-up display circuit is controlled to perform head-up display through the button display instruction or the voice display instruction. In the case of a fault in the image acquisition device, the control of the head-up display can be sent by physical buttons or voice, effectively dealing with image acquisition faults, enriching the control method of the head-up display position, and ensuring the safety of the driver. Therefore, through the technical solution of this application, once the camera fails, the position of the head-up display cannot be effectively adjusted, and the installation of the head-up display optical machine has a high space requirement and high hardware cost, and the control method of the head-up display position is enriched and the hardware cost is reduced.

[0078] Optionally, the head-up display control device also includes:

[0079] a facial image acquisition module, for, if not, acquiring a facial image of the driver acquired by an image acquisition device of the driver monitoring system;

[0080] A head-up display on judgment module, used to determine whether to turn on the head-up display based on the driver's facial image and the preset on information of the head-up display;

[0081] A display position determination module, for determining the eyeball position through the facial image, and determining the display position of the head-up display according to the eyeball position;

[0082] The head-up display system control module is used to control the head-up display system to display the display content to the display position.

[0083] Optionally, a display position determination module includes:

[0084] An eyeball coordinate determination unit, used for identifying eyeballs in a facial image and determining eyeball coordinates in a preset human eye coordinate system;

[0085] A display offset determination unit, used for determining a display offset according to eyeball coordinates and preset reference coordinates;

[0086] The display position determining unit is used to determine the display position of the head-up display according to the display offset and a preset position mapping formula.

[0087] Optionally, the display position determination module further includes:

[0088] The display angle determination unit is used to determine the offset angle according to the angle difference between the eyeball coordinates and the preset reference coordinates, and determine the display angle according to the offset angle.

[0089] Optionally, the head-up display control device also includes:

[0090] Fatigue driving analysis module, used for driver monitoring system to analyze driver's facial image for fatigue driving;

[0091] A target warning mode determination module is used to determine the driver's fatigue level and determine the target warning mode if it is determined that the driver is driving fatigued;

[0092] The head-up display system adjustment module is used to control the head-up display system to adjust the display mode and display content according to the target warning mode.

[0093] Optionally, the head-up display control device also includes:

[0094] The alarm information display module is used to control the head-up display system to display the alarm information if the alarm information is obtained.

[0095] The head-up display control device provided in the embodiment of the present application can execute the head-up display control method provided in any embodiment of the present application, and has the corresponding functional modules and beneficial effects for executing the head-up display control method.

[0096] According to an embodiment of the present invention, the present invention also provides an electronic device, a readable storage medium and a computer program product.

[0097] Embodiment 4

[0098] Figure 4 A schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present application is shown in FIG. Figure 4 As shown, the electronic device includes a processor 410, a memory 420, an input device 430, and an output device 440; the number of the processor 410 in the electronic device can be one or more. Figure 4A processor 410 is taken as an example; the processor 410, the memory 420, the input device 430 and the output device 440 in the electronic device can be connected via a bus or other means. Figure 4 The example of connecting through bus is taken in the following.

[0099] The memory 420, as a computer-readable storage medium, can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the head-up display control method in the embodiment of the present application (for example, the fault detection module 310, the control instruction detection module 320 and the head-up display control module 330). The processor 410 executes various functional applications and data processing of the electronic device by running the software programs, instructions and modules stored in the memory 420, that is, implements the above-mentioned head-up display control method.

[0100] The memory 420 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 420 may further include a memory remotely arranged relative to the processor 410, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0101] The input device 430 may be used to receive input character information and generate key signal input related to user settings and function control of the electronic device. The output device 440 may include a display device such as a display screen.

[0102] Embodiment 5

[0103] Embodiment 5 of the present application also provides a storage medium containing computer executable instructions. When the computer executable instructions are executed by a computer processor, they are used to execute a head-up display control method, which is applied to a vehicle body controller that integrates a driver monitoring system and a head-up display system. The method includes: detecting whether there is a fault in the image acquisition device in the driver monitoring system; if so, prompting the user to control the head-up display function using a physical button or voice, and detecting whether there is a button display instruction sent through a physical button or a voice display instruction sent through a voice control system; if so, controlling the head-up display circuit to perform a head-up display through the button display instruction or the voice display instruction.

[0104] Of course, the computer executable instructions of a storage medium containing computer executable instructions provided in an embodiment of the present application are not limited to the method operations described above, and can also execute related operations in the head-up display control method provided in any embodiment of the present application.

[0105] Through the above description of the implementation method, the technicians in the relevant field can clearly understand that the present application can be implemented with the help of software and necessary general hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application can be essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions for an electronic device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0106] It is worth noting that in the embodiment of the above-mentioned head-up display control device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application.

[0107] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A head-up display control method, characterized in that: Applied to body controllers that integrate driver monitoring systems and head-up display systems, including: Detect whether the image acquisition device in the driver monitoring system is faulty; If yes, prompt the user to control the head-up display function by physical button mode or voice mode, and detect whether there is a button display instruction sent by a physical button or a voice display instruction sent by a voice control system; If so, the head-up display circuit is controlled to perform head-up display through the button display instruction or the voice display instruction.

2. The method according to claim 1, characterized in that After detecting whether the image acquisition device of the driver monitoring system is faulty, the method further includes: If not, obtaining a facial image of the driver captured by an image capture device of the driver monitoring system; Determining whether to turn on the head-up display based on the driver's facial image and preset turn-on information of the head-up display; If yes, determining the eyeball position through the facial image, and determining the display position of the head-up display according to the eyeball position; The head-up display system is controlled to display the display content at the display position.

3. The method according to claim 2, characterized in that The step of determining the eyeball position through the facial image and determining the display position of the head-up display according to the eyeball position includes: Identifying eyeballs in the facial image and determining eyeball coordinates in a preset human eye coordinate system; Determine the display offset according to the eyeball coordinates and the preset reference coordinates; The display position of the head-up display is determined according to the display offset and a preset position mapping formula.

4. The method according to claim 3, characterized in that After determining the display offset according to the eyeball coordinates and the preset reference coordinates, the method further includes: An offset angle is determined according to an angle difference between the eyeball coordinates and the preset reference coordinates, and a display angle is determined according to the offset angle.

5. The method according to claim 2, characterized in that: After acquiring the driver's facial image acquired by the image acquisition device of the driver monitoring system, the method further includes: The driver monitoring system performs fatigue driving analysis on the driver's facial image; If it is determined that the driver is driving fatigued, the driver's fatigue level is determined and the target warning method is determined; The head-up display system is controlled to adjust the display mode and display content according to the target warning mode.

6. The method according to claim 2, characterized in that After acquiring the driver's facial image acquired by the image acquisition device of the driver monitoring system, the method further includes: If the alarm information is obtained, the head-up display system is controlled to display the alarm information.

7. A head-up display control device, characterized in that: The body controller configured in the integrated driver monitoring system and head-up display system includes: A fault detection module, used to detect whether there is a fault in the image acquisition device in the driver monitoring system; A control command detection module, for, if yes, prompting the user to control the head-up display function by physical button mode or voice mode, and detecting whether there is a button display command sent by a physical button or a voice display command sent by a voice control system; The head-up display control module is used to control the head-up display circuit to perform head-up display through the button display instruction or voice display instruction.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the head-up display control method as described in any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the head-up display control method as described in any one of claims 1 to 6 is implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the head-up display control method according to any one of claims 1 to 6 is implemented.

Images