Window display method and device, equipment, medium and product
By dynamically managing in-vehicle screen displays based on driver attention, the method reduces visual distraction and enhances driving safety by ensuring minimal diversion from road conditions during operations.
Patent Information
- Application Number
- CN202510821255.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-19
- Publication Date
- 2025-07-15
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The frequent need for drivers to operate in-vehicle infotainment systems during driving leads to visual distraction, increasing the risk of accidents, especially in high-speed scenarios, as existing advanced driver assistance systems (ADAS) are costly, have recognition limitations, and provide only reactive warnings.
A method and system that detects driver attention using facial recognition and sensors to dynamically load and unload road condition windows on the infotainment screen based on driver interaction, ensuring minimal distraction by optimizing display configurations.
Enhances driving safety by reducing visual distraction from in-vehicle screens during operations, allowing drivers to maintain focus on the road.
Smart Images

Figure CN120307882A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of screen display, and particularly to a window display method, device, equipment, medium, and product. Background Art
[0002] With the development of automotive intelligence, modern vehicles are generally equipped with in-vehicle infotainment systems with large-sized central control screens, integrating composite function modules such as navigation, multimedia playback, and communication interaction. During driving, when the driver frequently needs to perform function setting operations such as navigation route replanning, call operations, and multimedia switching, the visual focus must be transferred from the driving road surface to the central control screen interface. This line-of-sight transfer process usually lasts for 1 to 2 seconds, and complex operations may even take longer.
[0003] However, in high-speed driving scenarios such as highways, this visual interruption behavior will cause the driver to be unable to monitor sudden road conditions in real time (such as emergency braking of the vehicle ahead, crossing of pedestrians or non-motor vehicles, etc.), significantly increasing the risk coefficient of collision accidents.
[0004] Existing solutions mainly rely on the accident warning function of the Advanced Driver Assistance System (ADAS), but there are the following technical limitations: First, the ADAS system needs to be configured with multiple environmental perception sensors (such as millimeter-wave radars, stereo vision cameras, etc.) and high-performance computing units, resulting in a significant increase in the overall vehicle cost and being difficult to popularize and apply in mid- to low-end vehicle models; Second, the obstacle recognition algorithm based on machine vision has recognition blind spots in scenarios such as complex lighting conditions and special target shapes, and the false alarm rate and missed alarm rate of the system have not reached an absolutely reliable level; Third, the existing system can only perform passive warning after the accident risk is formed, and cannot fundamentally eliminate the visual distraction hazard when the driver operates the in-vehicle device.
[0005] The above content is only used to assist in understanding the technical solution of this application, and does not represent an admission that the above content is prior art. Summary of the Invention
[0006] The main purpose of this application is to provide a window display method, device, equipment, medium, and product, aiming to solve the technical problem that operating the in-vehicle screen while driving a vehicle is likely to distract the driver and thus cause accidents.
[0007] To achieve the above purpose, this application proposes a window display method. The window display method is applied to the in-vehicle system and the in-vehicle screen of the in-vehicle system. The method includes: When detecting that the driver triggers a road condition window display instruction, load a road condition window onto the in-vehicle screen according to the pre-set window display configuration; Perform a trigger judgment on the road condition window through a window closing configuration. When it is judged that the window is closed, close the road condition window.
[0008] In one embodiment, the in-vehicle system further includes a driver detection platform, and the driver detection platform includes a camera device and a sensor. Before the step of loading a road condition window to the in-vehicle screen according to a preset window display configuration when it is detected that the driver triggers a road condition window display instruction, the method further includes: Performing face recognition on the driver through the camera device to obtain a face image; Reading driver information from a driver database according to the face image; Loading a window control configuration based on the driver information, where the window control configuration includes a window display configuration, a window closing configuration, and a window display mode configuration, and the window display mode configuration includes floating display, upper split screen display, right split screen display, and adaptive display; Performing attention detection on the driver through the driver detection platform to obtain an attention detection result; Judging whether the driver triggers a road condition window display instruction according to the attention detection result.
[0009] In one embodiment, the step of loading a road condition window to the in-vehicle screen according to a preset window display configuration includes: Analyzing the window display mode configuration to obtain a first display area, a first split screen setting, and a first application display content of the vehicle driving picture; Performing image rendering on the received video data through a camera frame multiplexing module to obtain a road condition video; Loading the road condition video to the in-vehicle screen based on the first display area, the first split screen setting, and the second application display content.
[0010] In one embodiment, after the step of loading a road condition window to the in-vehicle screen according to a preset window display configuration, the method further includes: Receiving an operation instruction of the driver, and analyzing the operation instruction to obtain the operation application of the driver; Updating the display area, the split screen setting, and the application display content based on the application display configuration of the operation application to obtain a second display area, a second split screen setting, and a second application display content; Loading the road condition video to the in-vehicle screen based on the second display area, the second split screen setting, and the second application display content.
[0011] In one embodiment, the step of performing attention detection on the driver through the driver detection platform to obtain an attention detection result includes: When the window display is configured to be automatically displayed, perform line-of-sight detection on the face image through a binocular attention direction recognition algorithm to obtain a line-of-sight detection result; Perform hand position detection on the driver through the sensor and the hand position algorithm to obtain a hand position detection result; Perform attention detection on the driver according to the line-of-sight detection result and the hand position detection result to obtain an attention detection result.
[0012] In one embodiment, the step of performing attention detection on the driver through the driver detection platform to obtain an attention detection result further includes: When the window display is configured to be passively displayed, detect whether the driver has an interaction input, where the interaction input includes physical button input, voice command input, and screen gesture input; If it is detected that the driver has an interaction input, then obtain an attention detection result that the driver's attention is not on the vehicle driving road.
[0013] In addition, to achieve the above object, the present application also proposes a window display device, which is applied to a vehicle machine system, and the vehicle machine system includes a vehicle machine screen. The device includes: A loading module, configured to load a road condition window to the vehicle machine screen according to a pre-set window display configuration when it is detected that the driver triggers a road condition window display instruction; A closing module, configured to perform a trigger judgment on the road condition window through a window closing configuration, and close the road condition window when it is determined that the window is closed.
[0014] In addition, to achieve the above object, the present application also proposes a window display device, which includes: a memory, a processor, and a computer program stored on the memory and executable on the processor. The computer program is configured to implement the steps of the window display method as described above.
[0015] In addition, to achieve the above object, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the window display method as described above.
[0016] In addition, to achieve the above object, the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the steps of the window display method as described above.
[0017] One or more technical solutions proposed by the present application have at least the following technical effects: A window display method, device, equipment, medium and product proposed in an embodiment of the present application, when detecting that a driver triggers a road condition window display instruction, loads a road condition window to the in-vehicle screen according to a pre-set window display configuration; makes a trigger judgment on the road condition window through a window closing configuration, and closes the road condition window when it is judged that the window is closed. Thus, when detecting that a driver triggers a road condition window display instruction, the road condition window is loaded to the in-vehicle screen according to the window display configuration, and it is judged whether the road condition window is closed through the window closing configuration. When it is determined that the window is closed, a closing process is performed on the road condition window, solving the problem that operating the in-vehicle screen while driving a vehicle is likely to distract the driver and cause an accident, thereby improving driving safety. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present application and, together with the specification, are used to explain the principles of the present application.
[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.
[0020] Figure 1 It is a flowchart provided for Embodiment 1 of the window display method of the present application; Figure 2 It is a schematic diagram of the method for displaying a floating road condition window involved in the window display method of the present application; Figure 3 It is a schematic diagram of the method for displaying a front road condition window in a right split screen involved in the window display method of the present application; Figure 4 It is a schematic diagram of the method for displaying a front road condition window in an upper split screen involved in the window display method of the present application; Figure 5 It is a schematic diagram of the method for multi-source data fusion involved in the window display method of the present application; Figure 6 It is a schematic diagram of the split screen method between the address book application and the road condition window involved in the window display method of the present application; Figure 7 It is a schematic diagram of the split screen method between the navigation application and the road condition window involved in the window display method of the present application; Figure 8 It is a flowchart provided for Embodiment 2 of the window display method of the present application; Figure 9 It is a brief flowchart of the window display method provided for Embodiment 2 of the present application; Figure 10 Schematic diagram of the module structure of the window display device according to an embodiment of the present application; Figure 11 Schematic diagram of the device structure of the hardware operating environment involved in the window display method according to an embodiment of the present application.
[0021] The implementation, functional features, and advantages of the present application will be further described in conjunction with embodiments and with reference to the accompanying drawings. Specific embodiments
[0022] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.
[0023] For a better understanding of the technical solutions of the present application, the following will be described in detail in conjunction with the drawings of the specification and specific embodiments.
[0024] The main solution of the embodiment of this application is as follows: The driving person is subjected to face recognition by the camera device to obtain a face image; the driving person information is obtained by reading a driving person database according to the face image; a window control configuration is loaded based on the driving person information, and the window control configuration includes a window display configuration, a window closing configuration, and a window display mode configuration, and the window display mode configuration includes floating display, upper split-screen display, right split-screen display, and adaptive display; the driving person is subjected to attention detection by a driver detection platform to obtain an attention detection result; it is judged whether the driving person triggers a road condition window display instruction according to the attention detection result. The first display area, the first split-screen setting, and the first application display content of the vehicle driving picture are obtained by parsing the window display mode configuration; the received video data is subjected to image rendering by a camera frame multiplexing module to obtain a road condition video; based on the first display area, the first split-screen setting, and the second application display content, the road condition video is loaded onto the vehicle-mounted screen. An operation instruction of the driving person is received, and the operation application of the driving person is obtained by parsing the operation instruction; based on the application display configuration of the operation application, the display area, the split-screen setting, and the application display content are updated to obtain a second display area, a second split-screen setting, and a second application display content; based on the second display area, the second split-screen setting, and the second application display content, the road condition video is loaded onto the vehicle-mounted screen. In the case where the window display configuration is automatic display, the line-of-sight detection is performed on the face image by a binocular attention direction recognition algorithm to obtain a line-of-sight detection result; the hand position detection is performed on the driving person by the sensor and the hand position algorithm to obtain a hand position detection result; the attention detection is performed on the driving person according to the line-of-sight detection result and the hand position detection result to obtain an attention detection result. In the case where the window display configuration is passive display, it is detected whether the driving person has an interactive input, and the interactive input includes physical button input, voice command input, and screen gesture input; if it is detected that the driving person has an interactive input, the attention detection result is obtained that the attention of the driving person is not on the vehicle driving road. Thereby, the problem that the operation of the vehicle-mounted screen during driving easily distracts the driving person and thus causes an accident is solved, the display of the window is realized, and the driving safety is improved. Based on the solution of the present invention, starting from the problem that in reality, there is no scenario where when the driver operates the main screen of the vehicle-mounted device, the line of sight has to be transferred to the vehicle-mounted screen, which easily leads to traffic accidents, a window display method is designed, and the effectiveness of the window display method of the present invention is verified when the window is displayed. Finally, the safety of vehicle driving is significantly improved through the method of the present invention.
[0025] In this embodiment, for the convenience of description, the following will be described with the window display device as the execution subject.
[0026] Since there is no scenario in the prior art where, when a driver operates the main screen of the in-vehicle infotainment (IVI) system, they have to divert their line of sight to the IVI screen, which can easily lead to traffic accidents. Currently, most cars are equipped with relatively large central control screens that integrate a large number of functions convenient for driving, such as radio, music, navigation, telephone, message sending and receiving, etc. When the vehicle is traveling at high speed, the driver often needs to make some settings on the IVI system. For example, in scenarios such as changing the navigation destination, re-planning the route, making a phone call, or switching radio programs. At this time, the driver's line of sight must leave the road surface and focus on the IVI screen, resulting in a loss of effective observation of the road surface condition for at least 1 or 2 seconds, or even several seconds or longer. If there is a sudden change in road conditions at this time, the driver cannot quickly detect and respond, easily causing rear-end collisions, or hitting suddenly emerging pedestrians, electric vehicles, etc., leading to traffic accidents. Moreover, the current technology relies on the vehicle's assisted driving technology, with high implementation costs, and many vehicles are not yet equipped. In addition, the recognition algorithms of assisted driving are not 100% accurate and there is still a possibility of failure, so it cannot completely solve the risk caused by the driver's line of sight leaving the road surface when operating the main screen of the IVI system.
[0027] The present application provides a solution. In the IVI system, it is determined whether a road condition window is to be displayed based on the attention detection result of the driver. When it is determined that the window is to be displayed, the road condition window is loaded onto the IVI screen according to the window display configuration. At the same time, a trigger judgment is made on the road condition window through the window closing configuration. When it is judged that the window is to be closed, the road condition window is closed, providing a better service for users.
[0028] As can be seen from the above embodiments, in the present application, when it is detected that the driver triggers a road condition window display instruction, the road condition window is loaded onto the IVI screen according to the pre-set window display configuration; a trigger judgment is made on the road condition window through the window closing configuration. When it is judged that the window is to be closed, the road condition window is closed. Thus, when it is detected that the driver triggers a road condition window display instruction, the road condition window is loaded onto the IVI screen according to the window display configuration, and it is judged whether the road condition window is closed through the window closing configuration. When it is determined that the window is closed, the road condition window is closed, solving the problem that operating the IVI screen while driving the vehicle easily distracts the driver, thereby causing accidents, and improving driving safety.
[0029] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication, and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device, a window display device, etc. that can implement the above functions. Hereinafter, the window display device is taken as an example to illustrate this embodiment and the following embodiments.
[0030] Based on this, an embodiment of the present application provides a window display method, referring toFigure 1 , Figure 1 is a schematic flowchart of the first embodiment of the window display method of the present application.
[0031] In this embodiment, the window display method is applied to a vehicle-mounted system, which includes a driver detection platform and a vehicle-mounted screen. The method includes steps S01 to S02: Step S01, when it is detected that the driver triggers a road condition window display instruction, load the road condition window to the vehicle-mounted screen according to the pre-set window display configuration; It should be clear that with the development of vehicle intelligence, modern vehicles are generally equipped with in-vehicle infotainment systems with large-sized central control screens, integrating composite function modules such as navigation, multimedia playback, and communication interaction. During driving, when the driver frequently needs to perform function setting operations such as re-planning the navigation route, making a call, and switching multimedia, the visual focus must be transferred from the driving road surface to the central control screen interface. This line-of-sight transfer process usually lasts for 1 to 2 seconds, and complex operations even require longer time.
[0032] However, in high-speed driving scenarios such as highways, this visual interruption behavior will cause the driver to be unable to monitor sudden road conditions in real time (such as emergency braking of the vehicle in front, crossing of pedestrians or non-motor vehicles, etc.), significantly increasing the risk coefficient of collision accidents.
[0033] Existing solutions mainly rely on the accident warning function of the advanced driver assistance system (ADAS), but there are the following technical limitations: First, the ADAS system needs to be equipped with multiple environmental perception sensors (such as millimeter-wave radar, stereo vision cameras, etc.) and high-performance computing units, resulting in a significant increase in the overall vehicle cost and being difficult to popularize and apply in mid-range and low-end models; Second, the obstacle recognition algorithm based on machine vision has recognition blind spots in scenarios such as complex lighting conditions and special target shapes, and the false alarm rate and missed alarm rate of the system have not reached an absolutely reliable level; Third, the existing system can only give passive warnings after the accident risk is formed, and cannot fundamentally eliminate the visual distraction hidden danger when the driver operates the in-vehicle device.
[0034] Therefore, in order to solve the above problems, in this embodiment, when it is detected that the driver triggers a road condition window display instruction, load the road condition window to the vehicle-mounted screen according to the pre-set window display configuration. Among them, whether to trigger in this embodiment can be realized through window control configuration, which can detect the driver's identity information when the driver gets in the car and select the corresponding display configuration, trigger configuration, etc.
[0035] Step S02, perform a trigger judgment on the road condition window through the window closing configuration, and close the road condition window when it is judged that the window is closed.
[0036] In this embodiment, the main problem to be addressed is to provide the driver with a road condition video of the vehicle's traveling direction when the driver needs to temporarily operate the in-vehicle screen. Specifically, in scenarios such as when the driver's communication device is connected to the in-vehicle system and the driver needs to make a call, the in-vehicle screen can provide a list of contacts. At this time, the driver's attention will shift to the in-vehicle screen. At this time, the in-vehicle system will sense that the driver's attention is not on the vehicle's driving road, and will load the road condition window onto the in-vehicle screen according to the pre-set window display configuration for the driver to view the road conditions.
[0037] After the operation is completed, it is also necessary to consider the closing of the road condition window so that the in-vehicle screen can display the corresponding application program. Therefore, a trigger judgment is made on the road condition window through the window closing configuration. In the case where it is judged that the window is closed, the road condition window is closed, realizing the display and closing of the road condition window.
[0038] Specifically, in order to achieve the rapid loading and display effect of the road condition window, this embodiment also needs to pre-set the window display configuration, etc. Therefore, the above in-vehicle system further includes a driver detection platform. The driver detection platform includes a camera device and a sensor. In the above step S01, before the step of loading the road condition window onto the in-vehicle screen according to the pre-set window display configuration in the case of detecting that the driver triggers the road condition window display instruction, the method further includes: Step S0101, performing face recognition on the driver through the camera device to obtain a face image; Step S0102, reading the driver information from the driver database according to the face image; Step S0103, loading the window control configuration based on the driver information. The window control configuration includes a window display configuration, a window closing configuration, and a window display mode configuration. The window display mode configuration includes floating display, upper split-screen display, right split-screen display, and adaptive display; Step S0104, performing an attention detection on the driver through the driver detection platform to obtain an attention detection result; Step S0105, judging whether the driver triggers the road condition window display instruction according to the attention detection result.
[0039] First, device initialization and calibration are required. In this embodiment, the in-vehicle near-infrared camera is started, and the focal length and angle are adjusted to cover the upper body of the driver. Subsequently, the dynamic exposure compensation algorithm is pre-loaded to adapt to strong / weak light environments (such as tunnel entrance and exit scenarios). Then, the lightweight MTCNN model is used to detect the face area in real time, filtering out invalid images with an occlusion rate > 30% (such as masks and sunglasses), and distinguishing real faces from photos / screen captures through live detection technologies (such as eyeball micro-motion tracking and 3D structured light depth detection).
[0040] Then, the ArcFace algorithm is used to extract a 512-dimensional face feature vector. After normalization, it is compared with the database (cosine similarity threshold ≥ 0.75). Exception handling: After 3 consecutive recognition failures, a voice prompt "Please adjust your sitting posture" is triggered and the detection is paused for 5 seconds. If there is no abnormal situation, the face image of the driver is obtained.
[0041] Subsequently, driver information matching is performed. Using the database query logic, the driver database (SQLite / MySQL) is matched according to the feature vector. It should be clear that the driver's information can be obtained and recorded in advance through settings such as the driver obtaining and recording their face through the APP on the communication device after purchasing the vehicle. In this embodiment, an edge-side caching mechanism is also used, that is, the feature vectors of the last 10 drivers are locally stored to reduce the cloud query latency. To protect the privacy and security of the driver's information, in this embodiment, the face feature vectors are encrypted by AES-256, and not only are they transmitted to the trusted execution environment (TEE), but the access permissions are also restricted to necessary fields (such as not returning sensitive information such as driver's license numbers).
[0042] After the corresponding driver information is recognized from the face image, the JSON configuration file in the driver information can be parsed to obtain the window control configuration corresponding to the driver. The window control configuration specifically includes window display configuration (auto-open or passive-open), window closing configuration (auto-close or passive-close), and window display mode configuration (including the display position of the window and the split-screen mode with other applications, etc., and also includes the floating display, upper split-screen display, right split-screen display, and adaptive display of the road condition window).
[0043] Since the in-vehicle system of this embodiment is configured with a driver detection platform and an in-vehicle screen, during the vehicle driving process, the driver's attention can be detected through the driver detection platform to obtain whether the driver's current attention is focused on the vehicle driving road. When it is detected that the driver's attention is not on the vehicle driving road, the road condition window is loaded onto the in-vehicle screen according to the window display configuration for the driver to view the road conditions, ensuring the safety of the driver during driving.
[0044] In this embodiment, the driver's information is stored in advance, and the window display configuration corresponding to the driver is recognized before the driver starts driving, providing a more intelligent and convenient configuration loading method for users without the need to adjust it every time during driving.
[0045] More specifically, the above step S01, the step of loading the road condition window onto the in-vehicle screen according to the pre-set window display configuration includes: Step S011, analyze the window display mode configuration to obtain the first display area, the first split-screen setting, and the first application display content of the vehicle driving screen; Step S012, perform image rendering on the received video data through the camera frame multiplexing module to obtain a road condition video; Step S013, based on the first display area, the first split-screen setting, and the second application display content, load the road condition video onto the vehicle-mounted screen.
[0046] For the real-time video window of the road surface in front of the vehicle, the video screen of the driving recorder can be reused (suitable for the case of relatively low vehicle configuration, and the video data can be obtained through the purchased driving recorder), or it can be the video collected by a dedicated front-view camera. The video can be appropriately cropped to include the main information of the road surface in front. The video angle and clarity of the camera should ensure that the small window can completely and clearly display the road conditions in front, allowing the driver to easily observe the main object information on the road surface. Once a situation is found, the driver can immediately return the line of sight to the actual road surface and take corresponding measures such as braking and steering.
[0047] In order to enable the driver to conveniently observe the road conditions in front in the small window while operating the central control screen, in this embodiment, the window display mode corresponding to the driver is analyzed to obtain the first display area, the first split-screen setting, and the first application display content of the vehicle driving screen. Among them, the display area is the display position of the window, which can be in all aspects of the vehicle-mounted screen and is displayed correspondingly according to the driver's preset settings. The split-screen setting provides floating, upper split-screen, and right split-screen display modes for the road condition window. The first application display content is the picture that may already be displayed by an application (such as a music player or a navigation software) when the driver opens the road condition window. For the smooth loading, in this embodiment, the loaded road condition window is adapted according to the application display content previously set by the driver and is displayed on the vehicle-mounted screen for the driver to operate. In addition, the driver can also adjust the display position, display mode, and display size of the window through finger clicks and drag operations. This embodiment also implements a memory function, which can record the driver's last display mode and can also predefine multiple display modes of the small window. A group of semi-transparent display mode switching buttons are provided at a certain position on the main screen (such as the upper left corner) for quick switching. Ensure that the driver can obtain the best display mode in time without affecting the convenience of the driver's touch operation on the screen. The small window should be kept in a position where the driver can easily notice it and should not be blocked by the hand to ensure that the driver can always pay attention to the road conditions in front during the operation and can quickly brake or avoid in case of an emergency.
[0048] The specific display of the road condition window is as Figure 2The floating display road condition window mode shown in the figure, after triggering and opening the window, the front road condition picture is floatingly displayed on the center control screen. In this way, the main picture does not need to change, but some content will be blocked by the road condition window. The user can drag the position of the floating road condition window by touch to avoid affecting the current operation and facilitate observing the road condition information.
[0049] The right split-screen display mode is as Figure 3 shown. The front road condition window is split-screen displayed on the right side of the center control screen. This mode horizontally shrinks the main car machine picture while keeping the height unchanged, and the vacated position is used for the road condition window to be displayed.
[0050] The upper split-screen display mode is as Figure 4 shown. The center control screen is split-screened above to display the front road condition window. This mode vertically shrinks the main car machine picture while keeping the width unchanged, and the vacated position above is used for the road condition window to be displayed.
[0051] This embodiment also provides a screen virtual button solution, that is, a schematic diagram of the quick switching button for the road condition window display mode, as Figure 4 shown by the 3 buttons in the upper left corner. It can be set that double-clicking on the small window will switch between the split-screen display and floating display modes. When the floating window is dragged close to the upper part of the screen and double-clicked on the small window, it will switch to the upper split-screen display mode. When the floating window is dragged close to the right side of the screen and double-clicked on the small window, it will switch to the right split-screen display mode. These 3 display modes can basically meet the needs of various operation scenarios of the driver, and the remaining display modes can also be set correspondingly according to the actual needs of the user.
[0052] Furthermore, the solution of this embodiment is as Figure 5 shown. In the input information and data acquisition part, it includes the input information of the road condition window function (loading of configuration information) and data acquisition (acquisition of road condition video data). Among them, the real-time road condition video data acquisition is to acquire road condition video data through a dedicated in-vehicle front camera or a driving recorder. The vehicle driving state information is that the vehicle machine system acquires the current vehicle driving state information by monitoring the user's voice commands, touch operations, button inputs, etc. These information will be used as the basic data for subsequent processing. The DMS driver's line of sight and hand position monitoring is to monitor the driver's line of sight direction and hand position through the driver monitoring system (DMS), which may be used to judge the driver's attention state, etc., to assist in the decision-making of the road condition window function. The road condition window function configuration is the above-mentioned window display configuration, which involves the setting of relevant configuration parameters of the road condition window function.
[0053] After obtaining the above configuration information and data, the actual control of the road condition window can be carried out. According to the various input information and configuration parameters obtained previously, the core control logic processing is performed in this module to determine the display switch state, display mode (such as full screen, half screen, etc.) and display position of the road condition window, etc.
[0054] The display processing of the road condition window then performs specific display processing on the road condition window according to the result of the core control logic, including rendering road condition video data, etc., to present appropriate road condition information display to the user. Among them, for the display windows of relevant applications (APPs) in the cockpit, the shape and position can also be adjusted accordingly according to the display situation of the road condition window to ensure the coordination and reasonableness of the overall display effect.
[0055] In this embodiment, by obtaining a variety of input information and data, through the processing of the core control logic, the reasonable display of the road condition window and the coordinated adjustment of the display windows of relevant applications are finally realized, so as to provide appropriate road condition information display for the driver, while taking into account various requirements such as driving safety and operation convenience.
[0056] Specifically, after the step S01 of loading the road condition window to the in-vehicle screen according to the pre-set window display configuration, the method further includes: Step S0106, receiving the operation instruction of the driver, and parsing the operation instruction to obtain the operation application of the driver; Step S0107, based on the application display configuration of the operation application, updating the display area, split screen setting and application display content to obtain a second display area, a second split screen setting and a second application display content; Step S0108, based on the second display area, the second split screen setting and the second application display content, loading the road condition video to the in-vehicle screen.
[0057] When the in-vehicle system is in the running state, it waits for the operation instruction of the driver. For example, the driver can issue an operation instruction through touch operation on the in-vehicle screen, physical button operation or voice instruction, etc. After the system receives the instruction, it will parse it to determine the specific operation application that the driver wants to use, such as address book list query and navigation route planning, etc.
[0058] Such as Figure 6As shown, according to the operation application selected by the driver (assumed to be "address book list query"), the system will re-plan the display area of the in-vehicle screen. The relatively large area that might originally be used to display the road condition window (the large rectangular area on the right in the figure) may be adjusted to meet the display requirements of the new application. If the in-vehicle screen was in a certain split-screen state before (such as simultaneously displaying the road condition window and other content), when the driver selects the "address book list query" application, the split-screen setting will change accordingly. It may change from the split-screen mode where the road condition window occupies a relatively large area to the split-screen mode where the address book list query interface occupies the main display area. For the "address book list query" application, the system will also load the corresponding display content of this application, such as interface elements like the contact list and search bar, to form the second application display content. At the same time, other originally displayed content (such as the road condition window content) will be hidden or have its display ratio reduced, etc., to obtain the second display area and the second split-screen setting. After completing the update of the display area, split-screen setting, and application display content, if the driver needs to view the road condition information during the operation process, the system will, based on the layout of the new second display area, second split-screen setting, and second application display content, load the road condition video to an appropriate position on the in-vehicle screen (which may be the previous road condition window position or a re-planned position). For example, if the previous split-screen setting has changed, the road condition video may be loaded and displayed in a smaller window form, or when the driver switches back to the road condition viewing interface, it will be re-loaded and displayed in a larger window (such as the large rectangular area on the right in the figure) so that the driver can clearly view the road condition information.
[0059] Similarly, as Figure 7 shown, when the user operates the navigation destination setting, the navigation interface is displayed at the bottom of the screen, and the road condition window is displayed above, which is more convenient for the driver's route navigation operation.
[0060] Through the above method, in this embodiment, the road condition window is adjusted for the actually used application, realizing the driver's convenient operation of the central control, avoiding the driver having to focus on the central control screen for a long time, and improving the safety of driving the vehicle.
[0061] In this embodiment, through the above solution, specifically, when it is detected that the driver triggers a road condition window display instruction, the road condition window is loaded onto the vehicle-mounted screen according to the pre-set window display configuration; a trigger judgment is made on the road condition window through the window closing configuration, and when it is judged that the window is closed, the road condition window is closed. Thus, when it is detected that the driver triggers a road condition window display instruction, the road condition window is loaded onto the vehicle-mounted screen according to the window display configuration, and it is judged whether the road condition window is closed through the window closing configuration. When it is determined that the window is closed, a closing process is performed on the road condition window, solving the problem that operating the vehicle-mounted screen while driving easily distracts the driver, thus causing an accident, and improving driving safety.
[0062] Based on the first embodiment of this application, in the second embodiment of this application, the same or similar content as the above first embodiment can be referred to the above introduction and will not be repeated hereinafter. On this basis, please refer to Figure 8 , in step S0104 of the above embodiment, in the step of performing attention detection on the driver through the driver detection platform to obtain an attention detection result, the window display method further includes steps S011 to S013: Step S01041, when the window display configuration is automatic display, perform line-of-sight detection on the face image through a binocular attention direction recognition algorithm to obtain a line-of-sight detection result; Step S01042, perform hand position detection on the driver through the sensor and the hand position algorithm to obtain a hand position detection result; Step S01043, perform attention detection on the driver according to the line-of-sight detection result and the hand position detection result to obtain an attention detection result.
[0063] In the above embodiment, after performing face recognition on the driver, the window display configuration corresponding to the driver can be obtained, including the window display configuration. It should be clear that the switch of the window display can be active display and automatic display. Actually, it should be based on the user's settings. When the window display configuration is automatic display, during the driving of the vehicle, line-of-sight detection is performed on the real-time face image through a binocular attention direction recognition algorithm to obtain the driver's line-of-sight detection result. Subsequently, position detection is performed on the driver's hand through the set sensor and hand position algorithm to obtain a hand position detection result. Finally, attention detection is performed on the driver according to the line-of-sight detection result and the hand position detection result to obtain an attention detection result.
[0064] More specifically, the in-vehicle unit of this embodiment combines automatic scene recognition with a dedicated or DMS camera, which can automatically open and close the road condition window. It adds a face and hand recognition camera above the main screen of the in-vehicle unit, or reuses the DMS camera, and enables the driver's binocular attention direction recognition algorithm and hand position recognition algorithm. During the vehicle driving process, when continuously recognizing that the angle of the driver's binocular attention is aligned with the center control screen (allowing an angle deviation within a certain value range, such as within the range of plus or minus 10 degrees) for a duration greater than a certain time, such as 1 s, and at the same time recognizing that the driver's hand is in the position above the main screen, the attention detection result can be obtained that the driver's attention is not on the vehicle driving road, and the road condition window is automatically opened. When the vehicle stops, or when recognizing that the angle of the driver's binocular attention is not aligned with the camera for a duration greater than a certain time, such as 1 s, and at the same time recognizing that the driver's hand is not operating on the main screen, the attention detection result is obtained that the driver's attention is on the vehicle driving road, and the road condition window is automatically closed.
[0065] After the in-vehicle unit receives the start command of the road condition window, on the center control screen of the in-vehicle unit, a road condition window of the front road surface is opened in an appropriate manner, and the window is displayed on the center control screen in a suitable way. The display method and position can be preset and adjusted in real time according to user needs to ensure that it does not block the display interface that the user is concerned about, and at the same time allows the user to pay attention to whether there are special situations on the front road surface through the road condition window. After the user completes the operation of the in-vehicle unit (for example: temporarily viewing important information, searching for contacts, switching the music or radio played by the in-vehicle unit, etc.), and transfers the attention back to the front road surface, the user can close the road condition window through the automatic scene recognition of the in-vehicle unit.
[0066] Further, the step S0104 of obtaining the attention detection result by detecting the driver's attention through the driver detection platform further includes: Step S01044, when the window display is configured as passive display, detecting whether the driver has an interactive input, where the interactive input includes physical button input, voice command input, and screen gesture input; Step S01045, if it is detected that the driver has an interactive input, then the attention detection result is obtained that the driver's attention is not on the vehicle driving road.
[0067] In addition to the automatic display, this embodiment also provides a way for the driver to actively operate, that is, the passive display of the traffic condition window (it should be clear here that in actual use, usually both are combined, that is, it can be actively opened by the driver during driving, or it can be passively opened after the vehicle computer detects the driver's attention). The passive display mainly relies on the driver's interactive input, including but not limited to cockpit quick physical buttons, voice commands, and specific touch gestures, etc. During the high-speed driving of the vehicle, the driver can send a start command for a real-time traffic condition window (hereinafter referred to as "traffic condition window") in the following ways, that is, cockpit quick physical buttons, specific voice commands, and specific touch screen gestures (such as three fingers sliding down in parallel or swiping left, etc.) to open the traffic condition window. Among them, the cockpit quick physical buttons can use the physical buttons on the steering wheel or the physical buttons on the center console. Click to open the traffic condition window display and double-click or long-press to close the traffic condition window. The specific voice commands include "open traffic condition window" and "close traffic condition window", etc. The specific touch screen gestures are three fingers sliding down in parallel or swiping left to open the traffic condition window and three fingers sliding up or swiping right to close the traffic condition window.
[0068] Through the above window display configuration, it is realized that the traffic condition window can be automatically displayed, passively displayed or a combination of both according to the actual settings of the user. When the driver temporarily operates the vehicle computer screen, a traffic condition window on the road where the vehicle is traveling is provided for the driver, improving the safety of driving the vehicle.
[0069] It should be clear that this embodiment also includes a way to close the window, which can be specifically determined according to the window closing configuration, including automatic closing, that is, detecting the driver's attention through the line-of-sight detection result and the hand position detection result. When it is detected that the driver's attention is on the road, the traffic condition window can be closed. In addition, it can also be passive closing, that is, the driver actively inputs, including physical button input, voice command input, and screen gesture input to close the traffic condition window.
[0070] Through the above solution in this embodiment, specifically, when the window display configuration is set to automatic display, the line-of-sight detection of the face image is performed through the binocular attention direction recognition algorithm to obtain the line-of-sight detection result; the hand position of the driver is detected through the sensor and the hand position algorithm to obtain the hand position detection result; the driver's attention is detected according to the line-of-sight detection result and the hand position detection result to obtain the attention detection result. Thus, when it is detected that the driver triggers the traffic condition window display instruction, the traffic condition window is loaded onto the vehicle computer screen according to the window display configuration, and it is judged whether the traffic condition window is closed through the window closing configuration. When it is determined to be closed, the traffic condition window is closed, solving the problem that operating the vehicle computer screen while driving easily distracts the driver, thus leading to accidents, and improving the safety of driving.
[0071] Exemplarily, to help understand the implementation process of the window display method obtained by combining the present embodiment with the above-mentioned Embodiment 1, please refer to Figure 9 , Figure 9 A schematic diagram of the brief process of a window display method is provided. Specifically: The acquisition of real-time traffic condition video data mainly reuses the camera data. First, the front-view camera video frame reuse module of the intelligent vehicle head unit is preferentially used to obtain the front-view camera video frame data. If the vehicle head unit does not have this reuse module, it is necessary to develop and implement the acquisition of the front-view camera video data by itself. In addition, the front-view camera video data can also be obtained through other means such as a dash cam.
[0072] The vehicle head unit system monitors relevant information, that is, through user operations and vehicle state monitoring, including real-time acquisition of driver voice commands, touch screen operation data, and button input information, so as to judge whether to start or close the traffic condition window. At the same time, the vehicle driving state information is obtained, and the traffic condition window is only started when the vehicle is driving. In this embodiment, the cockpit quick physical button operation can also be used, and the physical buttons on the steering wheel or the center console can be used. For example, click to open the traffic condition window display, double-click or long-press to close the traffic condition window, which can be flexibly set according to the vehicle cockpit function. Among them, specific voice and touch gesture operations include specific voice commands, such as "open the traffic condition window" and "close the traffic condition window", and specific touch screen gestures include three fingers sliding down or left to open the traffic condition window and three fingers sliding up or right to close the traffic condition window.
[0073] For the DMS driver's line of sight and hand position monitoring, a face and hand recognition camera is added above the main screen of the vehicle head unit or the DMS camera is reused to obtain the input image of the camera. The driver's state is recognized through the driver's binocular attention direction recognition algorithm and hand position recognition algorithm. During vehicle driving, when the binocular attention angle is aligned with the center control screen (allowing a deviation of plus or minus 10 degrees) for more than 1 s and the hand is above the main screen, the traffic condition window is automatically opened. When the vehicle stops or the binocular attention angle is not aligned with the camera for more than 1 s and the hand is not operating on the main screen, the traffic condition window is automatically closed.
[0074] The traffic condition window function configuration includes the opening method configuration (whether to enable opening methods such as voice, screen virtual buttons, physical buttons, touch screen gestures, and automatic recognition of DMS camera scenarios), and the specific parameters of each opening method are configured to meet the user's personal habits. In addition, there are also display-related configurations, which can configure the default display method of the traffic condition window, whether to enable adaptive display adjustment, and the adjustment of the touch gesture control display method.
[0075] The road condition window display switch, display method, and position control logic mainly synthesize the information of each input module above, judge in real time whether the road condition window is opened or closed, control its display position and method, generate control commands and send them to the road condition window display module for execution.
[0076] During the processing of the road condition window display, the multiplexed data of the front view camera frame is obtained to display the real-time road condition video, and control messages are received. The road condition window display is opened or closed as required and the display method is adjusted. At the same time, the display status and method are sent to the shape and position adjustment processing module of the cockpit APP display window.
[0077] The shape and position adjustment of the cockpit APP display window then synthesizes the information of the currently displayed APP content, the road condition window display content and method, adjusts the display method of the currently displayed APP, and unifies the display of the road condition window and the adjusted APP display content on the in-vehicle infotainment system central control screen.
[0078] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the window display method of this application. Based on this technical concept, more forms of simple transformations are within the protection scope of this application.
[0079] This application also provides a window display device. Please refer to Figure 10 , The window display is applied to the in-vehicle infotainment system. The in-vehicle infotainment system includes a driver detection platform and an in-vehicle infotainment system screen. The device includes: A loading module 10, configured to detect the driver's attention through the driver detection platform to obtain an attention detection result; A closing module 20, configured to load a road condition window to the in-vehicle infotainment system screen according to a pre-set window display configuration when the attention detection result indicates that the driver's attention is not on the vehicle driving road.
[0080] The window display device provided by this application adopts the window display method in the above embodiment, and can solve the technical problem that operating the in-vehicle infotainment system screen while driving easily distracts the driver, thereby causing accidents. Compared with the prior art, the beneficial effects of the window display device provided by this application are the same as those of the window display method provided by the above embodiment, and other technical features in the window display device are the same as those disclosed in the method of the above embodiment, and will not be elaborated here.
[0081] This application provides a window display device. The window display device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the window display method in the first embodiment above.
[0082] The following refers to Figure 11 , which shows a schematic structural diagram of a window display device suitable for implementing the embodiments of the present application. The window display device in the embodiments of the present application may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 11 The window display device shown is merely an example and should not impose any limitations on the functions and usage scope of the embodiments of the present application.
[0083] As Figure 11 shown, the window display device may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to the program stored in the read-only memory 1002 or the program loaded from the storage device 1003 into the random access memory 1004. In the random access memory 1004, various programs and data required for the operation of the window display device are also stored. The processing device 1001, the read-only memory 1002, and the random access memory 1004 are connected to each other through a bus 1005. An input / output interface 1006 is also connected to the bus. Generally, the following systems may be connected to the input / output interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the window display device to communicate with other devices wirelessly or wiredly to exchange data. Although the figure shows a window display device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be alternatively implemented or had.
[0084] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a read-only memory 1002. When the computer program is executed by a processing device 1001, the above functions defined in the methods of the embodiments disclosed in the present application are executed.
[0085] The window display device provided by the present application adopts the window display method in the above embodiment, and can solve the technical problem that operating the in-vehicle screen while driving a vehicle is likely to distract the driver, thus causing accidents. Compared with the prior art, the beneficial effects of the window display device provided by the present application are the same as those of the window display method provided by the above embodiment, and other technical features in the window display device are the same as those disclosed in the method of the previous embodiment, and will not be elaborated here.
[0086] It should be understood that each part disclosed in the present application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in a suitable manner in any one or more embodiments or examples.
[0087] As mentioned above, the above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, and all should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
[0088] The present application provides a computer-readable storage medium having computer-readable program instructions (i.e., computer programs) stored thereon, and the computer-readable program instructions are used to execute the window display method in the above embodiment.
[0089] The computer-readable storage medium provided by the present application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) or flash memory, optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer-readable storage medium can be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.
[0090] The above computer-readable storage medium can be included in a window display device; or it can exist separately without being assembled into the window display device.
[0091] The above computer-readable storage medium carries one or more programs. When the one or more programs are executed by the window display device, the window display device is caused to: perform attention detection on the driver through a driver detection platform to obtain an attention detection result; and when the attention detection result indicates that the driver's attention is not on the vehicle driving road, load a road condition window to the in-vehicle screen according to a pre-set window display configuration.
[0092] Computer program code for performing the operations of this application can be written in one or more programming languages or combinations thereof. The above-mentioned programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN: Local Area Network) or a wide area network (WAN: Wide Area Network), or it can be connected to an external computer (for example, by connecting through an Internet service provider using the Internet).
[0093] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, as well as combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.
[0094] The modules described in the embodiments of this application can be implemented in software or in hardware. Among them, the name of the module does not constitute a limitation to the unit itself in some cases.
[0095] The readable storage medium provided by this application is a computer-readable storage medium. The computer-readable storage medium stores computer-readable program instructions (i.e., computer programs) for performing the above-mentioned window display method, and can solve the technical problem that operating the in-vehicle screen while driving a vehicle is likely to distract the driver, thus causing accidents. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by this application are the same as those of the window display method provided in the above embodiments, and will not be elaborated here.
[0096] The present application also provides a computer program product, including a computer program, which when executed by a processor implements the steps of the window display method as described above.
[0097] The computer program product provided by the present application can solve the technical problem that operating the in-vehicle screen while driving a vehicle is likely to distract the driver, thereby causing accidents. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as those of the window display method provided by the above embodiments, and will not be elaborated herein.
[0098] The above are only partial embodiments of the present application, and thus do not limit the patent scope of the present application. Any equivalent structural transformation made by using the content of the specification and drawings of the present application under the technical concept of the present application, or any direct / indirect application in other related technical fields is included in the patent protection scope of the present application.
Claims
1. A window display method, characterized in that, The described window display method is applied to a vehicle-mounted system, and the vehicle-mounted system has a vehicle-mounted screen. The method includes: When it is detected that the driver triggers a road condition window display instruction, load the road condition window to the vehicle-mounted screen according to the pre-set window display configuration; Perform a trigger judgment on the road condition window through the window closing configuration, and close the road condition window when it is judged that the window is to be closed.
2. The window display method according to claim 1, wherein The vehicle-mounted system further includes a driver detection platform, and the driver detection platform includes a camera device and a sensor. Before the step of loading the road condition window to the vehicle-mounted screen when it is detected that the driver triggers a road condition window display instruction, the method further includes: Perform face recognition on the driver through the camera device to obtain a face image; Read the driver information from the driver database according to the face image; Load the window control configuration based on the driver information. The window control configuration includes a window display configuration, a window closing configuration, and a window display mode configuration. The window display mode configuration includes floating display, upper split-screen display, right split-screen display, and adaptive display; Perform an attention detection on the driver through the driver detection platform to obtain an attention detection result; Judge whether the driver triggers a road condition window display instruction according to the attention detection result.
3. The window display method according to claim 2, wherein The step of loading the road condition window to the vehicle-mounted screen according to the pre-set window display configuration includes: Analyze the window display mode configuration to obtain a first display area, a first split-screen setting, and a first application display content of the vehicle driving picture; Perform image rendering on the received video data through a camera frame multiplexing module to obtain a road condition video; Based on the first display area, the first split-screen setting, and the second application display content, load the road condition video to the vehicle-mounted screen.
4. The window display method according to claim 3, characterized in that After the step of loading the road condition window to the vehicle-mounted screen according to the pre-set window display configuration, the method further includes: Receive the operation instruction of the driver, and analyze the operation instruction to obtain the operation application of the driver; Update the display area, the split-screen setting, and the application display content based on the application display configuration of the operation application to obtain a second display area, a second split-screen setting, and a second application display content; Based on the second display area, the second split-screen setting, and the second application display content, load the road condition video to the vehicle-mounted screen.
5. The window display method according to claim 2, characterized in that The step of performing an attention detection on the driver through the driver detection platform to obtain an attention detection result includes: When the window display configuration is automatic display, perform a line-of-sight detection on the face image through a binocular attention direction recognition algorithm to obtain a line-of-sight detection result; Perform a hand position detection on the driver through the sensor and a hand position algorithm to obtain a hand position detection result; Perform an attention detection on the driver according to the line-of-sight detection result and the hand position detection result to obtain an attention detection result.
6. The window display method according to claim 2, wherein The step of performing an attention detection on the driver through the driver detection platform to obtain an attention detection result further includes: When the window display is configured for passive display, detect whether the driver has interactive input, where the interactive input includes physical button input, voice command input, and screen gesture input; If it is detected that the driver has interactive input, then the attention detection result is that the driver's attention is not on the vehicle driving road.
7. A window display device, characterized in that, The window display device is applied to a vehicle-mounted system, the vehicle-mounted system includes a vehicle-mounted screen, and the device includes: A loading module, configured to load a road condition window to the vehicle-mounted screen according to a pre-set window display configuration when it is detected that the driver triggers a road condition window display instruction; A closing module, configured to perform a trigger judgment on the road condition window through a window closing configuration, and close the road condition window when it is determined that the window is closed.
8. A window display device, characterized in that, The device includes: a memory, a processor, and a computer program stored on the memory and executable on the processor, where the computer program is configured to implement the steps of the window display method according to any one of claims 1 to 6.
9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium, and when the computer program is executed by a processor, it implements the steps of the window display method according to any one of claims 1 to 6.
10. A computer program product, characterized in that, The computer program product includes a computer program, and when the computer program is executed by a processor, it implements the steps of the window display method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Auxiliary driving method, automobile data recorder, display device and system
CN105235595A
Driving environment intelligent adjustment and driver registration method and device, vehicle and equipment
CN111071187A
Driving function intelligent configuration pushing method, device and equipment, and storage medium
CN113401135A
Image data display processing method and device, controller and storage medium
CN115092055A
Equipment control method, equipment and system in vehicle-mounted system
CN115534987A
Cited By
Display processing method and device of cabin system and mobile equipment
CN121062470A