Integrated screen display method based on driving scene, vehicle machine and storage medium

By receiving environmental and driving parameter data, identifying driving scenarios and in-vehicle occupant behaviors, and dynamically adjusting the display content and proportion of the integrated screen, the problem of poor flexibility and safety caused by the fixed display area in existing technologies is solved, thereby improving the adaptability of the display and the user experience.

CN121650441APending Publication Date: 2026-03-13VOYAH AUTOMOBILE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-12-08
Publication Date
2026-03-13

AI Technical Summary

Technical Problem

The existing integrated screen has a fixed display area ratio and content between the driver's and passenger's display areas throughout the entire driving process. This makes it unable to adapt to the display needs of different driving scenarios and different user actions, resulting in poor display flexibility, poor safety, and a poor experience for passengers in the vehicle.

Method used

By receiving data from environmental data perception sensors, driving parameter sensors, and in-vehicle cameras, the system identifies vehicle driving scenarios and occupant behaviors, dynamically adjusting the display content and proportions of the driver's and passenger's display areas to adapt to different driving scenarios and user actions.

Benefits of technology

This achieves greater flexibility and enhanced safety in terms of the display content and aspect ratio of the integrated screen, improving the user experience for passengers inside the vehicle.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121650441A_ABST
    Figure CN121650441A_ABST
Patent Text Reader

Abstract

The invention provides an integrated screen display method based on a driving scene, a vehicle machine and a storage medium, and relates to the technical field of vehicle screen display. According to the method, a driving scene where the vehicle is located can be determined according to environmental data outside the vehicle and driving parameters of the vehicle, and behaviors of people in the vehicle are identified according to image data of the people in the vehicle; according to the driving scene where the vehicle is located, the behaviors of the persons in the vehicle and whether gesture interaction data exists in the integrated screen or not, the display content of a main driving display area and / or the display content of a co-driving area of the integrated screen and the display proportion of the main driving display area and the co-driving display area are determined. Therefore, different display requirements of people in the vehicle on the display content under different driving scenes and different user actions can be met, the display flexibility of the integrated screen is good, the safety is high, and the use experience of the people in the vehicle on the integrated screen is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of vehicle screen display technology, and in particular to an integrated screen display method, vehicle system and storage medium based on driving scenarios. Background Technology

[0002] As the automotive industry undergoes a profound transformation towards the "new four modernizations" (electrification, intelligentization, connectivity, and sharing), the intelligent cockpit has become one of the core indicators for measuring the technological content and user experience of a vehicle. Among these, the in-vehicle display system, as the main interface for human-machine interaction, has undergone particularly rapid evolution in both form and function. In-vehicle screens have evolved from early mechanical instrument panels and small central control screens to today's large-area, high-resolution integrated screens. These integrated screens extend from the driver's seat to the passenger seat, continuously breaking down the physical boundaries of the display area and providing an unprecedented canvas for information presentation.

[0003] Current integrated screens often adopt a fixed split-screen mode: for example, the left 50% of the integrated screen is used as the driver's display area, which is used to display instrument panel information and core driving information (such as navigation information), while the right 50% of the integrated screen is used as the passenger's display area, which is used to display entertainment information (such as video information or music playback information).

[0004] However, in the aforementioned fixed split-screen mode, the display area ratio and content of the driver's display area and passenger's display area of ​​the integrated screen remain unchanged throughout the entire driving process. This cannot adapt to the different display needs of the in-vehicle personnel under different driving scenarios and different user actions. The integrated screen has poor display flexibility, poor safety, and poor in-vehicle experience. Summary of the Invention

[0005] This application provides an integrated screen display method, vehicle system, and storage medium based on driving scenarios, which solves the problems of poor display flexibility, poor safety, and poor user experience of integrated screens in the prior art. The display area ratio and display content of the main driver display area and the passenger display area of ​​the integrated screen remain unchanged throughout the driving process, which cannot adapt to the different display needs of the in-vehicle personnel under different driving scenarios and different user actions.

[0006] Firstly, this application provides an integrated screen display method based on driving scenarios, applied to a vehicle's infotainment system. The infotainment system includes an integrated screen extending from the driver's seat to the passenger seat. The infotainment system is electrically connected to the vehicle's environmental data perception sensors, vehicle driving parameter sensors, and an in-vehicle camera. The method provided in this application includes: It receives environmental data from the outside of the vehicle collected by the environmental data perception sensor, driving parameters of the vehicle collected by the driving parameter sensor, and image data of the people inside the vehicle collected by the in-vehicle camera. Based on environmental data outside the vehicle and the vehicle's driving parameters, determine the driving scenario in which the vehicle is located. Based on image data of people inside the vehicle, identify the behavior of the people inside the vehicle; Based on the driving scenario of the vehicle, the behavior of the occupants, and whether there is gesture interaction data on the integrated screen, determine the display content of the driver's display area and / or the passenger's display area on the integrated screen, as well as the display ratio between the driver's display area and the passenger's display area.

[0007] In some implementations, the display content of the driver's side display area and / or the passenger side display area of ​​the integrated screen, as well as the display ratio between the driver's side display area and the passenger side display area, are determined based on the driving scenario of the vehicle, the behavior of the occupants, and whether there is gesture interaction data on the integrated screen. This includes: In a driving scenario where the vehicle is located, indicating a safety risk, the behavior of the occupants is that the driver is driving normally, the front passenger is sitting still in the front passenger seat, and there is no gesture interaction data on the integrated screen, the display ratio of the driver's side display area is determined to be greater than that of the front passenger side display area, and the content displayed in the driver's side display area includes driving safety risk warnings.

[0008] In some implementations, external environmental data includes distance to the vehicle in front, vehicle driving parameters include vehicle speed, and driving safety risk warnings include anti-cutting warning information. Based on the external environmental data and vehicle driving parameters, the driving scenario in which the vehicle is located is determined, including: If, based on environmental data outside the vehicle, the distance between the vehicle and the vehicle in front is less than a preset distance threshold for a preset duration, and the vehicle speed is less than a set speed threshold for a preset duration, then the driving scenario in which the vehicle is located is determined to be a commuting congestion scenario, and the commuting congestion scenario indicates that the vehicle has a risk of unsafe driving. The occupants of the vehicle include the driver and front passenger. Based on the image data of the occupants, their behavior is identified, including: Based on the image data of the people inside the vehicle, it was identified that the driver's behavior was normal driving, and the behavior of the front passenger was sitting still in the front passenger seat. In the scenario where the driving scenario is a commuting congestion scenario, the behavior of the people in the car is that the driver is driving the vehicle normally, the passenger is sitting quietly in the passenger seat, and there is no gesture interaction data on the integrated screen, the content displayed in the driver's display area of ​​the integrated screen is determined to be the instrument panel screen, and the instrument panel screen includes anti-jamming warning information. The content displayed in the driver's display area of ​​the integrated screen is entertainment data, and the area ratio of the driver's display area to the passenger's display area is 7:3.

[0009] In some implementations, the environmental data outside the vehicle includes driving environment data in front of the vehicle, the vehicle's driving parameters include the vehicle's speed, and the driving safety risk warning includes text prompts to indicate cautious driving. Based on the environmental data outside the vehicle and the vehicle's driving parameters, the driving scenario in which the vehicle is located is determined, including: If an intersection is detected within a preset distance in front of the vehicle based on environmental data outside the vehicle, and the number of pedestrians or vehicles in front of the vehicle is greater than a set threshold, the driving scenario in which the vehicle is located is determined to be a complex intersection scenario, and the complex intersection scenario indicates that the vehicle has a safety driving risk. In a scenario where the driving scenario involves a complex intersection, the occupants are driving normally, the front passenger is sitting quietly in the front passenger seat, and there is no gesture interaction data on the integrated screen, the content displayed in the driver's side display area of ​​the integrated screen is determined to be the panoramic image data of the vehicle's surroundings, while the content displayed in the front passenger side display area is the navigation map, and the area ratio between the driver's side display area and the front passenger side display area is 7:3.

[0010] In some implementations, the environmental data outside the vehicle includes the vehicle's GPS positioning data and the vehicle's driving parameters, including the vehicle's speed. Based on the environmental data outside the vehicle and the vehicle's driving parameters, the driving scenario in which the vehicle is located is determined, including: If the vehicle's GPS positioning data indicates that the vehicle is on a city center road and the vehicle's speed is lower than the set speed threshold, then the driving scenario in which the vehicle is located is determined to be an urban commuting scenario. The occupants of the vehicle include the driver and front passenger. Based on the image data of the occupants, their behavior is identified, including: Based on the image data of the people inside the vehicle, it was identified that the driver's behavior was normal driving, and the behavior of the front passenger was sitting still in the front passenger seat. Based on the driving scenario, the behavior of the occupants, and whether there is gesture interaction data on the integrated screen, determine the display content of the driver's display area and / or the passenger's display area on the integrated screen, as well as the display ratio between the driver's and passenger's display areas, including: In the scenario where the driving scenario is urban commuting, the behavior of the people in the vehicle is that the driver is driving normally, the passenger is sitting quietly in the passenger seat, and there is no gesture interaction data on the integrated screen, the content displayed in the driver's side display area of ​​the integrated screen is determined to be instrument panel information, the content displayed in the driver's side display area of ​​the integrated screen is entertainment data, and the area ratio of the driver's side display area to the passenger side display area is 1:1.

[0011] In some implementations, the environmental data outside the vehicle includes the vehicle's GPS positioning data and the vehicle's driving parameters, including the vehicle's speed. Based on the environmental data and the driving parameters, the driving scenario in which the vehicle is located is determined, including: If the vehicle's GPS positioning data indicates that the vehicle is on a city center road and the vehicle's speed is lower than the set speed threshold, then the driving scenario in which the vehicle is located is determined to be an urban commuting scenario. The occupants of the vehicle include the driver and front passenger. Based on the image data of the occupants, their behavior is identified, including: Based on the image data of the people inside the vehicle, it was determined that the driver's behavior was that the driver's gaze was off the road for a period of time exceeding a preset threshold or that the driver was in a state of fatigue. The behavior of the front passenger was that the passenger was sitting still in the front passenger seat. In the case that there was no gesture interaction data on the integrated screen, it was determined that the content displayed in the driver's display area of ​​the integrated screen was the instrument panel screen, and the instrument panel screen included prompts for normal driving. The content displayed in the front passenger display area of ​​the integrated screen was entertainment data, and the area ratio of the driver's display area to the front passenger display area was 7:3.

[0012] In some implementations, the display content of the driver's side display area and / or the passenger side display area of ​​the integrated screen, as well as the display ratio between the driver's side display area and the passenger side display area, are determined based on the driving scenario of the vehicle, the behavior of the occupants, and whether there is gesture interaction data on the integrated screen. This includes: Under the conditions that the driving scenario in which the vehicle is located indicates that there is no safety risk to the vehicle, the behavior of the people in the vehicle is that the driver is driving the vehicle normally, the front passenger is sitting quietly in the front passenger seat, and the integrated screen has gesture interaction data, the data associated with the gesture interaction data is determined to be displayed in full screen on the integrated screen.

[0013] In some implementations, the driving scenario of the vehicle is determined based on environmental data outside the vehicle and the vehicle's driving parameters, including: If a construction area is detected ahead based on environmental data outside the vehicle, and the vehicle speed is greater than the set speed threshold, the driving scenario of the vehicle is determined to be a construction road scenario. The occupants of the vehicle include the driver and front passenger. Based on the image data of the occupants, their behavior is identified, including: Based on the image data of the people inside the vehicle, it was identified that the driver's behavior was normal driving, and the behavior of the front passenger was sitting still in the front passenger seat. In a driving scenario where the road is under construction, the driver is driving normally, the passenger is sitting still in the front passenger seat, and there is no gesture interaction data on the integrated screen, the system will determine to display the surround panoramic image data around the vehicle and the prompt to take over the vehicle on the full-screen integrated screen.

[0014] Secondly, this application provides a vehicle infotainment system, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the vehicle infotainment system performs the method provided in the first aspect of this application.

[0015] Thirdly, this application also provides a storage medium storing a computer program, which, when executed by a processor, causes the computer to perform the method as described in the first aspect of this application.

[0016] This application provides an integrated screen display method, vehicle-mounted system, and storage medium based on driving scenarios. It can determine the driving scenario of the vehicle based on external environmental data and vehicle driving parameters, and identify the behavior of occupants based on image data. Based on the driving scenario, occupant behavior, and the presence of gesture interaction data on the integrated screen, it determines the display content of the driver's side display area and / or the passenger side display area, as well as the display ratio between the driver's side and passenger side display areas. Since the determination of the display content of the driver's side display area and / or the passenger side display area, and the display ratio between the driver's side and passenger side display areas, is based on the driving scenario, occupant behavior, and the presence of gesture interaction data on the integrated screen, it can adapt to the different display needs of occupants under different driving scenarios and user actions. The integrated screen offers good display flexibility, high security, and an improved user experience. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 A circuit module connection block diagram of a vehicle provided in an embodiment of this application; Figure 2A flowchart illustrating the integrated screen display method based on driving scenarios provided in this application embodiment. Detailed Implementation

[0019] Embodiments of the present disclosure will now be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the disclosure. Furthermore, descriptions of well-known structures and technologies are omitted in the following description to avoid unnecessarily obscuring the concepts of the present disclosure.

[0020] The accompanying drawings illustrate various structural schematics according to embodiments of the present disclosure. These drawings are not to scale, and some details have been enlarged for clarity, and some details may have been omitted. The shapes of the various regions and layers shown in the drawings, as well as their relative sizes and positional relationships, are merely exemplary and may deviate from reality due to manufacturing tolerances or technical limitations. Furthermore, those skilled in the art can design regions / layers with different shapes, sizes, and relative positions as needed.

[0021] In the context of this disclosure, when a layer / element is referred to as being "above" another layer / element, the layer / element may be directly above the other layer / element, or there may be an intermediate layer / element between them. Additionally, if a layer / element is "above" another layer / element in one orientation, then when the orientation is reversed, the layer / element may be "below" the other layer / element.

[0022] The technical solutions of this application and how they solve the aforementioned technical problems will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0023] This application provides an integrated screen display method based on driving scenarios, applied to a vehicle's infotainment system. The infotainment system includes an integrated screen that extends from the driver's seat to the front passenger seat. Figure 1As shown, the vehicle's infotainment system is electrically connected to the vehicle's environmental data perception sensors, vehicle driving parameter sensors, and in-vehicle cameras. The vehicle's environmental data perception sensors may include, but are not limited to, exterior surround-view cameras, millimeter-wave radar / LiDAR, etc. The exterior surround-view cameras are used to collect environmental images of the vehicle's surroundings; the millimeter-wave radar / LiDAR is used to detect environmental point cloud data around the vehicle (including distances to surrounding objects); and the GPS positioning module is used to collect the vehicle's GPS positioning information. The vehicle driving parameter sensors may include, but are not limited to, a speed sensor for collecting vehicle speed; an acceleration sensor for collecting vehicle acceleration; a gear sensor for collecting vehicle gear position; a throttle sensor for collecting vehicle throttle position; a brake sensor for collecting vehicle braking progress; a steering angle sensor for collecting vehicle steering angle; and an intelligent driving domain controller for acquiring vehicle driving mode information (such as adaptive cruise control, lane keeping assist, navigation-assisted driving, and automatic parking). Figure 2 As shown, the method provided in this application embodiment includes: S201: Receives environmental data outside the vehicle collected by the environmental data perception sensor, vehicle driving parameters collected by the driving parameter sensor, and image data of people inside the vehicle collected by the in-vehicle camera.

[0024] For example, the environmental data outside the vehicle may include, but is not limited to, environmental images of the scene in which the vehicle is located, environmental point cloud data around the vehicle (including distances to surrounding objects), and the vehicle's GPS positioning information. The vehicle's driving parameters include, but are not limited to, the vehicle's speed, acceleration, gear, throttle position, braking process, steering angle, and driving mode information.

[0025] S202: Determine the driving scenario of the vehicle based on environmental data outside the vehicle and the vehicle's driving parameters.

[0026] For example, environmental data outside the vehicle includes the distance to the vehicle in front, and driving parameters of the vehicle include the vehicle speed. If the vehicle is found to be less than a preset distance threshold (e.g., 10m) and the distance to the vehicle in front remains less than a preset distance threshold (e.g., 10m) for a preset duration, and the vehicle speed remains less than a preset speed threshold (20km / h) for a preset duration (e.g., 5min) based on the environmental data outside the vehicle, the driving scenario in which the vehicle is located is determined to be a commuting congestion scenario, and the commuting congestion scenario indicates that the vehicle has a safe driving risk.

[0027] For example, the environmental data outside the vehicle includes the driving environment data in front of the vehicle, and the vehicle's driving parameters include the vehicle's speed. If the environmental data outside the vehicle detects an intersection within a preset distance in front of the vehicle, and the number of pedestrians or vehicles in front of the vehicle is greater than a set threshold (e.g., 2), the driving scenario in which the vehicle is located is determined to be a complex intersection scenario, and a complex intersection scenario indicates that the vehicle has a safety driving risk.

[0028] For example, environmental data outside the vehicle includes the vehicle's GPS location data and driving parameters such as vehicle speed. If the vehicle's GPS location data indicates that the vehicle is on a city center road and the vehicle speed is below a set speed threshold, then the driving scenario is determined to be an urban commuting scenario.

[0029] For example, if environmental data outside the vehicle detects a construction area ahead and the vehicle's speed exceeds a set speed threshold, the driving scenario is determined to be a construction road scenario.

[0030] S203: Identify the behavior of occupants based on image data of those inside the vehicle.

[0031] For example, the people inside the vehicle can include the driver and the front passenger. The pre-trained image recognition model of the vehicle's infotainment system can identify the actions, gaze direction, and facial expressions of the people inside the vehicle. Based on the actions, gaze direction, and facial expressions of the people inside the vehicle, it can identify whether the driver is driving the vehicle normally, and whether the driver's behavior is normal driving, and whether the front passenger's behavior is sitting still in the front passenger seat.

[0032] S204: Based on the driving scenario of the vehicle, the behavior of the occupants, and whether there is gesture interaction data on the integrated screen, determine the display content of the driver's side display area and / or the passenger side display area of ​​the integrated screen, as well as the display ratio between the driver's side display area and the passenger side display area.

[0033] Specifically, S204 can be implemented as follows: When the driving scenario indicates a safety risk to the vehicle, the occupants' behavior is that the driver is driving normally, the front passenger is sitting still in the front passenger seat, and there is no gesture interaction data on the integrated screen, the display ratio of the driver's side display area is determined to be larger than that of the front passenger side display area, and the content displayed in the driver's side display area includes driving safety risk warnings. In this way, the driver can more clearly see the content displayed in the driver's side display area (such as vehicle speed, navigation information, surrounding view images, and driving safety risk warnings), which better meets the driver's browsing needs and ensures driving safety. At the same time, the content displayed in the front passenger side display area is retained, accommodating the front passenger's ability to browse entertainment information (such as the music player interface or news browsing interface).

[0034] For example, in a scenario where the driving scenario is a commuter traffic jam, the behavior of the occupants is that the driver is driving normally, the front passenger is sitting quietly in the front passenger seat, and there is no gesture interaction data on the integrated screen, the content displayed in the driver's side display area of ​​the integrated screen is determined to be the instrument panel screen, and the instrument panel screen includes anti-cutting warning information (such as a simplified but vivid simulation map of the vehicle's surrounding environment displayed in real time on the integrated screen, including lane lines, the vehicle model, and vehicle models in front, behind, left, and right; the vehicle model attempting to cut in will be highlighted, as well as text prompts, such as "Please be aware of vehicles on the side"). The content displayed in the driver's side display area of ​​the integrated screen is entertainment data, and the area ratio of the driver's side display area to the front passenger side display area is 7:3.

[0035] For example, in a scenario where the driving scenario is a complex intersection, the behavior of the people in the vehicle is that the driver is driving normally, the passenger is sitting quietly in the passenger seat, and there is no gesture interaction data on the integrated screen, the content displayed in the driver's side display area of ​​the integrated screen is determined to be the panoramic image data of the vehicle's surroundings, and the content displayed in the passenger side display area is the navigation map, and the area ratio of the driver's side display area to the passenger side display area is 7:3.

[0036] Furthermore, S204 can be specifically implemented as follows: In a scenario where the driving scenario is urban commuting, the vehicle occupants are driving normally, the front passenger is seated quietly, and there is no gesture interaction data on the integrated screen, the content displayed in the main driver's area of ​​the integrated screen is determined to be instrument panel information (such as vehicle speed, acceleration, and navigation information), while the content displayed in the passenger's area is entertainment data, with a 1:1 ratio between the main driver's area and the passenger's area. In urban commuting scenarios, where there is no safety risk, the main driver's area and the passenger's area can be displayed in a 1:1 ratio, allowing the driver to easily view the instrument panel information in the main driver's area and the passenger to easily view the entertainment data in the passenger's area.

[0037] For example, based on in-vehicle occupant image data, if the driver's behavior is identified as the driver's gaze deviating from the road for a preset time threshold or a state of fatigue, and the front passenger's behavior is identified as sitting still in the front passenger seat, and there is no gesture interaction data on the integrated screen, then the content displayed in the driver's side display area of ​​the integrated screen is determined to be the instrument panel display, including prompts indicating proper driving. The content displayed in the front passenger side display area is entertainment data, and the area ratio of the driver's side display area to the front passenger side display area is 7:3. When the in-vehicle occupant image data identifies the driver's behavior as the driver's gaze deviating from the road for a preset time threshold or a state of fatigue, indicating a risk to safe driving, the display area of ​​the driver's side display area is larger than that of the front passenger side display area. The driver's side display area displays prompts indicating proper driving, which can more reliably remind the driver to drive properly, while retaining the display content of the front passenger side display area, accommodating the front passenger's browsing of entertainment information (such as the music player interface or news browsing interface).

[0038] For example, if the driving scenario indicates no safety risks to the vehicle, the occupants' behavior is that the driver is driving normally, the front passenger is sitting quietly in the front passenger seat, and the integrated screen displays gesture interaction data, it means the current driving status is relatively safe, the driver is driving safely, and the passenger is not interfering with driving. In this case, the integrated screen will display the data associated with the gesture interaction data in full screen. For instance, when the driver taps to open a map, the integrated screen will display the navigation map in full screen, allowing the driver to view the map more clearly (understandably, the area ratio between the driver's and front passenger's display areas is 10:0). As another example, if the front passenger taps to play a video, the integrated screen will display the video in full screen (understandably, the area ratio between the driver's and front passenger's display areas is 0:10), allowing the front passenger to view the video more clearly without affecting safe driving.

[0039] For example, in a scenario where the driving scenario involves a construction road, the driver is driving normally, the passenger is sitting quietly in the front passenger seat, and there is no gesture interaction data on the integrated screen, it indicates that the current autonomous driving system has low safety and reliability. Furthermore, the driver is driving safely and correctly, and the passenger is not interfering with driving. In this case, it is determined to display the surrounding panoramic image data and the vehicle takeover prompts on the integrated screen in full screen (understandably, the area ratio between the driver's and passenger's display areas is 10:0). This allows the driver to clearly see the surrounding environment and the vehicle takeover prompts, enabling safe manual driving.

[0040] In summary, this application provides an integrated screen display method based on driving scenarios. It can determine the driving scenario of the vehicle based on external environmental data and vehicle driving parameters, and identify the behavior of occupants based on image data of the occupants. Based on the driving scenario, the behavior of the occupants, and the presence of gesture interaction data on the integrated screen, it determines the display content of the driver's side display area and / or the passenger side display area, as well as the display ratio between the driver's side and passenger side display areas. Since the determination of the display content of the driver's side display area and / or the passenger side display area, and the display ratio between the driver's side and passenger side display areas, is based on the driving scenario, the behavior of the occupants, and the presence of gesture interaction data on the integrated screen, it can adapt to the different display needs of occupants under different driving scenarios and user actions. The integrated screen offers good display flexibility, high security, and improves the user experience for occupants.

[0041] In addition, this application provides a vehicle infotainment system, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the vehicle infotainment system performs the method provided in the above embodiments of this application.

[0042] In addition, this application embodiment also provides a storage medium storing a computer program, which, when executed by a processor, causes the computer to perform the method provided in the above embodiments of this application.

[0043] The above description does not provide detailed technical specifications regarding the structure of each layer. However, those skilled in the art should understand that layers and regions of desired shapes can be formed using various technical means. Furthermore, to form the same structure, those skilled in the art can also design methods that are not entirely identical to those described above. Additionally, although various embodiments have been described above, this does not mean that the measures in the various embodiments cannot be advantageously combined.

[0044] Although preferred embodiments of this application have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of this application.

[0045] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. An integrated screen display method based on driving scenarios, characterized in that, An in-vehicle infotainment system for vehicles, comprising an integrated screen extending from the driver's seat to the passenger seat, wherein the infotainment system is electrically connected to environmental data sensing sensors, vehicle driving parameter sensors, and an in-vehicle camera, the method comprising: The system receives environmental data collected by the environmental data perception sensor outside the vehicle, driving parameters collected by the driving parameter sensor, and image data of occupants collected by the in-vehicle camera. Based on the environmental data outside the vehicle and the vehicle's driving parameters, the driving scenario in which the vehicle is located is determined; Based on the image data of the occupants inside the vehicle, the behavior of the occupants inside the vehicle is identified; Based on the driving scenario of the vehicle, the behavior of the occupants, and whether there is gesture interaction data on the integrated screen, determine the display content of the driver's side display area and / or the passenger side display area of ​​the integrated screen, as well as the display ratio of the driver's side display area to the passenger side display area.

2. The method according to claim 1, characterized in that, Based on the driving scenario of the vehicle, the behavior of the occupants, and whether there is gesture interaction data on the integrated screen, the display content of the driver's side display area and / or the passenger side display area of ​​the integrated screen, as well as the display ratio of the driver's side display area to the passenger side display area, are determined, including: In the driving scenario where the vehicle is located, the vehicle has safety risks, the behavior of the people in the vehicle is that the driver is driving normally, the front passenger is sitting still in the front passenger seat, and there is no gesture interaction data on the integrated screen, it is determined that the display ratio of the driver's display area is greater than that of the front passenger display area, and the display content of the driver's display area includes driving safety risk warnings.

3. The method according to claim 2, characterized in that, The environmental data outside the vehicle includes the distance to the vehicle in front, the vehicle's driving parameters include the vehicle's speed, the driving safety risk warning includes anti-cutting warning information, and determining the driving scenario of the vehicle based on the environmental data outside the vehicle and the vehicle's driving parameters includes: If, based on environmental data outside the vehicle, the distance between the vehicle and the vehicle in front is less than a preset distance threshold for a preset duration, and the vehicle speed is less than a set speed threshold for a preset duration, then the driving scenario in which the vehicle is located is determined to be a commuting congestion scenario, and the commuting congestion scenario indicates that the vehicle has a safety driving risk. The occupants of the vehicle include the driver and the front passenger. Based on the image data of the occupants, the behavior of the occupants is identified, including: Based on the image data of the people inside the vehicle, it was identified that the driver's behavior was normal driving, and the behavior of the front passenger was sitting still in the front passenger seat; In the scenario where the driving scenario is a commuting congestion scenario, the behavior of the people in the vehicle is that the driver is driving the vehicle normally, the front passenger is sitting quietly in the front passenger seat, and there is no gesture interaction data on the integrated screen, it is determined that the display content of the driver's display area on the integrated screen is the instrument panel screen, and the instrument panel screen includes the anti-jamming warning information. The display content of the driver's display area on the integrated screen is entertainment data, and the area ratio of the driver's display area to the front passenger display area is 7:

3.

4. The method according to claim 2, characterized in that, The environmental data outside the vehicle includes driving environment data in front of the vehicle, the vehicle's driving parameters include the vehicle's speed, the driving safety risk warning includes text prompts indicating cautious driving, and determining the driving scenario of the vehicle based on the environmental data outside the vehicle and the vehicle's driving parameters includes: If an intersection is detected within a preset distance in front of the vehicle based on environmental data outside the vehicle, and the number of pedestrians or vehicles in front of the vehicle is greater than a set threshold, the driving scenario in which the vehicle is located is determined to be a complex intersection scenario, and the complex intersection scenario indicates that the vehicle has a safety driving risk. In the case where the driving scenario is the complex intersection scenario, the behavior of the people in the vehicle is the driver driving the vehicle normally, the passenger in the front passenger seat is sitting still and there is no gesture interaction data on the integrated screen, the content displayed in the driver's display area of ​​the integrated screen is determined to be the panoramic image data of the vehicle's surroundings, the content displayed in the passenger's display area is the navigation map, and the area ratio of the driver's display area to the passenger's display area is 7:

3.

5. The method according to claim 1, characterized in that, The environmental data outside the vehicle includes the vehicle's GPS positioning data, and the vehicle's driving parameters include the vehicle's speed. Determining the driving scenario based on the environmental data and the vehicle's driving parameters includes: If the GPS positioning data of the vehicle indicates that the vehicle is on a road in the city center and the vehicle speed is lower than a set speed threshold, then the driving scenario in which the vehicle is located is determined to be an urban commuting scenario. The occupants of the vehicle include the driver and the front passenger. Based on the image data of the occupants, the behavior of the occupants is identified, including: Based on the image data of the people inside the vehicle, it was determined that the driver's behavior was normal driving, and the behavior of the front passenger was sitting still in the front passenger seat. The step of determining the display content of the driver's display area and / or the passenger's display area of ​​the integrated screen, and the display ratio of the driver's display area to the passenger's display area, based on the driving scenario of the vehicle, the behavior of the occupants, and whether there is gesture interaction data on the integrated screen, includes: In the case where the driving scenario is the urban commuting scenario, the behavior of the people in the vehicle is the driver driving the vehicle normally, the front passenger is sitting quietly in the front passenger seat and there is no gesture interaction data on the integrated screen, it is determined that the display content of the main driver display area of ​​the integrated screen is the instrument panel information, the display content of the main driver display area of ​​the integrated screen is the entertainment data, and the area ratio of the main driver display area to the front passenger display area is 1:

1.

6. The method according to claim 1, characterized in that, The environmental data outside the vehicle includes the vehicle's GPS positioning data, and the vehicle's driving parameters include the vehicle's speed. Determining the driving scenario based on the environmental data and the vehicle's driving parameters includes: If the GPS positioning data of the vehicle indicates that the vehicle is on a road in the city center and the vehicle speed is lower than a set speed threshold, then the driving scenario in which the vehicle is located is determined to be an urban commuting scenario. The occupants of the vehicle include the driver and the front passenger. Based on the image data of the occupants, the behavior of the occupants is identified, including: Based on the image data of the occupants in the vehicle, it is determined that the driver's gaze is deviating from the road ahead for a duration exceeding a preset threshold or that the driver is in a state of fatigue. Additionally, the front passenger is found to be sitting still in the front passenger seat. Furthermore, if there is no gesture interaction data on the integrated screen, the content displayed in the driver's side display area of ​​the integrated screen is determined to be the instrument panel display, which includes prompts indicating proper driving. The content displayed in the front passenger side display area of ​​the integrated screen is entertainment data, and the area ratio between the driver's side display area and the front passenger side display area is 7:

3.

7. The method according to claim 1, characterized in that, Based on the driving scenario of the vehicle, the behavior of the occupants, and whether there is gesture interaction data on the integrated screen, the display content of the driver's side display area and / or the passenger side display area of ​​the integrated screen, as well as the display ratio of the driver's side display area to the passenger side display area, are determined, including: If the driving scenario in which the vehicle is located indicates that there is no safety risk to the vehicle, the behavior of the people in the vehicle is that the driver is driving the vehicle normally, the front passenger is sitting quietly in the front passenger seat, and the integrated screen has gesture interaction data, then it is determined that the integrated screen will display the data associated with the gesture interaction data in full screen.

8. The method according to claim 1, characterized in that, Determining the driving scenario of the vehicle based on the environmental data outside the vehicle and the vehicle's driving parameters includes: If a construction area is detected ahead based on environmental data outside the vehicle, and the vehicle speed is greater than a set speed threshold, the driving scenario in which the vehicle is located is determined to be a construction road scenario. The occupants of the vehicle include the driver and the front passenger. Based on the image data of the occupants, the behavior of the occupants is identified, including: Based on the image data of the people inside the vehicle, it was determined that the driver's behavior was normal driving, and the behavior of the front passenger was sitting still in the front passenger seat. When the driving scenario is the construction road scenario, the behavior of the people in the vehicle is that the driver is driving the vehicle normally, the front passenger is sitting quietly in the front passenger seat, and there is no gesture interaction data on the integrated screen, it is determined that the panoramic image data of the surroundings of the vehicle and the prompt information for taking over the vehicle will be displayed in full screen on the integrated screen.

9. A vehicle infotainment system, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it causes the vehicle system to perform the method as described in any one of claims 1 to 7.

10. A storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it causes the computer to perform the method as described in any one of claims 1 to 7.