Intelligent interaction method, device and equipment of vehicle display screen and storage medium

Abstract

The invention discloses an intelligent interaction method, device and equipment for a vehicle display screen and a storage medium, and the method comprises the steps: detecting the voice data of a driver and passengers in a target vehicle in the operation process of the target vehicle, and carrying out the behavior detection analysis of the driver and passengers; according to the voice data, performing intention recognition on the driver and the passenger to obtain a corresponding intention recognition result; determining a target menu interface corresponding to a display screen of the target vehicle according to the intention recognition result; and when the result of the behavior detection analysis represents that the driver and the passengers are about to perform interactive operation on the display screen, adjusting the current interface of the display screen to be the target menu interface. According to the technical scheme, the problems that the menu level of the vehicle-mounted display screen is complex and operation is tedious are effectively solved by combining voice recognition and behavior detection analysis. The method can be widely applied to the technical field of vehicles.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to an intelligent interaction method, device, equipment, and storage medium for a vehicle display screen. Background Technology

[0002] With the rapid development of automotive intelligent technology, the functions of in-vehicle displays have become increasingly rich, evolving from simple information display to an interactive hub integrating navigation, entertainment, vehicle control, and driving assistance.

[0003] Currently, in-vehicle displays are integrating an increasing number of functional modules, including navigation, entertainment, climate control, vehicle settings, and driver assistance, resulting in complex menu hierarchies and cumbersome operations. Traditional display menu layouts typically use fixed categories or functional groupings, often requiring users to click or swipe multiple times to find the desired function. This is cumbersome and time-consuming, especially while driving, as prolonged distraction from screen operation not only affects the user experience but may also pose safety hazards. Furthermore, some solutions attempt to introduce voice control or gesture operation to simplify interaction, but due to insufficient recognition accuracy or response delays, the actual experience remains not smooth enough, and practicality is limited.

[0004] In summary, the problems with the relevant technologies urgently need to be addressed. Summary of the Invention

[0005] The purpose of this application is to at least partially solve one of the technical problems existing in the related art.

[0006] Therefore, one objective of the embodiments of this application is to provide an intelligent interaction method, apparatus, device, and storage medium for a vehicle display screen.

[0007] To achieve the above-mentioned technical objectives, the technical solutions adopted in the embodiments of this application include:

[0008] On one hand, embodiments of this application provide an intelligent interaction method for a vehicle display screen, applied to a target vehicle, the method comprising:

[0009] During the operation of the target vehicle, the voice data of the driver and passengers inside the target vehicle are detected, and the behavior of the driver and passengers is detected and analyzed.

[0010] Based on the voice data, the driver and passengers' intentions are identified to obtain the corresponding intention recognition results;

[0011] Based on the intent recognition result, the target menu interface corresponding to the display screen of the target vehicle is determined;

[0012] When the behavior detection analysis indicates that the driver or passenger is about to interact with the display screen, the current interface of the display screen is adjusted to the target menu interface.

[0013] In addition, the intelligent interaction method for a vehicle display screen according to the above embodiments of this application may also have the following additional technical features:

[0014] Furthermore, in one embodiment of this application, after detecting the voice data of the occupants in the target vehicle, the method further includes:

[0015] The ambient noise inside the target vehicle was collected;

[0016] The speech data is adaptively filtered based on the ambient noise.

[0017] Furthermore, in one embodiment of this application, the behavioral detection and analysis of the driver and passengers includes:

[0018] The eye movement trajectory and hand gesture characteristics of the driver and passengers were collected.

[0019] Based on the eye movement trajectory, determine the focal point of the driver's gaze;

[0020] When it is detected that the driver's gaze is focused on the area where the display screen is located, and the hand gesture characteristics indicate that the driver's hand is moving towards the display screen, it is determined that the driver is about to interact with the display screen.

[0021] Furthermore, in one embodiment of this application, determining the target menu interface corresponding to the display screen of the target vehicle based on the intent recognition result includes:

[0022] Obtain the operation records of the driver and passengers within a historical time period, and determine the functional preference information corresponding to the driver and passengers based on the operation records;

[0023] Based on the intent recognition results and the function preference information, multiple candidate function icons are determined;

[0024] The candidate function icons are arranged and combined to obtain the initial menu interface;

[0025] The ambient light data inside the target vehicle is detected, and the background color of the initial menu interface is adjusted according to the ambient light data to obtain the target menu interface.

[0026] Furthermore, in one embodiment of this application, the step of arranging and combining the candidate function icons to obtain the initial menu interface includes:

[0027] Based on the intent recognition results and the function preference information, determine the matching degree data corresponding to each candidate function icon;

[0028] Based on the matching degree data, a corresponding display area is assigned to each candidate function icon; wherein, the display area and the matching degree data are positively correlated.

[0029] According to the display area, the candidate function icons are filled and arranged within the displayable area of ​​the display screen to obtain the initial menu interface.

[0030] Furthermore, in one embodiment of this application, the step of performing intent recognition on the driver / passenger based on the voice data to obtain the corresponding intent recognition result includes:

[0031] The voice data is input into a locally deployed intent recognition model, and analyzed by the intent recognition model to obtain the intent recognition result.

[0032] Furthermore, in one embodiment of this application, the intent recognition model is built on the Transformer architecture.

[0033] On the other hand, embodiments of this application provide an intelligent interactive device for a vehicle display screen, applied to a target vehicle, the device comprising:

[0034] The detection unit is used to detect the voice data of the driver and passengers in the target vehicle during the operation of the target vehicle, and to perform behavioral detection and analysis on the driver and passengers.

[0035] The recognition unit is used to perform intent recognition on the driver and passenger based on the voice data, and obtain the corresponding intent recognition result;

[0036] The processing unit is configured to determine the target menu interface corresponding to the display screen of the target vehicle based on the intent recognition result;

[0037] An adjustment unit is used to adjust the current interface of the display screen to the target menu interface when the result of the behavior detection analysis indicates that the driver or passenger is about to perform an interactive operation on the display screen.

[0038] On the other hand, embodiments of this application provide an electronic device, including:

[0039] At least one processor;

[0040] At least one memory for storing at least one program;

[0041] When the at least one program is executed by the at least one processor, the at least one processor implements the above-described intelligent interaction method for a vehicle display screen.

[0042] On the other hand, embodiments of this application also provide a computer-readable storage medium storing a processor-executable program, which, when executed by a processor, is used to implement the above-described intelligent interaction method for a vehicle display screen.

[0043] The advantages and beneficial effects of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application:

[0044] This application discloses an intelligent interaction method, device, equipment, and storage medium for a vehicle display screen. The method includes: detecting voice data of occupants in the target vehicle during operation and performing behavior detection analysis on the occupants; performing intent recognition on the occupants based on the voice data to obtain corresponding intent recognition results; determining the target menu interface corresponding to the display screen of the target vehicle based on the intent recognition results; and adjusting the current display screen interface to the target menu interface when the behavior detection analysis result indicates that the occupants are about to perform interactive operations on the display screen. This application's technical solution, by combining voice recognition and behavior detection analysis, effectively improves the problems of complex menu hierarchy and cumbersome operation of in-vehicle display screens. During the operation of the target vehicle, the system monitors the voice data and behavioral status of the driver and passengers in real time, accurately identifies user intentions and predicts interaction needs, and automatically switches the display screen interface to the target menu. This significantly reduces the steps and time of manual operation, avoids the problem of multiple clicks in traditional fixed category menus, and overcomes the shortcomings of low recognition rate and slow response of single voice or gesture control. It significantly improves interaction efficiency and driving safety, and is especially suitable for convenient operation needs in dynamic driving scenarios. Attached Figure Description

[0045] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the following description is provided with accompanying drawings of the relevant technical solutions in the embodiments of this application or the prior art. It should be understood that the accompanying drawings described below are only for the purpose of clearly illustrating some embodiments of the technical solutions in this application. For those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0046] Figure 1 This is a schematic diagram illustrating the implementation environment of an intelligent interaction method for a vehicle display screen provided in this application embodiment;

[0047] Figure 2This is a flowchart illustrating an intelligent interaction method for a vehicle display screen provided in an embodiment of this application.

[0048] Figure 3 This is a schematic diagram of the structure of an intelligent interactive device for a vehicle display screen provided in an embodiment of this application;

[0049] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0050] The present application will be further described below with reference to the accompanying drawings and specific embodiments. The described embodiments should not be considered as limitations on the present application, and all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of the present application.

[0051] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0052] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0053] With the rapid development of automotive intelligent technology, the functions of in-vehicle displays have become increasingly rich, evolving from simple information display to an interactive hub integrating navigation, entertainment, vehicle control, and driving assistance.

[0054] Currently, in-vehicle displays are integrating an increasing number of functional modules, including navigation, entertainment, climate control, vehicle settings, and driver assistance, resulting in complex menu hierarchies and cumbersome operations. Traditional display menu layouts typically use fixed categories or functional groupings, often requiring users to click or swipe multiple times to find the desired function. This is cumbersome and time-consuming, especially while driving, as prolonged distraction from screen operation not only affects the user experience but may also pose safety hazards. Furthermore, some solutions attempt to introduce voice control or gesture operation to simplify interaction, but due to insufficient recognition accuracy or response delays, the actual experience remains not smooth enough, and practicality is limited.

[0055] In view of this, this application provides an intelligent interaction method, device, equipment, and storage medium for a vehicle display screen. The method includes: detecting voice data of occupants in the target vehicle during operation and performing behavior detection analysis on the occupants; performing intent recognition on the occupants based on the voice data to obtain a corresponding intent recognition result; determining the target menu interface corresponding to the display screen of the target vehicle based on the intent recognition result; and adjusting the current display screen interface to the target menu interface when the behavior detection analysis result indicates that the occupants are about to perform interactive operations on the display screen. This application's technical solution, by combining voice recognition and behavior detection analysis, effectively improves the problems of complex menu hierarchy and cumbersome operation of in-vehicle display screens. During the operation of the target vehicle, the system monitors the voice data and behavioral status of the driver and passengers in real time, accurately identifies user intentions and predicts interaction needs, and automatically switches the display screen interface to the target menu. This significantly reduces the steps and time of manual operation, avoids the problem of multiple clicks in traditional fixed category menus, and overcomes the shortcomings of low recognition rate and slow response of single voice or gesture control. It significantly improves interaction efficiency and driving safety, and is especially suitable for convenient operation needs in dynamic driving scenarios.

[0056] The technical solution of this application is mainly applicable to modern intelligent vehicles equipped with multi-functional in-vehicle displays, and is particularly suitable for scenarios where vehicle functions need to be operated quickly and safely while driving. When the driver or passenger expresses their needs via voice (such as adjusting the air conditioning, setting navigation, or switching entertainment content), the system can automatically predict the operation intention by combining real-time behavior detection (such as eye contact or gestures towards the screen) and directly jump to the relevant function interface, avoiding the cumbersome operation of traditional multi-level menus. This solution has significant advantages in driving environments that require concentration, such as highway driving and congested roads, balancing ease of operation and driving safety. It is also suitable for scenarios where visual interaction is limited, such as at night or in low light conditions.

[0057] Please refer to Figure 1 , Figure 1 This illustration shows an implementation environment diagram of an intelligent interaction method for a vehicle display screen provided in this application embodiment. In this implementation environment, the main entities involved are a vehicle and a backend server 120, referred to in this application as the target vehicle 110. The target vehicle 110 includes a display screen that can display menu interfaces for relevant functions and is used to realize interaction with the driver and passengers. The target vehicle 110 and the backend server 120 are communicatively connected. The intelligent interaction method for the vehicle display screen provided in this application embodiment can be executed independently on the target vehicle 110 side, or based on data interaction between the target vehicle 110 and the backend server 120.

[0058] Among them, the backend server 120 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.

[0059] The target vehicle 110 and the backend server 120 can establish a communication connection via a wireless network or a wired network. This wireless or wired network uses standard communication technologies and / or protocols. The network can be the Internet or any other network, including but not limited to any combination of Local Area Network (LAN), Metropolitan Area Network (MAN), Wide Area Network (WAN), mobile, wired or wireless networks, private networks, or virtual private networks.

[0060] Of course, this is understandable. Figure 1 The implementation environment described in this application is only one of the optional application scenarios for the intelligent interaction method of the vehicle display screen provided in this embodiment. The actual application is not fixed. Figure 1 The software and hardware environment shown.

[0061] Below, in conjunction with the foregoing description of the implementation environment, a smart interaction method for a vehicle display screen provided in this application embodiment will be introduced and explained.

[0062] Please refer to Figure 2 , Figure 2 This is a schematic diagram of an intelligent interaction method for a vehicle display screen provided in an embodiment of this application. The intelligent interaction method for the vehicle display screen includes, but is not limited to:

[0063] Step 210: During the operation of the target vehicle, detect the voice data of the driver and passengers in the target vehicle, and perform behavioral detection and analysis on the driver and passengers;

[0064] Step 220: Based on the voice data, perform intent recognition on the driver and passenger to obtain the corresponding intent recognition result;

[0065] Step 230: Based on the intent recognition result, determine the target menu interface corresponding to the display screen of the target vehicle;

[0066] Step 240: When the behavior detection analysis indicates that the driver or passenger is about to interact with the display screen, the current interface of the display screen is adjusted to the target menu interface.

[0067] This application provides an intelligent interaction method for a vehicle display screen. This method significantly improves the operational efficiency and safety of the in-vehicle system through multimodal interaction combining voice and behavior. During vehicle operation, the system monitors the voice data and actions of the driver and passengers in real time, intelligently analyzes user intentions and predicts operational needs, and automatically switches the display screen to the target menu interface, eliminating the tedious search process of traditional multi-level menus. Compared to single voice or touch interaction methods, this method effectively reduces the risk of misoperation, and is particularly suitable for blind operation needs in driving scenarios. While ensuring driving safety, it provides users with a more natural and smooth human-vehicle interaction experience.

[0068] Specifically, in this embodiment, the system continuously monitors the in-vehicle environment while the vehicle is in operation. For example, it can collect voice data from occupants using a high-sensitivity microphone array. Occupants can include the driver and passengers within the target vehicle. In this embodiment, the detected voice data includes not only explicit commands (such as turning on the air conditioning or navigating to the airport) but also potential semantic needs within the dialogue (e.g., "It's so hot!" might be associated with air conditioning adjustment, or "There seems to be traffic ahead!" might trigger a traffic query). The system continuously analyzes the temporal characteristics of the voice data, including intonation changes, keyword frequency, and dialogue context, to establish a dynamically updated semantic understanding model.

[0069] Furthermore, in this embodiment, behavioral detection and analysis of drivers and passengers can also be performed. For example, the system can construct an all-weather behavioral perception network using 3D ToF cameras and infrared sensor arrays deployed inside the vehicle. This network can accurately capture the subtle movement characteristics of the driver and passengers. In terms of detection dimensions, it can analyze not only explicit interaction features such as macroscopic behaviors like head rotation angles, gaze coordinates, and hand movement trajectories, but also implicit state indicators such as micro-expression changes and limb relaxation. For instance, when the system detects the driver frequently glancing at the screen with outstretched fingers, it may determine this as a preparatory action for menu operation; conversely, when the system detects a passenger closing their eyes and tilting their head back, it determines this as a resting state. At the technical implementation level, this embodiment can use a lightweight convolutional neural network to process the raw sensor data, and through a spatiotemporal feature fusion algorithm, convert discrete action fragments into continuous behavioral semantics. Specifically, the system can also establish a behavioral knowledge graph for driving scenarios, capable of distinguishing between easily confused behaviors such as "natural hand movements when adjusting the rearview mirror" and "directional actions intended to operate the screen." In some embodiments, to maximize detection reliability, the system performs cross-validation by combining vehicle dynamic data. For example, when the steering wheel angle sensor indicates that the vehicle is turning, the system automatically compensates for the false positive rate of driver line of sight deviation.

[0070] In this embodiment, based on voice data, the intent of the driver and passengers can be recognized to obtain the corresponding intent recognition result. Specifically, in some embodiments, intent recognition can adopt a multi-level semantic understanding architecture, using deep neural networks to perform three-dimensional analysis of voice data. For example, a hybrid intent recognition model based on Transformer can be used. This model integrates domain adaptation technology and context awareness mechanisms, and can simultaneously handle explicit instructions (such as turning on seat heating) and implicit needs (such as feet being a little cold). The hybrid intent recognition model constructs a dynamic intent probability distribution map by analyzing keyword density, intonation variation curves, and speech rate fluctuation features in the voice data, thereby obtaining the intent recognition result.

[0071] Specifically, in this embodiment, voice data can be input into a locally deployed intent recognition model, which then analyzes the data to obtain the intent recognition result. It is easy to understand that local processing eliminates network transmission latency, enabling the system to complete the entire process from voice data input to intent parsing in a shorter time, thus more efficiently meeting the real-time requirements of driving scenarios. Furthermore, local deployment of the intent recognition model, through vehicle-side computation, ensures user privacy and security, preventing the leakage of sensitive voice data and complying with increasingly stringent data compliance requirements.

[0072] In this embodiment, after obtaining the intent recognition result, the system can activate a multi-dimensional decision engine, comprehensively considering multiple variables such as the current driving status, function usage frequency, and environmental factors, and dynamically select the target menu interface that best meets the user's current needs from multiple preset interface templates. For example, in some embodiments, when a navigation-related intent is recognized, a menu interface that directly includes an entry point to a map application can be selected as the target menu interface. In other embodiments, the intent recognition result of the driver or passenger may include multiple desired functions, such as the simultaneous need for "home route + traffic announcement + air conditioning adjustment". In this case, the system can generate a customized aggregated interface as the target menu interface, intelligently arranging related functions within the same view for user convenience. In special scenarios, such as heavy rain, even if the user does not explicitly mention it, the system will proactively embed safety-related shortcuts such as wiper control and fog light switch in the target menu interface, thus better adapting to the current actual needs.

[0073] It is understood that, in the embodiments of this application, the context-aware interface dynamic optimization mechanism based on voice data can accurately match the user's needs, proactively predict potential operation intentions, and enable the user to complete the interaction of the functions they want to use on the first screen, greatly reducing the operational burden of traditional multi-level menus.

[0074] Furthermore, it should be noted that in this embodiment, after determining the target menu interface, updating the display of the target menu interface is not considered. This is because, in some cases, the driver or passenger may only mention some needs in conversation and may not actually intend to interact with the in-vehicle display screen. Moreover, since the driver's voice data may be quite frequent, updating the display screen every time the target menu interface is generated would cause frequent content changes, easily affecting the driver's attention and thus impacting vehicle safety.

[0075] Considering the above, this embodiment employs a dual guarantee mechanism of prediction and confirmation to optimize the interface switching logic, fully taking into account the complex interaction characteristics in actual driving scenarios. Specifically, an intelligent preloading engine can continuously run in the background, that is, the target menu interface is pre-rendered in memory and all resources are loaded, but the current interface visual remains unchanged. This design cleverly solves the problem of accidental voice triggering (for example, the driver or passenger is just illustrating a scenario and does not intend to implement it in the vehicle). In addition, the system also analyzes the user's body language through a behavior detection module (integrating a 3D ToF camera and millimeter-wave radar): if features such as the hand being continuously placed on the steering wheel or the gaze not being directed at the screen for more than 1.2 seconds are detected, it is determined to be an invalid command, avoiding meaningless interface jumps. Only when the system captures a clear combination of interaction signals (such as the driver's right hand leaving the steering wheel and moving towards the screen, the gaze focusing on a specific area of ​​the screen for more than 0.8 seconds, or the body leaning forward at an angle greater than 15 degrees, etc.) will the interface switching be triggered, adjusting the display screen to the target menu interface. This multimodal behavior verification mechanism improves the accuracy of interface updates, reduces a large number of invalid jumps compared to traditional solutions, and since the target menu interface is pre-loaded, the actual switching delay is negligible, and users can hardly perceive the loading process, resulting in a better experience.

[0076] It is understood that this application provides an intelligent interaction method, device, equipment, and storage medium for a vehicle display screen. The method includes: detecting voice data of occupants in the target vehicle during its operation, and performing behavior detection analysis on the occupants; performing intent recognition on the occupants based on the voice data to obtain a corresponding intent recognition result; determining the target menu interface corresponding to the display screen of the target vehicle based on the intent recognition result; and adjusting the current display screen interface to the target menu interface when the behavior detection analysis result indicates that the occupants are about to perform an interactive operation on the display screen. This method, by combining voice recognition and behavior detection analysis, effectively improves the problems of complex menu hierarchy and cumbersome operation of in-vehicle display screens. During the operation of the target vehicle, the system monitors the voice data and behavioral status of the driver and passengers in real time, accurately identifies user intentions and predicts interaction needs, and automatically switches the display screen interface to the target menu. This significantly reduces the steps and time of manual operation, avoids the problem of multiple clicks in traditional fixed category menus, and overcomes the shortcomings of low recognition rate and slow response of single voice or gesture control. It significantly improves interaction efficiency and driving safety, and is especially suitable for convenient operation needs in dynamic driving scenarios.

[0077] Specifically, in some embodiments, after detecting the voice data of the occupants in the target vehicle, the method further includes:

[0078] The ambient noise inside the target vehicle was collected;

[0079] The speech data is adaptively filtered based on the ambient noise.

[0080] In this embodiment, while collecting the voice data of drivers and passengers, reference microphones deployed throughout the vehicle cabin can be used to monitor environmental noise characteristics in real time, including low-frequency vibrations related to engine speed, the spectral distribution of tire noise and wind noise, and the impact of rain and snow on the acoustic environment. Based on these noise characteristics, an improved spectral subtraction and adaptive filtering algorithm can be used to dynamically construct inverse sound waves related to environmental noise, achieving accurate noise reduction of the original voice data. For example, when the vehicle accelerates to 80 km / h, the system automatically enhances the suppression of noise in the 200-500 Hz frequency band; while in heavy rain, the focus is on eliminating high-frequency random noise generated by raindrops hitting the roof. This environmentally adaptive noise reduction processing ensures that the voice recognition accuracy remains at a high level even in highway scenarios, which is beneficial to improving the accuracy of intelligent interaction.

[0081] Specifically, in some embodiments, the behavioral detection and analysis of the occupants includes:

[0082] The eye movement trajectory and hand gesture characteristics of the driver and passengers were collected;

[0083] Based on the eye movement trajectory, determine the focal point of the driver's gaze;

[0084] When it is detected that the driver's gaze is focused on the area where the display screen is located, and the hand gesture characteristics indicate that the driver's hand is moving towards the display screen, it is determined that the driver is about to interact with the display screen.

[0085] In this embodiment of the application, the interaction intentions of drivers and passengers can be accurately predicted by integrating visual and action-based behavioral analysis.

[0086] Specifically, in-vehicle vision sensors can be used to capture the natural behavioral characteristics of drivers and passengers, including their eye movement trajectories and hand gestures. By analyzing eye rotation angles and dwell times, it's possible to intelligently determine whether the gaze is truly focused on the display screen area, effectively distinguishing between unconscious scanning and purposeful operational fixation. Simultaneously, combined with the analysis of hand movement trajectories, when a hand is detected moving towards the display screen at a specific speed and direction, behavioral co-verification is achieved with eye focus, ensuring that only genuine operational intentions trigger an interface response.

[0087] In this embodiment, a multimodal behavior recognition mechanism is used to avoid accidental triggering due to occasional gaze deviation, while also responding promptly to real operational needs. This provides users with a smooth and natural interactive experience while ensuring driving safety. In practical applications, a behavior confidence evaluation algorithm can be designed so that only when gaze focus and hand movements simultaneously reach the interaction threshold is it determined to be a valid operational intent, making interface switching both precise and controlled.

[0088] Specifically, in some embodiments, determining the target menu interface corresponding to the display screen of the target vehicle based on the intent recognition result includes:

[0089] Obtain the operation records of the driver and passenger within a historical time period, and determine the functional preference information corresponding to the driver and passenger based on the operation records;

[0090] Based on the intent recognition results and the function preference information, multiple candidate function icons are determined;

[0091] The candidate function icons are arranged and combined to obtain the initial menu interface;

[0092] The ambient light data inside the target vehicle is detected, and the background color of the initial menu interface is adjusted according to the ambient light data to obtain the target menu interface.

[0093] In this embodiment of the application, when generating the target menu interface, a truly personalized in-vehicle interactive experience can be created by using an intelligent interface generation mechanism that integrates user habits and environmental awareness.

[0094] Specifically, after analyzing and obtaining the driver's / passenger's intent recognition results, a dynamic preference model can be constructed by combining the driver's / passenger's historical operation records to intelligently predict the possible combination of functions. For example, if the driver's / passenger's operation records within a historical period show that they frequently use navigation and music functions during commuting, the system will automatically associate and recommend icons for these two types of functions. Based on the intent recognition results and function preference information, multiple candidate function icons can be identified.

[0095] In this embodiment, for multiple candidate function icons, an adaptive layout algorithm can be used to generate the initial menu interface, ensuring that frequently used functions are in the optimal touch area. Simultaneously, ambient light sensing intelligent adjustment technology is introduced to automatically optimize the interface's color contrast and brightness based on the actual lighting conditions inside the vehicle. For example, it automatically switches to a high-contrast mode in strong light environments and activates a dark theme when driving at night, ensuring clear visibility of the interface while avoiding light stimulation that could affect driving safety. This dynamic interface generation method, which considers both user habits and environmental adaptation, makes each presented menu feel customized, significantly improving operational intuitiveness and efficiency, and better meeting the user's personalized needs.

[0096] Specifically, in some embodiments, arranging and combining the candidate function icons to obtain the initial menu interface includes:

[0097] Based on the intent recognition results and the function preference information, determine the matching degree data corresponding to each candidate function icon;

[0098] Based on the matching degree data, a corresponding display area is assigned to each candidate function icon; wherein, the display area and the matching degree data are positively correlated.

[0099] According to the display area, the candidate function icons are filled and arranged within the displayable area of ​​the display screen to obtain the initial menu interface.

[0100] In this embodiment, an intelligent dynamic layout algorithm for function icons can be used to achieve adaptive optimization of the target menu interface. Specifically, based on a deep understanding of user intent and historical preference analysis, a precise matching score can be calculated for each candidate function icon, reflecting the relevance of the function in the current scenario. According to the difference in matching scores, the system automatically allocates differentiated display areas. Core functions with high matching scores receive a larger display area and a central position, forming a visual focus; while less relevant functions are distributed in an appropriate proportion in the surrounding area, with a relatively smaller display area. This asymmetrical intelligent layout ensures quick access to primary functions while maintaining the accessibility of auxiliary functions, optimizing interface space utilization. By dynamically adjusting icon size and position, a visual attraction effect that meets user expectations is created, allowing the most important functions to naturally attract user attention and facilitating subsequent interactive operations.

[0101] Reference Figure 3 This application also provides an intelligent interactive device for a vehicle display screen, comprising:

[0102] The detection unit 310 is used to detect the voice data of the driver and passengers in the target vehicle during the operation of the target vehicle, and to perform behavioral detection and analysis on the driver and passengers.

[0103] The recognition unit 320 is used to perform intent recognition on the driver and passenger based on the voice data, and obtain the corresponding intent recognition result;

[0104] The processing unit 330 is used to determine the target menu interface corresponding to the display screen of the target vehicle based on the intent recognition result.

[0105] The adjustment unit 340 is used to adjust the current interface of the display screen to the target menu interface when the result of the behavior detection analysis indicates that the driver or passenger is about to perform an interactive operation on the display screen.

[0106] It is understood that the content of the above method embodiments is applicable to the present device embodiments. The specific functions implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0107] Reference Figure 4 This application provides an electronic device, including:

[0108] At least one processor 410;

[0109] At least one memory 420 is used to store at least one program;

[0110] When at least one program is executed by at least one processor 410, the at least one processor 410 implements the above-described intelligent interaction method for a vehicle display screen.

[0111] Similarly, the content of the above method embodiments is applicable to the embodiments of this electronic device. The specific functions implemented by the embodiments of this electronic device are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0112] This application embodiment also provides a computer-readable storage medium storing a program executable by a processor 410, which, when executed by the processor 410, is used to perform the above-described intelligent interaction method for a vehicle display screen.

[0113] Similarly, the content of the above method embodiments is applicable to the present computer-readable storage medium embodiments. The specific functions implemented by the present computer-readable storage medium embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0114] In some alternative embodiments, the functions / operations mentioned in the block diagrams may not occur in the order shown in the operation diagrams. For example, depending on the functions / operations involved, two consecutively shown blocks may actually be executed substantially simultaneously, or the blocks may sometimes be executed in reverse order. Furthermore, the embodiments presented and described in the flowcharts of this application are provided by way of example to provide a more comprehensive understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed and sub-operations described as part of a larger operation are executed independently.

[0115] Furthermore, although this application is described in the context of functional modules, it should be understood that, unless otherwise stated to the contrary, one or more of the functions and / or features may be integrated into a single physical device and / or software module, or one or more functions and / or features may be implemented in a separate physical device or software module. It is also understood that a detailed discussion of the actual implementation of each module is unnecessary for understanding this application. Rather, given the properties, functions, and internal relationships of the various functional modules in the apparatus disclosed herein, the actual implementation of the module will be understood within the scope of conventional technology for an engineer. Therefore, those skilled in the art can implement the application set forth in the claims using ordinary techniques without excessive experimentation. It is also understood that the specific concepts disclosed are merely illustrative and not intended to limit the scope of this application, which is determined by the full scope of the appended claims and their equivalents.

[0116] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0117] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0118] More specific examples of computer-readable media (a non-exhaustive list) include: electrical connections (electronic devices) having one or more wires, portable computer disk drives (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which programs can be printed, because programs can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0119] It should be understood that various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0120] In the foregoing description of this specification, the references to terms such as "one embodiment," "another embodiment," or "some embodiments," etc., indicate that a specific feature, structure, material, or characteristic described in connection with an embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0121] Although embodiments of this application have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of this application, the scope of which is defined by the claims and their equivalents.

[0122] The above is a detailed description of the preferred embodiments of this application, but this application is not limited to the embodiments. Those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of this application, and these equivalent modifications or substitutions are all included within the scope defined by the claims of this application.

Claims

1. A smart interaction method for a vehicle display screen, characterized in that, Applied to a target vehicle, the method includes: During the operation of the target vehicle, the voice data of the driver and passengers inside the target vehicle are detected, and the behavior of the driver and passengers is detected and analyzed. Based on the voice data, the driver and passengers' intentions are identified to obtain the corresponding intention recognition results; Based on the intent recognition result, the target menu interface corresponding to the display screen of the target vehicle is determined; When the behavior detection analysis indicates that the driver or passenger is about to interact with the display screen, the current interface of the display screen is adjusted to the target menu interface.

2. The intelligent interaction method for a vehicle display screen according to claim 1, characterized in that, After detecting the voice data of the occupants inside the target vehicle, the method further includes: The ambient noise inside the target vehicle was collected; The speech data is adaptively filtered based on the ambient noise.

3. The intelligent interaction method for a vehicle display screen according to claim 1, characterized in that, The behavioral detection and analysis of the drivers and passengers includes: The eye movement trajectory and hand gesture characteristics of the driver and passengers were collected; Based on the eye movement trajectory, determine the focal point of the driver's gaze; When it is detected that the driver's gaze is focused on the area where the display screen is located, and the hand gesture characteristics indicate that the driver's hand is moving towards the display screen, it is determined that the driver is about to interact with the display screen.

4. The intelligent interaction method for a vehicle display screen according to claim 1, characterized in that, The step of determining the target menu interface corresponding to the display screen of the target vehicle based on the intent recognition result includes: Obtain the operation records of the driver and passenger within a historical time period, and determine the functional preference information corresponding to the driver and passenger based on the operation records; Based on the intent recognition results and the function preference information, multiple candidate function icons are determined; The candidate function icons are arranged and combined to obtain the initial menu interface; The ambient light data inside the target vehicle is detected, and the background color of the initial menu interface is adjusted according to the ambient light data to obtain the target menu interface.

5. The intelligent interaction method for a vehicle display screen according to claim 4, characterized in that, The step of arranging and combining the candidate function icons to obtain the initial menu interface includes: Based on the intent recognition results and the function preference information, determine the matching degree data corresponding to each candidate function icon; Based on the matching degree data, a corresponding display area is assigned to each candidate function icon; wherein, the display area and the matching degree data are positively correlated. According to the display area, the candidate function icons are filled and arranged within the displayable area of ​​the display screen to obtain the initial menu interface.

6. The intelligent interaction method for a vehicle display screen according to claim 1, characterized in that, The step of performing intent recognition on the driver / passenger based on the voice data to obtain the corresponding intent recognition result includes: The voice data is input into a locally deployed intent recognition model, and analyzed by the intent recognition model to obtain the intent recognition result.

7. The intelligent interaction method for a vehicle display screen according to claim 6, characterized in that, The intent recognition model is built on the Transformer architecture.

8. An intelligent interactive device for a vehicle display screen, characterized in that, Applied to a target vehicle, the device includes: The detection unit is used to detect the voice data of the driver and passengers in the target vehicle during the operation of the target vehicle, and to perform behavioral detection and analysis on the driver and passengers. The recognition unit is used to perform intent recognition on the driver and passenger based on the voice data, and obtain the corresponding intent recognition result; The processing unit is configured to determine the target menu interface corresponding to the display screen of the target vehicle based on the intent recognition result; An adjustment unit is used to adjust the current interface of the display screen to the target menu interface when the result of the behavior detection analysis indicates that the driver or passenger is about to perform an interactive operation on the display screen.

9. An electronic device, characterized in that, include: At least one processor; At least one memory for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements a smart interaction method for a vehicle display screen as described in any one of claims 1-7.

10. A computer-readable storage medium storing a processor-executable program, characterized in that, The processor-executable program, when executed by the processor, is used to implement an intelligent interaction method for a vehicle display screen as described in any one of claims 1-7.

Images