Display control method and device of user interface, electronic equipment and medium

By recognizing user behavior data and judging driving attention, the display mode of the application interface of the in-vehicle terminal is automatically adjusted, which solves the problem of attention distraction caused by touch operation during driving and improves driving safety and user experience.

CN116069155BActive Publication Date: 2026-06-26HUMAN HORIZONS (SHANGHAI) CLOUD COMPUTING TECH CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
HUMAN HORIZONS (SHANGHAI) CLOUD COMPUTING TECH CO LTD
Filing Date
2021-10-29
Publication Date
2026-06-26

AI Technical Summary

Technical Problem

During driving, the operation of touch-screen in-vehicle systems requires users to touch the screen, which can lead to distraction and affect driving safety.

Method used

By recognizing user behavior data and utilizing eye-tracking, gesture, and lip-reading technologies, the display mode of the application interface of the in-vehicle terminal is automatically adjusted. Based on the driver's attention judgment, preset application interfaces are displayed or hidden, and the system switches to the ADAS interface to improve driving safety.

Benefits of technology

While ensuring driving safety, we aim to improve user experience, reduce visual resource usage, and enhance driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116069155B_ABST
    Figure CN116069155B_ABST
Patent Text Reader

Abstract

The application provides a display control method and device of a user interface, an electronic device and a medium. The method comprises the following steps: identifying and analyzing real-time collected user behaviors to obtain user behavior data; and controlling a preset application interface to display in different display modes according to the user behavior data, so that the user experience is improved under the premise of ensuring driving safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of driver assistance systems, and more particularly to a method, apparatus, electronic device, and medium for displaying and controlling a user interface. Background Technology

[0002] With the development of technology, touch-screen in-vehicle systems have gradually become standard equipment in vehicles from various manufacturers in recent years. Compared to traditional physical control-based in-vehicle systems, touch-screen systems offer richer functions, such as calls, navigation, video, and music. Unlike mobile interaction scenarios, driving is the primary task in an in-vehicle environment, while other tasks are secondary and should be used only when driving safety is a priority. However, both physical control and touch-screen in-vehicle systems require user touch operation to display secondary tasks, causing attention to be diverted for extended periods to areas that may affect driving safety. This consumes more of the user's visual resources while driving, thus impacting driving safety. Summary of the Invention

[0003] This application provides a user interface display control method, device, electronic device, and medium to solve the problems existing in related technologies. The technical solution is as follows:

[0004] In a first aspect, embodiments of this application provide a user interface display control method applied to an in-vehicle terminal, comprising: identifying and analyzing real-time collected user behavior to obtain user behavior data; and controlling a preset application interface to display in different display modes based on the user behavior data.

[0005] Secondly, embodiments of this application provide a user interface display control device applied to an in-vehicle terminal, comprising: an identification module for identifying and analyzing real-time collected user behavior to obtain user behavior data; and a control module for controlling a preset application interface to display in different display modes based on the user behavior data.

[0006] Thirdly, embodiments of this application provide an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to execute the aforementioned user interface display control method.

[0007] Fourthly, embodiments of this application provide a computer-readable storage medium that stores computer instructions, wherein when the computer instructions are executed on a computer, the methods in any of the above-described embodiments are performed.

[0008] The advantages or beneficial effects of the above technical solutions include at least the following:

[0009] This application can determine different display modes of the preset application interface based on user behavior data, thereby improving the user experience while ensuring driving safety.

[0010] The above overview is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features of this application will become readily apparent from the accompanying drawings and the following detailed description. Attached Figure Description

[0011] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the various drawings denote the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings depict only some embodiments disclosed in this application and should not be construed as limiting the scope of this application.

[0012] Figure 1 This is a flowchart of a user interface display control method according to an embodiment of this application;

[0013] Figure 2 This is a schematic diagram illustrating the target gesture behavior according to an embodiment of this application;

[0014] Figure 3 This is a schematic diagram of a preset application interface according to an embodiment of this application;

[0015] Figures 4A-4D This is a schematic diagram illustrating different display modes of a preset application interface according to an embodiment of this application;

[0016] Figure 5 This is a schematic diagram illustrating the switching of a preset application interface in different display modes according to an embodiment of this application;

[0017] Figure 6 This is a block diagram of a display control device for a user interface according to an embodiment of this application;

[0018] Figure 7 This is a block diagram of an electronic device used to implement the display control method for the user interface in the embodiments of this application. Detailed Implementation

[0019] In the following description, only certain exemplary embodiments are briefly described. As those skilled in the art will recognize, the described embodiments can be modified in various ways without departing from the spirit or scope of this application. Therefore, the drawings and description are considered to be exemplary in nature and not restrictive.

[0020] In the current technology, touch-screen in-vehicle terminals have gradually become the standard configuration of vehicles from various manufacturers. However, when users need to launch certain applications with entertainment functions while driving, they inevitably need to touch to switch to the application interface. Furthermore, since the touch screen of the in-vehicle system cannot provide haptic feedback, it will occupy a lot of the user's visual resources while driving, making it impossible for the user to concentrate on driving and affecting driving safety.

[0021] In view of this, please refer to Figure 1 As shown, this application provides a user interface display control method applied to an in-vehicle terminal, such as... Figure 1 As shown, the display control method may include:

[0022] Step S101: Identify and analyze the user behavior collected in real time to obtain user behavior data.

[0023] Step S102: Based on user behavior data, control the preset application interface to display in different display modes.

[0024] The user interface display control method in this embodiment can match the corresponding display mode based on user behavior, achieving application interface display without requiring any additional operation from the user on the vehicle terminal. This allows users to conveniently perform various operations on the preset application interface while maintaining driving safety. For example, when a specified operation by the user on the preset application interface is detected, the display mode switches from a first display mode to a second display mode. The different display modes include interface display elements arranged according to different priorities.

[0025] In one possible implementation, user behavior data is a variety of standard data used to describe user behavior. Optionally, user behavior data includes any combination of visual location coordinates, target gesture data, target body data, or target lip reading data.

[0026] In step S101, the real-time collected user behavior is identified and analyzed to obtain user behavior data. This can be achieved through the following process: using eye-tracking technology, the visual position coordinates of the user's visual focus on the vehicle terminal are captured; the user's gesture features are identified and mapped to the corresponding target gesture data; the user's limb features are identified and mapped to the corresponding target limb data; the user's lip reading features are identified and mapped to the corresponding target lip reading data.

[0027] Optionally, this application uses machine vision recognition technology to identify and analyze user behavior collected in real time.

[0028] For example, when recognizing target gesture data, the collected gesture features are mapped to target gesture behavior, thereby mapping the collected gesture features to their corresponding target gesture data. Figure 2 The example illustrates seven target gesture behaviors, such as comparing a captured gesture feature with... Figure 2 The target gesture behaviors are compared, and the target gesture behavior with the smallest difference is used as the target gesture data for recognition. Similarly, the same recognition principle is used when recognizing target limb data and target lip reading data. The collected limb features are mapped to target limb data, and the collected lip reading features are mapped to target lip reading data. This will not be elaborated on here.

[0029] In one possible implementation, before identifying and analyzing the real-time collected user behavior, the method further includes: acquiring driving data from the vehicle terminal; using the driving data to determine driving attention and obtain a driving attention determination result; and collecting user behavior in real time when the driving attention determination result meets preset conditions.

[0030] In this embodiment, the driving data is related data used to describe the state of the vehicle terminal. The state of the vehicle terminal includes information such as the road conditions, gear position, GPS positioning, and vehicle speed.

[0031] In practice, when acquiring driving data from the vehicle-mounted terminal, the vehicle-mounted sensors are used to obtain road data, gear data, GPS data, and vehicle speed data to obtain the driving data of the vehicle-mounted terminal.

[0032] Specifically, using driving data to determine driving attention and obtain the driving attention determination result can be achieved in the following way: inputting driving data into a preset driving attention determination model to determine driving attention and obtain the driving attention determination result.

[0033] Optionally, in this embodiment of the application, the driver's attention is scored using a driving attention judgment model based on the identified driving data. The driver's attention score characterizes the degree of driver attention. Specifically, if the driving data matches characteristics of driver inattention, such as the engine being on or the speed being 0 for a duration less than a preset time, the attention score is high; conversely, the attention score is low. A high attention score indicates a high degree of attention. Optionally, the driving attention judgment model scores the driving data separately to obtain a final attention score.

[0034] Optionally, in this embodiment, an attention judgment model needs to be pre-built. For various driving scenarios, driving data related to each scenario is acquired, the impact of this data on driving safety is analyzed, and the degree of impact of different types of driving data on driving safety is classified into levels. After acquiring the above data, it can be used as training data to build the attention judgment model. Once the attention judgment model is established, inputting new driving data into it will automatically output the corresponding driving scenario and the corresponding attention judgment level for that scenario.

[0035] In this embodiment of the application, based on the driving attention judgment result, the display or hiding of the preset application interface on the vehicle terminal is controlled, including the following two situations:

[0036] In scenario one, if the driver attention assessment result meets the preset conditions, the preset application interface is displayed on the vehicle terminal in the first display mode.

[0037] Optionally, when the driver's attention is low, the in-vehicle terminal displays a preset application interface in the first display mode. In this case, the driver's attention can be diverted to secondary tasks other than driving, making it easier for the user to perform further operations on the preset application interface. For example, the user can open the relevant application for music function, thereby improving the user experience.

[0038] Scenario 2: If the driver attention judgment result does not meet the preset condition, the preset application interface is hidden on the vehicle terminal, and the preset Advanced Driver Assistant System (ADAS) interface is displayed.

[0039] Optionally, when the driver's attention is high, it indicates that the driving environment is complex and the driving difficulty is high. At this time, the vehicle terminal hides the application interface and displays the ADAS interface. This allows the driver to drive safely by using the displayed ADAS interface and avoids diverting the driver's attention to secondary tasks that affect driving safety, thereby improving driving safety.

[0040] Optionally, a corresponding display strategy can be adopted based on the relationship between the attention score or attention judgment level output by the driving attention judgment model and a pre-set decision threshold. Specifically, the decision threshold can be divided into different stages or levels. Within the safe range, the preset application interface can be displayed; outside the safe range, the preset application interface is hidden, and the preset ADAS interface is displayed.

[0041] It is worth mentioning that the preset application interface in this application embodiment is an application operation interface for human-computer interaction.

[0042] Please see Figure 3 , Figure 3The diagram shows an exemplary preset application interface. This preset application interface consists of five display areas with different operation types: an entry-level function display area, an operation-level function display area, a status-level function display area, a streaming-level function display area, and a search-level function display area. The entry-level function display area is located at the bottom of the interface and is used to provide control functions for important vehicle subsystems, such as the air conditioning system. The operation-level function display area allows selection of services provided by the application. The status-level function display area displays the current status of the services provided by the application. Different types of display areas have different priorities during loading and display. Table 1 shows the different priorities corresponding to different types of display areas, with P0 having the highest priority and P3 having the lowest priority.

[0043] Table 1

[0044]

[0045]

[0046] ADAS is an active safety technology that uses various sensors installed on the vehicle (which can detect variables such as light, heat, and pressure) to collect environmental data inside and outside the vehicle in real time. It performs technical processing such as identification, detection, and tracking of static and dynamic objects, so that the driver can detect potential dangers in the shortest possible time, thereby raising awareness and improving safety.

[0047] ADAS mainly consists of GPS and CCD camera detection modules, communication modules, and control modules. The GPS and CCD camera detection module receives GPS satellite signals through a GPS receiver to determine the vehicle's latitude and longitude coordinates, speed, time, and other information. Using CCD cameras installed at the front and rear of the vehicle, it monitors the roadside conditions in real time. The communication module can send detected information and transmit driving information between approaching vehicles in real time. The control module can take proactive measures to prevent accidents from occurring.

[0048] The ADAS interface described in this application is an interface that can display the vehicle's attitude and driving status.

[0049] Specifically, controlling the preset application interface to switch from the first display mode to the second display mode may include: controlling the preset application interface to switch from the first display mode to the second display mode with a display area different from the first display mode.

[0050] For example, four different display modes are shown in the embodiments of this application, which can be referred to in detail. Figures 4A-4D As shown.

[0051] Display mode A displays the entry-level function display area in the navigation bar of the ADAS interface.

[0052] The ADAS interface consists of two parts: the main interface and the navigation bar at the bottom of the main interface. In display mode one, the default application interface content is not displayed on the main interface of the ADAS interface; instead, the original main interface content is displayed. Display mode one is used to fully display the default ADAS interface. For details, please refer to [link / reference]. Figure 4A As shown.

[0053] Display Mode B displays an entry-level function display area in the navigation bar of the ADAS interface, and an operation-level function display area and a status-level function display area in the first sub-interface. This first sub-interface occupies part of the main interface of the ADAS interface.

[0054] In display mode two, only a portion of the preset application interface is displayed. The display position of the first sub-interface can be set according to the user's visual habits or can be preset, for example, located in the lower left corner of the main interface. This application does not impose specific limitations on this; please refer to the relevant documentation for details. Figure 4B As shown.

[0055] Display mode C displays an entry-type function display area in the navigation bar of the ADAS interface, and displays an operation-type function display area, a status-type function display area, and a streaming-type function display area in the second sub-interface. The second sub-interface occupies part of the main interface of the ADAS interface, and the display area of ​​the second sub-interface is larger than that of the first sub-interface.

[0056] In display mode three, only a portion of the preset application interface is displayed. The display position of the first sub-interface can be set according to the user's visual habits or preset, for example, in the lower left corner of the main interface. Compared to display mode two, the preset application displays more content and has a larger display area. For details, please refer to [link / reference]. Figure 4C As shown.

[0057] Display mode D displays the entry-level function display area in the navigation bar of the ADAS interface, and displays the operation-level function display area, status-level function display area, flow-level function display area, and editing-level function display area in the main interface of the ADAS interface. The ADAS interface itself is not displayed.

[0058] In display mode four, the entire main interface of the ADAS interface is used to display the preset application interface. In this mode, the preset ADAS interface is hidden, and the preset application interface is displayed in full screen. See details... Figure 4D As shown.

[0059] Optionally, the first display mode and the second display mode of this application include any one of the above display modes, and are not the same. The specified operation includes any one of manual operation, voice operation, and visual operation.

[0060] Please see Figure 5 As shown, Figure 5 This illustration shows a schematic diagram illustrating the switching of a preset application interface between different display modes in an embodiment of this application. Figure 5 It can be seen that detecting a user's specified operation on the preset application interface can switch the display mode of the preset application interface. For example, it can switch from display mode A to display mode B, as long as the display modes are different.

[0061] It should be noted that in the embodiments of this application, different display modes correspond to application display interfaces with different priorities. For example, if user behavior data determines that the user behavior is eye-tracking, then the human-computer interaction method is eye-tracking, and the first display interface displayed is the application display interface with the highest priority. This first display interface has fewer menus. As another example, if user behavior data determines that the user behavior is touch-tracking, then the human-computer interaction method is touch-tracking, and the second display interface displayed has the same priority. This second display interface can be the display interface with the most and most complete content. As yet another example, if user behavior data determines that the user behavior is voice-tracking, then the human-computer interaction method is voice-tracking, and the third display interface displayed is the application display interface with the lowest priority. In this case, the voice robot is displayed on the top layer of the third display interface.

[0062] It should be noted that, although... Figure 3 The preset application interface described above serves as an example of a display interface that indicates the driver's attention level meets preset conditions. However, those skilled in the art will understand that this application is not limited to this. In fact, users can flexibly set the display area of ​​the preset application interface according to their personal preferences and / or actual application scenarios, as long as it can achieve the display of specific entertainment functions.

[0063] In summary, the embodiments of this application can determine driving attention based on driving data, and decide whether to display a preset application interface based on the determination result of driving attention, thereby improving user experience while ensuring driving safety.

[0064] Figure 6 A structural block diagram of a display control device according to an embodiment of this application is shown. Figure 6 As shown, the device may include:

[0065] The identification module 601 is used to identify and analyze user behavior collected in real time to obtain user behavior data;

[0066] The control module 602 is used to control the preset application interface to be displayed in different display modes based on user behavior data.

[0067] In one possible implementation, different display modes include interface display elements that exist in order of different priorities.

[0068] In one possible implementation, the device further includes:

[0069] The acquisition module is used to acquire driving data from the vehicle terminal before identifying and analyzing real-time user behavior.

[0070] The judgment module is used to judge driving attention using driving data and obtain the driving attention judgment result; when the driving attention judgment result meets the preset conditions, it collects user behavior in real time.

[0071] In one possible implementation, the identification module 601 is specifically used for:

[0072] Using eye-tracking technology, the visual position coordinates of the user's visual focus on the in-vehicle terminal are captured, and the visual position coordinates are used as user behavior data;

[0073] Identify the user's gesture features, map the gesture features to the corresponding target gesture data, and use the target gesture data as user behavior data;

[0074] Identify the user's body features, map the body features to the corresponding target body data, and use the target body data as user behavior data;

[0075] Identify the user's lip-reading features, map the lip-reading features to the corresponding target lip-reading data, and use the target lip-reading data as user behavior data.

[0076] In one possible implementation, the acquisition module is specifically used for:

[0077] Driving data for the vehicle terminal is obtained by using at least one of the following: road data, gear data, GPS data, and vehicle speed data acquired by the vehicle-mounted sensor.

[0078] In one possible implementation, the control module 602 is further configured to:

[0079] If the driver attention assessment result does not meet the preset conditions, the preset application interface is hidden on the in-vehicle terminal, and the preset Advanced Driver Assistance System (ADAS) interface is displayed.

[0080] In one possible implementation, the control module 602 is specifically used for:

[0081] Determine the first display mode that matches the user behavior data;

[0082] The preset application interface is displayed according to the first display mode.

[0083] In one possible implementation, the first display mode includes any one of the following display modes:

[0084] The display mode is to show the entry-level function display area in the navigation bar of the ADAS interface;

[0085] The display mode is to display the entry-type function display area in the navigation bar of the ADAS interface, and the operation-type function display area and status-type function display area in the first sub-interface. The first sub-interface occupies part of the main interface of the ADAS interface.

[0086] The display mode is as follows: the entry function display area is displayed in the navigation bar of the ADAS interface, and the operation function display area, status function display area and flow function display area are displayed in the second sub-interface. The second sub-interface occupies part of the main interface of the ADAS interface, and the display area of ​​the second sub-interface is larger than that of the first sub-interface.

[0087] The display mode is to show the entry-level function display area in the navigation bar of the ADAS interface, and the operation-level function display area, status-level function display area, flow-level function display area, and editing-level function display area in the main interface of the ADAS interface, while not displaying the ADAS interface.

[0088] The functions of each module in each device in the embodiments of this application can be found in the corresponding descriptions in the above methods, and will not be repeated here.

[0089] Figure 7 A structural block diagram of an electronic device according to an embodiment of this application is shown. Figure 7 As shown, the electronic device includes a memory 710 and a processor 720. The memory 710 stores instructions that can be executed on the processor 720. When the processor 720 executes the instructions, it implements the display control method of the user interface in the above embodiments. The number of memories 710 and processors 720 can be one or more. This electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or claimed herein.

[0090] The electronic device may also include a communication interface 730 for communicating with external devices and exchanging data. The devices are interconnected using different buses and can be mounted on a common motherboard or otherwise as needed. The processor 720 can process instructions executed within the electronic device, including instructions stored in or on memory to display graphical information of a GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, multiple processors and / or multiple buses can be used with multiple memories and multiple memory modules, if desired. Similarly, multiple electronic devices can be connected, each providing some of the necessary operations (e.g., as a server array, a group of blade servers, or a multiprocessor system). The bus can be divided into address buses, data buses, control buses, etc. For ease of illustration, Figure 7 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0091] Optionally, in a specific implementation, if the memory 710, processor 720, and communication interface 730 are integrated on a single chip, then the memory 710, processor 720, and communication interface 730 can communicate with each other through an internal interface.

[0092] It should be understood that the aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. General-purpose processors can be microprocessors or any conventional processor. It is worth noting that the processor can be a processor supporting Advanced Reduced Instruction Set Machines (ARM) architecture.

[0093] This application provides a computer-readable storage medium (such as the memory 710 described above) that stores computer instructions, which, when executed by a processor, implement the method provided in this application.

[0094] Optionally, the memory 710 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and application programs required for at least one function; the data storage area may store applications required for at least one function. Figure 7The data generated by the use of electronic devices, etc. Furthermore, memory 710 may include high-speed random access memory, and may also include non-transient memory, such as at least one disk storage device, flash memory device, or other non-transient solid-state storage device. In some embodiments, memory 710 may optionally include memory remotely located relative to processor 720, and these remote memories can be connected to a network. Figure 7 Electronic devices. Examples of the aforementioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0095] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of those different embodiments or examples.

[0096] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.

[0097] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more (two or more) executable instructions for implementing a particular logical function or process. Furthermore, the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functionality involved.

[0098] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus or device (such as a computer-based system, a processor-included system or other system that can fetch and execute instructions from, an instruction execution system, apparatus or device).

[0099] It should be understood that various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. All or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware, the program being stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiments.

[0100] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. This storage medium can be a read-only memory, a disk, or an optical disk, etc.

[0101] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various variations or substitutions within the technical scope disclosed in this application, and these should all be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A user interface display control method, applied to an in-vehicle terminal, characterized in that, include: Acquire driving data from the vehicle-mounted terminal; Using the driving data, a driving attention assessment is performed to obtain the driving attention assessment result; User behavior is collected in real time when the driving attention assessment result meets preset conditions; The process involves identifying and analyzing real-time collected user behaviors to obtain user behavior data; wherein, the identification and analysis of real-time collected user behaviors to obtain user behavior data includes at least one of the following: Using eye-tracking technology, the visual position coordinates of the user's visual focus on the in-vehicle terminal are captured, and the visual position coordinates are used as the user behavior data; Identify the user's gesture features, map the gesture features to corresponding target gesture data, and use the target gesture data as the user behavior data; Identify the user's body features, map the body features to corresponding target body data, and use the target body data as the user behavior data; Identify the user's lip-reading features, map the lip-reading features to corresponding target lip-reading data, and use the target lip-reading data as the user's behavior data; Based on the user behavior data, the preset application interface is controlled to display in different display modes; wherein, the different display modes include any one of the following display modes: The display mode is to show the entry-type function display area in the navigation bar of the Advanced Driver Assistance System (ADAS) interface; The display mode is to display an entry-type function display area in the navigation bar of the ADAS interface, and an operation-type function display area and a status-type function display area in the first sub-interface. The first sub-interface occupies part of the main interface of the ADAS interface. The display mode is to display an entry-type function display area in the navigation bar of the ADAS interface, and an operation-type function display area, a status-type function display area, and a streaming-type function display area in the second sub-interface. The second sub-interface occupies part of the main interface of the ADAS interface, and the display area of ​​the second sub-interface is larger than that of the first sub-interface. The display mode is to display the entry-type function display area in the navigation bar of the ADAS interface, and the operation-type function display area, status-type function display area, flow-type function display area, and editing-type function display area in the main interface of the ADAS interface, without displaying the ADAS interface itself.

2. The method according to claim 1, characterized in that, The different display modes include interface display elements that exist according to different priorities.

3. The method according to claim 1, characterized in that, The acquisition of driving data from the vehicle terminal includes: The vehicle terminal obtains driving data by acquiring at least one of the following data from the vehicle-mounted sensor: road data, gear data, GPS data, and vehicle speed data.

4. The method according to claim 1, characterized in that, Also includes: If the driving attention judgment result does not meet the preset conditions, the preset application interface is hidden on the vehicle terminal, and the preset advanced driver assistance system (ADAS) interface is displayed.

5. The method according to any one of claims 1-4, characterized in that, Based on the user behavior data, control the preset application interface to display in different display modes, including: A first display mode matching the user behavior data is determined; the preset application interface is displayed according to the first display mode.

6. A user interface display control device, applied to an in-vehicle terminal, characterized in that, include: The acquisition module is used to acquire driving data from the vehicle terminal. The judgment module is used to use the driving data to judge driving attention and obtain the driving attention judgment result; The recognition module is used to collect user behavior in real time when the driving attention judgment result meets the preset conditions; The process involves identifying and analyzing real-time collected user behaviors to obtain user behavior data; wherein, the identification and analysis of real-time collected user behaviors to obtain user behavior data includes at least one of the following: Using eye-tracking technology, the visual position coordinates of the user's visual focus on the in-vehicle terminal are captured, and the visual position coordinates are used as the user behavior data; Identify the user's gesture features, map the gesture features to corresponding target gesture data, and use the target gesture data as the user behavior data; Identify the user's body features, map the body features to corresponding target body data, and use the target body data as the user behavior data; Identify the user's lip-reading features, map the lip-reading features to corresponding target lip-reading data, and use the target lip-reading data as the user's behavior data; The control module is used to control the preset application interface to be displayed in different display modes based on the user behavior data; wherein, the different display modes include any one of the following display modes: The display mode is to show the entry-type function display area in the navigation bar of the Advanced Driver Assistance System (ADAS) interface; The display mode is to display an entry-type function display area in the navigation bar of the ADAS interface, and an operation-type function display area and a status-type function display area in the first sub-interface. The first sub-interface occupies part of the main interface of the ADAS interface. The display mode is to display an entry-type function display area in the navigation bar of the ADAS interface, and an operation-type function display area, a status-type function display area, and a streaming-type function display area in the second sub-interface. The second sub-interface occupies part of the main interface of the ADAS interface, and the display area of ​​the second sub-interface is larger than that of the first sub-interface. The display mode is to display the entry-type function display area in the navigation bar of the ADAS interface, and the operation-type function display area, status-type function display area, flow-type function display area, and editing-type function display area in the main interface of the ADAS interface, without displaying the ADAS interface itself.

7. The apparatus according to claim 6, characterized in that, The different display modes include interface display elements that exist according to different priorities.

8. The apparatus according to claim 6, characterized in that, The acquisition module is specifically used for: The vehicle terminal obtains driving data by acquiring at least one of the following data from the vehicle-mounted sensor: road data, gear data, GPS data, and vehicle speed data.

9. The apparatus according to claim 6, characterized in that, The control module is also used for: If the driving attention judgment result does not meet the preset conditions, the preset application interface is hidden on the vehicle terminal, and the preset advanced driver assistance system (ADAS) interface is displayed.

10. The apparatus according to any one of claims 6-9, characterized in that, The control module is specifically used for: Determine a first display mode that matches the user behavior data; The preset application interface is displayed according to the first display mode.

11. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.

12. A computer-readable storage medium storing computer instructions that, when executed by a processor, implement the method as described in any one of claims 1-5.