Function interface information acquisition method and device, equipment, medium and program product

Abstract

The application discloses a function interface information acquisition method, device, equipment, medium and program product, and belongs to the technical field of computers. The method comprises the following steps: acquiring M vehicle-mounted system interfaces, wherein M is a positive integer; inputting the M vehicle-mounted system interfaces into a trained interface recognition model to obtain first category information and target position information of each function module in the vehicle-mounted system interface; wherein the target position information of each function module is determined based on a sample interface in the interface recognition model; and generating function interface information by using the first category information and the target position information of each function module in the vehicle-mounted system interface. The function interface information acquisition method of the application is efficient in the way of information acquisition.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a method, apparatus, device, medium, and program product for acquiring functional interface information. Background Technology

[0002] With the development of technology, digital transformation has become a common need in all walks of life. As a bridge between users and systems, the display of the functional interface directly affects the user experience.

[0003] Currently, designers and interaction designers need to manually acquire and analyze slices of each functional interface one by one. Manually processing functional interface information is inefficient, especially when benchmarking multiple products and interfaces. Furthermore, manually acquiring functional interface information is prone to errors. Therefore, the method for acquiring functional interface information is inefficient.

[0004] The above content is only used to help understand the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main objective of this application is to provide a method, apparatus, device, medium, and program product for obtaining functional interface information, aiming to solve the technical problem of low accuracy of vehicle backup mileage in existing methods.

[0006] In a first aspect, embodiments of this application provide a method for obtaining functional interface information, the method comprising:

[0007] Get M in-vehicle system interfaces, where M is a positive integer;

[0008] The M vehicle system interfaces are input into the trained interface recognition model to obtain the first category information and target location information of each functional module in the vehicle system interface; wherein, the target location information of each functional module is determined based on the sample interface in the interface recognition model.

[0009] Functional interface information is generated using the first category information and target location information of each functional module in the vehicle system interface.

[0010] Secondly, embodiments of this application provide a functional interface information acquisition device, the device comprising:

[0011] The module retrieves M in-vehicle system interfaces, where M is a positive integer.

[0012] The input / output module inputs the M vehicle system interfaces into the trained interface recognition model to obtain the first category information and target location information of each functional module in the vehicle system interface; wherein, the target location information of each functional module is determined based on the sample interface in the interface recognition model.

[0013] The generation module uses the first category information and target location information of each functional module in the vehicle system interface to generate functional interface information.

[0014] Thirdly, embodiments of this application provide a functional interface information acquisition device, the device comprising: a memory, a processor, and a computer processing program stored in the memory and executable on the processor, the computer processing program being configured to implement the steps of the functional interface information acquisition method as described in the first aspect.

[0015] Fourthly, embodiments of this application provide a storage medium storing a computer processing program, which, when executed by a processor, implements the steps of the functional interface information acquisition method described in the first aspect.

[0016] Fifthly, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the steps of the functional interface information acquisition method as described in the first aspect.

[0017] This application proposes a method, apparatus, device, medium, and program product for acquiring functional interface information. The method involves acquiring M vehicle system interfaces (M being a positive integer); then, inputting these M interfaces into a trained interface recognition model to obtain the first category information and target location information of each functional module within the vehicle system interface; wherein the target location information of each functional module is determined based on sample interfaces in the interface recognition model; finally, functional interface information is generated using the first category information and target location information of each functional module in the vehicle system interface. This method, by inputting the acquired vehicle system interfaces into an interface recognition model to obtain the first category information and target location information of each functional module, and generating functional interface information based on the first category and target location information, achieves unified recognition, extraction, and display of information. This method can automatically acquire functional interface information, improving the accuracy and efficiency of functional interface information acquisition. Attached Figure Description

[0018] Figure 1 This is a flowchart illustrating the method for obtaining functional interface information according to an embodiment of this application;

[0019] Figure 2 This is a schematic diagram of a processing device for acquiring functional interface information in an embodiment of this application;

[0020] Figure 3 This is one of the schematic diagrams of a processing device for obtaining functional interface information in an embodiment of this application;

[0021] Figure 4This is a second schematic diagram of a processing device for acquiring functional interface information in an embodiment of this application;

[0022] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0023] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0024] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0025] The display method provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0026] Reference Figure 1 , Figure 1 This is a flowchart illustrating the method for obtaining functional interface information in an embodiment of this application.

[0027] This application provides a method for obtaining functional interface information, which is applied to an electronic device. In this embodiment, the method for obtaining functional interface information includes the following steps:

[0028] Step 10: Obtain M in-vehicle system interfaces, where M is a positive integer;

[0029] Step 20: Input the M vehicle system interfaces into the trained interface recognition model to obtain the first category information and target location information of each functional module in the vehicle system interface; wherein, the target location information of each functional module is determined based on the sample interface in the interface recognition model;

[0030] Step 30: Generate functional interface information using the first category information and target location information of each functional module in the vehicle system interface.

[0031] This application's embodiment acquires M in-vehicle system interfaces, where M is a positive integer; then, it inputs these M in-vehicle system interfaces into a trained interface recognition model to obtain the first category information and target location information of each functional module in the in-vehicle system interface; wherein, the target location information of each functional module is determined based on sample interfaces in the interface recognition model; finally, it generates functional interface information using the first category information and target location information of each functional module in the in-vehicle system interface. This method, by inputting the real-time acquired in-vehicle system interface into the interface recognition model to obtain the first category information and target location information of each functional module in the in-vehicle system interface, and generating functional interface information based on the first category and target location information, achieves unified recognition, extraction, and display of information. This method can automatically acquire functional interface information, improving the accuracy and efficiency of functional interface information acquisition.

[0032] In some embodiments, in step 10 above, the in-vehicle system interface can be the vehicle's screen or a touchscreen display. The in-vehicle system interface may include functional modules such as a navigation system, audio control, vehicle status display, and communication system. M is a positive integer representing the number of in-vehicle system interfaces to be acquired.

[0033] For example, assuming M equals three, then three in-vehicle system interfaces need to be obtained. The three in-vehicle interfaces may include multiple functional modules such as navigation, entertainment, and vehicle monitoring.

[0034] In some embodiments, in step 20 above, the interface recognition model can be a pre-trained machine learning model capable of recognizing and analyzing the category and location information of each functional module on the vehicle system interface. A functional module can be an independent component or area on the vehicle system interface, such as a navigation module, a music playback module, or a phone answering module. The first category information can be the classification information of the functional module, such as identifying the navigation module as the "navigation" category, or it can be type, size, color, location, interactive behavior, etc. The first category information is used to determine the display style of the functional module. The target location information can be the specific location information of the functional module on the interface, such as coordinates or area demarcation. The target location information is used to determine the display position of the functional module. The sample interface can be a set of known interfaces used to train the interface recognition model, and the sample interface contains known functional modules, location information, and category information.

[0035] First, a number of in-vehicle system interfaces are collected and input into a trained interface recognition model. Then, the interface recognition model analyzes the input interfaces and identifies the category information of each functional module (which may be some or all of the functional modules within the selected in-vehicle system interfaces), such as navigation and music. Next, based on the location of functional modules in the sample interfaces, the interface recognition model determines the target location information of each functional module in the input interface. Finally, the interface recognition model outputs the category and location information of each functional module for further use or analysis.

[0036] Before using the interface recognition model, it needs to be trained. Data Collection: Collect sample images of various functional areas from the vehicle's system interface, including but not limited to air conditioning, navigation, and multimedia functional areas. Data Labeling: Use professional labeling tools (such as Label Image, LabelImg) to label the collected images, generating a labeled file containing the location and labels of the functional areas. The labeling should include the bounding boxes of the functional areas and their category information. Model Selection: Select a suitable object detection model, such as the YOLO model or the Faster Region-based Convolutional Neural Network (Faster R-CNN), which perform well in object detection tasks and can effectively identify and locate functional areas. Data Preprocessing: Preprocess the labeled data, dividing the dataset into training and validation sets to ensure data diversity and representativeness. Model Training: Train the object detection model using deep learning frameworks (such as TensorFlow, PyTorch). During training, adjust hyperparameters (such as learning rate, batch size, etc.) to optimize model performance, and perform validation periodically to monitor model performance.

[0037] For example, suppose we have a trained interface recognition model and now we need to analyze three in-vehicle system interfaces.

[0038] A set of in-vehicle system interface images, including modules such as navigation, music playback, and vehicle settings, were collected. An interface recognition model was trained using these images, capable of outputting the category and location information of functional modules on the in-vehicle system interface. Three new in-vehicle system interface images were then input into the interface recognition model. The model analyzed these images, identifying modules such as navigation, music playback, and vehicle settings. It further identified the navigation module as belonging to the "Navigation" category, the music playback module as belonging to the "Music" category, and so on. Based on the sample interfaces used during training, the model determined the exact location of each module on the output interface, such as the coordinates of the top-left corner of the navigation module. Finally, the model output the category and location information of each module, for example: "The navigation module is located at (100, 200), category: Navigation."

[0039] In some embodiments, in step 30 above, the functional interface information may be an interface layout and functional description generated based on the category and location information of the functional modules, which is used to guide interface design or user interaction.

[0040] The interface recognition model outputs primary category information and target location information for each functional module. Based on the primary category information, the function and purpose of each module are understood. Based on the target location information, the layout and relative position of each functional module on the in-vehicle system interface are determined, thereby generating detailed functional interface information, including design elements such as module size, color, and font. This functional interface information is saved in the required format (such as JSON or XML) for easy parsing and use. The generated functional interface information is applied to the actual interface and user testing is conducted, with iterative optimization based on feedback.

[0041] If the position information of multiple functional modules overlaps in the functional interface information, and some of the functional modules are selected for display, the following methods can be used to resolve the issue, but are not limited to these:

[0042] 1. Tabs: Use tabs to organize different functional modules. Users can click on different tabs to switch between displaying different module content.

[0043] 2. Sidebar or drawer menu: Place some functional modules in the sidebar or drawer menu, which users can access by swiping.

[0044] III. Priority Settings: Set priorities for functional modules. When modules overlap, priority determines which modules are displayed first.

[0045] IV. Interactive prompts: When the user operates, prompts will inform the user which modules are selected or obscured.

[0046] For example, assume we already have the recognition results of the in-vehicle system interface, including the category and location information of three functional modules: navigation, music playback, and air conditioning control. The interface recognition model determines that the navigation module belongs to the "Navigation" category and is located in the upper left corner of the interface; the music playback module belongs to the "Music" category and is located in the center of the interface; and the air conditioning control module belongs to the "Air Conditioning" category and is located in the lower right corner of the interface. Analysis of the functional modules reveals that the navigation module is used to display maps and routes, the music playback module is used to control audio playback, and the air conditioning control module is used to adjust the vehicle's interior temperature. Based on the location information, the navigation module is placed in the upper left corner of the interface, the music playback module in the center, and the air conditioning control module in the lower right corner. A sketch is drawn to show the approximate layout of these three modules on the interface. Then, interface information is generated, defining in detail the size, button size, icon style, and text label of each module.

[0047] In some implementations, the interface recognition model described above performs the following steps:

[0048] Identify the first location information and first category information of each functional module in the M vehicle system interfaces;

[0049] For each functional module, the target position information of the functional module is determined based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model.

[0050] Output the first category information and target location information of each functional module.

[0051] In this embodiment, firstly, an interface recognition model is used to identify the first location information and first category information of each functional module in M ​​in-vehicle system interfaces. For each identified functional module, the model needs to associate two location information: first location information (the location directly identified by the model) and second location information (the known location of the module in the sample interface). By comparing the first and second location information, the interface recognition model determines the target location information of the functional module. Finally, the interface recognition model outputs the first category information and target location information for each functional module. The first category information and target location information can be used for subsequent interface design, user interaction optimization, or other analyses. By automatically identifying and locating functional modules through the model, workload can be reduced and efficiency improved. At the same time, it adapts to different in-vehicle system interface designs, providing flexible solutions for customized needs and exhibiting strong adaptability.

[0052] In this embodiment, it should be noted that the second location information can be the location information of the functional module in the sample interface, serving as a reference standard. For functional modules, if two functional modules have the same category information, it indicates that the two functional modules are the same functional module.

[0053] M new in-vehicle system interface images are input into the trained model. In some implementations, the interface recognition model identifies functional modules in each in-vehicle system interface image and obtains first location information and first category information. The identified first location information is associated with second location information in the sample interface. Based on the first and second location information, the target location information of the functional modules is determined through mapping or transformation. The interface recognition model outputs the first category information and target location information for each functional module.

[0054] In other implementations, the interface recognition model identifies functional modules in each vehicle system interface image and obtains first location information and first category information. The identified first location information is then associated with second location information in the sample interface. The first and second location information are compared; if the matching degree is greater than a threshold, the first location information is used as the target location information; otherwise, the second location information is used as the target location information. The interface recognition model outputs the first category information and target location information for each functional module.

[0055] When M is greater than 1, and the M in-vehicle system interfaces include N first functional modules, the interface recognition model identifies N first position information of the first functional modules. When N is an integer greater than 1, the interface recognition model identifies the functional module in each in-vehicle system interface image and outputs the first position information and first category information. The identified multiple first position information are associated with the second position information in the sample interface. The N first position information are then matched with the second position information of the first functional module in the sample interface of the interface recognition model, obtaining N matching values ​​corresponding one-to-one with the N first position information. The first position information corresponding to the largest matching value among the N matching values ​​is determined as the target position information of the first functional module. The interface recognition model outputs the first category information and target position information for each functional module.

[0056] For example, suppose there are three in-vehicle system interfaces that need to be analyzed, and an interface recognition model has already been trained.

[0057] The model is trained using 100 known in-vehicle system interface images, where the locations and categories of functional modules are known. Three new in-vehicle system interface images are then input into the interface recognition model. The model identifies the navigation, music playback, and air conditioning control modules in each interface and outputs their positions (first position information) and function types (first category information) within the interface. The model compares the identified position information with the position information from the sample interfaces used during training (second position information). Based on the comparison, the optimal position (target position information) for each functional module in the new in-vehicle system interface is determined; for example, the navigation module might be mapped to the top center of the interface. The model outputs the category information (e.g., "navigation," "music," "air conditioning") and their target position information (e.g., coordinates or region description) for each module.

[0058] In some implementations, when M is greater than 1 and the M vehicle system interfaces include N first functional modules, the interface recognition model identifies N first location information of the first functional modules, where N is an integer greater than 1.

[0059] For each functional module, determining the target position information of the functional module based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model includes:

[0060] The N first location information are matched with the second location information of the first functional module in the sample interface of the interface recognition model to obtain N matching values ​​that correspond one-to-one with the N first location information.

[0061] The first location information corresponding to the largest matching value among the N matching values ​​is determined as the target location information of the first functional module.

[0062] In this embodiment, when M is greater than 1, and the M in-vehicle system interfaces include N first functional modules, and the interface recognition model identifies N first position information of the first functional modules (where N is an integer greater than 1), firstly, sample interface data for the interface recognition model needs to be prepared. This sample interface data includes the second position information of the functional modules, i.e., their standard or known positions within the sample interface. For the N in-vehicle system interfaces, the interface recognition model identifies the first position information of the first functional modules in each interface. The first position information identified in each interface is matched with the second position information in the sample interface, and the matching degree is calculated. For each of the N first position information, the matching value between each and the corresponding module in the sample interface is calculated. Among all matching values, the largest matching value is selected, representing the highest matching degree. The first position information corresponding to the largest matching value is determined as the target position information of the functional module. Through this matching process, the target position of the functional module on the interface can be accurately determined, improving the accuracy of the interface design. Simultaneously, users can expect to find the same function in similar locations, reducing learning costs and improving ease of use.

[0063] In this embodiment, it should be noted that the first functional module can be a specific functional module identified in the vehicle system interface, such as navigation or a music player. The second location information can be standard or known location information of the same functional module in the sample interface. Matching can be a process of comparing the location information identified in the actual interface with the standard location information in the sample interface. The matching value can be a quantitative result generated by the matching process, representing the similarity or matching degree of the two location information. The maximum matching value can be the highest value among all matching values, representing the most similar or most matched location information.

[0064] An interface recognition model is trained using sample interface data to identify the location and category of functional modules. For N different vehicle system interfaces, the interface recognition model identifies the first location information of the first functional module in each interface. The first location information in each interface is matched with the second location information in the sample interface, and a matching value is calculated. The maximum matching value is found from the N matching values, which represents the best matching result. The first location information corresponding to the maximum matching value is determined as the target location information of that functional module.

[0065] For example, suppose we are analyzing 5 different in-vehicle system interfaces (N=5) and have a pre-trained interface recognition model.

[0066] The interface recognition model identifies the first location information of each navigation module in five interfaces. For each navigation module in the vehicle system interface, the model calculates the matching value between its first location information and the second location information of the navigation module in the sample interface. Then, the matching value is analyzed, assuming five matching values ​​are obtained: 0.7, 0.8, 0.6, 0.9, and 0.85. Among these matching values, 0.9 is the largest. Therefore, the first location information corresponding to the matching value of 0.9 is determined as the target location information of the navigation module.

[0067] In some implementations, when M is greater than 1, the interface recognition model performs the following steps:

[0068] The M vehicle system interfaces are matched with the sample interface to obtain M matching values ​​that correspond one-to-one with the M vehicle system interfaces.

[0069] The vehicle system interface corresponding to the largest matching value among the M matching values ​​is determined as the target vehicle system interface;

[0070] Identify the first location information and first category information of each functional module in the target vehicle system interface;

[0071] Output the first location information and first category information of each functional module in the target vehicle system interface, wherein the first location information is the target location information.

[0072] In this embodiment, M in-vehicle system interfaces are compared with sample interfaces to obtain matching values. For each in-vehicle system interface, the matching degree with the sample interface is calculated, resulting in M ​​matching values. Among the M matching values, the largest matching value is selected. The in-vehicle system interface corresponding to the largest matching value is considered to be the closest to the sample interface and is therefore determined as the target in-vehicle system interface. In the target in-vehicle system interface, the first location information and first category information of each functional module are identified. The location and category information of all functional modules in the target in-vehicle system interface are output, where the location information is considered to be the target location information verified by the matching process. Through the matching process, the target in-vehicle system interface can be accurately identified, ensuring the accuracy of the identification results. By determining the target in-vehicle system interface, a standardized interface reference model can be established, improving the uniformity of interface design across different vehicles.

[0073] In this embodiment, it should be noted that the target vehicle system interface can be the vehicle system interface that is closest to the sample interface, determined based on the matching value.

[0074] Compare M in-vehicle system interfaces with the sample interfaces and calculate the matching value for each interface. Select the maximum matching value from the M matching values ​​and determine the corresponding in-vehicle system interface as the target interface. Identify the first location information and first category information of each functional module in the target in-vehicle system interface. Output the first location information and first category information of each functional module in the target in-vehicle system interface, where the first location information is regarded as the target location information.

[0075] For example, suppose there are 5 in-vehicle system interfaces (M=5), and sample interfaces are used to evaluate their similarity. These 5 interfaces are matched against the sample interfaces, resulting in 5 matching values, such as 0.6, 0.7, 0.8, 0.5, and 0.9. Among these matching values, 0.9 is the maximum, therefore the corresponding 5th in-vehicle system interface is identified as the target interface. Within the target interface, the location and category information of functional modules such as navigation, music playback, and air conditioning control are identified. For example, the navigation module is located in the upper left corner of the screen, the music playback module is located in the center, and the air conditioning control is located in the lower right corner. The location and category information of each functional module in the target interface are output. For example: Navigation module: Category information is "Navigation", Location information is "Upper left corner of the screen". Music playback module: Category information is "Music playback", Location information is "Center of the screen". Air conditioning control module: Category information is "Air conditioning control", Location information is "Lower right corner of the screen".

[0076] In some embodiments, after the step of generating functional interface information using the first category information and target location information of each functional module in the at least two vehicle system interfaces, the method includes:

[0077] Identify at least one functional module to be displayed;

[0078] Obtain the first category information and target location information of the at least one functional module from the functional interface information;

[0079] The at least one functional module is displayed on the vehicle display screen according to the first category information and target location information of the at least one functional module.

[0080] In this embodiment, the first step is to determine which functional modules need to be displayed on the in-vehicle display screen, which can be based on user needs. First-category information and target location information of the selected functional modules are extracted from the functional interface information. Based on the obtained first-category information and target location information, these functional modules are laid out and displayed on the in-vehicle display screen. Allowing users to customize the functional modules displayed on the in-vehicle display screen according to their needs and preferences improves personalized service. By displaying the functional modules that users care about most, user satisfaction is improved. Furthermore, by optimizing the interface layout, the possibility of driver distraction is reduced, contributing to improved safety.

[0081] In this embodiment, it should be noted that the in-vehicle display screen can be a display device inside the vehicle used to display information and control the interface, and is usually a touch screen.

[0082] Based on user needs, determine the functional modules that need to be displayed on the in-vehicle display screen. Extract the primary category information and target location information of the selected functional modules from the functional interface information.

[0083] For example, suppose we are designing an in-vehicle system that needs to display navigation and music playback functions on the screen. We decide to display two functional modules on the in-vehicle display: "Navigation" and "Music Playback." For the "Navigation" module, the first category of information is "Navigation," and the target location information might be on the left or top of the screen. For the "Music Playback" module, the first category of information is "Music Playback," and the target location information might be on the right or bottom of the screen. Based on the obtained information, we render the navigation interface on the left side of the in-vehicle display, displaying the map and route information. On the right side of the screen, we render the music playback interface, displaying the currently playing track, playback control buttons, etc.

[0084] In some embodiments, the aforementioned functional module includes functional units; the step of generating functional interface information using the first category information and target location information of each functional module in the at least two vehicle system interfaces includes:

[0085] Based on the functional unit, a classification operation is performed on each of the functional modules to obtain the second category information of each functional unit in each of the functional modules;

[0086] Based on the second category information, the first category information, and the target location information, generate functional interface information.

[0087] In this embodiment, firstly, the functional modules in the vehicle system are categorized according to their functional units. These functional units may include, but are not limited to, user interaction, information display, and control operations. Through this categorization, a second category of information for each functional unit is obtained; this is a more detailed functional category, such as "real-time navigation," "media playback," and "environmental control." The first category information (a more general category, such as "navigation," "entertainment," or "settings") and the second category information for each functional module, along with their target location information, are then integrated. Using this integrated information, complete functional interface information is generated, which may include the module type, subtype, and specific location on the interface, and is saved in the required format (such as JSON or XML). By categorizing the functional modules, users can more quickly find and use the functions they need, improving the user experience. Placing the most frequently used functional modules in easily accessible locations reduces user operation steps and improves interface efficiency.

[0088] In this embodiment, it should be noted that a functional unit can be a basic functional component in an in-vehicle system used to perform a specific task or provide a specific service. The classification operation can be a process of categorizing functional modules according to their functional units. The second category information can be more refined functional module category information obtained through the classification operation. The functional interface information can be data that integrates the category information and location information of the functional modules, used to guide the interface layout and display.

[0089] Based on functional units, the various functional modules in the vehicle system are categorized to obtain more specific secondary category information. Each functional module is further subdivided to determine its more specific role or function within the system. Combining the secondary category information, primary category information, and target location information for each functional module, functional interface information is generated. This functional interface information guides how to display each functional module on the vehicle's display screen.

[0090] For example, suppose we design an in-vehicle system that includes multiple functional modules, such as navigation, music playback, telephone, and vehicle settings. These modules are categorized according to their functional units. For instance, the navigation module might be divided into two subcategories: "real-time navigation" and "offline maps." The second category of information for the navigation module might be "real-time navigation." The music playback module might be further subdivided into "FM radio," "Bluetooth music," etc. For the "real-time navigation" module, we integrate the second category of information, "real-time navigation," the first category of information, "navigation," and the target location information, such as "center of the screen." Based on the integrated information, we generate functional interface information to guide the layout of these modules on the in-vehicle display screen. For example, we might decide to place the "real-time navigation" module in the center of the screen for easy viewing by the driver.

[0091] Reference Figure 2 This application provides a method for obtaining functional interface information, which includes a device for obtaining functional interface information.

[0092] Module 201 retrieves M in-vehicle system interfaces, where M is a positive integer;

[0093] The input / output module 202 inputs the M vehicle system interfaces into the trained interface recognition model to obtain the first category information and target location information of each functional module in the vehicle system interface; wherein, the target location information of each functional module is determined based on the sample interface in the interface recognition model.

[0094] The generation module 203 generates functional interface information using the first category information and target location information of each functional module in the vehicle system interface.

[0095] Furthermore, the input / output module 202 is also used to: identify the first position information and the first category information of each functional module in the M vehicle system interfaces;

[0096] For each functional module, the target position information of the functional module is determined based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model.

[0097] Output the first category information and target location information of each functional module.

[0098] Furthermore, the input / output module 202 is also used to: match the N first position information with the second position information of the first functional module in the sample interface of the interface recognition model, respectively, to obtain N matching values ​​that correspond one-to-one with the N first position information;

[0099] The first location information corresponding to the largest matching value among the N matching values ​​is determined as the target location information of the first functional module.

[0100] Furthermore, the input / output module 202 is also used to: match the M vehicle system interfaces with the sample interface to obtain M matching values ​​that correspond one-to-one with the M vehicle system interfaces;

[0101] The vehicle system interface corresponding to the largest matching value among the M matching values ​​is determined as the target vehicle system interface;

[0102] Identify the first location information and first category information of each functional module in the target vehicle system interface;

[0103] Output the first location information and first category information of each functional module in the target vehicle system interface, wherein the first location information is the target location information.

[0104] Furthermore, the generation module 203 is also used to: determine at least one functional module to be displayed;

[0105] Obtain the first category information and target location information of the at least one functional module from the functional interface information;

[0106] The at least one functional module is displayed on the vehicle display screen according to the first category information and target location information of the at least one functional module.

[0107] Furthermore, the generation module 203 is also configured to: perform a classification operation on each of the functional modules according to the functional units to obtain the second category information of each functional unit in each of the functional modules;

[0108] Based on the second category information, the first category information, and the target location information, generate functional interface information.

[0109] The functional interface information acquisition device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the specific device.

[0110] The functional interface information acquisition device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.

[0111] The functional interface information acquisition device provided in this application embodiment can achieve... Figure 1 The various processes implemented in the method embodiments can achieve the same technical effect, and will not be described again here to avoid repetition.

[0112] Optionally, such as Figure 3 As shown, this application embodiment also provides an electronic device 300, including a processor 301 and a memory 302. The memory 302 stores a program or instructions that can run on the processor 301. When the program or instructions are executed by the processor 301, they implement the various steps of the above-described display method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0113] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.

[0114] Figure 4 A schematic diagram of the hardware structure of the electronic device used to implement the embodiments of this application.

[0115] The electronic device 400 includes, but is not limited to, components such as: radio frequency unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 404, memory 409, and processor 410.

[0116] Those skilled in the art will understand that the electronic device 400 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 410 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 4 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0117] The processor 410 is used for:

[0118] Get M in-vehicle system interfaces, where M is a positive integer;

[0119] The M vehicle system interfaces are input into the trained interface recognition model to obtain the first category information and target location information of each functional module in the vehicle system interface; wherein, the target location information of each functional module is determined based on the sample interface in the interface recognition model.

[0120] Functional interface information is generated using the first category information and target location information of each functional module in the vehicle system interface.

[0121] In some implementations, the processor 410 is further configured to:

[0122] Identify the first location information and first category information of each functional module in the M vehicle system interfaces;

[0123] For each functional module, the target position information of the functional module is determined based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model.

[0124] Output the first category information and target location information of each functional module.

[0125] In some implementations, the processor 410 is further configured to:

[0126] For each functional module, determining the target position information of the functional module based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model includes:

[0127] The N first location information are matched with the second location information of the first functional module in the sample interface of the interface recognition model to obtain N matching values ​​that correspond one-to-one with the N first location information.

[0128] The first location information corresponding to the largest matching value among the N matching values ​​is determined as the target location information of the first functional module.

[0129] In some implementations, the processor 410 is further configured to:

[0130] The M vehicle system interfaces are matched with the sample interface to obtain M matching values ​​that correspond one-to-one with the M vehicle system interfaces.

[0131] The vehicle system interface corresponding to the largest matching value among the M matching values ​​is determined as the target vehicle system interface;

[0132] Identify the first location information and first category information of each functional module in the target vehicle system interface;

[0133] Output the first location information and first category information of each functional module in the target vehicle system interface, wherein the first location information is the target location information.

[0134] In some implementations, the processor 410 is further configured to:

[0135] Identify at least one functional module to be displayed;

[0136] Obtain the first category information and target location information of the at least one functional module from the functional interface information;

[0137] The at least one functional module is displayed on the vehicle display screen according to the first category information and target location information of the at least one functional module.

[0138] In some implementations, the processor 410 is further configured to:

[0139] Based on the functional unit, a classification operation is performed on each of the functional modules to obtain the second category information of each functional unit in each of the functional modules;

[0140] Based on the second category information, the first category information, and the target location information, generate functional interface information.

[0141] It should be understood that, in this embodiment, the input unit 404 may include a graphics processing unit (GPU) 4041 and a microphone 4042. The GPU 4041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 406 may include a display panel 4061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 407 includes at least one of a touch panel 4071 and other input devices 4072. The touch panel 4071 is also called a touch screen. The touch panel 4071 may include a touch detection device and a touch controller. Other input devices 4072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0142] The memory 409 can be used to store software programs and various data. The memory 409 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 409 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 409 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0143] Processor 410 may include one or more processing units; optionally, processor 410 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 410.

[0144] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described method for obtaining functional interface information and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0145] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0146] Furthermore, this application provides a computer program product that is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described functional interface information acquisition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0147] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0148] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0149] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0150] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A method for obtaining functional interface information, characterized in that, The method includes the following steps: Get M in-vehicle system interfaces, where M is a positive integer; The M vehicle system interfaces are input into the trained interface recognition model to obtain the first category information and target location information of each functional module in the vehicle system interface; wherein, the target location information of each functional module is determined based on the sample interface in the interface recognition model. The interface recognition model performs the following steps: Identify the first location information and first category information of each functional module in the M vehicle system interfaces; For each functional module, the target position information of the functional module is determined based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model. Output the first category information and target location information of each functional module; Where M is greater than 1, and the M vehicle system interfaces include N first functional modules, the interface recognition model recognizes N first location information of the first functional modules, where N is an integer greater than 1. For each functional module, determining the target position information of the functional module based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model includes: The N first location information are matched with the second location information of the first functional module in the sample interface of the interface recognition model to obtain N matching values ​​that correspond one-to-one with the N first location information. The first location information corresponding to the largest matching value among the N matching values ​​is determined as the target location information of the first functional module; Functional interface information is generated using the first category information and target location information of each functional module in the vehicle system interface.

2. The method as described in claim 1, characterized in that, When M is greater than 1, the interface recognition model performs the following steps: The M vehicle system interfaces are matched with the sample interface to obtain M matching values ​​that correspond one-to-one with the M vehicle system interfaces. The vehicle system interface corresponding to the largest matching value among the M matching values ​​is determined as the target vehicle system interface; Identify the first location information and first category information of each functional module in the target vehicle system interface; Output the first location information and first category information of each functional module in the target vehicle system interface, wherein the first location information is the target location information.

3. The method as described in claim 1, characterized in that, After the step of generating functional interface information using the first category information and target location information of each functional module in the vehicle system interface, the method includes: Identify at least one functional module to be displayed; Obtain the first category information and target location information of the at least one functional module from the functional interface information; The at least one functional module is displayed on the vehicle display screen according to the first category information and target location information of the at least one functional module.

4. The method as described in claim 1, characterized in that, The functional module includes functional units; the step of generating functional interface information using the first category information and target location information of each functional module in the vehicle system interface includes: Based on the functional unit, a classification operation is performed on each of the functional modules to obtain the second category information of each functional unit in each of the functional modules; Based on the second category information, the first category information, and the target location information, generate functional interface information.

5. A device for acquiring functional interface information, characterized in that, The device includes: The module retrieves M in-vehicle system interfaces, where M is a positive integer. The input / output module inputs the M vehicle system interfaces into the trained interface recognition model to obtain the first category information and target location information of each functional module in the vehicle system interface; wherein, the target location information of each functional module is determined based on the sample interface in the interface recognition model. The input / output module is further configured to: identify the first position information and first category information of each functional module in the M vehicle system interfaces; for each functional module, determine the target position information of the functional module based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model; and output the first category information and target position information of each functional module. Where M is greater than 1, and the M vehicle system interfaces include N first functional modules, the interface recognition model identifies N first position information of the first functional module, where N is an integer greater than 1; the input / output module is further configured to: match the N first position information with the second position information of the first functional module in the sample interface of the interface recognition model, respectively, to obtain N matching values ​​corresponding one-to-one with the N first position information; and determine the first position information corresponding to the largest matching value among the N matching values ​​as the target position information of the first functional module; The generation module uses the first category information and target location information of each functional module in the vehicle system interface to generate functional interface information.

6. A device for acquiring functional interface information, characterized in that, The device includes: a memory, a processor, and a computer processing program stored in the memory and executable on the processor, the computer processing program being configured to implement the steps of the functional interface information acquisition method as described in any one of claims 1 to 4.

7. A storage medium, characterized in that, The storage medium stores a computer processing program, which, when executed by a processor, implements the steps of the functional interface information acquisition method as described in any one of claims 1 to 4.

8. A computer program product, characterized in that, When the instructions in the computer program product are executed by the processor of the electronic device, the electronic device performs the steps of the functional interface information acquisition method as described in any one of claims 1 to 4.

Images