Function interface information acquisition method and device, equipment, medium and program product

Abstract

The invention discloses a function interface information acquisition method and device, equipment, a medium and a program product, and belongs to the technical field of computers. The method comprises the following steps: acquiring M vehicle-mounted system interfaces, wherein M is a positive integer; inputting the M vehicle-mounted system interfaces into a trained interface recognition model to obtain first category information and target position information of each functional module in the vehicle-mounted system interfaces; wherein the target position information of each functional module is determined based on a sample interface in the interface recognition model; and generating function interface information by using the first category information and the target position information of each function module in the vehicle-mounted system interface. According to the function interface information obtaining method, the information obtaining mode is high in efficiency.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device, equipment, medium and program product for obtaining functional interface information. Background Art

[0002] With the development of technology, digital transformation has become a common demand in all walks of life. The functional interface serves as a bridge for interaction between users and systems, and its display directly affects the user experience.

[0003] Currently, designers and interaction designers need to manually obtain and analyze slices of each functional interface one by one. Manual processing of functional interface information is inefficient, especially when benchmarking multiple products and interfaces. Moreover, manual operation to obtain functional interface information is prone to errors. Therefore, the efficiency of the functional interface information acquisition method is low.

[0004] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the embodiments of the present application is to provide a method, device, equipment, medium and program product for obtaining functional interface information, aiming to solve the technical problem of low accuracy of vehicle backup mileage in existing methods.

[0006] In a first aspect, an embodiment of the present application provides a method for obtaining function interface information, the method comprising:

[0007] Get M vehicle system interfaces, where M is a positive integer;

[0008] Inputting the M vehicle-mounted system interfaces into the trained interface recognition model to obtain first category information and target position information of each functional module in the vehicle-mounted system interface; wherein the target position information of each functional module is determined based on the sample interface in the interface recognition model;

[0009] Functional interface information is generated using the first category information and target location information of each functional module in the vehicle-mounted system interface.

[0010] In a second aspect, an embodiment of the present application provides a device for acquiring function interface information, the device comprising:

[0011] Acquisition module, obtains M vehicle system interfaces, where M is a positive integer;

[0012] An input-output module inputs the M vehicle-mounted system interfaces into a trained interface recognition model to obtain first category information and target position information of each functional module in the vehicle-mounted system interface; wherein the target position information of each functional module is determined based on a sample interface in the interface recognition model;

[0013] The generating module generates the functional interface information by using the first category information and the target position information of each functional module in the vehicle-mounted system interface.

[0014] In a third aspect, an embodiment of the present application provides a functional interface information acquisition device, the device comprising: a memory, a processor, and a computer processing program stored in the memory and executable on the processor, the computer processing program being configured to implement the steps of the functional interface information acquisition method as described in the first aspect.

[0015] In a fourth aspect, an embodiment of the present application provides a storage medium having a computer processing program stored thereon, and when the computer processing program is executed by a processor, the steps of the method for obtaining functional interface information as described in the first aspect are implemented.

[0016] In a fifth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the method for acquiring functional interface information as described in the first aspect.

[0017] The present application proposes a method, device, equipment, medium and program product for obtaining functional interface information, by obtaining M vehicle-mounted system interfaces, where M is a positive integer; then, the M vehicle-mounted system interfaces are input into a trained interface recognition model to obtain the first category information and target position information of each functional module in the vehicle-mounted system interface; wherein the target position information of each functional module is determined based on the sample interface in the interface recognition model; finally, the first category information and target position information of each functional module in the vehicle-mounted system interface are used to generate functional interface information. The method of the present application obtains the first category information and target position information of each functional module in the vehicle-mounted system interface by inputting the obtained vehicle-mounted system interface into the interface recognition model, and generates functional interface information based on the first category and target position information, thereby realizing unified identification, extraction and display of information. This method can automatically obtain functional interface information, thereby improving the accuracy and efficiency of obtaining functional interface information. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a flowchart of a method for obtaining functional interface information according to an embodiment of the present application;

[0019] Figure 2 A schematic diagram of a processing device for obtaining functional interface information according to an embodiment of the present application;

[0020] Figure 3 This is one of the schematic diagrams of a processing device for obtaining functional interface information in an embodiment of the present application;

[0021] Figure 4The second schematic diagram of the processing device for obtaining functional interface information in the embodiment of the present application;

[0022] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0024] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0025] The display method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0026] Reference Figure 1 , Figure 1 This is a flow chart of the method for obtaining functional interface information according to an embodiment of the present application.

[0027] The embodiment of the present application provides a method for obtaining function interface information, which is applied to an electronic device. In this embodiment, the method for obtaining function interface information includes the following steps:

[0028] Step 10: Obtain M vehicle system interfaces, where M is a positive integer;

[0029] Step 20: input the M vehicle-mounted system interfaces into the trained interface recognition model to obtain first category information and target position information of each functional module in the vehicle-mounted system interface; wherein the target position information of each functional module is determined based on the sample interface in the interface recognition model;

[0030] Step 30: Generate functional interface information using the first category information and target location information of each functional module in the vehicle-mounted system interface.

[0031] The embodiment of the present application obtains M vehicle-mounted system interfaces, where M is a positive integer; then, the M vehicle-mounted system interfaces are input into a trained interface recognition model to obtain the first category information and target position information of each functional module in the vehicle-mounted system interface; wherein the target position information of each functional module is determined based on the sample interface in the interface recognition model; finally, the first category information and target position information of each functional module in the vehicle-mounted system interface are used to generate functional interface information. The method of the present application obtains the first category information and target position information of each functional module in the vehicle-mounted system interface by inputting the vehicle-mounted system interface obtained in real time into the interface recognition model, and generates functional interface information based on the first category and target position information, thereby realizing unified identification, extraction and display of information. This method can automatically obtain functional interface information, thereby improving the accuracy and efficiency of obtaining functional interface information.

[0032] In some embodiments, in the above step 10, the vehicle system interface may be a display interface of a vehicle screen or a touch screen. The vehicle system interface may include functional modules such as a navigation system, audio control, vehicle status display, and a communication system. M is a positive integer, indicating the number of vehicle system interfaces to be acquired.

[0033] For example, assuming that M is equal to three, three vehicle-mounted system interfaces need to be acquired. The three vehicle-mounted interfaces may include multiple functional modules such as navigation, entertainment, and vehicle monitoring.

[0034] In some embodiments, in the above step 20, the interface recognition model can be a trained machine learning model that can recognize and analyze the category information and location information of each functional module on the vehicle system interface. The functional module can be an independent component or area on the vehicle system interface, such as a navigation function module, a music playback function module, and a phone answering function module. The first category information can be the classification information of the functional module, such as the navigation module is identified as the "navigation" category, or it can be the type, size, color, position, interactive behavior, etc. The first category information is used to determine the display style of the functional module. The target location information can be the specific location information of the functional module on the interface, such as coordinates or area boundaries, and the target location information is used to determine the display position of the functional module. The sample interface can be a set of known interfaces used to train the interface recognition model, and the sample interface contains known functional modules, location information and category information.

[0035] First, a certain number of vehicle system interfaces are collected and input into the trained interface recognition model. Then, the interface recognition model analyzes the input interface and identifies the category information of each functional module (which may be the functional modules in part or all of a certain number of vehicle system interfaces), such as navigation, music, etc. Secondly, the interface recognition model determines the target position information of each functional module in the input interface based on the position of the functional module in the sample interface. Finally, the interface recognition model outputs the category and position information of each functional module for further use or analysis.

[0036] Before using the interface recognition model, the interface recognition model needs to be trained. Data collection: Collect sample images of various functional blocks from the vehicle system interface, including but not limited to air conditioning, navigation, multimedia and other functional blocks. Data annotation: Use professional annotation tools (such as Label Image (LabelImg)) to annotate the collected images and generate annotation files containing the location and labels of the functional blocks. The annotation content should include the bounding box of the functional block and its category information. Model selection: Select a suitable target detection model, such as the YOLO model, Faster Region-based Convolutional Neural Network (Faster R-CNN), etc. These models perform well in target detection tasks and can effectively identify and locate functional blocks. Data preprocessing: Preprocess the labeled data and divide the data set into a training set and a validation set to ensure the diversity and representativeness of the data. Model training: Use a deep learning framework (such as TensorFlow, PyTorch) to train the target detection model. During the training process, hyperparameters (such as learning rate, batch size, etc.) are adjusted to optimize model performance, and validation is performed regularly to monitor model performance.

[0037] For example, assume that there is a trained interface recognition model and now three vehicle system interfaces need to be analyzed.

[0038] A set of vehicle system interface images containing modules such as navigation, music playback, and vehicle settings are collected. An interface recognition model is trained using these images, and the interface recognition model is able to output the category and location information of the functional modules on the vehicle system interface. Three new vehicle system interface images are input into the interface recognition model. The interface recognition model analyzes these images and recognizes the modules such as navigation, music playback, and vehicle settings on the interface. It also recognizes that the navigation module belongs to the "navigation" category, the music playback module belongs to the "music" category, and so on. The interface recognition model determines the exact location of each module on the output interface based on the sample interface used during training, such as the coordinates of the upper left corner of the navigation module. Finally, the interface recognition model outputs the category and location information of each module, for example: "The navigation module is located at (100,200) and the category is navigation."

[0039] In some embodiments, in the above step 30, the functional interface information may be an interface layout and functional description generated based on the category and location information of the functional module, and used to guide interface design or user interaction.

[0040] The interface recognition model outputs the first category information and target location information of each functional module. Based on the first category information, the function and purpose of each functional module are understood. Based on the target location information, the layout and relative position of each functional module on the vehicle system interface are determined, and then detailed functional interface information is generated, including the module size, color, font and other design elements, and the functional interface information is saved in the required format (such as JSON, XML) for easy parsing and use. The generated functional interface information is applied to the actual interface, and user testing is carried out, and iterative optimization is performed based on feedback.

[0041] If the position information of multiple function modules overlaps in the function interface information, and some of the function modules are selected for display, the following methods can be used to solve the problem, but are not limited to the following methods:

[0042] 1. Tabs: Use tabs to organize different functional modules. Users can click different tabs to switch to display different module contents.

[0043] 2. Sidebar or drawer menu: Place some functional modules in the sidebar or drawer menu, and users can access these modules by sliding.

[0044] 3. Priority setting: Set priorities for functional modules. When modules overlap, the priority determines which modules are displayed in front.

[0045] 4. Interactive prompts: When the user is operating, prompt information is used to inform the user which modules are selected or blocked.

[0046] For example, assume that there is already a recognition result of the vehicle system interface, including the category and location information of the three functional modules of navigation, music playback and air conditioning control. The interface recognition model obtains that the navigation module belongs to the "navigation" category and is located in the upper left corner of the interface; the music playback module belongs to the "music" category and is located in the center of the interface; the air conditioning control module belongs to the "air conditioning" category and is located in the lower right corner of the interface. By analyzing the functional modules, it is known that the navigation module is used to display maps and routes, the music playback module is used to control audio playback, and the air conditioning control module is used to adjust the temperature in the car. According to the location information, the navigation module is placed in the upper left corner of the interface, the music playback module is placed in the center, and the air conditioning control module is placed in the lower right corner. Draw a sketch showing the approximate layout of the three modules on the interface. Then generate interface information, which defines the size, button size, icon style and text label of each module in detail.

[0047] In some implementations, the interface recognition model described above performs the following steps:

[0048] Identify first position information and first category information of each functional module in the M vehicle-mounted system interfaces;

[0049] For each functional module, based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model, determine the target position information of the functional module;

[0050] The first category information and target location information of each functional module are output.

[0051] In this implementation, first, an interface recognition model is used to respectively identify the first position information and first category information of each functional module in the M vehicle-mounted system interfaces. For each identified functional module, the model needs to associate two pieces of position information: the first position information (the position directly recognized by the model) and the second position information (the known position of the module in the sample interface). By comparing the first position information and the second position information, the interface recognition model determines the target position information of the functional module. Finally, the interface recognition model outputs the first category information and target position information of each functional module, and the first category information and target position information can be used for subsequent interface design, user interaction optimization or other analysis. Automatic identification and positioning of functional modules by the model can reduce workload and improve efficiency. At the same time, it can adapt to different vehicle-mounted system interface designs, provide flexible solutions for customized needs, and have strong adaptability.

[0052] In this embodiment, it should be noted that the second position information may be the position information of the function module in the sample interface as a reference standard. For function modules, if the category information of two function modules is the same, it means that the two function modules are the same function module.

[0053] Input M new vehicle-mounted system interface images into the trained model. In some embodiments, the interface recognition model recognizes the functional modules in each vehicle-mounted system interface image and obtains the first position information and the first category information. The recognized first position information is associated with the second position information in the sample interface. Based on the first position information and the second position information, the target position information of the functional module is determined by mapping or transforming. The interface recognition model outputs the first category information and the target position information of each functional module.

[0054] In other embodiments, the interface recognition model recognizes the functional modules in each vehicle-mounted system interface image and obtains the first position information and the first category information. The recognized first position information is associated with the second position information in the sample interface. The first position information and the second position information are compared. If the matching degree between the two is greater than a threshold, the first position information is used as the target position information; if it is less than the threshold, the second position information is used as the target position information. The interface recognition model outputs the first category information and the target position information of each functional module.

[0055] When M is greater than 1, and the M vehicle-mounted system interfaces include N first functional modules, the interface recognition model identifies the N first position information of the first functional module. When N is an integer greater than 1, the interface recognition model identifies the functional module in each vehicle-mounted system interface image and outputs the first position information and the first category information. The identified multiple first position information are associated with the second position information in the sample interface. The N first position information are matched with the second position information of the first functional module in the sample interface of the interface recognition model respectively to obtain N matching values ​​corresponding to the N first position information; the first position information corresponding to the maximum matching value among the N matching values ​​is determined as the target position information of the first functional module. The interface recognition model outputs the first category information and the target position information of each functional module.

[0056] For example, it is assumed that there are three vehicle system interfaces that need to be analyzed and an interface recognition model has been trained.

[0057] The model is trained using 100 known vehicle system interface images, in which the positions and category information of the functional modules are known. Three new vehicle system interface images are input into the interface recognition model. The interface recognition model identifies the navigation, music playback and air conditioning control modules in each interface, and outputs their positions in the interface (first position information) and function types (first category information). The interface recognition model compares the identified position information with the position information in the sample interface used during training (second position information). Based on the comparison results, the optimal position (target position information) of each functional module in the new vehicle system interface is determined. For example, the navigation module may be mapped to the top center of the interface. The interface recognition model outputs the category information of each module (such as "navigation", "music", "air conditioning") and their target position information (such as coordinate points or area descriptions).

[0058] In some embodiments, when M is greater than 1 and the M vehicle-mounted system interfaces include N first functional modules, the interface recognition model recognizes and obtains N first position information of the first functional modules, where N is an integer greater than 1;

[0059] The step of determining, for each functional module, target position information of the functional module based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model includes:

[0060] Matching the N first position information with the second position information of the first functional module in the sample interface of the interface recognition model respectively, to obtain N matching values ​​corresponding to the N first position information one by one;

[0061] The first position information corresponding to the maximum matching value among the N matching values ​​is determined as the target position information of the first functional module.

[0062] In this embodiment, when M is greater than 1, and M vehicle-mounted system interfaces include N first function modules, the interface recognition model identifies N first position information of the first function module, and N is an integer greater than 1, first, it is necessary to prepare sample interface data of the interface recognition model, and the sample interface data includes the second position information of the function module, that is, the standard or known position in the sample interface. For the N vehicle-mounted system interfaces, the interface recognition model is used to identify the first position information of the first function module in each interface. The first position information identified in each interface is matched with the second position information in the sample interface, and the matching degree is calculated. For the N first position information, their matching values ​​with the corresponding modules in the sample interface are calculated respectively. Among all the matching values, the largest matching value is selected, which represents the highest matching degree. The first position information corresponding to the maximum matching value is determined as the target position information of the function module. Through the matching process, the target position of the function module on the interface can be accurately determined, and the accuracy of the interface design can be improved. At the same time, users can expect to find the same function in similar positions, reduce learning costs, and improve ease of use.

[0063] In this embodiment, it should be noted that the first functional module can be a specific functional module identified in the vehicle system interface, such as navigation or music player. The second location information can be the standard or known location information of the same functional module in the sample interface. Matching can be the process of comparing the location information identified by the actual interface with the standard location information in the sample interface. The matching value can be a quantitative result generated by the matching process, indicating the similarity or matching degree of the two location information. The maximum matching value can be the highest value among all matching values, representing the most similar or most matching location information.

[0064] The interface recognition model is trained using sample interface data to enable it to recognize the location and category of the functional module. For N different vehicle system interfaces, the interface recognition model identifies the first position information of the first functional module in each interface. The first position information in each interface is matched with the second position information in the sample interface, and the matching value is calculated. The maximum matching value is found from the N matching values, which represents the best matching result. The first position information corresponding to the maximum matching value is determined as the target position information of the functional module.

[0065] Exemplarily, assume that five different vehicle system interfaces (N=5) are being analyzed and there is an already trained interface recognition model.

[0066] The interface recognition model identifies the first position information of each navigation module in the five interfaces. For each navigation module in the vehicle system interface, the model calculates the matching value between its first position information and the second position information of the navigation module in the sample interface. Then, the matching value analysis assumes that five matching values ​​are obtained, which are 0.7, 0.8, 0.6, 0.9, and 0.85. Among these matching values, 0.9 is the largest matching value. Therefore, the first position information corresponding to the matching value of 0.9 is determined as the target position information of the navigation module.

[0067] In some embodiments, when M is greater than 1, the interface recognition model performs the following steps:

[0068] Matching the M vehicle-mounted system interfaces with the sample interface to obtain M matching values ​​corresponding to the M vehicle-mounted system interfaces one by one;

[0069] Determine the vehicle system interface corresponding to the maximum matching value among the M matching values ​​as the target vehicle system interface;

[0070] Identify first position information and first category information of each functional module in the target vehicle system interface;

[0071] Output the first position information and the first category information of each functional module in the target vehicle-mounted system interface, wherein the first position information is the target position information.

[0072] In this embodiment, M vehicle-mounted system interfaces are compared with the sample interface to obtain a matching value. For each vehicle-mounted system interface, the degree of matching with the sample interface is calculated to obtain M matching values. Among the M matching values, the largest matching value is selected, and the vehicle-mounted system interface corresponding to the largest matching value is considered to be the closest to the sample interface, and is therefore determined to be the target vehicle-mounted system interface. In the target vehicle-mounted system interface, the first position information and the first category information of each functional module are identified. The position and category information of all functional modules in the target vehicle-mounted system interface are output, where the position information is considered to be the target position information verified by the matching process. Through the matching process, the target vehicle-mounted system interface can be accurately identified, ensuring the accuracy of the identification result. By determining the target vehicle-mounted system interface, a standardized interface reference model can be established, thereby improving the uniformity of interface design for different vehicles.

[0073] In this embodiment, it should be noted that the target vehicle-mounted system interface may be a vehicle-mounted system interface that is closest to the sample interface and is determined according to the matching value.

[0074] Compare the M vehicle system interfaces with the sample interface and calculate the matching value of each interface. Select the maximum matching value from the M matching values ​​and determine the corresponding vehicle system interface as the target interface. Identify the first position information and the first category information of each functional module in the target vehicle system interface. Output the first position information and the first category information of each functional module in the target vehicle system interface, wherein the first position information is regarded as the target position information.

[0075] Exemplarily, assume that there are 5 vehicle-mounted system interfaces (M=5), and use the sample interface to evaluate their similarity. Match these 5 interfaces with the sample interface to obtain 5 matching values, such as 0.6, 0.7, 0.8, 0.5, and 0.9. Among these matching values, 0.9 is the maximum value, so the corresponding 5th vehicle-mounted system interface is determined as the target interface. In the target interface, the position and category information of functional modules such as navigation, music playback and air conditioning control are identified. For example, the navigation module is located in the upper left corner of the screen, the music playback module is located in the center, and the air conditioning control is located in the lower right corner. Output the position and category information of each functional module in the target interface. For example: Navigation module: category information is "navigation" and location information is "upper left corner of the screen". Music playback module: category information is "music playback" and location information is "center of the screen". Air conditioning control module: category information is "air conditioning control" and location information is "lower right corner of the screen".

[0076] In some embodiments, after the step of generating functional interface information using the first category information and target location information of each functional module in the at least two vehicle-mounted system interfaces, the method includes:

[0077] determining at least one functional module to be displayed;

[0078] Acquire first category information and target location information of the at least one functional module from the functional interface information;

[0079] According to the first category information and the target location information of the at least one functional module, the at least one functional module is displayed on the vehicle display screen.

[0080] In this embodiment, it is first determined which functional modules need to be displayed on the vehicle display screen, which can be based on user needs. The first category information and target location information of the selected functional module are extracted from the functional interface information. According to the obtained first category information and target location information, these functional modules are laid out and displayed on the vehicle display screen. Allowing users to customize the functional modules displayed on the vehicle display screen according to their needs and preferences improves personalized services. By displaying the functional modules that users are most concerned about, user satisfaction is improved. In addition, by optimizing the interface layout, the possibility of driver distraction is reduced, which helps to improve safety.

[0081] In this embodiment, it should be noted that the vehicle-mounted display screen may be a display device inside the vehicle for displaying information and controlling the interface, usually a touch screen.

[0082] According to user needs, the function modules to be displayed on the vehicle display screen are determined, and the first category information and target location information of the selected function module are extracted from the function interface information.

[0083] For example, suppose that you are designing an in-vehicle system and need to display navigation and music playback functions on the display screen. It is decided to display the two functional modules of "navigation" and "music playback" on the in-vehicle display screen. For the "navigation" module, the first category of information is "navigation", and the target location information may be the left side or top of the screen. For the "music playback" module, the first category of information is "music playback", and the target location information may be the right side or bottom of the screen. Based on the information obtained, the navigation interface is rendered on the left side of the in-vehicle display screen to display the map and route information. On the right side of the screen, the music playback interface is rendered to display the currently playing track, playback control buttons, etc.

[0084] In some embodiments, the functional module includes a functional unit; the step of generating functional interface information using the first category information and target location information of each functional module in the at least two vehicle-mounted system interfaces includes:

[0085] Performing a classification operation on each of the functional modules according to the functional units to obtain second category information of each functional unit in each of the functional modules;

[0086] Functional interface information is generated according to the second category information, the first category information and the target location information.

[0087] In this implementation, first, the functional modules in the vehicle system are classified according to the functional units. Functional units may include but are not limited to user interaction, information display, control operation, etc. Through the classification operation, the second category information of each functional unit is obtained, which is a more subdivided functional category, such as "real-time navigation", "media playback", "environmental control", etc. Combine the first category information (more general categories, such as "navigation", "entertainment", "settings") and the second category information of each functional module, as well as their target location information, and integrate them. The above integrated information is used to generate complete functional interface information, which may include the type of module, subtype, specific location on the interface, etc., and save it in the required format (such as JSON, XML). By subdividing the categories of functional modules, users can find and use the functions they need more quickly, improving the user experience. Put the most commonly used functional modules in an easily accessible location to reduce user operation steps and improve interface efficiency.

[0088] In this embodiment, it should be noted that the functional unit may be a basic functional component in the vehicle system for performing a specific task or providing a specific service. The classification operation may be a process of classifying the functional modules according to the functional unit. The second category information may be more detailed functional module category information obtained through the classification operation. The functional interface information may be data that integrates the category information and location information of the functional module and is used to guide the interface layout and display.

[0089] According to the functional units, each functional module in the vehicle system is classified to obtain more specific second category information. Each functional module is subdivided to determine the more specific role or function of the functional module in the system. Combined with the second category information, first category information and target location information of each functional module, functional interface information is generated, and the functional interface information is used to guide how to display each functional module on the vehicle display screen.

[0090] For example, suppose you design an in-vehicle system that includes multiple functional modules, such as navigation, music playback, phone calls, vehicle settings, etc. These modules are classified according to functional units. For example, the navigation module may be divided into two subcategories: "real-time navigation" and "offline map". The second category of information for the navigation module may be "real-time navigation". The music playback module may be subdivided into "FM radio", "Bluetooth music", etc. For the "real-time navigation" module, the second category of information "real-time navigation", the first category of information "navigation", and the target location information, such as "center of the screen", are integrated. Based on the above integrated information, functional interface information is generated to guide how to layout these modules on the in-vehicle display screen. For example, it may be decided to place the "real-time navigation" module in the center of the screen for the driver to view.

[0091] Reference Figure 2 The method for obtaining function interface information in an embodiment of the present application provides a device for obtaining function interface information, the device comprising:

[0092] An acquisition module 201 acquires M vehicle-mounted system interfaces, where M is a positive integer;

[0093] The input-output module 202 inputs the M vehicle-mounted system interfaces into the trained interface recognition model to obtain first category information and target position information of each functional module in the vehicle-mounted system interface; wherein the target position information of each functional module is determined based on the sample interface in the interface recognition model;

[0094] The generating module 203 generates the functional interface information by using the first category information and the target position information of each functional module in the vehicle-mounted system interface.

[0095] Furthermore, the input-output module 202 is further used to: identify the first position information and the first category information of each functional module in the M vehicle-mounted system interfaces;

[0096] For each functional module, based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model, determine the target position information of the functional module;

[0097] The first category information and target location information of each functional module are output.

[0098] Furthermore, the input-output module 202 is further used to: match the N first position information with the second position information of the first functional module in the sample interface of the interface recognition model respectively, to obtain N matching values ​​corresponding to the N first position information one by one;

[0099] The first position information corresponding to the maximum matching value among the N matching values ​​is determined as the target position information of the first functional module.

[0100] Furthermore, the input-output module 202 is further used to: match the M vehicle-mounted system interfaces with the sample interface to obtain M matching values ​​corresponding to the M vehicle-mounted system interfaces one by one;

[0101] Determine the vehicle system interface corresponding to the maximum matching value among the M matching values ​​as the target vehicle system interface;

[0102] Identify first position information and first category information of each functional module in the target vehicle system interface;

[0103] Output the first position information and the first category information of each functional module in the target vehicle-mounted system interface, wherein the first position information is the target position information.

[0104] Furthermore, the generating module 203 is further used to: determine at least one functional module to be displayed;

[0105] Acquire first category information and target location information of the at least one functional module from the functional interface information;

[0106] According to the first category information and the target location information of the at least one functional module, the at least one functional module is displayed on the vehicle display screen.

[0107] Furthermore, the generating module 203 is further used to: perform a classification operation on each of the functional modules according to the functional units to obtain second category information of each functional unit in each of the functional modules;

[0108] Functional interface information is generated according to the second category information, the first category information and the target location information.

[0109] The functional interface information acquisition device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application is not specifically limited.

[0110] The functional interface information acquisition device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0111] The functional interface information acquisition device provided in the embodiment of the present application can achieve Figure 1 The various processes implemented by the method embodiment can achieve the same technical effect, and to avoid repetition, they will not be described here.

[0112] Alternatively, if Figure 3 As shown, an embodiment of the present application further provides an electronic device 300, including a processor 301 and a memory 302, wherein the memory 302 stores programs or instructions that can be executed on the processor 301, and when the program or instructions are executed by the processor 301, the various steps of the above-mentioned display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0113] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0114] Figure 4 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0115] The electronic device 400 includes but is not limited to: a radio frequency unit 401, a network module 402, an audio output unit 403, an input unit 404, a sensor 405, a display unit 406, a user input unit 407, an interface unit 404, a memory 409, and a processor 410.

[0116] Those skilled in the art will appreciate that the electronic device 400 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 410 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 4 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0117] The processor 410 is used for:

[0118] Get M vehicle system interfaces, where M is a positive integer;

[0119] Inputting the M vehicle-mounted system interfaces into the trained interface recognition model to obtain first category information and target position information of each functional module in the vehicle-mounted system interface; wherein the target position information of each functional module is determined based on the sample interface in the interface recognition model;

[0120] Functional interface information is generated using the first category information and target location information of each functional module in the vehicle-mounted system interface.

[0121] In some implementations, the processor 410 is further configured to:

[0122] Identify first position information and first category information of each functional module in the M vehicle-mounted system interfaces;

[0123] For each functional module, based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model, determine the target position information of the functional module;

[0124] The first category information and target location information of each functional module are output.

[0125] In some implementations, the processor 410 is further configured to:

[0126] The step of determining, for each functional module, target position information of the functional module based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model includes:

[0127] Matching the N first position information with the second position information of the first functional module in the sample interface of the interface recognition model respectively, to obtain N matching values ​​corresponding to the N first position information one by one;

[0128] The first position information corresponding to the maximum matching value among the N matching values ​​is determined as the target position information of the first functional module.

[0129] In some implementations, the processor 410 is further configured to:

[0130] Matching the M vehicle-mounted system interfaces with the sample interface to obtain M matching values ​​corresponding to the M vehicle-mounted system interfaces one by one;

[0131] Determine the vehicle system interface corresponding to the maximum matching value among the M matching values ​​as the target vehicle system interface;

[0132] Identify first position information and first category information of each functional module in the target vehicle system interface;

[0133] Output the first position information and the first category information of each functional module in the target vehicle-mounted system interface, wherein the first position information is the target position information.

[0134] In some implementations, the processor 410 is further configured to:

[0135] determining at least one functional module to be displayed;

[0136] Acquire first category information and target location information of the at least one functional module from the functional interface information;

[0137] According to the first category information and the target location information of the at least one functional module, the at least one functional module is displayed on the vehicle display screen.

[0138] In some implementations, the processor 410 is further configured to:

[0139] Performing a classification operation on each of the functional modules according to the functional units to obtain second category information of each functional unit in each of the functional modules;

[0140] Functional interface information is generated according to the second category information, the first category information and the target location information.

[0141] It should be understood that in the embodiment of the present application, the input unit 404 may include a graphics processor (Graphics Processing Unit, GPU) 4041 and a microphone 4042, and the graphics processor 4041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 406 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 407 includes a touch panel 4071 and at least one of other input devices 4072. The touch panel 4071 is also called a touch screen. The touch panel 4071 may include two parts: a touch detection device and a touch controller. Other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0142] The memory 409 can be used to store software programs and various data. The memory 409 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 409 may include a volatile memory or a non-volatile memory, or the memory 409 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 409 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0143] The processor 410 may include one or more processing units; optionally, the processor 410 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 410.

[0144] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned functional interface information acquisition method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0145] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0146] In addition, an embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned functional interface information acquisition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0147] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises one..." does not exclude the presence of other identical elements in the process, method, article or system including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0148] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0149] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0150] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for obtaining function interface information, characterized in that: The method comprises the following steps: Get M vehicle system interfaces, where M is a positive integer; Inputting the M vehicle-mounted system interfaces into the trained interface recognition model to obtain first category information and target position information of each functional module in the vehicle-mounted system interface; wherein the target position information of each functional module is determined based on the sample interface in the interface recognition model; Functional interface information is generated using the first category information and target location information of each functional module in the vehicle-mounted system interface.

2. The method according to claim 1, characterized in that The interface recognition model performs the following steps: Identify first position information and first category information of each functional module in the M vehicle-mounted system interfaces; For each functional module, based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model, determine the target position information of the functional module; The first category information and target location information of each functional module are output.

3. The method according to claim 2, characterized in that When M is greater than 1 and the M vehicle-mounted system interfaces include N first functional modules, the interface recognition model recognizes and obtains N first position information of the first functional modules, where N is an integer greater than 1; The step of determining, for each functional module, target position information of the functional module based on the first position information of the functional module and the second position information of the functional module in the sample interface of the interface recognition model includes: Matching the N first position information with the second position information of the first functional module in the sample interface of the interface recognition model respectively, to obtain N matching values ​​corresponding to the N first position information one by one; The first position information corresponding to the maximum matching value among the N matching values ​​is determined as the target position information of the first functional module.

4. The method according to claim 1, characterized in that When M is greater than 1, the interface recognition model performs the following steps: Matching the M vehicle-mounted system interfaces with the sample interface to obtain M matching values ​​corresponding to the M vehicle-mounted system interfaces one by one; Determine the vehicle system interface corresponding to the maximum matching value among the M matching values ​​as the target vehicle system interface; Identify first position information and first category information of each functional module in the target vehicle system interface; Output the first position information and the first category information of each functional module in the target vehicle-mounted system interface, wherein the first position information is the target position information.

5. The method according to claim 1, characterized in that After the step of generating functional interface information by using the first category information and target location information of each functional module in the at least two vehicle-mounted system interfaces, the method includes: determining at least one functional module to be displayed; Acquire first category information and target location information of the at least one functional module from the functional interface information; According to the first category information and the target location information of the at least one functional module, the at least one functional module is displayed on the vehicle display screen.

6. The method according to claim 1, characterized in that The functional module includes a functional unit; the step of using the first category information and target location information of each functional module in the at least two vehicle-mounted system interfaces to generate functional interface information includes: Performing a classification operation on the functional module to obtain second category information of each functional unit in the functional module; Functional interface information is generated according to the second category information, the first category information and the target location information.

7. A functional interface information acquisition device, characterized in that: The device comprises: Acquisition module, obtains M vehicle system interfaces, where M is a positive integer; An input-output module inputs the M vehicle-mounted system interfaces into a trained interface recognition model to obtain first category information and target position information of each functional module in the vehicle-mounted system interface; wherein the target position information of each functional module is determined based on a sample interface in the interface recognition model; The generating module generates the functional interface information by using the first category information and the target position information of each functional module in the vehicle-mounted system interface.

8. A functional interface information acquisition device, characterized in that: The device comprises: a memory, a processor, and a computer processing program stored in the memory and executable on the processor, wherein the computer processing program is configured to implement the steps of the method for acquiring functional interface information as described in any one of claims 1 to 6.

9. A storage medium, characterized in that: The storage medium stores a computer processing program, and when the computer processing program is executed by the processor, the steps of the method for obtaining functional interface information according to any one of claims 1 to 6 are implemented.

10. A computer program product, characterized in that When the instructions in the computer program product are executed by a processor of an electronic device, the electronic device executes the steps of the method for acquiring functional interface information as described in any one of claims 1 to 6.

Images