Interaction method and device based on intelligent cabin and intelligent cabin

Abstract

The invention relates to the technical field of intelligent driving, in particular to an interaction method and device based on an intelligent cabin and the intelligent cabin. The method comprises the steps of determining browsing interest points corresponding to a target area according to the target area input by a user; in the intelligent cabin or in a user terminal connected with the intelligent cabin, calling at least one target application corresponding to the browsing interest point; searching interest point application information corresponding to the browsing interest point in each target application; and the interest point application information corresponding to each target application is fed back to the user through the intelligent cabin.

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to an interaction method and device based on an intelligent cockpit, and an intelligent cockpit. Background Art

[0002] The smart cockpit in a vehicle refers to a mobile space equipped with advanced software and hardware systems, and has the human-machine-environment integration capabilities of human-machine interaction, networked services, and scenario expansion, providing drivers and passengers with a comprehensive experience of safety, intelligence, efficiency, and pleasure.

[0003] In traditional technology, the smart cockpit is connected to the external network through Internet technology, which can obtain road conditions and weather information in real time and plan travel routes for drivers.

[0004] However, when a user pays attention to a certain browsing point of interest during a travel route, the smart cockpit in traditional technology cannot perform intelligent analysis on the browsing point of interest. Summary of the invention

[0005] Based on this, it is necessary to provide an interactive method, device and smart cockpit based on a smart cockpit that can perform intelligent analysis of browsing points of interest in a travel route in response to the above technical problems.

[0006] In a first aspect, the present application provides an interaction method based on a smart cockpit, which is applied to a smart cockpit, and the method includes:

[0007] Determine the browsing points of interest corresponding to the target area according to the target area input by the user;

[0008] In the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing point of interest;

[0009] In each target application, search and browse the POI application information corresponding to the POI;

[0010] The point of interest application information corresponding to each target application is fed back to the user through the smart cockpit.

[0011] In one embodiment, in the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing point of interest includes:

[0012] In the browsing interface provided by the smart cockpit, input the point of interest identifier of the browsing point of interest to obtain the application identifier of the target application corresponding to the browsing point of interest;

[0013] In the local application set of the smart cockpit, the target application is called according to the application identifier of the target application, or in the user terminal connected to the smart cockpit, the target application is called according to the application identifier of the target application.

[0014] In one embodiment, the method further comprises:

[0015] If the target application does not exist in the local application set of the smart cockpit, obtain the download address of the target application;

[0016] Install the target application in the smart cockpit according to the download address;

[0017] After the target application is installed, the user information stored by the user in the smart cockpit is registered in the target application to obtain the target application containing the user information.

[0018] In one embodiment, searching and browsing the POI application information corresponding to the POI in each target application includes:

[0019] If the target application is a target application installed in the user terminal, a sharing mechanism with the user terminal is established so that the user can control the target application in the user terminal to perform corresponding actions through the operation instructions input in the smart cockpit;

[0020] Under the sharing mechanism, by inputting a search instruction for the point of interest identifier of the browsing point of interest in the target application in the cockpit interface, the point of interest application information corresponding to the browsing point of interest returned by the target application is obtained.

[0021] In one embodiment, under the sharing mechanism, by inputting a search instruction for a point of interest identifier of a browsing point of interest in a target application in a cockpit interface, obtaining the point of interest application information corresponding to the browsing point of interest returned by the target application, including:

[0022] Under the sharing mechanism, by inputting a search instruction for a point of interest identifier for browsing points of interest in the target application in the cockpit interface, the browsing information of the points of interest corresponding to the browsing points of interest returned by the target application is obtained;

[0023] Screen capture of the browsing information of the points of interest is performed to obtain images of the points of interest;

[0024] The interest point description information of each dimension in the interest point image is extracted to obtain the interest point application information corresponding to the browsing interest point.

[0025] In one embodiment, if the number of target applications is at least two, then under the sharing mechanism, by inputting a search instruction for browsing the point of interest identifier in the target application in the cockpit interface, the search instruction includes:

[0026] According to the number of target applications, the cockpit interface is split into multiple split-screen interfaces;

[0027] Under the sharing mechanism, different target applications are displayed in different split-screen interfaces;

[0028] For each split screen interface, a search instruction for a point of interest identifier for browsing points of interest is input in the target application through the split screen interface.

[0029] In a second aspect, the present application also provides an interactive device based on a smart cockpit, comprising:

[0030] The interest point generation module is used to determine the browsing interest points corresponding to the target area according to the target area input by the user;

[0031] An application calling module, used to call at least one target application corresponding to the browsing interest point in the smart cockpit or in a user terminal connected to the smart cockpit;

[0032] A point of interest search module is used to search and browse the point of interest application information corresponding to the point of interest in each target application;

[0033] The point of interest feedback module is used to feed back the point of interest application information corresponding to each target application to the user through the smart cockpit.

[0034] In a third aspect, the present application further provides a smart cockpit, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0035] Determine the browsing points of interest corresponding to the target area according to the target area input by the user;

[0036] In the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing point of interest;

[0037] In each target application, search and browse the POI application information corresponding to the POI;

[0038] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the following steps are implemented:

[0039] Determine the browsing points of interest corresponding to the target area according to the target area input by the user;

[0040] In the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing point of interest;

[0041] In each target application, search and browse the POI application information corresponding to the POI;

[0042] The point of interest application information corresponding to each target application is fed back to the user through the smart cockpit.

[0043] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0044] Determine the browsing points of interest corresponding to the target area according to the target area input by the user;

[0045] In the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing point of interest;

[0046] In each target application, search and browse the POI application information corresponding to the POI;

[0047] The point of interest application information corresponding to each target application is fed back to the user through the smart cockpit.

[0048] The above-mentioned interactive method, device and smart cockpit based on the smart cockpit, this application automatically calls relevant applications and searches for information about points of interest, and the smart cockpit can realize intelligent analysis of user's focus points and provide more accurate and personalized services. By integrating information from multiple applications, the smart cockpit can provide users with all-round and multi-angle information about browsing points of interest to meet users' in-depth exploration needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0050] Figure 1 is a flow chart of an interactive method based on a smart cockpit in one embodiment;

[0051] Figure 2 A schematic diagram of a flow chart of a step of calling at least one target application corresponding to a browsing point of interest in one embodiment;

[0052] Figure 3 A schematic diagram of a flow chart of the steps of searching and browsing the point of interest application information corresponding to the point of interest in one embodiment;

[0053] Figure 4 A flowchart of the steps of obtaining the point of interest application information corresponding to the browsing point of interest returned by the target application in one embodiment;

[0054] Figure 5 A schematic flow chart of the steps of inputting a search instruction for a point of interest identifier for browsing points of interest in a target application in one embodiment;

[0055] Figure 6 is a structural block diagram of an interactive device based on a smart cockpit in one embodiment;

[0056] Figure 7 Schematic diagram of the internal structure of a smart cockpit in one embodiment. DETAILED DESCRIPTION

[0057] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0058] In an exemplary embodiment, Figure 1 As shown, an interaction method based on a smart cockpit is provided, and the method is applied to a smart cockpit as an example for explanation, including:

[0059] S101, determining browsing interest points corresponding to a target area according to a target area input by a user.

[0060] The target area refers to the geographical location, spatial range or specific area that the user is interested in. For example, in the navigation of the smart cockpit, the user may enter a city name, a scenic spot name or a specific address as the target area, indicating that he wants to obtain relevant information about the area or navigate to the area.

[0061] Among them, browsing points of interest refer to specific places or locations that users may be interested in in maps, navigation or similar applications, such as restaurants, hotels, attractions, shopping malls, etc. For example, if the target area entered by the user is a city, then famous attractions, popular restaurants, shopping malls, etc. in the city may become browsing points of interest.

[0062] S102, in the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing interest point.

[0063] Among them, the smart cockpit is equipped with an on-board information system, and communicates and exchanges data with the user terminal (such as user terminal, tablet, etc.) through wireless connection (such as Bluetooth, Wi-Fi, etc.), so that the smart cockpit can access the applications and resources on the user terminal, and also allow the user terminal to control certain functions of the smart cockpit.

[0064] Optionally, the user enters or selects a specific target area through the interface of the smart cockpit, and based on this area, browsing points of interest that the user may be interested in are determined. Once the browsing points of interest are determined, applications related to these points of interest will be searched in the local application set of the smart cockpit or the user terminal. These applications may be navigation applications, restaurant reservation applications, attraction introduction applications, etc., depending on the nature of the point of interest. Based on factors such as the type of point of interest, user preferences and historical behavior, the most relevant application that is most likely to meet the user's needs will be selected for retrieval.

[0065] The retrieved target application will then be displayed on the display screen of the smart cockpit, or on the user terminal through the interconnection function between the user terminal and the smart cockpit. Users can interact with these applications through the smart cockpit interface or voice commands to obtain more information about points of interest or perform related operations (such as booking, navigation, etc.).

[0066] S103, searching and browsing the point of interest application information corresponding to the point of interest in each target application.

[0067] Optionally, after determining the target applications, search within these applications to find application information directly related to browsing the points of interest. The application information of the points of interest includes but is not limited to: detailed introduction of the points of interest, pictures, videos, user reviews, opening hours, prices, location information, contact information, and bookable services or products.

[0068] S104, feeding back the point of interest application information corresponding to each target application to the user through the smart cockpit.

[0069] Optionally, the searched POI application information may be integrated and displayed to the user in a unified form, or the POI application information may be further analyzed to provide targeted feedback based on user preferences or user question information.

[0070] Based on the above interactive method of the smart cockpit, this application automatically retrieves relevant applications and searches for information about points of interest. The smart cockpit can realize intelligent analysis of user's focus points and provide more accurate and personalized services. By integrating information from multiple applications, the smart cockpit can provide users with all-round and multi-angle information about browsing points of interest to meet users' in-depth exploration needs.

[0071] In an exemplary embodiment, Figure 2 As shown, in the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing interest point includes:

[0072] S201, in the browsing interface provided by the smart cockpit, input the point of interest identifier of the browsing point of interest, and obtain the application identifier of the target application corresponding to the browsing point of interest.

[0073] Optionally, the user starts the smart cockpit, and the smart cockpit enters the main interface. In the main interface or specific menu of the smart cockpit, an interface specifically for browsing points of interest is displayed, or the browsing interface can also be a third-party browser interface. The smart cockpit provides users with a variety of input methods for users to choose, such as touch screen input, voice input (combined with dialect recognition technology), gesture input, etc. The user enters the identifier of the point of interest that he wants to know or visit in the browsing interface through the selected input method. The point of interest identifier can be a name, keyword, code, etc., depending on the design of the smart cockpit and the user's input habits.

[0074] The smart cockpit receives the POI identifier input by the user, and uses built-in recognition algorithms (such as natural language processing, pattern recognition, etc.) to identify and parse the input content, obtain the POI identifier, and query the POI identifier in the internal target application library.

[0075] It is understandable that the target application library is a database containing various applications related to the POI, and each application has a unique application identifier. The smart cockpit searches the target application library for an application that matches the input POI identifier and obtains the application identifier of the application.

[0076] S202, invoking a target application in a local application set of the smart cockpit according to an application identifier of the target application, or invoking a target application in a user terminal connected to the smart cockpit according to an application identifier of the target application.

[0077] Optionally, determine whether the target application has been pre-installed in the local application set of the smart cockpit. If the conditions are met, the target application will be selected in the local environment. Specifically, according to the application identifier of the target application, a match is made in the local application set. After a successful match, the target application is directly started and displayed to the user.

[0078] If it is determined that the current environment is not in the local environment of the smart cockpit, or the target application is not pre-installed in the local application set of the smart cockpit, but a connection has been established with a user terminal (such as a smart user terminal, tablet computer, etc.), and the target application has been installed on the user terminal, the target application will be selected to be retrieved in the user terminal. Specifically, in the user terminal environment, the application identifier of the target application is sent to the user terminal through the communication interface with the user terminal. After receiving the application identifier, the user terminal matches it in its local application store or installed applications. After the match is successful, the user terminal starts the target application and can display it to the user on the display screen of the smart cockpit through screen projection, mirroring, etc.

[0079] Furthermore, the method also includes: if the target application does not exist in the local application set of the smart cockpit, obtaining the download address of the target application; installing the target application in the smart cockpit according to the download address; after the target application is installed, registering the user information stored by the user in the smart cockpit in the target application to obtain the target application containing the user information.

[0080] It is understandable that when it is determined that the target application does not exist in the local application set, the smart cockpit will try to obtain the download address of the target application from the preset application store, the application provider's server or other reliable download sources. It may first check whether there is a pre-stored download address. If there is no pre-stored download address, it may try to access the application store API or the application provider's server to dynamically obtain the latest download address of the target application.

[0081] Specifically, after obtaining the download address of the target application, the smart cockpit will start downloading and installing the application. After the target application is installed, the user information (such as user name, password, preferences, etc.) stored in the smart cockpit will be registered in the target application. After registration is completed, the target application will contain the user's personalized information, so as to provide users with more customized services and experiences.

[0082] In an exemplary embodiment, Figure 3 As shown, in each target application, search and browse the POI application information corresponding to the POI, including:

[0083] S301: If the target application is a target application installed in the user terminal, a sharing mechanism with the user terminal is established so that the user can control the target application in the user terminal to perform corresponding actions through operation instructions input in the smart cockpit.

[0084] It is understandable that when the target application is installed in the user terminal, the smart cockpit needs to establish a sharing mechanism with the user terminal. The sharing mechanism in this embodiment refers to a bridge for data and information interaction established between the smart cockpit and the user terminal. This mechanism allows the smart cockpit to obtain and display the content on the user terminal screen in real time, and allows the user to operate and control the application on the user terminal through the interface of the smart cockpit. The specific process of establishing a sharing mechanism is to connect the user terminal and the smart cockpit wirelessly or wired to ensure that the screen projection function is turned on normally.

[0085] S302, under the sharing mechanism, by inputting a search instruction for the point of interest identifier of the browsing point of interest in the target application in the cockpit interface, the point of interest application information corresponding to the browsing point of interest returned by the target application is obtained.

[0086] Specifically, the smart cockpit identifies and connects to the user's user terminal, and projects the user terminal screen content onto the vehicle display screen in real time. The user navigates to the user terminal application (i.e., target application) that he wants to operate, such as a map navigation application, a music player application, etc., by means of touch, voice, or physical buttons on the vehicle display screen. In the target application, the user enters a search instruction for the point of interest identifier (such as a place name, keyword, etc.) for browsing points of interest through the input interface of the vehicle display screen (which may be a virtual keyboard, voice input, etc.). The smart cockpit transmits these input instructions to the user terminal in real time, and the user terminal application processes these instructions.

[0087] Then, after receiving the search command, the user terminal application performs a search or query operation internally according to the command content. The application finds the POI application information (such as location details, pictures, reviews, etc.) that matches the search command and prepares this information for return. The user terminal application sends the retrieved POI application information back to the smart cockpit through a preset communication protocol. After receiving this information, the smart cockpit displays it on the vehicle display for the user to browse and further operate.

[0088] For example, suppose that the user is using a map navigation application as the target application and wants to find and browse information about a specific place (such as a restaurant). The user connects the user terminal to the smart cockpit via Wi-Fi and turns on the screen projection function. The in-vehicle display starts to display the user terminal screen content in real time. The user navigates to the map navigation application through touch operations on the in-vehicle display. The user enters the name of the restaurant (such as "XX restaurant") on the virtual keyboard on the in-vehicle display. The smart cockpit transmits this input instruction to the user terminal. After receiving the instruction, the map navigation application searches internally. The application finds location information matching "XX restaurant", including address, business hours, reviews, etc. The map navigation application sends this information back to the smart cockpit through the communication protocol. The detailed information of "XX restaurant" is displayed on the in-vehicle display, and the user can further browse or navigate to the place through touch operations.

[0089] In an exemplary embodiment, Figure 4 As shown, under the sharing mechanism, by inputting a search instruction for the point of interest identifier of the browsing point of interest in the target application in the cockpit interface, the point of interest application information corresponding to the browsing point of interest returned by the target application is obtained, including:

[0090] S401, under the sharing mechanism, by inputting a search instruction for a point of interest identifier for browsing points of interest in a target application in a cockpit interface, obtaining browsing information of points of interest corresponding to the browsing points of interest returned by the target application.

[0091] It is understandable that, when the sharing mechanism has been established (i.e., the user terminal and the smart cockpit have been successfully connected, and the user terminal screen content is being projected onto the cockpit interface in real time), the user enters a POI identifier retrieval instruction for a certain browsing POI in the target application through the input method on the cockpit interface. Subsequently, the target application processes the retrieval instruction and returns the POI browsing information corresponding to the browsing POI.

[0092] S402, taking screenshots of the browsing information of the points of interest to obtain images of the points of interest.

[0093] Specifically, when browsing the POI browsing information in the cockpit interface, a screenshot operation can be triggered according to the sliding action of the browsing page (or the page switching instruction issued by the user), and the currently displayed interface is captured through the screenshot operation to obtain an image of the POI browsing information currently displayed on the smart cockpit interface. After the screenshot is completed, the captured image is saved as an image file, which is the POI image.

[0094] S403, extracting the interest point description information of each dimension in the interest point image to obtain the interest point application information corresponding to the browsing interest point.

[0095] Among them, the description information of the point of interest may include multiple dimensions such as name, address, contact number, business hours, user reviews, picture links, etc.

[0096] Specifically, the description information of the interest points in each dimension in the interest point image is extracted to construct an answer library.

[0097] The specific process of building the answer library is as follows: Based on the user's possible interests and concerns, predict the questions that the user may ask about browsing the POI. These questions may involve the basic information, characteristics, surrounding facilities, transportation methods, etc. of the POI. Match the corresponding answers to the predicted questions from the extracted POI description information. Ensure the accuracy and relevance of the answers to meet the needs of users. Continuously optimize the content of the answer library based on the actual feedback and query conditions of users. Add new question and answer pairs to cover a wider range of user needs.

[0098] In this embodiment, a more convenient, intelligent and personalized service experience is provided to users through the fine extraction of interest point description information and the construction of an answer library.

[0099] In an exemplary embodiment, Figure 5 As shown, if the number of target applications is at least two, then under the sharing mechanism, by inputting a search instruction for the point of interest identifier for browsing the point of interest in the target application in the cockpit interface, the command includes:

[0100] S501, split-screen processing is performed on the cockpit interface according to the number of target applications to obtain multiple split-screen interfaces.

[0101] Optionally, the number of target applications that need to be displayed simultaneously is first detected. Based on the number, the cockpit interface is split into multiple split-screen interfaces to display different target applications simultaneously.

[0102] S502, under the sharing mechanism, different target applications are displayed in different split-screen interfaces respectively.

[0103] Optionally, maintain a mapping relationship between an application and a split-screen interface to ensure that each application is displayed in the correct split-screen interface. Users can switch between different split screens or adjust the split-screen layout through the navigation bar, shortcut keys, or gestures on the cockpit interface.

[0104] S503, for each split screen interface, inputting a search instruction for the point of interest identifier for browsing the point of interest in the target application through the split screen interface.

[0105] Specifically, for each split-screen interface, the user can enter a search instruction for a specific browsing point of interest in the target application within the interface. Based on the user's input, the search operation is performed separately in each split-screen interface, and the search results are displayed. Optionally, the user can enter a search instruction in the target application within the split-screen interface through touch, voice input, or physical buttons. It is necessary to ensure that each split-screen interface can independently process the user's input and that the search results can be accurately displayed in the corresponding split-screen interface.

[0106] For example, suppose that the user is planning a travel route in the smart cockpit and wants to view information on multiple aspects such as catering, accommodation and attractions at the same time. The user chooses to open three target applications: map navigation, catering recommendations and hotel reservations through the cockpit interface. The cockpit interface is automatically divided into three screens to display these three applications separately. In the split-screen interface of the map navigation application, the user enters the destination name as a search instruction to view the route and surrounding attractions. In the split-screen interface of the catering recommendation application, the user enters the restaurant type or taste preference as a search instruction to find nearby restaurants. In the split-screen interface of the hotel reservation application, the user enters the check-in date and location as a search instruction to find a suitable hotel. Users can view and compare this information simultaneously in different split-screen interfaces in order to plan the best travel plan.

[0107] In an exemplary embodiment, the smart cockpit provided in this embodiment further provides the following functional modules:

[0108] The dialect recognition module is used to design a speech recognition model for dialects using deep learning technology to improve the accuracy of dialect recognition. The purpose is to enhance the friendliness of human-computer interaction, enable the smart cockpit to understand and respond to user commands from different regions, improve the natural fluency of voice interaction, enhance user identification and satisfaction, and reflect regional cultural diversity.

[0109] Specifically, the construction process of the dialect recognition module is as follows: collect a large amount of dialect speech data, which should cover diverse user groups from different regions, ages, genders, etc. to ensure the generalization ability of the model; preprocess the collected dialect speech data, including noise removal, speech segmentation, feature extraction and other steps. The feature extraction link extracts speech features that can reflect the characteristics of the dialect, such as tone, speaking speed, pronunciation habits, etc. Based on deep learning technology, a speech recognition model for dialects is designed. The model structure may include convolutional neural networks, recurrent neural networks or long short-term memory networks, etc., to capture the temporal dependencies and spatial features in speech signals. The model is trained using the preprocessed dialect speech data. During the training process, the model parameters need to be continuously optimized to improve the accuracy of dialect recognition. The trained dialect recognition module is integrated into the smart cockpit system, which involves interface design and data interaction with other modules in the system.

[0110] The geolocation module is used to integrate the GPS positioning system, obtain vehicle location information in real time, and automatically match the regional cultural environment based on the user's geographical location. The purpose is to push health monitoring images, desktop theme wallpapers and navigation languages ​​that are consistent with regional characteristics, provide personalized experiences with regional cultural characteristics, and enhance the cultural experience and sense of belonging in the driving process.

[0111] Specifically, the construction process of the geolocation module is as follows: integrate the GPS positioning hardware into the vehicle to ensure its compatibility with the communication interface of the smart cockpit system, configure the relevant software parameters of the GPS positioning system, such as positioning accuracy, update frequency, etc., to meet the needs of the smart cockpit system, receive the vehicle's location information in real time through the GPS positioning system, including longitude, latitude, speed, etc., pre-process the received location information, such as denoising, filtering, etc., to improve the accuracy and reliability of the data, establish a database containing different regional cultural characteristics, including health monitoring images, desktop theme wallpapers, navigation languages, etc., design a matching algorithm based on the real-time vehicle location information and dialect recognition results, and automatically select content that matches the regional characteristics from the database. Based on the results of the matching algorithm, generate health monitoring images, desktop theme wallpapers and navigation languages ​​that match the regional characteristics, and design a push mechanism to push the generated content to the display interface and voice interaction module of the smart cockpit system in real time.

[0112] The health monitoring module is used to combine the health monitoring system with regional cultural elements to design a health monitoring image with a specific regional clothing style. Through the cultural design of the health monitoring image, users' sense of identity with regional culture is enhanced.

[0113] Specifically, the construction process of the health monitoring module is as follows: integrate health monitoring equipment (such as heart rate monitors, blood pressure monitors, etc.) into the smart cockpit, collect cultural elements from different regions, especially information related to clothing styles, organize the collected cultural elements, and screen out elements suitable for health monitoring image design. Combine regional cultural elements to conceive a health monitoring image with a specific regional clothing style. Use graphic design software or 3D modeling tools to design the conceived health monitoring image. During the design process, pay attention to the vividness, recognizability and accuracy of cultural characteristics of the image. Integrate the designed health monitoring image into the display interface of the smart cockpit, and design dynamic display effects, such as the actions and expressions of the health monitoring image in different states, to enhance the user's interactive experience.

[0114] The personalized interface design module is used to dynamically adjust the interface elements of the smart cockpit according to the user's dialect and driving area information. The purpose is to enable the smart cockpit system to better adapt to the needs and preferences of different users.

[0115] Specifically, the construction process of the personalized interface design model is as follows: through user registration and usage records of the smart cockpit system, the user's dialect information, driving area information, etc. are collected, the user data is processed and analyzed, and the key information for personalized interface design is extracted; according to the user's dialect and regional cultural characteristics, a health monitoring image with a specific clothing style is designed; in combination with the cultural elements and scenic features of the user's driving area, a personalized desktop theme wallpaper is designed; according to the user's dialect, personalized navigation language options are provided, and a navigation style that conforms to regional characteristics is designed; the conditions that trigger personalized interface adjustment are determined, such as user login, vehicle start-up, area change, etc.; the logic of dynamic adjustment of interface elements is designed to ensure that when the trigger conditions are met, the interface elements can be accurately adjusted according to the user's dialect and driving area information.

[0116] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0117] Based on the same inventive concept, the embodiment of the present application also provides an interactive device based on a smart cockpit for implementing the interactive method based on a smart cockpit involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the embodiments of one or more interactive devices based on a smart cockpit provided below can refer to the limitations of the interactive method based on a smart cockpit above, and will not be repeated here.

[0118] In an exemplary embodiment, Figure 6 As shown, an interactive device based on a smart cockpit is provided, which is configured in the smart cockpit and includes:

[0119] The interest point generation module 11 is used to determine the browsing interest points corresponding to the target area according to the target area input by the user;

[0120] An application calling module 12, used to call at least one target application corresponding to the browsing interest point in the smart cockpit or in a user terminal connected to the smart cockpit;

[0121] The point of interest search module 13 is used to search and browse the point of interest application information corresponding to the point of interest in each target application;

[0122] The point of interest feedback module 14 is used to feed back the point of interest application information corresponding to each target application to the user through the smart cockpit.

[0123] In one embodiment, the application retrieval module 12 is further used to: input a point of interest identifier of a browsing point of interest in a browsing interface provided by the smart cockpit, and obtain an application identifier of a target application corresponding to the browsing point of interest;

[0124] In the local application set of the smart cockpit, the target application is called according to the application identifier of the target application, or in the user terminal connected to the smart cockpit, the target application is called according to the application identifier of the target application.

[0125] In one embodiment, the application retrieval module 12 is further used to: if the target application does not exist in the local application set of the smart cockpit, obtain the download address of the target application;

[0126] Install the target application in the smart cockpit according to the download address;

[0127] After the target application is installed, the user information stored by the user in the smart cockpit is registered in the target application to obtain the target application containing the user information.

[0128] In one embodiment, the POI search module 13 is further configured to: if the target application is a target application installed in a user terminal, establish a sharing mechanism with the user terminal so that the user can control the target application in the user terminal to perform a corresponding action through an operation instruction input in the smart cockpit;

[0129] Under the sharing mechanism, by inputting a search instruction for the point of interest identifier of the browsing point of interest in the target application in the cockpit interface, the point of interest application information corresponding to the browsing point of interest returned by the target application is obtained.

[0130] In one embodiment, the point of interest search module 13 is further used to: under the sharing mechanism, by inputting a search instruction for the point of interest identifier for browsing the point of interest in the target application in the cockpit interface, to obtain the point of interest browsing information corresponding to the browsing point of interest returned by the target application;

[0131] Screen capture of the browsing information of the points of interest is performed to obtain images of the points of interest;

[0132] The interest point description information of each dimension in the interest point image is extracted to obtain the interest point application information corresponding to the browsing interest point.

[0133] In one embodiment, if the number of target applications is at least two, the point of interest search module 13 is further used to: split the cockpit interface according to the number of target applications to obtain multiple split-screen interfaces;

[0134] Under the sharing mechanism, different target applications are displayed in different split-screen interfaces;

[0135] For each split screen interface, a search instruction for a point of interest identifier for browsing points of interest is input in the target application through the split screen interface.

[0136] Each module in the above-mentioned smart cockpit-based interactive device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the smart cockpit in the form of hardware, or can be stored in the memory in the smart cockpit in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0137] In an exemplary embodiment, a smart cockpit is provided, and its internal structure diagram can be as follows: Figure 7 As shown. The smart cockpit includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the smart cockpit is used to provide computing and control capabilities. The memory of the smart cockpit includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the smart cockpit is used to exchange information between the processor and the external device. The communication interface of the smart cockpit is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (Near Field Communication, NFC) or other technologies. When the computer program is executed by the processor, an interactive method based on the smart cockpit is implemented. The display unit of the smart cockpit is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the smart cockpit can be a touch layer covering the display screen, or a button, trackball or touchpad set on the smart cockpit shell, or an external keyboard, touchpad or mouse.

[0138] Those skilled in the art will understand that Figure 7 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the smart cockpit to which the scheme of the present application is applied. The specific smart cockpit may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0139] In an exemplary embodiment, a smart cockpit is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0140] Determine the browsing points of interest corresponding to the target area according to the target area input by the user;

[0141] In the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing point of interest;

[0142] In each target application, search and browse the POI application information corresponding to the POI;

[0143] The point of interest application information corresponding to each target application is fed back to the user through the smart cockpit.

[0144] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0145] Determine the browsing points of interest corresponding to the target area according to the target area input by the user;

[0146] In the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing point of interest;

[0147] In each target application, search and browse the POI application information corresponding to the POI;

[0148] The point of interest application information corresponding to each target application is fed back to the user through the smart cockpit.

[0149] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0150] Determine the browsing points of interest corresponding to the target area according to the target area input by the user;

[0151] In the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing point of interest;

[0152] In each target application, search and browse the POI application information corresponding to the POI;

[0153] The point of interest application information corresponding to each target application is fed back to the user through the smart cockpit.

[0154] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0155] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0156] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. An interactive method based on a smart cockpit, characterized in that: Applied to a smart cockpit, the method comprises: Determine, according to the target area input by the user, the browsing points of interest corresponding to the target area; In the smart cockpit, or in a user terminal connected to the smart cockpit, calling at least one target application corresponding to the browsing point of interest; Searching for the point of interest application information corresponding to the browsing point of interest in each target application; The point of interest application information corresponding to each target application is fed back to the user through the smart cockpit.

2. The method according to claim 1, characterized in that The step of calling at least one target application corresponding to the browsing point of interest in the smart cockpit or in a user terminal connected to the smart cockpit includes: In the browsing interface provided by the smart cockpit, input the point of interest identifier of the browsing point of interest to obtain the application identifier of the target application corresponding to the browsing point of interest; The target application is retrieved according to the application identifier of the target application in the local application set of the smart cockpit, or the target application is retrieved according to the application identifier of the target application in a user terminal connected to the smart cockpit.

3. The method according to claim 2, characterized in that The method further comprises: If the target application does not exist in the local application set of the smart cockpit, obtaining a download address of the target application; According to the download address, installing the target application in the smart cockpit; After the target application is installed, the user information stored by the user in the smart cockpit is registered in the target application to obtain the target application containing the user information.

4. The method according to claim 2, characterized in that: In each target application, searching for the point of interest application information corresponding to the browsing point of interest includes: If the target application is a target application installed in the user terminal, a sharing mechanism with the user terminal is established so that the user can control the target application in the user terminal to perform a corresponding action through an operation instruction input in the smart cockpit; Under the sharing mechanism, a search instruction for the point of interest identifier of the browsing point of interest is input in the target application through the cockpit interface, and the point of interest application information corresponding to the browsing point of interest returned by the target application is obtained.

5. The method according to claim 4, characterized in that Under the sharing mechanism, through the cockpit interface, a search instruction for the point of interest identifier of the browsing point of interest is input in the target application to obtain the point of interest application information corresponding to the browsing point of interest returned by the target application, including: Under the sharing mechanism, a search instruction for the point of interest identifier of the browsing point of interest is input in the target application through the cockpit interface, and the point of interest browsing information corresponding to the browsing point of interest returned by the target application is obtained; Taking screenshots of the browsing information of the points of interest to obtain images of the points of interest; The interest point description information of each dimension in the interest point image is extracted to obtain the interest point application information corresponding to the browsing interest point.

6. The method according to claim 4, characterized in that If the number of the target applications is at least two, then under the sharing mechanism, inputting a search instruction for the point of interest identifier of the browsing point of interest in the target application through the cockpit interface includes: According to the number of the target applications, the cockpit interface is split-screened to obtain multiple split-screen interfaces; Under the sharing mechanism, different target applications are displayed in different split-screen interfaces respectively; For each split-screen interface, a search instruction for the point of interest identifier of the browsing point of interest is input in the target application through the split-screen interface.

7. An interactive device based on a smart cockpit, characterized in that: Configured in a smart cockpit, the device includes: An interest point generation module is used to determine the browsing interest points corresponding to the target area according to the target area input by the user; An application calling module, used to call at least one target application corresponding to the browsing interest point in the smart cockpit or in a user terminal connected to the smart cockpit; A point of interest search module, used to search for point of interest application information corresponding to the browsing point of interest in each target application; The point of interest feedback module is used to feed back the point of interest application information corresponding to each target application to the user through the smart cockpit.

8. A smart cockpit, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images