Interaction method and device based on intelligent cockpit and intelligent cockpit

Abstract

This application relates to the field of intelligent driving technology, and in particular to an interaction method, device, and intelligent cockpit based on an intelligent cockpit. The method includes: determining browsing points of interest (POIs) corresponding to a target area input by a user; retrieving at least one target application corresponding to the POIs within the intelligent cockpit or on a user terminal connected to the intelligent cockpit; searching for POI application information corresponding to the POIs within each target application; and feeding back the POI application information corresponding to each target application to the user through the intelligent cockpit.

Description

Technical Field

[0001] This application relates to the field of intelligent driving technology, and in particular to an interaction method, device and intelligent cockpit based on an intelligent cockpit. Background Technology

[0002] The intelligent cockpit in a vehicle refers to a mobile space equipped with advanced software and hardware systems, possessing human-machine-environment integration capabilities for human-machine interaction, connected services, and scenario expansion, providing drivers and passengers with a comprehensive experience of safety, intelligence, efficiency, and enjoyment.

[0003] In traditional technologies, smart cockpits connect to external networks via internet technology, enabling them to obtain real-time road conditions and weather information and plan travel routes for drivers.

[0004] However, when a user focuses on a specific point of interest along their travel route, traditional smart cockpit technologies cannot intelligently analyze that point of interest. Summary of the Invention

[0005] Therefore, it is necessary to provide an interactive method, device, and smart cockpit based on a smart cockpit that can intelligently analyze browsing points of interest in a travel route, addressing the aforementioned technical problems.

[0006] Firstly, this application provides an interaction method based on a smart cockpit, applied to a smart cockpit, the method comprising:

[0007] Based on the target area entered by the user, determine the browsing points of interest corresponding to the target area;

[0008] Within the smart cockpit, or on a user terminal connected to the smart cockpit, retrieve at least one target application corresponding to the browsing point of interest;

[0009] Within each target application, search and browse the application information corresponding to the points of interest;

[0010] The information on points of interest corresponding to each target application is fed back to the user through the smart cockpit.

[0011] In one embodiment, retrieving at least one target application corresponding to browsing points of interest within the smart cockpit or on a user terminal connected to the smart cockpit includes:

[0012] Within the browsing interface provided by the smart cockpit, you can enter the point of interest identifier to obtain the application identifier of the target application corresponding to the point of interest.

[0013] Within the local application set of the smart cockpit, the target application is retrieved based on its application identifier, or within the user terminal connected to the smart cockpit, the target application is retrieved based on its application identifier.

[0014] In one embodiment, the method further includes:

[0015] If the target application does not exist in the local application set of the smart cockpit, then obtain the download address of the target application.

[0016] Install the target application in the smart cockpit according to the download address;

[0017] After the target application is installed, the user information stored in the smart cockpit is registered in the target application, resulting in a target application containing the user information.

[0018] In one embodiment, within each target application, searching and browsing application information corresponding to the point of interest includes:

[0019] If the target application is an application installed on the user terminal, a sharing mechanism is established with the user terminal so that the user can control the target application on the user terminal to perform corresponding actions by inputting operation commands in the smart cockpit.

[0020] Under the sharing mechanism, by entering a search command for the point of interest identifier in the target application within the cockpit interface, the user can obtain the point of interest application information corresponding to the point of interest returned by the target application.

[0021] In one embodiment, under the sharing mechanism, by inputting a search command for the point of interest identifier within the target application on the cockpit interface, the user obtains the point of interest application information corresponding to the browsing point of interest returned by the target application, including:

[0022] Under the sharing mechanism, by entering a search command for the point of interest identifier in the target application within the cockpit interface, the user can obtain the point of interest browsing information returned by the target application.

[0023] Screenshot the browsing information of points of interest to obtain images of the points of interest;

[0024] The description information of interest points in each dimension of the interest point image is extracted to obtain the interest point application information corresponding to the browsing interest point.

[0025] In one embodiment, if the number of target applications is at least two, then under the sharing mechanism, by entering a search command for the point of interest identifier within the target application in the cockpit interface, the following steps are taken:

[0026] Based on the number of target applications, the cockpit interface is split into multiple screens.

[0027] Under the sharing mechanism, different target applications are displayed in different split-screen interfaces;

[0028] For each split-screen interface, within the split-screen interface, enter the search command for the point of interest identifier in the target application.

[0029] Secondly, this application also provides an interactive device based on a smart cockpit, comprising:

[0030] The point of interest generation module is used to determine the browsing points of interest corresponding to the target area based on the target area input by the user.

[0031] The application retrieval module is used to retrieve at least one target application corresponding to browsing points of interest within the smart cockpit or within a user terminal connected to the smart cockpit.

[0032] The Point of Interest (POI) search module is used to search and browse POI application information corresponding to POIs within each target application.

[0033] The Point of Interest (POI) feedback module is used to feed back the POI application information corresponding to each target application to the user through the smart cockpit.

[0034] Thirdly, this application also provides an intelligent cockpit, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0035] Based on the target area entered by the user, determine the browsing points of interest corresponding to the target area;

[0036] Within the smart cockpit, or on a user terminal connected to the smart cockpit, retrieve at least one target application corresponding to the browsing point of interest;

[0037] Within each target application, search and browse the application information corresponding to the points of interest;

[0038] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, performs the following steps:

[0039] Based on the target area entered by the user, determine the browsing points of interest corresponding to the target area;

[0040] Within the smart cockpit, or on a user terminal connected to the smart cockpit, retrieve at least one target application corresponding to the browsing point of interest;

[0041] Within each target application, search and browse the application information corresponding to the points of interest;

[0042] The information on points of interest corresponding to each target application is fed back to the user through the smart cockpit.

[0043] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, performs the following steps:

[0044] Based on the target area entered by the user, determine the browsing points of interest corresponding to the target area;

[0045] Within the smart cockpit, or on a user terminal connected to the smart cockpit, retrieve at least one target application corresponding to the browsing point of interest;

[0046] Within each target application, search and browse the application information corresponding to the points of interest;

[0047] The information on points of interest corresponding to each target application is fed back to the user through the smart cockpit.

[0048] The aforementioned interactive method, device, and smart cockpit based on a smart cockpit, through automatically retrieving relevant applications and searching for points of interest, enable the smart cockpit to intelligently analyze user concerns and provide more accurate and personalized services. By integrating information from multiple applications, the smart cockpit can provide users with comprehensive, multi-faceted information about browsing points of interest, meeting users' needs for in-depth exploration. Attached Figure Description

[0049] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0050] Figure 1 This is a flowchart illustrating an interaction method based on a smart cockpit in one embodiment;

[0051] Figure 2 This is a flowchart illustrating the steps of retrieving at least one target application corresponding to a browsing point of interest in one embodiment.

[0052] Figure 3 This is a flowchart illustrating the steps of searching and browsing application information corresponding to points of interest in one embodiment.

[0053] Figure 4 This is a flowchart illustrating the steps of obtaining the point of interest application information corresponding to the browsing point of interest returned by the target application in one embodiment.

[0054] Figure 5 This is a flowchart illustrating the steps of inputting a search command for a point of interest identifier within a target application in one embodiment.

[0055] Figure 6 This is a structural block diagram of an interactive device based on a smart cockpit in one embodiment;

[0056] Figure 7 This is an internal structural diagram of the smart cockpit in one embodiment. Detailed Implementation

[0057] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0058] In one exemplary embodiment, such as Figure 1 As shown, an interaction method based on a smart cockpit is provided. Taking the application of this method in a smart cockpit as an example, it is illustrated as follows:

[0059] S101, determine the browsing interest points corresponding to the target area based on the target area input by the user.

[0060] The target area refers to a geographical location, spatial range, or specific region that the user is interested in. For example, in the navigation of a smart cockpit, a user might enter a city name, a tourist attraction name, or a specific address as the target area, indicating that they want to obtain relevant information about that area or navigate to that area.

[0061] Points of interest (POIs) refer to specific locations or areas that a user might be interested in on a map, navigation, or similar application, such as restaurants, hotels, attractions, and shopping malls. For example, if the user enters a city as their target area, then famous attractions, popular restaurants, and shopping centers within that city could all become POIs.

[0062] S102, in the smart cockpit or in a user terminal connected to the smart cockpit, retrieve at least one target application corresponding to the browsing point of interest.

[0063] The smart cockpit is equipped with an in-vehicle information system, and communicates and exchanges data with user terminals (such as user terminals, tablets, etc.) through wireless connections (such as Bluetooth, Wi-Fi, etc.) based on the in-vehicle information system. This enables the smart cockpit to access applications and resources on the user terminal, and also allows the user terminal to control certain functions of the smart cockpit.

[0064] Optionally, the user inputs or selects a specific target area through the smart cockpit interface, which identifies points of interest (POIs) that the user may be interested in. Once POIs are identified, the smart cockpit's local application set or the user's terminal searches for applications related to these POIs. These applications may be navigation apps, restaurant booking apps, attraction information apps, etc., depending on the nature of the POIs. The most relevant applications, those most likely to meet the user's needs, are selected and retrieved based on factors such as the type of POI, the user's preferences, and historical behavior.

[0065] The retrieved target applications will then be displayed on the smart cockpit's screen, or on the user terminal via the interconnection function between the user terminal and the smart cockpit. Users can interact with these applications through the smart cockpit's interface or voice commands to obtain more information about points of interest, or perform related operations (such as booking, navigation, etc.).

[0066] S103, within each target application, search and browse the application information corresponding to the points of interest.

[0067] Optionally, after identifying target applications, a search can be performed within these applications to find application information directly related to browsing points of interest. Points of interest application information includes, but is not limited to: detailed descriptions of the points of interest, images, videos, user reviews, opening hours, prices, location information, contact information, and bookable services or products.

[0068] S104 feeds back the point of interest application information corresponding to each target application to the user through the smart cockpit.

[0069] Optionally, the searched point-of-interest (POI) application information can be integrated and presented to users in a unified format, or the POI application information can be further analyzed to provide targeted feedback based on user preferences or user questions.

[0070] The aforementioned interactive method based on a smart cockpit, through automatically retrieving relevant applications and searching for points of interest, enables the smart cockpit to intelligently analyze user concerns and provide more accurate and personalized services. By integrating information from multiple applications, the smart cockpit can provide users with comprehensive, multi-faceted information about browsing points of interest, meeting their needs for in-depth exploration.

[0071] In one exemplary embodiment, such as Figure 2 As shown, within the smart cockpit, or on a user terminal connected to the smart cockpit, retrieving at least one target application corresponding to browsing points of interest includes:

[0072] S201, within the browsing interface provided by the smart cockpit, input the point of interest identifier to obtain the application identifier of the target application corresponding to the point of interest.

[0073] Optionally, when the user activates the smart cockpit, it enters the main interface. This main interface, or a specific menu, displays a dedicated interface for browsing points of interest (POIs), or a third-party browser interface. The smart cockpit offers users multiple input methods, such as touchscreen input, voice input (combined with dialect recognition technology), and gesture input. Users input the identifiers of the POIs they wish to learn about or access within the browsing interface using their chosen input method. POI identifiers can be names, keywords, codes, etc., depending on the smart cockpit's design and the user's input habits.

[0074] The intelligent cockpit receives user-inputted point of interest (POI) identifiers and uses built-in recognition algorithms (such as natural language processing and pattern recognition) to identify and parse the input content, obtain the POI identifiers, and then queries the internal target application library for the POI identifiers.

[0075] Understandably, the target application library is a database containing various applications related to points of interest, each with a unique application identifier. The smart cockpit searches the target application library for applications that match the input point of interest identifier and retrieves that application's identifier.

[0076] S202, within the local application set of the smart cockpit, retrieve the target application based on the application identifier of the target application, or within the user terminal connected to the smart cockpit, retrieve the target application based on the application identifier of the target application.

[0077] Optionally, it can be determined whether the target application is pre-installed in the smart cockpit's local application set. If the condition is met, the target application will be retrieved in the local environment. Specifically, a match will be made within the local application set based on the target application's application identifier. If a match is successful, the target application will be launched directly and displayed to the user.

[0078] If it is determined that the user is not currently in the local environment of the smart cockpit, or if the target application is not pre-installed in the smart cockpit's local application set but has already established a connection with the user terminal (such as a smart user terminal, tablet, etc.) and is already installed on the user terminal, the user terminal will be selected to retrieve the target application. Specifically, in the user terminal environment, the application identifier of the target application is sent to the user terminal through the communication interface with the user terminal. After receiving the application identifier, the user terminal will match it in its local app store or among its installed applications. If the match is successful, the user terminal will launch the target application and can display it to the user on the smart cockpit's display screen through screen projection, mirroring, or other methods.

[0079] Furthermore, the method also includes: if the target application does not exist in the local application set of the smart cockpit, then obtaining the download address of the target application; installing the target application in the smart cockpit according to the download address; after the target application is installed, registering the user information stored in the smart cockpit into the target application to obtain the target application containing the user information.

[0080] Understandably, when it's determined that the target app doesn't exist within the local app set, the smart cockpit will attempt to obtain the download address from a pre-set app store, the app provider's server, or other reliable download sources. It might first check if a pre-stored download address exists. If no pre-stored download address exists, it might attempt to access the app store's API or the app provider's server to dynamically obtain the latest download address for the target app.

[0081] Specifically, after obtaining the download address of the target application, the smart cockpit will begin downloading and installing the application. Once the target application is installed, the user's information stored within the smart cockpit (such as username, password, preferences, etc.) will be registered in the target application. After registration, the target application will contain the user's personalized information, thereby enabling it to provide the user with more customized services and experiences.

[0082] In one exemplary embodiment, such as Figure 3 As shown, within each target application, search and browse the application information corresponding to the point of interest, including:

[0083] S301, if the target application is an application installed in the user terminal, a sharing mechanism is established with the user terminal so that the user can control the target application in the user terminal to perform corresponding actions by inputting operation commands in the smart cockpit.

[0084] Understandably, when the target application is installed on the user terminal, the smart cockpit needs to establish a sharing mechanism with the user terminal. In this embodiment, the sharing mechanism refers to a bridge for data and information interaction between the smart cockpit and the user terminal. This mechanism allows the smart cockpit to acquire and display the content on the user terminal screen in real time, while allowing the user to operate and control the application on the user terminal through the smart cockpit's interface. The specific process of establishing the sharing mechanism involves connecting the user terminal and the smart cockpit wirelessly or via wired connection, ensuring that the screen projection function is enabled correctly.

[0085] S302, under the sharing mechanism, by entering a search command for the point of interest identifier in the target application within the cockpit interface, the application information corresponding to the point of interest returned by the target application is obtained.

[0086] Specifically, the smart cockpit identifies and connects to the user's terminal, projecting the terminal's screen content onto the in-vehicle display in real time. Users navigate to the desired application (i.e., the target application), such as a map navigation app or a music player, via touch, voice, or physical buttons on the in-vehicle display. Within the target application, users input search commands based on points of interest (such as location names or keywords) through the in-vehicle display's input interface (which may be a virtual keyboard or voice input). The smart cockpit transmits these input commands to the user's terminal in real time, where the application processes them.

[0087] Then, after receiving the search command, the user terminal application performs an internal search or query operation based on the command content. The application finds point-of-interest (POI) information (such as location details, images, reviews, etc.) that matches the search command and prepares this information for return. The user terminal application sends the retrieved POI information back to the smart cockpit via a preset communication protocol. After receiving this information, the smart cockpit displays it on the in-vehicle display screen for the user to browse and perform further operations.

[0088] For example, suppose a user is using a map navigation app and wants to find and browse information about a specific location (such as a restaurant). The user connects their device to the smart cockpit via Wi-Fi and enables screen mirroring. The in-vehicle display begins displaying the user's device screen content in real time. The user navigates to the map navigation app using touch controls on the in-vehicle display. The user enters the restaurant's name (e.g., "XX Restaurant") on the virtual keyboard on the in-vehicle display. The smart cockpit transmits this input command to the user's device. Upon receiving the command, the map navigation app performs an internal search. The app finds location information matching "XX Restaurant," including address, opening hours, and reviews. The map navigation app sends this information back to the smart cockpit via a communication protocol. The in-vehicle display shows detailed information about "XX Restaurant," and the user can further browse or navigate to the location using touch controls.

[0089] In one exemplary embodiment, such as Figure 4 As shown, under the sharing mechanism, by entering a search command for the point of interest identifier within the target application in the cockpit interface, the target application returns the point of interest application information corresponding to the browsed point of interest, including:

[0090] S401, under the sharing mechanism, by entering a search command for the point of interest identifier in the target application within the cockpit interface, the user obtains the point of interest browsing information corresponding to the browsing point of interest returned by the target application.

[0091] Understandably, once the sharing mechanism is established (i.e., the user terminal and the smart cockpit are successfully connected, and the user terminal screen content is being projected onto the cockpit interface in real time), the user inputs a search command for a specific point of interest within the target application using the input method on the cockpit interface. The target application then processes this search command and returns the browsing information corresponding to that point of interest.

[0092] S402, take a screenshot of the browsing information of the points of interest to obtain the image of the points of interest.

[0093] Specifically, when browsing point-of-interest (POI) information within the cockpit interface, a screenshot can be triggered based on the page scrolling action (or a user-issued page switching command). This screenshot captures an image of the currently displayed POI information on the smart cockpit interface. After the screenshot is taken, the captured image is saved as an image file; this image file is the POI image.

[0094] S403, extract the interest point description information of each dimension in the interest point image to obtain the interest point application information corresponding to the browsing interest point.

[0095] The description information of points of interest can include multiple dimensions such as name, address, contact number, business hours, user reviews, and image links.

[0096] Specifically, the descriptive information of interest points in each dimension of the interest point image is extracted to construct an answer database.

[0097] The specific process of building the answer database is as follows: Based on users' potential interests and concerns, predict the questions users might ask about the browsing points of interest. These questions may involve basic information, features, surrounding facilities, transportation methods, etc., about the points of interest. Match corresponding answers to the predicted questions from the extracted descriptions of the points of interest. Ensure the accuracy and relevance of the answers to meet user needs. Continuously optimize the content of the answer database based on actual user feedback and query data. Add new question and answer pairs to cover a wider range of user needs.

[0098] In this embodiment, by refining the description information of points of interest and constructing an answer database, a more convenient, intelligent and personalized service experience is provided to users.

[0099] In one exemplary embodiment, such as Figure 5 As shown, if there are at least two target applications, then under the sharing mechanism, by entering a search command for the point of interest identifier within the target application in the cockpit interface, including:

[0100] S501 splits the cockpit interface into multiple screens based on the number of target applications.

[0101] Optionally, first detect the number of target applications that need to be displayed simultaneously. Based on this number, split the cockpit interface into multiple split-screen interfaces to display different target applications at the same time.

[0102] Under the sharing mechanism, S502 displays different target applications in different split-screen interfaces.

[0103] Optionally, a mapping relationship between applications and split-screen interfaces can be maintained to ensure that each application is displayed in the correct split-screen interface. Users can switch between or adjust the split-screen layout through the navigation bar, shortcut keys, or gestures on the cockpit interface.

[0104] S503, for each split-screen interface, allows users to input search commands for point-of-interest identifiers within the target application on the split-screen interface.

[0105] Specifically, for each split-screen interface, users can enter search commands targeting specific browsing interests within the target application. Based on the user's input, the search operation is executed in each split-screen interface, and the search results are displayed. Optionally, users can enter search commands within the target application of the split-screen interface via touch, voice input, or physical buttons. It is essential to ensure that each split-screen interface can independently process user input, and that search results are accurately displayed in their respective split-screen interfaces.

[0106] For example, suppose a user is planning a trip in a smart cockpit and wants to view information on multiple aspects such as dining, accommodation, and attractions simultaneously. The user selects three target applications through the cockpit interface: map navigation, restaurant recommendations, and hotel booking. The cockpit interface is automatically split into three screens, displaying each application separately. In the map navigation application's screen, the user enters the destination name as a search command to view routes and nearby attractions. In the restaurant recommendations application's screen, the user enters restaurant type or taste preferences as a search command to find nearby restaurants. In the hotel booking application's screen, the user enters check-in dates and locations as search commands to find suitable hotels. The user can view and compare this information simultaneously in different screens to plan the best travel itinerary.

[0107] In one exemplary embodiment, the smart cockpit provided in this embodiment also provides the following functional modules:

[0108] The dialect recognition module utilizes deep learning technology to design speech recognition models specifically for dialects, improving the accuracy of dialect recognition. The aim is to enhance the user-friendliness of human-computer interaction, enabling the intelligent cockpit to understand and respond to user commands from different regions, improving the natural fluency of voice interaction, increasing user identification and satisfaction, and reflecting respect for regional cultural diversity.

[0109] Specifically, the construction process of the dialect recognition module is as follows: A large amount of dialect speech data is collected, covering diverse user groups from different regions, ages, and genders to ensure the model's generalization ability. The collected dialect speech data is preprocessed, including noise removal, speech segmentation, and feature extraction. The feature extraction stage extracts speech features that reflect the characteristics of the dialect, such as pitch, speech rate, and pronunciation habits. Based on deep learning technology, a dialect-specific speech recognition model is designed. The model structure may include convolutional neural networks, recurrent neural networks, or long short-term memory networks to capture the temporal dependencies and spatial features in the speech signal. The preprocessed dialect speech data is used to train the model. During training, the model parameters need to be continuously optimized to improve the accuracy of dialect recognition. The trained dialect recognition module is then integrated into the intelligent cockpit system, which involves interface design and data interaction with other modules in the system.

[0110] The geolocation module integrates a GPS positioning system to acquire real-time vehicle location information. Combined with dialect recognition results, it automatically matches the regional cultural environment based on the user's geographical location. The aim is to push health monitoring images, desktop themes, and navigation languages ​​that align with regional characteristics, providing a personalized experience with regional cultural features and enhancing the cultural experience and sense of belonging during the driving process.

[0111] Specifically, the construction process of the geolocation module is as follows: GPS positioning hardware is integrated into the vehicle, ensuring compatibility with the communication interface of the intelligent cockpit system. Relevant software parameters of the GPS positioning system, such as positioning accuracy and update frequency, are configured to meet the needs of the intelligent cockpit system. Real-time vehicle location information, including longitude, latitude, and speed, is received through the GPS positioning system. The received location information is preprocessed, such as through noise reduction and filtering, to improve data accuracy and reliability. A database containing different regional cultural characteristics is established, including health monitoring images, desktop themes, and navigation languages. Based on the real-time vehicle location information and dialect recognition results, a matching algorithm is designed to automatically select content matching the regional characteristics from the database. Based on the matching algorithm results, health monitoring images, desktop themes, and navigation languages ​​matching the regional characteristics are generated. A push mechanism is designed to push the generated content to the intelligent cockpit system's display interface and voice interaction module in real time.

[0112] The health monitoring module integrates the health monitoring system with regional cultural elements, designing health monitoring avatars with specific regional clothing styles. This cultural design enhances users' sense of identification with the regional culture.

[0113] Specifically, the construction process of the health monitoring module is as follows: integrate health monitoring devices (such as heart rate monitors, blood pressure monitors, etc.) into the smart cockpit, collect cultural elements from different regions, especially information related to clothing styles, organize the collected cultural elements, select elements suitable for health monitoring image design, combine regional cultural elements to conceive a health monitoring image with a specific regional clothing style, use graphic design software or 3D modeling tools to design the conceived health monitoring image, pay attention to the vividness, recognizability and accuracy of cultural characteristics of the image during the design process, integrate the designed health monitoring image into the display interface of the smart cockpit, design dynamic display effects, such as the health monitoring image's actions and expressions in different states, to enhance the user's interactive experience.

[0114] The personalized interface design module dynamically adjusts the smart cockpit's interface elements based on the user's dialect and driving area information. The aim is to enable the smart cockpit system to better adapt to the needs and preferences of different users.

[0115] Specifically, the process of building the personalized interface design module is as follows: User dialect information and driving area information are collected through user registration and usage records of the intelligent cockpit system. User data is processed and analyzed to extract key information for personalized interface design. Based on the user's dialect and regional cultural characteristics, a health monitoring image with a specific clothing style is designed. Personalized desktop theme wallpapers are designed in conjunction with the cultural elements and scenic features of the user's driving area. Personalized navigation language options are provided based on the user's dialect, and a navigation style that conforms to regional characteristics is designed. Conditions for triggering personalized interface adjustments are determined, such as user login, vehicle startup, and area changes. The logic for dynamically adjusting interface elements is designed to ensure that when the triggering conditions are met, interface elements can be accurately adjusted according to the user's dialect and driving area information.

[0116] It should be understood that although the steps in the flowcharts of the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0117] Based on the same inventive concept, this application also provides a smart cockpit-based interaction device for implementing the aforementioned smart cockpit-based interaction method. The solution provided by this device is similar to the implementation described in the above method; therefore, the specific limitations in one or more smart cockpit-based interaction device embodiments provided below can be found in the limitations of the smart cockpit-based interaction method described above, and will not be repeated here.

[0118] In one exemplary embodiment, such as Figure 6 As shown, an interactive device based on a smart cockpit is provided, configured in the smart cockpit, including:

[0119] The point of interest generation module 11 is used to determine the browsing points of interest corresponding to the target area based on the target area input by the user.

[0120] The application retrieval module 12 is used to retrieve at least one target application corresponding to browsing points of interest in the smart cockpit or in a user terminal connected to the smart cockpit.

[0121] The point of interest search module 13 is used to search and browse the point of interest application information corresponding to the point of interest within each target application;

[0122] The point of interest feedback module 14 is used to feed back the point of interest application information corresponding to each target application to the user through the smart cockpit.

[0123] In one embodiment, the application retrieval module 12 is further configured to: input the point of interest identifier of the browsing point of interest in the browsing interface provided by the smart cockpit, and obtain the application identifier of the target application corresponding to the browsing point of interest.

[0124] Within the local application set of the smart cockpit, the target application is retrieved based on its application identifier, or within the user terminal connected to the smart cockpit, the target application is retrieved based on its application identifier.

[0125] In one embodiment, the application retrieval module 12 is further configured to: if the target application does not exist in the local application set of the smart cockpit, then obtain the download address of the target application;

[0126] Install the target application in the smart cockpit according to the download address;

[0127] After the target application is installed, the user information stored in the smart cockpit is registered in the target application, resulting in a target application containing the user information.

[0128] In one embodiment, the point of interest search module 13 is further configured to: if the target application is a target application installed in the user terminal, establish a sharing mechanism with the user terminal so that the user can control the target application in the user terminal to perform corresponding actions by inputting operation commands in the smart cockpit;

[0129] Under the sharing mechanism, by entering a search command for the point of interest identifier in the target application within the cockpit interface, the user can obtain the point of interest application information corresponding to the point of interest returned by the target application.

[0130] In one embodiment, the point of interest search module 13 is further configured to: under the sharing mechanism, by inputting a search command for the point of interest identifier for browsing the point of interest in the target application through the cockpit interface, obtain the point of interest browsing information corresponding to the browsing point of interest returned by the target application.

[0131] Screenshot the browsing information of points of interest to obtain images of the points of interest;

[0132] The description information of interest points in each dimension of the interest point image is extracted to obtain the interest point application information corresponding to the browsing interest point.

[0133] In one embodiment, if the number of target applications is at least two, the point of interest search module 13 is further configured to: perform split-screen processing on the cockpit interface according to the number of target applications to obtain multiple split-screen interfaces;

[0134] Under the sharing mechanism, different target applications are displayed in different split-screen interfaces;

[0135] For each split-screen interface, within the split-screen interface, enter the search command for the point of interest identifier in the target application.

[0136] The modules in the aforementioned smart cockpit-based interactive device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor within the smart cockpit in hardware form or independent of it, or stored in the smart cockpit's memory in software form, so that the processor can call and execute the corresponding operations of each module.

[0137] In one exemplary embodiment, a smart cockpit is provided, the internal structure of which can be shown in the following diagram. Figure 7 As shown, the smart cockpit includes a processor, memory, input / output interfaces, a communication interface, a display unit, and input devices. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input devices are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, Near Field Communication (NFC), or other technologies. When the computer program is executed by the processor, it implements an interactive method based on the smart cockpit. The display unit is used to form a visually visible image and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the smart cockpit can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the shell of the smart cockpit, or external keyboards, touchpads, or mice, etc.

[0138] Those skilled in the art will understand that Figure 7 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the smart cockpit to which the present application is applied. A specific smart cockpit may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0139] In one exemplary embodiment, a smart cockpit is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0140] Based on the target area entered by the user, determine the browsing points of interest corresponding to the target area;

[0141] Within the smart cockpit, or on a user terminal connected to the smart cockpit, retrieve at least one target application corresponding to the browsing point of interest;

[0142] Within each target application, search and browse the application information corresponding to the points of interest;

[0143] The information on points of interest corresponding to each target application is fed back to the user through the smart cockpit.

[0144] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0145] Based on the target area entered by the user, determine the browsing points of interest corresponding to the target area;

[0146] Within the smart cockpit, or on a user terminal connected to the smart cockpit, retrieve at least one target application corresponding to the browsing point of interest;

[0147] Within each target application, search and browse the application information corresponding to the points of interest;

[0148] The information on points of interest corresponding to each target application is fed back to the user through the smart cockpit.

[0149] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0150] Based on the target area entered by the user, determine the browsing points of interest corresponding to the target area;

[0151] Within the smart cockpit, or on a user terminal connected to the smart cockpit, retrieve at least one target application corresponding to the browsing point of interest;

[0152] Within each target application, search and browse the application information corresponding to the points of interest;

[0153] The information on points of interest corresponding to each target application is fed back to the user through the smart cockpit.

[0154] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0155] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0156] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. An interaction method based on a smart cockpit, characterized in that, Applied to smart cockpits, the method includes: Based on the target area input by the user, determine the browsing interest points corresponding to the target area; Within the smart cockpit, or within a user terminal connected to the smart cockpit, at least one target application corresponding to the browsing point of interest is retrieved; Within each target application, the application information corresponding to the browsing point of interest is searched. If the target application is installed on the user terminal, a sharing mechanism is established with the user terminal, allowing the user to control the target application on the user terminal to perform corresponding actions through operation commands input in the smart cockpit. Under the sharing mechanism, through the cockpit interface, a search command for the point of interest identifier of the browsing point of interest is input in the target application to obtain the application information corresponding to the browsing point of interest returned by the target application. The sharing mechanism allows the smart cockpit to acquire and display the content on the user terminal screen in real time, while also allowing the user to operate and control the applications on the user terminal through the smart cockpit interface. The information on points of interest corresponding to each target application is fed back to the user through the smart cockpit.

2. The method according to claim 1, characterized in that, The step of retrieving at least one target application corresponding to the browsing interest point within the smart cockpit or within a user terminal connected to the smart cockpit includes: Within the browsing interface provided by the smart cockpit, the point of interest identifier of the browsing point of interest is entered to obtain the application identifier of the target application corresponding to the browsing point of interest. Within the local application set of the smart cockpit, the target application is retrieved based on its application identifier, or within the user terminal connected to the smart cockpit, the target application is retrieved based on its application identifier.

3. The method according to claim 2, characterized in that, The method further includes: If the target application does not exist in the local application set of the smart cockpit, then obtain the download address of the target application; Install the target application in the smart cockpit according to the download address; After the target application is installed, the user information stored in the smart cockpit is registered in the target application to obtain a target application containing the user information.

4. The method according to claim 1, characterized in that, Under the sharing mechanism, through the cockpit interface, a search command for the point of interest identifier of the browsing point of interest is input within the target application to obtain the point of interest application information corresponding to the browsing point of interest returned by the target application, including: Under the sharing mechanism, by entering a search command for the point of interest identifier of the browsing point of interest in the target application through the cockpit interface, the browsing information of the point of interest corresponding to the browsing point of interest returned by the target application is obtained; The browsing information of the points of interest is captured to obtain images of the points of interest; The interest point description information of each dimension in the interest point image is extracted to obtain the interest point application information corresponding to the browsing interest point.

5. The method according to claim 1, characterized in that, If the number of target applications is at least two, then under the sharing mechanism, through the cockpit interface, a search command for the point of interest identifier of the browsing point of interest is entered within the target application, including: Based on the number of target applications, the cockpit interface is split into multiple screens. Under the aforementioned sharing mechanism, different target applications are displayed in different split-screen interfaces; For each split-screen interface, a search command for the point of interest identifier is entered within the target application on the split-screen interface.

6. The method according to any one of claims 1-5, characterized in that, The establishment of a sharing mechanism with the user terminal includes: The user terminal and the smart cockpit are connected wirelessly or via wired means.

7. An interactive device based on a smart cockpit, characterized in that, Configured in a smart cockpit, the device includes: The point of interest generation module is used to determine the browsing points of interest corresponding to the target area based on the target area input by the user. An application retrieval module is used to retrieve at least one target application corresponding to the browsing point of interest within the smart cockpit or within a user terminal connected to the smart cockpit. The point-of-interest (POI) search module is used to search for POI application information corresponding to the browsed POI within each target application. If the target application is installed on the user terminal, a sharing mechanism is established with the user terminal, allowing the user to control the target application on the user terminal to perform corresponding actions via operation commands input within the smart cockpit. Under the sharing mechanism, by inputting a retrieval command targeting the POI identifier within the target application through the cockpit interface, the POI application information corresponding to the browsed POI returned by the target application is obtained. The sharing mechanism allows the smart cockpit to acquire and display content on the user terminal screen in real time, while also allowing the user to operate and control applications on the user terminal through the smart cockpit interface. The point of interest feedback module is used to feed back the point of interest application information corresponding to each target application to the user through the smart cockpit.

8. An intelligent cockpit, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

Images