Method, device, storage medium and terminal for obtaining mini program information on a vehicle-mounted terminal
Through the connection between the on-board terminal and the mobile terminal, mini program business information is extracted and processed, which solves the problem of insufficient interaction between the car and mobile phone and improves the user experience.
Patent Information
- Application Number
- CN202110469033.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-28
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2041-04-28
AI Technical Summary
The interactive functions of existing car computers and mobile phones have not been fully utilized, especially when processing mini-program messages, the user experience is poor and cannot obtain and process these messages in a timely manner.
Establish a connection with the mobile terminal through the on-board terminal, extract the business information in the mini program, and send it to the on-board terminal. The vehicle terminal obtains processing commands for business information from the user and processes it according to the commands.
It realizes that users process mini-program information of mobile terminal applications through the vehicle terminal, improves user experience, and optimizes the interactive function between the vehicle and mobile phone.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of automobile intelligent technology, and in particular to a method, device, storage medium and terminal for a vehicle-mounted terminal to obtain service information of a small program of a mobile terminal. Background Art
[0002] As people's living standards improve, cars have gradually become one of the main means of transportation for people's daily travel. As users spend more time using their cars, in addition to meeting users' driving needs, cars now need to provide users with more and more value-added services to meet the diverse needs of different users. For example, the connection between car computers and smartphones has become a must-have function for car computers, and this function is becoming more and more important.
[0003] Nowadays, mobile phones have long become people's personal assistants. With the development of car computer functions, car computers often need to obtain users' personal information, application preferences, etc. through mobile phones, and the interactive functions between car computers and mobile phones are becoming more and more abundant.
[0004] However, the interaction function between car computers and mobile phones still needs to be improved. Summary of the invention
[0005] The technical problem solved by the embodiments of the present disclosure is to provide a method, device, storage medium and terminal for a vehicle-mounted terminal to obtain business information of a mobile terminal mini-program, so as to improve the interaction function between the vehicle computer and the mobile phone.
[0006] To solve the above technical problems, an embodiment of the present disclosure provides a method for a vehicle-mounted terminal to obtain business information of a mobile terminal mini-program, including: establishing a connection with the vehicle-mounted terminal; extracting business information from the mini-program; sending the business information to the vehicle-mounted terminal; obtaining a user's processing command for the business information from the vehicle-mounted terminal, and processing the business information according to the processing command.
[0007] Optionally, the method for extracting business information from a mini program includes: monitoring reminder messages in a notification bar of a mobile terminal to determine whether the reminder message is a mini program message; in response to determining that the reminder message is a mini program message, jumping to an application page where the mini program message is located; simulating a click on the application page where the mini program message is located to open the mini program and display the mini program page; obtaining text information from the page; and extracting business information from the text information.
[0008] Optionally, before simulating a click on the application page where the mini-program message is located, the method further includes: enabling an accessibility service function, and simulating a click on the application page where the mini-program message is located through the accessibility service.
[0009] Optionally, the method for obtaining text information of the mini-program page includes: taking a screenshot of the mini-program page to obtain screenshot information; and using optical character recognition technology to recognize text information in the screenshot information.
[0010] Optionally, the method for acquiring business information in text information includes: matching and filtering the text information using a keyword rule to acquire the business information.
[0011] Optionally, before obtaining a user's processing command for the business information from the vehicle-mounted terminal and processing the business information according to the processing command, the method further includes: presenting the business information on the vehicle-mounted terminal.
[0012] Optionally, the method of establishing a connection with the vehicle-mounted terminal includes: wireless connection or wired connection.
[0013] Optionally, the method for extracting business information from a mini program includes: monitoring reminder messages in a notification bar of a mobile terminal to determine whether the reminder message is a mini program message; in response to confirming that the reminder message is a mini program message, obtaining preliminary information about the mini program through an accessibility service; and based on the preliminary information about the mini program, searching on the platform where the mini program is located to obtain business information from the mini program.
[0014] Correspondingly, an embodiment of the present disclosure further provides a storage medium on which computer instructions are stored, and the steps of the above method are executed when the computer instructions are executed.
[0015] Correspondingly, an embodiment of the present disclosure further provides a terminal, including a memory and a processor, wherein the memory stores computer instructions that can be executed on the processor, and the processor executes the steps of the above method when executing the computer instructions.
[0016] To solve the above technical problems, an embodiment of the present disclosure also provides a method for a vehicle-mounted terminal to obtain business information of a mobile terminal mini-program, including: establishing a connection with a mobile terminal; obtaining business information in the mini-program from the mobile terminal; obtaining a user's processing command for the business information, and processing the business information according to the processing command.
[0017] Optionally, the business information in the mini program includes: text information of the mini program page recognized by optical character recognition technology.
[0018] Optionally, the method for obtaining the user's processing command for the business information includes: obtaining the user's processing command for the business information through one or more of voice interaction, screen interaction, and physical button interaction.
[0019] Optionally, before obtaining a processing command from a user for the business information and processing the business information according to the processing command, the method further includes: presenting the business information.
[0020] Optionally, the manner of establishing a connection with the mobile terminal includes: a wireless connection or a wired connection.
[0021] Correspondingly, an embodiment of the present disclosure further provides a storage medium on which computer instructions are stored, and the steps of the above method are executed when the computer instructions are executed.
[0022] Correspondingly, an embodiment of the present disclosure further provides a terminal, including a memory and a processor, wherein the memory stores computer instructions that can be executed on the processor, and the processor executes the steps of the above method when executing the computer instructions.
[0023] Compared with the prior art, the embodiments of the present disclosure have the following beneficial effects:
[0024] In the method of the embodiment of the present disclosure, a mobile terminal establishes a connection with a vehicle terminal, the mobile terminal extracts the service information in the mini program and then sends the service information to the vehicle terminal, the vehicle terminal obtains a processing command for the service information from the user, and processes the service information according to the processing command. Thus, the user can process the mini program information of the mobile terminal application through the vehicle terminal, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] Figure 1 is a flow chart of a method for a vehicle-mounted terminal to obtain service information of a mobile terminal applet in an embodiment of the present disclosure;
[0026] Figure 2 It is a flow chart of a method in which a vehicle-mounted terminal obtains mobile terminal mini-program business information in another disclosed embodiment. DETAILED DESCRIPTION
[0027] As described in the background technology, the interaction function between the car computer and the mobile phone still needs to be improved.
[0028] Specifically, in the car-mobile phone interconnection project, the car computer can obtain WeChat text messages, voice messages, geographic location messages and red envelope messages on the mobile phone, and the user can respond to these messages in a timely manner through voice input to the car computer.
[0029] However, some mini-program messages, such as WeChat mini-programs, are not open platform mini-programs, and key business information in the mini-programs cannot be directly obtained. These mini-programs require users to click to open them and read them, which is a relatively complicated operation. This makes it impossible for users to obtain such messages and process them in time while driving, resulting in a poor user experience.
[0030] In order to solve the above problems, the embodiments of the present disclosure provide a method, device, storage medium and terminal for an in-vehicle terminal to obtain the service information of a mobile terminal applet. The in-vehicle terminal establishes a connection with the mobile terminal. The mobile terminal extracts the service information in the applet and sends the service information to the in-vehicle terminal. The in-vehicle terminal obtains a processing command for the service information from the user and processes the service information according to the processing command. Thus, the user can process the information of the applet applied by the mobile terminal through the in-vehicle terminal, thereby improving the user experience.
[0031] In order to make the above-mentioned objects, features and beneficial effects of the present invention more obvious and easy to understand, specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.
[0032] Figure 1 It is a flow chart of a method for a vehicle-mounted terminal to obtain mobile terminal mini-program service information in an embodiment of the present disclosure.
[0033] Please refer to Figure 1 , the method for the vehicle-mounted terminal to obtain the mobile terminal applet service information includes:
[0034] S101: Establishing a connection with the vehicle terminal;
[0035] S102: extracting business information from the mini program;
[0036] S103: Sending business information to the vehicle terminal;
[0037] S104: Obtaining a user's processing command for the service information from the vehicle-mounted terminal, and processing the service information according to the processing command.
[0038] The mobile terminal establishes a connection with the vehicle terminal, and the mobile terminal extracts the business information in the mini program and sends the business information to the vehicle terminal. The vehicle terminal obtains a processing command for the business information from the user and processes the business information according to the processing command. Thus, the user can process the mini program information of the mobile terminal application through the vehicle terminal, thereby optimizing the user experience.
[0039] Next, each step will be described separately.
[0040] Execute step S101: establish a connection with the vehicle-mounted terminal.
[0041] The way of establishing connection between the mobile terminal and the vehicle-mounted terminal includes: wireless connection or wired connection.
[0042] The wireless connection method includes Bluetooth connection, WIFI connection or NFC connection. The wired connection method includes USB connection.
[0043] Execute step S102: extract business information in the mini program.
[0044] In this embodiment, the method for extracting business information from a mini program includes: monitoring reminder messages in a notification bar of a mobile terminal to determine whether the reminder message is a mini program message; in response to determining that the reminder message is a mini program message, jumping to an application page where the mini program message is located; simulating a click on the application page where the mini program message is located to open the mini program and display the mini program page; obtaining text information from the page; and extracting business information from the text information.
[0045] Before simulating a click on the application page where the mini-program message is located, the method also includes: enabling an accessibility service function, and simulating a click on the application page where the mini-program message is located through the accessibility service.
[0046] The method for obtaining text information of a mini-program page includes: taking a screenshot of the mini-program page to obtain screenshot information; and using optical character recognition technology to recognize text information in the screenshot information.
[0047] The method for obtaining business information in text information includes: matching and filtering the text information using keyword rules to obtain business information, for example, extracting information such as address, rating, store name, etc. in the text information.
[0048] In the scenario of this embodiment, the mini program is the mini program of Dianping.com, which is a non-open platform. The mobile terminal monitors various reminder messages in the notification bar and filters out the mini program messages of Dianping.com from the various reminder messages; then, the mobile terminal enters the application page where the Dianping.com mini program message is located, such as the WeChat page, from the Dianping.com mini program message in the notification bar, and then simulates a click on the application page to open the Dianping.com mini program and display the Dianping.com page; a screenshot of the Dianping.com page is taken, and then optical character recognition technology is used to identify the text information in the screenshot, such as the store name, price, rating, and specific geographical location of the store, and then the text information is output through voice or displayed on the in-vehicle terminal; finally, the user makes corresponding processing through one or more methods of voice interaction, screen interaction, and physical button interaction, such as replying to the message or navigating to the store.
[0049] In another embodiment, a method for extracting business information from a mini program includes: monitoring reminder messages in a notification bar of a mobile terminal to determine whether the reminder message is a mini program message; in response to confirming that the reminder message is a mini program message, obtaining preliminary information of the mini program through an accessibility service; based on the preliminary information of the mini program, searching on the platform where the mini program is located to obtain business information in the mini program.
[0050] At this time, the platform where the mini program is located is an open platform, and you can directly search on the platform where the mini program is located to obtain the business information in the mini program.
[0051] The method has only one network request step, so the search speed is fast and the business information in the mini program can be obtained quickly.
[0052] In another embodiment scenario, the mini program is the mini program of Tuniu Travel. At this time, the Tuniu Travel open platform, the mobile terminal listens to various reminder messages in the notification bar, and filters out the mini program messages of Tuniu Travel from the various reminder messages; obtains the product route name of Tuniu Travel through accessible services, and the product route name of Tuniu Travel is preliminary information at this time; then, according to the product route name, search in the Tuniu Travel platform to obtain business information, such as searching for multiple similar products, or the price, time, rating and other information of the product route; finally, the user makes corresponding processing through one or more methods of voice interaction, screen interaction and physical button interaction, such as replying to information or purchasing products.
[0053] Execute step S103: send business information to the vehicle terminal.
[0054] The mobile terminal sends the business information to the vehicle terminal so that the user can process the business information through the vehicle terminal, thereby optimizing the user experience.
[0055] Before executing step S104, the method further includes: presenting the service information on the vehicle-mounted terminal.
[0056] The manner of presenting the service information on the vehicle-mounted terminal includes: displaying the service information on a display screen of the vehicle-mounted terminal, or outputting the service information through voice.
[0057] Execute step S104: obtain a user's processing command for the service information from the vehicle-mounted terminal, and process the service information according to the processing command.
[0058] The method for the vehicle terminal to obtain the user's processing command for the business information includes: obtaining the user's processing command for the business information through one or more of voice interaction, screen interaction and physical button interaction. That is, the user can input the user's processing command for the business information by inputting a voice command, performing a touch operation on the vehicle display screen or operating a physical button on the vehicle computer. For example, replying to a message, purchasing a product or navigating to a destination, etc.
[0059] Figure 2 It is a flow chart of a method in which a vehicle-mounted terminal obtains mobile terminal mini-program business information in another disclosed embodiment.
[0060] Please refer to Figure 2, the method for the vehicle-mounted terminal to obtain the mobile terminal applet service information includes:
[0061] S201: Establishing a connection with a mobile terminal;
[0062] S202: Obtaining business information in the mini program from the mobile terminal;
[0063] S203: Obtain a processing command from a user for the service information, and process the service information according to the processing command.
[0064] Next, each step will be described separately.
[0065] Execute step S201: establish a connection with a mobile terminal.
[0066] The way to establish connection between the vehicle-mounted terminal and the mobile terminal includes: wireless connection or wired connection.
[0067] The wireless connection method includes Bluetooth connection, WIFI connection or NFC connection. The wired connection method includes USB connection.
[0068] Execute step S202: obtain business information in the mini program from the mobile terminal.
[0069] In this embodiment, the method for a mobile terminal to extract business information from a mini program includes: monitoring the reminder message in the notification bar of the mobile terminal to determine whether the reminder message is a mini program message; in response to determining that the reminder message is a mini program message, jumping to the application page where the mini program message is located; simulating a click on the application page where the mini program message is located to open the mini program and display the mini program page; obtaining text information on the page; and extracting business information from the text information.
[0070] Before the mobile terminal simulates clicking on the application page where the mini-program message is located, the method further includes: enabling an accessibility service function and simulating clicking on the application page where the mini-program message is located through the accessibility service.
[0071] The method for a mobile terminal to obtain text information of a mini-program page includes: taking a screenshot of the mini-program page to obtain screenshot information; and using optical character recognition technology to recognize text information in the screenshot information.
[0072] The method for a mobile terminal to obtain business information in text information includes: using keyword rules to match and filter the text information to obtain business information, for example, extracting information such as address, rating, store name, etc. from the text information.
[0073] In this embodiment, the method for extracting business information from a mini program includes: monitoring a reminder message in a notification bar of a mobile terminal, determining whether the reminder message is a mini program message; matching and filtering in response to confirming the reminder message, and obtaining business information. For example, extracting information such as an address, rating, and store name from text information.
[0074] In the scenario of this embodiment, the mini program is the mini program of Dianping.com, which is a non-open platform. The mobile terminal monitors various reminder messages in the notification bar and filters out the mini program messages of Dianping.com from the various reminder messages; then, the mobile terminal enters the application page where the Dianping.com mini program message is located, such as the WeChat page, from the Dianping.com mini program message in the notification bar, and then simulates a click on the application page to open the Dianping.com mini program and display the Dianping.com page; a screenshot of the Dianping.com page is taken, and then optical character recognition technology is used to identify the text information in the screenshot, such as the store name, price, rating, and specific geographical location of the store, and then the text information is output through voice or displayed on the in-vehicle terminal; finally, the user makes corresponding processing through one or more methods of voice interaction, screen interaction, and physical button interaction, such as replying to the message or navigating to the store.
[0075] In another embodiment, a method for a mobile terminal to extract business information from a mini program includes: monitoring reminder messages in a notification bar of the mobile terminal to determine whether the reminder message is a mini program message; in response to confirming that the reminder message is a mini program message, obtaining preliminary information of the mini program through an accessibility service; based on the preliminary information of the mini program, searching on the platform where the mini program is located to obtain business information in the mini program.
[0076] The method has only one network request step, so the search speed is fast and the business information in the mini program can be obtained quickly.
[0077] In another embodiment scenario, the mini program is the mini program of Tuniu Travel. At this time, the Tuniu Travel open platform, the mobile terminal listens to various reminder messages in the notification bar, and filters out the mini program messages of Tuniu Travel from the various reminder messages; obtains the product route name of Tuniu Travel through accessible services, and the product route name of Tuniu Travel is preliminary information at this time; then, according to the product route name, search in the Tuniu Travel platform to obtain business information, such as searching for multiple similar products, or the price, time, rating and other information of the product route; finally, the user makes corresponding processing through one or more methods of voice interaction, screen interaction and physical button interaction, such as replying to information or purchasing products.
[0078] Before executing step S203, the method further includes: presenting the service information. The method of presenting the service information includes: displaying the service information on a display screen of a vehicle-mounted terminal, or outputting the service information through voice.
[0079] Execute step S203: obtain a user's processing command for the service information, and process the service information according to the processing command.
[0080] The method for obtaining the user's processing command for the business information includes: obtaining the user's processing command for the business information through one or more of voice interaction, screen interaction and physical button interaction. That is, the user can input the user's processing command for the business information by inputting a voice command, performing a touch operation on the vehicle display screen or operating a physical button on the vehicle computer. For example, replying to a message, purchasing a product or navigating to a destination, etc.
[0081] Accordingly, the present disclosure also provides a storage medium on which a computer instruction is stored, wherein the computer instruction is executed when it is executed. Figure 1 The steps of the method.
[0082] Accordingly, the present disclosure also provides a storage medium on which a computer instruction is stored, wherein the computer instruction is executed when it is executed. Figure 2 The steps of the method.
[0083] Accordingly, an embodiment of the present disclosure further provides a terminal, including a memory and a processor, wherein the memory stores computer instructions that can be executed on the processor, and wherein when the processor executes the computer instructions, Figure 1 The steps of the method.
[0084] Accordingly, an embodiment of the present disclosure further provides a terminal, including a memory and a processor, wherein the memory stores computer instructions that can be executed on the processor, and wherein when the processor executes the computer instructions, Figure 2 The steps of the method.
[0085] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the scope defined by the claims.
Claims
1. A method for a vehicle-mounted terminal to obtain mobile terminal applet service information, characterized in that: include: Establish a connection with the vehicle terminal; Extract business information from the mini program; Send business information to the vehicle terminal; Obtaining a user's processing command for the service information from the vehicle-mounted terminal, and processing the service information according to the processing command; Methods for extracting business information from a mini program include: Monitor the reminder message in the notification bar of the mobile terminal, and determine whether the reminder message is a mini program message; In response to determining that the reminder message is a mini-program message, jump to the application page where the mini-program message is located; simulate a click on the application page where the mini-program message is located, open the mini-program, and display the mini-program page; obtain text information of the page; and extract business information from the text information.
2. The method for obtaining mobile terminal mini program service information by a vehicle terminal according to claim 1, before simulating a click on the application page where the mini program message is located, further comprising: Enable the accessibility service function and use the accessibility service to simulate a click on the application page where the mini program message is located.
3. The method for obtaining mobile terminal mini program service information by the vehicle terminal according to claim 1, wherein the method for obtaining text information of the mini program page comprises: Taking a screenshot of the mini program page to obtain screenshot information; Optical character recognition technology is used to recognize text information in the screenshot information.
4. The method for obtaining mobile terminal applet service information by a vehicle-mounted terminal according to claim 1, wherein the method for obtaining service information in text information comprises: The text information is matched and filtered using keyword rules to obtain business information.
5. The method for obtaining mobile terminal mini-program service information by a vehicle terminal according to claim 1, before obtaining a user's processing command for the service information from the vehicle terminal and processing the service information according to the processing command, further comprising: The business information is presented on the vehicle-mounted terminal.
6. The method for obtaining mobile terminal applet service information by a vehicle terminal according to claim 1, wherein the method for establishing a connection with the vehicle terminal comprises: Wireless or wired connection.
7. The method for obtaining mobile terminal mini-program service information by a vehicle-mounted terminal according to claim 1, wherein the method for extracting service information from the mini-program comprises: Monitor the reminder message in the notification bar of the mobile terminal, and determine whether the reminder message is a mini program message; In response to confirming that the reminder message is a mini-program message, preliminary information of the mini-program is obtained through an accessibility service; based on the preliminary information of the mini-program, a search is performed on the platform where the mini-program is located to obtain business information in the mini-program.
8. A method for a vehicle-mounted terminal to obtain service information of a mobile terminal applet, characterized in that: include: Establishing a connection with a mobile terminal; Obtain business information in the mini program from the mobile terminal; Obtaining a user's processing command for the business information, and processing the business information according to the processing command; Methods for extracting business information from a mini program include: Monitor the reminder message in the notification bar of the mobile terminal, and determine whether the reminder message is a mini program message; In response to determining that the reminder message is a mini-program message, jump to the application page where the mini-program message is located; simulate a click on the application page where the mini-program message is located, open the mini-program, and display the mini-program page; obtain text information of the page; and extract business information from the text information.
9. The method for obtaining mobile terminal mini-program service information by a vehicle-mounted terminal according to claim 8, wherein the service information in the mini-program includes: The text information of the applet page is recognized by optical character recognition technology.
10. The method for obtaining mobile terminal applet service information by a vehicle terminal according to claim 8, wherein the method for obtaining a user's processing command for the service information comprises: The user's processing command for the business information is obtained through one or more of voice interaction, screen interaction and physical button interaction.
11. The method for obtaining mobile terminal applet service information by a vehicle terminal according to claim 8, before obtaining a user's processing command for the service information and processing the service information according to the processing command, further comprising: The business information is presented.
12. The method for obtaining mobile terminal applet service information by a vehicle terminal according to claim 8, wherein the method for establishing a connection with the mobile terminal comprises: Wireless or wired connection.
13. A storage medium having computer instructions stored thereon, characterized in that: When the computer instructions are executed, the processor is caused to execute the steps of the method according to any one of claims 1 to 7.
14. A storage medium having computer instructions stored thereon, characterized in that: When the computer instructions are executed, the processor is caused to execute the steps of the method according to any one of claims 8 to 12.
15. A terminal comprising a memory and a processor, wherein the memory stores computer instructions that can be executed on the processor, characterized in that: When the processor executes the computer instructions, the steps of the method according to any one of claims 1 to 7 are performed.
16. A terminal comprising a memory and a processor, wherein the memory stores computer instructions that can be executed on the processor, characterized in that: When the processor executes the computer instructions, the steps of the method according to any one of claims 8 to 12 are performed.
Citation Information
Patent Citations
Control method and control system for vehicle-mounted air conditioner, mobile terminal and storage medium
CN107608602A
User service recommendation method, user service recommendation device, vehicle and storage medium
CN112365312A