Method and device for acquiring applet information by vehicle-mounted terminal, storage medium and terminal

Abstract

The invention discloses a method and device for a vehicle-mounted terminal to obtain mobile terminal applet service information, a storage medium and a terminal. The method comprises the steps that connection with the vehicle-mounted terminal is established; extracting service information in the applet; sending the service information to the vehicle-mounted terminal; and obtaining a processing command of a user on the service information from the vehicle-mounted terminal, and processing the service information according to the processing command. Therefore, the user can process the applet information of the mobile terminal application through the vehicle-mounted terminal, and the user experience can be improved.

Description

Technical Field

[0001] The present invention relates to the field of automotive intelligent technologies, and particularly to a method, device, storage medium, and terminal for a vehicle-mounted terminal to obtain mobile terminal applet service information. Background Art

[0002] With the improvement of people's living standards, cars have gradually become one of the main means of transportation for people's daily travel. As the user's driving time increases, modern cars need to provide more and more value-added services in addition to meeting the user's driving needs to meet the diverse needs of different users. For example, the connection between a car head unit and a smart phone has become an essential function of the head unit, and this function has become increasingly important.

[0003] Nowadays, mobile phones have long become people's personal assistants. With the development of the functions of car head units, car head units often need to obtain users' personal information, application preferences, etc. through mobile phones, and the interaction functions between car head units and mobile phones are also becoming more and more abundant.

[0004] However, the interaction functions between current car head units and mobile phones still need to be improved. Summary of the Invention

[0005] The technical problem solved by the embodiments of the present disclosure is to provide a method, device, storage medium, and terminal for a vehicle-mounted terminal to obtain mobile terminal applet service information to improve the interaction function between a car head unit and a mobile phone.

[0006] To solve the above technical problem, an embodiment of the present disclosure provides a method for a vehicle-mounted terminal to obtain mobile terminal applet service information, including: establishing a connection with the vehicle-mounted terminal; extracting service information in the applet; sending the service information to the vehicle-mounted terminal; obtaining a processing command of the user for the service information from the vehicle-mounted terminal, and processing the service information according to the processing command.

[0007] Optionally, the method for extracting service information in the applet includes: listening for reminder messages in the mobile terminal notification bar, and determining whether the reminder message is an applet message; in response to determining that the reminder message is an applet message, jumping to the application page where the applet message is located; performing a simulated click on the application page where the applet message is located to open the applet and display the page of the applet; obtaining the text information of the page; extracting the service information from the text information.

[0008] Optionally, before performing the simulated click on the application page where the applet message is located, it further includes: enabling the accessibility service function, and performing a simulated click on the application page where the applet message is located through the accessibility service.

[0009] Optionally, the method for obtaining the text information of the applet page includes: taking a screenshot of the applet page to obtain screenshot information; using optical character recognition technology to recognize the text information in the screenshot information.

[0010] Optionally, the method for obtaining the service information in the text information includes: matching and filtering the text information using keyword rules to obtain the service information.

[0011] Optionally, before obtaining the processing command of the user for the service information from the in-vehicle terminal and processing the service information according to the processing command, it further includes: presenting the service information on the in-vehicle terminal.

[0012] Optionally, the ways to establish a connection with the in-vehicle terminal include: wireless connection or wired connection.

[0013] Optionally, the method for extracting the service information in the applet includes: listening to the reminder message in the notification bar of the mobile terminal to determine whether the reminder message is an applet message; in response to confirming that the reminder message is an applet message, obtaining the preliminary information of the applet through the accessibility service; searching on the platform where the applet is located according to the preliminary information of the applet to obtain the service information in the applet.

[0014] Correspondingly, an embodiment of the present disclosure further provides a storage medium, on which computer instructions are stored, and when the computer instructions run, they execute the steps of the above method.

[0015] Correspondingly, an embodiment of the present disclosure further provides a terminal, including a memory and a processor, where computer instructions capable of running on the processor are stored on the memory, and when the processor runs the computer instructions, it executes the steps of the above method.

[0016] To solve the above technical problems, an embodiment of the present disclosure further provides a method for an in-vehicle terminal to obtain the service information of the mobile terminal applet, including: establishing a connection with the mobile terminal; obtaining the service information in the applet from the mobile terminal; obtaining the processing command of the user for the service information, and processing the service information according to the processing command.

[0017] Optionally, the service information in the applet includes: the text information of the applet page recognized by optical character recognition technology.

[0018] Optionally, the method for obtaining the processing command of the user for the service information includes: obtaining the processing command of the user for the service information through one or more of voice interaction, screen interaction, and physical button interaction.

[0019] Optionally, before obtaining a processing command of the user for the service information and processing the service information according to the processing command, the method further includes: presenting the service information.

[0020] Optionally, the way to establish a connection with the mobile terminal includes: wireless connection or wired connection.

[0021] Correspondingly, an embodiment of the present disclosure further provides a storage medium, on which computer instructions are stored, and when the computer instructions run, they execute the steps of the above method.

[0022] Correspondingly, an embodiment of the present disclosure further provides a terminal, including a memory and a processor. A computer instruction capable of running on the processor is stored on the memory, and when the processor runs the computer instruction, it executes the steps of the above method.

[0023] Compared with the prior art, the embodiments of the present disclosure have the following beneficial effects:

[0024] In the method of the embodiment of the present disclosure, the mobile terminal establishes a connection with the vehicle-mounted terminal. After the mobile terminal extracts the service information in the applet, it sends the service information to the vehicle-mounted terminal. The vehicle-mounted terminal obtains a processing command of the user for the service information from the user, and processes the service information according to the processing command. Thus, the user can process the applet information of the mobile terminal application through the in-vehicle terminal, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 is a flowchart of a method for a vehicle-mounted terminal to obtain service information of a mobile terminal applet in an embodiment of the present disclosure;

[0026] Figure 2 is a flowchart of a method for a vehicle-mounted terminal to obtain service information of a mobile terminal applet in another embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] As described in the background art, the interaction function between the in-vehicle computer and the mobile phone still needs to be improved.

[0028] Specifically, in the in-vehicle computer and mobile phone interconnection project, the in-vehicle computer can obtain WeChat text messages, voice messages, location messages, and red envelope messages on the mobile phone, and the user can make corresponding timely processing of these messages through voice input to the in-vehicle computer.

[0029] However, for some applet messages, such as WeChat applets, these applets are non-open platform applets, and the key service information in the applets cannot be directly obtained. These applets need to be clicked and opened by the user for reading, and the operation is relatively complex. This makes it impossible for the user to obtain such messages and make corresponding processing in a timely manner during driving, resulting in a poor user experience.

[0030] To solve the above problems, embodiments of the present disclosure provide a method, apparatus, storage medium, and terminal for a vehicle-mounted terminal to obtain service information of a mobile terminal mini-program. The vehicle-mounted terminal establishes a connection with the mobile terminal. After the mobile terminal extracts the service information in the mini-program, it sends the service information to the vehicle-mounted terminal. The vehicle-mounted terminal obtains a processing command for the service information from the user and processes the service information according to the processing command. Thus, the user can process the mini-program information of the mobile terminal application through the in-vehicle device, thereby improving the user experience.

[0031] To make the above objects, features, and beneficial effects of the present invention more obvious and understandable, the following describes the specific embodiments of the present invention in detail with reference to the accompanying drawings.

[0032] Figure 1 It is a flowchart of a method for a vehicle-mounted terminal to obtain service information of a mobile terminal mini-program in an embodiment of the present disclosure.

[0033] Please refer to Figure 1 , the method for the vehicle-mounted terminal to obtain service information of the mobile terminal mini-program includes:

[0034] S101: Establish a connection with the vehicle-mounted terminal;

[0035] S102: Extract the service information in the mini-program;

[0036] S103: Send the service information to the vehicle-mounted terminal;

[0037] S104: Obtain a processing command for the service information from the vehicle-mounted terminal and process the service information according to the processing command.

[0038] The mobile terminal establishes a connection with the vehicle-mounted terminal. After the mobile terminal extracts the service information in the mini-program, it sends the service information to the vehicle-mounted terminal. The vehicle-mounted terminal obtains a processing command for the service information from the user and processes the service information according to the processing command. Thus, the user can process the mini-program information of the mobile terminal application through the in-vehicle device, thereby optimizing the user experience.

[0039] Next, each step will be described separately.

[0040] Execute step S101: Establish a connection with the vehicle-mounted terminal.

[0041] The ways for the mobile terminal to establish a connection with the vehicle-mounted terminal include: wireless connection or wired connection.

[0042] The wireless connection ways include Bluetooth connection, WIFI connection, or NFC connection. The wired connection way includes USB connection.

[0043] Execute step S102: Extract the business information in the applet.

[0044] In this embodiment, the method for extracting the business information in the applet includes: listening to the reminder messages in the notification bar of the mobile terminal, and determining whether the reminder message is an applet message; in response to determining that the reminder message is an applet message, jumping to the application page where the applet message is located; performing a simulated click on the application page where the applet message is located to open the applet and display the page of the applet; obtaining the text information of the page; and extracting the business information from the text information.

[0045] Before performing the simulated click on the application page where the applet message is located, it further includes: enabling the accessibility service function, and performing the simulated click on the application page where the applet message is located through the accessibility service.

[0046] The method for obtaining the text information of the applet page includes: taking a screenshot of the applet page to obtain screenshot information; and using optical character recognition technology to recognize the text information in the screenshot information.

[0047] The method for extracting the business information from the text information includes: matching and filtering the text information using keyword rules to obtain the business information. For example, extracting information such as the address, rating, and store name from the text information.

[0048] In the scenario of this embodiment, the applet is the applet of Dianping.com. Dianping.com is a non-open platform. The mobile terminal listens to various reminder messages in the notification bar and filters out the applet messages of Dianping.com from the various reminder messages; then enters the application page where the Dianping.com applet message is located from the Dianping.com applet message in the notification bar, such as the WeChat page, and then simulates a click on the application page to open the Dianping.com applet and display the page of Dianping.com; takes a screenshot of the Dianping.com page, and then uses optical character recognition technology to recognize the text information in the screenshot, such as the store name, price, rating, and specific geographical location of the store, etc., and then outputs the text information through voice or displays it on the in-vehicle terminal; finally, the user makes corresponding processing through one or more of voice interaction, screen interaction, and physical button interaction, such as replying to information or navigating to the store, etc.

[0049] In another embodiment, the method for extracting the business information in the applet includes: listening to the reminder messages in the notification bar of the mobile terminal, and determining whether the reminder message is an applet message; in response to confirming that the reminder message is an applet message, obtaining the preliminary information of the applet through the accessibility service; and searching on the platform where the applet is located according to the preliminary information of the applet to obtain the business information in the applet.

[0050] At this time, the platform where the mini-program is located is an open platform, and it is possible to directly search on the platform where the mini-program is located to obtain the business information in the mini-program.

[0051] The method only involves one network request, so the search speed is relatively fast, and the business information in the mini-program can be obtained quickly.

[0052] In the scenario of another embodiment, the mini-program is a mini-program of Tuniu Tourism. At this time, on the Tuniu Tourism open platform, the mobile terminal monitors various reminder messages in the notification bar and filters out the mini-program messages of Tuniu Tourism from the various reminder messages; obtains the product route name of Tuniu Tourism through the accessibility service. At this time, the product route name of Tuniu Tourism is preliminary information; then, according to the product route name, search on the platform of Tuniu Tourism to obtain business information, such as searching for multiple similar products, or information such as the price, time, and rating of the product route; finally, the user makes corresponding processing through one or more of voice interaction, screen interaction, and physical button interaction, such as replying to information or purchasing products, etc.

[0053] Execute step S103: Send the business information to the in-vehicle terminal.

[0054] The mobile terminal sends the business information to the in-vehicle terminal so that the user can process the business information through the in-vehicle terminal, thereby optimizing the user experience.

[0055] Before executing step S104, it further includes: presenting the business information on the in-vehicle terminal.

[0056] The ways to present the business information on the in-vehicle terminal include: displaying the business information on the in-vehicle terminal display screen, or outputting the business information through voice.

[0057] Execute step S104: Obtain the processing command of the user for the business information from the in-vehicle terminal, and process the business information according to the processing command.

[0058] The methods for the in-vehicle terminal to obtain the processing command of the user for the business information include: obtaining the processing command of the user for the business information through one or more of voice interaction, screen interaction, and physical button interaction. That is, the user can input the processing command of the user for the business information in the way of inputting a voice command, performing a touch operation on the in-vehicle display screen, or operating the physical buttons on the car machine. For example, replying to information, purchasing products, or navigating to a destination, etc.

[0059] Figure 2 It is a flowchart of the method for the in-vehicle terminal to obtain the mini-program business information of the mobile terminal in another publicly disclosed embodiment.

[0060] Please refer to Figure 2, the method for the vehicle-mounted terminal to obtain the mobile terminal applet service information includes:

[0061] S201: Establish a connection with the mobile terminal;

[0062] S202: Obtain the service information in the applet from the mobile terminal;

[0063] S203: Obtain the processing command of the user for the service information, and process the service information according to the processing command.

[0064] Next, each step will be described separately.

[0065] Execute step S201: Establish a connection with the mobile terminal.

[0066] The ways for the vehicle-mounted terminal to establish a connection with the mobile terminal include: wireless connection or wired connection.

[0067] The wireless connection ways include Bluetooth connection, WIFI connection or NFC connection. The wired connection way includes USB connection.

[0068] Execute step S202: Obtain the service information in the applet from the mobile terminal.

[0069] In this embodiment, the method for the mobile terminal to extract the service information in the applet includes: listening to the reminder message in the mobile terminal notification bar, and judging whether the reminder message is an applet message; in response to determining that the reminder message is an applet message, jump to the application page where the applet message is located; perform a simulated click on the application page where the applet message is located to open the applet and display the page of the applet; obtain the text information of the page; extract the service information from the text information.

[0070] Before the mobile terminal performs a simulated click on the application page where the applet message is located, it further includes: enabling the accessibility service function, and performing a simulated click on the application page where the applet message is located through the accessibility service.

[0071] The method for the mobile terminal to obtain the text information of the applet page includes: taking a screenshot of the applet page to obtain screenshot information; using optical character recognition technology to recognize the text information in the screenshot information.

[0072] The method for the mobile terminal to obtain the service information from the text information includes: matching and filtering the text information by using keyword rules to obtain the service information. For example, extracting information such as address, score, store name, etc. from the text information.

[0073] In this embodiment, the method for extracting business information from a mini-program includes: listening for reminder messages in the notification bar of the mobile terminal, and determining whether the reminder message is a mini-program message; in response to confirming the reminder message, performing matching and filtering to obtain business information. For example, extracting information such as addresses, ratings, and store names from text information.

[0074] In the scenario of this embodiment, the mini-program is a mini-program of Dianping.com. Dianping.com is a non-open platform. The mobile terminal listens for various reminder messages in the notification bar and filters out the mini-program messages of Dianping.com from the various reminder messages; then enters from the Dianping.com mini-program message in the notification bar into the application page where the Dianping.com mini-program message is located, such as the WeChat page, and then simulates a click to open the Dianping.com mini-program on the application page to display the Dianping.com page; takes a screenshot of the Dianping.com page, and then uses optical character recognition technology to recognize the text information in the screenshot, such as the store name, price, rating, and specific geographical location of the store, etc., and then outputs the text information by voice or displays it on the in-vehicle terminal; finally, the user makes corresponding processing through one or more of voice interaction, screen interaction, and physical button interaction, such as replying to information or navigating to the store, etc.

[0075] In another embodiment, the method for the mobile terminal to extract business information from a mini-program includes: listening for reminder messages in the notification bar of the mobile terminal, and determining whether the reminder message is a mini-program message; in response to confirming that the reminder message is a mini-program message, obtaining preliminary information of the mini-program through an accessibility service; according to the preliminary information of the mini-program, searching on the platform where the mini-program is located to obtain the business information in the mini-program.

[0076] The method only has one network request, so the search speed is relatively fast, and the business information in the mini-program can be obtained quickly.

[0077] In the scenario of another embodiment, the mini-program is a mini-program of Tuniu Tourism. At this time, Tuniu Tourism is an open platform. The mobile terminal listens for various reminder messages in the notification bar and filters out the mini-program messages of Tuniu Tourism from the various reminder messages; obtains the product route name of Tuniu Tourism through an accessibility service. At this time, the product route name of Tuniu Tourism is the preliminary information; then according to the product route name, searches on the platform of Tuniu Tourism to obtain business information, such as searching for multiple similar products, or information such as the price, time, and rating of the product route; finally, the user makes corresponding processing through one or more of voice interaction, screen interaction, and physical button interaction, such as replying to information or purchasing products, etc.

[0078] Before performing step S203, it further includes: presenting the service information. The ways of presenting the service information include: displaying the service information on the in-vehicle terminal display screen, or outputting the service information by voice.

[0079] Perform step S203: Obtain a processing command of the user for the service information, and process the service information according to the processing command.

[0080] The method for obtaining a processing command of the user for the service information includes: obtaining a processing command of the user for the service information through one or more of voice interaction, screen interaction, and physical button interaction. That is, the user can input a voice command, perform a touch operation on the in-vehicle display screen, or operate the physical buttons on the vehicle computer to input a processing command of the user for the service information. For example, reply to information, purchase a product, or navigate to a destination, etc.

[0081] Correspondingly, an embodiment of the present disclosure further provides a storage medium, on which computer instructions are stored, characterized in that when the computer instructions run, they execute Figure 1 the steps of the method.

[0082] Correspondingly, an embodiment of the present disclosure further provides a storage medium, on which computer instructions are stored, characterized in that when the computer instructions run, they execute Figure 2 the steps of the method.

[0083] Correspondingly, an embodiment of the present disclosure further provides a terminal, including a memory and a processor, where computer instructions capable of running on the processor are stored on the memory, characterized in that when the processor runs the computer instructions, it executes Figure 1 the steps of the method.

[0084] Correspondingly, an embodiment of the present disclosure further provides a terminal, including a memory and a processor, where computer instructions capable of running on the processor are stored on the memory, characterized in that when the processor runs the computer instructions, it executes Figure 2 the steps of the method.

[0085] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention should be subject to the scope defined by the claims.

Claims

1. A method for a vehicle-mounted terminal to obtain mobile terminal applet service information, characterized in that: It includes: Establish a connection with the vehicle-mounted terminal; Extract the service information in the applet; the platform where the applet is located is an open platform or a non-open platform; send the service information to the vehicle-mounted terminal; Obtain the processing command of the user for the service information from the vehicle-mounted terminal, and process the service information according to the processing command.

2. The method for a vehicle-mounted terminal to obtain mobile terminal applet service information according to claim 1, wherein the method for extracting the service information in the applet includes: Monitor the reminder message in the mobile terminal notification bar, and judge whether the reminder message is an applet message; In response to determining that the reminder message is an applet message and the platform where the applet is located is a non-open platform, jump to the application page where the applet message is located; perform a simulated click on the application page where the applet message is located, open the applet, display the page of the applet; obtain the text information of the page; extract the service information from the text information.

3. The method for a vehicle-mounted terminal to obtain mobile terminal applet service information according to claim 1, before obtaining the processing command of the user for the service information from the vehicle-mounted terminal and processing the service information according to the processing command, further includes: Present the service information on the vehicle-mounted terminal.

4. The method for a vehicle-mounted terminal to obtain mobile terminal applet service information according to claim 1, wherein the method for extracting the service information in the applet includes: If the platform where the applet is located is an open platform, directly search on the platform where the applet is located to obtain the service information in the applet.

5. The method for a vehicle-mounted terminal to obtain mobile terminal applet service information according to claim 4, wherein the method for extracting the service information in the applet includes: Monitor the reminder message in the mobile terminal notification bar, and judge whether the reminder message is an applet message; In response to confirming that the reminder message is an applet message and the platform where the applet is located is an open platform, obtain the preliminary information of the applet through an accessibility service; search on the platform where the applet is located according to the preliminary information of the applet to obtain the service information in the applet.

6. A method for a vehicle-mounted terminal to obtain mobile terminal applet service information, characterized in that: It includes: Establish a connection with the mobile terminal; Obtain the service information in the applet from the mobile terminal; the platform where the applet is located is an open platform or a non-open platform; Obtain the processing command of the user for the service information, and process the service information according to the processing command.

7. The method for a vehicle-mounted terminal to obtain mobile terminal applet service information according to claim 6, wherein the method for obtaining the processing command of the user for the service information includes: Obtain the processing command of the user for the service information through one or more of voice interaction, screen interaction, and physical button interaction.

8. The method for a vehicle-mounted terminal to obtain mobile terminal applet service information according to claim 6, before obtaining the processing command of the user for the service information and processing the service information according to the processing command, further includes: Present the service information.

9. A storage medium having computer instructions stored thereon, characterized in that, when the computer instructions run, they execute the steps of the method according to any one of claims 1 to 5.

10. A storage medium having computer instructions stored thereon, characterized in that, when the computer instructions run, they execute the steps of the method according to any one of claims 6 to 8.

11. A terminal, comprising a memory and a processor, wherein the memory has computer instructions stored thereon that can run on the processor, characterized in that, when the processor runs the computer instructions, it executes the steps of the method according to any one of claims 1 to 5.

12. A terminal, comprising a memory and a processor, wherein the memory has computer instructions stored thereon that can run on the processor, characterized in that, when the processor runs the computer instructions, it executes the steps of the method according to any one of claims 6 to 8.

Images