Information processing method and device of vehicle-mounted system, computer equipment and program product

Abstract

The invention relates to the technical field of data processing, and discloses an information processing method and device of a vehicle-mounted system, computer equipment and a program product, the method comprises the following steps: detecting an information request instruction of a target object, the information request instruction being an instruction sent by a user based on media content of the vehicle-mounted system; obtaining object information of the target object; and based on a pre-configured health database, filtering the object information, and generating a target material list of the target object. Therefore, the problem that information related to media content is inconvenient to operate, record or search when a user uses a vehicle-mounted system is effectively avoided, the information request instruction of the user is timely and accurately responded, the obtained object information is filtered according to the pre-configured health database, and the user experience is improved. The target material list of the target object conforming to user expectation is obtained, and the user experience is remarkably improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, and in particular to an information processing method and device of a vehicle-mounted system, a computer device and a program product. BACKGROUND

[0002] With the increasing maturity of intelligent cockpit and other technologies, the intelligent degree of vehicles is continuously improved, and more and more users listen to or watch media content through vehicle-mounted media devices, for example, food programs with a relatively high degree of association with daily life. There is a huge connection value between content consumption in a vehicle-mounted scenario and actual life needs. In particular, in terms of healthy diet and efficient shopping, consumers are increasingly hoping to obtain actual action guidance from the content they watch or listen to. However, in the intelligent cockpit provided by the related technology, a user cannot timely and accurately remember all the ingredients and other information when seeing content such as dishes of interest in the cockpit media content. SUMMARY

[0003] Therefore, the present application provides an information processing method and device of a vehicle-mounted system, a computer device and a program product to solve or at least partially solve the above technical problems.

[0004] In a first aspect, the present application provides an information processing method of a vehicle-mounted system, which comprises:

[0005] detecting an information request instruction of a target object, the information request instruction being an instruction issued by a user based on media content of the vehicle-mounted system;

[0006] obtaining object information of the target object;

[0007] filtering the object information based on a pre-configured health database to generate a target material list of the target object.

[0008] The information processing method of the vehicle-mounted system of the present application, when detecting the information request instruction of the target object issued by the user based on the media content of the vehicle-mounted system, obtains the object information of the target object in a timely manner, and filters the object information based on the pre-configured health database to generate the target material list of the target object. Thus, the problem that the user cannot conveniently operate, record or find information related to the media content when using the vehicle-mounted system is effectively avoided, the information request instruction of the user is timely and accurately responded to, and the object information obtained is filtered according to the pre-configured health database to obtain the target material list of the target object that meets the user's expectation, thereby significantly improving the user experience.

[0009] In some optional embodiments, after generating the material list of the target object, the method further comprises:

[0010] obtaining user behavior planning information and location information, wherein the user behavior planning information comprises a planned time for the user to handle a set event;

[0011] generating user behavior guidance information based on the user behavior planning information and the location information, wherein the user behavior guidance information comprises path planning information of materials included in a bill of materials and time reminder information.

[0012] In some optional embodiments, after generating the user behavior guidance information based on the user behavior planning information and the location information, the method further comprises:

[0013] issuing a user behavior guidance reminder when it is determined that the current location information of the vehicle-mounted system and the location in the user behavior guidance information meet a set location reminder rule, the user behavior guidance reminder being used to represent reminding the user to perform a corresponding behavior.

[0014] In some optional embodiments, after generating the user behavior guidance information based on the user behavior planning information and the location information, the method further comprises:

[0015] issuing a user behavior guidance reminder when it is determined that the current time and the location in the user behavior guidance information meet a set time reminder rule, the user behavior guidance reminder being used to represent reminding the user to perform a corresponding behavior at a set time.

[0016] In some optional embodiments, the information request instruction of the target object comprises at least one of:

[0017] recognizing a voice instruction as the information request instruction of the target object included in the media content sent by the user terminal;

[0018] receiving the intention information of the target object included in the media content sent by the user terminal, issuing confirmation information in response to the intention information, and receiving the information request instruction sent by the user terminal based on the confirmation information.

[0019] In some optional embodiments, the health database comprises at least one of:

[0020] setting historical data of the application, the historical data representing a selection plan of the user for a plurality of materials;

[0021] a pre-configured material database, the material database representing health index information of a plurality of materials;

[0022] a pre-configured recipe library, the recipe library representing a bill of materials corresponding to a plurality of dishes, the bill of materials including a plurality of materials required for making a corresponding dish and alternative materials;

[0023] The pre-configured nutrition database represents material information corresponding to a plurality of nutritional components.

[0024] In some optional embodiments, the object information is filtered based on the pre-configured health database to generate a target bill of materials of the target object, including:

[0025] The object information is filtered based on the pre-configured health database to generate a target bill of materials of the target object.

[0026] In a second aspect, the present application provides an information processing device of a vehicle-mounted system, the device comprising:

[0027] The detection module is configured to detect an information request instruction of a target object, the information request instruction being an instruction issued by a user based on media content of the vehicle-mounted system;

[0028] The acquisition module is configured to acquire object information of the target object;

[0029] The generation module is configured to filter the object information based on a pre-configured health database to generate a target bill of materials of the target object.

[0030] In a third aspect, the present application provides a computer device, comprising:

[0031] The memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the computer instructions to perform the information processing method of the vehicle-mounted system according to the first aspect or any one of the corresponding embodiments thereof.

[0032] In a fourth aspect, the present application provides a computer program product comprising computer instructions for causing a computer to perform the information processing method of the vehicle-mounted system according to the first aspect or any one of the corresponding embodiments thereof. BRIEF DESCRIPTION OF DRAWINGS

[0033] In order to more clearly illustrate the specific embodiments of the present application or the technical solutions in the prior art, the following will briefly introduce the drawings needed to be used in the specific embodiments or prior art description. Obviously, the drawings described below are some embodiments of the present application, and those skilled in the art can obtain other drawings according to these drawings without creative labor.

[0034] Figure 1 is an application scenario diagram of the information processing method of the vehicle-mounted system provided by the embodiments of the present application;

[0035] Figure 2 is a flowchart of the information processing method of the vehicle-mounted system according to the embodiments of the present application;

[0036] Figure 3 A display interface schematic diagram of the vehicle-mounted system identifying dishes in a video is shown;

[0037] Figure 4 A schematic diagram of an interface in which a user confirms or modifies dish information identified by the system is shown;

[0038] Figure 5 A schematic diagram of a display of a labeled integrated shopping list is shown;

[0039] Figure 6 A schematic diagram of a vehicle-mounted system UI interface is shown;

[0040] Figure 7 A schematic diagram of a mobile phone APP UI interface is shown;

[0041] Figure 8 A schematic diagram of a short message / MMS interface showing a target material list is shown;

[0042] Figure 9 is a flowchart of an information processing method of another vehicle-mounted system according to an embodiment of the present application;

[0043] Figure 10 is a flowchart of a first specific application example of an information processing method of a vehicle-mounted system according to an embodiment of the present application;

[0044] Figure 11 is a flowchart of a second specific application example of an information processing method of a vehicle-mounted system according to an embodiment of the present application;

[0045] Figure 12 is a structural block diagram of an information processing device of a vehicle-mounted system according to an embodiment of the present application;

[0046] Figure 13 is a hardware structure schematic diagram of a computer device according to an embodiment of the present application. DETAILED DESCRIPTION

[0047] To make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described below in connection with the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0048] The application provides an information processing method and device of a vehicle-mounted system, computer equipment and a program product, effectively solves the problem that a user cannot remember all information such as ingredients when seeing content such as dishes in cabin media content, and provides actual action guide information related to information obtained from media content based on the vehicle-mounted system in time.

[0049] In order to more accurately describe the information processing method of the vehicle-mounted system provided by the embodiment of the application, the application scenario of the information processing method of the vehicle-mounted system provided by the embodiment of the application is exemplarily described first.

[0050] Figure 1 FIG. 1 is a schematic diagram of an application scenario of the information processing method of the vehicle-mounted system provided by the embodiment of the application, referring to Figure 1 The information processing method of the vehicle-mounted system provided by the embodiment of the application can be applied to the vehicle-mounted system, and the vehicle-mounted system can include a front-end layer, an application layer, a service layer, an infrastructure layer and an external integration layer.

[0051] The front-end layer is responsible for interaction between the vehicle-mounted system and the user, and can include a vehicle-mounted intelligent cabin interface, a user terminal APP (application program) and a voice interaction interface, for ensuring that the user can conveniently use the vehicle-mounted system for operation and data processing both in the vehicle and outside the vehicle. The user terminal APP can be a mobile phone APP.

[0052] The application layer can include the core business logic of the vehicle-mounted system, for realizing core functions such as content recognition, shopping list generation, ingredient classification and marking and nutrition analysis. For example, the application layer can include a content recognition engine, a shopping list generation system, an ingredient classification and marking system and a nutrition and health analysis system.

[0053] The service layer is used to provide support functions such as AI (Artificial Intelligence) recommendation, user portrait, location service and the like, and provides necessary service support for the application layer. For example, the service layer can include an AI recommendation engine, a user portrait service, a location service, a data analysis service, a message push service and a privacy management service.

[0054] The infrastructure layer can include various databases and storage systems, and provides data support for the entire vehicle-mounted system. For example, the infrastructure layer can include a user database, an ingredient database, a recipe library, a nutrition database and cloud storage. The user database can include historical data of user terminal application programs such as fitness APPs and shopping APPs.

[0055] It should be noted that the data involved in the user level in the embodiments of the present application all belong to the data within the legal fixed range and the user authorized range, and the data obtained and processed is only used to provide services to the user for reasonable data processing in accordance with the legal regulations.

[0056] The external integration layer can be connected and data exchanged with external systems such as a content platform of media content, a supermarket retailer, a payment system, and a health APP. For example, the external integration layer can include a content platform API (Application Programming Interface), a supermarket retailer API, a payment system API, and a health / fitness APP. The content platform can include a podcast or a video content platform.

[0057] According to the embodiments of the present application, a kind of information processing method of vehicle-mounted system is provided, it should be noted that the steps shown in the flowchart of the drawing can be executed in computer system such as a group of computer executable instructions, and although logical order is shown in flowchart, in some cases, the steps shown or described can be executed in different order from here.

[0058] In the present embodiment, an information processing method of vehicle-mounted system is provided, which can be used in the vehicle-mounted system described above, Figure 2 is the flowchart of the information processing method of vehicle-mounted system according to the embodiments of the present application, as Figure 2 shown, the flow includes the following steps:

[0059] Step S201, the information request instruction of target object is detected, and the information request instruction is the instruction issued by the user based on the media content of vehicle-mounted system.

[0060] In some optional embodiments, the target object can be dishes, such as small fried meat, vegetarian dumplings, seafood rice, etc.

[0061] In some optional embodiments, step S201 can receive or detect the information request instruction sent by the user through the front end layer through the application layer of vehicle-mounted system as Figure 1 shown.

[0062] In some optional embodiments, step S201 can include at least one of the following:

[0063] Step S2011, the information request instruction for the target object included in the media content sent by the user end is identified, and the information request instruction is voice instruction.

[0064] Specifically, when a user watches media content of the vehicle-mounted system, the user can directly send an information request instruction for a target object through a voice instruction. The target object can be a dish, a song list, etc. The information request instruction can be a voice instruction such as "this small fried pork looks good, I want to make this dish" or "what is the dish shown in the video just now, I want to know about this dish".

[0065] In some optional embodiments, a dynamic noise filtering algorithm is adopted to filter environmental noise during vehicle driving, so as to optimize the recognition accuracy of the voice instruction.

[0066] In step S2012, the user terminal sends the intention information for the target object included in the media content, sends confirmation information in response to the intention information, and receives the information request instruction sent by the user terminal based on the confirmation information.

[0067] Specifically, the intention information for the target object included in the media content sent by the user terminal can be similar to that in step S2011. It can be applied to a distributed vehicle-mounted system. For example, the vehicle-mounted system is configured with display screens in front and back rows of the vehicle. When the rear row personnel watches the media content displayed on the display screen and clicks the button for sharing the dish to the front row driver and passenger, the front row display screen displays the confirmation information such as "the rear row passenger shares a dish with you, do you want to view the details?" The front row driver and passenger can send a voice instruction such as "OK, I want to see" after receiving the intention information, to indicate that the dish needs to be viewed. At this time, the voice instruction sent by the front row driver and passenger is the information request instruction.

[0068] Here, the user can also set the names of the front and rear row driver and passenger in advance according to the use demand, such as father, mother, baby, son, and daughter, etc.

[0069] Further, in some optional embodiments, the dish information in the media content can also be automatically analyzed and recognized, and when a dish set by the user or a dish meeting the requirements of the pre-configured health database is detected, a prompt information such as "A dish that you may be interested in is detected" is popped up. The prompt information can be a text or image prompt information popped up through the display screen, or a voice prompt information output through the voice. The user terminal can send an information request instruction for indicating that the object information of the target object needs to be obtained based on the prompt information.

[0070] For example, the media content can be a video, Figure 3 Fig. 2 shows a display interface schematic diagram of the vehicle-mounted system recognizing the dish in the video, referring to Figure 3As shown, the vehicle-mounted system can directly identify the video content of the food channel being played in the video content area, and obtain the target object as Italian seafood risotto, and the object information included in the target object as "identified ingredients: Italian rice, shrimp, mussels, garlic, onion, …".

[0071] In step S202, object information of the target object is obtained.

[0072] In some optional embodiments, the object information of the target object can be obtained through a network accessed by the vehicle-mounted system. It can be obtained through a pre-set URL address crawler, or through a pre-configured database of recipes, or through an application interface established with a set application program. The object information can include a list of ingredients included in the dish, such as wood ear, spring bamboo shoots, shredded meat, and fish-flavored sauce. The object information can also include information of each ingredient, such as energy, warm or cold nature, sugar content, and recommended user group information such as whether it is suitable for children or the elderly. The list of ingredients can include main ingredients and auxiliary materials, etc.

[0073] After obtaining the object information of the target object, the user can also modify it. Figure 4 An interface schematic diagram for the user to confirm or modify the dish information identified by the system is shown, referring to Figure 4 The user can modify the object information of the target object based on the total calorie value and protein content of the ingredients, etc. For example, one of the ingredients in "main ingredients: Italian rice, shrimp, mussels" can be deleted or replaced with other ingredients.

[0074] In step S203, the object information is filtered based on a pre-configured health database to generate a target list of ingredients of the target object.

[0075] In some optional embodiments, the health database includes at least one of the following from a pre-configured ingredient database, a recipe database, a nutrition database, and historical data of a set application:

[0076] The historical data of the set application represents the user's selection plan for a plurality of ingredients. For example, the set application is a health / fitness APP of the user, and the user configures a fat gain plan or a weight loss plan within a set time.

[0077] The pre-configured ingredient database represents the health index information of a plurality of ingredients. For example, the fiber content of celery, the protein content of soybeans, the fat content and protein content of various meats, the nutritional components of various vegetables, and the purine content of various ingredients, etc.

[0078] The pre-configured recipe library corresponds to a plurality of menu lists, and the menu list includes a plurality of materials required for making the corresponding menu and alternative materials. For example, the recipe can include a plurality of menu, and the food materials and auxiliary materials required for each menu.

[0079] The pre-configured nutrition database represents the material information corresponding to a plurality of nutritional ingredients.

[0080] The nutrition database is mainly used to represent which food materials correspond to each type of nutritional ingredient, and how much the nutritional ingredient content of the corresponding food material is. For example: high-protein food materials include: fish seeds, soybeans, chicken breasts, etc. In actual application process, the content of nutritional ingredients of food materials and other specific indicators can also be marked.

[0081] In some optional embodiments, the above step S203 can be realized by screening the materials of the object information that meet the requirements of the health database.

[0082] Specifically, for a user who has a muscle building plan and is currently in the muscle building period, a food material list for the muscle building period can be generated for a certain menu, and the protein content, optimal eating time, etc. of each food material are marked.

[0083] Figure 5 A schematic diagram of displaying a labeled integrated shopping list is shown. The integrated shopping list is the above-mentioned target material list. As shown in Figure 5 The integrated shopping list can include Italy, shrimp, and mussels. The sorting method can be selected. The display interface shown here Figure 5 also provides an option of "send to mobile phone".

[0084] In order to more intuitively illustrate the above Figures 3-5 embodiment, a user and vehicle-mounted system voice interaction process is provided here:

[0085] User: "This Italian seafood pilaf looks good, I want to make this dish".

[0086] Vehicle-mounted system: "I have identified the food materials of Italian seafood pilaf. Italian rice, shrimp, mussels, garlic, onion and olive oil are required. The calorie of this dish is about 456 calories, which meets your healthy diet plan. Do you want to add these food materials to the shopping list?".

[0087] User: "OK, add to my shopping list, but I don't need olive oil, I have it at home".

[0088] Car system: "Italian rice, shrimp, mussels, garlic and onions have been added to your shopping list. Among them, shrimp and mussels are high-protein foods, and onions are seasonal vegetables. I will send you a detailed list when you arrive at the supermarket on your shopping day on Friday. Is there anything else you need?"

[0089] Further, the car system can also display the final target object target material list to the user in the form of a virtual shopping cart, for the user to view and modify on the terminal device or the car system.

[0090] Specifically, Figure 6 The car system UI interface schematic diagram is shown. Referring to Figure 6 As shown, the car system can perform content recognition on the media content, and the interface of the current example is an interface for displaying the currently recognized content.

[0091] Further, the target material list can also be displayed through the user's terminal device. For example, the terminal device is a mobile phone, and the target material list can be displayed through the mobile phone APP. Figure 7 The mobile phone APP UI interface schematic diagram is shown. Referring to Figure 7 As shown, the target object can be displayed in the recommended dishes this week column. The target material lists of multiple target objects can be combined into one shopping list for direct use by the user when shopping.

[0092] In some optional embodiments, the car system can also send the target material list to the user's terminal device in the form of instant messages such as SMS or MMS, to facilitate the user to view and modify the target material list and other operations. Figure 8 The SMS / MMS interface for displaying the target material list is shown. Referring to Figure 8 , the target material lists of multiple target objects can also be combined into one shopping list for direct use by the user when shopping. Figure 8 A reminder message is also shown, which will be described in detail below in conjunction with specific embodiments, and will not be described here.

[0093] The information processing method of the car system of the present application, when detecting the information request instruction of the target object issued by the user based on the media content of the car system, timely acquires the object information of the target object, and filters the object information based on the pre-configured health database to generate the target material list of the target object. Therefore, the problem of inconvenient operation, recording or finding information related to the media content when the user uses the car system is effectively avoided, the information request instruction of the user is timely and accurately responded to, and the object information obtained is filtered according to the pre-configured health database to obtain the target material list of the target object that meets the user's expectation, significantly improving the user experience.

[0094] In the embodiment, an information processing method of a vehicle-mounted system is provided, which can be applied to the vehicle-mounted system described above, Figure 9 is a flowchart of the information processing method of the vehicle-mounted system according to the embodiment of the present application, which comprises the following steps as shown in the figure: Figure 9

[0095] In step S901, an information request instruction of a target object is detected, which is an instruction issued by a user based on media content of the vehicle-mounted system.

[0096] For details, refer to step S201 of the embodiment shown in the figure, which will not be repeated here. Figure 2

[0097] In step S902, object information of the target object is acquired.

[0098] For details, refer to step S202 of the embodiment shown in the figure, which will not be repeated here. Figure 2

[0099] In step S903, the object information is filtered based on a pre-configured health database to generate a target bill of materials of the target object.

[0100] For details, refer to step S203 of the embodiment shown in the figure, which will not be repeated here. Figure 2

[0101] In step S904, user behavior planning information and location information are acquired, wherein the user behavior planning information comprises a planning time of the user for handling a set event.

[0102] For example, the user behavior planning information can comprise a shopping day set by the user, such as a fixed shopping day every Saturday or every Sunday. The location information is current location information of a vehicle where the vehicle-mounted system is located or user terminal equipment such as a mobile phone, a tablet computer, a sports watch, etc. bound to the vehicle-mounted system.

[0103] In step S905, user behavior guidance information is generated based on the user behavior planning information and the location information, wherein the user behavior guidance information comprises path planning information and time reminding information of materials included in the bill of materials.

[0104] Specifically, shopping reminding information can be sent to the terminal equipment when the shopping day set by the user in the user behavior planning information is approaching. Or shopping reminding information can be sent when the vehicle-mounted system or the user terminal equipment bound to the vehicle-mounted system approaches a location where the user often shops, such as a supermarket, according to the location information of the user.

[0105] ​​​​Step S906, when it is determined that the current position information of the vehicle-mounted system and the position in the user behavior guidance information meet the set position reminding rule, a user behavior guidance reminder is sent out, and the user behavior guidance reminder is used to represent reminding the user to perform the corresponding behavior.

[0106] For example, when the current position information of the vehicle-mounted system of the user Ms. Li and the distance from the position where Ms. Li often goes shopping in a supermarket are less than a set threshold value, a short message reminder or other application information is sent out to confirm with Ms. Li whether to navigate to the position where she often goes shopping in a supermarket. For example, the set threshold value is 3 km. The position where Ms. Li often goes shopping in a supermarket can be determined according to the historical data of the application set by the terminal device of Ms. Li. Here, reference can be made to the short message / MMS interface shown in Figure 8

[0107] Step S907, when it is determined that the current time and the position in the user behavior guidance information meet the set time reminding rule, a user behavior guidance reminder is sent out, and the user behavior guidance reminder is used to represent reminding the user to perform the corresponding behavior at the set time.

[0108] For example, the user set shopping time of the user behavior guidance information of the vehicle-mounted system of the user Ms. Li is every Friday afternoon, and a target material list for reminding Ms. Li to purchase target food is sent to the vehicle-mounted system or the terminal device of Ms. Li at Friday afternoon. The position where Ms. Li often goes shopping in a supermarket can be determined according to the historical data of the application set by the terminal device of Ms. Li.

[0109] Here, the object information of the target object can also be preprocessed in combination with the historical shopping records of the user. For example, a certain food material is divided into multiple grades or multiple places of origin, and the food material meeting the daily shopping habit of the user can be pushed according to the historical shopping records of the user.

[0110] Therefore, the cross-platform data integration method is adopted to realize the fusion modeling of the space-time perception reminding strategy of the multi-source information such as the media consumption records, the fitness APP data, the shopping history and the geographic position of the user. The best reminding time is predicted based on the user behavior mode. For example, the reminding information is sent to the user 30 minutes before approaching the supermarket.

[0111] Here, it needs to be noted that the information processing method of the vehicle-mounted system adopts the localized content processing method, the sensitive information is analyzed at the vehicle machine end, and only the structured data such as the target material list is uploaded to the cloud or the user. And the situational authorization management method is adopted to dynamically adjust the data collection authority according to the driving or parking driving state of the user.

[0112] In the embodiment, an information processing method of a vehicle-mounted system is provided, which can be used for the vehicle-mounted system described above, Figure 10 ​is a flowchart of a first specific application example of an information processing method of a vehicle-mounted system according to an embodiment of the present application, as shown in Figure 10 The flowchart includes the following steps:

[0113] Step S1001, a user watches or listens to media content.

[0114] Specifically, step S1001 can include:

[0115] Step S10011, the user watches media video.

[0116] Step S10012, the user listens to media content.

[0117] Step S1002, the vehicle-mounted system analyzes the media content in real time.

[0118] Step S1003, identify the dish or food material related information in the media content.

[0119] Specifically, step S1003 can specifically include the vehicle-mounted system actively identifying the dish or food material related information in the media content obtained from the media content. These information can be pushed to the user.

[0120] Thus, the present application adopts semantic level dish extraction technology to extract complete dish information from unstructured media content, including main ingredients, auxiliary ingredients, seasonings, cooking methods, etc., and constructs structured dish knowledge.

[0121] In actual application, in order to avoid frequent disturbance of information push to the user, specific push rules can be set, such as full screen video playing without push. Step S1003 can also include receiving user sent information request instruction and then obtaining dish or food material related information through web crawler and other ways.

[0122] Step S1004, receiving the user's information request instruction.

[0123] Specifically, the user can send information request instruction for representing user interest point by clicking screen push content, or clicking image containing dish in the screen, etc. It can also send information request instruction for representing user interest point through voice instruction. In actual application, it can be reasonably set according to actual demand and the function supported by the hardware equipment such as display device of vehicle-mounted system.

[0124] Step S1005, extracting complete food material list of complete dish for the user.

[0125] Here the dish is the target object.

[0126] Step S1006, query the user's health database such as fitness or diet plan.

[0127] Specifically, the historical data of the application can be obtained through a fitness APP or the like.

[0128] In step S1007, the ingredients in the complete ingredient list are classified and labeled.

[0129] For example, the main ingredients and auxiliary ingredients shown in Figure 4 can be classified and labeled. The ingredients can also be labeled as in-season or out-of-season ingredients, and whether they belong to high-protein ingredients, etc. Figure 5

[0130] In step S1008, nutritional analysis and matching are performed.

[0131] Here, the nutritional analysis and matching of the ingredients contained in the dish can be performed by querying the user's fitness or diet plan health database and other pre-configured health databases in step S1106.

[0132] In step 1009, an optimized shopping list is generated.

[0133] The optimized shopping list is the target material list.

[0134] In step S1010, it is added to the user's shopping cart.

[0135] Referring back to Figure 7 the mobile phone APP UI interface shown in , the target material list is displayed to the user in the form of a virtual shopping cart.

[0136] In step S1011, the vehicle system learns the user feedback optimization model.

[0137] Specifically, the vehicle system can obtain the user's actual shopping list, and update the user's fitness or diet plan health database based on the actual shopping list. Thus, when performing nutritional analysis and matching, the user can be provided with a customized target object target material list.

[0138] Figure 11 In this embodiment, an information processing method of a vehicle system is provided, which can be used in the vehicle system described above, Figure 11 is a flowchart of a second specific application example of an information processing method of a vehicle system according to an embodiment of the present application, as shown in , which mainly shows the process of reminding the user based on the target material list. Specifically, the process includes the following steps:

[0139] In step S1101, the vehicle system detects that the user's shopping day is approaching.

[0140] Here, it can be specific to the date, for example: every Saturday is the shopping day, so every Friday is determined to be approaching the user's shopping day.

[0141] The shopping time of the user can be specifically set, for example, 6:00 pm on Friday every week is the shopping time. It is determined that the shopping day of the user is approaching at 4:00 pm on Friday every week.

[0142] Here, the shopping day of the user is the user behavior planning information.

[0143] Step S1102, generating a navigation route.

[0144] Here, the navigation route can be generated according to the frequently-visited supermarkets determined according to the historical data of the user and the current position information of the vehicle-mounted system.

[0145] Step S1103, detecting that the user is approaching the supermarket.

[0146] Here, the judgment can be made through the position information of the user position and the supermarket position.

[0147] Step S1104, obtaining the inventory information of the supermarket.

[0148] Here, the inventory information of the large supermarket can be directly obtained through the shopping APP and other setting applications.

[0149] Step S1105, confirming the shopping list status.

[0150] Here, the shopping list is the target material list described above, and the status of whether the food materials in the shopping cart have been purchased or need to be purchased can be marked and confirmed through the virtual shopping cart and other methods, so that the shopping list status can be updated in real time.

[0151] Step S1106, pushing instant information such as colorful short messages to the user terminal device.

[0152] Step S1107, updating the shopping list in real time according to the shopping situation of the user.

[0153] Step S1108, obtaining the list of actual purchased materials of the user.

[0154] Step S1109, updating the user portrait and the recommendation model according to the list of actual purchased materials of the user.

[0155] Specifically, the health database can be updated here.

[0156] In order to better illustrate the above embodiment, the following interaction example between the user and the vehicle-mounted system is provided to better illustrate the above embodiment.

[0157] Specifically, the application example one is as follows:

[0158] The user profile determined based on historical data of the application is as follows: Ms. Li, 35 years old, marketing manager, single. Commutes 40 minutes every day and likes to listen to food podcasts in the car. Pays attention to healthy diet and likes to try new recipes on weekends. User behavior planning information includes grocery shopping at a supermarket near home every Saturday morning.

[0159] On the way home from work on Wednesday, Ms. Li listens to the food podcast "Taste Bud Travel" in the car, which explains in detail a low-calorie and healthy "quinoa vegetable salad". This is in line with her ongoing weight loss plan.

[0160] Ms. Li interacts with the in-car system to obtain the shopping list for this dish, and the specific interaction process is as follows:

[0161] 1. The in-car system recognizes the dish information in the podcast, and a prompt "New Recipe Detected: Quinoa Vegetable Salad, Interested?" appears in the lower right corner of the car screen.

[0162] 2. Ms. Li confirms by voice: "Yes, I want to know about this dish".

[0163] 3. The in-car system displays the dish details and analyzes that the dish is low in calories and high in fiber, meeting the weight loss requirements.

[0164] 4. Ms. Li issues a voice command "Add to my weekend shopping list".

[0165] 5. The in-car system confirms and prompts: "Quinoa and 5 vegetables have been added to the shopping list for Saturday, 4 of which are seasonal vegetables, expected to save 15%".

[0166] 6. On Saturday morning, when Ms. Li approaches the supermarket she often goes to, the in-car system sends a text message reminder with a detailed shopping list and in-store location navigation.

[0167] 7. After shopping, the system records the actual purchase and takes into account Ms. Li's selection preferences in the next recommendation.

[0168] Thus, in this application example, the in-car system accurately identifies the dish in the media content and timely pushes the corresponding shopping list to the user, significantly improving the user experience.

[0169] The second application example is as follows:

[0170] The user profile determined based on historical data of the application is as follows: Mr. Zhang, a tech enthusiast, 42 years old, IT engineer, married, with a 10-year-old son, likes to take his family on weekend trips, his son often watches videos on a certain platform in the car during the trip, likes to try international cuisine at home on weekends. User behavior planning information includes grocery shopping at a large supermarket every Sunday for next week's food.

[0171] On Saturday, the family went on a car trip. On the way back, the son watched a food channel video on a certain platform in the back row of the vehicle and was interested in a "Japanese grilled chicken rice" dish. He hoped his father would make it for the whole family next week.

[0172] The user interacts with the vehicle system to obtain the shopping list of the dish, and the specific interaction process is as follows:

[0173] 1. The son clicks the "Share with Dad" button on the back row screen.

[0174] 2. The front row driving screen displays a prompt: "Son shared the Japanese grilled chicken rice video with you. Do you want to see the details?".

[0175] 3. Mr. Zhang confirms by voice while driving: "OK, I'll take a look".

[0176] 4. The vehicle system analyzes the video content, extracts the recipe and ingredient list, and considers the dietary preferences and past records of allergens of family members.

[0177] 5. The vehicle system prompts: "This dish contains soy sauce and honey. Please confirm whether it is suitable for family members to eat?".

[0178] 6. Mr. Zhang confirms that there is no problem, and the system adds the ingredients to the Sunday shopping list and marks the existing seasonings at home.

[0179] 7. When arriving at the supermarket on Sunday, the vehicle system sends an MMS containing not only the ingredient list but also a simple diagram of the cooking steps of the dish.

[0180] 8. After Mr. Zhang completes the purchase, the system records and reminds Mr. Zhang that he can make the dish at the appropriate time in the coming week.

[0181] In this scenario, the vehicle system's information processing method of the present application fully integrates multiple application data to provide a target material list that better meets user needs, significantly improving user experience.

[0182] The third application scenario is as follows:

[0183] The user portrait determined based on the historical data of the set application is as follows: Mr. Wang, a fitness enthusiast, 28 years old, a fitness trainer, has a fixed fitness plan, strictly controls his diet, and pays attention to a high-protein and low-carbohydrate diet structure. He likes to listen to fitness and nutrition-related podcasts in the car. User behavior planning information includes: purchasing fresh ingredients every 3 days.

[0184] Mr. Wang is in an 8-week muscle-building plan and needs to accurately control the daily intake of protein, carbohydrates, and fat ratio. He listens to a fitness podcast in the car and hears a discussion about the "best food ingredient combination during muscle building".

[0185] The specific interaction process between the user and the in-vehicle system is as follows:

[0186] 1. The in-vehicle system identifies the podcast content and extracts key ingredients and nutritional information.

[0187] 2. The in-vehicle system prompts: "Detected muscle-building recipes that may interest you. Do you need detailed information?".

[0188] 3. Mr. Wang confirms his interest through voice or UI interface, and the in-vehicle system displays recommended ingredients and detailed analysis of their nutritional components.

[0189] 4. The in-vehicle system correlates Mr. Wang's current fitness plan with the previously authorized fitness app data and analyzes the matching degree of ingredients with his fitness goals.

[0190] 5. Mr. Wang sends a voice command: "Help me optimize a three-day shopping list based on my muscle-building plan".

[0191] 6. The in-vehicle system generates a list of ingredients for the muscle-building period and labels the protein content and optimal eating time of each ingredient, such as before or after training.

[0192] 7. The in-vehicle system also identifies special offers at local supermarkets and recommends more cost-effective protein ingredient options.

[0193] 8. When Mr. Wang arrives at the supermarket, he receives a shopping list sorted by "training day" and "recovery day" to facilitate purchasing according to the customized training plan.

[0194] Thus, in this application example, general fitness knowledge is converted into personalized practical shopping guides, providing truly individualized dietary recommendations that meet personal training plans through data integration with fitness apps, effectively realizing multi-platform data fusion, improving user's precise nutrient intake control data calculation process, and more effectively achieving customized target material lists for user needs, effectively improving the timeliness and customization of information processing.

[0195] In some optional embodiments, multi-modal interaction expansion can be performed on the interaction between the user and the in-vehicle system. For example, in addition to voice and screen interaction, gesture control or AR navigation can be added to improve safety in driving scenarios.

[0196] Further, the user's terminal device and the user's account logged into the in-vehicle system can include multiple accounts. Family account hierarchical control can be implemented. For example, the main account manages the shopping list, and sub-accounts can participate in dish or ingredient recommendations with limited permissions.

[0197] Further, in the process of sending the reminder information to the user, a dynamic route planning and inventory linkage mode can also be used. For example, by combining virtual vouchers and route optimization technology, real-time association of supermarket inventory data can be used to automatically adjust the recommended list.

[0198] In further, a health data fusion extension function can also be added. Specifically, in addition to the fitness APP, data such as blood glucose monitoring of the medical health platform can also be accessed to provide more accurate dietary taboo reminders for the user.

[0199] In the embodiment, an information processing device of a vehicle-mounted system is also provided, which is used to implement the above embodiments and preferred embodiments, and has been described above. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware can also be implemented and conceived.

[0200] The embodiment provides an information processing device of a vehicle-mounted system, as shown in Figure 12 , comprising:

[0201] The detection module 1201 is configured to detect an information request instruction of a target object, the information request instruction being an instruction issued by a user based on media content of the vehicle-mounted system;

[0202] The acquisition module 1202 is configured to acquire object information of the target object;

[0203] The generation module 1103 is configured to filter the object information based on a preconfigured health database, and generate a target material list of the target object.

[0204] Further function descriptions of the above various modules and units are the same as those of the corresponding embodiments described above, and will not be repeated here.

[0205] The information processing device of the vehicle-mounted system in the embodiment is presented in the form of a functional unit, and the unit herein refers to an ASIC (Application Specific Integrated Circuit, Application Specific Integrated Circuit) circuit, a processor and a memory executing one or more software or fixed programs, and / or other devices that can provide the above functions.

[0206] The embodiment of the present application also provides a computer device with the information processing device of the vehicle-mounted system as shown in Figure 12 .

[0207] Please refer to Figure 13 , Figure 13 is a structural schematic diagram of a computer device provided by an optional embodiment of the present application, as shown in Figure 13As shown, the computer device includes one or more processors 10, memory 20, and interfaces 30 for external devices such as a keyboard and a mouse and peripheral devices such as disk devices or other storage devices. One or more busses 10 can be used to implement the interface between the various circuits and components of the computer device. It will be appreciated that the bus 10 can be implemented using any one or more of a variety of bus structures, such as a Peripheral Component Interconnect (PCI) bus, a Bluetooth bus, an Industry Standard Architecture (ISA) bus, an Enhanced ISA bus, an Accelerated Graphics Port (AGP) bus, a Video Electronics Standards Association (VESA) local bus, a Micro Channel Architecture (MCA) bus, a Universal Serial Bus (USB), and the like. Figure 13 The processor 10 is used in the embodiments as an example.

[0208] The processor 10 can be a central processing unit, a network processor, or a combination thereof. The processor 10 can further include a hardware chip. The hardware chip can be an application specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device can be a complex programmable logic device, a field programmable logic device, a general array logic, or any combination thereof.

[0209] The memory 20 stores instructions that can be executed by the at least one processor 10, so that the at least one processor 10 can perform the method shown in the above embodiments.

[0210] The memory 20 can include a program region and a data region. The program region can store an operating system and application programs required by at least one function. The data region can store data created by the use of the computer device, and the like. In addition, the memory 20 can include a high-speed random access memory, and can further include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state memory device. In some alternative embodiments, the memory 20 can optionally include a memory that is remotely arranged with respect to the processor 10, and these remote memories can be connected to the computer device through a network. Examples of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0211] The memory 20 can include a volatile memory, such as a random access memory, and can also include a non-volatile memory, such as a flash memory, a hard disk, or a solid state disk. The memory 20 can further include a combination of the above-mentioned memories.

[0212] The computer device further includes a communication interface 30 for communication with other devices or communication networks.

[0213] The embodiments of the present application further provide a computer readable storage medium, and the method according to the embodiments of the present application can be implemented in hardware, firmware, or recorded in a storage medium, or stored in a remote storage medium or a non-transitory machine readable storage medium and downloaded to a local storage medium through network, so that the method described herein can be processed by such software on a storage medium using a general purpose computer, a special purpose processor, or programmable or special hardware. The storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid state disk, etc. Further, the storage medium can also include a combination of the above-mentioned memories. It can be understood that the computer, the processor, the microprocessor controller, or the programmable hardware includes a storage component that can store or receive software or computer code, when the software or computer code is accessed and executed by the computer, the processor, or the hardware, the method shown in the above embodiments is implemented.

[0214] Part of the present application can be applied as a computer program product, for example, computer program instructions, when executed by a computer, through the operation of the computer, the method and / or technical solutions according to the present application can be called or provided. Those skilled in the art should understand that the form of computer program instructions in a computer readable medium includes but is not limited to source files, executable files, installation package files, etc. Correspondingly, the way of executing computer program instructions by computer includes but is not limited to: the computer directly executes the instructions, or the computer compiles the instructions and then executes the corresponding compiled program, or the computer reads and executes the instructions, or the computer reads and installs the instructions and then executes the corresponding installed program. Here, the computer readable medium can be any available computer readable storage medium or communication medium accessible to the computer.

[0215] Although the embodiments of the present application are described in conjunction with the accompanying drawings, various modifications and changes can be made by those skilled in the art without departing from the spirit and scope of the present application, and such modifications and changes fall within the scope defined by the appended claims.

Claims

1. An information processing method of an in-vehicle system, characterized by, The method comprises: detecting an information request instruction of a target object, the information request instruction being an instruction issued by a user based on media content of the vehicle-mounted system; obtaining object information of the target object; filtering the object information based on a pre-configured health database to generate a target bill of materials of the target object.

2. The method of claim 1, wherein, After the target bill of materials of the target object is generated, the method further comprises: obtaining user behavior planning information and location information, wherein the user behavior planning information comprises a planned time for the user to handle a setting event; generating user behavior guidance information based on the user behavior planning information and the location information, wherein the user behavior guidance information comprises path planning information and time reminder information for obtaining materials included in the bill of materials.

3. The method of claim 2, wherein, After the user behavior guidance information is generated based on the user behavior planning information and the location information, the method further comprises: issuing a user behavior guidance reminder when it is determined that the current location information of the vehicle-mounted system and the location in the user behavior guidance information meet a setting location reminder rule, the user behavior guidance reminder being used to represent a reminder for the user to perform a corresponding behavior.

4. The method of claim 2, wherein, After the user behavior guidance information is generated based on the user behavior planning information and the location information, the method further comprises: issuing a user behavior guidance reminder when it is determined that a current time and the location in the user behavior guidance information meet a setting time reminder rule, the user behavior guidance reminder being used to represent a reminder for the user to perform a corresponding behavior at a setting time.

5. The method of claim 1, wherein, The detection of the information request instruction of the target object comprises at least one of the following: identifying an information request instruction sent by a user terminal for a target object included in the media content, the information request instruction being a voice instruction; receiving intention information sent by a user terminal for a target object included in the media content, issuing confirmation information in response to the intention information, and receiving an information request instruction sent by the user terminal based on the confirmation information.

6. The method of claim 1, wherein, The health database comprises at least one of the following: setting application history data, the history data representing a selection plan of a user for a plurality of materials; a pre-configured material database, the material database representing health index information of a plurality of materials; a pre-configured recipe library, the recipe library representing a bill of materials corresponding to a plurality of dishes, the bill of materials including a plurality of materials required for making a corresponding dish and alternative materials; a pre-configured nutrition database, the nutrition database representing material information corresponding to a plurality of nutritional ingredients.

7. The method of claim 1, wherein, The filtering of the object information based on the pre-configured health database to generate the target bill of materials of the target object comprises: screening materials of the object information that meet requirements of the health database.

8. An information processing apparatus of an in-vehicle system, characterized by comprising: The device comprises: a detection module configured to detect an information request instruction of a target object, the information request instruction being an instruction issued by a user based on media content of the vehicle-mounted system; an obtaining module configured to obtain object information of the target object; The generating module is configured to filter the object information based on a preconfigured health database to generate a target bill of materials of the target object.

9. A computer device, comprising: The system comprises: A memory and a processor, which are in communication connection with each other, and the memory stores computer instructions, and the processor executes the computer instructions to perform the information processing method of the vehicle-mounted system according to any one of claims 1 to 7.

10. A computer program product, characterised in that, The computer instructions are configured to enable a computer to perform the information processing method of the vehicle-mounted system according to any one of claims 1 to 7.

Images