Method and device for recommending shopping according to advertisement information outside vehicle

Abstract

The invention discloses a method and device for recommending shopping according to advertisement information outside a vehicle, and the method comprises the steps: determining the driving state of a current vehicle, and displaying the obtained advertisement information to a user based on the driving state of the current vehicle; when an advertisement selection instruction is received, obtaining an advertisement type of a selected advertisement contained in the selection instruction, and obtaining user consumption behavior data of a user from a historical consumption record; inputting the user consumption behavior data and the advertisement type of the selected advertisement into a pre-trained preference digital model to obtain purchase channel information of the selected advertisement; and based on the purchase channel information of the selected advertisement, recommending a purchase channel to the user. Therefore, shops along the route of the advertisement are not directly recommended to the user on navigation, the mode that the user likes to purchase the advertisement is recommended according to the user consumption behavior data and the type of the selected advertisement, and the consumption conversion rate of the advertisement outside the vehicle can be effectively improved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method and device for recommending shopping based on off-vehicle advertising information. Background Art

[0002] With the development of science and technology, the autonomous driving technology of vehicles is becoming more and more mature, and users' attention is gradually distracted. In order to attract users' attention to advertisements outside the car, enhance the conversion efficiency of advertisements, and promote advertising consumption, advertisements will be recommended to users in the car.

[0003] In existing technologies, environmental images are mainly acquired based on the driver's line of sight, where the environmental images include advertising information that the driver is interested in. Image recognition is then performed on the environmental images to determine the tag information that the driver is looking at. Finally, based on the tag information and the vehicle's positioning information, shops along the route are recommended to the driver in navigation.

[0004] Since there is no recommendation of purchase channels for the advertisements based on the driver's purchasing preferences, but the navigation system directly recommends shops along the route based on the location information, it may not attract the driver's desire to buy the advertisements. In addition, the label information does not have the corresponding timeliness and spatial timeliness attributes, which makes it impossible to create a psychological feeling in users that they will miss out if they do not purchase in time, thereby affecting the consumer conversion rate of the advertisements. Summary of the Invention

[0005] Based on the above-mentioned deficiencies in the prior art, the present application provides a method and device for recommending shopping based on off-vehicle advertising information to solve the problem of low consumer conversion rate of prior art advertising.

[0006] In order to achieve the above objectives, this application provides the following technical solutions:

[0007] In a first aspect, the present application provides a method for recommending shopping based on off-vehicle advertising information, comprising:

[0008] Determining a current driving state of the vehicle, and displaying the acquired advertising information to the user based on the current driving state of the vehicle;

[0009] When an advertisement selection instruction is received, obtaining the advertisement type of the selected advertisement included in the selection instruction, and obtaining the user consumption behavior data of the user from the historical consumption record;

[0010] Inputting the user consumption behavior data and the advertisement type of the selected advertisement into a pre-trained preference digital model to obtain purchase channel information of the selected advertisement; wherein the preference digital model is pre-trained using historical consumption behavior data of multiple sample users and various advertisement types;

[0011] Based on the purchase channel information of the selected advertisement, a purchase channel is recommended to the user.

[0012] Optionally, in the above-mentioned method for recommending shopping based on off-vehicle advertising information, the method further includes:

[0013] When receiving a replay ad instruction, each target ad is obtained from the backend; wherein each target ad is obtained by pre-loading the QR code information corresponding to all the external billboards that can be identified by the vehicle during driving through the image sensor and storing it in the backend;

[0014] Each of the targeted advertisements is displayed to the user.

[0015] Optionally, in the above-mentioned method for recommending shopping based on off-vehicle advertising information, after recommending a purchasing channel to the user based on the purchasing channel information of the selected advertisement, the method further includes:

[0016] When no channel click instruction is received, or when an advertisement close instruction is received, determining whether the selected advertisement exceeds the effective display time and spatial range based on the current vehicle location information and the time information of the selected advertisement;

[0017] If the selected advertisement does not exceed the displayed validity period and the displayed spatial range, the user is prompted with information about the validity period of the selected advertisement using an explicit countdown;

[0018] If the selected advertisement exceeds the effective time and the spatial range of display, the selected advertisement is closed.

[0019] Optionally, in the above-mentioned method for recommending shopping based on off-vehicle advertising information, the method further includes:

[0020] Determining whether the current vehicle is traveling beyond a time limit for displaying the current advertisement;

[0021] If the current vehicle travels out of the time limit for displaying the current advertisement, invalidating the current advertisement;

[0022] If the current vehicle has not traveled beyond the time limit for displaying the current advertisement, the current advertisement continues to be displayed to the user, along with a countdown for the time limit for displaying the current advertisement.

[0023] Optionally, in the above-mentioned method for recommending shopping based on off-vehicle advertising information, determining the current driving state of the vehicle and displaying the acquired advertising information to the user based on the current driving state of the vehicle includes:

[0024] When it is determined that the current vehicle is stationary or in an autonomous driving state, the AR layer information of the advertisement information on the 3D display device is calculated based on the user's line of sight, the current vehicle's driving information, and the basic information of the external billboard corresponding to the acquired advertisement information;

[0025] Based on the stationary state or the autonomous driving state, displaying the acquired AR layer information of the advertising information to the user with a 3D visual effect on the 3D display device;

[0026] When it is determined that the current driving state of the vehicle is in a manual driving state, the acquired advertising information is displayed to the user with a 2D visual effect on a 3D display device based on the manual driving state.

[0027] A second aspect of the present application provides a device for recommending shopping based on off-vehicle advertising information, comprising:

[0028] an advertising information display unit, configured to determine a current driving state of the vehicle and display the acquired advertising information to the user based on the current driving state of the vehicle;

[0029] an acquiring unit, configured to, upon receiving an advertisement selection instruction, acquire the advertisement type of the selected advertisement contained in the selection instruction, and acquire the user consumption behavior data of the user from historical consumption records;

[0030] an input unit, configured to input the user consumption behavior data and the advertisement type of the selected advertisement into a pre-trained preference digital model to obtain purchase channel information of the selected advertisement; wherein the preference digital model is pre-trained using historical consumption behavior data of a plurality of sample users and various advertisement types;

[0031] The recommendation unit is configured to recommend a purchase channel to the user based on the purchase channel information of the selected advertisement.

[0032] Optionally, the above-mentioned device for recommending shopping based on off-vehicle advertising information further includes:

[0033] The target advertisement acquisition unit is configured to acquire each target advertisement from the backend upon receiving a playback advertisement instruction; wherein each target advertisement is obtained by pre-loading the QR code information corresponding to all the external billboards that can be identified by the vehicle during driving through the image sensor and storing it in the backend;

[0034] The target advertisement display unit is used to display each target advertisement to the user.

[0035] Optionally, the above-mentioned device for recommending shopping based on off-vehicle advertising information further includes:

[0036] a judgment unit, configured to judge whether the selected advertisement exceeds the effective time and spatial range of display based on the current vehicle position information and the time information of the selected advertisement when no channel click instruction is received or when an advertisement close instruction is received;

[0037] a prompting unit, configured to prompt the user with information about the validity period of the selected advertisement by means of an explicit countdown if the selected advertisement does not exceed the displayed validity period and the displayed spatial range;

[0038] The closing unit is configured to close the selected advertisement if the selected advertisement exceeds the effective display time and the spatial range.

[0039] Optionally, the above-mentioned device for recommending shopping based on off-vehicle advertising information further includes:

[0040] A validity determination unit, configured to determine whether the current vehicle is traveling outside a time validity range for displaying the current advertisement;

[0041] a processing unit, configured to invalidate the current advertisement if the current vehicle travels out of a time limit for displaying the current advertisement;

[0042] A countdown unit is used to continue displaying the current advertisement to the user and displaying the countdown of the current advertisement if the current vehicle has not traveled out of the time limit for displaying the current advertisement.

[0043] Optionally, in the above-mentioned device for recommending shopping based on off-vehicle advertising information, the advertising information display unit includes:

[0044] a calculation unit, configured to calculate, when it is determined that the current vehicle is stationary or in an automatic driving state, AR layer information for the advertisement information on the 3D display device based on the user's line of sight, the current vehicle's driving information, and basic information of the external billboard corresponding to the acquired advertisement information;

[0045] A special effect advertisement display unit, configured to display AR layer information of the acquired advertisement information to the user with a 3D visual effect on the 3D display device based on the stationary state or the autonomous driving state;

[0046] The flat advertising display unit is used to display the acquired advertising information to the user with a 2D visual effect on a 3D display device based on the manual driving state when it is determined that the current driving state of the vehicle is in the manual driving state.

[0047] This application provides a method for recommending shopping based on off-vehicle advertising information. The method determines the current driving state of the vehicle and displays the acquired advertising information to the user based on the current driving state. Next, upon receiving an advertisement selection instruction, the method obtains the advertisement type of the selected advertisement contained in the selection instruction and obtains the user's consumer behavior data from historical consumption records. The method then inputs the user's consumer behavior data and the selected advertisement type into a pre-trained preference digital model to obtain purchase channel information for the selected advertisement. The preference digital model is pre-trained using the historical consumer behavior data of multiple sample users and various advertisement types. Finally, based on the purchase channel information for the selected advertisement, the method recommends a purchase channel to the user. This method no longer directly recommends shops along the route of the advertisement to the user through navigation. Instead, the method recommends the user's preferred purchase method for the advertisement based on the user's consumer behavior data and the selected advertisement type, effectively improving the consumption conversion rate of off-vehicle advertisements. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without any creative work.

[0049] Figure 1 A schematic diagram of the application environment provided by the embodiment of the present application;

[0050] Figure 2 A flowchart of a method for recommending shopping based on off-vehicle advertising information provided in an embodiment of the present application;

[0051] Figure 3 A flow chart of a method for determining the display of advertising information provided in an embodiment of the present application;

[0052] Figure 4 A schematic diagram of the structure of an advertisement recommendation process provided in an embodiment of the present application;

[0053] Figure 5 A flowchart of a method for determining the timeliness of a selected advertisement provided in an embodiment of the present application;

[0054] Figure 6 A flowchart of a method for reviewing an advertisement is provided for another embodiment of the present application;

[0055] Figure 7 A flowchart of a method for determining the timeliness of an advertisement is provided for another embodiment of the present application;

[0056] Figure 8A flowchart of an application method for recommending shopping based on off-vehicle advertising information provided in an embodiment of the present application;

[0057] Figure 9 A schematic structural diagram of a device for recommending shopping based on off-vehicle advertising information, provided in another embodiment of the present application. DETAILED DESCRIPTION

[0058] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0059] In this application, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

[0060] See also Figure 1 , shows a method for recommending shopping based on off-vehicle advertising information. The method for off-vehicle advertising conversion rate provided in the embodiment of the present application can be applied to Figure 1 The interactive system 100 shown includes a vehicle system 101 and a display device 102 .

[0061] It should be noted that the vehicle system 101 may include an external image acquisition device, a vehicle networking system, a user eye movement acquisition device, a motion capture device, a voice collection device, a positioning system, a timer, a head-up display system, an information processor, a transceiver, and a storage device.

[0062] Among them, the external image acquisition device is used to collect advertising images outside the vehicle and identify the location of billboards.

[0063] The Internet of Vehicles system is used to load the QR code information corresponding to the advertising image outside the vehicle.

[0064] Eye movement data is collected from everyone in the vehicle, including gaze direction, eye movements, pupil size, and other eye movement data. Motion capture data is used to capture movement data from everyone in the vehicle, such as waving, shaking, and pointing. Voice data is collected from everyone in the vehicle. Specifically, the vehicle system can determine whether everyone in the vehicle has selected an advertisement based on their eye movement, movement, and speech data.

[0065] Positioning system: used to obtain the vehicle's current location, direction, and destination information to determine whether the vehicle has driven out of the advertising display range.

[0066] Timer: used to calculate the timeliness of the advertisement data stored in the information storage so as to determine whether the advertisement has reached the timeliness for displaying the advertisement.

[0067] Head-up display system: used to display the image information layer of advertising data, and display the image on the display device 102 to achieve an augmented reality effect.

[0068] The information processor, transceiver and storage are used to process, send, receive and store the advertising information collected by the external image acquisition device, as well as the user and his advertising preference data.

[0069] The display device 102 may include various display devices in the car, such as one or more of the central control, co-pilot screen, rear screen, head-mounted VR device, HUD, etc., which are mainly used to display advertising details and allow everyone in the car to select, zoom, and perform other interactive operations on the advertising details on the display device, while making it convenient for all passengers in the car to view the content of the advertisement.

[0070] Based on the application scenarios disclosed in the above embodiments of the present application, such as Figure 2 FIG. 1 is a flowchart of a method for recommending shopping based on off-vehicle advertising information provided by an embodiment of the present application. The method can be applied to the vehicle system 101 in the above application scenario and mainly includes the following steps:

[0071] S201: Determine the current driving state of the vehicle, and display the acquired advertising information to the user based on the current driving state of the vehicle.

[0072] Here, user refers to the driver.

[0073] It should be noted that in order to ensure the safety of the user while driving, in an embodiment of the present application, it is necessary to determine the current driving status of the vehicle and display the acquired advertising information to the user based on the determined current driving status of the vehicle.

[0074] It should also be noted that before displaying the acquired advertising information to the user, it is necessary to first obtain the billboards and their corresponding QR code information around the vehicle using an external image acquisition device. The corresponding QR code information for the billboards is then loaded into the connected vehicle system to obtain the advertising information corresponding to the QR code information. The QR code information is integrated with the vehicle system, so that the vehicle's external advertising image is captured by the vehicle's image acquisition device based on the QR code information. The relative position of the billboard and the vehicle can also be determined by scanning the QR code. Specifically, the perspective (deformation) of the QR code captured by the vehicle's camera allows the vehicle system to determine the perspective relationship between the billboard and the vehicle, such as the distance and angle. This allows the user to better align the 3D visual effect of the advertising information with the real environment and the billboard when viewing the billboard from the perspective of the vehicle's windshield or through a head-mounted VR device. Therefore, in addition to the advertising information on the external billboard, the QR code information also includes the world coordinate information of the external billboard, the 3D visual effect advertising information displayed inside the vehicle, and advertising promotion information.

[0075] Optionally, in another embodiment of the present application, a specific implementation of step S201 is as follows: Figure 3 As shown, the following steps are included:

[0076] S301. Determine the current driving state of the vehicle, and based on the current driving state of the vehicle, determine whether to display special effect advertising information to the user.

[0077] Specifically, in order to make the advertisement attractive enough and ensure that the user is interested in the advertisement while driving safely, the vehicle system can determine whether the user is suitable for viewing special effect advertising information based on the driving state of the vehicle. Special effect advertising information refers to advertising information with 3D effects. Therefore, when it is determined that the current driving state of the vehicle is stationary or in an automatic driving state, it is determined that the user is suitable for viewing special effect advertising information, so the user will be shown 3D effect advertising information in a virtual reality manner, that is, step S302 is executed. When it is determined that the current driving state of the vehicle is in a manual driving state, it is determined that the user is not suitable for viewing special effect advertising information, and a simple flat advertising information can be displayed to the user, that is, step S304 is executed.

[0078] S302. When it is determined that the current vehicle is stationary or in an automatic driving state, calculate the AR layer information of the advertising information on the 3D display device based on the user's line of sight, the current vehicle's driving information, and the basic information of the external billboard corresponding to the acquired advertising information.

[0079] It should be noted that in order to ensure that the special effects advertising information can be displayed precisely in the corresponding billboard area and achieve the naked-eye 3D effect, when it is determined that the current vehicle is stationary or in autonomous driving, the system needs to calculate the AR layer information of the special effects advertising information on the 3D display device based on the user's line of sight, the current vehicle's speed, and the size, frame position, relative distance, and other information of the billboard. Among them, the AR layer information includes the dynamic size, position, and scaling ratio of the advertising information display, the current vehicle's driving information includes the current driving speed, and the basic information of the billboard outside the vehicle includes the size, frame position, relative distance, etc.

[0080] S303: Based on the stationary state or the automatic driving state, the AR layer information of the obtained advertising information is displayed to the user with a 3D visual effect on the 3D display device.

[0081] Specifically, the AR layer information of the acquired advertisement is displayed to the user in 3D visual effects on the 3D display device. The virtual characters or animals in the advertisement can make eye contact with the user based on the user's eye gaze captured by the user's eye movement acquisition device, and can also respond to the user's gestures, such as waving, touching, and making expressions. This can stimulate the user's interest in the advertisement and solve the problem of boredom during autonomous driving.

[0082] S304: When it is determined that the current driving state of the vehicle is in the manual driving state, the acquired advertising information is displayed to the user with a 2D visual effect on a 3D display device based on the manual driving state.

[0083] Specifically, if the vehicle is currently in manual driving mode, it indicates that the user is not suitable for viewing advertising information with 3D effects at this time. In other words, it indicates that the driver is not suitable for viewing advertising information with 3D effects at this time. Therefore, the obtained advertising information can be displayed to the user in 2D visual effects on a 3D display device. The 3D display device can be an ARHUD (augmented reality head-up display) or a head-mounted VR device.

[0084] Specifically, in order to make advertisements attractive enough and ensure that users are interested in advertisements while driving safely, the vehicle system can determine whether the user is suitable for viewing special-effect advertisements based on the vehicle's driving state. Special-effect advertisements refer to advertisements with 3D effects. Therefore, when it is determined that the current driving state of the vehicle is stationary or in autonomous driving mode, it indicates that the user is suitable for viewing special-effect advertisements. Therefore, virtual reality will be used to display 3D-effect advertisements to the user. When the current driving state of the vehicle is in manual driving mode, it indicates that the user is not suitable for viewing special-effect advertisements, and a simple flat advertisement can be displayed to the user.

[0085] It should be noted that passengers in the car can watch 3D visual effect advertisements normally by wearing VR glasses, and the passengers' viewing devices can watch 3D visual effect advertisements on the screen or VR device according to their preferences without affecting the driver's manual driving.

[0086] S202: When an advertisement selection instruction is received, the advertisement type of the selected advertisement included in the selection instruction is obtained, and the user consumption behavior data of the user is obtained from the historical consumption record.

[0087] It should be noted that when displaying acquired advertising information to a user, the vehicle system's eye movement, motion capture, and voice collection devices can be used to determine whether an ad selection instruction has been received. For example, looking at content of interest, blinking twice quickly and looking at content of interest, nodding and looking at content of interest, pressing the steering wheel's OK button and looking at content of interest, grabbing and looking at content of interest, and simple voice commands such as "OK" and "Select" can all be considered ad selection instructions.

[0088] It should also be noted that in order to achieve the best consumer conversion effect for advertisements, in this embodiment of the application, purchase channels can be recommended to users based on the user's favorite way of purchasing the advertisement type. For example, for clothing, if the user prefers to try on and purchase offline, the nearest offline mall will be recommended. For digital products, if the user prefers to purchase online, an online purchase platform will be recommended. Therefore, when receiving an advertisement selection instruction, it is necessary to obtain the advertisement type of the selected advertisement contained in the selection instruction and obtain the user's user consumption behavior data from the historical consumption record, so that the user's favorite way of purchasing products can be determined later.

[0089] Optionally, if no ad selection instruction is received, indicating that the user has no interest in selecting the ad, a small window will be displayed to the user with a countdown to the flash sale of the ad information (the countdown can be a time countdown or a distance countdown, for example, the benefit will disappear if the user drives 2 km away from a building, or the benefit will disappear if it is not claimed after 1:59:00). The small window will not disappear until the user manually closes it, leaves the ad range, or exceeds the time range. This can make users feel a sense of loss aversion if they do not use the offer in time, making them feel a certain degree of tension, which in turn helps to increase the consumer conversion rate of the ad.

[0090] S203: Input the user consumption behavior data and the advertisement type of the selected advertisement into a pre-trained preference digital model to obtain purchase channel information of the selected advertisement.

[0091] The preference digital model is pre-trained using historical consumption behavior data of multiple sample users and various advertising types.

[0092] Specifically, the system will pre-build a preference digital model based on a neural network algorithm, and then the product classifier will classify advertisements into: clothing, automobiles, mobile phones, digital products (drones, cameras, VR glasses, etc.), daily necessities (facial cleansers, paper towels, data cables, etc.), fresh food, and catering. The system will then retrieve the preference digital model through the user ID, input the user's consumption behavior data and the type of the selected advertisement into the preference digital model, and then analyze the number and amount of online and offline purchases of the user through the preference digital model, and then obtain the channel information of the user's preferred purchase of advertisements. For the specific recommendation process, please refer to Figure 4 Optionally, the system will also record each user's consumption behavior data in the historical consumption records in order to obtain each user's preferred method of purchasing advertisements.

[0093] S204: Recommend purchasing channels to the user based on the purchasing channel information of the selected advertisement.

[0094] Specifically, when the purchase channel information of the selected ad refers to online purchases, the user is prioritized to frequently used shopping websites (where there are many purchase records of the same category and large amounts). When the purchase channel information of the selected ad refers to offline purchases, the purchase channel recommender prioritizes shopping malls frequently visited by the user. The purchase channel recommender also recommends the most suitable shopping malls for the user based on the offline store's address, operating hours, nearby traffic volume, number of parking spaces, mall activities, and user navigation frequency.

[0095] For example, when the user selects clothing as the advertising type, based on the user's historical consumption records for clothing (assuming that the offline consumption amount in the past six months is larger and the frequency is greater than that of online consumption), the system will determine that the user likes to purchase offline, and therefore give priority to recommending offline stores. When making recommendations, the system will recommend the most suitable offline shopping malls (those near the destination, frequently visited by the user, and with the biggest discounts) based on the user's historical consumption records.

[0096] If the user selects a daily necessities ad, and if, based on their spending and frequency across various shopping websites, they determine they prefer online shopping and prefer Pinduoduo, the Pinduoduo product page will pop up, proactively pushing exclusive coupons and limited-time deals for that product. After the order is placed, the product will be delivered to the owner's home or car (as long as the owner enters a pickup time and parking spot, and authorizes the courier to open the trunk). If the user has no specific preferences, they can be recommended to purchase on the official website.

[0097] Optionally, after recommending a purchase channel to a user, there may still be a situation where the user only browses the purchase channel without clicking on it, or the user directly closes the advertisement. Therefore, after executing step S204, if Figure 5 As shown, further comprising:

[0098] S501. When no channel click instruction is received, or when an advertisement close instruction is received, determine whether the selected advertisement exceeds the effective time and spatial range of the display based on the current vehicle location information and the time information of the selected advertisement.

[0099] It should be noted that in order to effectively improve the conversion rate of advertisements after recommending a purchase channel to a user, but when the user does not make a purchase, or when the user closes the advertisement, the system will use a countdown within the display range of the advertisement to remind the user that the benefits provided by this advertisement are time-sensitive, thereby increasing the user's sense of urgency and preventing the user from wanting to consider it before making a decision, but forgetting it as soon as they turn around. Therefore, in an embodiment of the present application, when no channel click instruction is received, or when an advertisement closing instruction is received, it is determined whether the selected advertisement exceeds the effective time and spatial range of the display based on the current vehicle's location information and the time information of the selected advertisement. If the selected advertisement does not exceed the effective time and spatial range of the display, it means that the selected advertisement does not exceed the display range, and therefore step S502 needs to be executed. If the selected advertisement exceeds the effective time and spatial range of the display, it means that the selected advertisement exceeds the display range, and then step S503 is executed.

[0100] Alternatively, when the selected ad is a local specialty product ad or a promotional ad, the timeliness of displaying such an ad is generally based on location. For example, once the vehicle leaves the city where the specialty product ad is displayed or the highway where the promotional ad is located, the discount offered by the ad will expire.

[0101] For example, tourists visiting Yunnan's characteristic towns might simply drive by if they don't know about the wineries, Guizhou's baijiu wineries, or other local specialties. By leveraging the timeliness of advertising space mentioned in this invention to guide users to experience offline experiences, local consumption can be increased, and users who prefer not to shop offline can also be provided with an online purchasing channel.

[0102] Alternatively, integrating local service areas can more efficiently access the products corresponding to the selected advertisements. For example, if a driver wants to purchase Dongpeng Special Drink on the highway while driving long distances, the ad could display a discount of 9.9 for three bottles at any service area on the highway. For a Sichuan tourist, the ad could display a buy-one-get-one-free deal on a certain brand of internet-famous hot pot base at the next service area. This can further improve the timeliness and convenience of product acquisition, thereby increasing the conversion rate of the advertisement.

[0103] S502: Using an explicit countdown method, the user is prompted with information about the validity period of the discount for the selected advertisement.

[0104] Specifically, when a selected ad exceeds its effective display time and spatial range, a countdown for the selected ad will be displayed in a small window on the far right side of the front windshield, reminding the user that the offer for the selected ad is about to expire. For example, a small window will display a message on the far right side of the front windshield: "Please claim a 5.9% discount coupon for a certain brand in time, as the offer will expire in more than 2 hours." Optionally, the countdown displayed in the small window can automatically disappear after the ad exceeds its benefit range, or the user can close the small window countdown if they no longer want to view the offer for the ad.

[0105] S503: Close the selected advertisement.

[0106] When the selected ad exceeds the effective display time and space range, the selected ad will be automatically closed to avoid affecting the display of the next ad.

[0107] Optionally, the user may not view the advertising information of interest because the vehicle is not in autonomous driving mode. Therefore, in order to allow the user to still see the advertisements of interest that they have missed before, in another embodiment of the present application, the system will record all the advertisements identified along the way and store them in the background for subsequent viewing.

[0108] Alternatively, as Figure 6 As shown, another embodiment of the present application provides a method for reviewing an advertisement, comprising the following steps:

[0109] S601: When receiving an instruction to watch advertisements again, obtain each target advertisement from the background.

[0110] Among them, each target advertisement is pre-loaded by the image sensor using the QR code information corresponding to all the external billboards that can be identified by the vehicle while it is driving and stored in the background.

[0111] It's worth noting that the system includes a replay feature to prevent users in manual driving from missing out on promotional offers due to inactivity. Therefore, upon receiving a replay command, the system retrieves the target ads from the backend.

[0112] Alternatively, users can review all ads detected that day after a day's journey, or while waiting at a traffic light, with the car's autonomous driving function engaged, or while parked. Passengers in the front and rear seats can also access stored ads at any time through their respective information interaction systems.

[0113] S602: Display each target advertisement to the user.

[0114] It should be noted that when users view each target advertisement, they can sort according to the identification time of each target advertisement, or sort according to the timeliness of each target advertisement, or filter according to the category of each target advertisement (for example, only display fashion advertisements, only display food advertisements, only display digital product advertisements, only display advertisements containing coupons, only display local tourist souvenir advertisements or service area consumption coupon discount advertisements, etc.), or users can directly search for keywords of the advertisement on the vehicle display screen, etc., and review them to display them to users so that they can obtain the discounts on the products they need in a timely and convenient manner.

[0115] It should also be noted that each ad has a certain time limit. If the user does not view the ad's discount information in time, the discount information will expire. However, the replay function will also display the location of each ad recognition (the area where the vehicle passed the ad recognition) and the time limit, so that when the user wants to get the discount for a certain ad, they can return to the recognition location. Alternatively, the user can claim the discount the next time they pass this section of road.

[0116] Optionally, in order to prevent the same advertisement from being displayed to the user all the time, which makes the user feel bored and cannot effectively improve the consumption conversion rate of the advertisement, the display advertisement has a certain time limit. Therefore, in another embodiment of the present application, Figure 7 As shown, another embodiment of the present application provides a method for determining the timeliness of an advertisement, comprising the following steps:

[0117] S701: Determine whether the current vehicle is traveling out of the time limit for displaying the current advertisement.

[0118] In order to attract users to consume advertisements, advertisements are generally set with a certain time limit, and the products or coupons included in the advertisements also have a certain time limit. The purpose is to arouse users' sense of urgency and promote advertising consumption. Therefore, it is pre-determined whether the current vehicle has traveled out of the time limit for displaying the current advertisement. If the current vehicle has traveled out of the time limit for displaying the current advertisement, it means that the current advertisement can no longer be displayed, and step S702 needs to be executed at this time. If the current vehicle has traveled within the time limit for displaying the current advertisement, it means that the current advertisement can continue to be displayed, and step S703 is executed.

[0119] Specifically, the validity range of the advertisement can be determined by the advertiser. Optionally, the advertisement may be effective only when displayed on certain road sections. For example, the road section where the current vehicle is located can be obtained based on high-precision map information and satellite navigation information, and then it can be determined whether the current advertisement can be displayed on that road section. It can also be effective only when the advertisement is displayed within a certain range of the advertisement position. For example, the information interaction system can mark the advertisement information according to the location of the billboard, and determine whether the current vehicle is within the effective distance range for advertisement display based on the marked advertisement information. Optionally, the effective distance range can be set to 5-10 kilometers, and of course other distance thresholds can also be used. The specific setting can be based on the needs. The advertisement information can also be valid within a certain time range after being recognized by the current vehicle. For example, the information interaction system can set a time tag to mark the advertisement information. Specifically, it can be determined whether the advertisement is expired based on the interval between the current time and the time when the advertisement is recognized. Optionally, the interval can be valid within 10-30 minutes, and of course other time thresholds can also be used. The specific setting can be based on the needs.

[0120] S702: Invalidate the current advertisement.

[0121] Specifically, when the current vehicle travels outside the timeframe for displaying the current ad, the fused information within the current ad needs to be promptly invalidated to avoid affecting the display of the next ad. This can include clearing the inventory of the currently displayed discount product, limiting coupon redemption, and so on.

[0122] S703: Continue to display the current advertisement to the user, and display the countdown of the validity of the current advertisement.

[0123] Specifically, when the current vehicle has not traveled beyond the effective range of the current advertisement, the current advertisement will continue to be displayed to the user, but the effective time countdown of the current advertisement will also be displayed to the user, such as the effective distance countdown or the effective time countdown.

[0124] This application provides a method for recommending shopping based on off-vehicle advertising information. The method determines the current driving state of the vehicle and displays the acquired advertising information to the user based on the current driving state. Next, upon receiving an advertisement selection instruction, the method obtains the advertisement type of the selected advertisement contained in the selection instruction and obtains the user's consumer behavior data from historical consumption records. The method then inputs the user's consumer behavior data and the selected advertisement type into a pre-trained preference digital model to obtain purchase channel information for the selected advertisement. The preference digital model is pre-trained using the historical consumer behavior data of multiple sample users and various advertisement types. Finally, based on the purchase channel information for the selected advertisement, the method recommends a purchase channel to the user. This method no longer directly recommends shops along the route of the advertisement to the user through navigation. Instead, the method recommends the user's preferred purchase method for the advertisement based on the user's consumer behavior data and the selected advertisement type, effectively improving the consumption conversion rate of off-vehicle advertisements.

[0125] Based on the application scenarios disclosed in the above embodiments of the present application, such as Figure 8 As shown, it is a flowchart of an application method for recommending shopping based on off-vehicle advertising information, which is improved in an embodiment of the present application.

[0126] Among them, the application scenario architecture involved includes Figure 1 Shown are: a vehicle system 101 and a display device 102 , wherein the vehicle system 101 at least includes an external image acquisition device 10 and a vehicle networking system 11 .

[0127] S801. The vehicle exterior image acquisition device 10 acquires exterior vehicle advertisement images and their corresponding QR code information.

[0128] It should be noted that every time the vehicle drives to an outdoor advertising image, the outdoor image acquisition device in the vehicle system will automatically collect the outdoor advertising image and its corresponding QR code information, so that the advertising information corresponding to the outdoor advertising image can be loaded later and displayed to the user.

[0129] S802. The Internet of Vehicles system 11 loads the QR code information corresponding to the billboard outside the vehicle to obtain advertising information.

[0130] S803: The vehicle system 101 determines the current driving state of the vehicle, and sends the advertisement information and the current driving state of the vehicle to the display device.

[0131] Specifically, in order to display the identified advertising information to the user for selection and ensure the user's safety during the display, it is necessary to send the advertising information and the current driving status of the vehicle to the display device.

[0132] S804 , when the display device 102 receives the advertising information sent by the vehicle system and the current driving status of the vehicle, it displays the advertising information to the user based on the current driving status of the vehicle.

[0133] It should be noted that when the vehicle is currently stationary or in an autonomous driving state, the 3D visual effect advertising information is displayed on the AR-HUD or a head-mounted VR device, allowing the user to view the 3D visual effect advertising information. When the vehicle is currently in a manual driving state, the 2D visual effect advertising information is displayed on the display device 102.

[0134] It should also be noted that, in addition to the driver, passengers in the car usually rely on wearable AR or VR devices to view 3D advertising effects in a more immersive way, or use other display devices (screens) as an auxiliary to view advertising information with 3D visual effects. The immersiveness is poor, but it is convenient for touch and can achieve the effect of quickly purchasing goods.

[0135] S805 . When the vehicle system 101 receives an advertisement selection instruction from the user, it obtains the advertisement type of the selected advertisement contained in the selection instruction, and obtains the user consumption behavior data of the user from the historical consumption records.

[0136] It should be noted that the specific implementation of step S805 can refer to step S202 accordingly, and will not be repeated here.

[0137] S806 , the vehicle system 101 inputs the advertisement type of the selected advertisement and the user consumption behavior data into a pre-trained preference digital model to obtain purchase channel information of the selected advertisement.

[0138] It should be noted that the specific implementation of step S806 may refer to step S203 accordingly, and will not be repeated here.

[0139] S807 . The vehicle system 101 recommends a purchase channel to the user based on the purchase channel information of the selected advertisement.

[0140] It should be noted that the specific implementation of step S807 may refer to step S204 accordingly, and will not be repeated here.

[0141] S808. When the vehicle system 101 does not receive a click instruction from the user, or when it receives an advertisement closing instruction from the user, it prompts the user with the preferential validity information of the selected advertisement.

[0142] It should be noted that the specific implementation of step S808 can refer to step S501 accordingly, and will not be repeated here.

[0143] S809 . When the vehicle system 101 receives the replay instruction sent by the user, it displays each target advertisement to the user and prompts the user with advertisement expiration information.

[0144] Each targeted ad is pre-loaded with the image sensor and stored in the backend, along with the corresponding QR code information for all external billboards it can identify while driving. Ad expiration notifications are used to notify users that the offer in the ad will automatically expire after the ad's display period expires.

[0145] It should be noted that the playback and countdown of the target advertisement do not require a specific display device. When the current vehicle is stationary or in automatic driving state, the playback and countdown of the target advertisement can be displayed on the same display device (usually HUD for the driver) or displayed on multiple display devices at the same time (head-mounted devices or screens of all members in the car) for viewing.

[0146] It should also be noted that the specific implementation of step S809 can refer to step S601 accordingly, and will not be repeated here.

[0147] Based on the application scenarios disclosed in the above embodiments of the present application, such as Figure 9 FIG. 1 is a schematic diagram of a device for recommending shopping based on off-vehicle advertising information, provided in another embodiment of the present application. The device can be applied to the vehicle system 101 in the above-mentioned application scenario, and mainly includes the following steps:

[0148] The advertisement information display unit 901 is used to determine the current driving state of the vehicle and display the acquired advertisement information to the user based on the current driving state of the vehicle.

[0149] The acquisition unit 902 is configured to, upon receiving an advertisement selection instruction, acquire the advertisement type of the selected advertisement contained in the selection instruction, and acquire the user consumption behavior data of the user from the historical consumption record.

[0150] The input unit 903 is used to input the user consumption behavior data and the advertisement type of the selected advertisement into the pre-trained preference digital model to obtain the purchase channel information of the selected advertisement.

[0151] The preference digital model is pre-trained using historical consumption behavior data of multiple sample users and various advertising types.

[0152] The recommendation unit 904 is configured to recommend a purchase channel to the user based on the purchase channel information of the selected advertisement.

[0153] It should be noted that the specific working process of the above-mentioned units in the embodiment of the present application can refer to steps S201 to S204 in the above-mentioned method embodiment, and will not be repeated here.

[0154] Optionally, another embodiment of the present application provides an apparatus for recommending shopping based on off-vehicle advertising information, further comprising the following units:

[0155] The target advertisement acquisition unit is used to acquire each target advertisement from the backend upon receiving the instruction to replay the advertisement. Each target advertisement is acquired by pre-loading the QR code information corresponding to all the external advertisement boards that can be identified by the vehicle during driving through the image sensor and storing it in the backend.

[0156] The target advertisement display unit is used to display each target advertisement to the user.

[0157] Optionally, another embodiment of the present application provides an apparatus for recommending shopping based on off-vehicle advertising information, further comprising the following units:

[0158] The judgment unit is used to judge whether the selected advertisement exceeds the effective time and spatial range of the display based on the current vehicle position information and the time information of the selected advertisement when no channel click instruction is received or when an advertisement closing instruction is received.

[0159] The prompting unit is used to prompt the user with the preferential validity information of the selected advertisement by using an explicit countdown method if the selected advertisement does not exceed the effective time and space range of the display.

[0160] The closing unit is used to close the selected advertisement if the selected advertisement exceeds the effective display time and space range.

[0161] Optionally, another embodiment of the present application provides an apparatus for recommending shopping based on off-vehicle advertising information, further comprising the following units:

[0162] The validity judgment unit is used to judge whether the current vehicle has traveled out of the time validity range for displaying the current advertisement.

[0163] The processing unit is configured to invalidate the current advertisement if the current vehicle travels out of the time limit for displaying the current advertisement.

[0164] The countdown display unit is used to continue displaying the current advertisement and the countdown of the current advertisement to the user if the current vehicle has not traveled out of the time limit for displaying the current advertisement.

[0165] Optionally, in another embodiment of the present application, in a device for recommending shopping based on off-vehicle advertising information, the advertising information display unit 901 includes the following units:

[0166] The calculation unit is used to calculate the AR layer information of the advertising information on the 3D display device according to the user's line of sight, the current vehicle's driving information and the basic information of the external billboard corresponding to the obtained advertising information when it is determined that the current vehicle is in a stationary state or in an automatic driving state.

[0167] The special effects advertising display unit is used to display the AR layer information of the acquired advertising information to the user with 3D visual effects on a 3D display device based on a stationary state or an autonomous driving state.

[0168] The flat advertising display unit is used to display the acquired advertising information to the user with a 2D visual effect on a 3D display device based on the manual driving state when it is determined that the current driving state of the vehicle is in the manual driving state.

[0169] It should be noted that the specific working process of each unit provided in the above embodiments of the present application can refer to the corresponding steps in the above method embodiments, and will not be repeated here.

[0170] In summary, the embodiments of the present application provide a device for recommending shopping based on off-vehicle advertising information. The vehicle system can recommend purchasing channels for selected advertisements to users based on the user's consumption behavior and the type of advertisements selected by the user, thereby obtaining the user's favorite way to purchase items based on the user's consumption behavior data, thereby effectively improving the consumption conversion rate of advertisements and promoting advertising consumption.

[0171] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the components and steps of each example according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0172] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present application. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for recommending shopping based on advertisement information outside a vehicle, characterized in that: include: Determining a current driving state of the vehicle, and displaying the acquired advertising information to the user based on the current driving state of the vehicle; When receiving an advertisement selection instruction, obtaining the advertisement type of the selected advertisement contained in the selection instruction, and obtaining the user consumption behavior data of the user from the historical consumption record; Inputting the user consumption behavior data and the advertisement type of the selected advertisement into a pre-trained preference digital model to obtain purchase channel information of the selected advertisement; wherein the preference digital model is pre-trained using historical consumption behavior data of multiple sample users and various advertisement types; Based on the purchase channel information of the selected advertisement, a purchase channel is recommended to the user.

2. The method according to claim 1, characterized in that Also includes: When receiving an instruction to watch the advertisement again, each target advertisement is obtained from the background; wherein each target advertisement is obtained by loading the QR code information corresponding to all the external advertisement boards that can be identified by the vehicle during driving in advance through the image sensor and storing it in the background; Each of the targeted advertisements is displayed to the user.

3. The method according to claim 1, characterized in that After recommending a purchase channel to the user based on the purchase channel information of the selected advertisement, the method further includes: When no channel click instruction is received, or when an advertisement closing instruction is received, judging whether the selected advertisement exceeds the effective time and spatial range of display according to the current vehicle position information and the time information of the selected advertisement; If the selected advertisement does not exceed the displayed validity period and the spatial range, the user is prompted with information about the validity period of the selected advertisement by means of an explicit countdown; If the selected advertisement exceeds the effective time and the spatial range of display, the selected advertisement is closed.

4. The method according to claim 1, characterized in that: Also includes: Determining whether the current vehicle is traveling beyond the time limit for displaying the current advertisement; If the current vehicle travels out of the time limit for displaying the current advertisement, the current advertisement is invalidated; If the current vehicle has not traveled beyond the time limit for displaying the current advertisement, the current advertisement continues to be displayed to the user, and a time limit countdown for the current advertisement is displayed.

5. The method according to any one of claims 1 to 4, characterized in that: The determining the current driving state of the vehicle and displaying the acquired advertising information to the user based on the current driving state of the vehicle includes: When it is determined that the current vehicle is in a stationary state or in an automatic driving state, the AR layer information of the advertising information on the 3D display device is calculated according to the user's sight direction, the current vehicle's driving information, and the basic information of the external billboard corresponding to the acquired advertising information; Based on the stationary state or the autonomous driving state, displaying the acquired AR layer information of the advertisement information to the user with a 3D visual effect on the 3D display device; When it is determined that the current driving state of the vehicle is in a manual driving state, the acquired advertising information is displayed to the user with a 2D visual effect on a 3D display device based on the manual driving state.

6. A device for recommending shopping based on advertisement information outside a vehicle, characterized in that: include: An advertising information display unit, used to determine the current driving state of the vehicle and display the acquired advertising information to the user based on the current driving state of the vehicle; an acquisition unit, configured to, when receiving an advertisement selection instruction, acquire the advertisement type of the selected advertisement contained in the selection instruction, and acquire the user consumption behavior data of the user from the historical consumption record; An input unit, used to input the user consumption behavior data and the advertisement type of the selected advertisement into a pre-trained preference digital model to obtain purchase channel information of the selected advertisement; wherein the preference digital model is pre-trained using historical consumption behavior data of multiple sample users and various advertisement types; The recommendation unit is used to recommend a purchase channel to the user based on the purchase channel information of the selected advertisement.

7. The device according to claim 6, characterized in that Also includes: The target advertisement acquisition unit is used to acquire each target advertisement from the background when receiving the instruction to watch the advertisement again; wherein each target advertisement is obtained by loading the QR code information corresponding to all the external advertisement boards that can be identified by the vehicle during driving in advance through the image sensor and storing it in the background; The target advertisement display unit is used to display each of the target advertisements to the user.

8. The device according to claim 6, characterized in that Also includes: A judgment unit, configured to judge whether the selected advertisement exceeds the effective time and spatial range of display according to the position information of the current vehicle and the time information of the selected advertisement when no channel click instruction is received or when an advertisement closing instruction is received; a prompting unit, configured to prompt the user with preferential validity information of the selected advertisement by means of an explicit countdown if the selected advertisement does not exceed the displayed validity period and the spatial range; The closing unit is used to close the selected advertisement if the selected advertisement exceeds the effective time and the spatial range of display.

9. The device according to claim 6, characterized in that Also includes: A validity determination unit, used to determine whether the current vehicle is traveling out of a time validity range for displaying the current advertisement; A processing unit, configured to invalidate the current advertisement if the current vehicle travels out of a time limit for displaying the current advertisement; A countdown unit is used to continue to display the current advertisement to the user and to display the countdown of the time limit of the current advertisement if the current vehicle has not traveled beyond the time limit of displaying the current advertisement.

10. The device according to any one of claims 6 to 9, characterized in that: The advertising information display unit comprises: A calculation unit, configured to calculate AR layer information of the advertising information on the 3D display device according to the sight direction of the user, the driving information of the current vehicle, and the basic information of the external billboard corresponding to the acquired advertising information when it is determined that the driving state of the current vehicle is in a stationary state or in an automatic driving state; A special effect advertisement display unit, configured to display the obtained AR layer information of the advertisement information to the user with a 3D visual effect on the 3D display device based on the stationary state or the automatic driving state; The flat advertising display unit is used to display the acquired advertising information to the user with a 2D visual effect on a 3D display device based on the manual driving state when it is determined that the current driving state of the vehicle is in a manual driving state.

Images