Vehicle advertising system and method of use

Abstract

A vehicle advertising system and method of use are provided to improve the effectiveness of mobile advertising. The mobile advertising system includes a non-transitory computer readable medium configured to store commands and a processor coupled to the non-transitory computer readable medium. The processor is configured to execute a command to receive line-of-sight data from a viewing vehicle. The processor is configured to execute a command to receive location information from an advertising vehicle. The processor is configured to execute a command to correlate the line-of-sight data with the location information and determine whether the line-of-sight data indicates a view of an advertisement mounted on the advertising vehicle. The processor is configured to execute a command to update a histogram based on the correlation between the line-of-sight data and the location information. The processor is configured to execute a command to generate a travel plan to improve advertising effectiveness with respect to the advertisement. The processor is configured to execute a command to transmit the travel plan to the advertising vehicle.

Description

Technical Field

[0001] This application relates to U.S. Application No. 17 / 497,846, filed October 8, 2021, the contents of which are incorporated herein by reference in their entirety. Background Technology

[0002] Advertising is often placed in signage around driveways. Recently, it has also been placed along roads and other traffic arteries. Prices for various advertising locations vary based on the anticipated visibility of the advertisement. Advertisers aim to get vehicle occupants, such as drivers, to see the advertisement and purchase the advertised product or service.

[0003] In some cases, fixed or vehicle-mounted electronic signs change periodically, displaying various advertisements at different times. As a result, multiple advertisements can be displayed in the same location using electronic signs. Attached Figure Description

[0004] Figure 1 This is a block diagram of a mobile advertising system implemented using various methods.

[0005] Figure 2 This is a flowchart illustrating a method for advertising using vehicles, implemented through various methods.

[0006] Figure 3 This is a diagram of the data structure of line-of-sight data implemented through various methods.

[0007] Figure 4 This is a flowchart of a method for generating line-of-sight data, implemented through several methods.

[0008] Figure 5 It is a diagram of the data structure of the state of advertising vehicles implemented by some methods.

[0009] Figure 6 This is a flowchart of a method for determining the status of advertising vehicles, implemented through various methods.

[0010] Figure 7 This is a flowchart of a method for using vehicle evaluation advertisements, implemented through several methods.

[0011] Figure 8 It is a diagram of the data structure of trajectory data implemented by some methods.

[0012] Figure 9 This is a diagram of a vehicle's user interface implemented using various methods.

[0013] Figure 10This is a flowchart of a navigation method for advertising vehicles implemented using various methods.

[0014] Figure 11 This is a flowchart of a navigation method for advertising vehicles implemented using various methods.

[0015] Figure 12 This is a diagram of a system for installing vehicle advertising systems, implemented using various methods. Detailed Implementation

[0016] The technical solution disclosed herein is best understood when read in conjunction with the accompanying drawings, and according to the following detailed description. It should be noted that, in accordance with industry standard practice, various functions are not depicted to a fixed scale. In fact, the dimensions of various features can be arbitrarily increased or decreased for clarity of explanation.

[0017] The following disclosure provides numerous different implementations or embodiments for carrying out various functions of the provided subject matter. To simplify this disclosure, constituent elements, values, actions, materials, configurations, or similar examples are described below. These are merely examples and are not intended to be limiting. Other constituent elements, values, actions, materials, configurations, or similar items may also be present. For example, the following description of forming a first function on top of a second function may include implementations where the first and second functions are in direct contact, or implementations where an additional function is formed between the first and second functions so that the first and second functions do not need to be in direct contact. Furthermore, references to numbers and / or words may be repeated in various embodiments. This repetition is for simplification and clarity and does not in itself indicate a relationship between the various implementations and / or configurations discussed.

[0018] Recently, advertisers have been looking to expand their campaigns by incorporating advertisements as part of mobile vehicles, such as cars, trucks, trains, or even aircraft. Vehicle operators can attach one or more advertisements to a vehicle. In some implementations, advertisements are attached using removable methods such as magnets, suction cups, static stickers, temporary adhesives, or other suitable removable mounting options. In some implementations, advertisements are attached using non-removable methods such as permanent adhesives, rivets, or other suitable permanent mounting options. In some implementations, advertisements can be modified to represent the advertised product or service, for example, using electronic tags. In some implementations, multiple advertisements are attached to the same vehicle. For example, in some implementations, a first advertisement is located on the driver's side of the vehicle, and a second advertisement is located on the rear window. In some implementations, each of the multiple advertisements corresponds to the same product or service. In some implementations, at least one of the multiple advertisements is for a different product or service than another.

[0019] Advertisers anticipate that locations with more people are more likely to see their ads and purchase goods or services. However, in reality, advertisers cannot accurately determine who sees these mobile ads and at what frequency. Consequently, advertisers cannot determine how effective their advertising is at attracting customers, nor can they determine whether the cost of advertising on the routes traveled by vehicles carrying the ads matches the expected customer generation. Signage on vehicles traveling in high-traffic or low-traffic areas is presumed to be more valuable than advertising on vehicles traveling on low-traffic or low-traffic areas, but a concrete benchmark of how many potential customers are actually seeing the ads does not exist. Similarly, while routes with slow-moving traffic are presumed to be more valuable than routes with fast-moving traffic, there is no accurate method to measure whether the ads actually attract the attention of many potential customers.

[0020] To provide reliable information for determining whether an advertisement attracts the attention of potential customers, as well as demographic information related to potential customers, a vehicle occupant gaze detection system is used, combining map data and information related to the advertising vehicle, to determine whether the occupants of the viewing vehicle see the moving advertisement. The following description pertains to moving advertisements on vehicles, but those skilled in the art will understand that the vehicle occupant gaze detection system can be applied to various advertising materials, such as stationary signs, signs carried by people, shop window displays, or other related advertisements.

[0021] A vehicle occupant gaze detection system captures images of one or more eyes of vehicle occupants, such as the driver, front passenger, and rear passenger. The system combines these captured images with map data, information related to the advertising vehicle, and / or images from outward-facing detectors installed in the vehicle to determine which mobile advertisement (if any) the occupant viewed for how long. In some implementations, the system also collects occupant-related data, such as predicted age, height, weight, hair length, hair color, and clothing, to estimate the occupant's demographics. Based on this information, the system can generate historical information related to how many people with what demographics viewed the mobile advertisement, or whether the advertiser noticed a possible driving route allocated to the driver for future mobile advertisements. This information can be used by advertisers to determine if the advertisement has had the desired impact. Additionally, this information can be used by rental agencies or vehicle drivers to help determine appropriate pricing for various advertisements and driving routes.

[0022] Figure 1 This is a block diagram of a mobile advertising system 100 implemented using several methods. The description of the mobile advertising system 100 focuses on a driver-controlled vehicle. However, those skilled in the art will recognize that other vehicles and operators, such as trains driven by engineers or other mobile vehicles, are also within the scope of this specification. The mobile advertising system 100 includes a vehicle observation system 110 configured to capture information related to the occupants of the observed vehicle and generate gaze data. The mobile advertising system 100 also includes a server 130 configured to receive the generated gaze data and information related to the advertising vehicle, and determine which advertisement was viewed by the occupants of the observed vehicle and for how long. The mobile advertising system 100 also includes an advertising vehicle system 150 responsible for advertising. The advertising vehicle system 150 is configured to provide information associated with the location and travel path of the advertising vehicle to the server 130, specifying which advertisements to display. The mobile advertising system 100 also includes a banking system 180 enabling advertisers to pay the drivers of the advertising vehicles based on information from the server 130. The mobile advertising system 100 also includes a customer 190 who receives updates on advertising effectiveness, as well as recommendations on pricing and driving routes.

[0023] The vehicle observation system 110 includes: an occupant monitoring camera 112, a front camera 114, a global positioning system (GPS) 116, and an electronic control unit (ECU) 120 configured to receive data from a map 118. The ECU 120 includes a gaze detector 122 configured to receive data from the occupant monitoring camera 112 and detect gaze direction and / or gaze depth based on the received data. The ECU 120 also includes an object detector 124 configured to receive data from the front camera 114 and determine the position of any detected object based on the received data. The ECU 120 further includes a position determination unit 126 configured to receive data from the GPS 116, map 118, object detector 124, and road recognition device (…). Figure 1 (Not shown in the figure) Receives data to determine the position of the observed vehicle relative to the position of detected and / or known objects and / or roads, as well as the posture and state of the observed vehicle. Posture is the orientation of the vehicle relative to a reference point, such as a road. In some embodiments, the position of the observed vehicle also refers to the position vector of the observed vehicle. The posture and state of the observed vehicle refer to the speed and direction of travel of the observed vehicle. In some embodiments, the posture and state of the observed vehicle also refer to the velocity vector, acceleration vector, and jerk vector of the observed vehicle. In some embodiments, the position vector, velocity vector, acceleration vector, and jerk vector include angle vectors. In some embodiments, the state of the observed vehicle also refers to whether the engine or motor of the observed vehicle is operating. The ECU 120 also includes a line-of-sight data generator 128, which is configured to receive information from the line-of-sight detector 122, the object detector 124, and the position determination unit 126 to generate line-of-sight data to be sent to the server 130.

[0024] Occupant monitoring camera 112 is configured to capture images of the driver or other occupants of the observed vehicle. Occupant monitoring camera 112 is connected to the observed vehicle. In some embodiments, occupant monitoring camera 112 includes a visible light camera. In some embodiments, occupant monitoring camera 112 includes an infrared (IR) camera or other suitable sensor. In some embodiments, occupant monitoring camera 112 is movable relative to the observed vehicle to capture images of at least one eye of an occupant of various sizes. It is preferable to capture images of both eyes of the occupant; however, in some cases where the occupant has only one eye or the occupant's head is offset from occupant monitoring camera 112, only one eye of the occupant can be captured by occupant monitoring camera 112. In some embodiments, occupant monitoring camera 112 can be automatically adjusted. In some embodiments, occupant monitoring camera 112 can be manually adjusted. In some embodiments, the captured images include at least one eye of the occupant. In some embodiments, the captured images include additional information related to the occupant, such as approximate height, approximate weight, hair length, hair color, clothing, or other suitable information. In some embodiments, the occupant monitoring camera 112 includes multiple image capturing devices for capturing images of various parts of the occupant. In some embodiments, the occupant monitoring camera 112 is configured in various locations within the vehicle. For example, in some embodiments, a first occupant monitoring camera 112 is configured near the rearview mirror in the center of the vehicle, and a second occupant monitoring camera 112 is configured near the driver's side door. Those skilled in the art will recognize that other locations of the occupant monitoring camera 112 that do not interfere with the operation of the vehicle are within the scope of this disclosure. In some embodiments, data from the occupant monitoring camera 112 includes timestamps or other metadata to facilitate synchronization with other data.

[0025] Those skilled in the art will understand that in some embodiments, the vehicle monitoring system 110 includes additional cameras for monitoring multiple occupants. These additional cameras are identical to the occupant monitoring cameras 112 described above. For example, in some embodiments, one or more monitoring cameras are configured in the vehicle to capture images of at least one eye of a front-seat passenger. In some embodiments, one or more monitoring cameras are configured in the vehicle to capture images of at least one eye of a rear-seat passenger. In some embodiments, the additional cameras are activated only in response to the vehicle detecting a corresponding front-seat or rear-seat passenger. In some embodiments, the vehicle operator can selectively disable the additional cameras. In embodiments including additional cameras, the captured images are still sent to the gaze detector 122, which is capable of generating gaze results regarding the monitored occupants of the vehicle.

[0026] The front-facing camera 114 is configured to capture images of the environment surrounding the observed vehicle. In some embodiments, the front-facing camera 114 includes a visible light camera and an infrared camera. In some embodiments, the front-facing camera 114 is replaced with or includes a LiDAR sensor, a RADAR sensor, a SONAR sensor, or other suitable sensors. In some embodiments, the front-facing camera 114 includes additional cameras located elsewhere on the vehicle. For example, in some embodiments, the additional cameras are positioned on the sides of the vehicle to detect a larger portion of the environment to the left and right of the observed vehicle. Since the occupants of the observed vehicle can observe the outside through the side windows, using additional cameras to detect a larger portion of the environment surrounding the observed vehicle helps improve the accuracy of identifying objects perceived by the occupants. For example, in some embodiments, an additional camera is positioned on the rear side of the observed vehicle to detect a larger portion of the environment behind the observed vehicle. This information helps capture additional objects that occupants other than the driver can perceive through the rear window. Additionally, the front-facing camera 114 can capture images used to determine whether there are obstacles such as a central divider or guardrail between the location of the object, such as the advertising vehicle, and the occupants of the observed vehicle. In some embodiments, the data from the front-facing camera 114 includes timestamps or other metadata to facilitate synchronization between the data from the front-facing camera 114 and the data from the occupant monitoring camera 112.

[0027] GPS 116 is used to determine the location of the observed vehicle. Knowing the location of the observed vehicle helps to associate objects and directions that attract the occupant's attention with objects and areas associated with the identified location of the advertising vehicle on map 118. Knowing the direction of travel of the observed vehicle helps to predict which direction the occupant of the observed vehicle is looking in order to assist in the generation of gaze data. Knowing the speed of the observed vehicle helps to determine how long the occupant of the observed vehicle has the opportunity to view the moving advertisement. For example, sometimes it is determined that an occupant identified as having viewed a moving advertisement for 2 seconds (2s) from an observed vehicle traveling at low speed has less attention to the advertised product or service than an occupant identified as having viewed a moving advertisement for 2 seconds from an observed vehicle traveling at high speed. By taking the vehicle's speed into account when determining attention, false detections of attention can be reduced or avoided. For example, people sitting in traffic jams, even if they are looking out the window, sometimes do not actually care much about the advertisement. In contrast, if people in a fast-moving vehicle spend time viewing the advertisement, it suggests a higher level of attention to the advertisement.

[0028] Map 118 contains information associated with lanes and known objects along the lanes. In some embodiments, map 118 can be used in conjunction with GPS 116 to determine the location and direction of travel of the observed vehicle. In some embodiments, map 118 is received from an external device, such as server 130. In some embodiments, map 118 is periodically updated based on information from front-facing camera 114 and / or GPS 116. In some embodiments, map 118 is periodically updated based on information received from external devices. In some embodiments, map 118 is generated from sensor data using a Simultaneous Localization and Mapping (SLAM) algorithm.

[0029] For the sake of brevity, the following description focuses primarily on the analysis of information associated with the driver. Those skilled in the art will understand that this description is also applicable to other occupants, such as front or rear passengers in the vehicle.

[0030] The gaze detector 122 is configured to receive data from the occupant monitoring camera 112 and generate a gaze detection result. The gaze detection result includes the direction the driver's eyes are looking. In some embodiments, the direction includes azimuth and elevation. Including azimuth and elevation allows for the determination of whether the driver is looking in a direction parallel to or perpendicular to the horizontal line. In some embodiments, the gaze detection result also includes depth information. Depth information is the estimated distance from the driver to the convergent visual axis of their eyes. By including depth information, the distance between the driver and the object being gazed at can be determined. Combining depth information with azimuth and elevation improves the accuracy of the gaze detection result. In some embodiments where the captured image only includes one of the driver's eyes, depth information is difficult to determine, so the gaze detector 122 only determines azimuth and elevation. In some embodiments, the gaze detection result also includes the variance of azimuth, elevation, and depth information, which allows for the estimation of the probability distribution of the area the driver is paying attention to. In some embodiments, the accuracy of the gaze detection results is further improved by applying a probabilistic filter, such as a Kalman filter, to the temporal sequence of the probability distribution. In some embodiments, the gaze detector 122 is further configured to receive data from the front-facing camera 114 and associate the detected gaze with the pixel position of the image from the front-facing camera 114 based on the azimuth and elevation angles.

[0031] In some embodiments, the gaze detector 122 is not installed on the observed vehicle. In some embodiments, the gaze detector 122 is worn by the occupants of the observed vehicle. For example, in some embodiments, the gaze detector 122 includes smart glasses, other smart clothing, or other related devices capable of determining the wearer's gaze information. In some embodiments utilizing smart glasses, gaze data can be collected from pedestrians, cyclists, or other people not riding in the vehicle. The mobile advertising system 100 can utilize this gaze dataset to help determine the effectiveness of mobile advertising.

[0032] Object detector 124 is configured to receive data from front-facing camera 114 and any additional sensors for detecting the environment surrounding the observed vehicle. Based on the received data, object detector 124 identifies objects in the surrounding environment. In some embodiments, object detector 124 is further configured to receive data from GPS 116 and / or map 118, aiding in object identification based on the location of the observed vehicle from GPS 116 and the locations of known objects from map 118. Using information from GPS 116 and map 118 helps reduce the processing load on object detector 124. In some embodiments, object detector 124 is further configured to identify the type of object, such as other vehicles, pedestrians, road signs, advertising signs, advertising signs on advertising vehicles, buildings, etc. Those skilled in the art will understand that if mobile advertising, such as mobile advertising on trucks or buses, exists, this disclosure can also be applied to determine what attracts the vehicle occupants. In some embodiments, camera images are analyzed to determine the presence of mobile advertising. In some embodiments, the location information of the mobile advertisement is combined with data from the advertising vehicle to determine whether an occupant has observed the mobile advertisement. In some embodiments, the advertising vehicle equipped with the advertising sign periodically sends its location information to server 130, where the location information is mapped to gaze data. In some embodiments, object detector 124 outputs received data from front-facing camera 114 and / or received data from additional sensors to gaze data generator 128 and / or position determination unit 126.

[0033] The location determination unit 126 is configured to receive information from the object detector 124, GPS 116, and map 118, and determine the location of the observed vehicle in the world coordinate system, or the location of objects on the map 118, and the location of the observed vehicle associated with objects detected by the object detector 124. In some embodiments, the location determination unit 126 can be used to determine the direction of travel and speed of the observed vehicle. The location determination unit 126 is also configured to determine the state information of the observed vehicle. In some embodiments, the state information includes the speed of the observed vehicle. In some embodiments, the state information includes the velocity vector of the observed vehicle. In some embodiments, the state information includes the direction of travel of the observed vehicle. In some embodiments, the state information includes the acceleration vector of the observed vehicle. In some embodiments, the state information includes the jerk vector of the observed vehicle. In some embodiments, the state information includes whether the engine or motor of the observed vehicle is operating. In some embodiments, the state information includes other state information associated with the observed vehicle, such as the operation of the windshield wipers.

[0034] The gaze data generator 128 is configured to receive gaze results detected by the gaze detector 122, object detection information from the object detector 124, and vehicle position and status information from the position determination unit 126. The gaze data generator 128 detects the line in which the driver's gaze is directed and generates gaze data based on the detected line. Those skilled in the art will understand that the line of the driver's gaze refers to a ray of light or a semi-straight line representing the direction the driver is looking from the point of the driver's eye. The gaze data includes: timestamp information, vehicle information of the observation vehicle system 110, the position of the observed vehicle, and the driver's gaze angle towards the observed vehicle. In some embodiments, the gaze data generator 128 is configured to determine what kind of mobile advertisement (if any) can be seen by the driver. In some embodiments, the gaze data generator 128 is configured to identify any known objects obstructing the driver's view of the mobile advertisement based on the map 118. These obstructed objects are identified, and as a result, these objects can be excluded from consideration during the generation of the gaze data. In some embodiments, the gaze data generator 128 further combines gaze data with the location of objects from either the object detector 124 or the location determination unit 126. In some embodiments, the gaze data generator 128 excludes gaze data associated with mobile advertisements determined to be obscured based on information from the object detector 124 and the location determination unit 126. In some embodiments, an obstacle threshold such as 50% obstruction of the mobile advertisement's area is used by the gaze data generator 128 to determine whether to exclude gaze data associated with obscured mobile advertisements.

[0035] In some embodiments, the gaze data generator 128 is further configured to include an image of at least one driver in the gaze data in order to enable driver demographic analysis based on the captured images. In some embodiments, the gaze data generator 128 is configured to include driver identification data, such as a driver identification number, along with the gaze data in order to enable driver demographic analysis. In some embodiments, the driver identification data is received based on ownership or rental information stored in the ECU 120.

[0036] The gaze data generator 128 outputs gaze data that should be sent to the server 130. In some embodiments, the vehicle observation system 110 sends the gaze data to the server 130 wirelessly. In some embodiments, the vehicle observation system 110 sends the gaze data to the server 130 via a wired connection. In some embodiments, the gaze data generator 128 is configured to send advertising vehicle identification information, such as license plate number or other identification information, to the server 130 so that the server 130 can accurately associate the gaze data with the correct advertising vehicle.

[0037] Server 130 includes map 134. Server 130 also includes attention area analyzer 132 configured to receive line-of-sight data from observation vehicle system 110. Attention area analyzer 132 is also configured to receive information from map 134. Attention area analyzer 132 is configured to receive line-of-sight data and format it. Then, the line-of-sight data is correlated with information from map 134 to determine that the line-of-sight data represents the location being observed by the occupants of the observation vehicle. Server 130 also includes driving path analyzer 136 configured to receive advertising vehicle information from advertising vehicle system 150. Advertising vehicle information includes information such as which advertisement is displayed by the advertising vehicle, the location of the advertising vehicle, the speed of the advertising vehicle, the posture of the advertising vehicle, or other appropriate information related to the advertising vehicle. The driving path analyzer is configured to combine the advertising vehicle information with map 134. Server 130 further includes an attention marker analyzer 138, configured to receive information from attention area analyzer 132 and driving path analyzer 136, determine whether an occupant of the observing vehicle is viewing an advertisement on the advertising vehicle, and if so, determine which advertisement has been viewed for how long. Server 130 also includes a contribution estimator 140 configured to receive information related to the occupants of the observing vehicle viewing advertisements on the advertising vehicle. Contribution estimator 140 is configured to determine, in order to determine the validity of the advertising vehicle, the viewing time of each advertisement on the advertising vehicle. Server 130 further includes a payment system 142 configured to pay the operator of the advertising vehicle based on information from contribution estimator 140.

[0038] In some embodiments, server 130 further includes a memory unit configured to store a histogram generated based on the correlation between gaze data and map 134, and the correlation between gaze data and map 134. This histogram associates the correlation between gaze data and map 134 with additional data such as date, time, demographic data, or other appropriate information. Server 130 also includes an advisor 144 configured to receive information from attention marker analyzer 138. Advisor 144 is configured to analyze the information from attention marker analyzer 138 to determine which type of person, when, and for how long viewed the mobile advertisement. Advisor 144 is also configured to provide updated or new driving plans to the advertising vehicle to improve the effectiveness of the advertising vehicle when the advertisement displayed on the advertising vehicle is viewed.

[0039] Map 134 contains information related to lanes and known objects along the lanes. In some embodiments, map 134 includes additional information beyond the lanes, such as train tracks or other suitable information. In some embodiments, map 134 also includes traffic light-related information that may affect the stopping time of the advertising vehicle system 150, such as location and lighting schedule. In some embodiments, map 134 also includes information on traffic signs that may affect the stopping time of the advertising vehicle system 150, such as stop signs. In some embodiments, map 134 is the same as map 118. In some embodiments, map 134 has a higher level of detail than map 118. In some embodiments, map 134 is received from an external device. In some embodiments, map 134 is periodically sent to the observation vehicle system 110 to update map 118. In some embodiments, map 134 is periodically updated based on update information received through server 130.

[0040] Note that the area analyzer 132 is configured to correlate received gaze data with map 134 in order to determine the direction of the driver's gaze. In some embodiments, this correlation is stored as a correlation between gaze data and map 134 based on multiple grid points. Each grid point includes, for example, location information related to position coordinates such as X, Y, and Z, as well as azimuth and elevation angles. Information related to how long the driver's gaze has been contained within the area defined by the location information for each grid point is also included. In some embodiments, the location information used for the correlation between gaze data and map 134 is determined based on known objects from map 134 and / or objects detected in the gaze data. In some embodiments, only grid points with gaze durations exceeding a threshold are included in the correlation between gaze data and map 134. In some embodiments, the threshold is adjusted based on vehicle status information from location determination unit 126. For example, in some embodiments, as vehicle speed increases, the threshold gaze duration decreases, taking into account the shorter time that mobile advertisements will be within the driver's potential field of vision. When the correlation between the line-of-sight data and map 134 is generated, the correlation is stored in a memory unit. In some embodiments, the correlation between the line-of-sight data and map 134 can be displayed individually upon request from a user such as advertiser 192 or advertising agency 194. In some embodiments, the correlation between the line-of-sight data and map 134 can be customized to include only grid points associated with a specific user such as advertiser 192 or advertising agency 194. In some embodiments, the correlation between the line-of-sight data and map 134 can be customized to include only grid points of selected users. In some embodiments, the selected users include competitors of advertiser 192.

[0041] In some implementations, a grid map is generated using grid points to visualize the correlation between the received line-of-sight data and map 134. In some implementations, the state information of points in the grid map is determined based on known objects from map 134 and / or objects detected in the line-of-sight data. When the grid map is generated, it is stored in a memory unit. When additional line-of-sight data is received by server 130, the grid map is updated to include new grid points, or information associated with existing grid points is updated. Updating the grid map includes updating the state information for at least one point within the grid map. For example, when a vehicle moves relative to other objects, the positional relationship between the vehicle and other objects changes. Consequently, the state information of various points in the grid map changes.

[0042] When additional line-of-sight data is received via server 130, the correlation between the line-of-sight data and map 134 is updated to include new grid points, or information associated with existing grid points is updated. In some embodiments, the attention area analyzer 132 is configured to generate a correlation between line-of-sight data and map 134 for a single observing vehicle. In some embodiments, the attention area analyzer 132 is configured to generate a correlation between line-of-sight data and map 134 for multiple observing vehicles. In some embodiments, the attention area analyzer 132 is configured to generate a correlation between line-of-sight data and map 134 for a predetermined geographical area defined by map 134. In some embodiments, the attention area analyzer 132 is configured to generate and manage multiple correlations, such as a first correlation relative to a first geographical area, a second correlation relative to a second geographical area, and a third correlation relative to a specific group of observing vehicles.

[0043] In some embodiments, server 130 includes a memory unit configured to store the correlation between line-of-sight data and map 134, as well as a histogram. In some embodiments, the memory unit is also configured to store additional information, such as line-of-sight data and map 134. In some embodiments, the memory unit includes a solid-state memory device. In some embodiments, the memory unit includes dynamic random access memory (DRAM). In some embodiments, the memory unit includes a non-volatile memory device. In some embodiments, the memory unit includes cloud-based storage or other suitable storage configurations.

[0044] The driving path analyzer 136 is configured to receive the location and vehicle information of the advertising vehicles from the advertising vehicle system 150. The driving path analyzer 136 is configured to determine the trajectory of the advertising vehicles relative to map 134 at various points in time. In some embodiments, the trajectory includes places the vehicle has previously passed. In some embodiments, the trajectory includes a predicted trajectory the vehicle will take. In some embodiments, the driving path analyzer 136 is configured to determine the trajectory of the advertising vehicles in real time. In some embodiments, the driving path analyzer 136 is configured to determine at least partially completed driving paths of the advertising vehicles. In some embodiments, since the driving path analyzer 136 is configured to periodically receive information associated with the advertising vehicles, it periodically performs trajectory determination for the advertising vehicles.

[0045] Attention marker analyzer 138 is configured to correlate the trajectory of advertising vehicles at various time points with information generated by attention region analyzer 132, such as the correlation between gaze data and map 134. Attention marker analyzer 138 is configured to generate histograms based on the correlations to determine the effectiveness of mobile advertising. In some embodiments, attention marker analyzer 138 generates histograms based on time, weather conditions, marker location, marker angle relative to the vehicle's direction of travel, demographic information, or other suitable benchmarks. In some embodiments, demographic information is based on driver identification information associated with log entries in the grid points of the correlation between gaze data and map 134. In some embodiments, demographic information is extracted based on driver features from captured images associated with log entries in the grid points of the correlation between gaze data and map 134. For example, if the captured image of the driver indicates a person with facial hair, then the driver is identified as male in some cases. Other body features can be used to determine other demographic information. In some embodiments, the learned neural network can be used to extract demographic information based on captured images. In some embodiments, the attention marker analyzer 138 is configured to generate a histogram for a single observed vehicle. In some embodiments, the attention marker analyzer 138 is configured to generate histograms for multiple observed vehicles. In some embodiments, the attention marker analyzer 138 is configured to generate a histogram for a predetermined geographic area. In some embodiments, the attention marker analyzer 138 is configured to generate multiple histograms, for example, a first histogram for a first geographic area, a second histogram for a second geographic area, and a third histogram for a specific group of vehicles, etc. In some embodiments, the attention marker analyzer 138 continuously updates the histogram as new correlations between gaze data and map 134 data become available. In some embodiments, the attention marker analyzer 138 is configured to generate new histograms based on requested parameters received from customer 190. In some embodiments, the histogram contains information about which driver of the advertising vehicle 150 attracted what degree of attention. In some implementations, the histogram contains information about which type of vehicle attracts the most attention and to what extent.

[0046] In some embodiments, the advertising vehicle includes two or more advertisements installed on the vehicle. To determine which advertisement draws the eye of an occupant observing the vehicle, the attention marker analyzer 138 is configured to determine which area of ​​the advertising vehicle the occupant's gaze is directed towards. The correlation between gaze data and map 134 is combined with information about the advertising vehicle to identify the area of ​​the advertising vehicle that drew the occupant's gaze. Then, information related to the advertising vehicle is used to determine which advertisement is located within the advertising vehicle's viewing area. In some embodiments, advertisements within the advertising vehicle's viewing area are identified based on information received from the observing vehicle system 110, such as images from the front-facing camera 114.

[0047] The contribution estimator 140 uses a histogram generated by the attention marker analyzer 138 to determine the number of views per advertisement installed on the advertising vehicle. Based on the number of views per advertisement, the contribution estimator 140 can determine the payment amount that the operator of the advertising vehicle should be paid. In some embodiments, the payment amount is determined purely based on the number of views. In some embodiments, the payment amount is determined based on additional factors, such as whether the viewer belongs to the target group, the time of the view, the duration of the advertisement view, the location where the advertisement view is detected, or other appropriate additional factors. People in the target group who view the advertisement are more likely to become customers than those who do not belong to the target group. Therefore, in some embodiments, detected views performed by people in the target group have a higher payment amount than detected views performed by people who do not belong to the target group. The time of the view can affect the probability of purchase. For example, an advertisement for a restaurant viewed close to mealtime is more likely to generate restaurant support than an advertisement for a restaurant viewed outside of mealtime. Therefore, in some embodiments, the payment to the operator of the advertising vehicle varies depending on the timing of the detected viewing. The longer a person views the advertisement, the higher the likelihood of a purchase. Therefore, in some embodiments, the payment increases with the length of time the advertisement's viewing is detected. An advertisement viewed near the advertised business is more likely to result in the person visiting the advertised business. Therefore, in some embodiments, the payment increases with increasing proximity to the advertised business.

[0048] Payment system 142 is configured to receive payment amounts from contribution estimator 140 and, based on the payment amount, move funds to the bank account of the operator of the advertising vehicle. In some embodiments, payment system 142 can access accounts that can be controlled by the customer 190 or a third-party intermediary. Payment system 142 is configured to move money from the account of the customer 190 or a third party to the account of the operator of the advertising vehicle. In some embodiments, the operator's account is the account of the driver of the advertising vehicle. In some embodiments, the operator's account is the account of the company where the driver works. In some embodiments, funds are transmitted wirelessly. In some embodiments, funds are transmitted via signals received through a wired connection.

[0049] Advertising consultant 144 is configured to receive a histogram and extract information to determine which mobile advertisement is viewed most frequently and / or for the longest time. Obtaining information related to the areas of attention of vehicle occupants helps identify locations for future advertising. Advertising consultant 144 is configured to provide the extracted information to customer 190. In some embodiments, advertising consultant 144 is configured to receive a data request from customer 190 and extract information from the histogram based on the received data request. In some embodiments, the data request includes: the type of product or service on a particular sign, the driving path that generates the most views, the area of ​​the advertising vehicle most frequently viewed, or other benchmark-related information. Advertising consultant 144 extracts demographic information to identify people who show interest in the corresponding product or service. In some embodiments, the product or service on the sign is extracted based on data captured by front-facing camera 114.

[0050] In some implementations, the mobile advertisement includes an electronic identifier that changes the advertisement periodically. In some implementations, the advertising consultant 144 associates timestamp information from a histogram with the advertisement displayed by the electronic identifier during the corresponding timestamp period to determine which advertisement has attracted the attention of the occupants of the observing vehicle.

[0051] Advertising consultant 144 outputs histogram information to be sent to customer 190. In some embodiments, server 130 sends the histogram information to customer 190 wirelessly. In some embodiments, server 130 sends the histogram information to customer 190 via a wired connection. In some embodiments, server 130 commands a printer to print the histogram information and provides the printed information to customer 190.

[0052] The advertising vehicle system 150 is configured to provide driver 170 with information to encourage driver 170 to drive the advertising vehicle in a manner that enhances the effectiveness of mobile advertising. The advertising vehicle system 150 includes a driving plan receiver 152 configured to receive driving plans proposed by advertising consultant 144 from server 130. The advertising vehicle system 150 also includes a status notification device 154 configured to send advertising vehicle information to server 130. The advertising vehicle system 150 further includes a navigation system 156 configured to receive driving plans recommended by the driving plan receiver 152, and map information and location information from a Global Positioning System (GPS) 160. The advertising vehicle system 150 also includes a user interface (UI) 158 configured to provide information to driver 170 and receive input information from driver 170. The advertising vehicle system 150 also includes GPS configured to provide map information and location information to navigation system 156 and location determination unit 164. The advertising vehicle system 150 also includes sensors 162 configured to detect the vicinity of the advertising vehicle. The location determination unit 164 is configured to determine the location and orientation of the advertising vehicle based on information from GPS 160 and sensor 162. The advertising vehicle system 150 also includes information related to the advertisement 166 displayed on the advertising vehicle. In some embodiments, information about the advertisement 166 is stored in a memory. In some embodiments, information about the advertisement 166 is received from the driver 170 via UI 158. In some embodiments where the advertising vehicle includes electronic tags or other adjustable advertisements, information about the advertisement 166 is updated, for example, using Bluetooth (registered trademark), WiFi (registered trademark), or other communication protocols, based on communication with the adjustable advertisement.

[0053] The driving plan receiver 152 is configured to receive a proposed driving route for the advertising vehicle based on information from the advertising consultant 144. The proposed driving route is a route recommended by the advertising consultant 144. The proposed driving route is determined to maximize the effectiveness of the advertising on the advertising vehicle. In some embodiments where the driver can access multiple advertisements or where the advertisements are adjustable, the proposed driving route includes information related to the recommended advertisements to be displayed on the advertising vehicle. In some embodiments, the advertising consultant 144 receives information related to advertisement 166 via a status notification device 154.

[0054] Status notification device 154 is configured to provide advertising vehicle information to server 130. In some embodiments, the advertising vehicle information includes: the location of the advertising vehicle, vehicle posture, information related to the advertisement 166, identification information about the advertising vehicle, identification information about the driver 170, or other suitable information. In some embodiments, status notification device 154 is configured to provide the advertising vehicle information to server 130 wirelessly. In some embodiments, status notification device 154 is configured to provide the advertising vehicle information to server 130 via a wired connection.

[0055] Navigation system 156 is configured to receive a proposed driving route from driving plan receiver 152, map information from GPS 160, and location information, thereby planning a driving route along the lanes used to implement the proposed driving route. Navigation system 156 is configured to issue a command to display the driving route to driver 170 via UI 158. In some embodiments, navigation system 156 is configured to respond to acceptance of the driving route received from driver 170 via UI 158 by instructing driver 170 to execute the driving route. In some embodiments where the advertising vehicle has autonomous driving capabilities, navigation system 156 is configured to respond to acceptance received from driver 170 via UI 158 by providing instructions to the transmission and steering systems within the advertising vehicle, or by implementing the driving route. In some embodiments, even when driver 170 is driving towards a destination for purposes other than advertising, driver 170 can obtain supplementary advertising income in their daily life by having navigation system 156 propose the optimal route for the most effective advertising.

[0056] UI 158 is configured to provide information to driver 170 and receive instructions from driver 170. In some embodiments, UI 158 includes a device integrated with the advertising vehicle. In some embodiments, UI 158 includes a touchscreen. In some embodiments, UI 158 includes a mobile device, such as a smartphone that is not integrated with the advertising vehicle.

[0057] GPS 160 is configured to store map and lane-related information. GPS 160 is configured to receive location information. GPS 160 is configured to share map and location information with navigation system 156. In some embodiments, GPS 160 is integrated with UI 158. In some embodiments, GPS 160 is separate from UI 158.

[0058] Sensor 162 is configured to capture images of the environment surrounding the advertising vehicle. In some embodiments, sensor 162 is the same as front-facing camera 114. In some embodiments, sensor 162 is different from front-facing camera 114. In some embodiments, sensor 162 includes multiple sensing elements in multiple locations of the advertising vehicle. In some embodiments, sensor 162 includes a single sensor.

[0059] The location determination unit 164 is configured to receive information from GPS 160 and sensor 162, determine the location of the advertising vehicle in the world coordinate system, or observe the location of the vehicle relative to objects on GPS 160 and objects detected by sensor 162. In some embodiments, sensor 162 is the same as location determination unit 126. In some embodiments, sensor 162 is different from location determination unit 126.

[0060] Information related to advertisement 166 can be used to help server 130 determine what kind of advertisement should be displayed on the advertising vehicle and the area of ​​the vehicle displaying the advertisement. In some embodiments where the advertising vehicle can display multiple advertisements, driver 170 can input information related to advertisement 166 via UI 158. In some embodiments where the advertisement is an adjustable advertisement, the information related to advertisement 166 provides information about the timing and order of the advertisements displayed on the vehicle. In some embodiments, the information related to advertisement 166 can be updated by driver 170 via, for example, UI 158. In some embodiments, the information related to advertisement 166 can be updated based on information received from server 130 or other external devices. In some embodiments, the driving plan receiver 152 contains an indication of what kind of advertisement should be displayed as an adjustable advertisement.

[0061] Banking system 180 includes financial services capable of receiving payments to operators of advertising vehicles based on instructions received from server 130. In some embodiments, payments include currency, cryptocurrency, or other electronic payment options. Banking system 180 includes an operator bank account 182 accessible to the operator of the advertising vehicle. In some embodiments, operator bank account 182 is accessible to the driver 170. In some embodiments, operator bank account 182 is accessible to the owner of the advertising vehicle.

[0062] Customer 190 includes an advertising sponsor 192 who advertises (promotes) products or services. Customer 190 also includes an advertising agency 194 that supports (assists) the advertising sponsor 192 in selling products or services in the market. In some embodiments, the advertising agency 194 includes a company that has a contract to lease advertising vehicles used to display mobile advertisements. In some embodiments, customer 190 includes other persons, businesses, or agencies. For example, in some embodiments, customer 190 includes a government agency that licenses additional advertising options or can use information from advertising consultant 144 to determine whether any advertising option poses a risk of excessively distracting the driver. In some embodiments, customer 190 provides a data request to server 130 with information about a specific logo, advertising sponsor 192, or other desired data. In some embodiments, the data request is sent wirelessly to server 130. In some embodiments, the data request is sent to server 130 via a wired connection.

[0063] By outputting histogram information to customer 190, mobile advertising system 100 can use real detection data to determine the effectiveness of advertising in attracting the attention of vehicle occupants. This effectiveness information can be used to support advertiser 192 in allocating resources more effectively. This effectiveness information can also be used by advertising agency 194 to set pricing options for various mobile advertising options that correspond to the actual attention given by vehicle occupants. Furthermore, by regularly updating the histogram, or by utilizing new gaze data, advertiser 192 and advertising agency 194 can identify consumer preferences without directly surveying consumers.

[0064] Figure 2 This is a flowchart of a method 200 for advertising using vehicles, implemented through some embodiments. In some embodiments, method 200 uses a mobile advertising system 100 (… Figure 1 ) and is implemented. In some implementations, method 200 uses server 130 ( Figure 1 ) and is implemented. In some implementations, method 200 uses system 1200 ( Figure 12 And thus implemented.

[0065] In action 205, gaze data of an occupant of the observed vehicle is received. In some embodiments, the occupant is the driver of the observed vehicle. In some embodiments, the occupant is not the driver of the observed vehicle. In some embodiments, the gaze data is received based on information from a device installed in the observed vehicle. In some embodiments, the gaze data is received based on information detachable from the observed vehicle, such as smart glasses. In some embodiments where the gaze data is received based on information from smart glasses, the occupant is not inside the observed vehicle but is riding a bicycle or a pedestrian. The gaze data includes information about the angle of the occupant's gaze towards the observed vehicle and the time at which the gaze data is collected. In some embodiments, the gaze data also includes information about known or detected objects in the environment surrounding the observed vehicle. In some embodiments, the gaze data is received wirelessly. In some embodiments, the gaze data is received via a wired connection. In some embodiments, the gaze data is transmitted via an attention area analyzer 132 (…). Figure 1 (and was received.)

[0066] In action 210, the status of the advertising vehicle is received. The status of the advertising vehicle includes information about its location and posture. The status also includes time information related to its location and posture. In some embodiments, the status of the advertising vehicle includes information about the content of the advertisements on the advertising vehicle. In some embodiments, the status includes information about the location of the advertisements on the advertising vehicle. In some embodiments, the status includes information about multiple advertisements on the advertising vehicle and the locations of each advertisement. In some embodiments, the status also includes information about whether the engine or motor of the advertising vehicle is operating. In some embodiments, the status of the advertising vehicle is received wirelessly. In some embodiments, the status of the advertising vehicle is received via a wired connection. In some embodiments, the status of the advertising vehicle is received via a driving path analyzer 136 (…). Figure 1 (and was received.)

[0067] In action 215, trajectory data is generated based on the state of the advertising vehicle. The trajectory data can be used to determine the real-world orientation of the advertising vehicle relative to known objects. In some implementations, the trajectory data is generated based on a known driving plan of the advertising vehicle. In some implementations, the trajectory data uses a driving path analyzer 136 (… Figure 1 It is generated by ).

[0068] In action 220, the trajectory data is correlated with the received gaze data. Correlating the trajectory data with the received gaze data allows for the determination of whether the gaze data indicates that an occupant has viewed an advertisement installed on the advertising vehicle. In some embodiments where the advertising vehicle has multiple advertisements, the correlation is further based on information about which part of the advertising vehicle was viewed by an occupant observing the vehicle, and the location of the advertisement on the advertising vehicle, to identify which advertisement was viewed by the occupant. In some embodiments, an attention marker analyzer 138 is used. Figure 1 This allows the trajectory data to be correlated with the received line-of-sight data.

[0069] In action 225, the histogram is generated based on the correlation between trajectory data and received line-of-sight data. The histogram associates the correlation between line-of-sight data and map data with additional data, such as date, time, demographic data, or other suitable information. In some embodiments, the histogram is based on time period, weather conditions, location of the sign, angle of the sign relative to the vehicle's direction of travel, demographic information, or other suitable references. In some embodiments, the histogram uses attention sign analyzer 138 (… Figure 1 It is generated by ).

[0070] In action 230, the driving plan of the advertising vehicle is updated based on a histogram. Updating the driving plan improves the effectiveness of the mobile advertising on the advertising vehicle. The driving plan is updated in a manner that ensures the mobile advertising travels to locations with a high probability of reaching the target layer of the mobile advertising. In some embodiments, the updated driving plan is intended for immediate implementation. In some embodiments, the updated driving plan is intended for further implementation; in some cases, the updated driving plan means it can be used for the next drive of the advertising vehicle. In some embodiments, the updated driving plan includes: the time of commencement of driving, the desired speed to be maintained during the implementation of the updated driving plan, the requested location of the mobile advertising on the advertising vehicle, or other appropriate information. In some embodiments, the updated driving plan is implemented by the driver or operator of the advertising vehicle. In some embodiments where the advertising vehicle is capable of autonomous driving, the updated driving plan includes commands that can be executed by the autonomous driving vehicle to enable the autonomous driving vehicle to implement the updated driving plan. In some embodiments, the driving plan uses advertising advisor 144 (… Figure 1 It was updated.

[0071] In action 235, the update is sent to the customer. In some implementations, the customer includes customer 190 ( Figure 1In some embodiments, the update includes histogram-based information to notify customers of mobile ad views, demographics of mobile ad viewers, duration of mobile ad views, location of mobile ad views, or other appropriate information. In some embodiments, the update is transmitted wirelessly. In some embodiments, the update is transmitted via a wired connection. In some embodiments, the update includes a response to a data request received from a customer. In some embodiments, the update is received from advertising advisor 144 (…). Figure 1 )send.

[0072] In action 240, an update regarding the proposed fees for mobile advertising is sent to the customer. In some implementations, the customer includes customer 190 ( Figure 1 In some implementations, the updated cost is determined based on the number of mobile ad views, the demographics of the mobile ad viewers, the duration of mobile ad views, or other appropriate information. In some implementations, the updated cost is determined by advertising advisor 144 (…). Figure 1 The cost is determined by [the system / mechanism]. In some implementations, the cost update is sent wirelessly. In some implementations, the cost update is sent via a wired connection. In some implementations, the updated cost is displayed using advertising advisor 144. Figure 1 In some implementations, the updated fee is sent in response to a request from a customer. In some implementations, the updated fee is sent in response to a request from the driver or operator of the advertising vehicle.

[0073] In action 245, the updated driving plan is sent to the advertising vehicle. In some embodiments, the updated driving plan is sent wirelessly. In some embodiments, the updated driving plan is sent via a wired connection. In some embodiments, the updated driving plan is sent via advertising advisor 144 (… Figure 1 It was sent.

[0074] Those skilled in the art will understand that modifications to method 200 are included within the scope of this specification. In some embodiments, additional actions are included in method 200. For example, in some embodiments, method 200 includes: transmitting a payment order to a banking system and making payment to the driver or operator of the advertising vehicle. In some embodiments, at least one action of method 200 is omitted. For example, in some embodiments, action 210 is omitted, and the recognition of the advertisement is determined based on image data received along with gaze data. In some embodiments, the order of actions of method 200 is adjusted. For example, in some embodiments, updates to customers are sent before the updated driving plan is generated.

[0075] Figure 3 This is a diagram of a data structure 300 for line-of-sight data implemented through some embodiments. In some embodiments, data structure 300 is associated with the data transmitted from the observation vehicle system 110 to the server 130. Figure 1 The data structure 300 corresponds to the gaze data sent by server 130. In some implementations, the data structure 300 corresponds to the gaze data sent by server 130. Figure 1 The system uses eye-tracking data to determine whether a mobile advertisement has been recognized, generates a driving plan, provides payment instructions to the driver or operator of the advertising vehicle, or provides recommendations to the customer.

[0076] The data structure 300 for gaze data includes timestamp information 305. Timestamp information 305 indicates the moment the gaze data was collected. Data structure 300 also includes vehicle information 310. Vehicle information 310 indicates the type of vehicle being observed, such as a car, motorcycle, pedestrian, or bicycle. Data structure 300 also includes vehicle location information 315. Vehicle location information 315 indicates the location and orientation of the observed vehicle in the real world. In some implementations, the location and orientation are determined based on map data relative to the location of known objects. Data structure 300 also includes a gaze angle 320 relative to the vehicle's location. Gazing angle 320 indicates the direction the occupant is looking relative to the orientation of the observed vehicle. Data structure 300 also includes the location of an advertisement 325. The location of the advertisement 325 indicates the time at which the data was collected by a sensor of the observed vehicle, such as the front-facing camera 114, at a time consistent with timestamp information 305. Figure 1 The data structure 300 also includes advertisement type information 330. Advertisement type information 330 indicates whether the mobile advertisement is installed on an advertising vehicle sign, is displayed on the roof of the advertising vehicle, or is other appropriate information. In some embodiments, advertisement type information 330 indicates the size of the mobile advertisement relative to the advertising vehicle. In some embodiments, advertisement type information 330 is based on the use of sensors observing the vehicle, such as a front-facing camera 114. Figure 1 The data structure 300 is determined by data received from sources such as (e.g., the front-facing camera 114). The data structure 300 also includes an area 335 that has attracted attention. The area 335 represents the region of the advertising vehicle that has attracted the attention of the occupant, who is a data source of visual information. In some embodiments, the area 335 that has attracted attention is based on the use of sensors observing the vehicle, such as the front-facing camera 114. Figure 1 The data received is judged based on the data received, such as ) etc.

[0077] Data structure 300 is merely illustrative, and those skilled in the art will understand that various types of information can be included in the gaze data. In some embodiments, at least one of the constituent elements is excluded from data structure 300. For example, in some embodiments, the area 335 that attracts attention is excluded from data structure 300. In some embodiments, additional information is included in data structure 300. For example, in some embodiments, data structure 300 also includes occupant demographic information as a gaze data source.

[0078] Figure 4 This is a flowchart illustrating a method for generating gaze data implemented through several embodiments. In some embodiments, method 400 uses a mobile advertising system 100 (… Figure 1 In some implementations, method 400 uses the observation vehicle system 110 ( Figure 1 ) and implemented. In some implementations, method 400 uses system 1200 ( Figure 12 And thus implemented.

[0079] In action 405, occupant-related information is, for example, obtained from occupant surveillance camera 112 ( Figure 1 The information is received by surveillance cameras such as [e.g., cameras]. In some embodiments, the information includes images captured using a single image capture device. In some embodiments, the information includes images captured using multiple image capture devices. In some embodiments, the image capture devices are configured in various positions relative to the occupant. In some embodiments, at least one of the image capture devices can be selectively deactivated.

[0080] In action 410, the occupant's gaze is detected based on received information. In some embodiments, the occupant's gaze is detected based on the azimuth and elevation angles of the occupant's eyes, which are detected based on a captured image of the occupant. In some embodiments, additionally, the occupant's gaze is detected based on depth coordinates determined based on the visual axis of the occupant's eyes in a captured image of the driver. In some embodiments, the occupant's gaze is based on information from, for example, a front-facing camera 114 observing the vehicle. Figure 1 Information from cameras such as [camera name missing] is detected, and the gaze is associated with the pixel position of the image captured by the camera. In some embodiments, action 410 is performed based on data collected by action 415. In some embodiments, the occupant's gaze is detected, for example, using a gaze detector 122. Figure 1 It is detected by line-of-sight detectors such as those used for visual detection.

[0081] In action 415, information about the environment surrounding the vehicle is received from the front-facing camera. This information is received using one or more sensors mounted on the vehicle. In some embodiments, the sensors include: a visible light camera, an infrared camera, a LiDAR sensor, a RADAR sensor, a SONAR sensor, or other suitable sensors. In some embodiments, the sensor includes a front-facing camera 114. Figure 1 In some implementations, the information from action 415 is used in action 410 to associate the occupant's line of sight with the information from action 415.

[0082] In action 420, the object is detected based on data collected by action 415. In some embodiments, the object is detected using a neural network that has been trained to analyze data from action 415. In some embodiments, the object is detected, for example, using object detector 124. Figure 1 The object is detected by an object detector such as a Single Mapping Detector (SSD) or Faster R-CNN. In some embodiments, the neural network of the object detector 124 uses a neural network architecture, such as a Single Mapping Detector (SSD), Faster R-CNN, etc. In some embodiments, in addition to detecting the position of the object, action 420 also includes detecting the angle of the object relative to the observed vehicle.

[0083] In action 425, the location of the observed vehicle in the world coordinate system or the location of the observed vehicle relative to the object detected in action 420 is determined. In some embodiments, action 425 also determines the state information of the observed vehicle. In some embodiments, the state information includes the speed of the observed vehicle. In some embodiments, the state information includes the velocity vector of the observed vehicle. In some embodiments, the state information includes the direction of travel of the observed vehicle. In some embodiments, the state information includes the acceleration vector of the observed vehicle. In some embodiments, the state information includes the jerk vector of the observed vehicle. In some embodiments, the state information includes whether the engine or motor of the observed vehicle is operating. In some embodiments, the state information includes other state information related to the observed vehicle, such as changes in speed (acceleration), operation of the windshield wipers, etc. In some embodiments, action 425 uses, for example, a position determination unit 126 ( Figure 1 The location determination unit, etc., is implemented.

[0084] In action 430, the object pointed to by the detected gaze is identified. The object is identified by associating the detected container (case) with the detected object. The detected gaze is mapped to the surrounding environment, and the intersection between the gaze and the detected object is identified. In some embodiments, action 430 uses position determination unit 126 ( Figure 1 And thus implemented.

[0085] In action 435, the region of the object pointed to by the detected gaze is identified. The region is identified by associating the detected container with the detected object. The detected gaze is mapped to the surrounding environment, and the intersection between the gaze and a portion of the detected object is identified. In some embodiments, the information from action 415 lacks sufficient resolution for accurate implementation of action 435, and action 435 is omitted. In some embodiments, action 435 uses position determination unit 126 ( Figure 1 And thus implemented.

[0086] In action 440, gaze data is generated based on data from actions 410, 420, and 425. The gaze data is generated, for example, using gaze data generator 128. Figure 1 The gaze data is generated by a gaze data generator. In some embodiments, actions 430 and / or 435 are also used to generate gaze data. In some embodiments, the gaze data includes: timestamp information, vehicle information of the vehicle system, the position of the observed vehicle, and the occupant's gaze angle relative to the observed vehicle. In some embodiments, the gaze data also links the gaze data to the location of any of the objects in actions 430 and / or 435. In some embodiments, action 440 determines what kind of mobile advertisement (if any) can be seen by the occupant. In some embodiments, action 440 identifies objects obscured by other objects that would prevent the occupant from seeing the obscured object. In some embodiments, the gaze data excludes gaze data related to objects identified as obscured based on information from actions 420 and / or 425. In some embodiments, the gaze data includes information about a second vehicle displaying the mobile advertisement (e.g., location, license plate ID, etc.).

[0087] In some embodiments, the gaze data further includes at least one image of the occupant in order to enable occupant demographic analysis based on the captured images. In some embodiments, the gaze data includes occupant identification data, such as an occupant identification number, in order to enable occupant demographic analysis. In some embodiments, the occupant identification data is received based on ownership or rental information from internal memory or external devices.

[0088] In action 445, the gaze data generated in action 440 is sent to server 130, for example. Figure 1 Servers such as [server name missing]. In some implementations, gaze data is transmitted wirelessly. In other implementations, gaze data is transmitted via a wired connection.

[0089] In some embodiments, additional actions are included in method 400. For example, in some embodiments, method 400 includes generating driver demographic information based on captured images of the driver. In some embodiments, the order of actions in method 400 is changed. For example, in some embodiments, the identification of objects that attract gaze is performed after gaze data is sent to the server. In some embodiments, at least one action in method 400 is omitted. For example, in some embodiments, action 430 or action 435 is omitted or performed by the server.

[0090] Figure 5 This is a diagram of a data structure 500 representing the state of an advertising vehicle, implemented through various methods. In some implementations, data structure 500 corresponds to the data transmitted from the advertising vehicle system 150 to the server 130. Figure 1 The status of the advertising vehicle sent by the server 130. In some implementations, data structure 500 corresponds to: determining whether a mobile advertisement has been viewed, generating a driving plan, providing a payment order to the driver or operator of the advertising vehicle, or providing recommendations to customers. Figure 1 The status of the advertising vehicle data used.

[0091] Data structure 500 includes timestamp information 505. Timestamp information 505 indicates the time corresponding to the location, posture, and other data related to the received advertising vehicle. Data structure 500 also includes vehicle information 510. Vehicle information 510 indicates whether the engine or motor of the advertising vehicle is working, the location of the displayed advertisement, or other appropriate information. Data structure 500 also includes vehicle location information 515. Vehicle location information 515 includes location information and posture information of the advertising vehicle. Data structure 500 also includes the type of advertising display information 520. The type of advertising display information 520 indicates the content and structure of the mobile advertisement installed on the advertising vehicle. In some embodiments where the advertisement is an adjustable advertisement, the type of advertising display information 520 indicates the order and timing of various advertisements displayed through the adjustable advertisement. In some embodiments, the advertising vehicle 150 is shared by multiple drivers, and data structure 500 includes identification information of the driver driving the vehicle to help ensure that the correct driver receives credit.

[0092] Data structure 500 is merely illustrative, and those skilled in the art will understand that various types of information can be included in the line-of-sight data. In some embodiments, at least one of the constituent elements is excluded from data structure 500. For example, in some embodiments, vehicle information 310 is excluded from data structure 500. In some embodiments, additional information is included in data structure 500. For example, in some embodiments, data structure 500 also includes driver identification information of the advertising vehicle.

[0093] Figure 6 This is a flowchart of a method 600 for determining the status of an advertising vehicle, implemented through several embodiments. In some embodiments, method 600 uses a mobile advertising system 100 (… Figure 1 ) and implemented. In some implementations, method 600 uses advertising vehicle system 150 ( Figure 1 ) and is implemented. In some implementations, method 600 uses system 1200 ( Figure 12 And thus implemented.

[0094] In action 605, GPS data is received. The GPS data is received to determine the position of the advertising vehicle relative to other known objects in the real world. In some embodiments, the GPS data is received from a device external to the advertising vehicle. In some embodiments, the GPS data is received from a GPS sensor inside the advertising vehicle. In some embodiments, the GPS data is received from a GPS160 (… Figure 1 ) received. In some implementations, GPS data is received via navigation system 156 ( Figure 1 The GPS data is received by the location determination unit 164 in some embodiments. Figure 1 (and was received.)

[0095] In action 610, the vehicle position and orientation of the advertising vehicle are determined based on received GPS data. In some embodiments, the vehicle position and orientation are based, for example, on data from sensor 162 (…). Figure 1 The vehicle position and attitude are determined by sensor data from the position determination unit 164. In some embodiments, the vehicle position and attitude are determined by the position determination unit 164. Figure 1 They were sentenced to disqualification.

[0096] In action 615, the status of the advertising vehicle is sent. The status of the advertising vehicle includes vehicle location information and vehicle posture information. In some embodiments, the status information of the advertising vehicle includes additional information, such as the location of the mobile advertisement on the advertising vehicle, whether the engine or motor of the advertising vehicle is working, the content of the mobile advertisement installed on the advertising vehicle, or other appropriate information. In some embodiments, the status of the advertising vehicle is communicated via status notification device 154. Figure 1The status of the advertising vehicle is transmitted wirelessly. In some embodiments, the status of the advertising vehicle is transmitted via a wired connection. Then, in action 615, method 600 returns to action 605.

[0097] Those skilled in the art will understand that modifications to method 600 are included within the scope of this specification. In some embodiments, additional actions are included in method 600. For example, in some embodiments, method 600 includes updating the driving schedule of the advertising vehicle. In some embodiments, at least one action in method 600 is omitted. For example, in some embodiments, action 605 is omitted because the location of the advertising vehicle is tracked by an external device.

[0098] Figure 7 This is a flowchart of a method 700 for evaluating advertisements using vehicles, implemented through some embodiments. In some embodiments, method 700 uses a mobile advertising system 100 ( Figure 1 ) and is implemented. In some implementations, method 700 uses server 130 ( Figure 1 ) and is implemented. In some implementations, method 700 uses system 1200 ( Figure 12 And thus implemented.

[0099] In action 705, gaze data of an occupant inside the observed vehicle is received. In some embodiments, the occupant is the driver of the observed vehicle. In some embodiments, the occupant is not the driver of the observed vehicle. In some embodiments, the gaze data is received based on information from a device installed in the observed vehicle. In some embodiments, the gaze data is information that can be separated from the observed vehicle, for example, based on smart glasses. In some embodiments where the gaze data is received based on information from smart glasses, the occupant is a cyclist or pedestrian, replacing someone inside the observed vehicle. The gaze data includes information that correlates the occupant's gaze angle relative to the observed vehicle and the time when the gaze data was collected. In some embodiments, the gaze data also includes information about known or detected objects in the environment surrounding the observed vehicle. In some embodiments, the gaze data is received wirelessly. In some embodiments, the gaze data is received via a wired connection. In some embodiments, the gaze data is transmitted via an attention area analyzer 132 (… Figure 1 (and was received.)

[0100] In action 710, the status of the advertising vehicle is received. The status of the advertising vehicle includes information about its location and posture. The status also includes time information related to its location and posture. In some embodiments, the status includes information about the content of the advertisements on the advertising vehicle. In some embodiments, the status includes information about the location of the advertisements on the advertising vehicle. In some embodiments, the status includes information about multiple advertisements on the advertising vehicle and the locations of each advertisement. In some embodiments, the status also includes information about whether the engine or motor of the advertising vehicle is operating. In some embodiments, the status of the advertising vehicle is received wirelessly. In some embodiments, the status is received via a wired connection. In some embodiments, the status of the advertising vehicle is received via a driving path analyzer 136 (…). Figure 1 (and was received.)

[0101] In action 715, trajectory data is generated based on the state of the advertising vehicle. The trajectory data can be used to determine the real-world orientation of the advertising vehicle relative to known objects. In some implementations, the trajectory data is generated based on a known driving plan of the advertising vehicle. In some implementations, the trajectory data uses an attention marker analyzer 138 (…). Figure 1 It is generated by ).

[0102] In action 720, the trajectory data is correlated with the received gaze data. This correlation allows determination of whether the gaze data indicates that the occupant has viewed an advertisement installed on the advertising vehicle. In some embodiments where the advertising vehicle has multiple advertisements, the correlation is further based on information regarding which part of the advertising vehicle the occupant viewed and the location of the advertisement on the advertising vehicle, identifying which advertisement the occupant viewed. In some embodiments, an attention marker analyzer 138 is used. Figure 1 This allows the trajectory data to be correlated with the received line-of-sight data.

[0103] In action 725, a histogram is generated based on the correlation between trajectory data and received line-of-sight data. The histogram associates the correlation between line-of-sight data and map data with additional data, such as date, time, demographic data, or other suitable information. In some embodiments, the histogram is based on time period, weather conditions, location of the sign, angle of the sign relative to the vehicle's direction of travel, demographic information, or other suitable references. In some embodiments, the histogram uses attention sign analyzer 138 (… Figure 1 It is generated by ).

[0104] In action 730, the update is sent to the customer. In some implementations, the customer includes customer 190 ( Figure 1 In some embodiments, the update includes histogram-based information to notify customers of mobile ad views, demographics of mobile ad viewers, duration of mobile ad views, location of mobile ad views, or other appropriate information. In some embodiments, the update is transmitted wirelessly. In some embodiments, the update is transmitted via a wired connection. In some embodiments, the update includes a response to a data request received from a customer. In some embodiments, the update is received from advertising advisor 144 (…). Figure 1 )send.

[0105] In action 735, an update regarding the proposed fees for mobile advertising is sent to the customer. In some implementations, the customer includes customer 190 ( Figure 1 In some implementations, the updated cost is determined based on the number of mobile ad views, the demographics of the mobile ad viewers, the duration of the mobile ad views, or other appropriate information. In some implementations, the updated cost is determined by advertising consultant 144 ( Figure 1 The decision is made. In some implementations, fee updates are sent wirelessly. In some implementations, fee updates are sent via a wired connection. In some implementations, the updated fee is displayed using advertising advisor 144. Figure 1 In some implementations, the updated fee is sent in response to a request from a customer. In some implementations, the updated fee is sent in response to a request from the driver or operator of the advertising vehicle.

[0106] In action 740, the updated driving plan is sent to the advertising vehicle. In some embodiments, the updated driving plan is sent wirelessly. In some embodiments, the updated driving plan is sent via a wired connection. In some embodiments, the updated driving plan is sent via advertising advisor 144 (… Figure 1 It was sent.

[0107] Those skilled in the art will understand that modifications to method 700 are within the scope of this specification. In some embodiments, additional actions are included in method 700. For example, in some embodiments, method 700 includes transmitting a payment command to a banking system to make payment to the driver or operator of the advertising vehicle. In some embodiments, at least one action in method 700 is omitted. For example, in some embodiments, action 735 is omitted. In some embodiments, the order of actions in method 700 is adjusted. For example, in some embodiments, updates to customers are sent before the updated driving schedule is sent.

[0108] Figure 8 This is a diagram of a data structure 800 for trajectory data implemented through some embodiments. In some embodiments, data structure 800 corresponds to the data obtained through the driving path analyzer 136 (…). Figure 1 The trajectory data is determined by the attention marker analyzer 138 in some implementations. In some embodiments, data structure 800 corresponds to the data structure used by the attention marker analyzer 138 to correlate the gaze data with the trajectory data. Figure 1 The trajectory data used.

[0109] Data structure 800 contains vehicle identification information 805. Vehicle identification information 805 represents information identifying the advertised vehicle, such as license plate number, vehicle identification number (VIN), etc., for example, based on customer 190 (…). Figure 1 This includes customer registration information, or other appropriate information. Data structure 800 also contains multiple trajectory elements 810 captured at various times. Each trajectory element 810 contains the same type of information, resulting in the recognition of mobile advertising installed on the advertising vehicle being determined at various times during the vehicle's movement along its travel path. In some embodiments, the time for determining trajectory elements 810 is set based on receiving updated location information from the advertising vehicle. In some embodiments, for example, advertising vehicle system 150 (… Figure 1 Advertising vehicle systems, such as those for advertising vehicles, are configured to send periodic location information. For example, in some implementations, the periodic interval is as long as approximately 1 second to approximately 10 seconds. In cases where the periodic interval is too long, the accuracy of determining the effectiveness of the advertisement decreases. In cases where the periodic interval is too short, in some cases, for example, server 130 (… Figure 1 The processing load on servers such as [unspecified servers] increases without a significant improvement in accuracy. In some implementations, location information of the advertising vehicle is sent in response to triggering events such as traveling a certain distance, passing a predetermined location, or responding to a request from the server.

[0110] The trajectory element 810 includes timestamp information 812. Timestamp information 812 indicates the time when the information for the corresponding trajectory element 810 was collected. The trajectory element 810 also includes location information 814. Location information 814 indicates location information and posture information related to the advertising vehicle. In some embodiments, location information 814 is determined by a location determination unit 164 (…). Figure 1 The trajectory is determined by the location the vehicle has previously passed through. In some embodiments, the trajectory includes a predicted trajectory the vehicle will take. The trajectory element 810 also includes the type 816 of the displayed advertisement. The type 816 of the displayed advertisement indicates whether the mobile advertisement is an identifier installed on the advertising vehicle, a display on the roof of the advertising vehicle, or other suitable information. In some embodiments, the type 816 of the displayed advertisement indicates the size of the mobile advertisement relative to the advertising vehicle. In some embodiments, the type of the displayed advertisement is, for example, based on the location via UI158 ( Figure 1 The type of advertisement 816 is determined by information received from the driver or operator of the advertising vehicle. In some embodiments where mobile advertising is adjustable advertising, the type of advertisement 816 displayed is provided, for example, to a status notification device 154 via mobile advertising. Figure 1 Status notification devices, such as )

[0111] Data structure 800 is merely illustrative, and those skilled in the art should understand that various types of information can be included in the visual data. In some embodiments, at least one of the constituent elements is excluded from data structure 800. For example, in some embodiments, when an advertising vehicle is already associated with a single type of advertising, the type 816 of the displayed advertisement is excluded from data structure 800. In some embodiments, additional information is included in data structure 800. For example, in some embodiments, data structure 800 also includes the location of each displayed advertisement.

[0112] Figure 9 This is a diagram of a vehicle user interface 900 implemented using some methods. In some implementations, UI 900 corresponds to UI 158 (…). Figure 1 UI900 can be used to notify the driver of the advertising vehicle of the driving route using navigation UI905. UI900 can also be used, using advertising placement UI910, to notify the driver of the type of requested advertisement and the location of the advertisement display on the advertising vehicle. In some embodiments, UI900 is configured to receive information from the driver of the advertising vehicle or other occupants of the advertising vehicle. In some embodiments, UI900 is integrated with the advertising vehicle. In some embodiments, UI900 can be detached from the advertising vehicle. In some embodiments, UI900 is a mobile device, such as a smartphone.

[0113] The navigation UI905 is configured, for example, from GPS160 ( Figure 1 The navigation UI 905 receives GPS information and displays a map visible to the driver of the advertising vehicle. The navigation UI 905 is also configured to display a driving route along the map intended for the advertising vehicle to traverse. In some embodiments, the navigation UI 905 includes a touchscreen. In some embodiments, the navigation UI 905 is configured to receive data from an external device, such as server 130. Figure 1 ) etc. to receive map and / or driving route updates.

[0114] The advertising UI 910 includes a requested ad type field 915 and a requested ad location field 920. The requested ad type field 915 is configured to notify the driver of the requested ad to be displayed on the advertising vehicle. In situations where the driver of the advertising vehicle can access multiple different mobile advertisements, the requested ad type field 915 can be used to, for example, notify customer 190 (…). Figure 1 The system notifies the driver of the advertising vehicle which mobile advertisement the customer prefers. In some embodiments, the requested advertisement type field 915 includes information regarding the fees payable to the driver or operator of the advertising vehicle associated with each available mobile advertisement. The requested advertisement location field 920 is configured to notify the driver of the advertising vehicle of the requested location where the advertisement to be displayed on the advertising vehicle. Where the driver of the advertising vehicle can access multiple different mobile advertisements, the requested advertisement location field 920 can be used, for example, based on information from customer 190 (…). Figure 1 Customer information, such as [customer information], will be used to notify the driver of the advertising vehicle of the preferred locations for each mobile advertisement. In some embodiments, the requested advertising location field 920 includes information regarding the fees payable to the driver or operator of the advertising vehicle associated with each mobile advertisement available at various locations on the advertising vehicle. In some embodiments, the advertising placement UI 910 can receive input from the driver for confirming or rejecting the requested type of advertisement or advertising location. In some embodiments, the advertising placement UI 910 includes a touchscreen.

[0115] Figure 9 Includes a navigation UI 805 separate from the advertising UI 910. In some implementations, the advertising UI 910 overlaps with the navigation UI 905. In some implementations, the advertising UI 910 is hidden immediately upon the activation of the advertising vehicle.

[0116] Figure 10 This is a flowchart of a method 1000 for navigating an advertising vehicle, implemented through several embodiments. In some embodiments, method 1000 utilizes a mobile advertising system 100 (… Figure 1 ) and is implemented. In some implementations, method 1000 uses system 1200 ( Figure 12 And thus implemented.

[0117] In action 1005, a request is provided to the driver of the advertising vehicle. The request includes a requested driving plan for driving the advertising vehicle. In some implementations, the request also includes a request regarding which mobile advertisement the advertising vehicle should display. In some implementations, the request uses a UI such as UI158 (…). Figure 1 The request is transmitted to the driver. The request is received from an external device. In some implementations, the request is received from the advertising advisor 144. Figure 1 ) Received. In some implementations, the request is received wirelessly. In some implementations, the request is received via a wired connection.

[0118] In action 1010, a determination is made regarding whether the driver accepts the received information. This determination is based on input received from the driver. In some implementations, the input uses a UI such as UI158. Figure 1 Input is received from a device different from the UI. In some implementations, input is received from a device different from the UI. In response to the driver not accepting the request, method 1000 returns to action 1005, awaiting a new request from the driver. In some implementations, the driver can input recommendations for additional requests. In response to the driver accepting the request, method 1000 proceeds to action 1015.

[0119] In action 1015, the driver receives an instruction on which mobile advertisement to install on the advertising vehicle. In some embodiments, the instruction also includes the location on the advertising vehicle where the mobile advertisement will be displayed. In some embodiments where the driver can access multiple mobile advertisements, the instruction includes a request for more than two locations for the mobile advertisement.

[0120] In action 1020, the destination is set by the driver. In some implementations, the destination is set independently of the request from the advertiser who sent the request for action 1005. In some implementations, the destination is set considering the request from the advertiser. In some implementations, the destination is based, for example, on UI158 (…). Figure 1 The destination is set based on input received from the driver. In some implementations, the destination is set, for example, via navigation system 156. Figure 1 Navigation systems such as 130 are received. The set destination is sent to server 130 ( Figure 1 (Sent by the server, etc.)

[0121] In action 1025, a driving plan based on the set destination is received by the advertising vehicle. In some embodiments, the driving plan is transmitted via a driving plan receiver 152 ( Figure 1 The driving plan is determined to take the driver to the set destination and to set a route to the set destination along a path predicted to increase the effectiveness of the mobile advertising installed on the advertising vehicle. In some implementations, the driving plan uses advertising consultant 144 ( Figure 1 The decision is made based on the navigation system 156. Figure 1 Navigation systems such as navigation guide the driver along the driving route.

[0122] In action 1030, the driver begins driving the advertising vehicle along the driving path based on the received driving plan. In some embodiments where the advertising vehicle has autonomous driving capabilities, the advertising vehicle executes instructions for driving along the driving path determined by the driving plan.

[0123] In action 1035, the advertising vehicle provides updates on its location and posture. These updates are sent, for example, to server 130 (…). Figure 1 The server sends the updated information, including traffic information, the location of the updated advertising vehicle, the updated advertising visibility information, or other appropriate information. Then, the server determines whether to adjust the driving plan based on the updated information.

[0124] In action 1040, in response to the decision to update the driving plan, the updated driving plan is sent to the advertising vehicle via a wireless or wired connection. The updated driving plan is then sent to a navigation system, for example, navigation system 156. Figure 1 Input. In some implementations, the navigation system is configured to automatically notify the driver of the advertising vehicle of changes to the driving plan. In some implementations, the driver uses, for example, UI158 (…). Figure 1 It has the option to accept or reject the updated driving plan. In some implementations, the updated driving plan is automatically replaced by any existing driving plan.

[0125] In action 1045, the advertising vehicle arrives at the designated destination.

[0126] In action 1050, payment for advertising vehicles traveling along a route determined by the driving plan is received through the account of the driver or operator of the advertising vehicle. In some embodiments, payment is based solely on the driving route taken to reach the destination. In some embodiments, payment is partly based on the time the advertising vehicle is parked and the location where the advertising vehicle is parked.

[0127] Those skilled in the art will understand that modifications to method 1000 are included within the scope of this specification. In some embodiments, additional actions are included in method 1000. For example, in some embodiments, method 1000 includes prompting multiple driving routes to a set destination for driver selection. In some embodiments, at least one action in method 1000 is omitted. For example, in some embodiments, action 1040 is omitted, and the driving route remains unchanged during movement to the destination. In some embodiments, the order of actions in method 1000 is adjusted. For example, in some embodiments, updating the driver's information begins before the destination is set.

[0128] Figure 11 This is a flowchart of a method 1100 for navigating an advertising vehicle, implemented through several embodiments. In some embodiments, method 1100 utilizes a mobile advertising system 100 (… Figure 1 ) and is implemented. In some implementations, method 1100 uses system 1200 ( Figure 12 Method 1100 and Method 1000 are implemented. Figure 10 Similarly, for the sake of brevity, actions with the same reference number will not be described in detail.

[0129] With method 1000 ( Figure 10 Compared to method 1100, method 1100 includes actions 1110 and 1120 between actions 1035 and 1040. In action 1110, the advertising vehicle receives a request for an updated advertising content. In action 1120, the advertising content on the advertising vehicle is updated in response to the received update request. In some embodiments where the mobile advertisement is adjustable, the adjustable advertisement is automatically changed in response to a received request to update the advertising content. In some embodiments where the mobile advertisement is not adjustable, the driver or operator of the advertising vehicle changes the mobile advertisement installed on the advertising vehicle. Including actions 1110 and 1120 helps to improve the effectiveness of the advertisement. For example, as the advertising vehicle moves along a driving path, the advertising vehicle approaches various businesses. In some embodiments, when the approach to various businesses meets a threshold condition, a request to change the mobile advertisement to various businesses is received.

[0130] Figure 12This is a diagram of a system 1200 for installing a vehicle advertising system, implemented using several embodiments. System 1200 includes: a hardware processor 1202, and a non-transitory computer-readable storage medium 1204 storing a set of executable commands encoded by computer program code 1206. The computer-readable storage medium 1204 is also encoded with commands 1207 for interfacing with external devices. The processor 1202 is electrically coupled to the computer-readable storage medium 1204 via a bus 1208. The processor 1202 is also electrically coupled to an input / output (I / O) interface 1210 via the bus 1208. Additionally, a network interface 1212 is electrically connected to the processor 1202 via the bus 1208. Because the network interface 1212 is connected to a network 1214, the processor 1202 and the computer-readable storage medium 1204 can connect to external elements via the network 1214. Processor 1202 is configured to enable system 1200 to perform operations in mobile advertising system 100. Figure 1 Method 200 Figure 2 Method 400 Figure 4 Method 700 Figure 7 Method 1000 Figure 10 ), or method 1100 ( Figure 11 The computer program code 1206, which is encoded by the computer-readable storage medium 1204, performs some or all of the actions described in the document.

[0131] In some implementations, processor 1202 is a central processing unit (CPU), a multiprocessor, a variance processing system, an application-specific integrated circuit (ASIC), and / or a suitable processing device.

[0132] In some embodiments, the computer-readable storage medium 1204 includes electronic, magnetic, optical, electromagnetic, infrared, and / or semiconductor systems (or machines or devices). For example, the computer-readable storage medium 1204 includes semiconductor memory, solid-state memory, magnetic tape, removable computer disk, random access memory (RAM), dedicated read-only memory (ROM), rigid disk, and / or optical disk. In some embodiments using optical disk, the computer-readable storage medium 1204 includes optical disc read-only memory (CD-ROM), optical disc read / write (CD-R / W), and / or digital video disc (DVD).

[0133] In some embodiments, storage medium 1204 is configured to enable system 1200 to execute in mobile advertising system 100. Figure 1 Method 200 Figure 2 Method 400 Figure 4Method 700 Figure 7 Method 1000 Figure 10 ), or method 1100 ( Figure 11 Part or all of the computer program code 1206 describing the actions in the mobile advertising system 100. In some embodiments, the storage medium 1204 also stores: for performing the actions in the mobile advertising system 100 Figure 1 Method 200 Figure 2 Method 400 Figure 4 Method 700 Figure 7 Method 1000 Figure 10 ), or method 1100 ( Figure 11 Information required for some or all of the actions described in the mobile advertising system 100, in order to perform them. Figure 1 Method 200 Figure 2 Method 400 Figure 4 Method 700 Figure 7 Method 1000 Figure 10 ), or method 1100 ( Figure 11 Information generated during part or all of the actions described in the document, such as information used to perform the actions in line-of-sight data parameter 1216, object data parameter 1218, vehicle position parameter 1220, advertising content parameter 1222, and / or mobile advertising system 100. Figure 1 Method 200 Figure 2 Method 400 Figure 4 Method 700 Figure 7 Method 1000 Figure 10 ), or method 1100 ( Figure 11 A set of executable commands, some or all of which are described in the action(s).

[0134] In some embodiments, storage medium 1204 stores commands 1207 for interfacing with external devices. Commands 1207 are for efficient implementation in the mobile advertising system 100. Figure 1 Method 200 Figure 2 Method 400 Figure 4 Method 700 Figure 7 Method 1000 Figure 10 ), or method 1100 ( Figure 11 Some or all of the actions described in the document enable the processor 1202 to generate commands that can be read by external devices.

[0135] System 1200 includes an I / O interface 1210. The I / O interface 1210 is coupled to external circuitry. In some embodiments, the I / O interface 1210 includes a keyboard, keypad, mouse, trackball, touchpad, and / or cursor arrow keys for transmitting information and commands to processor 1202.

[0136] System 1200 also includes a network interface 1212 integrated with processor 1202. Network interface 1212 enables communication between system 1200 and a network 1214 connected to one or more other computer systems. Network interface 1212 includes wireless network interfaces such as BLUETOOTH, WIFI, WIMAX, GPRS, or WCDMA, or wired network interfaces such as ETHERNET, USB, or IEEE-1394. In some embodiments, in mobile advertising system 100… Figure 1 Method 200 Figure 2 Method 400 Figure 4 Method 700 Figure 7 Method 1000 Figure 10 ), or method 1100 ( Figure 11 The actions described in the document are performed by two or more systems 1200, and information, such as line-of-sight data parameters 1216, object data parameters 1218, vehicle position parameters 1220, or advertising content parameters 1222, is exchanged between the various systems 1200 via network 1214.

[0137] This specification relates to a mobile advertising system. The mobile advertising system includes: a non-transitory computer-readable medium configured to store commands, and a processor connected to the non-transitory computer-readable medium. The processor is configured to execute commands for receiving gaze data from an observation vehicle. The processor is further configured to execute commands for receiving location information from an advertising vehicle. The processor is further configured to correlate the gaze data with the location information and execute commands for determining whether the gaze data indicates recognition of an advertisement installed on the advertising vehicle. The processor is further configured to execute commands for updating a histogram based on the correlation between the gaze data and the location information. The processor is further configured to execute commands for generating a driving plan to improve the effectiveness of the advertisement. The processor is further configured to execute commands for sending the driving plan to the advertising vehicle. In some embodiments, the processor is further configured to execute commands for: determining the effectiveness of the advertisement based on the histogram, and generating a payment command based on the determined effectiveness of the advertisement. In some embodiments, the processor is further configured to execute commands for: updating the histogram based on demographic information of the occupants of the observation vehicle associated with the gaze data. In some embodiments, the processor is further configured to execute commands for receiving information about the content of the advertisement from the advertising vehicle. In some embodiments, the processor is further configured to execute commands for determining, based on gaze data, which of a plurality of advertisements installed on the advertising vehicle is viewed. In some embodiments, the processor is further configured to execute commands for determining, based on gaze data, the area of ​​the viewed advertising vehicle. In some embodiments, the processor is further configured to execute commands for determining, based on gaze data, the duration for which the advertisement is viewed. In some embodiments, the processor is further configured to execute commands for generating recommendations based on histograms to improve the effectiveness of the advertisement.

[0138] This specification relates to a mobile advertising method. The method includes receiving gaze data from an observation vehicle. The method also includes receiving location information from an advertising vehicle. The method further includes: correlating the gaze data with the location information, and determining whether the gaze data indicates recognition of an advertisement installed on the advertising vehicle. The method also includes updating a histogram based on the correlation between the gaze data and the location information. The method further includes generating a driving plan to improve the effectiveness of the advertisement. The method also includes sending the driving plan to the advertising vehicle. In some embodiments, the method further includes: determining the effectiveness of the advertisement based on the histogram, and generating a payment command based on the determined effectiveness of the advertisement. In some embodiments, updating the histogram includes: updating the histogram based on demographic information of the occupants of the observation vehicle associated with the gaze data. In some embodiments, the method further includes receiving information about the content of the advertisement from the advertising vehicle. In some embodiments, the method further includes: determining, based on the gaze data, which of a plurality of advertisements installed on the advertising vehicle is recognized. In some embodiments, the method further includes: determining, based on the gaze data, the area of ​​the recognized advertising vehicle. In some embodiments, the method further includes: determining, based on the gaze data, the duration of the advertisement being recognized. In some implementations, the method further includes generating recommendations based on histograms to improve the effectiveness of advertising.

[0139] One technical solution of this specification relates to a mobile advertising system. The mobile advertising system includes an advertising vehicle system configured to determine location information of an advertising vehicle. The mobile advertising system includes an observation vehicle system configured to determine gaze data associated with occupants of an observation vehicle. The mobile advertising system also includes a server capable of communicating with both the advertising vehicle system and the observation vehicle system. The server includes a non-transitory computer-readable medium configured to store commands, and a processor connected to the non-transitory computer-readable medium. The processor is configured to execute commands for receiving gaze data from the observation vehicle system. The processor is also configured to execute commands for receiving location information from the advertising vehicle system. The processor is further configured to correlate the gaze data with the location information and execute commands for determining whether the gaze data represents recognition of an advertisement installed on the advertising vehicle. The processor is further configured to execute commands for updating a histogram based on the correlation between the gaze data and the location information. The processor is further configured to execute commands for generating a driving plan to improve the advertising effectiveness of the advertisement. The processor is further configured to execute commands for sending the driving plan to the advertising vehicle system. In some embodiments, the advertising vehicle system is configured to update the navigation system in response to receiving a driving plan from the server. In some embodiments, the processor is configured to execute a command to generate a request to update the advertising content based on a histogram and send the request to the advertising vehicle system. In some embodiments, the advertising vehicle system is configured to automatically update the advertising content in response to receiving the request to update the advertising content.

[0140] The foregoing description has outlined some features of the embodiments to enable those skilled in the art to better understand the technical solutions of this disclosure. Those skilled in the art should understand that, in order to achieve the same purpose and / or advantages as the embodiments incorporated into this specification, this disclosure can be readily used to design or modify the basis of other processes and constructions. Furthermore, those skilled in the art should understand that such equivalent constructions do not depart from the spirit and scope of this disclosure, and that they can make various changes, substitutions, and alterations in this specification without departing from the spirit and scope of this disclosure.

Claims

1. A mobile advertising system, comprising: Non-transitory computer-readable media, configured as stored commands; and The processor is connected to the non-transitory computer-readable medium. The processor is configured to execute the command, the command being used for: From observing the line-of-sight data received by the vehicle, Location information is received from advertising vehicles. The gaze data is correlated with the location information to determine whether the gaze data indicates recognition of an advertisement installed on the advertising vehicle. The histogram is updated based on the correlation between the line-of-sight data and the location information. Generate a driving plan to improve the effectiveness of the advertisement, such that the driving route is taken to locations with a high probability of the target layer of the advertisement being located, based on the histogram. The driving plan is sent to the advertising vehicle.

2. The mobile advertising system according to claim 1, The processor is configured to execute the command, and the command is further configured to: The effectiveness of the advertisement is determined based on the histogram. A payment order is generated based on the determined validity of the advertisement.

3. The mobile advertising system according to claim 1, The processor is configured to execute the command, and the command is further configured to: The histogram is updated based on demographic information of the occupants of the observed vehicle associated with the line-of-sight data.

4. The mobile advertising system according to any one of claims 1 to 3, The processor is configured to execute the command, and the command is further configured to: Receive information related to the content of the advertisement from the advertising vehicle.

5. The mobile advertising system according to any one of claims 1 to 3, The processor is configured to execute the command, and the command is further configured to: Based on the gaze data, it is determined which of the multiple advertisements installed on the advertising vehicle is being viewed.

6. The mobile advertising system according to any one of claims 1 to 3, The processor is configured to execute the command, and the command is further configured to: Based on the gaze data, the area of ​​the advertised vehicle is determined.

7. The mobile advertising system according to any one of claims 1 to 3, The processor is configured to execute the command, and the command is further configured to: Based on the gaze data, the duration for which the advertisement is perceived is determined.

8. The mobile advertising system according to any one of claims 1 to 3, The processor is configured to execute the command, and the command is further configured to: Based on the histogram, recommendations are generated to improve the effectiveness of the advertisement.

9. A mobile advertising method, comprising: From observing the line-of-sight data received by the vehicle, Location information is received from advertising vehicles. The gaze data is correlated with the location information to determine whether the gaze data indicates recognition of an advertisement installed on the advertising vehicle. The histogram is updated based on the correlation between the line-of-sight data and the location information. Generate a driving plan to improve the effectiveness of the advertisement, such that the driving route is taken to locations with a high probability of the target layer of the advertisement being located, based on the histogram. The driving plan is sent to the advertising vehicle.

10. The method of claim 9, further comprising: The effectiveness of the advertisement is determined based on the histogram. A payment order is generated based on the determined validity of the advertisement.

11. The method according to claim 9, Updating the histogram includes: The histogram is updated based on demographic information of the occupants of the observed vehicle associated with the line-of-sight data.

12. The method according to any one of claims 9 to 11, further comprising: Receive information related to the content of the advertisement from the advertising vehicle.

13. The method according to any one of claims 9 to 11, further comprising: Based on the gaze data, it is determined which of the multiple advertisements installed on the advertising vehicle is being viewed.

14. The method according to any one of claims 9 to 11, further comprising: Based on the gaze data, the area of ​​the advertised vehicle is determined.

15. The method according to any one of claims 9 to 11, further comprising: Based on the gaze data, the duration for which the advertisement is perceived is determined.

16. The method according to any one of claims 9 to 11, further comprising: Based on the histogram, recommendations are generated to improve the effectiveness of the advertisement.

17. A mobile advertising system, comprising: The advertising vehicle system is designed to determine location information related to the advertising vehicle; The vehicle observation system comprises line-of-sight data used to determine the relationship between the observed vehicle's occupants and the observed vehicle; and The server is capable of communicating with both the advertising vehicle system and the observation vehicle system. The server has the following features: Non-transitory computer-readable media, configured as stored commands; and The processor is connected to the non-transitory computer-readable medium. The processor is configured to execute the command, the command being used for: The line-of-sight data is received from the observation vehicle system. Receive the location information from the advertising vehicle system. The gaze data is correlated with the location information to determine whether the gaze data indicates recognition of an advertisement installed on the advertising vehicle. The histogram is updated based on the correlation between the line-of-sight data and the location information. Generate a driving plan to improve the effectiveness of the advertisement, such that the driving route is taken to locations with a high probability of the target layer of the advertisement being located, based on the histogram. The driving plan is sent to the advertising vehicle system.

18. The mobile advertising system according to claim 17, The advertising vehicle system is configured to update the navigation system in response to receiving the driving plan from the server.

19. The mobile advertising system according to claim 17 or 18, The processor is configured to execute the command, and the command is further configured to: A request to update the content of the advertisement is generated based on the histogram. The request is sent to the advertising vehicle system.

20. The mobile advertising system according to claim 19, The advertising vehicle system is configured to automatically update the content of the advertisement in response to receiving a request to update the content of the advertisement.

Images