Vehicular display system and method

The vehicular display system addresses viewer engagement measurement and dynamic content adaptation by integrating location tracking and machine learning, enabling real-time adjustment of advertisements based on viewer interaction and vehicle location, thus improving advertising effectiveness.

WO2026232193A1PCT designated stage Publication Date: 2026-11-12OOHA PTY LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/AU2026/050451
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-05-07
Filing Date
2026-05-06
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Conventional vehicle-based advertising systems struggle to effectively measure viewer engagement with displayed media content and adapt visual content in real-time due to limitations in data transmission and storage, as well as the inability to account for dynamic changes in vehicle location and audience demographics.

Method used

A vehicular display system that integrates geographical location tracking and viewer engagement determination using machine learning, allowing real-time interaction with a remote content management system to dynamically adjust displayed content based on viewer interaction and vehicle location, reducing data transfer through geofencing.

Benefits of technology

Enables real-time measurement of viewer engagement and dynamic content adjustment, enhancing the effectiveness of vehicle-based advertising by providing accurate engagement metrics and adapting content to changing environments and audiences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure AU2026050451_12112026_PF_FP_ABST
    Figure AU2026050451_12112026_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed is a vehicular display system comprising a display component, an imaging component, a communications component, and a controller connected to the components. The display component is affixed to a vehicle, and displays visual content to an environment external to the vehicle. The imaging component includes at least one camera located on the vehicle that captures one or more images of the environment. The communications component is configured for electronic communication with a content management system located remotely to the vehicle. The controller is a processing device configured to: (i) receive, from the at least one camera, imaging data representing the one or more images of the environment; (ii) generate, by executing an image analysis module on the imaging data, visual engagement data representing at least a number of impressions of the visual content in the environment, wherein the image analysis module is configured to apply one or more machine learning models to the imaging data; (iii) receive, from a position locating device associated with the vehicle, location data indicating a location of the vehicle; (iv) determine, by executing a geofencing module on the location data, whether the vehicle is located within a geographic region associated with the visual content; and (v) in response to determining that the vehicle is located within the geographic region, transmit the visual engagement data, via the communications component, to the content management system, wherein the content management system is configured to: determine, from the visual engagement data, one or more engagement metrics associated with the visual content; and provide the one or more engagement metrics to a publisher of the visual content.
Need to check novelty before this filing date? Find Prior Art

Description

"Vehicular display system and method"Cross-reference

[0001] The present application claims priority from Australian Provisional Patent Application No. 2025901724 filed on 7 May 2025, the contents of which are incorporated herein by reference in their entirety.Technical Field

[0002] The present disclosure relates to systems and methods for the display of visual information, such as image, video, or other visual media content, using a vehicle located in a real-world environment, and for determining engagement of one or more viewers with the displayed visual content.Background

[0003] The ability to effectively display visual information for consumption by individuals is of significance in many aspects of modern life. For example, visual advertising plays a crucial role in promoting products, services, and announcements. By leveraging various visual media content types, advertisers can reach a wide audience and influence consumer behaviour.

[0004] Out-of-home advertising (OOHA) is a significant segment of the advertising industry that focuses on delivering content to consumers in real-world settings. This form of advertising includes billboards, transit ads, street furniture, and other media displayed in public spaces. OOHA is effective due to its ability to provide information to individuals during their daily activities, making the information difficult to ignore.

[0005] In the context of OOHA, visual content is a primary method of capturing attention and conveying messages. Traditional billboards, for example, use large, static images and text to promote products or services. Digital signs, on the other hand, offer dynamic content that can be updated when desired by a publisher. Examples includedigital billboards that display rotating advertisements, interactive screens at bus stops, and electronic displays in shopping malls. These visual elements are designed to be eye-catching and memorable, enhancing the effectiveness of the advertising campaign.

[0006] Traditional static billboards and signs have limitations in terms of reach and engagement, as they are confined to specific locations and often fail to capture the attention of passersby. Vehicle-based systems have emerged as means for distributing visual information to a real-world environment. These systems, referred to as “vehicular display systems” herein, involve the use of electronic display devices (e.g., high-resolution screens or other display technologies) that are mounted on vehicles such as taxis, buses, and delivery trucks. Vehicular display systems leverage the mobility of vehicles to display digital content, thereby significantly enhancing the visibility and impact of the information. That is, the mobility of vehicles allows advertising content to reach a broader and more diverse audience, as a respective vehicle travels through different areas and interact with various demographics.Summary

[0007] There is provided a vehicular display system comprising: a display component affixed to a vehicle, the display component configured to display visual content to an environment external to the vehicle; an imaging component comprising at least one camera located on the vehicle, the at least one camera configured to capture one or more images of at least a portion of the environment; a communications component configured for electronic communication with at least one content management system located remotely to the vehicle; and a controller comprising a processor and a memory configured to store instructions executable by the processor as one or more modules, wherein the controller is connected to the display component, the imaging component, and the communications component, and wherein the controller is configured to: (i) receive, from the at least one camera, imaging data representing the one or more images of the environment; (ii) generate, by executing an image analysis module on the imaging data, visual engagement data representing at least a number of impressions of the visual content in the environment, wherein the image analysis module is configuredto apply one or more machine learning (ML) models to the imaging data; (iii) receive, from a position locating device associated with the vehicle, location data indicating a location of the vehicle; (iv) determine, by executing a geofencing module on the location data, whether the vehicle is located within a geographic region associated with the visual content; and (v) in response to determining that the vehicle is located within the geographic region, transmit the visual engagement data, via the communications component, to the content management system, wherein the content management system is configured to: determine, from the visual engagement data, one or more engagement metrics associated with the visual content; and provide the one or more engagement metrics to a publisher of the visual content.

[0008] In some embodiments, the controller is further configured to determine the visual content based at least in part on the location of the vehicle.

[0009] In some embodiments, the controller is further configured to operate the display component to commence displaying the visual content in response to determining the that vehicle has entered the geographic region associated with the visual content.

[0010] In some embodiments, the controller is further configured to operate the display component to cease displaying the visual content in response to determining that the vehicle has exited the geographic region associated with the visual content.

[0011] In some embodiments, the system further comprises a data store local to the vehicle, the data store configured to store media data including the visual content.

[0012] In some embodiments, the controller is further configured to receive the visual content from a remote media source via the communications component.

[0013] In some embodiments, the visual content comprises one or more of a dynamic image, a static image, a blank image, and a video feed.

[0014] In some embodiments, the display component comprises one or more electronic signs mounted to an exterior surface of the vehicle.

[0015] In some embodiments, the one or more electronic signs are collectively arranged to exhibit the visual content to the environment with a field of view of substantially 360 degrees.

[0016] In some embodiments, the one or more machine learning (ML) models comprise a neural network-based model configured to detect one or more viewers in the environment as captured by the one or more images.

[0017] In some embodiments, the image analysis module is further configured to detect each of the one or more viewers by determining, for the respective viewer, one or more of: a facial presence feature; a head orientation feature; and a gaze direction feature.

[0018] In some embodiments, the image analysis module is further configured to determine a duration that each of the one or more viewers views the visual content by performing gaze validation on the respective viewer.

[0019] In some embodiments, the position locating device comprises a GPS module, and wherein the geofencing module is configured to determine the location of the vehicle, as vehicle coordinate information, using data received from the GPS module in real-time or substantially real-time.

[0020] In some embodiments, the geofencing module is configured to process the vehicle coordinate information, and coordinate information of the geographic region associated with the visual content, to determine whether the vehicle is located within the geographic region.

[0021] In some embodiments, the geofencing module is configured to process the coordinates used to specify the geographic region using a point-in-polygon check.

[0022] In some embodiments, the controller is further configured to receive, from the content management system, advertising information as the visual content to be displayed by the display component.

[0023] In some embodiments, the controller is further configured to receive the advertising information in response to one or more predetermined conditions.

[0024] In some embodiments, the controller is further configured to: (vi) receive display update data, via the communications component, from the content management system, wherein the display update data indicates new or updated visual content to be displayed by the display component; and (vii) operate the display component to display the new or updated visual content to the environment.

[0025] In some embodiments, the controller is further configured to iteratively perform steps (i)-(vii) with the new or updated visual content of step (vii) used as the visual content of step (i).

[0026] In some embodiments, the controller is further configured to: generate system reporting data representing at least a measure of functionality of one or more of the display component; the imaging component; and the communications component; and transmit the system reporting data to a computing device of an operator of the vehicle.

[0027] In some embodiments, the controller is further configured to: detect a failure of one or more of the display component; the imaging component; and the communications component; and generate the system reporting data as a real-time response to detecting the failure.

[0028] There is also provided a method for providing engagement data of visual content displayed using a vehicle, the method comprising: (i) displaying, by controlling a display component affixed to the vehicle, the visual content to an environment external to the vehicle; (ii) receiving imaging data from at least one camera located on the vehicle, the imaging data representing one or more images of at least a portion ofthe environment; (iii) processing the imaging data to generate visual engagement data representing at least a number of impressions of the visual content in the environment, wherein processing the image data comprises applying one or more machine learning (ML) models to the imaging data; (iv) receiving, from a position locating device associated with the vehicle, location data indicating a location of the vehicle; (v) processing the location data to determine whether the vehicle is located within a geographic region associated with the visual content; and (vi) in response to determining that the vehicle is located within the geographic region, transmitting the visual engagement data to a content management system located remotely to the vehicle, wherein the content management system is configured to: determine, from the visual engagement data, one or more engagement metrics associated with the visual content; and provide the one or more engagement metrics to a publisher of the visual content.

[0029] In some embodiments, the method further comprises: (vii) receiving update data from the content management system, wherein the update data indicates new visual content to be displayed by the display component; and (viii) operating the display component to display the new visual content to the environment.

[0030] There is also provided a method for determining real-time engagement of individuals with visual content displayed to an environment external to a vehicle using a vehicular display system mounted to the vehicle, wherein the method is executed by at least one processor located remotely to the vehicle, the method comprising: receiving, from the vehicular display system, visual engagement data representing at least a number of impressions of the visual content in the environment; processing the visual engagement data to determine one or more engagement metrics associated with the visual content; and updating a graphical interface of a user device to exhibit the one or more engagement metrics in real-time, or substantially real-time, with the determination of the one or more engagement metrics, wherein the vehicular display system is a system described herein.

[0031] In some embodiments, the at least one processor is part of an advertising content management system, and wherein the graphical interface is rendered by a content control application executed on the user device.

[0032] In some embodiments, the method further comprises: receiving, from the graphical interface, advertising information comprising the visual content to be displayed by the vehicular display system; processing the advertising information to determine corresponding display data and geolocation data; and transmitting the corresponding display data and geolocation data to the vehicular display system.

[0033] In some embodiments, the method further comprises transmitting the advertising information to the vehicular display system automatically in response to one or more predetermined conditions.

[0034] In some embodiments, the method further comprises: generating or receiving update data indicating new visual content to be displayed by the vehicular display system; and transmitting the update data to the vehicular display system to cause the new visual content to be displayed by the vehicular display system.

[0035] In some embodiments, the method further comprises determining the new visual content using the visual engagement data of the visual content or the one or more engagement metrics associated with the visual content.

[0036] There is provided a method for displaying visual content using a vehicle, the method comprising: receiving, from a position locating device associated with the vehicle, location data indicating a location of the vehicle; processing the location data to determine whether the vehicle is located within a geographic region associated with the visual content; and in response to determining that the vehicle is located within the geographic region: displaying, by controlling a display component affixed to the vehicle, the visual content to an environment external to the vehicle; receiving imaging data from at least one camera located on the vehicle, the imaging data representing one or more images of at least a portion of the environment; processing the imaging data togenerate visual engagement data representing at least a number of impressions of the visual content in the environment, wherein processing the image data comprises applying one or more machine learning (ML) models to the imaging data; and transmitting the visual engagement data to a content management system located remotely to the vehicle.

[0037] In some embodiments, the content management system is configured to: determine, from the visual engagement data, one or more engagement metrics associated with the visual content; and provide the one or more engagement metrics to a publisher of the visual content.

[0038] There is also provided an apparatus comprising: a vehicular display system and a content management system, wherein the vehicular display system comprises: a display component affixed to a vehicle, the display component configured to display visual content in an environment external to the vehicle; an imaging component comprising at least one camera located on the vehicle, the at least one camera configured to capture one or more images of at least a portion of the environment; a communications component configured for electronic communication with a content management system located remotely to the vehicle; and a controller comprising a processor and a memory configured to store instructions executable by the processor as one or more modules, wherein the controller is connected to the display component, the imaging component, and the communications component, and wherein the controller is configured to: receive, from the at least one camera, imaging data representing one or more images of the environment; generate visual engagement data by applying one or more machine learning models to the imaging data, wherein the visual engagement data represents at least a number of impressions of the visual content in the environment; receive, from a position locating device associated with the vehicle, location data indicating a location of the vehicle; process the location data to determine whether the vehicle is located within a geographic region associated with the visual content; and in response to determining that the vehicle is located within the geographic region, transmit the visual engagement data, via the communications component, to the content management system; and wherein the content management system comprises: anelectronic communications interface; at least one computer processor to execute program instructions; and a memory, coupled to the at least one computer processor, to store program instructions for execution by the at least one computer processor, wherein the content management system is configured to communicate with the vehicular display system and a computing device of a publisher of the visual content, and wherein the content management system is configured to: receive, from the vehicular display system, the visual engagement data; process the visual engagement data to determine one or more engagement metrics associated with the visual content; and transmit instructions and data to cause the computing device of the publisher to update a graphical interface of the computing device to exhibit the one or more engagement metrics in real-time, or substantially real-time, with the determination of the one or more engagement metrics.Brief Description of Drawings

[0039] Some embodiments of the present invention will now be described, by way of example only, with reference to the accompanying drawings, in which:

[0040] Fig. la is a schematic diagram of a visual content display platform that includes a vehicular display system, a content management system and one or more user devices, in accordance with some embodiments of the proposed technology;

[0041] Fig. lb is a schematic diagram of an example configuration of the platform of Fig. la in which a plurality of vehicular display systems are mounted to respective vehicles, in accordance with some embodiments of the proposed technology;

[0042] Fig. 2a is a schematic diagram of components of the platform of Fig. la, in accordance with some embodiments of the proposed technology;

[0043] Fig. 2b is a schematic diagram of an exemplary configuration of a memory system of the content management system of the visual content display platform of Fig.2a, in accordance with some embodiments of the proposed technology;

[0044] Fig. 3a is a schematic diagram of a first exemplary implementation of the vehicular display system as a car-top system, in accordance with some embodiments of the proposed technology;

[0045] Fig. 3b is a schematic diagram of a second exemplary implementation of the vehicular display system as a car-top system, in accordance with some embodiments of the proposed technology;

[0046] Fig. 4a is a flow diagram of a method executed by a controller of the vehicular display system for providing real-time analytics information of visual content displayed using a vehicle to a content management system in accordance with some embodiments of the proposed technology;

[0047] Fig. 4b is a flow diagram of a method executed by a controller of the vehicular display system for displaying visual content displayed using a vehicle, in accordance with some embodiments of the proposed technology;

[0048] Fig. 5 is a flow diagram of a method for controlling a display component to display initial visual content in the method for providing real-time analytics information of Fig. 4a and for displaying visual content of Fig. 4b;

[0049] Fig. 6 is a flow diagram of a method for generating visual engagement data in the method for providing real-time analytics information of Fig. 4a and for displaying visual content of Fig. 4b;

[0050] Fig. 7 is a flow diagram of a method for determining engagement data comprising at least a number of impressions of the visual content in the method for providing real-time analytics information of Fig. 4a and for displaying visual content of Fig. 4b;

[0051] Fig. 8 is a flow diagram of a method for determining a real-time location of the vehicular display system in the method for providing real-time analytics information of Fig. 4a and for displaying visual content of Fig. 4b;

[0052] Fig. 9 is a flow diagram of a method for determining real-time engagement of visual content displayed with a vehicular display system mounted to a vehicle, in accordance with some embodiments of the proposed technology;

[0053] Fig. 10 is a flow diagram of a method executed by at least one processor of an advertisement server for receiving and processing advertising information as part of the method of Fig. 9;

[0054] Fig. 11 is a screenshot of a first exemplary interface rendered by a content control application executing on a user device of an advertiser user, in accordance with some embodiments of the proposed technology;

[0055] Fig. 12 is a screenshot of a second exemplary interface rendered by a content control application executing on the user device of an administrative user, in accordance with some embodiments of the proposed technology;

[0056] Fig. 13a is a screenshot of a portion of a third exemplary interface rendered by a content control application executing on a user device of an operator user, in accordance with some embodiments of the proposed technology;

[0057] Fig. 13b is a screenshot of another portion of the third exemplary interface rendered by the content control application executing on the user device of the operator user, in accordance with some embodiments of the proposed technology.Description of Embodiments

[0058] There are some challenges associated with conventional vehicle-based advertising systems. Advertising systems that provide visual content delivery via an electronic platform, such as, online web-based applications, allow the visualinformation displayed by the system to consumers to be easily and dynamically adjusted based on response metrics that are gathered from the digital environment in which the information is presented (e.g., the web page or associated software application).

[0059] However, conventional systems that deliver visual information to a real-world environment, such as using an electronic sign or billboard, cannot as easily assess a viewer's interest in the displayed information. Specifically, conventional vehicle-based advertising systems are unable to effectively measure the engagement of a consumer with the media content. The mobile nature of the vehicle results in technical difficulties in accurately detecting and analysing viewership of visual advertisements, particularly since there is no capability to measure an interaction of a consumer with the media content presented in the real-world environment analogously to an interaction with media that is delivered within a digital environment (e.g., a web page).

[0060] Further, conventional vehicle-based advertising systems do not account for the changes in physical position and geographical location of the vehicle, since the visual information displayed is often static or predetermined prior to its delivery to the environment.

[0061] It is desired to have a vehicle-based advertising system that can modify or change the media that is displayed in a manner that takes advantage of the physical mobility of the vehicle. The location of a vehicle changes as it moves resulting in an environment that dynamically changes, and consequently an ability to deliver information to a changing audience of potential consumers (i.e., viewers of visual media content). It is desirable to modify or change the media that is displayed by the vehicle-based system in response to determining the engagement of the consumers in the relevant environment.

[0062] There are technical issues associated with deploying a vehicle-based advertising system that is capable of dynamically modifying its displayed advertising content, and of tracking the engagement of the audience in real-time. One such issue isthe generation and management of electronic data by the vehicle-based systems. That is, a significant problem faced by conventional real-world advertising systems that are vehicle-based is related to data transmission and storage requirements.

[0063] Previously, real -world advertising systems have avoided peer-to-peer communication between vehicle-based subsystems and external systems by employing local data generation and aggregation techniques to manage data representing content that is displayed and viewership information obtained in relation to the content (if any). For example, vehicle-based systems typically have a local storage device that is configured to receive and store data representing the media that may be displayed during operation of the system. This localizes the management of media content and any engagement data to each individual vehicle subsystem, and therefore avoids the need to transfer data between an external source (e.g., a media provider device) and the vehicle subsystem that displays the content.

[0064] However, a consequence is that the visual content that may be displayed to consumers is limited to the set of media that is programmed into, or loaded onto, the system prior to its deployment and operation in the real-world environment. Further, publishers of the visual content are not able to receive real-time feedback on the level of interest in the content as displayed by the system.

[0065] The above issues lead to difficulties in the operation of the conventional vehicle-based advertising systems, since there is limited capability of the system to operate in real-time, accounting for potentially near constant motion of the vehicle, to obtain advertisement data to display to consumers, or to receive and provide information about viewer interest in the media that is being displayed at any given time, from and to a system external to the vehicle. It is therefore desired to provide improved systems and methods for using vehicles to exhibit visual information which addresses one or more problems of the conventional approaches, or one or more other problems, or that at least provides a useful alternative.Overview

[0066] Disclosed herein are systems, methods, and apparatus that use a vehicle to display visual content, such as image or video media, to a real-world environment by integrating geographical vehicle location tracking and viewer engagement determination based on image-processing, to provide real-time interaction with a remotely located content management system that accounts for dynamic changes to the environment as the vehicle moves.

[0067] Fig. la illustrates a visual content display apparatus 100 (also referred to as a visual content display platform) that includes a vehicle-based display system 102 (referred to as a “vehicular display system” (VDS)) configured to exhibit visual content (e.g., advertisements comprising images, video, and / or other graphical elements) to individuals in an environment around a vehicle 101 to which the VDS 102 is mounted on, or otherwise attached to. The VDS 102 includes a display component 104 configured to display visual content to the environment external to the vehicle 101, and an imaging component comprising at least one image capturing device located on the vehicle 101. The at least one capturing device of the imaging component 106 captures images of the environment in which the advertisements are displayed by the display component 104.

[0068] The VDS 102 collects real-time viewer engagement data (e.g., impressions and / or other metrics) to measure the effectiveness of the displayed content on one or more individuals in the environment (referred to as “viewers” of the displayed visual content herein). For example, the VDS 102 may be configured to display one or more advertisements as the visual content by way of display component 104, and to capture images of viewers of the visual content by the use of imaging component 106. A control component 108 generates engagement data including at least viewer impression data by processing the image(s) captured by the imaging component 106. The engagement data represents visual engagement of one or more viewers with the displayed visual content and includes at least a number of impressions of the visual content in the environment.

[0069] The VDS 102 communicates with a content management system 120, for example by way of a communication component 107 over a communications network 150. The communications network 150 is preferably a wide area network involving the use of one or more wireless communications channels to exchange data between the VDS 102 and the content management system 120. The VDS 102 transmits the engagement data in relation to the displayed content to the content management system 120, and optionally receives visual content (e.g., advertising material) to display, either initially or subsequent to providing the content management system 120 with the engagement (e.g., analytics) data.

[0070] The VDS 102 performs the generation and transmission of the engagement data to the content management system 120 in real-time simultaneously with the display of the visual content in the real-world environment using the display component 104. The VDS 102 determines a geographical location of the vehicle in real-time by using data received from a position locating device. The position locating device may be part of the VDS 102 (e.g., part of the communications component 107) or external to the VDS 102 (e.g., a GPS device of the vehicle 101, or a device of an operator of the vehicle).

[0071] Fig. lb illustrates a configuration of platform 100 in which a plurality of vehicular display systems 102a, 102b and 102c are mounted to respective vehicles 101a, 101b, and 101c to exhibit respective visual content VCa, VCb and VCc with respective associated geographic regions 10a, 10b, and 10c. Each VDS 102a, 102b, and 102c communicates with the remote content management system 120 (e.g., an advertisement server, which in turn communicates with a plurality of user devices 103a, 103b, and 103c).

[0072] In some embodiments, each VDS 102a, 102b, 102c is configured to display visual content that is common with or different from the visual content of any other VDS (e.g., any one of VCa, VCb, or VCc may be displayed by any of the VDSs 102a, 102b and 102c), and where the visual content may be associated with one or more geographical regions (e.g., any of regions 10a, 10b, and 10c). Fig. lb depicts anexample configuration with three VDSs and corresponding user devices, although it will be appreciated that, in other embodiments, platform 100 may be configured with any number of VDSs and / or user devices.

[0073] According to various embodiments of the proposed systems and methods, each VDS 102a, 102b, 102c controls the display of the visual content, and / or the generation and transmission of the engagement data obtained from the exhibition of the visual content in the environment, by tracking a geographical location of the vehicle 101a, 101b, 101c. That is, each VDS 102a, 102b, 102c may be configured to transmit the engagement data to the remotely located content management system 120 (e.g., a computing device configured as a server), in response to determining that the corresponding vehicle 101a, 101b, 101c is presently in a geographic region that is associated with the visual content to which the engagement data relates. For example, once vehicle 101a moves out of geographical region 10a, its attached VDS 102a may cease the transmission, to the content management system 120, of visual engagement data generated for visual content associated with the region 10a. As vehicle 101c is not located within the region 10c associated with visual content VCc presently displayed by the VDS 102c, the visual engagement data generated for VCc is not transmitted from the VDS 102c to the content management system 120.

[0074] Until the technology proposed in the present application, it was problematic to design a vehicle-based advertising system with a distributed communications architecture (e.g., involving ad-hoc data transmission between a local vehicle-based system and a remote server) at least because of the need to continuously transfer large amounts of data between the systems in real-time. Such transfers are prohibitive particularly when the remote system and the vehicle-based system are forced to communicate over wireless networks that are unreliable and subject to limited bandwidth (e.g., because the vehicle subsystem is in constant motion).

[0075] The proposed approach advantageously reduces the amount of data transferred between each individual VDS 102a, 102b, 102c, which operates to generate engagement data from the display of corresponding visual content in its real-worldenvironment, and the remotely located remote content management system 120 at least by constraining the data transfer using geofencing (as described herein). This further permits the VDS 102 to decouple the selection and display of particular visual content with the electronic transmission of the engagement data relating to the displayed visual content from a vehicle-based display system 102 to a centralized content management system 120.

[0076] In some embodiments, the VDS 102 is further configured to select and / or update the visual content (e.g., advertisements) displayed dynamically based on the vehicle location. For example, the VDS 102 may be configured to automatically commence or cease the display of particular visual content (e.g., specific advertisements) when entering a predefined real-world area as specified by at least one geographical region associated with the visual content by the content management system 120. This advantageously allows the VDS 102 to receive advertisement data representing new and / or updated visual content from the content management system 120 asynchronously (e.g., only when a relevant geographical boundary is crossed, or about to be crossed, by the vehicle), thereby reducing the total amount of data transferred between the local vehicle mounted devices 102 and the remote content management system 120, and also eliminating the need for a continuous data transfer between the same.

[0077] The VDS 102 transmits the engagement data to the content management system 120 and, optionally, receives visual content data (e.g., advertisement data) dynamically from the content management system 120. The content management system 120 is configured to determine one or more engagement metrics associated with the visual content from the engagement data, and provide the engagement metrics to an end user device 103 of an end user of the system in real-time. The end user may be an advertisement publisher having visual content for display by the VDS 102, and / or a subscriber that is subscribed to receive analytics of at least some visual content maintained and displayed by the platform 100.

[0078] In some embodiments, the content management system 120 communicates with the advertiser user device 103 to provide real-time analytics in relation to the visual content displayed by the VDS 102 via a user content control application 140 executing on the advertiser user device 103. The user content control application 140 is configured to communicate with the content management system 120 to receive engagement analytics information (e.g., metrics determined by the server based on the real-time engagement data) and to permit a publisher to upload visual content, and geographical regions associated with the content, to the content management system 120. A content management application 140’ may be executed by an operator user device 105 of an operator of the vehicle (e.g., a driver) to allow the operator to monitor the functionality of one or more components of the VDS 102 in real-time.

[0079] In some embodiments, the VDS 102 is configured to directly transmit the engagement data to the advertiser user device 103 (e.g., for consumption by an advertisement publisher or subscriber) either simultaneously with, or without any, transmission of the engagement data to the content management system 120. In such embodiments, the advertiser user device 103 is configured to operate as a content management system 120, where, for example, the user content control application 140 determines the engagement analytics information by processing the real-time engagement data received from the vehicle display system 102. In some embodiments, the advertiser user device 103 and the content management system 120 are the same computing device or set of devices, or share one or more common devices. In such embodiments, the platform 100 advantageously provides a peer-to-peer communication architecture that provides an advertiser user with a capability to receive and process analytics information generated by the VDS 102, in relation to their advertising material as uploaded to the system, via the advertiser user device 103.Vehicle mounted display system

[0080] Fig. 2a schematically illustrates components of the visual content display platform 100 according to some embodiments of the proposed technology. The platform 100 comprises a VDS 102 in communication with a remotely located contentmanagement system 120, and one or more user devices such as an advertiser user device 103, and an operator user device 105. An example embodiment of the VDS 102 is described below.Display component

[0081] The display component 104 comprises one or more displays 111 configured to display visual content. In various embodiments, the one or more displays 111 may comprise a single display, two displays, three displays, or any number of displays according to the configuration of the display component 104. In some embodiments, at least one of the one or more displays 111 is an electronic display device configured to exhibit an image or a sequence of images in response to receiving display image input data. For example, the one or more displays 111 may comprise one or more electronic signs or panels, each consisting of LEDs, OLEDS, or other individual display elements that, when operated collectively, render the image or image sequence of the visual content.

[0082] In some embodiments, the one or more displays 111 of the display component 104 are controlled by a display controller 111’. The display controller 111’ provides display image input data to the one or more electronic display devices 111 in response to receiving control instructions and data from a controller 110 of the VDS 102. In some embodiments, the display controller 111’ is a hardware component or integrated circuit configured to convert digital images represented by the display image input data into a format suitable for collective rendering by the display panel elements. The display controller 111’ renders the image or sequence of images with a desired resolution, refresh rate, colour fidelity and / or one or more other properties. In some embodiments, the display controller 111’ performs one or more image manipulation operations such as scaling, rotation, and colour correction to the image or sequence of images. In some embodiments, the display controller 111’ is integrated into one of the electronic display devices 111, or into each of the electronic display devices 111 as a local display control component.

[0083] In some embodiments, the one or more displays 111 comprise at least one non-electronic display device (not shown). A non-electronic display device refers to any type of display device that does not rely on electronic components to function. For example, each non-electronic display device may be configured to use physical or mechanical means to present visual content, such as by way of a physical board supporting a print copy of the image(s).

[0084] Fig. 3a illustrates an exemplary implementation of the VDS 102 as a car-top system 102’. As shown in Fig. 3a, the one or more displays 111, and optionally the display controller 111’, form a car-top display component 104’ that is affixed to a vehicle 101 on which the car-top display system 102’ is mounted. For example, each of the one or more displays may be attached to a portion of an exterior surface of the vehicle 101, such as a roof and / or a rear or a side of the vehicle 101, using a permanent or removable fastening mechanism (e.g., brackets, adhesives). In some embodiments, the one or more displays 111 are contained within an enclosure designed to protect the one or more displays 111 from damage that may occur as a result of the exposure of the displays 111 to a physical environment and / or from the vehicle's movement.

[0085] The display component 104’ is configured to display visual content by way of one or more electronic display devices 111 to an environment 11 external to the vehicle 101. In the example configuration of Fig. 3a, the car-top display component 104’ comprises three electronic display signs Illa, 111b, and 111c mounted to the exterior roof surface 101a of the vehicle 101 by way of a frame (not shown). The electronic display signs Illa, 111b, and 111c may be arranged in a common horizontal plane oriented parallel, or substantially parallel, to the exterior roof surface 101a of the vehicle 101.

[0086] The electronic display signs Illa, 111b, and 111c are each arranged such as to exhibit visual content in an associated viewing direction from which a viewer 1 within the environment 11 views the electronic display sign. In some embodiments, the one or more electronic signs Illa, 111b, and 111c are collectively arranged to exhibit the visual content to the environment 11 with a field of view of substantially 360 degrees.

[0087] In the example depicted by Fig. 3a, the signs are arranged in a triangular configuration as: a left-side sign Illa located toward the left side of the vehicle 101; a right-side sign 11 lb is located toward the right side of the vehicle, the left-side sign Illa and right-side sign 111b being angled relative to a common point shared by a first end of both signs; and a rear sign 111c located toward the back of the vehicle 101 and placed between respective second ends of the left-side sign Illa and the right-side sign 11 lb. The electronic display signs Illa, 11 lb, and 111c are unidirectional displays configured to display visual content in a direction outward relative to the vehicle (as indicated with arrows in Fig. 3a). The display controller 111’ is connected to each of the three signs Illa, 111b, and 111c from a central location and operates the signs Illa, 11 lb, and 111c collectively such that the same visual content is viewable substantially in all directions (i.e., over 360 degrees around the component 104’ on the vehicle) from within the environment 11.

[0088] Fig. 3b illustrates another exemplary implementation of the VDS 102 as a cartop system 102” in which a display component 104” comprises a single electronic sign 11 Id. Electronic sign 11 Id is configured with two connected display panels 11 le and 11 If oriented in opposing facing directions such as to exhibit the visual content to the environment 11 with a field of view of substantially 360 degrees, irrespective of the orientation of the sign 11 Id relative to the top surface of the vehicle 101. In some embodiments, the displays 111 of the display component 104’ are adjustable in position and / or orientation relative to an attachment point on the vehicle 101 (e.g., to move or rotate to improve the field of view with which the visual content is exhibited to the environment 11).Imaging component

[0089] Referring to Fig. 2a, the imaging component 106 of the VDS 102 is configured to capture the environment 11 surrounding the vehicle 101 as imaging data comprising a series of one or more images (e.g., as still images, and / or frames of a video feed).

[0090] The imaging component 106 comprises at least one camera 112 which will be understood to refer to either a static or still camera configured to generate images or asequence of images, or a video camera configured to capture smooth, continuous video footage at a frame rate, and while performing techniques such as image stabilization, autofocus, and various video recording modes (e.g., 1080p, 4K). In some embodiments, the imaging component comprises one or more other imaging devices, such as integrated image sensors, including a charge-coupled device (CCD) sensor, a complementary metal-oxide semiconductor (CMOS) sensor, an electron multiplying CCD (EMCCD), a scientific CMOS (sCMOS) sensor, and / or other image sensors configured to generate image signals of visible light received from the scene.

[0091] The at least one camera 112, and / or other imaging sensors, are configured to capture one or more images of at least a portion of the environment 11 to which the display component 104 displays the visual content. For example, the imaging component 106 may include one camera, two cameras, or any number of cameras collectively configured to generate imaging data representing one or more images of the environment 11 at an imaging resolution.

[0092] In the example depicted by Fig. 3a, the imaging component 106’ comprises three cameras 112a, 112b, and 112c configured to capture video at 1080p resolution. The cameras 112a, 112b, and 112c are located on the vehicle 101, such as for example by attachment of each camera 112a, 112b, and 112c to a corresponding electronic sign Illa, 11 lb, and 111c of the display component 104’ (i.e., as left-side, right-side and rear-side cameras respectively). This permits the imaging component 106’ to image the environment 11 with a field of view substantially equivalent to the field of view with which the visual content is exhibited to the environment 11 by the display component 104’. In the example depicted by Fig. 3b, the imaging component 106” comprises two cameras 112e, 112f attached to respective connected display panels 11 le, 11 If.

[0093] In some embodiments, the imaging component 106 includes an imaging control unit (not shown) in electronic communication with the at least one camera 112 to perform one or more control operations associated with imaging the vehicle environment, including: activating one or more of the cameras 112 to capture at least one image of the environment within the field of view cameras 112, in response toreceiving a control signal; receiving, from the cameras 112 image capture data (e.g., two dimensional images and / or three dimensional images) representing the environment in the field of view; and processing the image capture data received from the cameras 112 to generate imaging data of the vehicle environment 11.

[0094] In some embodiments, the imaging control unit is configured as an embedded system with a processor and memory implemented as an integrated microcontroller with a RISC architecture. In other embodiments, the imaging control unit may be integrated with the at least one camera 112, thereby enabling an exchange of data between operational modules of the imaging control unit and the at least one camera 112 via an internal controller bus or similar structure.Communications component

[0095] Referring to Fig. 2a, the communications component 107 of the VDS 102 comprises a communications module 117 configured to facilitate electronic communication between the VDS 102 and other electronic devices, including at least the content management system 120 located remotely to the vehicle 101. In some embodiments, the communications module 117 is implemented as a transceiver configured for exchanging data over at least a Global System for Mobile Communications (GSM) cellular network (e.g. 4G or 5G), a wide area network (WAN), and / or an Internet-based network. For example, in the car-top system 102’ of Figs. 3a and 3b the communications module 117 may be implemented as a module supporting GSM, GPRS, EDGE, UMTS, HSPA+, and LTE communication with remote devices. In some embodiments, the communications module 117 is configured to attach to a computing device of the control component 108 by way of a “hardware attached on top” (HAT) module, such as a 3G / 4G / 5G & LTE compatible HAT.

[0096] In some embodiments, the communications component 107 comprises a position locating device 118 associated with the vehicle 101. The position locating device 118 comprises one or more modules configured to generate location data indicating a location of the vehicle 101. The position locating device 118 generates a geolocation of the vehicle 101 represented as a set of coordinates, such as a latitude andlongitude pair, and outputs data related to the same as the vehicle location data. The position locating device 118 may be coupled to the vehicle 101, such as for example as arranged within a housing of one or more components of the VDS 102, where the housing is affixed to the vehicle 101 and / or contained within the vehicle such that the position locating device 118 moves together with the vehicle 101.

[0097] The position locating device 118 may be implemented according to any global navigation satellite system (GNSS), including a GPS, GLONASS, and / or Galileo based receiver and / or other device capable of determining the location of vehicle 101 based on wireless signals received from an external source. The vehicle location is represented as vehicle coordinate information, such as for example comprising a 3D spatial co-ordinate value representing at least a geographical position of the vehicle 101. In some embodiments, position locating device 118 may be configured to further determine a velocity or speed of the vehicle 101 (e.g., using a time series of position measurements of the location data).

[0098] In the embodiment depicted by Fig. 2a, the position locating device 118 is separate to the communications module 117. However, in other embodiments the communications module 117 is configured to provide the position locating device 118 associated with the vehicle 101. For example, the communications module 117 may include a GPS receiver component configured to receive GPS location data from one or more GPS transmitter devices (e.g., GPS satellites). The GPS receiver 118 processes the GPS location data in real-time to determine the location of the vehicle 101 as a Real-Time Kinematic GPS (RTKGPS) location value, according to a geographical coordinate system (e.g., by enabling the determination of a GPS co-ordinate value of the vehicle 101 from one or more GPS transmitter devices).

[0099] In other embodiments, the position locating device 118 is not part of the communications module 117 or the VDS 102. For example, the communications module 117 may be configured to receive the location data in real-time from an external position locating device such as a smart phone, or other device, that is configured with a capability to determine the location of the vehicle 101.Controller

[0100] Control component 108 includes a controller 110 electronically connected to other components of the platform 100, including the display component 104, the imaging component 106, and the communications component 107, and configured to execute, store and receive instructions for controlling operations of the VDS 102.

[0101] The controller 110 is an electronic device capable of processing electronic instructions including microprocessors, microcontrollers, host processors, controllers, vehicle communication processors, and application specific integrated circuits (ASICs). In some embodiments, controller 110 is implemented as a small-scale computing device, such as a single-board computer (e.g., a Raspberry Pi), and comprises a central system bus, a memory, one or more processors, and a communications device for intersystem communication (not shown). The controller 110 executes digitally-stored instructions, such as software or firmware programs, which enables the operation of the VDS 102. The controller 110 is configured to execute programs or process data to carry out at least a part of the methods performed by the VDS 102, as described herein.

[0102] In some embodiments, the controller 110 is configured to receive: imaging data from the imaging component 106 representing the one or more images of the environment 11; and location data from the position locating device 118 indicating a location of the vehicle 101. In some embodiments, the imaging data and the location data are received by the controller 110 as a live data stream provided by the respective imaging component 106 and position locating device 118 in real-time.

[0103] In some embodiments, the processes executed by the controller 110 are implemented as programming instructions of one or more software modules stored on within the memory system. The modules include: an image analysis module 114 configured to operate the imaging data to generate on visual engagement data representing at least a number of impressions of the visual content by one or more viewers in the environment 11; and a geofencing module 115 configured to operate on the location data to determine whether the vehicle 101 is located within a geographic region associated with the visual content being displayed by the display component104. In some other embodiments, the modules may be implemented as one or more dedicated hardware components, and / or another logic or processing device such as field programmable gate arrays (FPGAs) and / or application-specific integrated circuits (ASICs).Image analysis module

[0104] In some embodiments, the image analysis module 114 is configured to apply one or more machine learning (ML) models to the imaging data. The one or more images of the imaging data are input to the one or more ML models to output detection data representing one or more objects detected within each image (e.g., as a set of “detected objects” for the respective image). The detected objects enable the image analysis module 114 to detect engagement of an individual in the environment with the visual content, such as for example by performing one or more of face detection, gaze estimation, and age group classification.

[0105] In some embodiments, the image analysis module 114 is configured with one or more detection models (not shown) indicating the expected characteristics of individuals that are engaged with the displayed visual content. One or more of the detection models may be configured with one or more model parameters determined by a model training process to recognize aspects of an individual’s face (e.g., a position and orientation of their eyes and / or head, relative to their face) via supervised learning on a training image data set.

[0106] For example, image analysis module 114 may include a detection network, such as a multilayer perceptron (MLP), a recurrent neural network (RNN), or a convolutional neural network (CNN) trained on a set of training data specific to one or more features to be detected from the one or more images input into the image analysis module 114. Training of the detection network may be performed with, for example, a set of training images and labels indicating visual features of a human staring at an object from a predetermined angle. In some embodiments, other types of machine learning and / or pattern recognition models may be used as the one or more detection models of the image analysis module 114.

[0107] The image analysis module 114 is configured to receive the image(s) generated by the imaging component 106 and to generate the detection data using an object detection algorithm, such as Faster-RCNN [1] and You Only Look Once (YOLO) [2], to recognize objects based on the trained detection model(s). In some embodiments, the visual engagement data is generated by the image analysis module 114 by performing an assessment of features of a respective viewer over a temporal window defined by one or more images of the imaging data (e.g., to perform gaze validation).

[0108] In some embodiments, the imaging component 106 is configured to generate visual engagement data without the storage of any personal identification information of any individuals captured within the image(s) of the imaging data.Geofencing module

[0109] The geofencing module 115 is executed by the controller 110 to determine the location of the vehicle 101 using data received from the GPS module in real-time or substantially real-time. The geofencing module 115 is configured to continuously receive, from the position locating device 118, vehicle location information, for example as a set of coordinates, such as a latitude and longitude pair.

[0110] In some embodiments, the geofencing module 115 is configured to perform real-time processing of the location of the vehicle 101 with corresponding geographic areas or zones associated with visual content displayed, or to be displayed, by the vehicle 101. The geofencing module 115 compares the vehicle location (coordinate) information to corresponding coordinates defined by one or more geographic regions of interest, such as a geographic region associated with the visual content. The geofencing module 115 is configured to receive one or more input arguments as geographical coordinate values representing the geographic region, and determine whether the vehicle presently resides within the geographic region.

[0111] For example, the geographic region may be represented as a sequence of geographical coordinates that when form a shape on a corresponding geographical map(also referred to as a “zone” on the map). The geofencing module 115 processes the coordinates used to specify geographic regions using a point-in-polygon check performed locally.

[0112] The some embodiments, the geofencing module 115 is configured to transform values of geographical coordinates from a native reference frame to a global or universal reference frame. For example, coordinate values according to a local coordinate system (e.g., 3D cartesian) may be converted to coordinates in a global reference system (GPS) for processing with the techniques described herein.Local repository

[0113] In some embodiments, the control component 108 further comprises a local repository 116 configured to store data. The local repository 116 may be a data storage device comprising a non-volatile storage component, for example as provided by the controller 110 or as standalone storage device, similar to the storage components(s) implemented within the content management system 120. The local repository 116 may be implemented as a hard disk drive (HDD) with a rotating magnetic disk or a solid state drive (SSD) comprising NAND flash memory such as SLC (Single Level Cell), eMLC (Enterprise Multi Level Cell), MLC (Multi Level Cell), TLC (Triple Level Cell), and QLC (Quadruple Level Cell), and combinations of the above such as SSHD. In some embodiments, the local repository 116 comprises a plurality of individual physical storage devices or modules, possibly of different types, either external to or part of the controller 110.

[0114] The local repository 116 stores data representing the image-based media which forms the displayed visual content. For example the display data may represent one or more of a dynamic image, a static image, a blank image, and / or a video feed providing a sequence of images at a predetermined frame rate. The local repository 116 operates as a repository of visual content that is maintained locally to the VDS 102. The controller 110 is configured to receive the display data from a remote media source, such as the content management system 120, via the communications component 107. The local repository 116 may be configured to store the display data ina data structure that is accessed by a local data management component (e.g., as a relational database table).

[0115] The local repository 116 is further configured to store geolocation data indicating at least one real-world geographical region associated with the display data. In some embodiments, local repository 116 is further configured to store one or more of: user data indicating one or more end users of the platform 100 that are associated with the display image data; vehicle data of the vehicle 101 to which the VDS 102 is affixed to; and visual engagement data generated by the VDS 102. The visual engagement data may be stored, for example, as a record of the number of viewer impressions and / or of other engagement metrics over time (as “engagement logging data”). The local repository 116 may be further configured to store a record of the display image data displayed by the display component 104 over time (as “display logging data”), where the display logging data shares a time correlation with the corresponding engagement logging data.

[0116] The VDS 102 is configured to exchange data with the content management system 120, and optionally with the user device(s) 103, 105. Data flows between the VDS 102 and the content management system 120 occur in real-time or substantially real-time to provide engagement data generated by the control component 108 to the content management system 120 (as described herein). In some embodiments, the controller 110 is configured to synchronize with the content management system 120 by performing a periodic exchange of data, irrespective of and / or additional to the realtime provision of the engagement data to (and, optionally, receipt of visual content data from) the content management system 120. For example, the controller 110 may be configured to transmit the engagement logging data and the visual content logging data to the content management system 120 at a predetermined time (e.g., once every 24 hour period), and / or when a predetermined condition is met (e.g., when the vehicle stops moving for a threshold amount of time).Power source

[0117] As shown in Fig. 2a, a power source 160 is configured to provide electrical power to the components of the VDS 102. In some embodiments, the power source 160 is provided as part of the VDS 102 and includes one or more batteries (e.g., comprising of Lithium-Ion) that are electrically connected to the display component 104, imaging component 106, communications component 107 and control component 108 to provide an uninterrupted electrical supply. In some embodiments, the one or more batteries are configured for in-field recharging, for example by the use of one or more solar panels located on the vehicle 101 (not shown).

[0118] In some embodiments, the power source 160 of the VDS 102 is provided by, or common to, the vehicle 101. For example, one or more of the display component 104, imaging component 106, communications component 107 and control component 108 may be connected to the electrical system of the vehicle 101 to draw electrical power as needed for operation.Content management system

[0119] As shown in Fig. 2a, the platform 100 includes a content management system 120 comprising at least one computing device configured to provide the VDS 102 with backend functionality related to the management of visual content that is exhibited by the platform 100, and related information. In some embodiments, such as the embodiment shown in Fig. 2a, the content management system 120 is implemented as an advertisement server 120. However, it will be appreciated that the content management system 120 may be deployed for one or more other applications where it is desired to disseminate non-advertising related visual information to a real-world environment (e.g., an emergency alert and warning system) without substantially departing from the concepts described.

[0120] In some embodiments, the advertisement server 120 is configured as a standalone computing device, and comprises a central system bus (not shown), a memory system 122, one or more processors (CPUs) 121, and a communicationsinterface 128. The processor(s) 121 may be any microprocessor which performs the execution of sequences of machine instructions, and may have architectures consisting of a single or multiple processing cores such as, for example, a system having a 32- or 64-bit Advanced RISC Machine (ARM) architecture (e.g., ARMvx). The processor(s) 121 issues control signals to other device components via the system bus, and has direct access to at least some form of the memory system 122.

[0121] The memory system 122 provides internal media for the electrical storage of the machine instructions required to execute the user application. The memory system 122 may include random access memory (RAM), non-volatile memory (such as ROM or EPROM), cache memory and registers for fast access by the processor(s) 121, and high volume storage subsystems such as hard disk drives (HDDs), or solid state drives (SSDs).

[0122] In some embodiments, the processes executed by the advertisement server 120 are implemented as programming instructions of one or more software modules stored on non-volatile storage of the memory system 122. The modules include: a display control module 132; an analytics module 134; and a content management application module 136. The analytics module 134 is configured to perform functions related to determining the engagement of individuals with the visual content displayed to the environment by use of the VDS 102. The display control module 132 is configured to control the provision of visual content data to the VDS 102 by the advertisement server 120. The content management application module 136 provides an application programming interface (API) for the exchange of data between the advertisement server 120 and a content control application 140 executing on one or more user devices 103, 105 of end users of the platform 100.

[0123] Memory system 122 may also include one or more general application programs providing methods, data structures or other software services that define data or perform functions as required by the advertisement server 120 (e.g., an operating system). The data and instructions may reside in multiple parts of the memory system 122, including registers, cache, main memory, and high volume storage.

[0124] Communications interface 128 is configured to enable the establishment of a logical connection between the advertisement server 120 and other devices of the platform 100 through a wireless or wired transmission media. For example, communications interface 128 may be configured as one or more devices that receive and transmit sensor signals, control signals, and other signals from and to elements of platform 100 using a variety of wired and / or wireless communication techniques, including voltage signaling, Ethernet, WiFi, Bluetooth, Zigbee, Xbee, Micronet, or other medium and / or short range wired and / or wireless networking protocols and / or implementations. In such embodiments, each system of platform 100 may include one or more modules supporting communication with the communications interface 128, such as for example a network interface implementing the IEEE 802. xx family of networking protocols.

[0125] The advertisement server 120 implements one or more service modules including a data storage and retrieval module (not shown) enabling data to be stored in, and retrieved from, the memory system 122. In some embodiments, the data storage and retrieval module includes, for example, a SQL database and / or a file management system. In some embodiments, the data storage and retrieval module interacts with one or more data structures configured to store data within the memory system 122.

[0126] Fig. 2b illustrates an exemplary configuration of the memory system 122 comprising of data tables, or similar structures, configured to store at least user data 123, vehicle data 124, advertisement data 125, and engagement data 126.

[0127] The user data 123 comprises records related to one or more end users registered with the advertisement server 120. The user data 123 may include a unique identifier of a user (e.g., a user ID value) that distinguishes the user among others of the platform 100. The user data 123 may also include user information in the form of a name, a street address, and electronic address, and / or other personal details of the user.

[0128] As recorded in the advertisement server 120, the user data 123 may include one or more user types for each user, where the user type may be one of: an‘advertiser’, which is a user who publishes media to be displayed as visual content by the VDS 102 and who receives analytics information from the platform 100 in relation to the published media; and an ‘operator’ which is a user who operates a vehicle on which a display system 102 is mounted (e.g., a driver of vehicle 101).

[0129] The user data 123 may comprise user payment data representing information relating to one or more of a payment account of the user (e.g., a bank account or credit card number), a payment plan which the user is subscribed to, and one or more payment transactions made to or by the user in relation to use of the platform 100. For a user registered as an operator user, the user data 123 may comprise operator and / or vehicle data, such as a driver's licence number and / or information about the vehicle operated by the user. The vehicle information may include, for example, a registration number of the vehicle or other identifying information of the vehicle. The user data 123 may record a vehicle ID value to link to a record in the vehicle data 124 associated with a vehicle registered for operation by the user.

[0130] In some embodiments, the user data 123 includes device data associated with a user device 103, 105 used by the user to interact with the platform 100. The device data may include a device ID or key value uniquely identifying the device (e.g., a unique hardware identifier of the device, such as a processor serial number), connection data indicating properties of a connection between the user device and the advertisement server 120 and or the VDS 102. The connection data may include, for example a network address, a session identifier, and / or an authentication token for electronic communication between the advertisement server 120 and the user device 103, 105.

[0131] The vehicle data 124 includes one or more records representing respective vehicles 101 registered for use with the platform 100 (i.e., to which a VDS 102 may be attached for the purpose of performing the methods described herein). Each record of the vehicle data 124 may specify a vehicle ID unique to the vehicle 101 (e.g., a registration number) and other information such as the model and type, and optionally information in relation to the vehicle owner.

[0132] The advertisement data 125 includes one or more records representing or linking to display data maintained by the advertisement server 120. The display data may comprise one or more digital files representing images or video to be processed and displayed as visual content by the VDS 102. The display data is uploaded to a storage component of the advertisement server 120 by an advertiser user of the platform 100 (e.g., via the content control application 140 of their user device 103) associated with the display data. In some embodiments, the display data represents a plurality of visual content that may be separately displayed by the VDS 102 (e.g., different images, or sequences of images, representing, for example, different advertisements of the publisher). In such embodiments, the advertisement data 125 may be configured to record separate ID values for each independently displayable portion of the display data.

[0133] Each record of the advertisement data 125 further includes: a corresponding user ID of the advertiser user associated with the display data; and geolocation data indicating at least one real-world geographical region associated with the display data. In some embodiments, the geolocation data comprises a set of location values as geographical coordinates, such as latitude and longitude, that represent one or more boundaries defining the zone on a digital map. The geographical zone(s) associated with the display data may represent, for example, areas in which visual content corresponding to the display data is to be displayed by the VDS 102 and / or in which analytics for the display of the visual content are to be provided in real-time to the advertiser user by the platform 100.

[0134] In some embodiments, the advertisement data 125 includes display assignment data indicating, for a given vehicle registered for use with the platform 100: the advertisement data (i.e., display data and corresponding user IDs) assigned for display by the VDS 102 deployed onto the vehicle; and scheduling data indicating how the display data is to be displayed as visual content by the VDS 102. For example, the scheduling data may indicate a portion of time for which the display component 104 of the VDS 102 is to exhibit the visual content represented by the display data. The display assignment data is dynamically updated by the display control module 132 inaccordance with input received from the one or more users of the advertisement server 120 (e.g., via the content control application 140 executing on a respective user device 103).

[0135] The engagement data 126 includes one or more records representing at least one engagement metric derived in association with the display data of an advertisement data record. The at least one engagement metric may comprise: a number of impressions of the visual content represented by the display data (e.g., as engagement logging data, or as one or more values obtained by processing the logging data); and optionally other metrics in relation to the exhibition of the visual content (e.g., average and / or total duration of gaze of viewers, estimated demographics of the viewers registering an impression, etc.)

[0136] In some embodiments, the memory system 122 is configured to store additional data including advertising campaign data 129. The advertising campaign data 129 may include records comprising a user ID indicating an advertiser user associated with the campaign; a campaign ID uniquely identifying the campaign; and ID values of records of the advertisement data 125 associated with the campaign. Each record of the campaign data 129 represents an advertising campaign of the associated user, as defined at least in part by a set of media which is to be advertised, by display as visual content, using platform 100. In some embodiments, the records of the campaign data 129 each include a set of statistics associated with the advertising campaign, such as for example a set of engagement data corresponding to the media included in the campaign, and a set of financial data associated with the campaign (e.g., a value of revenue associated with the display of the media as visual content by at least one VDS 102).

[0137] As shown in Fig. 2a, various data flows 141, 143, 145, 147, 149 exist between one or more of the VDS 102, the advertisement server 120, and the user devices 103, 105. In some embodiments, the VDS 102 is configured to communicate with the advertisement server 120, and / or any of the user device 103, 105, over a protected channel. For example, transceiver 117 of the VDS 102 may establish a secure TLS-based communication session with the communications interface 128 of the advertisement server 120 (e.g. ,via an initial exchange of cryptographic key(s) and the application of encryption and decryption with the shared key(s)) thereby permitting the secure exchange of data using Internet Protocol (IP) addresses assigned to each respective device.

[0138] Data flow 141 comprises a transmission of visual engagement data generated by the controller 110, via the communications component 107, to the communications interface 128 of the advertisement server 120. The data flow 141 may also comprise the transmission of one or more media ID, user ID, and / or vehicle ID values, with corresponding values stored in the memory system 122, from the controller 110 to the advertisement server 120, where the ID values provide user, vehicle and media information associated with the visual engagement data to facilitate the processing of the same by the processor 121 of the advertisement server 120.

[0139] In some embodiments, data flow 141 further comprises a transmission of visual content, in the form of at least display data, from the advertisement server 120 to the controller 110 via the communications interface 128. The visual content may be received by the controller 110 as, or in addition to, advertising information (e.g., a media ID), user information (e.g., a user ID), and / or display assignment data comprising instructions for the controller 110 to control the display of the visual content via the display component 104.

[0140] A portion of data flow 141 may occur periodically at predetermined time intervals, or in response to predetermined events, such as to enable the controller 110 synchronize data stored in the local repository 116 with the memory system 122 of the advertisement server 120, and to permit the advertisement server 120 to provide regular updates to the visual content maintained locally by the VDS 102, and the scheduling of the display of the same. A further portion of the data flow 141 occurs asynchronously and as a real-time response to a change in the location of the vehicle 101, and based on one or more geographical regions associated with visual content maintained by the advertisement server 120 and / or the controller 110.

[0141] Position locating device 118 and / or transceiver 117 perform real-time tracking of the location of the vehicle 101, and therefore of the display component 104 exhibiting the visual content. The controller 110 receives vehicle location data from the position locating device 118 and / or transceiver 117 periodically, e.g., every 5 seconds or less, and invokes the geofencing module 115 to determine whether the vehicle is located within a geographic region associated with the visual content currently displayed, and / or any other visual content represented by advertising data currently loaded onto the controller 110 (e.g., stored in local repository 116).

[0142] Data flows 143 and 145 relate to the exchange of data between the advertisement server 120 and the user devices 103 and 105 of an advertiser user and an operator user (e.g. driver) respectively. Data flow 143 comprises the transmission of data, from the advertiser user device 103 to the advertisement server 120, representing one or more of: user information; and advertising information. The advertising information may include media files (e.g., images and / or videos) representing advertisement content to be exhibited by a VDS 102 of the platform 100, and one or more associated geographical regions for the advertisement content. The user information and advertising information is entered to a graphical interface (referred to as a “dashboard”) of the content control application 140 executing on the user device 103.

[0143] Data flow 143 further comprises transmission of data from the advertisement server 120 to the advertiser user device 103, which may include data representing one or more engagement metrics associated with the visual content of the advertisement information uploaded by the advertiser user. At least this portion of the data flow 143 occurs in real-time, or substantially real-time, with the generation of the one or more engagement metrics by the advertisement server 120.

[0144] Data flow 145 comprises transmission of data from the operator user device 105 to the advertisement server 120, representing one or more of: user information of a driver user registered with the platform 100; and vehicle information of a corresponding vehicle 101 operated by the driver user to display visual content via themounted VDS 102. The user information and / or vehicle information is transmitted to the communication interface 128 of the advertisement server 120 by an instance of the content management application 140’ executing on the operator user device 105.

[0145] In some embodiments, the data flow 145 is unidirectional in that the operator user device 105 does not receive data from the advertisement server 120 other than acknowledgement data in response to an upload of user information and / or vehicle information by the operator user via the content management application 140’. That is, the content management application 140’ executing on the operator user device 105 has restricted functionality, and in some implementations a distinct user interface, compared to the content management application 140 executing on the advertiser user device 103.

[0146] Data flow 147 relates to communication between the VDS 102 and the operator user device 105. In some embodiments, the data flow 147 comprises the transmission of system reporting data by the controller 110, via transceiver 117, to the operator user device 105. The controller 110 is configured to generate the system reporting data representing for example one or more metrics of functionality of one or more of the display component 104; the imaging component 106; and the communications component 107 of the VDS 102.

[0147] In some embodiments, the controller 110 is configured to generate and transmit the system reporting data to the operator user device 105 periodically, and / or asynchronously with the occurrence of a fault in one of the components of the system 102. For example, the controller 110 may comprise a system diagnostic module (not shown in Fig. 2a) that repeatedly polls a set of hardware parameters of each of the display component 104, the imaging component 106, and the communications component 107, and detects a failure of any of the components by comparing the polled values to predefined tolerance or threshold values. The controller 110 generates the system reporting data as a real-time response to detecting the failure in any of the components. This enables the operator user to be alerted to issues affecting theoperation of the VDS 102 in real-time, promoting a rapid response and an improved ability to maintain continuous performance of the on-vehicle hardware.

[0148] Data flow 149 is an optional data flow representing direct communication between the VDS 102 and the advertiser user device 103. For example, in some embodiments the controller 110 is configured to transmit, via the transceiver 117, visual engagement data generated for particular visual content to the advertiser user device 103 by way of a direct communication channel (i.e., without first transmitting the generated visual engagement data to the advertisement server 120).

[0149] In such embodiments, the advertiser user device 103 is configured as a content management system capable of: determining, from the visual engagement data received from the controller 110, one or more engagement metrics associated with displayed visual content; and providing the one or more engagement metrics to the advertiser user (e.g., directly via the dashboard of the content control application 140 executing on the same user device). In such embodiments, data flow 141 may still exist between the VDS 102 and the advertisement server 120, for example to enable the VDS 102 to be configured with at least an initial set of user data, display data and geographical region data to allow the system to generate engagement data and provide the engagement data to the operator user.User devices

[0150] As shown in Fig. 2a, the platform 100 includes user devices 103, 105 in communication with advertisement server 120 and the VDS 102. User devices 103, 105 comprise at least one device configured for use by an advertiser (“advertiser user device” 103) and at least one device configured for use by an operator of the vehicle 101 (“operator user device” 105).

[0151] In some embodiments, one or more of the user device 103, 105 is a mobile computing device, such as a smart phone or tablet. Generally, each user device 103, 105 is a computing device with a processing unit configured to execute a user content control application 140. The content control application 140 may be a mobileapplication in the form of a dedicated software program obtainable from a digital distribution platform that provides applications for an operating system executing on the device (e.g. Google Play Store or Apple Store). Alternatively, the content control application 140 may be a generic software application, such as a web browser configured to render one or more webpages hosted by a dedicated web server (e.g., as provided by the advertisement server 120).

[0152] The content control application 140 includes at least, a user interface, and a memory structure configured to store data in relation to the content management system 120, the vehicle 101, and / or the VDS 102. The user interface is configured to accept user input and / or provide feedback to a user of the device 103, 105. For example, the user interface may comprise one or more displays, touch screens, and / or input peripheral devices adapted to provide user input as a type of signal and / or information to the user device 103, 105.

[0153] The memory structure is implemented by one or more internal components configured for the electrical storage of the machine instructions required to execute the content control application 140 and to store related data. The internal components may comprise one or more of random access memory (RAM), non-volatile memory (such as ROM or EPROM), cache memory and registers for fast access by the processing unit of the user device 103, 105, and high volume storage subsystems such as hard disk drives, or solid state drives.

[0154] In some embodiments, the content control application 140 is configured to store one or more identifiers of the user device on which it executes, and of respective devices of the VDS 102, the content management system 120 and / or other devices that are configured to exchange data with the content control application 140 (e.g., to provide engagement data and / or system monitoring data to the content control application, and to receive advertising information from the content control application

[0155] In some embodiments, the content control application 140 is also configured to store session data including data related to any active secure communication session presently established between any VDS 102 and / or the content management system 120. The session data may include, for example: a session ID; and a shared secret (e.g., a cryptographic key pair) enabling the encryption of data transmitted over a wireless channel between the user device 103, 105 and the device of any VDS 102 and / or the content management system 120, for the session.

[0156] In some embodiments, the user device 103, 105 is registered with the content management system 120 to enable the user device 103, 105 to receive and transmit data from and to devices of any VDS 102 and / or the content management system 120. The content management system 120 registers a user device 103, 105 by storing its corresponding device key.Methods for displaying visual content

[0157] Fig. 4a illustrates a method 400 executed by the controller 110 of the VDS 102 for providing real-time analytics information of visual content displayed using a vehicle 101 to a content management system (e.g., an advertisement server 120, or a user device 103 if configured as such), in accordance with some embodiments of the proposed technology. That is, method 400 relates to the generation and controlled transmission of engagement data, as associated with particular displayed content, by the VDS 102 to the remote content management system 120, 103 using dynamic vehicle location tracking.

[0158] At step 402, the controller 110 controls the display component 104 to display the visual content to the environment 11 external to the vehicle 101.

[0159] Fig. 5 illustrates a method 500 for controlling the display component 104 to display initial visual content. At step 502, the controller 110 obtains display data representing image or video media. In some embodiments, the controller 110 queries the local repository 116 to obtain display data from advertisement data 125 previously uploaded to the VDS 102. In some embodiments, the controller 110 queries the contentmanagement system 120, 103 and receives the display data (e.g. as advertisement data 125) in response to the query at or shortly before the time at which the initial visual content is to be displayed.

[0160] In some embodiments, the controller 110 obtains display data, and thereby determines the visual content for display by the display component 104, independently of the real-time location of the vehicle 101. For example, the controller 110 may use the same display data to control the display component 104 to display the same visual content, irrespectively of whether the vehicle 101 moves into or out of different geographic regions. In such embodiments, according to the steps of method 400 described below, although the displayed visual content may remain constant as the vehicle 101 is located within different geographical regions, the controller 110 is able to control the transmission of the associated visual engagement data in real-time using vehicle location tracking.

[0161] In other embodiments, the controller 110 determines the visual content for display by obtaining the display data based at least in part on the location of the vehicle 101 (e.g., in accordance with method 450 of Fig. 4b described below).

[0162] At step 504, the controller 110 processes the display data to determine one or more images for electronic display by the one or more electronic signs 111 of the display component 104. For example, the controller 110 may extract the one or more images from display data or generate new images from media contained therein (e.g., from a video feed of the display data.

[0163] At step 506, the controller 110 generates and transmits display control instructions and the one or more images to the display component 104. The display control instructions may include information relating to the positioning, resolution, and / or timing of the display of the one or more images on any of the electronic signs 111 to create the initial visual content displayed to the environment. In some embodiments, the display control instructions are processed by the display controller 111’ of the one or more signs 111.

[0164] Referring to Fig. 4a, following step 402 the visual content is exhibited to one or more individuals in the environment 11, possibly as the VDS 102 moves with the vehicle 101 in the environment 11. At step 404, the controller 110 receives imaging data generated by the imaging component 106 representing one or more images of at least a portion of the environment 11. For example, the one or more cameras 112 may image the environment over a 360 field of view to generate imaging data as a set of HDR images captured at a rate of at least 20 images per second.

[0165] At step 406, the controller 110 processes the imaging data by executing the image analysis module 114 to generate visual engagement data representing at least a number of impressions of the visual content in the environment. The set of individuals that view the visual content are detected and registered as one or more viewers, where the visual engagement data records the impressions made by the one or more viewers against the displayed content.

[0166] Fig. 6 illustrates a method 600 performed by the controller 110 for generating the visual engagement data. At step 602, the controller 110 receives the imaging data from the imaging component 106. In some embodiments, the at least one camera 112 transmits imaging data directly to the controller 110 asynchronously with the generation of the images. At step 604, the controller 110 optionally performs image preprocessing or enhancement operations on the one or more images received from the cameras 112. For example, the controller 110 may invoke the image analysis module 114 to adjust the image brightness and / or contrast, sharpen the image details, and / or reduce noise or artefacts.

[0167] At step 606, the controller 110 generates engagement data from the one or more images capturing environment 11. The engagement data relates to the visual engagement of individuals in the environment on the content displayed by the display component 104 (hence referred to as “visual engagement data”), such as for example including metric(s) assessing whether the visual content was seen by an individual, and the extent (e.g., duration) of the exposure of the individual to the content as displayed. In some embodiments, the visual engagement data, as generated locally by thecontroller 110, includes one or more of: an impression count; a viewer count; a gaze time; an indication of viewer age group; a timestamp; and a geographic location.

[0168] Fig. 7 illustrates a method 700 executed by the image analysis module 114 to determine engagement data comprising at least a number of impressions of the visual content.

[0169] At step 702, the image analysis module 114 receives images captured by the cameras 112. The image analysis module 114 is configured to perform the detection of an impression without performing identity recognition of the individuals by detecting face presence, head orientation, and / or gaze direction features within the images captured by the camera(s) 112. The image analysis module 114 is configured with one or more machine learning (ML) models as detection models, such as for example a lightweight CNN (e.g., MobileNetV2) and YOLO for object detection. Views are detected and tracked by combining bounding box tracking with gaze validation. Valid impressions are calculated based on a minimum view time. In some embodiments, the ML models are trained on the WIDER FACE [3] and GazeCapture [4] datasets to facilitate the use of the one or more ML models to perform the steps 704-708 described below.

[0170] At step 704, the image analysis module 114 performs face detection on one or more of the received images. In some embodiments, the image analysis module 114 applies the one or more trained detection models to the received images (as inputs) according to YOLO. For example, the image analysis module 114 divides the input image into a grid and predicts bounding boxes and class probabilities for each grid cell. At least one convolutional neural networks (CNNs) of the detection models is applied to extract features from the input image and predict the locations of faces.

[0171] At step 705, the image analysis module 114 processes an output of the detection models to determine whether a face is present in the input image(s). On a positive determination, the image analysis module 114 performs gaze estimation at step 706. The image analysis module 114 analyzes eye movements and head orientation offacial features detected in the input image(s) by application of the detection models. Outputs from at least one detection model provide an indication of a gaze direction of the facial feature identified in the input image(s).

[0172] At step 708, the image analysis module 114 processes the detected gaze directions. For example, the image analysis module 114 may determine a dwell time of the gaze and by comparing this value to a dwell time thresholds. This allows the image analysis module 114 to filter out passive or accidental glances of viewers, such that these do not contribute to impression detection. The dwell time threshold, and / or other parameters of the detection models, may be configured prior to performing steps 704-708. In some embodiments, the dwell time threshold, and / or other parameters of the detection models, are set dynamically by the image analysis module 114 in response to attributes of the environment 11 (e.g., weather) and / or the vehicle 101 (e.g., its speed) to account for conditions that effect lighting and / or object visibility in the input image(s).

[0173] At step 709, the image analysis module 114 determines whether a valid impression based on the outcome of the processing in step 708. In response to the determination of a valid impression, at step 710 the image analysis module 114 generates impression data to count the number of detected and validated impressions over the one or more images of the environment 11. The method 700 advantageously determines an engagement metric without determining an identity of any of the viewers of the visual content, since the steps involve detecting and filtering impressions passively rather than based on identity conveying features.

[0174] Referring to Fig. 4a, at step 408, the controller 110 receives, from the position locating device 118 associated with the vehicle 101, location data indicating a location of the vehicle 101. Then, at step 410, the controller 110 processes the location data to determine whether the vehicle 101 is located within a geographic region associated with the visual content. The controller 110 performs steps 408 and 410 by executing the geofencing module 115 on the vehicle coordinate information representing the location of the vehicle 101.

[0175] Fig. 8 illustrates a method 800 performed by the geofencing module 115 to determine a real-time location of the VDS 102 relative to a geographic region of visual content. At step 802, the geofencing module 115 receives, from the position locating device 118, location data indicating a location of the vehicle 101. For example, the geofencing module 115 may use the real-time GPS data received from the position locating device 118 to track the vehicle location via a u-blox module, with the location data updated every few seconds.

[0176] At step 804, the geofencing module 115 obtains relevant zone data indicating one or more geographic regions of interest. In step 408 of method 400, the geographic regions of interest comprise at least one region associated with visual content that is currently displayed by the display component 104. In other methods, the geofencing module 115 may be invoked where the one or more geographic regions of interest also include the geographic regions of visual content that may potentially be displayed by the display component 104 (i.e., either as scheduled by advertisement scheduling data, or as a candidate for being dynamically displayed based on location, as described below). The geographic region associated with the visual content is determined by the advertiser user (i.e., the publisher of the visual content), where zones are defined via coordinates in GeoJSON format.

[0177] At step 806, the geofencing module 115 compares the vehicle coordinates of the location data to the coordinates of the geographic region of the visual content. In some embodiments, where the vehicle coordinate information comprises GPS coordinates to determine if the vehicle location is within the GeoJSON-defined region, the geofencing module 115 performs a point-in-polygon check involving: (i) parsing the GeoJSON defined region (e.g., by loading the GeoJSON data and extracting the coordinates of the polygon(s) that define the region); (ii) creating geometric representations of the polygons and the GPS point (e.g., by using a library function); and (iii) geometrically determining if the GPS point is inside the polygon of the geographic region.

[0178] At step 808, the geofencing module 115 generates output data indicating whether the present vehicle coordinates are located within the geographic region associated with the visual content (e.g., as a binary value), and provides the output data to the controller 110.

[0179] Referring to Fig. 4a, in response to determining that the vehicle 101 is located within the geographic region, at step 412 the controller 110 transmits, via the communications component 107, the visual engagement data to a content management system 120, 103 located remotely to the vehicle 101.

[0180] In some embodiments, the controller 110 is configured to process the visual engagement data prior to transmission to the content management system 120, 103. For example, the controller 110 may compress the visual engagement data and / or batch the visual engagement data together with other data generated for the same (or other) visual content and transmit the compressed and / or batched data to the content management system 120, 103. In some embodiments, the content management system 120, 103 is configured to process the visual engagement data to provide one or more engagement metrics to a publisher of the visual content (e.g., an advertiser user of the platform 100). in accordance with the methods described below.

[0181] Fig. 4b illustrates a method 450 executed by the controller 110 of the VDS 102 for displaying visual content displayed using a vehicle 101, in accordance with some embodiments of the proposed technology.

[0182] At step 452, the controller 110 receives, from the position locating device 118, location data indicating the location of the vehicle 101 (analogously to step 408 of method 400).

[0183] At step 454, the controller processes the location data to determine whether the vehicle 101 is located within a particular geographic region associated with particular visual content (analogously to step 410 of method 400). Based on the determination inat step 454, at step 456 the controller 110 controls the display component 104 to display the visual content to the environment 11.

[0184] For example, the controller 110 may be configured to process advertisement data 125 stored in the local repository 116 to obtain geolocation data for a set of candidate geographic regions of corresponding candidate visual content that may be displayed by the display component 104. The controller 110 invokes the geofencing module 115 to determine whether the vehicle is located within any one or more regions from the set of candidate geographic regions, including the particular geographic region.

[0185] In some embodiments, determining whether the vehicle is located within any one or more regions from the set of candidate geographic regions includes determining: (i) that the vehicle has entered the particular geographical region associated with the visual content; and / or (ii) that the vehicle has exited another geographical region associated with other visual content (e.g., visual content displayed prior to step 456). The controller 110 is configured to operate the display component 104 to commence displaying the particular visual content in the case of (i), and to cease displaying the other visual content in the case of (ii). This advantageously allows the VDS 102 to control the visual content that is displayed to the environment around the vehicle 101 dynamically in real-time as the vehicle 101 travels through multiple geographical regions (i.e., to show particular visual content, such as advertisement material, only in certain geographical region(s)) that are defined by the advertiser user(s).

[0186] At step 458, the controller 110 receives imaging data from the at least one camera 112 located on the vehicle 101, where the imaging data represents one or more images of at least a portion of the environment 11 (analogously to step 404 of method 400).

[0187] At step 460, the controller 110 processes the imaging data to generate visual engagement data representing at least a number of impressions of the visual content in the environment. The controller 110 invokes the image analysis module 114 to processthe image data by applying one or more machine learning (ML) models to the imaging data (analogously to step 406 of method 400).

[0188] At step 462, the controller 110 transmits the visual engagement data to a content management system located remotely to the vehicle (analogously to step 412 of method 400).Determining real-time engagement of visual content

[0189] Fig. 9 illustrates a method 900 for determining real-time engagement of visual content displayed with a VDS 102 mounted to a vehicle 101, as depicted in Figs. 1-3, in accordance with some embodiments of the proposed technology. The method 900 is executed by at least one processor located remotely to the vehicle 101, such as for example by a content management system 120, 103.

[0190] At step 902, the content management system 120, 103 receives, from the VDS 102, the visual engagement data of displayed visual content (i.e., as transmitted to the content management system 120, 103 at steps 412 and 462 of methods 400 and 450 respectively). The visual engagement data comprises at least a number of impressions of the visual content in the environment external to the vehicle 101.

[0191] At step 904, the content management system 120, 103 processes the received visual engagement data to determine one or more engagement metrics associated with the visual content. The one or more engagement metrics may include the same metric(s) as represented by the visual engagement data generated by the VDS 102. Alternatively, or in addition, the content management system 120, 103 may process the metric(s) as represented by the visual engagement data generated by the VDS 102 to generate one or more additional engagement metrics.

[0192] In some embodiments, the additional metrics may include one or more of: an aggregated number of impressions of the visual content over a predefined time window; an average gaze time of the visual content; a distribution of age demographicsof viewers of the visual content; and / or a distribution of the aggregated number of impressions correlated with one or more geographical locations.

[0193] In one example, the content management system 120, 103 sums the number of impressions indicated by all visual engagement data received from the VDS 102 in real-time over a selected time period (e.g., 24 hours) to generate a total impressions metric for the visual content. In another example, the content management system 120, 103 correlates individual or groups of impressions with location values where the impression was detected (as indicated by location stamp data within the visual engagement data received from the VDS 102) to generate a location-based impression heatmap for the visual content.

[0194] At step 906, the content management system 120, 103 updates a graphical interface of a user device 103 to exhibit the one or more engagement metrics in realtime, or substantially real-time, with the determination of the same. For example, the content management system 120, 103 may operate an interface of the content control application 140, as executed by the advertiser user device 103, to display graphical elements that permit an advertiser user to view the one or more engagement metrics associated with the visual content.

[0195] In some embodiments, the content management system is implemented as an advertisement server 120 as shown in Fig. 2a. The analytics module 134 of the advertisement server 120 processes the visual engagement data and generates the additional metrics according to steps 902 and 904 of method 900. The content management application module 136 of the advertisement server 120 generates and transmits data and instructions to the advertiser user device 103 to provide updates to the graphical elements rendered by the content control application 140 in real-time.

[0196] In other embodiments, the advertiser user device 103 may be configured as the content management system, such that the advertiser user device 103 receives the visual engagement data from the VDS 102. In such embodiments, the content control application 140 is configured to perform the steps related to the processing of the visualengagement data and generation of the additional metrics analogously to the display control module 132 and the analytics module 134 of the advertisement server 120.

[0197] Fig. 10 illustrates a method 1000 executed by at least one processor of the advertisement server 120 for receiving and processing advertising information as part of the method 900.

[0198] At step 1002, the advertisement server 120 receives, from the graphical interface of the content control application 140, advertising information comprising the visual content to be displayed by the VDS 102. The advertiser user acts as a publisher of advertising material, including the visual content, by uploading data (e.g., media files) using the interface elements rendered on the advertiser user device 103 by the content control application 140 (as described below).

[0199] At step 1004, the advertisement server 120 processes the advertising information to determine corresponding display data and / or geolocation data to facilitate the exhibition of the advertising material by the VDS 102.

[0200] At step 1006, the advertisement server 120 transmits the corresponding display data and geolocation data of the advertising information to the VDS 102. In some embodiments, the corresponding display data and geolocation data is transmitted to the VDS 102 synchronously with the advertisement server 120 receiving the advertising information from the advertiser user. In some embodiments, the advertisement server 120 transmits the display data and geolocation data to the VDS 102 automatically in response to one or more predetermined conditions (e.g., at a particular predefined time and / or date, or in response to a request received from a corresponding VDS 102).

[0201] In some embodiments, the advertisement server 120 issues display update commands and / or to the VDS 102 to control the advertisement material exhibited by the VDS 102. The advertisement server 120 may generate, or receive from the content control application 140, update data indicating new visual content to be displayed by the display component 104 of the VDS 102.

[0202] Optionally, the update data may be based on the real-time engagement analytics of the visual content. For example, the content control application 140 may generate update data to automatically adjust or set a desired frequency for the display of particular advertisement information based on the total number of impressions, or aggregated impressions over time, of the advertiser user’s visual content (i.e., as currently or previously displayed).

[0203] The advertisement server 120 transmits the update data to the VDS 102. The controller 110 receives the update data and operates the display component 104 to cause the display of the new visual content by the VDS 102.Exemplary content control application

[0204] The content control application 140 permits a user to interact with the platform 100 via user device 103, 105 executing the application. The functionality provided by the content control application 140 varies depending on the instance of the application 140 executed by the user device (i.e., in accordance with the role and level of permissions of the user).

[0205] Fig. 11 illustrates a first exemplary interface 1100 (referred to as a “dashboard”) rendered by the content control application 140 executing on a user device 103 of an advertiser user. Interface 1100 comprises a main panel 1101 with one or more interface elements 1102, each providing information associated with visual content of the advertiser user.

[0206] In the example dashboard 1100 depicted in Fig. 11, the one or more interface elements 1102 include sub-panels 1104, 1105, 1106, and 1107, displaying a visual indicator of at least one engagement metric associated with visual content of the advertiser user. Impressions panel 1104 provides a numerical report of the total number of verified impressions of the visual content in a period of time, and of the percentage change relative to a previous period.

[0207] Impressions overview panel 1105 graphically illustrates the total number of impressions over time within the time period. In some embodiments, the total number of impressions over time is determined in accordance with engagement logging data provided by one or more VDS 102 configured to display visual content corresponding to the advertiser’s advertising information.

[0208] Audience demographics panel 1106 graphically illustrates the distribution of age demographics of viewers of the visual content of the advertiser. In the example interface 1100, sub-panel 1106 has a view showing a percentage breakdown of the total number of impressions by (an estimate of) the age of the viewers. In an alternative view, sub-panel 1106 shows a percentage breakdown of the total number of impressions by an (estimate of) the gender of the viewers.

[0209] Dwell time panel 1107 graphically illustrates the dwell time of impressions within the time period. The sub-panel 1107 provides a numerical report of the value of the average dwell time of the visual content in a period of time, and of the percentage change relative to a previous period.

[0210] The one or more interface elements 1102 includes additional panels 1108 and 1110 displaying a visual indicator of at least one campaign related metric associated with the advertiser user. Active campaigns panel 1108 provides a numerical report of the total number of active advertising campaigns of the advertiser in a period of time, and of the percentage change relative to a previous period. Balance panel 1110 provides a numerical report of the financial balance (i.e., advertising budget) available to the advertiser.

[0211] Fig. 12 illustrates a second exemplary interface 1200 rendered by the content control application 140 executing on a user device 103 of an administrative user of the platform 100. Interface 1200 comprises one or more interface elements 1201 each providing information associated with advertisements, vehicular display systems and users of the platform 100.

[0212] In the example dashboard 1200 depicted in Fig. 12, the one or more interface elements 1201 include sub-panels 1202, 1208, 1210, 1216 and 1222, displaying a visual indicator of at least one metric associated with components of the platform 100. Online devices panel 1202 shows the total number of device (e.g., controllers 110 of VDS 102, and any user devices 103, 105, registered with the platform 100) in a time period, and the percentage change relative to a previous period. Device status panel 1216 shows the total number of devices currently online and offline for the platform 100. System alerts panel 1208 indicates one or more system alerts that are active in relation to one or more registered VDS 102 and / or the content management server 120. Device activity panel 1210 graphically illustrates the total number of devices online within the time period. Recent activity panel 1222 indicates events related to device activity (online / offline), system updates, user logins, and user licences generated for the platform 100.

[0213] The one or more interface elements 1201 includes additional panels 1204, 1206, 1212, 1214, 1218 and 1220 displaying a visual indicator of at least one campaign or impression related metric associated with all advertiser users of the platform 100. Approval panel 1206 indicates the total number of advertisements uploaded to the content management server 120 by advertiser users that are presently awaiting approval. Campaign status panel 1212 graphically indicates the status of one or more advertising campaigns associated with one or more advertiser users of the platform 100. Impressions and revenue panel 1214 illustrates total revenue generated by the platform 100 and a breakdown of revenue by device. Total impressions panel 1218 indicates a total number of impressions recorded across all visual content displayed by all VDSs 102 registered with the platform 100 over a time period. Detailed impressions panel 1220 illustrates a number of impressions recorded, the percentage share of total platform impressions and the associated revenue for a number of advertiser users of the platform 100 (e.g., the N-best advertiser users ranked by impressions).

[0214] Figs. 13a and 13b illustrate respective portions of a third exemplary interface 1300 rendered by the content control application 140 executing on a user device 105 of an operator user of the platform 100. Interface 1300 comprises one or more interfaceelements 1301 each providing information associated with the VDS 102 attached to the vehicle 101 operated by the operator user, and, optionally, information associated with the operational and financial performance of the operator user of the platform 100.

[0215] In the example dashboard 1300 depicted in Fig. 13a, the one or more interface elements 1301 include sub-panels 1302, 1304, 1306, and 1308, displaying the information associated with the operational and financial performance of the operator user of the platform 100. Earnings overview panel 1302 shows the earnings of the operator user from operating the vehicle 101 over a time period. Route map panel 1304 shows a record on a digital map of the routes undertaken by the operator user in their operation of the vehicle 101 over the time period. Route history panel 1306 shows a list of the routes recorded as undertaken by the vehicle 101 over the time period. Campaign panel 1308 shows a summary of the campaign currently associated with the VDS 102 of the vehicle 101 operated by the operator user.

[0216] As depicted in Fig. 13b, one or more interface elements 1301 includes additional panels 1310 and 1312 displaying the information associated with the VDS 102 attached to the vehicle 101 operated by the operator user. Device status panel 1310 shows the status of the controller 110 of the VDS 102 of the vehicle 101 (i.e., as online or offline). Device health panel 1312 shows an indication of the operational state of one or more components of the VDS 102. For example, the device health panel 1312 may indicate a charge state of the battery, a storage capacity of local repository 116, a capacity of the volatile memory of the controller 100, and a strength of a communications signal for inter-device communications.

[0217] It will be appreciated by persons skilled in the art that numerous variations and / or modifications may be made to the above-described embodiments, without departing from the broad general scope of the present disclosure. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive.References[1] Ren, Shaoqing, et al. "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks." Advances in Neural Information Processing Systems, 2015.[2] Redmon, Joseph, et al. "You Only Look Once: Unified, Real-Time Object Detection." IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.[3] Yang, Shuo, et al. "WIDER FACE: A Face Detection Benchmark." IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.[4] Krafka, Kyle, et al. "Eye Tracking for Everyone." IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.

Claims

CLAIMS:

1. A vehicular display system comprising:a display component affixed to a vehicle, the display component configured to display visual content to an environment external to the vehicle;an imaging component comprising at least one camera located on the vehicle, the at least one camera configured to capture one or more images of at least a portion of the environment;a communications component configured for electronic communication with a content management system located remotely to the vehicle; anda controller comprising a processor and a memory configured to store instructions executable by the processor as one or more modules, wherein the controller is connected to the display component, the imaging component, and the communications component, and wherein the controller is configured to:(i) receive, from the at least one camera, imaging data representing the one or more images of the environment;(ii) generate, by executing an image analysis module on the imaging data, visual engagement data representing at least a number of impressions of the visual content in the environment, wherein the image analysis module is configured to apply one or more machine learning (ML) models to the imaging data;(iii) receive, from a position locating device associated with the vehicle, location data indicating a location of the vehicle;(iv) determine, by executing a geofencing module on the location data, whether the vehicle is located within a geographic region associated with the visual content; and(v) in response to determining that the vehicle is located within the geographic region, transmit the visual engagement data, via the communications component, to the content management system, wherein the content management system is configured to: determine, from the visual engagement data, one or more engagement metrics associated with the visual content; and provide the one or more engagement metrics to a publisher of the visual content.

2. The system of claim 1, wherein the controller is further configured to determine the visual content based at least in part on the location of the vehicle.

3. The system of claim 2, wherein the controller is further configured to operate the display component to commence displaying the visual content in response to determining that the vehicle has entered the geographic region associated with the visual content.

4. The system of any of claims 2 to 3, wherein the controller is further configured to operate the display component to cease displaying the visual content in response to determining that the vehicle has exited the geographic region associated with the visual content.

5. The system of any of claims 1 to 4, wherein the system further comprises a data store local to the vehicle, the data store configured to store media data including the visual content.

6. The system of any of claims 1 to 5, wherein the controller is further configured to receive the visual content from a remote media source via the communications component.

7. The system of any of claims 1 to 6, wherein the visual content comprises one or more of a dynamic image, a static image, a blank image, and a video feed.

8. The system of any of claims 1 to 7, wherein the display component comprises one or more electronic signs mounted to an exterior surface of the vehicle.

9. The system of claim 8, wherein the one or more electronic signs are collectively arranged to exhibit the visual content to the environment with a field of view of substantially 360 degrees.

10. The system of any of claims 1 to 9, wherein the one or more machine learning (ML) models comprise a neural network-based model configured to detect one or more viewers in the environment as captured by the one or more images.

11. The system of claim 10, wherein the image analysis module is further configured to detect each of the one or more viewers by determining, for the respective viewer, one or more of: a facial presence feature; a head orientation feature; and a gaze direction feature.

12. The system of claim 11, wherein the image analysis module is further configured to determine a duration that each of the one or more viewers views the visual content by performing gaze validation on the respective viewer.

13. The system of any of claims 1 to 12, wherein the position locating device comprises a GPS module, and wherein the geofencing module is configured to determine the location of the vehicle, as vehicle coordinate information, using data received from the GPS module in real-time or substantially real-time.

14. The system of claim 13, wherein the geofencing module is configured to process the vehicle coordinate information, and coordinate information of the geographic region associated with the visual content, to determine whether the vehicle is located within the geographic region.

15. The system of claim 14, wherein the geofencing module is configured to process the coordinates used to specify the geographic region using a point-in-polygon check.

16. The system of any of claims 1 to 15, wherein the controller is further configured to receive, from the content management system, advertising information comprising the visual content to be displayed by the display component.

17. The system of claim 16, wherein the controller is further configured to receive the advertising information in response to one or more predetermined conditions.

18. The system of any of claims 1 to 17, wherein the controller is further configured to additionally perform the steps of:(vi) receive display update data, via the communications component, from the content management system, wherein the display update data indicates new or updated visual content to be displayed by the display component; and(vii) operate the display component to display the new or updated visual content to the environment.

19. The system of claim 18, wherein the controller is further configured to iteratively perform steps (i)-(vii) with the new or updated visual content of step (vii) used in a subsequent iteration of steps (i)-(vii).

20. The system of any of claims 1 to 19, wherein the controller is further configured to:generate system reporting data representing at least a measure of functionality of one or more of the display component; the imaging component; and the communications component; andtransmit the system reporting data to a computing device of an operator of the vehicle.

21. The system of claim 20, wherein the controller is further configured to:detect a failure of one or more of the display component; the imaging component; and the communications component; andgenerate the system reporting data as a real-time response to detecting the failure.

22. A method for providing engagement data of visual content displayed using a vehicle, the method comprising:(i) displaying, by controlling a display component affixed to the vehicle, the visual content to an environment external to the vehicle;(ii) receiving imaging data from at least one camera located on the vehicle, the imaging data representing one or more images of at least a portion of the environment;(iii) processing the imaging data to generate visual engagement data representing at least a number of impressions of the visual content in the environment, wherein processing the image data comprises applying one or more machine learning (ML) models to the imaging data;(iv) receiving, from a position locating device associated with the vehicle, location data indicating a location of the vehicle;(v) processing the location data to determine whether the vehicle is located within a geographic region associated with the visual content; and(vi) in response to determining that the vehicle is located within the geographic region, transmitting the visual engagement data to a content management system located remotely to the vehicle, wherein the content management system isconfigured to: determine, from the visual engagement data, one or more engagement metrics associated with the visual content; and provide the one or more engagement metrics to a publisher of the visual content.

23. The method of claim 22, wherein the content management system is configured to provide the one or more engagement metrics to the publisher via a graphical user interface rendered by a computing device of the publisher in real-time, or substantially real-time, with the determination of the one or more engagement metrics.

24. The method of any of claims 22 to 23, wherein the method further comprises:(vii) receiving update data from the content management system, wherein the update data indicates new visual content to be displayed by the display component; and(viii) operating the display component to display the new visual content to the environment.

25. A method for determining real-time engagement of individuals with visual content displayed to an environment external to a vehicle using a vehicular display system mounted to the vehicle, wherein the method is executed by at least one processor located remotely to the vehicle, the method comprising:receiving, from the vehicular display system, visual engagement data representing at least a number of impressions of the visual content in the environment;processing the visual engagement data to determine one or more engagement metrics associated with the visual content; andupdating a graphical interface of a user device to exhibit the one or more engagement metrics in real-time, or substantially real-time, with the determination of the one or more engagement metrics,wherein the vehicular display system is a system according to any of claims 1 to 21.

26. The method of claim 25, wherein the at least one processor is part of an advertising content management system, and wherein the graphical interface is rendered by a content control application executed on the user device.

27. The method of claim 26, wherein the method further comprises:receiving, from the graphical interface, advertising information comprising the visual content to be displayed by the vehicular display system;processing the advertising information to determine corresponding display data and geolocation data; andtransmitting the corresponding display data and geolocation data to the vehicular display system.

28. The method of claim 27, wherein the method further comprises transmitting the corresponding display data and geolocation data to the vehicular display system automatically in response to one or more predetermined conditions.

29. The method of any of claims 26 to 28, wherein the method further comprises:generating or receiving update data indicating new visual content to be displayed by the vehicular display system; andtransmitting the update data to the vehicular display system to cause the new visual content to be displayed by the vehicular display system.

30. The method of claim 29, wherein the method further comprises determining the new visual content using the visual engagement data of the visual content or the one or more engagement metrics associated with the visual content.

31. A method for displaying visual content using a vehicle, the method comprising:receiving, from a position locating device associated with the vehicle, location data indicating a location of the vehicle;processing the location data to determine whether the vehicle is located within a geographic region associated with the visual content; andin response to determining that the vehicle is located within the geographic region:displaying, by controlling a display component affixed to the vehicle, the visual content to an environment external to the vehicle;receiving imaging data from at least one camera located on the vehicle, the imaging data representing one or more images of at least a portion of the environment;processing the imaging data to generate visual engagement data representing at least a number of impressions of the visual content in the environment, wherein processing the image data comprises applying one or more machine learning (ML) models to the imaging data; andtransmitting the visual engagement data to a content management system located remotely to the vehicle.

32. The method of claim 31, wherein the content management system is configured to: determine, from the visual engagement data, one or more engagement metrics associated with the visual content; and provide the one or more engagement metrics to a publisher of the visual content.

33. An apparatus comprising:a vehicular display system and a content management system, wherein the vehicular display system comprises:a display component affixed to a vehicle, the display component configured to display visual content in an environment external to the vehicle;an imaging component comprising at least one camera located on the vehicle, the at least one camera configured to capture one or more images of at least a portion of the environment;a communications component configured for electronic communication with a content management system located remotely to the vehicle; anda controller comprising a processor and a memory configured to store instructions executable by the processor as one or more modules, wherein the controller is connected to the display component, the imaging component, and the communications component, and wherein the controller is configured to:receive, from the at least one camera, imaging data representing one or more images of the environment;generate visual engagement data by applying one or more machine learning models to the imaging data, wherein the visual engagement data represents at least a number of impressions of the visual content in the environment;receive, from a position locating device associated with the vehicle, location data indicating a location of the vehicle;process the location data to determine whether the vehicle is located within a geographic region associated with the visual content; andin response to determining that the vehicle is located within the geographic region, transmit the visual engagement data, via the communications component, to the content management system; andwherein the content management system comprises:an electronic communications interface;at least one computer processor to execute program instructions; anda memory, coupled to the at least one computer processor, to store program instructions for execution by the at least one computer processor,wherein the content management system is configured to communicate with the vehicular display system and a computing device of a publisher of the visual content, and wherein the content management system is configured to:receive, from the vehicular display system, the visual engagement data;process the visual engagement data to determine one or more engagement metrics associated with the visual content; andtransmit instructions and data to cause the computing device of the publisher to update a graphical interface of the computing device to exhibit the one or more engagement metrics in real-time, or substantially real-time, with the determination of the one or more engagement metrics.