Adaptive quick response code generation and display method

Abstract

A method for dynamically generating a customized quick response (QR) code for scanning by a mobile vehicle during a vehicle-merchant transaction includes detecting, via a sensor suite of an infrastructure node in communication with a merchant backend, parameters of a vehicle-mounted camera when the mobile vehicle approaches the infrastructure node. The parameters include a distance and an approach angle of the camera relative to the infrastructure node. The method also includes dynamically reshaping, via a processor of the infrastructure node, a baseline QR code in response to the parameters, thereby generating a customized QR code having a modified shape, size, and / or data capacity relative to the baseline QR code. The customized QR code is then displayed on a display screen when the mobile vehicle approaches the infrastructure node to enable the camera to scan the customized QR code during the transaction.

Description

Technical Field

[0001] This disclosure relates to automated systems and methods for assisting in quick response (QR) code scanning in vehicles using one or more airborne cameras. Background Technology

[0002] As understood by those skilled in the art, a QR code is a two-dimensional barcode that stores information such as website addresses, plain text, contact information, etc. The information is converted into binary data and then encoded into a pixelated black-and-white pattern. In a typical QR code, three large squares are arranged at the corners to allow the QR code to be recognized and oriented by a QR code scanner (e.g., a smartphone camera). Smaller squares in the QR code help correct for distortion. The QR code also includes version information corresponding to its data capacity, as well as data and error-correction keys that form the encoded information and associated error-correction codes.

[0003] To scan a QR code using a smartphone or other dedicated QR code reader, the reader's camera views an image of the displayed QR code. Then, before extracting the aforementioned binary data from the displayed square pattern, the reader's image processing software locates and orients the QR code within the camera's field of view. If necessary, error correction is applied before the reader's onboard processor decodes the information. Depending on the nature of the encoded data, the reader can respond to the decoded information by opening a website, displaying text, adding contact information, or performing numerous other possible actions. Summary of the Invention

[0004] This paper discloses a system and method for enabling cameras in moving vehicles to read Quick Response (QR) codes from a display screen. In a typical scenario, the display screen may be connected to or juxtaposed with a fixed infrastructure node, such as a kiosk, shop, toll booth, roadside stall, or another drive-through or drive-by building or other structure. Traditionally, the camera is positioned correctly facing the QR code so that it can scan and read the displayed QR code. However, in use cases where the vehicle and its mounted camera move relative to the display screen, adjusting the camera's position for this purpose is difficult. However, using the teachings of this paper, by optimizing the customized QR code generation and its presentation on the display screen based on the dynamically changing position of the vehicle / camera, the vehicle-mounted camera can read QR codes faster and more accurately than it might be possible otherwise without these teachings.

[0005] Specifically, this paper discloses a method for dynamically generating customized QR codes for scanning by an onboard camera of a moving vehicle. The method includes detecting camera parameters via a sensor suite of the infrastructure node as the moving vehicle approaches the infrastructure node. These parameters include at least the distance and approach angle of the vehicle relative to the infrastructure node. The method also includes dynamically reshaping a baseline QR code (e.g., a typical square, forward-facing QR code) in response to the parameters. This action, occurring via operation of a processor of the infrastructure node, generates a customized QR code, i.e., a QR code with modified shape, size, and data capacity relative to the baseline QR code. Furthermore, the method includes transmitting a display control signal to a display screen of the infrastructure node to cause the display screen to present the customized QR code on it as the moving vehicle approaches the infrastructure node.

[0006] One aspect of this disclosure includes a method for dynamically generating a customized QR code for scanning by a moving vehicle during a vehicle-to-merchant transaction. The method may include detecting parameters of an onboard camera via a sensor suite of an infrastructure node that communicates with a merchant backend. This occurs when a moving vehicle approaches the infrastructure node. The parameters include the distance and approach angle of the onboard camera relative to the infrastructure node. The method includes dynamically reshaping a baseline QR code via a processor of the infrastructure node in response to the parameters, thereby generating a customized QR code with modified shape, size, and / or data capacity relative to the baseline QR code. Furthermore, the method may include transmitting a display control signal to a display screen of the infrastructure node, and displaying the customized QR code on the display screen in response to the display control signal when the moving vehicle approaches the infrastructure node, enabling the onboard camera to scan the customized QR code during the vehicle-to-merchant transaction.

[0007] Displaying a custom QR code on the display screen may include generating a pixelated image tilted in a two-dimensional (2D) reference frame of the display screen. Detection parameters may include the use of one or more infrastructure cameras mounted to or juxtaposed with infrastructure nodes, and wherein the sensor suite includes one or more infrastructure cameras, possibly using the LiDAR sensor or radar sensor of the infrastructure node.

[0008] In one or more embodiments, the detection parameters include ultra-wideband (UWB) sensors using infrastructure nodes.

[0009] Dynamically reshaping a baseline square QR code can include performing a 3D-to-2D projection via a processor on an infrastructure node, such that the customized QR code, when displayed on a screen, has a 2D plane perpendicular to the focal axis of the vehicle-mounted camera.

[0010] This method may include establishing a secure network connection between an infrastructure node and a merchant backend, and then completing a vehicle-to-merchant transaction in response to a successful scan of a customized QR code by an onboard camera. Embodiments of this method also include establishing another secure network connection between the merchant backend and a cloud-based payment service. In this case, completing the vehicle-to-merchant transaction involves submitting payment information to the cloud-based payment service via the merchant backend.

[0011] Dynamically reshaping baseline QR codes can include calculating the required data capacity and resolution of customized QR codes based on the relative positions of mobile vehicles and infrastructure nodes.

[0012] In one or more embodiments, the method may include collecting historical drive-through data of multiple previously encountered vehicles and infrastructure nodes, including recording the time and location of each previously encountered vehicle, and training a support vector module (SVM) to use the historical drive-through data to identify successfully decoded and unsuccessfully decoded scans. The method may also include using the trained SVM during vehicle-to-merchant transactions to generate a predicted ideal size and predicted ideal data capacity for a customized QR code, along with dynamically reshaping the baseline QR code using at least partially the predicted ideal size and predicted ideal data capacity.

[0013] An infrastructure node operable for executing vehicle-to-merchant transactions with mobile vehicles is also disclosed herein. The infrastructure node may include a fixed structure, a sensor suite mounted to or juxtaposed with the fixed structure, a display screen, and a server communicating with a merchant backend. The server may include a processor and a non-transitory computer-readable storage medium (“memory”) on which instructions are recorded. Execution of the instructions by the processor causes the server to dynamically generate customized QR codes for scanning by a mobile vehicle equipped with an onboard camera, and, as the mobile vehicle approaches the fixed structure, detect parameters of the onboard camera via the sensor suite. These parameters include the distance and approach angle of the onboard camera relative to the fixed structure.

[0014] In this embodiment, execution of the instructions also causes the processor to dynamically reshape the baseline QR code in response to parameters, thereby generating a customized QR code with modified shape, size, and / or data capacity relative to the baseline QR code. The processor then transmits a display control signal to the display screen to display the customized QR code as the moving vehicle approaches the fixed structure, thereby enabling the onboard camera to scan the customized QR code during vehicle-to-business transactions.

[0015] Another embodiment of the method for dynamically generating customized QR codes outlined above involves detecting parameters of an onboard camera of a mobile vehicle via a sensor suite of the infrastructure node, which communicates with a merchant backend, as the vehicle approaches the infrastructure node. This sensor suite includes the infrastructure camera and one or more of a radar sensor, lidar sensor, or UWB sensor mounted on the infrastructure node. The parameters include the distance and approach angle of the onboard camera relative to the infrastructure node. The method includes dynamically reshaping a baseline QR code via a processor of the infrastructure node in response to the parameters, thereby generating a customized QR code with modified shape, size, and / or data capacity relative to the baseline QR code. This action further includes performing a 3D-to-2D projection via the processor of the infrastructure node such that the 2D plane of the customized QR code, when displayed via a display screen, is perpendicular to the focal axis of the onboard camera.

[0016] The method also includes calculating the data capacity and resolution required for the customized QR code based on the relative position of the mobile vehicle and the infrastructure node, transmitting a display control signal to the display screen of the infrastructure node, and displaying the customized QR code on the display screen in response to the display control signal when the mobile vehicle approaches the infrastructure node, so that the vehicle-mounted camera can scan the customized QR code during vehicle-to-merchant transactions.

[0017] This disclosure also relates to the following technical solutions.

[0018] Solution 1. A method for dynamically generating customized Quick Response (QR) codes for scanning by moving vehicles during vehicle-to-merchant transactions, the method comprising:

[0019] When a moving vehicle approaches an infrastructure node, the sensor suite of the infrastructure node, which communicates with the merchant’s backend, detects parameters of the vehicle-mounted camera, including the distance and approach angle of the vehicle-mounted camera relative to the infrastructure node.

[0020] In response to the parameters, the baseline QR code is dynamically reshaped via the processor of the infrastructure node to generate a customized QR code with modified shape, size and / or data capacity relative to the baseline QR code.

[0021] Transmit display control signals to the displays of infrastructure nodes; and

[0022] When a moving vehicle approaches an infrastructure node, in response to a display control signal, a custom QR code is displayed on the screen, enabling the onboard camera to scan the custom QR code during a vehicle-to-merchant transaction.

[0023] Option 2. The method according to Option 1, wherein displaying the customized QR code on the display screen includes generating a pixelated image tilted in a two-dimensional (2D) reference frame of the display screen.

[0024] Option 3. The method according to Option 2, wherein the detection parameters include the use of one or more infrastructure cameras mounted to or juxtaposed with the infrastructure node, and wherein the sensor suite includes one or more infrastructure cameras.

[0025] Option 4. The method according to Option 2, wherein the detection parameters include using a lidar sensor or a radar sensor of an infrastructure node, and wherein the sensor suite includes a radar sensor or a lidar sensor.

[0026] Option 5. The method according to Option 1, wherein the detection parameters include the use of ultra-wideband (UWB) sensors on infrastructure nodes, and wherein the sensor suite includes UWB sensors.

[0027] Option 6. According to the method of Option 1, wherein dynamically reshaping the baseline square QR code includes performing a three-dimensional (3D) to two-dimensional (2D) projection via the processor of the infrastructure node so that the 2D plane of the customized QR code when displayed via the display screen is perpendicular to the focal axis of the vehicle-mounted camera.

[0028] Option 7. The method according to Option 1 further includes:

[0029] Establish a secure network connection between infrastructure nodes and merchant back-end systems; and

[0030] The vehicle-merchant transaction is completed upon successful scanning of the customized QR code by the in-vehicle camera.

[0031] Option 8. The method according to Option 7 further includes:

[0032] Establish another secure network connection between the merchant backend and the cloud-based payment service, where completing a vehicle-merchant transaction involves submitting payment information to the cloud-based payment service via the merchant backend.

[0033] Option 9. The method according to Option 1, wherein dynamically reshaping the baseline QR code includes calculating the data capacity and resolution required for the customized QR code based on the relative positions of mobile vehicles and infrastructure nodes.

[0034] Option 10. The method according to Option 1 further includes:

[0035] Collect historical driving data from multiple past vehicles and infrastructure nodes, including recording the time and location of each past vehicle;

[0036] Historical driving data is used to train a Support Vector Module (SVM) to identify successfully decoded and unsuccessfully decoded scans; and

[0037] During vehicle-merchant transactions, the trained SVM is used to generate the ideal size and ideal data capacity for predicting custom QR codes; and

[0038] The baseline QR code is dynamically reshaped using at least part of the predicted ideal size and predicted ideal data capacity.

[0039] Option 11. An infrastructure node operable for executing vehicle-to-merchant transactions with moving vehicles, comprising:

[0040] Fixed structure;

[0041] Sensor kits mounted on or placed alongside a fixed structure;

[0042] Display screen; and

[0043] A server that communicates with the merchant's backend has a processor and a non-transitory computer-readable storage medium ("memory") on which instructions are recorded, wherein the processor's execution of the instructions causes the server to:

[0044] Dynamically generate customized Quick Response (QR) codes for scanning by mobile vehicles equipped with onboard cameras;

[0045] When a moving vehicle approaches a fixed structure, parameters of the onboard camera are detected via a sensor suite, including the distance and approach angle of the onboard camera relative to the fixed structure.

[0046] In response to the parameters, the baseline QR code is dynamically reshaped via the processor to generate a customized QR code with modified shape, size and / or data capacity relative to the baseline QR code;

[0047] A display control signal is transmitted to the display screen so that the display screen shows a customized QR code when the moving vehicle approaches the fixed structure, thereby enabling the vehicle-mounted camera to scan the customized QR code during the vehicle-to-business transaction.

[0048] Option 12. The infrastructure node according to Option 11, wherein the processor executes the instructions causing the server to display the customized QR code as a pixelated image on the display screen, the pixelated image being tilted in the two-dimensional (2D) reference frame of the display screen.

[0049] Option 13. The infrastructure node according to Option 11, wherein the sensor suite includes one or more infrastructure cameras.

[0050] Option 14. The infrastructure node according to Option 11, wherein the sensor suite includes radar sensors, lidar sensors and / or ultra-wideband (UWB) sensors.

[0051] Option 15. The infrastructure node according to Option 11, wherein the processor executes the instructions causing the server to dynamically reshape the baseline QR code by performing a three-dimensional (3D) to two-dimensional (2D) projection, such that the customized QR code, when displayed via the display screen, has a 2D plane perpendicular to the focal axis of the vehicle-mounted camera.

[0052] Option 16. The infrastructure node according to Option 11, wherein the processor executes the instructions to cause the server to establish a secure network connection with the merchant backend as part of the vehicle-merchant transaction.

[0053] Option 17. The infrastructure node according to Option 11, wherein the processor executes the instructions causing the server to dynamically reshape the baseline QR code by calculating the required data capacity and resolution of the customized QR code based on the relative positions of the mobile vehicle and the infrastructure node.

[0054] Option 18. The infrastructure node according to Option 11, wherein the fixed structure is one of a shop, toll station, roadside stall, or structure through which a vehicle passes or drives.

[0055] Solution 19. A method for dynamically generating customized Quick Response (QR) codes for scanning by mobile vehicles during vehicle-to-merchant transactions, the method comprising:

[0056] When a moving vehicle approaches an infrastructure node, parameters of the vehicle’s onboard camera are detected via a sensor suite of the infrastructure node that communicates with the merchant’s backend. The sensor suite includes an infrastructure camera and one or more of a radar sensor, lidar sensor, or ultra-wideband (UWB) sensor mounted on the infrastructure node, wherein the parameters include the distance and approach angle of the onboard camera relative to the infrastructure node.

[0057] In response to the parameters, the baseline QR code is dynamically reshaped via the processor of the infrastructure node to generate a customized QR code with modified shape, size, and / or data capacity relative to the baseline QR code, including:

[0058] The processor at the infrastructure node performs a 3D-to-2D projection so that the customized QR code, when displayed on the screen, has its 2D plane perpendicular to the focal axis of the vehicle-mounted camera; and

[0059] The required data capacity and resolution of a customized QR code are calculated based on the relative positions of mobile vehicles and infrastructure nodes.

[0060] Transmit display control signals to the displays of infrastructure nodes; and

[0061] When a moving vehicle approaches an infrastructure node, in response to a display control signal, a custom QR code is displayed on the screen, enabling the onboard camera to scan the custom QR code during a vehicle-to-merchant transaction.

[0062] Option 20. The method according to Option 19 further includes:

[0063] Establish a primary secure network connection between infrastructure nodes and merchant back-end systems;

[0064] Establish a second secure network connection between the mobile vehicle and the vehicle's backend;

[0065] Establish a third secure network connection between the merchant backend and cloud-based payment services; and

[0066] In response to the successful scanning of a customized QR code by the vehicle-mounted camera, a vehicle-to-merchant transaction is completed. This transaction involves financial transactions between the user of the moving vehicle and the merchant's back-end system, which are executed via a cloud-based payment service.

[0067] The above and other features and advantages of this disclosure will become apparent from the following detailed description of illustrative examples and models for carrying out this disclosure, taken in conjunction with the accompanying drawings and appended claims. Furthermore, this disclosure explicitly includes combinations and sub-combinations of the elements and features presented above and below. Attached Figure Description

[0068] Figure 1 This is an illustration of an exemplary operational scenario, in which a mobile vehicle reads a customized Quick Response (QR) code displayed from an infrastructure node. The characteristics of the customized QR code are calculated and applied by the server of the infrastructure node.

[0069] Figure 2 The illustration shows the customization and display of a QR code according to one aspect of this disclosure.

[0070] Figure 3 This is a flowchart describing a method for enabling onboard cameras of mobile vehicles to scan / read QR codes from the displays of infrastructure nodes.

[0071] Figure 4 It is an illustration of a reprojection of a customized QR code according to one aspect of this disclosure.

[0072] Figure 5This is a flowchart describing possible crowdsourcing methods that can be used as part of this strategy.

[0073] Figure 6 This is a diagram of a Support Vector Machine (SVM) that can be used as an optional part of this strategy.

[0074] Figure 7 and Figure 8 This is a diagram illustrating possible cloud-based payment processes that can be implemented according to various aspects of this disclosure.

[0075] This disclosure may be modified or implemented in alternative forms, with representative embodiments shown in the accompanying drawings and described in detail below. The inventive step of this disclosure is not limited to the disclosed embodiments. Rather, this disclosure is intended to cover alternatives falling within the scope of the disclosure defined by the appended claims. Detailed Implementation

[0076] Referring to the accompanying drawings, the same reference numerals throughout several views refer to the same features. Figure 1 The diagram illustrates a network architecture 10 in which a vehicle 12 moves relative to an infrastructure node 14, such as a roadside kiosk, toll booth, shop, or other drive-through / drive-by structure, acting as a point of sale for vehicle-merchant transactions. The vehicle 12 includes onboard cameras 16, i.e., one or more cameras mounted on the rearview mirror, dashboard, or other forward-facing location on the body 18 of the vehicle 12. Cameras 16 have a three-dimensional (3D) coordinate system or camera reference frame 11, whose axes are nominally labeled X, Y, and Z. The vehicle 12 may also include a set of wheels 20 coupled to the body 18, having an internal combustion engine, electric traction motor, or another prime mover (not shown) that provides torque to one or more wheels 20 to propel the vehicle 12 toward the infrastructure node 14. While the vehicle 12 is shown as a typical passenger vehicle, other mobile platforms, such as trucks, boats, motorcycles, bicycles, agricultural equipment, etc., can be used within the scope of this disclosure without limitation.

[0077] In potential use cases, the operator of vehicle 12 may wish to transact with a potential distant provider or merchant via infrastructure node 14, for example, by purchasing goods or services, or potentially gaining access to roads, bridges, or other restricted locations. For this purpose, camera 16 can automatically focus on display screen 22, which is connected to or juxtaposed with infrastructure node 14, and display a customized Quick Response (QR) code 24 thereon. To complete the aforementioned vehicle-to-merchant transaction, camera 16 can be operated to detect the customized QR code 24 within its field of view, magnify the customized QR code 24, and subsequently scan / read multiple frames of the customized QR code 24. However, movement of vehicle 12 relative to infrastructure node 14 may reduce scanning speed and accuracy. Therefore, this teaching is directed to improving these and other aspects of QR code-based vehicle-to-merchant transactions.

[0078] Specifically, when vehicle 12 moves relative to infrastructure node 14, and camera 16 attempts to read a QR code displayed in front of vehicle 12 at an angle relative to vehicle 12, several factors are considered to optimize the QR code scanning task. For example, the position of camera 16 on vehicle 12 is typically fixed, or at least difficult to adjust in real time. The distance between camera 16 and infrastructure node 14 may be too large and / or the approach angle too significant for fast and accurate scanning. The resolution of camera 16 may be too low. While QR codes are embedded with special patterns to help reduce distortion and align with the patterns, problems can arise when attempting to view and scan a QR code from a single angle. For example, pixel resolution decreases significantly at greater distances / angles, which in turn leads to QR code reading failures.

[0079] In order to solve Figure 1 To address these and other potential issues in the scenario, the infrastructure server 25 of infrastructure node 14 is configured to detect the location of camera 16 and optimize the generation and display of customized QR code 24 to take the detected location into account. This helps camera 16 to detect and read the customized QR code 24 more accurately and faster than it could otherwise without this instruction. Therefore, this solution provides an enhanced customer experience, such as in the in-vehicle mobile payment use case, an example of which will be referenced below. Figure 7 and Figure 8 Describe it.

[0080] To achieve this solution, Figure 1Infrastructure node 14 is equipped with a sensor suite 26, which is operable to detect the relative position between vehicle 12 and display screen 22, and a customized QR code 24 is ultimately displayed on display screen 22. The resident sensors of sensor suite 26 may include, as an example and not a limitation, infrastructure cameras, LiDAR sensors, radar sensors, ultra-wideband (UWB) sensors, etc. Server 25 ultimately uses the detected relative position to generate a customized QR code 24 with a customized shape, such as size, angle, and / or data content, and displays the customized QR code 24 in its customized shape via display screen 22.

[0081] For this purpose, vehicle 12 can communicate with server 25 via secure network connection 28 (e.g., a communication link or channel, such as a 5G cellular or WiFi link). Similarly, network connection 240 can be established between server 25 and sensor kit 26, while another secure network connection 260 can be established between base server 25 and display 22. Since sensor kit 26 and display 22 can be co-located with infrastructure node 14, in some embodiments, network connections 240 and 260 can be hardwired, such as via Ethernet, or network connections 240 and 260 can be implemented wirelessly. Wireless communication can be based on suitable wireless protocols, such as IEEE 802.11, WiMAX, and / or Bluetooth. TM To execute.

[0082] Server 25 Figure 1 The device is schematically depicted as having one or more processors (P) 27 and memory (M) 29, the latter including non-transitory memory or tangible non-transitory computer storage media / devices (read-only, programmable read-only, solid-state, random access, optical, magnetic, etc.). Recordings can be made on it. Figure 3 The memory 29 of the computer-readable instructions of method 100 is capable of storing machine-readable instructions in the form of one or more software or firmware programs or routines, one or more combinational logic circuits, one or more input / output circuits and devices, signal conditioning and buffering circuits, and other components that can be accessed by one or more processors to provide the functions described herein.

[0083] Additionally, regarding server 25, the input / output circuitry and devices include analog-to-digital converters and related devices for monitoring inputs from sensors at a preset sampling frequency or in response to trigger events. Software, firmware, programs, instructions, control routines, code, algorithms, and similar terms refer to the set of instructions executable by the controller, including calibration and lookup tables. Each controller executes one or more control routines to provide the desired functionality. Finally, server 25 outputs display control signals (arrow CC) to display screen 22.22 ), so that display screen 22 displays a reshaped custom QR code 24 as described herein.

[0084] Brief Reference Figure 2 The image shows a baseline QR code 24S, which may appear when presented via display screen 22 in its normal forward-facing square configuration. When a smartphone 30 or other suitable barcode scanner scans this baseline QR code 24S, the camera (not shown) of the smartphone 30 approaches and faces the baseline QR code 24S, and typically the plane of the smartphone 30 is oriented parallel to the plane of display screen 22. Therefore, the position of the smartphone 30 must be adjusted for its camera to successfully detect and decode the QR code 24S. However, Figure 1 The scene will show camera 16 (also) Figure 2 The image shown (for reference) is located at a considerable distance from the baseline QR code 24S (and at an approach angle relative to the baseline QR code 24S). Therefore, when approaching infrastructure node 14, the normal square appearance of the baseline QR code 24S will not be read by camera 16 in an accurate and timely manner.

[0085] However, as indicated by arrow A, the operation of server 25 as described herein will result in a dynamic reshaping of the baseline QR code 24S based on the relative position of the detected camera 16. Using this teaching, and regardless of the approach angle of camera 16 relative to infrastructure node 14 when vehicle 12 approaches, the customized QR code 24 will appear (from the viewpoint of camera 16) to have the same square shape, despite its distorted, resized, and / or otherwise modified characteristics, just as it actually appears on display 22.

[0086] refer to Figure 3 Method 100 can be expressed as computer-readable instructions and recorded in Figure 1 The memory 29 of server 25. For clarity, method 100 is described in terms of code segments or logic blocks, each of which can be defined by... Figure 1 The processor 27 executes the command to cause the server 25 to perform the described functions. Generally, method 100 is configured to dynamically generate custom QR codes 24 for scanning by a mobile vehicle 12 having at least one onboard camera 16.

[0087] Starting at box B102, method 100 includes detecting parameters of the onboard camera 16 via the sensor suite 26 of infrastructure node 14 when the moving vehicle 12 approaches infrastructure node 14. See below for reference. Figure 7 and Figure 8As mentioned, infrastructure node 14 communicates with merchant back-end (BO) 42. This parameter includes the distance and approach angle of camera 16 relative to infrastructure node 14 (“relative position data 32”).

[0088] As part of box B102, Figure 1 Server 25 receives relative position data 32 from sensor suite 26 via network connection 260. Relative position data 32 describes the relative positions of vehicle 12 / camera 16 and infrastructure node 14, particularly display 22. Using relative position data 32, server 25 detects the positions of vehicle 12 and its connected camera 16. As understood in the art, and using nominal x, y, z position coordinates, sensor suite 26 has position p0 (x0, y0, z0), vehicle 12 has position p1 (x1, y1, z1), and display 22 has position p2 (x2, y2, z2). Therefore, block B102 requires determining the 3D coordinates of vehicle 12, sensor suite 26, and display 22, respectively, p0, p1, and p2. Thereafter, method 100 proceeds to block B104.

[0089] Box B104 requires calculating the data capacity and resolution of the customized QR code 24 using the relative positions of vehicle 12 and camera 16. After calculating the data capacity and resolution, method 100 proceeds to box B106.

[0090] In block B106, method 100 includes dynamically reshaping the baseline QR code 24S via the processor 27 of infrastructure node 14 in response to parameters, thereby generating a customized QR code 24. As described above, the customized QR code 24 has a modified shape, size, and / or data capacity relative to the baseline QR code 24S.

[0091] In one or more embodiments, block B106 may include performing a 3D-to-2D projection, during which, Figure 1 The processor 27 of the server 25 shown projects a customized QR code 24 from 3D space to 2D space. In 3D space, that is, the 3D position of the camera 16 in free space, or in other words, in… Figure 1 In reference frame 11, server 25 creates a QR code display plane and ensures that the display plane is perpendicular to the focal axis of camera 16. The QR code in this virtual 3D space is then projected onto the 2D plane for use via... Figure 1 The display screen 22 shows the image, that is, it is projected onto the 2D space.

[0092] Brief Reference Figure 4 Box B106 needs to create a virtual QR code in 3D space, and then draw the virtual QR code on a plane in 3D space. v Up. planev Perpendicular to the line (p1, p2). The rectangle formed by the virtual QR code has four corner points (q1, q2, q3, q4). For a 2D plane d The 3D to 2D projection, its corner points (q'1,q'2,q'3,q'4), plane d This can be represented using vector notation:

[0093] (p–p0)·n=0

[0094] Where n is a plane v The normal vector of plane, p0 is the normal vector of plane. v Points on the line. The line (p1, q1) can also be represented using vector notation, here as:

[0095]

[0096] Where l is the unit vector along the line, l0 is a point on the line, and d is a scalar in the real number field. The intersection point q1 can be calculated as follows:

[0097]

[0098] q1=l0+l d

[0099] q2, q3, and q4 can be calculated using a similar method. Then proceed to box B108 using method 100.

[0100] exist Figure 3 At box B108, server 25 can... Figure 1 Display control signal (CC) 22 The signal is transmitted to display screen 22, causing display screen 22 to display the reshaped custom QR code 24. Figure 2 Unlike the standard QR code 24S, the reshaping / reprojection property of the custom QR code 24 will present it as a square rather than an arbitrary quadrilateral to the camera 16, even to a viewer standing directly in front of the display screen 22. This appearance allows the vehicle-mounted camera 16 to scan the custom QR code 24 during vehicle-to-merchant transactions. After the server 25 displays the custom QR code 24, method 100 proceeds to block B110.

[0101] Box B110 includes determining whether the QR code scanning / vehicle-merchant transaction initiated in box B102 has been completed. If so, method 100 proceeds to box B111. Alternatively, method 100 proceeds to box B102.

[0102] Box B111 may include the execution of a payment processing sequence, for example, such as Figure 7 and Figure 8 As shown and discussed below. For example, if the QR code scanning process in boxes B102-B110 involves a financial transaction, such as paying a toll or highway fee, purchasing goods or services, then box B111 can be executed to register the QR code with the owner of vehicle 12 and... Figure 1 The owners of infrastructure node 14 exchange currency. Method 100 is completed after the payment has been successfully processed.

[0103] refer to Figure 5 The above teachings can be extended by using optional crowdsourcing, which can be used to facilitate... Figure 1 Infrastructure node 14 identifies the ideal size of the customized QR code 24 and the data capacity of a vehicle 12 at a given distance. As a possible approach, infrastructure node 14 can utilize crowdsourced "drive-through" data to create a supervised learning model. This model can help infrastructure node 14 more accurately predict the ideal QR code size and data capacity when a new / unprecedented vehicle 12 visits the same location as multiple previously / unprecedented vehicles 12.

[0104] As one possible approach, method 200 for leveraging this crowdsourcing advantage begins at box B202, collecting historical driving data. For example, whenever sensor suite 26 (i) detects vehicle 12, (ii) initiates a vehicle-to-merchant transaction in the cloud, and (iii) completes the vehicle-to-merchant transaction in the cloud, Figure 1 Server 25 can record the time and location of each encountered vehicle 12. Method 200 then proceeds to box B204.

[0105] Box B204 may require calculating the data capacity and resolution of the custom QR code 24. This action involves representing the data in a high-dimensional space, where dimensions may include vehicle location, QR code display size, QR code data capacity, successful decoding, and / or other dimensions. After calculating the data capacity and resolution of the custom QR code 24, method 200 proceeds to box B206.

[0106] In box B206, server 25 can train a support vector module (SVM) to identify a hyperplane that maximally divides a data sample into two distinct sets: (i) successfully decoded / decoded, and (ii) unsuccessfully decoded / undecoded. As understood in the art, SVM is an exemplary supervised learning strategy for sample classification. Once the hyperplane of the SVM is determined, new data points can be classified by determining which side of the hyperplane the point falls on. Once the SVM has been trained, method 100 proceeds to box B208.

[0107] Brief Reference Figure 6 The high-dimensional space is shown in SVM 30. Data points 32A and 32B are located on either side of the aforementioned hyperplane 34. In this example, data point 32A corresponds to the set "unsuccessfully decoded / not decoded". Data point 32B corresponds to the set "successfully decoded / decoded". In SVM 30, x represents the position of vehicle 12, y is the size of the QR code, and z is the data capacity. Furthermore, a polynomial kernel (k) can be used in the SVM, i.e.:

[0108] k(x i ,x j )=(x i *x j +1) d

[0109] Where x i x j There are two data sets, and each point can have three dimensions (vehicle location, QR code size, data capacity), where d is the degree of the polynomial.

[0110] Refer again Figure 4 Box B208 includes the use of an SVM trained from box B206 to perform real-time classification of new data samples. As vehicle 12 enters the same driving-through location, server 25 can use the SVM model to predict the ideal size and data capacity of the custom QR code 24. As vehicle 12 approaches infrastructure location 14, the predictions together help server 25 accurately scan and quickly decode the custom QR code 24.

[0111] For each driving pass event using method 200, infrastructure node 14 can be in memory 29 ( Figure 1 The data includes recorded sensor data, QR code status, and system status for subsequent crowdsourcing processing. Representative sensor data may include the current position of vehicle 12 (distance and angle relative to infrastructure, etc.) and the speed / acceleration of vehicle 12. The QR code status may include the QR code display size and data capacity as described above. The system status may include binary classifications, such as "decoded" and "undecoded" as discussed above in box B206.

[0112] refer to Figure 7 and Figure 8 The corresponding cloud-based payment processes, figures 40 and 50, illustrate the monetization process. Figure 1 Two possible implementations of the basic vehicle-to-infrastructure transaction. Figure 7In the Merchant Backend (BO) path, it is assumed that vehicle 12 and merchant BO 42 are mutually authenticated, and vehicle 12's secure element stores payment account or credit card information. Furthermore, submissions are made to a payment cloud, such as a payment processor or payment gateway like PayPal, using a security protocol such as SPAKE2.

[0113] In the exemplary sequence beginning with step (1), infrastructure node 14 can request a QR code for a given good, service, or other deliverable from merchant BO 42, as shown in communication link AA. Merchant BO 42 returns the QR code to infrastructure node 14 via communication link BB in step (2). In step (3), infrastructure node 14 uses sensor kit 26 as described above via communication loop CC. Figure 1 The location of vehicle 12 is determined, and then in step (4), a customized QR code 24 for optimization / remodeling is displayed on display screen 22 via communication link DD. Link DD is similar to... Figure 1 Link 240.

[0114] Then, in step (5), vehicle 12 uses its camera 16 to scan and decode the customized QR code 24 via communication loop EE. Step (6) may require user authorization for payment, possibly via in-vehicle touchscreen confirmation or confirmation code, communication loop FF. The user's card information and the merchant's server entry point (e.g., URL) are sent to vehicle BO41 via communication link GG in step (7), for example, using SPAKE2 or other suitable security protocols.

[0115] continue Figure 7 In the discussion, in step (8), vehicle BO 41 can send card information to the entry point of merchant BO 42 via communication link HH. In step (9), merchant BO 42 submits information to the cloud-based payment service 44 via communication link II. Then, service 44 can confirm successful payment in steps (10a) and (10b), for example, by transmitting a payment receipt to infrastructure node 14 via communication link JJ in step (10a), and by transmitting a payment receipt to vehicle BO 41 via communication link KK in step (10b). Then, in step (10c), vehicle BO 41 can confirm the transaction with the user via communication link L1 by transmitting the payment receipt to vehicle 12. Figure 1 Similar to communication links 28, 240, and 260, various links / loops AA-LL can be wireless communication paths established and coordinated according to appropriate wireless protocols, such as IEEE 802.11, WiMAX, and Bluetooth. TM Bluetooth Low Energy (BLE), etc.

[0116] refer to Figure 8The cloud-based payment process 50 uses the vehicle back-end (BO) path, making the above assumptions that vehicle 12 and merchant BO 42 mutually authenticate each other, vehicle 12's secure element stores payment account or credit card information, submits it to the cloud-based payment service 44, and uses an appropriate security protocol. Similarly, payment process 50 uses... Figure 7 The payment process 40 uses steps (1)-(7) and the link / loop AA-GG, which have the above steps (1)-(7).

[0117] At step (8) of payment process 50, and unlike the sequence of process 40, vehicle BO 41 can directly send card information to payment cloud system 44 via communication link MM. The cloud-based payment service 44 can confirm successful payment via communication link NN at step (9) by transmitting a payment receipt to vehicle BO 41. Then, vehicle BO 41 can initiate communication with merchant BO 41 via a security protocol (e.g., SPAKE2) at step (10), and confirm the transaction with merchant BO 41 via a security link (e.g., communication link OO) at step (11). At step (11a), merchant BO 41 can transmit a similar confirmation to infrastructure node 14 via communication link PP.

[0118] Among other potential benefits, this method enables faster and more accurate generation of QR codes for vehicle-to-merchant transactions, in which vehicle 12 moves relative to infrastructure node 14, for example... Figure 1 , 7 The exemplary use case described in section 8. The solution described herein can be used to optimize the generation and display of QR codes based on the dynamically changing position of camera 16 on vehicle 12, enabling camera 16 to accurately read customized QR codes 24 from a distance. This can be achieved by projecting the QR code onto... Figure 1 This is achieved in the 2D plane of the display screen 22, taking into account the relative positions of the vehicle 12 and the infrastructure node 14. Although special patterns are embedded in the QR code to help the scanner avoid distortion and alignment, when attempting to extract from a QR code... Figure 1 When viewing a QR code at the proximity angle shown, scanning failure may be caused by a significant reduction in pixel resolution. Therefore, this teaching can be used to enhance the overall customer experience in in-vehicle mobile payment scenarios such as driving through services or merchants, toll booths, and electric vehicle (EV) charging stations. Those skilled in the art who benefit from the foregoing disclosure will readily recognize these and other potential benefits.

[0119] This disclosure allows for many different forms of embodiments. Representative examples of this disclosure are shown in the accompanying drawings and are described herein in detail as non-limiting examples of the disclosed principles. Therefore, elements and limitations described in the abstract, introduction, summary, and detailed description sections but not expressly set forth in the claims should not be incorporated into the claims, individually or collectively, by implication, inference, or otherwise.

[0120] For the purposes of this specification, unless otherwise stated, the use of the singular includes the plural, and vice versa; the terms “and” and “or” should be conjunctions and disjunctive words; “any” and “all” should mean “any and all”; and the words “including,” “contains,” “includes,” “has,” etc., should mean “including but not limited to.” Furthermore, approximate words such as “approximately,” “almost,” “substantially,” “generally,” etc., may be used herein in the sense of “being, near, or almost being” or “within 0-5%” or “within acceptable manufacturing tolerances” or logical combinations thereof.

[0121] The detailed description and accompanying drawings are intended to support and describe this teaching, but the scope of this teaching is defined only by the claims. While some preferred modes and other embodiments for implementing this teaching have been described in detail, various alternative designs and embodiments exist to practice the teaching as defined in the appended claims. Furthermore, this disclosure explicitly includes combinations and sub-combinations of the elements and features presented above and below.

Claims

1. A method for dynamically generating customized Quick Response (QR) codes for scanning by mobile vehicles during vehicle-to-merchant transactions, the method comprising: When a moving vehicle approaches an infrastructure node, the sensor suite of the infrastructure node, which communicates with the merchant's backend, detects parameters of the vehicle-mounted camera, including the distance and approach angle of the vehicle-mounted camera relative to the infrastructure node. In response to the parameters, the baseline QR code is dynamically reshaped via the processor of the infrastructure node to generate a customized QR code with modified shape, size and / or data capacity relative to the baseline QR code. Transmit display control signals to the displays of infrastructure nodes; and When a mobile vehicle approaches an infrastructure node, in response to a display control signal, a custom QR code is displayed on the screen, enabling the onboard camera to scan the custom QR code during a vehicle-to-merchant transaction.

2. The method according to claim 1, wherein, Dynamically reshaping the baseline square QR code involves performing a three-dimensional (3D) to two-dimensional (2D) projection via the processor of the infrastructure node, so that the customized QR code, when displayed via the display screen, has a 2D plane perpendicular to the focal axis of the vehicle-mounted camera.

3. An infrastructure node operable for executing vehicle-to-merchant transactions with moving vehicles, comprising: Fixed structure; Sensor kits mounted on or placed alongside a fixed structure; Display screen; and A server that communicates with the merchant's backend, and has a processor and a non-transitory computer-readable storage medium ("memory") on which instructions are recorded, wherein the processor's execution of the instructions causes the server to: Dynamically generate customized Quick Response (QR) codes for scanning by mobile vehicles equipped with onboard cameras; When a moving vehicle approaches a fixed structure, parameters of the onboard camera are detected via a sensor suite, including the distance and approach angle of the onboard camera relative to the fixed structure. In response to the parameters, the baseline QR code is dynamically reshaped via the processor to generate a customized QR code with modified shape, size and / or data capacity relative to the baseline QR code; A display control signal is transmitted to the display screen so that the display screen shows a customized QR code when the moving vehicle approaches the fixed structure, thereby enabling the vehicle-mounted camera to scan the customized QR code during the vehicle-to-business transaction.

4. The infrastructure node according to claim 3, wherein, The processor executes the instructions to cause the server to display the customized QR code as a pixelated image on the display screen, the pixelated image being tilted in the two-dimensional (2D) reference frame of the display screen.

5. The infrastructure node according to claim 3, wherein, The sensor suite includes one or more infrastructure cameras.

6. The infrastructure node according to claim 3, wherein, The sensor suite includes radar sensors, lidar sensors, and / or ultra-wideband (UWB) sensors.

7. The infrastructure node of claim 3, wherein the processor executes the instructions causing the server to dynamically reshape the baseline QR code by performing a three-dimensional (3D) to two-dimensional (2D) projection, such that the customized QR code, when displayed via the display screen, has a 2D plane perpendicular to the focal axis of the vehicle-mounted camera.

8. The infrastructure node according to claim 3, wherein, The processor executes the instructions to establish a secure network connection between the server and the merchant's backend as part of the vehicle-merchant transaction.

9. The infrastructure node of claim 3, wherein the processor executes the instructions causing the server to dynamically reshape the baseline QR code by calculating the required data capacity and resolution of the customized QR code based on the relative positions of the mobile vehicle and the infrastructure node.

10. The infrastructure node according to claim 3, wherein, The fixed structure is one of the following: a shop, a toll station, a roadside stall, or a structure through which a vehicle passes or drives.

Images