Vehicle real-time data is forwarded through a cloud-end forwarding three-party platform data forwarding and scheduling system, method, device and medium

Abstract

The present application belongs to the technical field of vehicle data processing, and specifically discloses a data forwarding and scheduling system, method, device and medium for forwarding vehicle real-time data through a cloud platform. The system comprises a resource scheduling management subsystem, a data acquisition and distribution subsystem, a message middleware, and a forwarding service subsystem. The data acquisition and distribution subsystem is connected with different vehicles, and the forwarding service subsystem is connected with a three-party receiving platform. The message middleware creates a topic corresponding to the three-party receiving platform. The forwarding service subsystem creates a platform forwarding service corresponding to the sum of the server numbers of the three-party receiving platform, and each platform forwarding service corresponds to a server. The present application can improve the automation and intelligence of vehicle real-time data forwarding, thereby improving the forwarding efficiency and being suitable for the forwarding processing of vehicle data.

Description

Technical Field

[0001] This invention belongs to the field of vehicle data processing technology, specifically relating to a data forwarding and scheduling system, method, device and medium for real-time vehicle data to be forwarded to a third-party platform via the cloud. Background Technology

[0002] After vehicle data is collected and uploaded to a remote server (i.e., a cloud server), it needs to be forwarded to other third-party cloud platforms through the capabilities of the remote server, so as to provide other cloud receiving services with real-time, full, complete, and full lifecycle vehicle data.

[0003] Currently, vehicle transfer systems on the market are designed using, for example... Figure 1 The architecture shown is as follows. Using the above system for data forwarding, vehicle data is collected and uploaded to a remote server, which then forwards it to more third-party receiving platforms. During the forwarding process, the remote server receives data and directly sends it to the third-party receiving platforms without any data forwarding management design, data flow, scheduling, or distribution processing. This results in excessively high throughput for individual forwarding tasks, a high failure rate, and excessive service pressure leading to downtime. In particular, the existing system lacks resource scheduling functionality. After adding a new third-party receiving platform, maintenance personnel need to configure the forwarding platform information, restart the forwarding tasks on the cloud server, and reload the latest configuration before data can be forwarded. This leads to data backlog, reduced real-time performance, and cumbersome configuration and application. Summary of the Invention

[0004] The purpose of this invention is to provide a data forwarding and scheduling system for real-time vehicle data via a cloud-based third-party platform, thereby improving the automation and intelligence of real-time vehicle data forwarding and thus increasing forwarding efficiency. The second objective of this invention is to provide a method for forwarding and scheduling real-time vehicle data via a cloud-based third-party platform, using the aforementioned system. A third objective of this invention is to provide an electronic device for use in the above-described method; A fourth objective of this invention is to provide a computer-readable storage medium for use in the above-described methods.

[0005] To achieve the above objectives, the technical solution adopted by this invention is as follows: A data forwarding and scheduling system for real-time vehicle data via a cloud-based third-party platform includes a resource scheduling and management subsystem, a data acquisition and distribution subsystem, a message middleware, and a forwarding service subsystem. The data acquisition and distribution subsystem is connected to different vehicles, and the forwarding service subsystem is connected to the third-party receiving platform. The message middleware creates topics that correspond one-to-one with the third-party receiving platforms; The forwarding service subsystem has the same number of servers as the three-party receiving platforms, and each platform forwarding service uniquely corresponds to one server. Resource scheduling and management subsystem: Used to configure, create, and manage basic information of the third-party receiving platform; used to configure, create, and manage topic names, storage periods, and storage sizes; used to control the flow and distribution of vehicle data by the data acquisition and distribution subsystem; used to manage data caching in the message middleware; used to provide access to configuration information for the forwarding service subsystem, control the frequency of vehicle data forwarding by the platform's forwarding service, start or stop the connection between the forwarding service subsystem and the third-party receiving platform, and display the connection status; used to dynamically display various statistical data and reports on data forwarding by the platform's forwarding service. Data acquisition and distribution subsystem: This system is used to receive vehicle-side data and distribute it to different topics according to the resource configuration of the resource scheduling and management subsystem. Message middleware: The resource scheduling and management subsystem dynamically configures, creates, or deletes topics and manages topic names in the message middleware based on the basic information of the third-party receiving platforms; Forwarding Service Subsystem: Based on the basic information of the third-party receiving platform, the resource scheduling and management subsystem dynamically creates or deletes platform forwarding services in the forwarding service subsystem; each platform forwarding service extracts the corresponding data from the corresponding topic and forwards it to the corresponding server.

[0006] As a limitation, the resource scheduling and management subsystem includes a resource scheduling and forwarding management platform with a web page.

[0007] The real-time vehicle data is forwarded to a third-party platform via the cloud using a data forwarding and scheduling method described above. This method includes the following steps. S1. The administrator configures, creates, and manages the basic information and connection tasks of the third-party receiving platform through the resource scheduling and management subsystem; and configures the unique vehicle identification number (VIN) that each third-party receiving platform needs to forward. S2. According to the configuration of the third-party receiving platform in step S1, the resource scheduling and management subsystem dynamically configures the topic name, storage period and storage size in the message middleware. On the other hand, it dynamically creates or deletes the platform forwarding service in the forwarding business service subsystem and configures the account and port of the platform forwarding service. Then the platform forwarding service automatically establishes a communication connection with the corresponding server. S3. The resource scheduling and management subsystem configures resources for the data acquisition and distribution subsystem based on the basic information of the third-party receiving platform. During this process, the data acquisition and distribution subsystem sends the corresponding vehicle data to the corresponding topic based on the extracted vehicle unique code information (VIN). The Vehicle Identification Number (VIN) is extracted by the data acquisition and distribution subsystem based on the received vehicle data. S4. The resource scheduling and management subsystem starts the forwarding task of the platform forwarding service. The platform forwarding service reads the vehicle data in the corresponding topic in a loop according to the forwarding task and forwards it to the corresponding server. S5. The server continuously receives vehicle data forwarded from the platform's forwarding service. While steps S4 and S5 are being performed, the platform forwarding service provides real-time feedback to the resource scheduling and management subsystem on the vehicle data transmission status and the information returned by the corresponding server. Based on the feedback from the platform forwarding service, the resource scheduling and management subsystem controls the forwarding frequency of vehicle data for the corresponding forwarding tasks.

[0008] As a limitation, the resource scheduling management subsystem includes a resource scheduling and forwarding management platform with a web page. In step S1, the administrator completes the configuration through the web page. The basic information of the third-party receiving platform includes the name of the third-party receiving platform, server account, IP address, and port.

[0009] As a further limitation, when the resource scheduling and management subsystem starts the forwarding task of the platform forwarding service, it enables the forwarding task to communicate directly and in real time with the resource scheduling and management subsystem. While steps S4 and S5 are being performed, the resource scheduling and management subsystem calculates and evenly distributes the forwarding data volume of each forwarding service through its built-in model algorithm, and controls the deletion and configuration update of forwarding services through the direct connection channel.

[0010] As a further limitation, while steps S4 and S5 are being performed, the resource scheduling and management subsystem calculates the forwarding throughput of the corresponding forwarding task and the forwarding throughput of the corresponding server based on the feedback from the platform forwarding service, and then controls the forwarding frequency of the corresponding forwarding task for vehicle data.

[0011] An electronic device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of the above-mentioned method for forwarding and scheduling real-time vehicle data through a cloud-based third-party platform.

[0012] A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the above-mentioned method for forwarding and scheduling real-time vehicle data through a cloud-based third-party platform.

[0013] The present invention, by adopting the above-described technical solution, achieves the following technical advancements compared to existing technologies: (1) The system package of the present invention includes a resource scheduling and management subsystem, a data collection and distribution subsystem, a message middleware, and a forwarding service subsystem. Through the unified management and coordination of the resource scheduling and management subsystem, it can automatically complete data forwarding, add, cancel, and delete third-party platforms, and automatically create and delete forwarding services. While giving full play to the advantages of the forwarding engine of the resource scheduling and management subsystem, it can execute forwarding data at a lower cost and higher efficiency. (2) The resource scheduling management subsystem of the present invention includes a resource scheduling forwarding management platform with a web page. Through the web page, the administrator can create and delete information and connection forwarding tasks of the receiving platform by configuration. When the forwarding task is created, the resource scheduling management subsystem will automatically create and delete the corresponding forwarding service at the appropriate time according to the built-in algorithm. There is no need to perform cumbersome operations manually. The automation and intelligence are higher and the efficiency is higher. (3) The present invention adopts a resource scheduling management subsystem to manage the data forwarding information of each vehicle VIN. Through management, the forwarded vehicle data is internally filtered, transferred and distributed, and the vehicle data is processed in a distributed manner to prevent data backlog and repeated calculations during data forwarding, reduce the forwarding time of data and improve the real-time performance of data. The forwarding business service subsystem is modularly processed, and a single forwarding service only performs a single forwarding task, reducing the complexity of logic, reducing operation and maintenance costs and reducing the probability of failure.

[0014] This invention belongs to the field of vehicle data processing technology and can improve the automation and intelligence of real-time vehicle data forwarding, thereby improving forwarding efficiency. Attached Figure Description

[0015] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used together with the embodiments of the invention to explain the invention and do not constitute a limitation thereof.

[0016] In the attached diagram: Figure 1 This is a design architecture diagram of a vehicle forwarding system in the market according to the prior art of this invention; Figure 2 This is an architecture diagram of Embodiment 1 of the present invention, which is connected to a third-party receiving platform. Figure 3 This is a flowchart of Embodiment 2 of the present invention. Detailed Implementation

[0017] The preferred embodiments of the present invention will now be described with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustrative and explanatory purposes only and are not intended to limit the scope of the invention.

[0018] Example 1: Real-time vehicle data is forwarded via the cloud to a third-party platform's data forwarding and scheduling system. like Figure 2 As shown, this embodiment includes a resource scheduling and management subsystem, a data acquisition and distribution subsystem, a message middleware, and a forwarding service subsystem. The data acquisition and distribution subsystem communicates with different vehicles, and the forwarding service subsystem communicates with third-party receiving platforms. The message middleware Kafka creates topics that correspond one-to-one with the third-party receiving platforms. The forwarding service subsystem creates platform forwarding services with the same number of servers as the sum of the number of servers on each third-party receiving platform, with each platform forwarding service uniquely corresponding to one server.

[0019] ①Resource Scheduling and Management Subsystem This system is used to configure, create, and manage the basic information of third-party receiving platforms. The basic information includes the platform's name, account, IP address, and port, and it also configures the unique vehicle identification number (VIN) for each platform to forward data. The resource scheduling and management subsystem includes a web-based resource scheduling and forwarding management platform. Administrators can configure, create, and delete the basic information and connection tasks of third-party receiving platforms through the web page. The resource scheduling and management subsystem then uses an internal algorithm to automatically create or delete the corresponding platform forwarding services based on the connection tasks.

[0020] This is used to configure, create, and manage topic names, storage periods, and storage sizes, and to manage data caching in the Kafka message middleware. After the configuration and creation of the third-party receiving platforms are completed, the resource scheduling and management subsystem will create a corresponding topic in the Kafka message middleware for each third-party receiving platform and complete the corresponding configuration, including the topic name, storage period, and storage size.

[0021] This is used to control the flow and distribution of vehicle data by the data acquisition and distribution subsystem. Specifically, after receiving vehicle data collected by the vehicle T-Box and packaged into a specified protocol format, the data acquisition and distribution subsystem extracts the Vehicle Identifier (VIN) from the vehicle data. Based on the administrator's configuration of the third-party receiving platform, the subsystem configures resources for the data acquisition and distribution subsystem and distributes the received vehicle data to different topics according to the above configuration.

[0022] Used to read configuration information of the forwarding service subsystem, control the frequency of vehicle data transmission by the platform forwarding service, start or stop the connection between the forwarding service subsystem and the third-party receiving platform, and display the connection status; used to dynamically display various statistical data and reports of data forwarding by the platform forwarding service.

[0023] ② Data Acquisition and Distribution Subsystem This is used to receive vehicle-side data and distribute it to different topics according to the resource configuration of the resource scheduling and management subsystem. First, after the vehicle T-Box collects vehicle data, it packages it according to a specified protocol format and sends it to the remote collection system via network protocol. Upon receiving the vehicle data, the data collection and distribution subsystem extracts the Vehicle Identifier (VIN) from the data. In the data collection and distribution subsystem, vehicle data is only distributed and not stored.

[0024] ③ Message middleware Kafka Based on the basic information of the third-party receiving platforms, the resource scheduling and management subsystem dynamically configures, creates, or deletes topics and manages topic names in the message middleware Kafka. Each third-party receiving platform corresponds to one topic.

[0025] ④ Forwarding Service Subsystem The resource scheduling and management subsystem dynamically creates or deletes platform forwarding services in the forwarding service subsystem based on the basic information of the third-party receiving platform. The platform forwarding service connects to the corresponding server based on the server account, IP, and port information of the third-party receiving platform configured by the resource scheduling and management subsystem.

[0026] For example, based on the administrator's configuration on the web page, vehicle data for a certain vehicle needs to be forwarded to three third-party receiving platforms. Each third-party receiving platform has two servers. Therefore, the Kafka message middleware will have three topics corresponding one-to-one with the three third-party receiving platforms. The forwarding service subsystem will create six forwarding services, each corresponding one-to-one with one of the six servers. Then, the resource scheduling and management subsystem, based on the vehicle's unique vehicle identification number (VIN) and the administrator's configuration, controls the sending of the corresponding vehicle data to the aforementioned three topics. Each platform's forwarding service cyclically reads the corresponding data from its topic and forwards it to the connected server.

[0027] Example 2: A method for forwarding and scheduling real-time vehicle data to a third-party platform via cloud transmission. This embodiment is implemented using Embodiment 1, such as... Figure 2 As shown, this embodiment includes the following steps: S1. The administrator configures, creates, and manages the basic information and connection tasks of the third-party receiving platforms through the web page on the resource scheduling and forwarding management platform in the resource scheduling and management subsystem; and configures the unique vehicle identification number (VIN) that each third-party receiving platform needs to forward. The basic information of the third-party receiving platform includes its name, account, IP address, and port. S2. According to the configuration of the third-party receiving platform in step S1, the resource scheduling and management subsystem dynamically configures the topic name, storage period and storage size in the message middleware Kafka. On the other hand, it dynamically creates or deletes the platform forwarding service in the forwarding business service subsystem and configures the account and port of the platform forwarding service. Then the platform forwarding service automatically establishes a communication connection with the corresponding server. It should be ensured that each third-party receiving platform corresponds to one topic, and each platform's forwarding service uniquely corresponds to one server; S3. The resource scheduling and management subsystem configures resources for the data acquisition and distribution subsystem based on the basic information of the third-party receiving platform. During this process, the data acquisition and distribution subsystem sends the corresponding vehicle data to the corresponding topic based on the extracted vehicle unique code information (VIN). The Vehicle Identification Number (VIN) is extracted by the data acquisition and distribution subsystem based on the received vehicle data. S4. The resource scheduling and management subsystem starts the forwarding task of the platform forwarding service. The platform forwarding service reads the vehicle data in the corresponding topic in a loop according to the forwarding task and forwards it to the corresponding server. S5. The server continuously receives vehicle data forwarded from the platform's forwarding service. While steps S4 and S5 are being performed, the platform forwarding service provides real-time feedback to the resource scheduling and management subsystem on the vehicle data transmission status and the information returned by the corresponding server. Based on the feedback from the platform forwarding service, the resource scheduling and management subsystem controls the forwarding frequency of vehicle data for the corresponding forwarding tasks.

[0028] In this embodiment, while the resource scheduling and management subsystem initiates the forwarding task of the platform forwarding service, it also enables the forwarding task to establish direct real-time communication with the resource scheduling and management subsystem. Simultaneously with steps S4 and S5, the resource scheduling and management subsystem uses its built-in model algorithm to calculate and evenly distribute the forwarding data volume across each forwarding service, and controls the deletion and configuration updates of forwarding services through the direct connection channel.

[0029] In this embodiment, while steps S4 and S5 are being performed, the resource scheduling and management subsystem calculates the forwarding throughput of the corresponding forwarding task and the forwarding throughput of the corresponding server based on the feedback from the platform forwarding service, and then controls the forwarding frequency of the vehicle data by the corresponding forwarding task.

[0030] Example 3: An electronic device An electronic device includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the method of Embodiment 2.

[0031] Example 4: A computer-readable storage medium A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method of Embodiment 2.

[0032] The computer-readable storage medium can be a computer storage medium or a communication medium. A communication medium includes any medium that facilitates the transfer of a computer program from one location to another. A computer storage medium can be any available medium accessible to a general-purpose or special-purpose computer. For example, a computer-readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the computer-readable storage medium. Of course, the computer-readable storage medium can also be a component of the processor. The processor and the computer-readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the ASIC can reside in a user equipment. Of course, the processor and the computer-readable storage medium can also exist as discrete components in a communication device. Specifically, the computer-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random-Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The storage medium can be any available medium accessible to general-purpose or special-purpose computers.

Claims

1. A data forwarding and scheduling system for real-time vehicle data transmitted via a cloud-based third-party platform, characterized in that: It includes a resource scheduling and management subsystem, a data acquisition and distribution subsystem, a message middleware, and a forwarding service subsystem; the data acquisition and distribution subsystem communicates with different vehicles, and the forwarding service subsystem communicates with the third-party receiving platform. The message middleware creates topics that correspond one-to-one with the third-party receiving platforms; The forwarding service subsystem has the same number of servers as the three-party receiving platforms, and each platform forwarding service uniquely corresponds to one server. Resource scheduling and management subsystem: used to configure, create, and manage the basic information of the third-party receiving platform; Used to configure, create, and manage topic names, storage periods, and storage sizes; Used to control the flow and distribution of vehicle data by the data acquisition and distribution subsystem; used to manage data caching in the message middleware; Used to read configuration information of the forwarding service subsystem, control the frequency of vehicle data transmission by the platform forwarding service, start or stop the connection between the forwarding service subsystem and the third-party receiving platform, and display the connection status; used to dynamically display various statistical data and reports of data forwarding by the platform forwarding service; Data acquisition and distribution subsystem: This system is used to receive vehicle-side data and distribute it to different topics according to the resource configuration of the resource scheduling and management subsystem. Message middleware: The resource scheduling and management subsystem dynamically configures, creates, or deletes topics and manages topic names in the message middleware based on the basic information of the third-party receiving platforms; Forwarding Service Subsystem: Based on the basic information of the third-party receiving platform, the resource scheduling and management subsystem dynamically creates or deletes platform forwarding services in the forwarding service subsystem; each platform forwarding service extracts the corresponding data from the corresponding topic and forwards it to the corresponding server; While the resource scheduling and management subsystem initiates the forwarding task of the platform forwarding service, it enables the forwarding task to establish direct real-time communication with the resource scheduling and management subsystem. The platform forwarding service provides real-time feedback to the resource scheduling and management subsystem on vehicle data transmission status and information from the corresponding server. Based on the feedback from the platform forwarding service, the resource scheduling and management subsystem uses a built-in scheduling algorithm to calculate the forwarding throughput of the corresponding forwarding task and the forwarding throughput of the corresponding server, thereby controlling the forwarding frequency of vehicle data by the corresponding forwarding task, and controlling the deletion and configuration update of the forwarding service through a direct connection channel.

2. The data forwarding and scheduling system for real-time vehicle data via cloud-based third-party platform as described in claim 1, characterized in that: The resource scheduling and management subsystem includes a resource scheduling and forwarding management platform with a web page.

3. The method for forwarding and scheduling real-time vehicle data to a third-party platform via cloud transmission, as described in claim 1 or 2, is characterized by the following: This method Includes the following steps, S1. The administrator configures, creates, and manages the basic information and connection tasks of the third-party receiving platform through the resource scheduling and management subsystem; and configures the unique vehicle identification number (VIN) that each third-party receiving platform needs to forward. S2. According to the configuration of the third-party receiving platform in step S1, the resource scheduling and management subsystem dynamically configures the topic name, storage period and storage size in the message middleware. On the other hand, it dynamically creates or deletes the platform forwarding service in the forwarding business service subsystem and configures the account and port of the platform forwarding service. Then the platform forwarding service automatically establishes a communication connection with the corresponding server. S3. The resource scheduling and management subsystem configures resources for the data acquisition and distribution subsystem based on the basic information of the third-party receiving platform. During this process, the data acquisition and distribution subsystem sends the corresponding vehicle data to the corresponding topic based on the extracted vehicle unique code information (VIN). The Vehicle Identification Number (VIN) is extracted by the data acquisition and distribution subsystem based on the received vehicle data. S4. The resource scheduling and management subsystem starts the forwarding task of the platform forwarding service and enables the forwarding task to communicate directly and in real time with the resource scheduling and management subsystem. The platform forwarding service reads vehicle data from the corresponding topic in a loop according to the forwarding task and forwards it to the corresponding server. S5. The server continuously receives vehicle data forwarded from the platform's forwarding service. While steps S4 and S5 are being performed, the platform forwarding service provides real-time feedback to the resource scheduling and management subsystem on the vehicle data transmission status and the information returned by the corresponding server. Based on the feedback from the platform forwarding service, the resource scheduling and management subsystem uses its built-in scheduling algorithm to calculate the forwarding throughput of the corresponding forwarding task and the forwarding throughput of the corresponding server, thereby controlling the forwarding frequency of vehicle data by the corresponding forwarding task. At the same time, the resource scheduling and management subsystem uses its built-in model algorithm to calculate and evenly distribute the forwarding data volume of each forwarding service, and controls the deletion and configuration update of forwarding services through the direct connection channel.

4. The method for forwarding and scheduling real-time vehicle data through a cloud-based third-party platform, as described in claim 3, is characterized in that... The resource scheduling and management subsystem includes a resource scheduling and forwarding management platform with a web page. In step S1, the administrator completes the configuration through the web page. The basic information of the third-party receiving platform includes the name of the third-party receiving platform, server account, IP address, and port.

5. An electronic device, characterized in that, The method includes a memory and a processor, the memory storing a computer program, characterized in that the processor executes the computer program to implement the steps of the method of claim 3 or 4.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method of claim 3 or 4.

Images