Method and system for on-board video monitoring of intelligent connected vehicles

Abstract

A method for on-board video surveillance of intelligent connected vehicles includes: a connected vehicle operation platform and a video service platform determine an operation platform identifier and a regional identifier, the operation platform proposes and agrees on video requirements with the video service platform; the connected vehicle operation platform numbers the intelligent connected vehicles according to a first preset rule based on the operation platform identifier and the regional identifier, and sends the numbering rule to the video service platform; the video service platform formulates connected vehicle operation platform configuration requirements based on the agreed video requirements, and fills in specific configuration items in the video service platform's access service to complete on-board video access; the video service platform manages the connected vehicle's on-board video data according to the specific configuration items accessed, meeting the requirements of the operation platform and the video service platform. The present invention is not limited by the video service platform scenario, nor by the number of operation platforms or intelligent connected vehicles, and can meet user requirements. It also simplifies the difficulty of the operation platform in uniquely identifying video names.

Description

Technical Field

[0001] The present invention relates to the fields of video and communications, and in particular to a method and system for on-board video monitoring of an intelligent connected vehicle. Background Art

[0002] With the rapid development of the Internet of Things (IoT) and intelligent connected vehicle (ICV) technologies, the use of onboard cameras is becoming increasingly common. Every ICV is equipped with at least one onboard camera. The real-time video captured by the camera is transmitted via the network to a video service platform. End users can access the video data from the video service platform on a website and watch it in real time. When the onboard camera transmits video data to the video service platform, a unique identifier must be assigned to each video uploaded by the camera to distinguish and manage the relationship between each video and the ICV. This unique identifier allows both the video service platform and users to quickly identify the operating platform, vehicle, and location of the video.

[0003] Currently, domestic intelligent connected vehicle (ICV) technology is still in the demonstration phase, and the number of operating platforms and ICVs under these platforms is extremely limited. Therefore, when assigning unique identifiers to videos uploaded from onboard cameras, each operating platform and ICV need only be assigned one identifier. However, as ICV technology matures, the number of operating platforms and ICVs is expected to increase significantly. These platforms and ICVs will not be limited to demonstration zones, but will be operational nationwide. Given this rapid development, without a sound identification rule, the possibility of duplicate uploaded video names is high. Since video service platforms cannot distinguish duplicate video names, subsequent uploads will fail, and users will also be unable to distinguish between duplicate video names. Furthermore, for vehicle information security reasons, the vehicle identifier (VIN) is not used in video naming. Therefore, even with a large number of ICVs, duplicate video names must be avoided. Furthermore, in the actual use of ICV in-vehicle video, differentiated management of in-vehicle videos is often required to meet user needs. Therefore, there is an urgent need to design a reasonable ICV in-vehicle video monitoring method and system that can meet these various needs. Summary of the Invention

[0004] In view of the above problems, the present invention is proposed to provide a method and system for on-board video monitoring of an intelligent connected vehicle that overcomes the above problems or at least partially solves the above problems.

[0005] In order to solve the above technical problems, the embodiments of the present application disclose the following technical solutions:

[0006] A method for on-board video monitoring of an intelligent connected vehicle, comprising:

[0007] S100. The connected vehicle operation platform and the video service platform determine the operation platform identifier and region identifier, and the operation platform proposes and agrees on video requirements with the video service platform.

[0008] S200. The connected vehicle operation platform numbers the intelligent connected vehicle according to the first preset rule based on the operation platform identification and regional identification, and sends the numbering rules to the video service platform;

[0009] S300. The video service platform formulates the configuration requirements for the connected vehicle operation platform based on the agreed-upon video requirements and fills in the specific configuration items in the video service platform's access service to complete the vehicle video access.

[0010] S400. The video service platform manages the connected vehicle’s onboard video data according to the specific configuration items connected to it to meet the needs of the operation platform and the video service platform.

[0011] Furthermore, in S100, the operation platform proposes and agrees on requirements with the video service platform. The requirements include: the operation platform expects that the video data uploaded by the vehicle video to the video service platform can be forwarded to the operation platform's own video service platform; the video service platform will synthesize all videos of each vehicle sent to the operation platform into one video, and ultimately only forward the synthesized video data.

[0012] Furthermore, in S200, the intelligent connected vehicles are numbered according to the first preset rule. The first preset rule is: the intelligent connected vehicles are numbered according to the operating platform identifier OperatorName, the area identifier Area and the vehicle number CarNum of the intelligent connected vehicle, where the vehicle number can start from a positive integer 1. For each new intelligent connected vehicle, the vehicle number is increased by a value to ensure that the vehicle number increases monotonically.

[0013] Furthermore, in S300 , the access service of the video service platform has the following functions at least: video data reception, video data format analysis, video data format transpackaging, video data storage, and interaction with external messages.

[0014] Furthermore, in S300, the video service platform manages configuration items through configuration files, wherein the configuration files are managed based on the operation platform, and the configurations of each operation platform are on a level with each other. The operation platform can further divide the vehicle video data by region.

[0015] Furthermore, in S400, the video service platform manages the connected vehicle's onboard video data according to the specific configuration items accessed, including:

[0016] The video service platform adjusts the resolution, adapts the encoding format, and performs special processing on the video data uploaded by the smart connected vehicles under the operating platform; it can also use the operating platform and the region as the basis for differentiation, and the video data uploaded by smart connected vehicles in different operating platforms and different regions can all receive specific processing.

[0017] Furthermore, the video access service process of the video service platform is as follows:

[0018] S301. The video service platform establishes a connection with the connected car's onboard camera and parses the operating platform name, region, and vehicle number information uploaded by the camera;

[0019] S302. Get the configuration content from the configuration file based on the operating name and region information;

[0020] S303. Complete vehicle data access and processing based on the configuration results.

[0021] Furthermore, the video management service process of the video service platform is as follows:

[0022] S401. The video management service receives a notification from the video access service, and the vehicle camera starts uploading video data. S402. The video management service receives a notification from the video access service, and a vehicle camera starts uploading video data.

[0023] The present invention also discloses a system for video surveillance of intelligent connected vehicles, including: a connected vehicle operation platform and a video service platform; wherein:

[0024] The connected vehicle operation platform is configured to determine the operation platform identifier and the region identifier with the video service platform, and to propose and negotiate video requirements with the video service platform; and is further configured to number the intelligent connected vehicles according to a first preset rule based on the operation platform identifier and the region identifier, and to send the numbering rule to the video service platform;

[0025] The video service platform is used to formulate the configuration requirements of the connected vehicle operation platform based on the agreed video requirements, and to fill in specific configuration items in the access service of the video service platform to complete the on-board video access; it is also used to manage the on-board video data of the connected vehicle according to the specific configuration items accessed to meet the requirements of the operation platform and the video service platform.

[0026] The beneficial effects of the above technical solutions provided by the embodiments of the present invention include at least:

[0027] The present invention discloses a method for on-board video monitoring of an intelligent connected vehicle, comprising: the connected vehicle operation platform and the video service platform determine the operation platform identifier and the regional identifier, the operation platform proposes and agrees on the video requirements to the video service platform; the connected vehicle operation platform numbers the intelligent connected vehicles according to the operation platform identifier and the regional identifier according to a first preset rule, and sends the numbering rule to the video service platform; the video service platform formulates the configuration requirements of the connected vehicle operation platform according to the agreed video requirements, and fills in the specific configuration items in the access service of the video service platform to complete the on-board video access; the video service platform manages the on-board video data of the connected vehicle according to the specific configuration items accessed to meet the requirements of the operation platform and the video service platform. The present invention is not limited by the video service platform scenario, such as the video service platform cluster, the interaction between the video service platform and the third-party platform, etc., nor is it limited by the number of operation platforms and intelligent connected vehicles. It can meet user needs and also simplifies the difficulty of the operation platform in uniquely identifying the video name. This invention has strong practicality and a wide range of applications.

[0028] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0030] Figure 1 This is a flow chart of a method for on-board video monitoring of an intelligent connected vehicle in embodiment 1 of the present invention;

[0031] Figure 2 This is a flowchart of a video access service process on a video service platform in Example 1 of the present invention;

[0032] Figure 3 This is a flowchart of the video management service processing of the video service platform in Example 1 of the present invention. DETAILED DESCRIPTION

[0033] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0034] In order to solve the problems existing in the prior art, an embodiment of the present invention provides a method for on-board video monitoring of an intelligent connected vehicle.

[0035] Example 1

[0036] This embodiment discloses a method for video surveillance of an intelligent connected vehicle. Figure 1 ,include:

[0037] S100. The connected vehicle operation platform and the video service platform determine the operation platform identifier and region identifier, and the operation platform proposes and agrees on video requirements with the video service platform.

[0038] In this embodiment, the operation platform proposes and agrees on requirements with the video service platform. The requirements include: the operation platform expects that a copy of the video data uploaded to the video service platform by the vehicle video can be forwarded to the operation platform's own video service platform; the video service platform will synthesize all videos of each vehicle sent to the operation platform into one video, and ultimately forward only the synthesized video data.

[0039] For example, a new operating platform A wants its vehicles in Wuhan to be connected to the intelligent connected vehicle management platform. The operating platform and video service platform maintenance personnel determine the operating platform identifier as OperatorNameA and the region identifier as WuHan. The operating platform expects that a copy of the video data uploaded by the vehicle to the video service platform can be forwarded to operating platform A's own video service platform. To save network bandwidth, it further expects that all videos from each vehicle can be combined into one video channel, and ultimately only the combined video data will be forwarded.

[0040] S200. The connected vehicle operation platform numbers the smart connected vehicles according to the first preset rule based on the operation platform identifier and the regional identifier, and sends the numbering rule to the video service platform. In this embodiment, the first preset rule is: number the smart connected vehicles according to the operation platform identifier OperatorName, the regional identifier Area, and the vehicle number CarNum of the smart connected vehicle, where the vehicle number can start from a positive integer 1. For each new smart connected vehicle, the vehicle number is increased by a numerical value to ensure that the vehicle number increases monotonically. This vehicle numbering naming rule is based on the region, and smart connected vehicles in each region can use this rule. The rules for numbering vehicles can be the same or different between different operation platforms.

[0041] For example: Continuing with the S100 example, the operating platform OperatorNameA plans to deploy 10,000 vehicles in the first phase of intelligent networking in Wuhan. The customized numbers of these 10,000 vehicles can range from 00001 to 10000. If another 10,000 vehicles are deployed in the second phase, the numbers of the newly deployed vehicles will continue to accumulate, from 10001 to 20000.

[0042] S300. The video service platform formulates the configuration requirements of the connected vehicle operation platform based on the agreed video requirements, and fills in the specific configuration items in the access service of the video service platform to complete the vehicle video access; in this embodiment, the access service of the video service platform has the following functions at least: video data reception, video data format parsing, video data format transpackaging, video data storage and interaction with external messages.

[0043] After comprehensively considering the needs of all parties, the video service platform formulates the configuration requirements of operation platform A and fills in the configuration items in the video service platform access service. Configuration files are managed based on the operation platform. The configurations of each operation platform are on a par with each other. The vehicle video data can be further divided by region within the operation platform. The video access service in the video service platform obtains the latest configuration and waits for the vehicle video data from operation platform A to be uploaded. It should be noted that the access service in the video service platform and many video data processing functions can be controlled by the configuration file. There are default configuration values ​​in the video access service. If the configuration file does not display the filled-in configuration items, the video access service uses the default configuration values. In addition, the video access service supports the hot loading function commonly used in the industry. After modifying the configuration file, the latest configuration content can be obtained without restarting the service.

[0044] For example, an operator (OperatorNameA) requires the video service platform to synthesize the video data from every vehicle in the Wuhan area and forward it to OperatorNameA's own video platform. At the same time, users of the intelligent connected vehicle management platform want all vehicle video data to be saved as historical video files and to have low latency when viewing in-vehicle video data in real time. To address these requirements, the video platform maintainer adds a WuHan subconfiguration to the OperatorNameA configuration directory when configuring the configuration file. Within this subconfiguration, they specify the interface address for communicating with the outside world during video data logging, the use of uncached video data processing, the need for in-vehicle video data synthesis, and the ingestion address of OperatorNameA's own video service platform. Once OperatorNameA uploads in-vehicle video data from Wuhan, the video access service processes the video data according to the configured options.

[0045] S400. The video service platform manages the connected vehicle's onboard video data based on the specific configuration items it accesses, meeting the needs of the operating platform and the video service platform. In this embodiment, the video service platform manages the connected vehicle's onboard video data based on the specific configuration items it accesses. This includes: the video service platform adjusts the resolution, adapts the encoding format, and performs special processing on the video data uploaded by the operating platform's smart connected vehicles. Alternatively, the platform can differentiate based on the operating platform and region, allowing video data uploaded by smart connected vehicles on different operating platforms and in different regions to receive specific processing.

[0046] For example: Continuing with the example of S300, the operation platform OperatorNameA uploads the on-board video data of the smart connected vehicles in the Wuhan area to the video access service. The video management service receives the access service notification, synthesizes the on-board video data of the operation platform OperatorNameA, and sends it to the video service platform of the operation platform OperatorNameA.

[0047] In order to better understand this embodiment, this embodiment describes the video service platform video access service process and the video service platform video management service process in more detail. Figure 2 , the video access service process of the video service platform is:

[0048] S301. The video service platform establishes a connection with the connected car's onboard camera and parses the operating platform name, region, and vehicle number information uploaded by the camera;

[0049] In S100, after operating platform A and the video service platform's maintenance personnel confirm the video data upload information, they configure the vehicle's onboard camera to upload the video data. The camera then requests a connection with the video service platform. The video service platform verifies the camera's legitimacy and establishes a connection. The camera then sends the video service platform the identifier of the operating platform to which the intelligent connected vehicle belongs, the region it belongs to, and the vehicle license plate assigned by the operating platform. The video service platform then parses and stores this information. For security reasons, this information can be encrypted before transmission.

[0050] For example, operating platform A has deployed 10,000 vehicles in the Wuhan area for intelligent connected vehicle operations. When setting up streaming information for the onboard camera of vehicle number 00100, it would enter the operating platform identifier OperatorNameA, the region WuHan, the vehicle number 00100, and the video direction Front. After the video service platform authenticates the camera as legitimate, it establishes communication with the camera and, according to the rules, parses and saves the OperatorNameA, WuHan, 00100, and Front information.

[0051] S302. Obtain configuration content from the configuration file based on the operator name and region information; for example: continuing with the example of S201, the access service in the video service platform can quickly locate the video data processing logic in the configuration file based on the operator platform name identifier OperatorNameA and the region identifier WuHan. For example, if the actual video data needs to be stored as a historical video file, it needs to interact with the video management service to notify the video management service to process the vehicle video data, etc.

[0052] S303. Complete vehicle data access and processing based on the configuration results.

[0053] like Figure 3 , the video management service process of the video service platform is:

[0054] S401. The Video Management Service receives notification from the Video Access Service that the vehicle camera begins uploading video data. The Operations Platform requests the video data uploaded by the intelligent connected vehicle's onboard camera, such as synthesizing the onboard video data and sending it to the video service platform established by the Operations Platform, allowing users to view real-time video with low latency. After receiving the onboard video data, the Access Service in the Video Service Platform interacts with the Video Management Service to notify it that the video data has been uploaded.

[0055] S402. The video management service receives a notification from the video access service that a vehicle-mounted camera has started uploading video data.

[0056] This embodiment discloses a method for on-board video monitoring of an intelligent connected vehicle, including: the connected vehicle operation platform and the video service platform determine the operation platform identifier and the regional identifier, and the operation platform proposes and agrees on the video requirements to the video service platform; the connected vehicle operation platform numbers the intelligent connected vehicles according to the operation platform identifier and the regional identifier according to the first preset rule, and sends the numbering rule to the video service platform; the video service platform formulates the configuration requirements of the connected vehicle operation platform according to the agreed video requirements, and fills in the specific configuration items in the access service of the video service platform to complete the on-board video access; the video service platform manages the on-board video data of the connected vehicle according to the specific configuration items accessed to meet the requirements of the operation platform and the video service platform. The present invention is not limited by the video service platform scenario, such as the video service platform cluster, the interaction between the video service platform and the third-party platform, etc., nor is it limited by the number of operation platforms and intelligent connected vehicles. It can meet user needs and also simplifies the difficulty of the operation platform in uniquely identifying the video name. This invention has strong practicality and a wide range of applications.

[0057] Example 2

[0058] This embodiment discloses a system for on-board video surveillance of an intelligent connected vehicle, including: a connected vehicle operation platform and a video service platform; wherein:

[0059] The connected vehicle operation platform is configured to determine the operation platform identifier and the region identifier with the video service platform, and to propose and negotiate video requirements with the video service platform; and is further configured to number the intelligent connected vehicles according to a first preset rule based on the operation platform identifier and the region identifier, and to send the numbering rule to the video service platform;

[0060] The video service platform is used to formulate the configuration requirements of the connected vehicle operation platform based on the agreed video requirements, and to fill in specific configuration items in the access service of the video service platform to complete the on-board video access; it is also used to manage the on-board video data of the connected vehicle according to the specific configuration items accessed to meet the requirements of the operation platform and the video service platform.

[0061] Specifically, the specific working methods of the operation platform and the video service platform have been described in detail in Example 1, and will not be repeated in this embodiment.

[0062] It should be understood that the specific order or hierarchy of steps in the disclosed processes is an example of an exemplary method. Based on design preferences, it should be understood that the specific order or hierarchy of steps in the process can be rearranged without departing from the scope of the present disclosure. The accompanying method claims present elements of the various steps in an exemplary order and are not intended to be limited to the specific order or hierarchy described.

[0063] In the foregoing detailed description, various features are grouped together in a single embodiment to simplify the disclosure. This method of disclosure should not be interpreted as reflecting an intention that embodiments of the claimed subject matter require more features than are expressly recited in each claim. On the contrary, as reflected in the appended claims, the invention comprises less than all the features of any individual disclosed embodiment. The appended claims are therefore hereby expressly incorporated into the detailed description, with each claim standing on its own as a separate preferred embodiment of the invention.

[0064] Those skilled in the art will also appreciate that the various illustrative logic blocks, modules, circuits, and algorithmic steps described in conjunction with the embodiments herein may be implemented as electronic hardware, computer software, or a combination thereof. In order to clearly illustrate the interchangeability between hardware and software, the various illustrative components, blocks, modules, circuits, and steps described above are generally described around their functions. Whether such functions are implemented as hardware or software depends on the specific application and the design constraints imposed on the entire system. A skilled person may implement the described functions in an adaptable manner for each specific application, but such implementation decisions should not be interpreted as departing from the scope of protection of this disclosure.

[0065] The steps of the methods or algorithms described in conjunction with the embodiments herein may be directly embodied as hardware, software modules executed by a processor, or a combination thereof. The software module may be located in a RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, register, hard disk, removable disk, CD-ROM, or any other form of storage medium well known in the art. An exemplary storage medium is connected to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium may also be an integral part of the processor. The processor and storage medium may be located in an ASIC. The ASIC may be located in a user terminal. Of course, the processor and storage medium may also be present in a user terminal as discrete components.

[0066] For software implementation, the techniques described in this application can be implemented using modules (e.g., procedures, functions, etc.) that perform the functions described in this application. These software codes can be stored in a memory unit and executed by a processor. The memory unit can be implemented within the processor or external to the processor. In the latter case, it is communicatively coupled to the processor via various means, which are well known in the art.

[0067] The foregoing description includes examples of one or more embodiments. Of course, it is not possible to describe all possible combinations of components or methods for the purposes of describing the above embodiments, but one of ordinary skill in the art will recognize that the various embodiments may be further combined and arranged. Therefore, the embodiments described herein are intended to encompass all such changes, modifications and variations that fall within the scope of the appended claims. Furthermore, to the extent the term "comprising" is used in the specification or claims, the term is intended to be encompassed in a manner similar to the term "including," as explained in terms of "including," used as a transitional word in the claims. Furthermore, any use of the term "or" in the specification of the claims is intended to mean a "non-exclusive or."

Claims

1. A method for on-board video monitoring of an intelligent connected vehicle, characterized in that: include: S100. The connected vehicle operation platform and the video service platform determine the operation platform identifier and region identifier, and the operation platform proposes and agrees on video requirements with the video service platform. In S100, the operation platform proposes and agrees on requirements with the video service platform. The requirements include: the operation platform expects that a copy of the video data uploaded by the vehicle to the video service platform be forwarded to the operation platform's own video service platform; the video service platform synthesizes all videos sent to the operation platform by each vehicle into one video channel, and ultimately forwards only the synthesized video data; S200. The connected vehicle operation platform numbers the intelligent connected vehicles according to the first preset rule based on the operation platform identifier and the regional identifier, and sends the numbering rule to the video service platform; In S200, the intelligent connected vehicles are numbered according to the first preset rule. The first preset rule is: the intelligent connected vehicles are numbered according to the operation platform identifier OperatorName, the regional identifier Area, and the vehicle number CarNum of the intelligent connected vehicle, where the vehicle number can start from a positive integer 1. For each new intelligent connected vehicle, the vehicle number is increased by a value to ensure that the vehicle number increases monotonically; S300. The video service platform formulates configuration requirements for the connected vehicle operation platform based on the agreed-upon video requirements and completes in-vehicle video access by filling in specific configuration items in the video service platform's access service. In S300, the video service platform's access service features at least include: video data reception, video data format parsing, video data format transpackaging, video data storage, and external message exchange. In S300, the video service platform manages configuration items through configuration files. Configuration files are managed on a per-operation platform basis, with configurations on each operating platform being on a par with each other. Operating platforms can further partition in-vehicle video data by region. S400. The video service platform manages the connected vehicle’s onboard video data according to the specific configuration items connected to it to meet the needs of the operation platform and the video service platform.

2. The method for on-board video monitoring of an intelligent connected vehicle according to claim 1, wherein: In S400, the video service platform manages the on-board video data of the connected vehicles according to the specific configuration items of the access, including: the video service platform adjusts the resolution, adapts the encoding format, and processes the video images of the video data uploaded by the smart connected vehicles under the operating platform; or based on the operating platform and the region, the video data uploaded by the smart connected vehicles in different operating platforms and different regions can be processed.

3. The method for on-board video monitoring of an intelligent connected vehicle according to claim 1, wherein: The video access service process of the video service platform is as follows: S301. The video service platform establishes a connection with the connected car's onboard camera and parses the operating platform name, region, and vehicle number information uploaded by the camera; S302. Get the configuration content from the configuration file based on the operating name and region information; S303. Complete vehicle data access and processing based on the configuration results.

4. The method for on-board video monitoring of an intelligent connected vehicle according to claim 1, wherein: The video management service process of the video service platform is as follows: S401. The video management service receives a notification from the video access service, and the vehicle camera starts uploading video data; S402. The video management service receives a notification from the video access service that a vehicle-mounted camera has started uploading video data.

5. A system for video surveillance of an intelligent connected vehicle, using the video surveillance method according to any one of claims 1 to 4, characterized in that: include: Connected car operation platform and video service platform; including: The connected vehicle operation platform is configured to determine the operation platform identifier and the region identifier with the video service platform, and to propose and negotiate video requirements with the video service platform; and is further configured to number the intelligent connected vehicles according to a first preset rule based on the operation platform identifier and the region identifier, and to send the numbering rule to the video service platform; The video service platform is used to formulate the configuration requirements of the connected vehicle operation platform based on the agreed video requirements, and to fill in specific configuration items in the access service of the video service platform to complete the on-board video access; it is also used to manage the on-board video data of the connected vehicle according to the specific configuration items accessed to meet the requirements of the operation platform and the video service platform.

Images