Flexible and efficient communication in microservice-based stream analysis pipelines

Abstract

A pull-based communication method for a micro-service-based real-time streaming video analysis pipeline is provided. This method receives a plurality of frames from a plurality of cameras each including a camera sidecar (1001), arranges a plurality of detectors in layers (1003), such that the first detector layer includes detectors having a detector sidecar and detector business logic, and the second detector layer includes detectors having only a sidecar, arranges a plurality of extractors in layers (1005), such that the first extractor layer includes extractors having an extractor sidecar and extractor business logic, and the second extractor layer includes extractors having only a sidecar, and during registration, a mesh controller selectively assigns inputs to one or more detector sidecars of the first detector layer and one or more extractor sidecars of the first extractor layer to enable pulling data items for processing (1007).

Claims

1. A computer-implemented method for a microservices-based real-time streaming video analytics pipeline, Each corresponds to a camera driver, and each receives multiple frames from multiple cameras, including camera sidecars (1001), Multiple detectors are arranged in layers such that the first detector layer includes a detector with a detector sidecar and detector business logic, and the second detector layer includes a detector with only a sidecar (1003), Multiple extractors are arranged in layers such that the first extractor layer includes an extractor equipped with an extractor sidecar and extractor business logic, and the second extractor layer includes an extractor equipped only with a sidecar (1005), A method comprising: enabling a mesh controller to communicate only with the detector sidecars of the first detector layer and the extractor sidecars of the first extractor layer, and during registration, the mesh controller selectively assigns inputs to one or more detector sidecars of the first detector layer and one or more extractor sidecars of the first extractor layer to extract data items for processing (1007).

2. A computer-implemented method according to claim 1, A method in which the plurality of detectors and the plurality of extractors are packaged as a Kubernetes pod.

3. A computer-implemented method according to claim 1, A method by which the camera sidecars of the plurality of cameras communicate directly only with the detector sidecar of the first detector layer.

4. A computer-implemented method according to claim 1, A method by which the sidecar of the second detector layer communicates directly only with the extractor sidecar of the first extractor layer.

5. A computer-implemented method according to claim 1, A method wherein the first detector layer includes a detector replica, and the first extractor layer includes an extractor replica, wherein the detector replica is prevented from direct communication with the extractor replica.

6. A computer-implemented method according to claim 1, A method by which the second detector layer provides the name of the detector stream and the name of the input stream to the mesh controller during registration.

7. A computer-implemented method according to claim 1, A method by which the first detector layer provides the name of the replica and the pod name to the mesh controller during registration.

8. A computer program product for a microservices-based real-time streaming video analytics pipeline, comprising a non-temporary computer-readable storage medium containing program instructions, wherein the program instructions are executable by a computer, and the computer... Each corresponds to a camera driver, and each receives multiple frames from multiple cameras, including camera sidecars (1001), Multiple detectors are arranged in layers such that the first detector layer includes a detector with a detector sidecar and detector business logic, and the second detector layer includes a detector with only a sidecar (1003), Multiple extractors are arranged in layers such that the first extractor layer includes an extractor equipped with an extractor sidecar and extractor business logic, and the second extractor layer includes an extractor equipped only with a sidecar (1005), A computer program product for causing a mesh controller to perform a method including enabling communication only between the detector sidecars of the first detector layer and the extractor sidecars of the first extractor layer, and during registration, selectively assigning inputs to one or more detector sidecars of the first detector layer and one or more extractor sidecars of the first extractor layer to extract data items for processing (1007).

9. A computer program product according to claim 8, A computer program product in which the aforementioned plurality of detectors and the plurality of extractors are packaged as a Kubernetes pod.

10. A computer program product according to claim 8, A computer program product in which the camera sidecars of the plurality of cameras communicate directly only with the detector sidecars of the first detector layer.

11. A computer program product according to claim 8, The sidecar of the second detector layer is a computer program product that communicates directly only with the extractor sidecar of the first extractor layer.

12. A computer program product according to claim 8, The first detector layer includes a detector replica, and the first extractor layer includes an extractor replica, wherein the detector replica is a computer program product that prevents direct communication with the extractor replica.

13. A computer program product according to claim 8, A computer program product in which the second detector layer provides the mesh controller with the name of the detector stream and the name of the input stream during registration.

14. A computer program product according to claim 8, A computer program product in which the first detector layer provides the name of the replica and the pod name to the mesh controller during registration.

15. A computer processing system for a microservices-based real-time streaming video analytics pipeline, A storage device for storing program code, The device comprises a processor device operationally coupled to the aforementioned storage device, and the processor device is Each corresponds to a camera driver, and each receives multiple frames from multiple cameras, including a camera sidecar (1001), Multiple detectors are arranged in layers such that the first detector layer includes a detector with a detector sidecar and detector business logic, and the second detector layer includes a detector with only a sidecar (1003). Multiple extractors are arranged in layers such that the first extractor layer includes an extractor equipped with an extractor sidecar and an extractor business logic, and the second extractor layer includes an extractor equipped only with a sidecar (1005). A computer processing system that enables a mesh controller to communicate only with the detector sidecars of the first detector layer and the extractor sidecars of the first extractor layer, and during registration, executes the program code for selectively assigning inputs to one or more detector sidecars of the first detector layer and one or more extractor sidecars of the first extractor layer to extract data items for processing (1007).

16. A computer processing system according to claim 15, A computer processing system in which the plurality of detectors and the plurality of extractors are packaged as a Kubernetes pod.

17. A computer processing system according to claim 15, A computer processing system in which the camera sidecars of the plurality of cameras communicate directly only with the detector sidecars of the first detector layer.

18. A computer processing system according to claim 15, The sidecar of the second detector layer is a computer processing system that communicates directly only with the extractor sidecar of the first extractor layer.

19. A computer processing system according to claim 15, The first detector layer includes a detector replica, the first extractor layer includes an extractor replica, and the detector replica is prevented from direct communication with the extractor replica.

20. A computer processing system according to claim 15, A computer processing system in which, during registration, the second detector layer provides the mesh controller with the name of the detector stream and the name of the input stream, and during registration, the first detector layer provides the mesh controller with the name of the replica and the name of the pod.

Images