Video structured task management method and terminal device, and video structured platform
By acquiring and updating the video channel saturation rate parameter, the task is assigned to the device with the heaviest load, which solves the problem of load imbalance caused by different hardware acceleration device specifications and realizes efficient processing of the video structuring platform.
Patent Information
- Application Number
- CN202011568444.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-12-25
- Publication Date
- 2025-11-18
- Estimated Expiration
- 2040-12-25
AI Technical Summary
In existing video structuring platforms, the different specifications of hardware acceleration devices lead to uneven load, with some devices idle while others are overwhelmed with tasks, resulting in low overall processing performance and efficiency.
By acquiring the video channel saturation rate parameters of each processing node device, the device with the heaviest load is selected to be assigned tasks, and the load status is updated in real time to achieve load balancing.
This ensured load balancing for hardware acceleration devices, improved the processing performance and efficiency of the video structuring platform, and prevented equipment backlog.
Smart Images
Figure CN114758262B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of video data processing technology, and in particular relates to a video structured task management method and terminal device. Background Technology
[0002] Video structuring refers to the process of intelligently analyzing people, vehicles, objects, colors, etc., in video footage to extract key information and perform semantic text descriptions. Video structuring platforms are now widely used in scenarios such as urban security, smart communities, and new business systems. In the video structuring process, video data is typically decoded first using functions provided by hardware acceleration devices, and then the decoded video data is processed by a video structuring engine for structuring.
[0003] However, a single hardware acceleration device cannot meet the analysis needs of numerous video access devices. Therefore, a cluster system is often deployed, integrating a large number of hardware acceleration devices. With the upgrading and iteration of hardware acceleration devices, a cluster system typically contains hardware acceleration devices of different specifications. These different specifications of hardware acceleration devices have varying amounts of video memory resources and different video data processing capabilities. Existing video structuring platforms cannot perform load balancing based on the structuring processing capabilities of different hardware acceleration devices. This leads to situations where some hardware acceleration devices are idle while others are heavily burdened with tasks, reducing the overall processing performance and efficiency of the platform. Summary of the Invention
[0004] In view of this, this application provides a video structuring task management method, terminal device, and video structuring platform to solve the problems of some hardware acceleration devices being idle while others have serious task backlogs in existing video structuring platforms, resulting in low overall processing performance and efficiency of the platform.
[0005] A first aspect of this application provides a video structuring processing method applied to a management node device, the method comprising:
[0006] Obtain the video channel saturation rate parameter of each processing node device; the video channel saturation rate parameter is generated by each processing node device according to the resolution information of the video structuring task it is processing;
[0007] The target processing node device is determined based on the video channel saturation rate parameter of each processing node device.
[0008] The video structuring task is distributed to the target processing node device for processing.
[0009] Furthermore, determining the target processing node device based on the video channel saturation rate parameter of each processing node device includes:
[0010] If the video channel saturation parameters of each processing node device are equal, then any processing node device is selected as the target processing node device.
[0011] If the video channel saturation rate parameters of each processing node device are not equal, then the processing node device with the largest video channel saturation rate parameter is selected as the target processing node device.
[0012] By selecting the processing node device with the largest video channel saturation parameter as the target processing node device, the load balance of each hardware acceleration device can be guaranteed.
[0013] Furthermore, the video structured task management method also includes:
[0014] Control each processing node device to perform initialization operations.
[0015] Furthermore, controlling each processing node device to perform initialization operations includes setting the maximum number of supported channels and video resolution reference values, as well as the initial video channel saturation rate parameters, for each processing node device controlled by the management node device.
[0016] A second aspect of this application provides a video structured task management method applied to a target processing node, the method comprising:
[0017] Upon receiving a video structuring task, the resolution information of the video data to be processed in the video structuring task is obtained; the video structuring task is issued by the management node device.
[0018] Update the video channel saturation parameter based on the resolution information of the video data to be processed;
[0019] Upload the updated video channel saturation parameters to the management node device.
[0020] Further, updating the video channel saturation parameter based on the resolution information of the video data to be processed includes:
[0021] Obtain the video resolution reference value and the maximum number of supported channels; the video resolution reference value and the maximum number of supported channels are set by the processing node device during initialization;
[0022] The video stream saturation rate parameter is calculated based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum supported number of streams.
[0023] For example, the calculation formula for determining the current video channel saturation parameter based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum supported channel count is as follows:
[0024] ω=(1-(V resolution +V base )÷V max )×100%;
[0025] Where ω represents the video saturation parameter, V resolution This refers to the resolution information of the video data to be processed, V base V represents the reference value for video resolution. max Indicates the maximum number of supported paths.
[0026] By updating its own video channel saturation parameters in real time and uploading them to the management node device, the management node device can effectively grasp the load status of each processing node device.
[0027] A third aspect of this application provides a video structuring task management method applied to a video structuring platform, which may include a management node device and a plurality of processing node devices. The method includes:
[0028] The management node device obtains the video channel saturation rate parameters of each processing node device;
[0029] The management node device determines the target processing node device based on the video channel saturation rate parameter of each processing node device.
[0030] The management node device distributes the video structuring task to the target processing node device for processing;
[0031] When the target processing node device receives a video structuring task issued by the management node device, it obtains the resolution information of the video data to be processed in the video structuring task.
[0032] The target processing node device updates the video channel saturation parameter according to the resolution information of the video data to be processed.
[0033] The target processing node device uploads the updated video channel saturation parameters to the management node device.
[0034] Furthermore, the aforementioned video structured task management method also includes:
[0035] The management node device controls each processing node device to perform initialization operations.
[0036] By setting various parameters through initialization, the video channel saturation rate parameter (real-time load status) of each processing node device can be determined, enabling the management node to adaptively control the number of concurrent video structured channels of each processing node device based on the real-time updated video channel saturation rate parameter.
[0037] A fourth aspect of this application provides a terminal device, including:
[0038] The first acquisition unit is used to acquire the video channel saturation rate parameters of each processing node device;
[0039] The determining unit is used to determine the target processing node device based on the video channel saturation rate parameter of each processing node device.
[0040] The distribution unit is used to distribute video structuring tasks to the target processing node devices for processing.
[0041] A fifth aspect of this application provides a terminal device, including:
[0042] The second acquisition unit is used to acquire the resolution information of the video data to be processed in the video structuring task when it receives the video structuring task issued by the management node device.
[0043] The update unit is used to update the video channel saturation parameter according to the resolution information of the video data to be processed;
[0044] The upload unit is used to upload the updated video channel saturation parameters to the management node device.
[0045] A sixth aspect of this application provides a video structuring platform, the video structuring platform including a management node device and a plurality of processing node devices, the management node device and the plurality of processing node devices being communicatively connected;
[0046] The management node device includes a first acquisition unit, a determination unit, and a distribution unit; wherein...
[0047] The first acquisition unit is used to acquire the video channel saturation rate parameters of each processing node device;
[0048] The determining unit is used to determine the target processing node device based on the video channel saturation rate parameter of each processing node device.
[0049] The distribution unit is used to distribute video structuring tasks to the target processing node device for processing;
[0050] The processing node device includes a second acquisition unit, an update unit, and an upload unit;
[0051] The second acquisition unit is used to acquire the resolution information of the video data to be processed in the video structuring task when it receives the video structuring task issued by the management node device;
[0052] The updating unit is used to update the video channel saturation parameter according to the resolution information of the video data to be processed.
[0053] The upload unit is used to upload the updated video channel saturation parameters to the management node device.
[0054] A seventh aspect of this application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the terminal device, wherein the processor executes the computer program to implement the steps of the video structured task management method provided in the first aspect.
[0055] An eighth aspect of this application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the terminal device. When the processor executes the computer program, it implements the steps of the video structuring task management method provided in the second aspect.
[0056] A ninth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the video structured task management method provided in the first aspect.
[0057] The tenth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the video structured task management method provided in the second aspect.
[0058] The eleventh aspect of this application provides a computer program product that, when run on a terminal device, causes the terminal device to execute each step of the video structured task management method described in any of the first aspects above.
[0059] The twelfth aspect of this application provides a computer program product that, when run on a terminal device, causes the terminal device to execute the steps of the video structured task management method described in any of the second aspects above.
[0060] The video structuring task management method, terminal device, and video structuring platform provided in this application have the following beneficial effects:
[0061] By using the video channel saturation rate parameter based on the processing node device to represent the load that different hardware acceleration devices can still bear, video structuring tasks for multi-resolution video data are allocated. This ensures that the load of each hardware acceleration device is balanced while preventing task backlog for individual hardware acceleration devices, thus guaranteeing that the video structuring platform can efficiently process video structuring tasks. This effectively solves the problem of some hardware acceleration devices being idle while others are heavily backed up with tasks in existing video structuring platforms, resulting in low overall processing performance and efficiency. Attached Figure Description
[0062] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0063] Figure 1 This is a schematic diagram of the architecture of a video structuring platform to which a video structuring task management method provided in this application embodiment is applicable;
[0064] Figure 2 This is a flowchart illustrating the implementation of a video structured task management method according to an embodiment of this application;
[0065] Figure 3 This is a schematic diagram illustrating the implementation process of a video structured task management method provided in another embodiment of this application;
[0066] Figure 4 This is a schematic diagram of the structure of a terminal device provided in one embodiment of this application;
[0067] Figure 5 This is a schematic diagram of the structure of a terminal device provided in another embodiment of this application;
[0068] Figure 6 This is a schematic diagram of the structure of a video structuring platform provided in one embodiment of this application;
[0069] Figure 7 This is a schematic diagram of the structure of a terminal device provided in another embodiment of this application. Detailed Implementation
[0070] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.
[0071] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.
[0072] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.
[0073] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."
[0074] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.
[0075] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0076] This application proposes a video structuring task management method that uses a video channel saturation rate parameter based on the processing node device to represent the load capacity of different hardware acceleration devices. This method allocates video structuring tasks for multi-resolution video data, ensuring load balancing across all hardware acceleration devices without causing task backlog for any single device. This guarantees efficient processing of video structuring tasks by the video structuring platform, effectively solving the problems of some hardware acceleration devices being idle while others are heavily burdened with tasks, resulting in low overall platform processing performance and efficiency in existing video structuring platforms.
[0077] Please see Figure 1 , Figure 1 This is a schematic diagram of the architecture of a video structuring platform provided in an embodiment of this application. In this embodiment, the video structuring platform 10 includes a management node device 11 and a plurality of processing node devices 12 connected to the management node device 11. The management node device 11 can receive video structuring tasks initiated by multiple video source devices 20, and the video structuring tasks include video data to be processed that needs to be structured.
[0078] It should be noted that the aforementioned video source device 20 can be used to capture video data or to store video data. For example, the aforementioned video source device can be a terminal device with video capture function, such as a camera, or a storage device (such as a hard disk or a cloud storage device) connected to the video capture terminal (camera) to store video data.
[0079] Among them, the management node device 11 is mainly used to schedule and manage the video structuring tasks initiated by each video source device, and distribute each video structuring task to each processing node device 12.
[0080] The processing node device 12 can perform video structuring processing on video structuring tasks, including decoding video files to obtain video data to be processed, and performing structuring processing on the video data to be processed.
[0081] In practical applications, decoding the video files in the aforementioned video structuring processing request can be achieved using function calls provided by the hardware acceleration device in the processing node device. For example, the aforementioned hardware acceleration device could be a computing accelerator card or other device capable of providing GPU resources.
[0082] In practical applications, the structuring of video data can be achieved by a video structuring engine in the processing node device. Structuring video data refers to the process of image analysis and key feature extraction of people or objects (including vehicles) in the video data, and then describing the characteristics of these people or objects through textual semantics. For example, when structuring people in video data is required, the gender, skin color, clothing, and posture features of the people in each frame of the video data can be extracted, and then these features can be described in text.
[0083] To provide a detailed explanation of the video structured task management method provided in this application, the following will be combined with... Figure 1 and Figure 2 Detailed explanation:
[0084] Please see Figure 2 , Figure 2 This diagram illustrates the implementation flow of the video structured task management method provided in this embodiment. The executing entity of the video structured task management method provided in this embodiment can be, for example: Figure 1 The video structuring platform shown.
[0085] like Figure 2 As shown, the above video structured task management method includes the following steps:
[0086] S11: The management node device obtains the video channel saturation rate parameters of each processing node device.
[0087] In this embodiment of the application, after receiving the video structuring tasks sent by each video source device, the management node device will uniformly manage and distribute the video structuring tasks. In order to ensure that each processing node device in the video structuring platform can achieve load balancing, it is necessary to determine the video channel saturation rate parameter of each processing node device at this time.
[0088] In this embodiment, each processing node device determines its current video stream saturation parameter based on the resolution information of the video data it is processing. Then, it feeds back its current video stream saturation parameter to the management node device in real time.
[0089] It should be noted that the above video channel saturation rate parameter can reflect the load status of the processing node equipment.
[0090] In practical applications, each processing node device determines its current video saturation parameter based on the resolution information of the video data it is processing. Each processing node device is connected to the management node device. Therefore, when the management node receives a video structuring task, it sends an instruction to each processing node device to obtain the video saturation parameter of each processing node device. After receiving the instruction, each processing node device sends its current video saturation parameter to the management node device.
[0091] S12: The management node device determines the target processing node device based on the video channel saturation rate parameter of each processing node device.
[0092] In this embodiment of the application, after the management node device obtains the video saturation parameters of each processing node device, it can determine the target processing node device based on the video saturation parameters of each processing node device.
[0093] In one embodiment of this application, S12 may include:
[0094] If the video channel saturation parameters of each processing node device are equal, then any processing node device is selected as the target processing node device.
[0095] If the video channel saturation rate parameters of each processing node device are not equal, then the processing node device with the largest video channel saturation rate parameter is selected as the target processing node device.
[0096] In this embodiment, after the management node device obtains the video saturation rate parameters of each processing node device, it first determines whether the video saturation rate parameters of each processing node device are equal. If they are all equal, any one processing node device is selected as the target processing node device. If they are not equal, the processing node device with the largest video saturation rate parameter is selected as the target processing node device.
[0097] S13: The management node device distributes the video structuring task to the target processing node device for processing.
[0098] In this embodiment of the application, once the target processing node is determined, the management node device sends the video structuring task to the target processing node device, which then performs structuring processing on the video data to be processed in the video structuring task.
[0099] In one embodiment of this application, the process of the target processing node device performing video structuring processing on the video data to be processed may include the following steps:
[0100] Decode the video files in the video structuring task to obtain the video data to be processed;
[0101] The video data to be processed is structured.
[0102] In practical applications, decoding the video files in the aforementioned video structuring task can be achieved using the function provided by an external hardware acceleration device.
[0103] It should be noted that structuring video data refers to the process of image analysis and key feature extraction of people or objects (including vehicles) in video data, and then describing the characteristics of people or objects through textual semantics. For example, when it is necessary to perform structuring processing on people in video data, the gender features, skin color features, clothing features, posture features, etc. of the people in each frame of the video data can be extracted, and then these features can be described in text.
[0104] S14: When the target processing node device receives the video structuring task issued by the management node device, it obtains the resolution information of the video data to be processed in the video structuring task.
[0105] It should be noted that the resolution of the video data acquired by each video source device is related to the acquisition parameters of that device. When a video source device acquires video data and initiates a video structuring processing request, it writes the relevant resolution information into the video structuring task. After receiving the video structuring task, the target processing node encapsulates and parses it to obtain the resolution information.
[0106] It should also be noted that existing parsing methods can be used to encapsulate and parse video structuring tasks, and will not be elaborated upon in the embodiments of this application.
[0107] S15: The target processing node device updates the video channel saturation parameter according to the resolution information of the video data to be processed.
[0108] In this embodiment of the application, after the target processing node device obtains the resolution information of the video data to be processed, it determines the current video saturation parameter based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum number of supported channels.
[0109] Specifically, the target processing node device can pre-set the video resolution reference value and the maximum number of channels it supports during initialization. When it needs to update its own video channel saturation parameters, it can directly read the aforementioned video resolution reference value and maximum number of channels supported.
[0110] In one embodiment of this application, S15 may include the following steps:
[0111] Obtain the video resolution reference value and the maximum number of supported channels; the video resolution reference value and the maximum number of supported channels are set by the processing node device during initialization;
[0112] The video stream saturation rate parameter is calculated based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum supported number of streams.
[0113] In practical applications, the calculation formula for determining the current video channel saturation parameter based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum supported number of channels is as follows:
[0114] ω=(1-(V resolution +V base )÷V max )×100%;
[0115] Where ω represents the video saturation parameter, V resolution This refers to the resolution information of the video data to be processed, V base V represents the reference value for video resolution. max Indicates the maximum number of supported paths.
[0116] S16: The target processing node device uploads the updated video channel saturation parameters to the management node device.
[0117] After the target processing node device determines the updated video stream saturation parameters, it will upload these parameters to the management node device. In other words, once the target processing node device updates its current video stream saturation parameters, it can automatically report these parameters to the management node device without waiting for instructions from the management node device. This ensures that the management node device can immediately grasp the load status of each processing node device and adaptively allocate video structuring tasks based on their respective load conditions.
[0118] As can be seen from the above, the video structuring task management method provided in this embodiment, proposed in this application, uses the video channel saturation rate parameter of the processing node device to represent the load that different hardware acceleration devices can still bear. It allocates video structuring tasks for multi-resolution video data, ensuring that no single hardware acceleration device has a backlog of tasks while maintaining a balanced load across all hardware acceleration devices. This ensures that the video structuring platform can efficiently process video structuring tasks, effectively solving the problem in existing video structuring platforms where some hardware acceleration devices are idle while others have a severe backlog of tasks, resulting in low overall platform processing performance and efficiency. Please refer to... Figure 3 , Figure 3 This is a schematic diagram illustrating the implementation flow of a video structured task management method provided in another embodiment of this application. For example... Figure 3 As shown, unlike the previous embodiment, the video structuring processing method provided in this application embodiment further includes the following steps:
[0119] S17: The management node device controls each processing node device to perform initialization operations.
[0120] In this embodiment of the application, before the video structuring platform begins video structuring processing, each processing node device can be controlled to perform initialization operations.
[0121] In this embodiment of the application, the initialization operation of the management node device controlling each processing node device may be to set the maximum number of supported channels, the video resolution reference value, and the initial video channel saturation rate parameter for each processing node device controlled by the management node device.
[0122] In practical applications, the management node device can set the maximum number of supported paths based on the data processing capabilities of each processing node device (e.g., GPU processing power, video memory size). It should be noted that the specifications of the hardware acceleration devices in different processing node devices may differ, and therefore the computing power they can provide (decoding capabilities and video memory size) will also vary. Therefore, the management node device can set the maximum number of supported paths for each processing node device based on its hardware parameters (i.e., the amount of video memory resources that the hardware acceleration devices can provide).
[0123] In practical applications, the management node device can also set a video resolution reference value based on the resolution of the video data collected (or stored) by the video source device connected to it.
[0124] Specifically, the aforementioned video resolution reference value can be set to the lowest resolution value among the video source devices connected to the management node. For example, if there are video source devices A (100W pixels / inch), B (200W pixels / inch), and C (500W pixels / inch) among the video source devices connected to the management node, then the video source device with the lowest resolution parameter is video source device A, and therefore the aforementioned video resolution reference value is set to 100W pixels / inch. It is understood that the aforementioned video resolution reference value can also be set according to other setting standards, such as directly setting the aforementioned video resolution reference value to a fixed value, for example, directly setting the aforementioned video resolution reference value to 200W pixels / inch. It should be noted that the above is only an example of setting the video resolution reference value and not a limitation.
[0125] In this embodiment of the application, the initial video saturation parameter can be set to 100%.
[0126] As can be seen from the above, the video structuring task management method provided in this application sets various parameters through initialization operations to determine the video channel saturation rate parameter (real-time load status) of each processing node device. This enables the management node to adaptively control the concurrent video structuring channel count of each processing node device based on the real-time updated video channel saturation rate parameter. This ensures that the load of each hardware acceleration device is balanced while ensuring that no single hardware acceleration device has a backlog of tasks. This guarantees that the video structuring platform can efficiently process video structuring tasks and effectively solves the problem of low overall processing performance and efficiency of existing video structuring platforms, where some hardware acceleration devices are idle while others have a serious backlog of tasks.
[0127] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0128] Please see Figure 4 , Figure 4 This is a structural block diagram of a terminal device provided in an embodiment of this application. The units included in this terminal device in this embodiment are used for performing... Figure 2 The corresponding embodiments describe the steps performed by the management node device. Please refer to [link / reference] for details. Figure 2 as well as Figure 2 The relevant descriptions in the corresponding embodiments are shown below. For ease of explanation, only the parts relevant to this embodiment are shown. See also... Figure 4 The terminal device 40 includes: a first acquisition unit 41, a determination unit 42, and a distribution unit 43. Wherein:
[0129] The first acquisition unit 41 is used to acquire the video channel saturation rate parameters of each processing node device;
[0130] The determining unit 42 is used to determine the target processing node device based on the video channel saturation rate parameter of each processing node device;
[0131] The distribution unit 43 is used to distribute the video structuring task to the target processing node device for processing.
[0132] As an embodiment of this application, the terminal device 40 further includes an initialization unit. Wherein:
[0133] The initialization unit is used to control the initialization operations of each processing node device.
[0134] As an embodiment of this application, the determining unit 42 includes a first selection unit and a second selection unit. Wherein:
[0135] The first selection unit is used to select any one of the processing node devices as the target processing node device if the video channel saturation parameters of each processing node device are equal.
[0136] The second selection unit is used to select the processing node device with the largest video saturation rate parameter as the target processing node device if the video saturation rate parameters of each processing node device are not equal.
[0137] Please see Figure 5 , Figure 5 This is a structural block diagram of another terminal device provided in an embodiment of this application. The units included in this terminal device in this embodiment are used for performing... Figure 2 The corresponding embodiment describes the steps performed by the processing node device. Please refer to [link / reference] for details. Figure 2 as well as Figure 2 The relevant descriptions in the corresponding embodiments are shown below. For ease of explanation, only the parts relevant to this embodiment are shown. See also... Figure 5 The terminal device 50 includes: a second acquisition unit 51, an update unit 52, and an upload unit 53. Wherein:
[0138] The second acquisition unit 51 is used to acquire the resolution information of the video data to be processed in the video structuring task when it receives the video structuring task issued by the management node device.
[0139] The update unit 52 is used to update the video channel saturation parameter according to the resolution information of the video data to be processed.
[0140] Upload unit 53 is used to upload the updated video channel saturation parameters to the management node device.
[0141] As an embodiment of this application, the update unit 52 includes a parameter acquisition unit and a calculation unit. Wherein:
[0142] The parameter acquisition unit is used to acquire the video resolution reference value and the maximum number of supported channels; the video resolution reference value and the maximum number of supported channels are set by the processing node device during initialization;
[0143] The calculation unit is used to calculate the video channel saturation rate parameter based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum supported number of channels.
[0144] Please see Figure 6 , Figure 6 This is a structural block diagram of another video structuring platform provided in this application embodiment. In this embodiment, the terminal device includes units used for execution... Figure 2 The steps performed in the corresponding embodiments are shown below. For ease of explanation, only the parts relevant to this embodiment are shown. See also Figure 5 The video structuring platform 60 includes: management node device 61 and processing node device 62.
[0145] Among them, the management node device 61 can be as follows: Figure 4 The terminal device shown, the processing node device 62 can be as follows: Figure 5 The terminal device shown.
[0146] The management node device 61 may include an initialization unit, a first acquisition unit, a determination unit, and a distribution unit. The processing node device 62 may include a second acquisition unit, an update unit, and an upload unit. Further details are omitted here.
[0147] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.
[0148] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0149] Figure 7 This is a structural block diagram of a terminal device provided in another embodiment of this application. For example... Figure 7 As shown, the terminal device 7 in this embodiment includes: a processor 70, a memory 71, and a computer program 72 stored in the memory 71 and executable on the processor 70, such as a program for a video structured task management method. When the processor 70 executes the computer program 72, it implements the steps in the various embodiments of the video structured task management methods described above, for example... Figure 2 As shown in S11 to S13, or as Figure 2 S14 to S16 are shown. Alternatively, the processor 70 implements the above when executing the computer program 72. Figure 4 The functions of each unit in the corresponding embodiments, or as follows: Figure 5 The functions of each unit in the corresponding embodiments, for example, Figure 4 The functions of units 41 to 43 shown are or Figure 5 For details on the functions of units 51 to 53 shown, please refer to [link / reference]. Figure 4 and Figure 5 The relevant descriptions in the corresponding embodiments are not repeated here.
[0150] For example, the computer program 72 may be divided into one or more units, which are stored in the memory 71 and executed by the processor 70 to complete this application. The one or more units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program 72 in the terminal device 7.
[0151] The terminal device may include, but is not limited to, a processor 70 and a memory 71. Those skilled in the art will understand that... Figure 7This is merely an example of terminal device 7 and does not constitute a limitation on terminal device 7. It may include more or fewer components than shown, or combine certain components, or different components. For example, the terminal device may also include input / output devices, network access devices, buses, etc.
[0152] The processor 70 may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.
[0153] The memory 71 can be an internal storage unit of the terminal device 7, such as a hard disk or memory of the terminal device 7. The memory 71 can also be an external storage device of the terminal device 7, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the terminal device 7. Furthermore, the memory 71 can include both internal storage units and external storage devices of the terminal device 71. The memory 71 is used to store the computer program and other programs and data required by the terminal device. The memory 71 can also be used to temporarily store data that has been output or will be output.
[0154] This application provides a computer program product that, when run on a mobile terminal, enables the mobile terminal to implement the steps described in the above-described method embodiments.
[0155] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a photographing device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.
[0156] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0157] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0158] In the embodiments provided in this application, it should be understood that the disclosed apparatus / network devices and methods can be implemented in other ways. For example, the apparatus / network device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.
[0159] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0160] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.
Claims
1. A video structured task management method, characterized in that, include: The video stream saturation rate parameter of each processing node device is obtained; the video stream saturation rate parameter is generated by each processing node device according to the resolution information of the video structured task it is processing; the video stream saturation rate parameter is used to reflect the load status of the processing node device; The target processing node device is determined based on the video channel saturation rate parameter of each processing node device. The step of determining the target processing node device based on the video channel saturation rate parameter of each processing node device includes: If the video channel saturation parameters of each processing node device are equal, then any processing node device is selected as the target processing node device. If the video channel saturation rate parameters of each processing node device are not equal, then the processing node device with the largest video channel saturation rate parameter is selected as the target processing node device. The video structuring task is distributed to the target processing node device for processing; Obtain the video resolution reference value and the maximum number of supported channels; the video resolution reference value and the maximum number of supported channels are set by the processing node device during initialization; The video stream saturation parameter is calculated based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum supported number of streams.
2. The video structured task management method according to claim 1, characterized in that, Also includes: Control each processing node device to perform initialization operations.
3. A video structured task management method, characterized in that, include: Upon receiving a video structuring task, the resolution information of the video data to be processed in the video structuring task is obtained; The video structuring task is issued by the management node device; The video stream saturation rate parameter is updated based on the resolution information of the video data to be processed; the video stream saturation rate parameter is used to reflect the load status of the processing node device. The step of updating the video channel saturation parameter based on the resolution information of the video data to be processed includes: Obtain the video resolution reference value and the maximum number of supported channels; the video resolution reference value and the maximum number of supported channels are set by the processing node device during initialization; Based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum supported number of channels, calculate the video channel saturation rate parameter; Upload the updated video channel saturation parameters to the management node device.
4. A video structured task management method, characterized in that, include: The management node device obtains the video channel saturation rate parameters of each processing node device; The video channel saturation rate parameter is used to reflect the load status of the processing node equipment. The management node device determines the target processing node device based on the video channel saturation rate parameter of each processing node device. The target processing node device is determined based on the video channel saturation rate parameters of each processing node device, including: If the video channel saturation parameters of each processing node device are equal, then any processing node device is selected as the target processing node device. If the video channel saturation rate parameters of each processing node device are not equal, then the processing node device with the largest video channel saturation rate parameter is selected as the target processing node device. The management node device distributes the video structuring task to the target processing node device for processing; When the target processing node device receives a video structuring task issued by the management node device, it obtains the resolution information of the video data to be processed in the video structuring task. The target processing node device updates the video channel saturation parameter according to the resolution information of the video data to be processed. The target processing node device uploads the updated video channel saturation rate parameters to the management node device; The step of updating the video channel saturation parameter based on the resolution information of the video data to be processed includes: Obtain the video resolution reference value and the maximum number of supported channels; the video resolution reference value and the maximum number of supported channels are set by the processing node device during initialization; The video stream saturation rate parameter is calculated based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum supported number of streams.
5. The video structured task management method according to claim 4, characterized in that, Also includes: The management node device controls each processing node device to perform initialization operations.
6. A video structuring platform, characterized in that, The video structuring platform includes a management node device and several processing node devices, which are communicatively connected. The management node device includes a first acquisition unit, a determination unit, and a distribution unit; wherein... The first acquisition unit is used to acquire the video saturation rate parameter of each processing node device; the video saturation rate parameter is used to reflect the load status of the processing node device; The determining unit is used to determine the target processing node device based on the video channel saturation rate parameter of each processing node device. The determining unit is used to select any processing node device as the target processing node device if the video saturation rate parameters of each processing node device are equal; and to select the processing node device with the largest video saturation rate parameter as the target processing node device if the video saturation rate parameters of each processing node device are not equal. The distribution unit is used to distribute video structuring tasks to the target processing node device for processing; The processing node device includes a second acquisition unit, an update unit, and an upload unit; The second acquisition unit is used to acquire the resolution information of the video data to be processed in the video structuring task when it receives the video structuring task issued by the management node device; The updating unit is used to update the video channel saturation parameter according to the resolution information of the video data to be processed; wherein, updating the video channel saturation parameter according to the resolution information of the video data to be processed includes: Obtain the video resolution reference value and the maximum number of supported channels; the video resolution reference value and the maximum number of supported channels are set by the processing node device during initialization; Based on the resolution information of the video data to be processed, the video resolution reference value, and the maximum supported number of channels, calculate the video channel saturation rate parameter; The upload unit is used to upload the updated video channel saturation parameters to the management node device.
7. A terminal device, characterized in that, The terminal device includes a memory, a processor, and a computer program stored in the memory and executable on the terminal device. When the processor executes the computer program, it implements the steps of the method as described in any one of claims 1 to 2.
8. A terminal device, characterized in that, The terminal device includes a memory, a processor, and a computer program stored in the memory and executable on the terminal device. When the processor executes the computer program, it implements the steps of the method as described in claim 3.