Distributed KVM seat control video storage method, device and equipment

Abstract

The embodiment of the invention discloses a seat control video storage method, device and equipment for a distributed KVM (Keyboard Video Mouse). The method is executed by a management node in a distributed KVM seat management system, the distributed KVM seat management system at least comprises the management node, at least one input node and at least one seat node, and the method comprises the following steps: acquiring picture change information of adjacent frames in a video stream acquired by a target input node determined by a target seat node; acquiring a current control state of the target seat node; and determining a storage state of a control video corresponding to the target input node controlled by the target seat node according to the picture change information and the current control state. According to the technical scheme, the video storage state can be determined and controlled in combination with the adjacent frame picture change information and the seat node control state, storage resources are greatly saved, and the labor cost of backtracking maintenance is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of video storage, and in particular to a distributed KVM seat control video storage method, device and equipment. Background Art

[0002] The distributed KVM agent management system uses a set of keyboards and mice to control multiple devices and achieve centralized management. KVM is a management device in the network. It is the first letter of the three words Keyboard, Video and Mouse. The system hardware consists of management nodes, input nodes, agent nodes and keyboards and mice. All non-management nodes are uniformly registered to the management node, and the services are configured through the platform software.

[0003] The platform configuration storage can call the video stream of the input node for real-time recording storage for maintenance personnel to call and retrieve. However, the input node recording time is long and occupies a lot of storage resources. The actual operation time of several hours of footage may only be a few minutes or seconds, and invalid footage is useless for maintenance backtracking.

[0004] In the related art, the input node is registered to the management platform, and the management platform requests the input node to continuously save the data to the storage resource. However, this solution is indiscriminate storage, which cannot distinguish between operation and non-operation screens and requires a large amount of storage resources. Summary of the invention

[0005] The present invention provides a distributed KVM seat control video storage method, device and equipment, which can determine the control video storage status by combining adjacent frame picture change information and seat node control status, greatly saving storage resources and reducing the labor cost of maintenance backtracking.

[0006] According to one aspect of the present invention, a distributed KVM seat control video storage method is provided, which is executed by a management node in a distributed KVM seat management system, wherein the distributed KVM seat management system includes at least a management node, at least one input node and at least one seat node, and the method includes:

[0007] Obtaining picture change information of adjacent frames in the video stream collected by the target input node determined by the target seat node;

[0008] Obtaining the current control state of the target agent node;

[0009] The storage state of the control video corresponding to the target input node controlled by the target agent node is determined according to the picture change information and the current control state.

[0010] According to another aspect of the present invention, a distributed KVM seat control video storage device is provided, which is configured in a distributed KVM seat management system, wherein the distributed KVM seat management system includes at least a management node, at least one input node and at least one seat node, and the device includes:

[0011] A picture change information determination module, used to obtain picture change information of adjacent frames in a video stream collected by a target input node determined by a target seat node;

[0012] A current control state determination module, used to obtain the current control state of the target agent node;

[0013] A storage state determination module is used to determine the storage state of the control video corresponding to the target input node controlled by the target seat node according to the picture change information and the current control state.

[0014] According to another aspect of the present invention, there is provided an electronic device, the electronic device comprising:

[0015] at least one processor; and

[0016] a memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the seat control video storage method of the distributed KVM described in any embodiment of the present invention.

[0018] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the distributed KVM seat control video storage method described in any embodiment of the present invention when executed.

[0019] The technical solution of the embodiment of the present invention first obtains the picture change information of adjacent frames in the video stream collected by the target input node determined by the target seat node; then obtains the current control state of the target seat node; and then determines the storage state of the control video corresponding to the target input node controlled by the target seat node based on the picture change information and the current control state. This technical solution can determine the storage state of the control video by combining the picture change information of adjacent frames and the control state of the seat node, which greatly saves storage resources and reduces the labor cost of maintenance backtracking.

[0020] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 This is a flow chart of a distributed KVM seat control video storage method provided according to the first embodiment of the present invention;

[0023] Figure 2 is a schematic diagram of adjacent I frames provided according to Embodiment 1 of the present invention;

[0024] Figure 3 This is a flow chart of a distributed KVM seat control video storage method provided in accordance with the second embodiment of the present invention;

[0025] Figure 4 This is a schematic diagram of the structure of a distributed KVM seat control video storage device provided according to Embodiment 3 of the present invention;

[0026] Figure 5 The invention is a schematic diagram of the structure of an electronic device for implementing a distributed KVM seat control video storage method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0028] It should be noted that the terms "first", "second", "target", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0029] Embodiment 1

[0030] Figure 1 This is a flow chart of a distributed KVM seat control video storage method provided in the first embodiment of the present invention. This embodiment is applicable to the case of effectively storing the seat control video of the distributed KVM. The method can be executed by a distributed KVM seat control video storage device. The distributed KVM seat control video storage device can be implemented in the form of hardware and / or software. The distributed KVM seat control video storage device can be configured in an electronic device with data processing capabilities. Figure 1 As shown, the method includes:

[0031] S110, obtaining picture change information of adjacent frames in a video stream collected by a target input node determined by a target seat node.

[0032] The technical solution of this embodiment can be executed by the management node in the distributed KVM agent management system, and the distributed KVM agent management system includes at least a management node, at least one input node and at least one agent node. Among them, the distributed KVM agent management system can refer to a multi-computer switching control system, which adopts a distributed architecture and is composed of input nodes, output nodes and keyboards and mice. Among them, the output node may include a management node and an agent node. Specifically, the input node may refer to an encoding device with HDMI data acquisition and USB signal transmission, which can be placed in the computer room together with the host to provide signal access. The agent node can be used as a remote control terminal in the distributed KVM agent management system, which can be connected to a keyboard and mouse, remotely control the host in the computer room, and has a decoding function. This technical solution can be applied to the target input node to collect the picture change information of adjacent frames in the video stream and the current control state of the target agent node, control the start and end time points of the stream storage request to the target input node, and selectively save the key operation screen.

[0033] In this embodiment, the target input node determined by the target agent node first acquires the picture change information of adjacent frames in the video stream collected by the target input node through the management node. The picture change information may include changes or no changes. Optionally, adjacent frames may also be video frames received continuously at adjacent times in the collected video stream; optionally, when the transmission encoding format of the collected video stream is H264 encoding, the corresponding adjacent frames are adjacent I frames. Specifically, the target input node first collects the original video stream of the input source such as the server, host or PC through the video line, and encodes the original video stream through the encoding module in the system. Exemplarily, during the encoding operation, the original video stream can be encoded into an I frame group by combining I frames, B frames and P frames. Figure 2 FIG. 1 is a schematic diagram of adjacent I frames provided in Embodiment 1 of the present invention. Figure 2 As shown, two adjacent I frame groups are shown in the figure, each I frame group can be expressed as IBBPBBP, and the I frames in the adjacent I frame groups are adjacent I frames. After the encoding is completed, the encoded I frame group can be sent to the multicast domain through the local area network by the encoding module.

[0034] When the target seat node turns on the viewing mode, it can join the multicast domain, start receiving the I frame group encoded by the target input node, and save the I frame group in a pre-set first buffer area. At the same time, the I frame group can be decoded by the seat decoding module in the system, and an I frame is extracted once every GOP and saved in a pre-set second buffer area. Among them, GOP can be understood as a group of continuous pictures, which can be used to characterize the I frame spacing corresponding to adjacent I frame groups. It should be noted that the cache space corresponding to the second buffer area can be used to cache two adjacent I frames. When the second buffer area is full, the first I frame in the second buffer area will be discarded according to the first-in-first-out principle, and the second I frame in the second buffer area will be written to the position of the first I frame, and the newly extracted I frame will be written to the position of the second I frame.

[0035] Then, the target seat node determines whether the two adjacent I frames in the second buffer are the same, and determines the picture change information of the adjacent frames in the video stream collected by the target input node according to the judgment result. Exemplarily, the pictures corresponding to the two adjacent I frames in the second buffer can be subtracted to obtain the picture difference information, and then the picture difference information is compared with the preset picture difference threshold, and the picture change information of the adjacent frames in the video stream collected by the target input node is determined according to the comparison result. Among them, the preset picture difference threshold can refer to a preset reference value of the picture difference information of two adjacent I frames, which can be set according to actual needs. Specifically, if the picture difference information is greater than the preset picture difference threshold, it indicates that the difference between the pictures corresponding to the two adjacent I frames is large, and at this time, it can be determined that the two adjacent I frames are not the same, thereby determining that the picture change information of the adjacent frames in the video stream collected by the target input node is changed; if the picture difference information is less than or equal to the preset picture difference threshold, it indicates that the difference between the pictures corresponding to the two adjacent I frames is small, and at this time, it can be determined that the two adjacent I frames are the same, thereby determining that the picture change information of the adjacent frames in the video stream collected by the target input node is unchanged.

[0036] Exemplarily, the pictures corresponding to the two I frames in the second buffer area can be binarized first, and then the similarity between the two binarized pictures can be calculated. If the calculated similarity is greater than the similarity threshold, it indicates that the pictures corresponding to the two adjacent I frames are relatively different. At this time, it can be determined that the two adjacent I frames are not the same, thereby determining that the picture change information of the adjacent frames in the video stream collected by the target input node has changed; if the calculated similarity is less than or equal to the similarity threshold, it indicates that the pictures corresponding to the two adjacent I frames are relatively different. At this time, it can be determined that the two adjacent I frames are the same, thereby determining that the picture change information of the adjacent frames in the video stream collected by the target input node has not changed. Among them, the similarity threshold is a pre-set similarity reference value, which can be set according to actual needs.

[0037] S120, obtaining the current control state of the target agent node.

[0038] In this embodiment, after obtaining the picture change information of adjacent frames in the video stream collected by the target input node determined by the target seat node, the management node is also required to obtain the current control state of the target seat node. Among them, the current control state can be understood as the control state at the current moment when the target seat node turns on the viewing mode, which can include being in control mode or not in control mode. Specifically, when the target seat node is in control mode, the video stream collected by the target input node can be remotely operated through the keyboard and mouse, such as modifying the viewing time node of the video stream or modifying the picture in the video stream, etc. If the picture content is a document, the document can be edited, etc.

[0039] S130, determining the storage state of the control video corresponding to the target input node controlled by the target seat node according to the picture change information and the current control state.

[0040] In this embodiment, after obtaining the screen change information and the current control state, the management node can further determine the storage state of the control video corresponding to the target input node controlled by the target agent node based on the screen change information and the current control state. Among them, the storage state may include being in the storage process or not being in the storage process. Exemplarily, the storage state of the control video corresponding to the target input node can be represented by setting a storage state flag (Flag). Specifically, when Flag=1, it indicates that it is in the storage process (i.e., the stream is being stored); when Flag=0, it indicates that it is not in the storage process (i.e., the stream is stopped and not stored). It should be noted that the initial state of the storage state flag is set to 0, that is, Flag=0.

[0041] In this embodiment, optionally, the storage status of the control video corresponding to the target input node controlled by the target seat node is determined based on the picture change information and the current control state, including: if the picture change information is changed and the current control state is in control mode, then determine whether the storage status of the control video corresponding to the target input node controlled by the target seat node is in the storage process; if not, modify the storage status and start the storage process for the control video; if so, keep the storage status unchanged, and continue to determine the storage status based on the picture change information of the next adjacent frame and the updated current control state.

[0042] In this embodiment, if it is determined that the picture change information is changed, and the current control state is in control mode, it indicates that the current control video picture belongs to the key operation picture, so it is necessary to store the control video corresponding to the target input node controlled by the target seat node. At this time, it is necessary to further determine whether the storage state of the control video corresponding to the target input node controlled by the target seat node is in the storage process. If it is not in the storage process, that is, Flag = 0, it indicates that the target input node is not enabled for storage. At this time, it is necessary to modify the storage state, that is, set Flag to 1, so as to start the storage process of the control video; if it is in the storage process, that is, Flag = 1, it indicates that the target input node is storing, and no intervention is required. At this time, it is only necessary to keep the storage state unchanged, and continue to determine the storage state according to the picture change information of the next adjacent frame and the updated current control state.

[0043] Through such a setting, this solution can quickly and accurately determine whether to start the storage process of the control video by judging the storage status of the control video corresponding to the target input node controlled by the target seat node when it is determined that the screen change information has changed and the current control state is in control mode, so as to maintain and trace back the key operation screen.

[0044] In this embodiment, optionally, the storage status of the control video corresponding to the target input node controlled by the target seat node is determined based on the picture change information and the current control status, including: if the picture change information shows that there is a change, and the current control status is not in control mode, the storage status is set to not in the storage process, the storage process of the control video is stopped, and the storage status is continued to be determined based on the picture change information of the next adjacent frame and the updated current control status.

[0045] In this embodiment, if the picture change information is determined to be changed, and the current control state is not in control mode, it indicates that the picture of the adjacent frame has changed, not because the target seat node controls the target input node, but because other seat nodes control the target input node. At this time, there is no need to store the control video corresponding to the target input node. Therefore, it is necessary to set the storage state to not be in the storage process, that is, set Flag to 0, so as to stop the storage process of the control video, and continue to determine the storage state according to the picture change information of the next adjacent frame and the updated current control state.

[0046] Through such a setting, this solution can stop the storage process of the control video by setting the storage state when it is determined that the picture change information has changed and the current control state is not in the control mode, thereby reducing the waste of storage resources.

[0047] In this embodiment, optionally, the storage status of the control video corresponding to the target input node controlled by the target seat node is determined based on the picture change information and the current control state, including: if the picture change information is unchanged and the current control state is the control mode, then judging whether the storage status of the control video corresponding to the target input node controlled by the target seat node is in the storage process; if so, then determining the cumulative number of adjacent frames during which the picture change information continues to be unchanged, and determining the storage status based on the cumulative number of adjacent frames; if not, keeping the storage status unchanged, and continuing to determine the storage status based on the picture change information of the next adjacent frame and the updated current control state.

[0048] In this embodiment, if it is determined that the picture change information is unchanged and the current control state is the control mode, in order to avoid the problem of frequent storage start and stop caused by the user's re-operation frequently triggering the key operation screen recognition, the recording will not be stopped within a short recording time (such as several GOP times). Therefore, it is necessary to further determine whether the storage state of the control video corresponding to the target input node of the target seat node is in the storage process, and determine the storage state according to the storage state judgment result.

[0049] Specifically, if it is in the storage process, that is, Flag = 1, it is necessary to determine the cumulative number of adjacent frames in which the picture change information continues to remain unchanged, and determine the storage state based on the cumulative number of adjacent frames. Among them, the cumulative number of adjacent frames can refer to the count of I frames that the second buffer area continues to receive after triggering non-critical operation picture recognition. Specifically, the initial cumulative number of adjacent frames is set to 0, and the cumulative number of adjacent frames will increase by 1 for each I frame received by the second buffer area, but if the critical operation picture recognition is triggered, the cumulative number of adjacent frames will be cleared.

[0050] In this embodiment, optionally, the storage status is determined based on the accumulated number of adjacent frames, including: if the accumulated number of adjacent frames is greater than or equal to a preset threshold, the storage status is modified, the storage process of the control video is stopped, and the storage status is continued to be determined based on the picture change information of the next adjacent frame and the updated current control status; if the accumulated number of adjacent frames is less than the preset threshold, the storage status is kept unchanged, and the storage status is continued to be determined based on the picture change information of the next adjacent frame and the updated current control status.

[0051] In this embodiment, after determining the number of cumulative adjacent frames during which the picture change information continues to be unchanged, the number of cumulative adjacent frames can be compared with a preset threshold, and then the storage state can be determined based on the comparison result. The preset threshold is a preset reference value of the number of cumulative adjacent frames, which can be set according to actual needs. Specifically, if the number of cumulative adjacent frames is greater than or equal to the preset threshold, it indicates that the picture change information continues to be unchanged for a long time, and it can be considered that the user has not operated the picture change during this period. At this time, the storage state needs to be modified, and the Flag is set to 0 to stop the storage process of the control video, and continue to determine the storage state according to the picture change information of the next adjacent frame and the updated current control state; if the number of cumulative adjacent frames is less than the preset threshold, it indicates that the picture change information continues to be unchanged for a short time, and the storage state is kept unchanged at this time, and the storage state is continued to be determined according to the picture change information of the next adjacent frame and the updated current control state. It should be noted that after each increase of 1 in the number of cumulative adjacent frames, it is necessary to determine the size relationship between the updated cumulative number of adjacent frames and the preset threshold.

[0052] If it is not in the storage process, that is, Flag=0, the storage state is kept unchanged, and the storage state is continuously determined according to the picture change information of the next adjacent frame and the updated current control state.

[0053] Through such a setting, the present solution can determine the storage state according to the accumulated number of adjacent frames in which the screen change information continues to be unchanged when it is determined that the screen change information is unchanged, the current control state is the control mode, and the storage state is in the storage process, thereby avoiding the problem of frequent storage start and stop caused by the user's frequent re-operation triggering the key operation screen recognition.

[0054] In this embodiment, optionally, the storage status of the control video corresponding to the target input node controlled by the target seat node is determined based on the picture change information and the current control status, including: if the picture change information is unchanged and the current control status is not in control mode, the storage status is kept unchanged, and the storage status is continued to be determined based on the picture change information of the next adjacent frame and the updated current control status.

[0055] In this embodiment, if it is determined that the picture change information is unchanged and the current control state is not in control mode, it indicates that there is no need to store the video corresponding to the target input node. At this time, the storage state is kept unchanged, that is, Flag=0, and the storage state is continued to be determined based on the picture change information of the next adjacent frame and the updated current control state.

[0056] Through such a setting, the present solution keeps the storage state unchanged when it is determined that the picture change information is unchanged and the current control state is not in the control mode, thereby reducing the waste of storage resources.

[0057] It should be noted that in the above implementation, if it is necessary to start the storage process of the control video, a start alarm event can be sent to the system through the management node, and the start alarm event carries the IP address of the target input node, and the system requests the target input node to start storage according to the IP address. If it is necessary to stop the storage process of the control video, a stop alarm event can be sent to the system through the management node, and the stop alarm event also carries the IP address of the target input node, and the system stops requesting storage to the target input node according to the IP address.

[0058] The technical solution of the embodiment of the present invention first obtains the picture change information of adjacent frames in the video stream collected by the target input node determined by the target seat node; then obtains the current control state of the target seat node; and then determines the storage state of the control video corresponding to the target input node controlled by the target seat node based on the picture change information and the current control state. This technical solution can determine the storage state of the control video by combining the picture change information of adjacent frames and the control state of the seat node, which greatly saves storage resources and reduces the labor cost of maintenance backtracking.

[0059] Embodiment 2

[0060] Figure 3 This is a flow chart of a distributed KVM seat control video storage method provided in Embodiment 2 of the present invention. This embodiment is optimized based on the above embodiment.

[0061] like Figure 3 As shown, the method of this embodiment specifically includes the following steps:

[0062] S210, obtaining picture change information of adjacent frames in a video stream collected by a target input node determined by a target seat node.

[0063] S220, obtaining the current control state of the target agent node.

[0064] S230, determining whether the screen change information indicates that there is a change, if so, executing S240, otherwise executing S290.

[0065] S240, clear the accumulated number of adjacent frames and determine whether the current control state is in the control mode, if so, execute S250, otherwise execute S280.

[0066] S250, determining whether the storage state of the control video corresponding to the target input node controlled by the target agent node is in the storage process, if so, executing S260, otherwise executing S270.

[0067] S260, keeping the storage state unchanged, and continuing to determine the storage state according to the picture change information of the next adjacent frame and the updated current control state.

[0068] S270, modifying the storage status and starting the storage process of the control video.

[0069] S280, setting the storage state to not being in the storage process, stopping the storage process of the control video, and continuing to determine the storage state according to the picture change information of the next adjacent frame and the updated current control state.

[0070] S290, determine whether the current control state is in the control mode, if so, execute S2100, otherwise execute S2130.

[0071] S2100, determining whether the storage status of the control video corresponding to the target input node controlled by the target agent node is in the storage process, if so, executing S2110, otherwise executing S2130.

[0072] S2110, determining the number of accumulated adjacent frames in which the picture change information continues to be unchanged, and determining whether the accumulated number of adjacent frames is less than a preset threshold, if not, executing S2120, and if so, executing S2130.

[0073] S2120, modifying the storage state, stopping the storage process of the control video, and continuing to determine the storage state according to the picture change information of the next adjacent frame and the updated current control state.

[0074] S2130, keeping the storage state unchanged, and continuing to determine the storage state according to the picture change information of the next adjacent frame and the updated current control state.

[0075] The technical solution of the embodiment of the present invention first obtains the picture change information of adjacent frames in the video stream collected by the target input node determined by the target seat node; then obtains the current control state of the target seat node; and then determines whether the storage state needs to be adjusted based on the picture change information and the current control state and the storage state of the control video corresponding to the target input node controlled by the target seat node. This technical solution can determine the storage state of the control video in combination with the picture change information of adjacent frames and the control state of the seat node, which greatly saves storage resources and reduces the labor cost of maintenance backtracking.

[0076] Embodiment 3

[0077] Figure 4 This is a structural diagram of a distributed KVM seat control video storage device provided in the third embodiment of the present invention. The device is configured in a distributed KVM seat management system. The distributed KVM seat management system includes at least a management node, at least one input node and at least one seat node. The device can execute the distributed KVM seat control video storage method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method. Figure 4 As shown, the device comprises:

[0078] The picture change information determination module 310 is used to obtain the picture change information of adjacent frames in the video stream collected by the target input node determined by the target seat node;

[0079] A current control state determination module 320 is used to obtain the current control state of the target agent node;

[0080] The storage state determination module 330 is used to determine the storage state of the control video corresponding to the target input node controlled by the target seat node according to the picture change information and the current control state.

[0081] Optionally, the storage state determination module 330 is used to:

[0082] If the picture change information indicates that there is a change, and the current control state is in control mode, then determining whether the storage state of the control video corresponding to the target input node controlled by the target seat node is in storage process;

[0083] If not, modify the storage state and start the storage process of the control video;

[0084] If so, the storage state is kept unchanged, and the storage state is continued to be determined according to the picture change information of the next adjacent frame and the updated current control state.

[0085] Optionally, the storage state determination module 330 is further configured to:

[0086] If the picture change information shows that there is a change and the current control state is not in the control mode, the storage state is set to not in the storage process, the storage process of the control video is stopped, and the storage state is continued to be determined based on the picture change information of the next adjacent frame and the updated current control state.

[0087] Optionally, the storage state determination module 330 includes:

[0088] A storage process judgment unit, configured to judge whether the storage state of the control video corresponding to the target input node controlled by the target seat node is in the storage process if the picture change information is unchanged and the current control state is the control mode;

[0089] A first storage state determining unit, configured to determine the number of accumulated adjacent frames during which the picture change information continues to remain unchanged, and determine the storage state according to the accumulated number of adjacent frames;

[0090] The second storage state determining unit is used to keep the storage state unchanged if it is not in the state, and continue to determine the storage state according to the picture change information of the next adjacent frame and the updated current control state.

[0091] Optionally, the first storage state determining unit is configured to:

[0092] If the accumulated number of adjacent frames is greater than or equal to a preset threshold, the storage state is modified, the storage process of the control video is stopped, and the storage state is continued to be determined according to the picture change information of the next adjacent frame and the updated current control state;

[0093] If the accumulated number of adjacent frames is less than a preset threshold, the storage state is kept unchanged, and the storage state is continuously determined according to the picture change information of the next adjacent frame and the updated current control state.

[0094] Optionally, the storage state determination module 330 is further configured to:

[0095] If the picture change information is unchanged and the current control state is not in the control mode, the storage state is kept unchanged, and the storage state is continuously determined according to the picture change information of the next adjacent frame and the updated current control state.

[0096] Optionally, the adjacent frames are adjacent I frames.

[0097] A distributed KVM seat control video storage device provided in an embodiment of the present invention can execute a distributed KVM seat control video storage method provided in any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method.

[0098] Embodiment 4

[0099] Figure 5 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0100] like Figure 5 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0101] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0102] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the seat control video storage method of the distributed KVM.

[0103] In some embodiments, the seat control video storage method of the distributed KVM can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the seat control video storage method of the distributed KVM described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to execute the seat control video storage method of the distributed KVM in any other appropriate manner (for example, by means of firmware).

[0104] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0105] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0106] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0107] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0108] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0109] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0110] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0111] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A distributed KVM seat control video storage method, characterized in that: The method is executed by a management node in a distributed KVM agent management system, wherein the distributed KVM agent management system includes at least a management node, at least one input node, and at least one agent node. The method includes: Obtaining picture change information of adjacent frames in the video stream collected by the target input node determined by the target seat node; Obtaining the current control state of the target agent node; The storage state of the control video corresponding to the target input node controlled by the target agent node is determined according to the picture change information and the current control state.

2. The method according to claim 1, characterized in that: Determining, according to the picture change information and the current control state, a storage state of a control video corresponding to the target input node controlled by the target agent node, including: If the picture change information indicates that there is a change, and the current control state is in control mode, then determining whether the storage state of the control video corresponding to the target input node controlled by the target seat node is in storage process; If not, modify the storage state and start the storage process of the control video; If so, the storage state is kept unchanged, and the storage state is continued to be determined according to the picture change information of the next adjacent frame and the updated current control state.

3. The method according to claim 1, characterized in that Determining, according to the picture change information and the current control state, a storage state of a control video corresponding to the target input node controlled by the target agent node, including: If the picture change information shows that there is a change and the current control state is not in the control mode, the storage state is set to not in the storage process, the storage process of the control video is stopped, and the storage state is continued to be determined based on the picture change information of the next adjacent frame and the updated current control state.

4. The method according to claim 1, characterized in that: Determining, according to the picture change information and the current control state, a storage state of a control video corresponding to the target input node controlled by the target agent node, including: If the picture change information is no change, and the current control state is the control mode, then determining whether the storage state of the control video corresponding to the target input node controlled by the target seat node is in the storage process; If yes, determining the number of accumulated adjacent frames during which the picture change information remains unchanged, and determining the storage state according to the accumulated number of adjacent frames; If not, the storage state is kept unchanged, and the storage state is continuously determined according to the picture change information of the next adjacent frame and the updated current control state.

5. The method according to claim 4, characterized in that Determining the storage state according to the accumulated number of adjacent frames includes: If the accumulated number of adjacent frames is greater than or equal to a preset threshold, the storage state is modified, the storage process of the control video is stopped, and the storage state is continued to be determined according to the picture change information of the next adjacent frame and the updated current control state; If the accumulated number of adjacent frames is less than a preset threshold, the storage state is kept unchanged, and the storage state is continuously determined according to the picture change information of the next adjacent frame and the updated current control state.

6. The method according to claim 1, characterized in that Determining, according to the picture change information and the current control state, a storage state of a control video corresponding to the target input node controlled by the target agent node, including: If the picture change information is unchanged and the current control state is not in the control mode, the storage state is kept unchanged, and the storage state is continuously determined according to the picture change information of the next adjacent frame and the updated current control state.

7. The method according to any one of claims 1 to 6, characterized in that: The adjacent frames are adjacent I frames.

8. A distributed KVM seat control video storage device, characterized in that: The device is configured in a distributed KVM agent management system, wherein the distributed KVM agent management system includes at least a management node, at least one input node and at least one agent node. The device includes: A picture change information determination module, used to obtain picture change information of adjacent frames in a video stream collected by a target input node determined by a target seat node; A current control state determination module, used to obtain the current control state of the target agent node; A storage state determination module is used to determine the storage state of the control video corresponding to the target input node controlled by the target seat node according to the picture change information and the current control state.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the seat-controlled video storage method of the distributed KVM according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the seat control video storage method of a distributed KVM according to any one of claims 1 to 7 when executed.

Images