Remote control method and system for high-definition cameras based on mobile APP

Abstract

The present invention relates to the technical field of surveillance cameras, and discloses a remote control method for a high-definition camera based on a mobile APP, comprising: judging whether there is a moving target in the current video frame, and if not, sending a freeze frame instruction; if so, judging whether there is a continuous motion area; if not, performing a motion area frame selection to obtain a motion window to be sent; if so, performing a motion area detection to obtain the current frame motion area, performing a motion area frame selection on the current video frame to obtain a compensation window to be sent and a target window to be sent, and displaying the motion window to be sent in a fit to obtain a moving fit frame; judging whether a remote control termination instruction is received, and if received, terminating the remote control. The present invention also proposes a remote control system, an electronic device, and a computer-readable storage medium for a high-definition camera based on a mobile APP. The present invention can solve the problem of low transmission efficiency in the current surveillance screen transmission.

Description

Technical Field

[0001] The present invention relates to the technical field of surveillance cameras, and in particular to a remote control method, system, electronic device and computer-readable storage medium for realizing a high-definition camera based on a mobile APP. Background Art

[0002] With the rapid development of mobile Internet, high-definition cameras have become essential equipment in homes, schools, shopping malls, etc. Currently, remote control of high-definition cameras in different locations using mobile apps has become a common application.

[0003] Currently, people often need to view and control remote video images through mobile APPs and remote high-definition cameras. When transmitting video surveillance images, a complete video frame is usually captured by a remote surveillance camera first, and then multiple continuous video frames are transmitted to the user's mobile APP in sequence for the user to view the surveillance images. Since the surveillance camera maintains the same monitoring angle most of the time, there are static areas in the picture, and the current picture transmission method often does not segment or classify the video frames, but simply transmits the captured video frames. Therefore, the current surveillance picture transmission has the problem of low transmission efficiency. Summary of the invention

[0004] The present invention provides a remote control method and system for a high-definition camera based on a mobile APP, and a computer-readable storage medium, the main purpose of which is to solve the problem of low transmission efficiency in the current monitoring image transmission.

[0005] To achieve the above object, the present invention provides a remote control method for a high-definition camera based on a mobile APP, comprising:

[0006] Receiving a remote control start instruction, and acquiring a current video frame and a previous video frame according to the remote control start instruction;

[0007] Determining whether there is a moving target in the current video frame according to the previous video frame;

[0008] If there is no moving target in the current video frame, a freeze frame instruction is sent to the pre-built mobile APP terminal;

[0009] If there is a moving target in the current video frame, determining whether there is a continuous motion area in the current video frame;

[0010] If the current video frame does not have a continuous motion area, a motion area frame is selected for the current video frame to obtain a motion window to be sent;

[0011] If there is a continuous motion area in the current video frame, predictive frame selection is performed on the current video frame using a pre-constructed predicted motion frame set to obtain an iterative window to be sent;

[0012] Eliminate the iterative window to be sent in the current video frame to obtain a current simplified video frame, and perform motion region detection on the current simplified video frame to obtain a current frame motion region;

[0013] Constructing a prediction compensation frame, a target motion frame and an initial prediction frame according to the motion region of the current frame, and selecting the motion region of the current video frame using the prediction compensation frame and the target motion frame to obtain a compensation window to be sent and a target window to be sent;

[0014] Calculate a continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and update the predicted motion frame set using the continuation adjustment value and the initial predicted frame;

[0015] Integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent to obtain a moving window to be sent;

[0016] Sending the moving window to be sent to the mobile APP end for fitting display to obtain a moving fitting frame;

[0017] Determine whether a remote control termination instruction is received;

[0018] If the remote control termination instruction is not received, return to the above step of receiving the remote control start instruction;

[0019] If a remote control termination command is received, the remote control is terminated, and the remote control of the high-definition camera based on the mobile APP is completed.

[0020] Optionally, the determining whether the current video frame has a continuous motion area includes:

[0021] Determine whether there is a historical moving target in the previous video frame;

[0022] If there is no historical moving target in the previous video frame, then there is no continuous moving area in the current video frame;

[0023] If there is a historical moving target in the previous video frame, determining whether there is a continuous moving target in the previous video frame that is the same as the moving target in the current video frame;

[0024] If the previous video frame does not have a continuous motion target that is the same as the motion target in the current video frame, then the current video frame does not have a continuous motion area;

[0025] If the previous video frame has a continuous motion target that is the same as the motion target in the current video frame, then the current video frame has a continuous motion area.

[0026] Optionally, the performing a motion region selection on the current video frame to obtain a motion window to be sent includes:

[0027] Performing inter-frame difference operation on the current video frame and the previous video frame to obtain a current frame motion area;

[0028] A motion region frame is selected for the motion region of the current frame to obtain a motion window to be sent.

[0029] Optionally, the predictive frame selection of the current video frame using a pre-built predicted motion frame set to obtain an iterative window to be sent includes:

[0030] Determining whether the continuous motion area is a preset single-target continuous area;

[0031] If the continued motion region is a single-target continued region, predictive frame selection is performed on the current video frame using the predicted motion frame in the predicted motion frame set to obtain an iterative window to be sent, the number of motion prediction frames in the predicted motion frame set is 1, and the number of iterative windows to be sent is 1;

[0032] If the continuous motion region is not a single target continuous region, determining whether the predicted motion frame sets overlap;

[0033] If the predicted motion frame sets do not overlap, then sequentially extracting preset target continuation regions from the continuation motion regions, identifying target continuation motion frames corresponding to the target continuation regions in the predicted motion frame sets, and predictively selecting the target continuation regions using the target continuation motion frames to obtain iterative windows to be sent, where the number of iterative windows to be sent is greater than 1;

[0034] If the predicted motion frame sets overlap, determining whether there is a preset unconnected continuation area in the continuation motion area;

[0035] If there is no unconnected continuation area in the continuation motion area, connecting and merging the predicted motion frames in the predicted motion frame set to obtain a connected prediction frame;

[0036] Using the connected prediction box to predictively select the continuous motion area, to obtain iterative windows to be sent, the number of the iterative windows to be sent is 1;

[0037] If there is a disconnected continuation area in the continuation motion area, identifying a disconnected motion frame corresponding to the disconnected continuation area in the prediction motion frame set, and predictively selecting the disconnected continuation area by using the disconnected motion frame to obtain a first iterative sending window, wherein the number of the first iterative sending windows is greater than or equal to 1;

[0038] The unconnected motion frame is removed from the predicted motion frame set to obtain a connected motion frame set, and the unconnected continuation region is removed from the continuation motion region to obtain a connected continuation region;

[0039] Performing connectivity fusion on the connected motion frame set to obtain a connected prediction frame, using the connected prediction frame to perform predictive frame selection on the connected continuation area to obtain a second iterative sending window, where the number of the second iterative sending windows is 1;

[0040] The first iteration sending window and the second iteration sending window are aggregated to obtain an iteration waiting-to-send window.

[0041] Optionally, removing the iterative to-be-sent window from the current video frame to obtain a current simplified video frame includes:

[0042] Identifying a window limit point set of the iterative window to be sent;

[0043] Identify the video frame pixel point of each window limit point in the window limit point set to obtain a video frame pixel point set;

[0044] The iterative window to be sent is eliminated in the current video frame according to the video frame pixel point set to obtain a current simplified video frame.

[0045] Optionally, constructing a prediction compensation frame, a target motion frame and an initial prediction frame according to the current frame motion region includes:

[0046] Extracting a window boundary of an iterative window to be sent in the current video frame;

[0047] Determine whether the current frame motion area intersects with the window boundary;

[0048] If the current frame motion area does not intersect with the window boundary, the prediction compensation frame is set to empty;

[0049] Identify a target boundary point set of the motion region of the current frame, and draw a boundary frame line through each target boundary point in the target boundary point set to obtain a first target boundary frame line set, wherein the boundary frame lines are horizontal and vertical;

[0050] Each target first boundary frame line in the target first boundary frame line set is moved outward according to the frame selection gap value to obtain a target second boundary frame line set;

[0051] Constructing the target motion frame according to the target second boundary frame line set;

[0052] Identify the orientation size set of the target motion frame, and query the initial prediction gap value in a pre-constructed orientation size-initial prediction table according to the orientation size set;

[0053] According to the initial prediction gap value, each target second boundary frame line in the target motion frame is moved outward to obtain an initial prediction frame;

[0054] If the current frame motion region intersects with the window boundary, identifying a compensation boundary point set of the current frame motion region;

[0055] Drawing a boundary line through each compensation boundary point in the compensation boundary point set to obtain a compensated first boundary line set;

[0056] Identify common boundary lines in the compensated first boundary line set, remove the common boundary lines from the compensated first boundary line set, and obtain a boundary line set to be moved outward, wherein the common boundary lines refer to boundary lines that overlap with the window boundary;

[0057] Each of the boundary frame lines to be moved outward in the boundary frame line set to be moved outward is moved outward according to the frame selection gap value to obtain a second compensation boundary frame line set;

[0058] The predicted compensation frame is constructed according to the common bounding frame line and the compensated second bounding frame line set.

[0059] Optionally, the calculating a continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and updating the predicted motion frame set by using the continuation adjustment value and an initial predicted frame, comprises:

[0060] Obtaining the azimuth growth rate of the compensation window to be sent of the iterative window to be sent;

[0061] Determining a continuous adjustment value according to the azimuth speed increase, wherein the continuous adjustment value includes an iterative compensation azimuth and an iterative azimuth compensation value;

[0062] The predicted motion frame to be adjusted corresponding to the iterative window to be sent is extracted from the predicted motion frame set, the predicted motion frame to be adjusted is adjusted using the continued adjustment value to obtain an iterative predicted motion frame, the predicted motion frame to be adjusted is replaced by the iterative predicted motion frame, and the initial predicted frame is added to the predicted motion frame set to complete the update of the predicted motion frame.

[0063] Optionally, the step of integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent to obtain a moving window to be sent includes:

[0064] Performing window-connected fusion on the iterative window to be sent and the compensation window to be sent to obtain a connected compensation window;

[0065] Determine whether there is a window handover between the target to-be-sent window and the connected compensation window;

[0066] If there is a window intersection between the target window to be sent and the connected compensation window, the target window to be sent is connected and merged with the connected compensation window to obtain a moving window to be sent;

[0067] If there is no window handover between the target window to be sent and the connectivity compensation window, the target window to be sent and the connectivity compensation window are aggregated to obtain a moving window to be sent.

[0068] Optionally, the sending of the moving window to be sent to the mobile APP end for fitting display to obtain a moving fitting frame includes:

[0069] Sending the moving window to be sent to the mobile APP end, and identifying a window limit point set of the moving window to be sent;

[0070] Extracting the last displayed video frame on the mobile APP end, and defining a set of pixel points to be aligned in the last displayed video frame according to the window limit point set;

[0071] The pixel values ​​of the pixel point set to be fitted are updated using the moving window to be sent to obtain a moving fitted frame.

[0072] In order to solve the above problems, the present invention also provides a remote control system for a high-definition camera based on a mobile APP, the system comprising:

[0073] A freeze frame instruction sending module is used to receive a remote control start instruction, obtain a current video frame and a previous video frame according to the remote control start instruction; determine whether there is a moving target in the current video frame according to the previous video frame; if there is no moving target in the current video frame, send a freeze frame instruction to a pre-built mobile APP terminal;

[0074] A continuous motion region determination module, configured to determine whether there is a continuous motion region in the current video frame if there is a moving target in the current video frame;

[0075] A motion region classification frame selection module is used to perform motion region frame selection on the current video frame to obtain a motion window to be sent if there is no continuous motion region in the current video frame; if there is a continuous motion region in the current video frame, perform predictive frame selection on the current video frame using a pre-constructed predicted motion frame set to obtain an iterative window to be sent; remove the iterative window to be sent from the current video frame to obtain a current simplified video frame, perform motion region detection on the current simplified video frame to obtain a current frame motion region; construct a predicted compensation frame, a target motion frame and an initial predicted frame according to the current frame motion region, respectively use the predicted compensation frame and the target motion frame to perform motion region frame selection on the current video frame to obtain a compensated window to be sent and a target window to be sent; calculate a continuation adjustment value according to the iterative window to be sent and the compensated window to be sent, and update the predicted motion frame set using the continuation adjustment value and the initial predicted frame; integrate the iterative window to be sent, the compensated window to be sent and the target window to be sent to obtain a motion window to be sent;

[0076] A moving window to be sent pasting module, used for sending the moving window to be sent to the mobile APP end for pasting display, and obtaining a moving pasting frame;

[0077] The termination instruction reception judgment module is used to judge whether a remote control termination instruction is received; if the remote control termination instruction is not received, return to the above step of receiving the remote control start instruction; if the remote control termination instruction is received, terminate the remote control.

[0078] In order to solve the above problem, the present invention further provides an electronic device, the electronic device comprising:

[0079] at least one processor; and,

[0080] a memory communicatively connected to the at least one processor; wherein,

[0081] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to implement the above-mentioned remote control method of a high-definition camera based on a mobile APP.

[0082] In order to solve the above problems, the present invention also provides a computer-readable storage medium, in which at least one instruction is stored. The at least one instruction is executed by a processor in an electronic device to implement the above-mentioned remote control method of a high-definition camera based on a mobile APP. Compared with the phenomenon described in the background technology, the embodiment of the present invention divides and classifies the current video frame, and then displays the segmented motion window to be sent in combination with the previous video frame to obtain a moving frame, thereby greatly improving the transmission efficiency of the current video frame. First, it is necessary to receive a remote control start instruction, obtain the current video frame and the previous video frame according to the remote control start instruction, and then determine whether the current video frame has a moving target. If the current video frame does not have a moving target, a freeze frame instruction is sent to a pre-built mobile APP terminal. If there is a moving target, it is necessary to further determine whether the current video frame has a continuous motion area. If the current video frame does not have a continuous motion area, the current video frame can be directly framed to obtain a motion window to be sent. If the current video frame has a continuous motion area, in order to improve the frame selection efficiency of the moving target, the current video frame can be predictively framed using a pre-built predicted motion frame set to obtain an iterative window to be sent. Since the iterative window to be sent may still have incomplete frame selection or multiple moving targets, it is necessary to remove the iterative window to be sent in the current video frame. to the current simplified video frame, perform motion region detection on the current simplified video frame to obtain the current frame motion region, then construct a prediction compensation frame, a target motion frame and an initial prediction frame according to the current frame motion region, respectively use the prediction compensation frame and the target motion frame to select the motion region of the current video frame to obtain a compensation window to be sent and a target window to be sent, finally calculate a continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and use the continuation adjustment value and the initial prediction frame to update the prediction motion frame set. At this time, by integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent, the motion window to be sent can be obtained. Since the motion window to be sent includes all the moving targets in the current video frame, the motion window to be sent is sent to the mobile APP end for fitting display. At this time, a mobile fitting frame is obtained and the screen of the mobile APP end is displayed. Finally, since the mobile fitting frame is only a video frame, it is necessary to determine whether a remote control termination instruction is received. If the remote control termination instruction is not received, return to the above-mentioned step of receiving the remote control start instruction. If the remote control termination instruction is received, the remote control is terminated. Therefore, the method, system, electronic device and computer-readable storage medium for remotely controlling a high-definition camera based on a mobile APP proposed in the present invention can solve the problem of low transmission efficiency in the current monitoring image transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0083] Figure 1 A flowchart of a method for remotely controlling a high-definition camera based on a mobile APP provided in one embodiment of the present invention;

[0084] Figure 2 A functional module diagram of a remote control system for a high-definition camera based on a mobile APP provided in one embodiment of the present invention;

[0085] Figure 3 A schematic diagram of the structure of an electronic device for implementing the method for remotely controlling a high-definition camera based on a mobile APP provided in one embodiment of the present invention.

[0086] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments. DETAILED DESCRIPTION

[0087] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0088] The embodiment of the present application provides a remote control method for a high-definition camera based on a mobile APP. The execution subject of the remote control method for a high-definition camera based on a mobile APP includes but is not limited to at least one of the electronic devices such as a server and a terminal that can be configured to execute the method provided by the embodiment of the present application. In other words, the remote control method for a high-definition camera based on a mobile APP can be executed by software or hardware installed on a terminal device or a server device. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc.

[0089] Embodiment 1:

[0090] Reference Figure 1 FIG. 1 is a flow chart of a method for remotely controlling a high-definition camera based on a mobile APP according to an embodiment of the present invention. In this embodiment, the method for remotely controlling a high-definition camera based on a mobile APP includes:

[0091] S1. Receive a remote control start instruction, and obtain a current video frame and a previous video frame according to the remote control start instruction.

[0092] It can be explained that the remote control instruction can be a monitoring voice call instruction or a monitoring screen viewing instruction initiated by the user's mobile APP. The current video frame is the screen captured by the monitoring camera at the current moment, and the previous video frame is the previous video frame of the current video frame captured by the monitoring camera.

[0093] S2. Determine whether there is a moving target in the current video frame according to the previous video frame.

[0094] Furthermore, the moving target refers to a target that moves or causes a change in the picture, for example, a person walking, a light beam changing, an object moving, etc. in the monitoring picture.

[0095] If there is no moving target in the current video frame, execute S3 and send a freeze frame instruction to the pre-built mobile APP terminal.

[0096] It can be understood that the freeze frame instruction refers to an instruction to maintain the current video frame displayed in the mobile APP end as the previous video frame unchanged.

[0097] If there is a moving object in the current video frame, execute S4 to determine whether there is a continuous motion area in the current video frame.

[0098] Furthermore, the continuous motion area refers to the area in the current video frame where the moving target continues to change in the previous video frame and the current video frame. For example, in the previous video frame of the monitoring screen, there is a person walking, and when the person walks to the moment corresponding to the current video frame, the screen area occupied by the person will change, and the screen area is the continuous motion area. The non-continuous motion area refers to the area of ​​the current video frame occupied by the moving target that appears for the first time in the current video frame. For example, in the previous video frame, there is a balloon hanging on the wall, and in the current video frame, the balloon explodes (no picture changes occur in other positions), then the current video frame does not have a continuous motion area. For another example, if a person walks into the monitoring screen, then when the current video frame is the first picture frame that captures the person, the current video frame does not have a continuous motion area.

[0099] In the embodiment of the present invention, determining whether the current video frame has a continuous motion area includes:

[0100] Determine whether there is a historical moving target in the previous video frame;

[0101] If there is no historical moving target in the previous video frame, then there is no continuous moving area in the current video frame;

[0102] If there is a historical moving target in the previous video frame, determining whether there is a continuous moving target in the previous video frame that is the same as the moving target in the current video frame;

[0103] If the previous video frame does not have a continuous motion target that is the same as the motion target in the current video frame, then the current video frame does not have a continuous motion area;

[0104] If the previous video frame has a continuous motion target that is the same as the motion target in the current video frame, then the current video frame has a continuous motion area.

[0105] It can be explained that the historical moving target refers to the moving target captured by the monitoring before the current moment. The continuous moving target that is the same as the moving target in the current video frame refers to the same moving target, for example, the same moving person in the previous video frame and the current video frame is the same moving target, and different moving people in the previous video frame and the current video frame are different moving targets.

[0106] If the current video frame does not have a continuous motion area, then S5 is executed to select a motion area on the current video frame to obtain a motion window to be sent.

[0107] It should be understood that the motion window to be sent refers to a video window in which a motion area in the current video frame is framed and waits to be sent.

[0108] In the embodiment of the present invention, the step of selecting a motion region of the current video frame to obtain a motion window to be sent includes:

[0109] Performing inter-frame difference operation on the current video frame and the previous video frame to obtain a current frame motion area;

[0110] A motion region frame is selected for the motion region of the current frame to obtain a motion window to be sent.

[0111] It can be understood that the inter-frame difference operation refers to a video frame difference operation performed on the current video frame and the previous video frame using an inter-frame difference method. The inter-frame difference operation is a prior art and will not be described in detail herein.

[0112] It should be understood that the current frame motion area refers to the area where there is picture change in the previous video frame and the current video frame. For example: when the same moving person exists in the previous video frame and the current video frame, first obtain the picture area (human-shaped area) occupied by the walking person in the previous video frame and the current video frame, then identify the pixel point position set of the picture area in the previous video frame, and then frame the picture area in the current video frame, but the pixel point set needs to be included in the frame selection process to obtain the moving window to be sent. It should be noted that since the window border of the moving window to be sent is horizontal and vertical, in order to ensure that the window border does not touch the picture area, the window border of the moving window to be sent needs to be a certain distance away from the boundary point of the picture area, see S8 for details.

[0113] If there is a continuous motion area in the current video frame, execute S6, use the pre-built predicted motion frame set to perform predictive frame selection on the current video frame to obtain an iterative window to be sent.

[0114] It can be explained that the predicted motion frame set refers to a set of frame frames set according to the speed of change of the size of the continuous motion region in the previous video frame and the current video frame. Since there may be multiple continuous motion regions in the current video frame, multiple predicted motion frames need to be set. See S9 for details.

[0115] In the embodiment of the present invention, the predictive frame selection of the current video frame using the pre-constructed predicted motion frame set to obtain the iterative window to be sent includes:

[0116] Determining whether the continuous motion area is a preset single-target continuous area;

[0117] If the continued motion region is a single-target continued region, predictive frame selection is performed on the current video frame using the predicted motion frame in the predicted motion frame set to obtain an iterative window to be sent, the number of motion prediction frames in the predicted motion frame set is 1, and the number of iterative windows to be sent is 1;

[0118] If the continuous motion region is not a single target continuous region, determining whether the predicted motion frame sets overlap;

[0119] If the predicted motion frame sets do not overlap, then sequentially extracting preset target continuation regions from the continuation motion regions, identifying target continuation motion frames corresponding to the target continuation regions in the predicted motion frame sets, and predictively selecting the target continuation regions using the target continuation motion frames to obtain iterative windows to be sent, where the number of iterative windows to be sent is greater than 1;

[0120] If the predicted motion frame sets overlap, determining whether there is a preset unconnected continuation area in the continuation motion area;

[0121] If there is no unconnected continuation area in the continuation motion area, connecting and merging the predicted motion frames in the predicted motion frame set to obtain a connected prediction frame;

[0122] Using the connected prediction box to predictively select the continuous motion area, to obtain iterative windows to be sent, the number of the iterative windows to be sent is 1;

[0123] If there is a disconnected continuation area in the continuation motion area, identifying a disconnected motion frame corresponding to the disconnected continuation area in the prediction motion frame set, and predictively selecting the disconnected continuation area by using the disconnected motion frame to obtain a first iterative sending window, wherein the number of the first iterative sending windows is greater than or equal to 1;

[0124] The unconnected motion frame is removed from the predicted motion frame set to obtain a connected motion frame set, and the unconnected continuation region is removed from the continuation motion region to obtain a connected continuation region;

[0125] Performing connectivity fusion on the connected motion frame set to obtain a connected prediction frame, using the connected prediction frame to perform predictive frame selection on the connected continuation area to obtain a second iterative sending window, where the number of the second iterative sending windows is 1;

[0126] The first iteration sending window and the second iteration sending window are aggregated to obtain an iteration waiting-to-send window.

[0127] It can be explained that the single target continuation area refers to a single continuous motion area, for example, there is only one person walking in the current video frame. The iterative window to be sent refers to the window to be sent selected according to the predicted motion frame. When the continuous motion area is not a single target continuation area, since the predicted motion frame set may overlap, for example, there are two people walking closely in the current video frame, the predicted motion frame set will overlap.

[0128] Further, the unconnected region refers to a continuous motion region without connected contact. The connected prediction frame refers to a large prediction motion frame obtained by connecting and merging the prediction motion frames of each continuous motion region. For example, when the four pixel corner point coordinates of the first prediction motion frame are (2, 5), (2, 7), (4, 5), (4, 7), and the four pixel corner point coordinates of the second prediction motion frame are (3, 6), (3, 8), (6, 6), (6, 8) (pixel corner points refer to the four right-angle vertices of the prediction motion frame), the acquisition process of the connected prediction frame is: firstly, the intersection points (4, 6) and (3, 7) of the first prediction motion frame and the second prediction motion frame are calculated, and then the coordinates of the corner points of the connected prediction frame are determined according to the two intersection points and their respective pixel corner points as (2, 5), (2, 7), (4, 5) (three pixel corner point coordinates of the first prediction motion frame); (3, 8), (6, 6), (6, 8) (three pixel corner point coordinates of the second prediction motion frame) and (4, 6), (3, 7). If there are unconnected continuous areas in the continuous motion area, the connection and fusion are similar, which will not be described in detail here.

[0129] S7. Eliminate the iterative window to be sent from the current video frame to obtain a current simplified video frame, and perform motion region detection on the current simplified video frame to obtain a current frame motion region.

[0130] It can be explained that since the iterative window to be sent is the area determined to be sent in the current video frame, it does not need to be processed further, so it needs to be eliminated in the current video frame and the previous video frame. The motion area detection refers to the detection of the screen area of ​​the moving target, which can be calculated using the inter-frame difference method and the background difference method. For example: using the inter-frame difference method, the motion area detection is performed based on the previous video frame and the current simplified video frame.

[0131] In the embodiment of the present invention, removing the iterative to-be-sent window from the current video frame to obtain the current simplified video frame includes:

[0132] Identifying a window limit point set of the iterative window to be sent;

[0133] Identify the video frame pixel point of each window limit point in the window limit point set to obtain a video frame pixel point set;

[0134] The iterative window to be sent is eliminated in the current video frame according to the video frame pixel point set to obtain a current simplified video frame.

[0135] It can be explained that the window limit point set refers to a set of vertices of the window in the iterative window to be sent. For example, when the iterative window to be sent is a square, the window limit point set refers to a set of four vertices.

[0136] S8. Construct a prediction compensation frame, a target motion frame and an initial prediction frame according to the motion region of the current frame, and use the prediction compensation frame and the target motion frame to select the motion region of the current video frame to obtain a compensation window to be sent and a target window to be sent.

[0137] It can be explained that the prediction compensation frame refers to the compensation sending window of the iterative window to be sent. Since the iterative window to be sent may not be able to completely capture the same moving target, the prediction compensation frame can be used for further selection. The target motion frame refers to other non-continuous motion areas appearing in the current frame motion area, and the initial prediction frame refers to the first motion prediction frame of the target motion frame.

[0138] In the embodiment of the present invention, the step of constructing a prediction compensation frame, a target motion frame and an initial prediction frame according to the current frame motion region includes:

[0139] Extracting a window boundary of an iterative window to be sent in the current video frame;

[0140] Determine whether the current frame motion area intersects with the window boundary;

[0141] If the current frame motion area does not intersect with the window boundary, the prediction compensation frame is set to empty;

[0142] Identify a target boundary point set of the motion region of the current frame, and draw a boundary frame line through each target boundary point in the target boundary point set to obtain a first target boundary frame line set, wherein the boundary frame lines are horizontal and vertical;

[0143] Each target first boundary frame line in the target first boundary frame line set is moved outward according to the frame selection gap value to obtain a target second boundary frame line set;

[0144] Constructing the target motion frame according to the target second boundary frame line set;

[0145] Identify the orientation size set of the target motion frame, and query the initial prediction gap value in a pre-constructed orientation size-initial prediction table according to the orientation size set;

[0146] According to the initial prediction gap value, each target second boundary frame line in the target motion frame is moved outward to obtain an initial prediction frame;

[0147] If the current frame motion region intersects with the window boundary, identifying a compensation boundary point set of the current frame motion region;

[0148] Drawing a boundary line through each compensation boundary point in the compensation boundary point set to obtain a compensated first boundary line set;

[0149] Identify common boundary lines in the compensated first boundary line set, remove the common boundary lines from the compensated first boundary line set, and obtain a boundary line set to be moved outward, wherein the common boundary lines refer to boundary lines that overlap with the window boundary;

[0150] Each of the boundary frame lines to be moved outward in the boundary frame line set to be moved outward is moved outward according to the frame selection gap value to obtain a second compensation boundary frame line set;

[0151] The predicted compensation frame is constructed according to the common bounding frame line and the compensated second bounding frame line set.

[0152] It can be explained that the window boundary refers to the frame selection frame of the iterative window to be sent. If the current frame motion area does not intersect with the window boundary, it means that the iterative window to be sent has completely captured the same moving target, so there is no need for a prediction compensation frame to further select the moving target, so the prediction compensation frame is set to empty. The frame selection gap value refers to the outward displacement distance of the first boundary frame line of the target, for example, 5 pixels. The orientation dimension set refers to the horizontal and vertical frame line dimensions of the target motion frame. For example: when the coordinates of the four corner points of the target motion frame are (2, 5), (2, 7), (4, 5), and (4, 7), the orientation dimension set is a horizontal distance of 2 pixels and a vertical distance of 2 pixels.

[0153] Furthermore, in order to more accurately estimate the accuracy of the initial prediction frame in selecting the next video frame of the current video frame, the size of the initial prediction frame in each orientation can be set according to the size of the target motion frame in each orientation. For example, when the orientation size set is a horizontal distance of 10,000 pixels and a vertical distance of 80,000 pixels, it means that the object in the target motion frame is relatively large and may be a person. Therefore, the size of the initial prediction frame in each orientation is set by considering the displacement speed of the person. When the orientation size set is a horizontal distance of 50 pixels and a vertical distance of 50 pixels, the object in the target motion frame is relatively small and may be a ping-pong ball. Therefore, the size of the initial prediction frame in each orientation is set by considering the displacement speed of the ping-pong ball. Therefore, the orientation size-initial prediction table can be constructed for query.

[0154] It should be explained that the common boundary line refers to the line shared by the first compensation boundary line set and the window boundary.

[0155] S9, calculating a continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and updating the predicted motion frame set using the continuation adjustment value and the initial predicted frame.

[0156] It can be understood that the continuation adjustment value refers to a size adjustment value for adjusting the compensation window to be sent.

[0157] In the embodiment of the present invention, the calculating of the continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and updating the predicted motion frame set using the continuation adjustment value and the initial predicted frame include:

[0158] Obtaining the azimuth growth rate of the compensation window to be sent of the iterative window to be sent;

[0159] Determining a continuous adjustment value according to the azimuth speed increase, wherein the continuous adjustment value includes an iterative compensation azimuth and an iterative azimuth compensation value;

[0160] The predicted motion frame to be adjusted corresponding to the iterative window to be sent is extracted from the predicted motion frame set, the predicted motion frame to be adjusted is adjusted using the continued adjustment value to obtain an iterative predicted motion frame, the predicted motion frame to be adjusted is replaced by the iterative predicted motion frame, and the initial predicted frame is added to the predicted motion frame set to complete the update of the predicted motion frame.

[0161] It can be explained that the azimuth growth rate refers to the speed of increase of the size of the compensation window to be sent in each azimuth (horizontally and vertically). For example, when the horizontal size of the compensation window to be sent in the previous video frame is 5 pixels and the vertical size is 10 pixels, the horizontal size of the compensation window to be sent in the current video frame is 8 pixels and the vertical size is 15 pixels, and the horizontal size of the compensation window to be sent in the next video frame is 12 pixels and the vertical size is 20 pixels, then a size change curve can be drawn according to 5, 8, 12 or 10, 15, 20, and the slope is calculated to obtain the azimuth growth rate. The iterative compensation azimuth can be an iterative horizontal compensation azimuth and an iterative vertical compensation azimuth. The iterative azimuth compensation value can be adaptively determined according to the azimuth growth rate in each azimuth.

[0162] S10, integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent to obtain a moving window to be sent.

[0163] In the embodiment of the present invention, the step of integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent to obtain the moving window to be sent includes:

[0164] Performing window-connected fusion on the iterative window to be sent and the compensation window to be sent to obtain a connected compensation window;

[0165] Determine whether there is a window handover between the target to-be-sent window and the connected compensation window;

[0166] If there is a window intersection between the target window to be sent and the connected compensation window, the target window to be sent is connected and merged with the connected compensation window to obtain a moving window to be sent;

[0167] If there is no window handover between the target window to be sent and the connectivity compensation window, the target window to be sent and the connectivity compensation window are aggregated to obtain a moving window to be sent.

[0168] It can be explained that the window handover means that there is a window intersection between the target to-be-sent window and the connectivity compensation window.

[0169] S11, sending the moving window to be sent to the mobile APP end for fitting display to obtain a moving fitting frame.

[0170] It can be explained that the moving fit frame refers to a video display frame obtained by fitting the moving window to be sent to the previous video frame according to the corresponding corner point coordinates on the mobile APP side.

[0171] In the embodiment of the present invention, the step of sending the moving window to be sent to the mobile APP end for fitting display to obtain a moving fitting frame includes:

[0172] Sending the moving window to be sent to the mobile APP end, and identifying a window limit point set of the moving window to be sent;

[0173] Extracting the last displayed video frame on the mobile APP end, and defining a set of pixel points to be aligned in the last displayed video frame according to the window limit point set;

[0174] The pixel values ​​of the pixel point set to be fitted are updated using the moving window to be sent to obtain a moving fitted frame.

[0175] S12: Determine whether a remote control termination instruction is received.

[0176] It can be explained that the remote control termination instruction can be an application exit instruction input by the user on the mobile APP side, a camera rotation instruction, etc.

[0177] If the remote control termination instruction is not received, the process returns to the above step of receiving the remote control start instruction.

[0178] If a remote control termination instruction is received, S13 is executed to terminate the remote control, thereby completing the remote control of the high-definition camera based on the mobile APP.

[0179] Compared with the phenomenon described in the background technology, the embodiment of the present invention divides and classifies the current video frame, and then displays the segmented motion window to be sent in combination with the previous video frame to obtain a moving frame, thereby greatly improving the transmission efficiency of the current video frame. First, it is necessary to receive a remote control start instruction, obtain the current video frame and the previous video frame according to the remote control start instruction, and then determine whether the current video frame has a moving target. If the current video frame does not have a moving target, a freeze frame instruction is sent to a pre-built mobile APP terminal. If there is a moving target, it is necessary to further determine whether the current video frame has a continuous motion area. If the current video frame does not have a continuous motion area, the current video frame can be directly framed to obtain a motion window to be sent. If the current video frame has a continuous motion area, in order to improve the frame selection efficiency of the moving target, the current video frame can be predictively framed using a pre-built predicted motion frame set to obtain an iterative window to be sent. Since the iterative window to be sent may still have incomplete frame selection or multiple moving targets, it is necessary to remove the iterative window to be sent in the current video frame. to the current simplified video frame, perform motion region detection on the current simplified video frame to obtain the current frame motion region, then construct a prediction compensation frame, a target motion frame and an initial prediction frame according to the current frame motion region, respectively use the prediction compensation frame and the target motion frame to select the motion region of the current video frame to obtain a compensation window to be sent and a target window to be sent, finally calculate a continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and use the continuation adjustment value and the initial prediction frame to update the prediction motion frame set. At this time, by integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent, the motion window to be sent can be obtained. Since the motion window to be sent includes all the moving targets in the current video frame, the motion window to be sent is sent to the mobile APP end for fitting display. At this time, a mobile fitting frame is obtained and the screen of the mobile APP end is displayed. Finally, since the mobile fitting frame is only a video frame, it is necessary to determine whether a remote control termination instruction is received. If the remote control termination instruction is not received, return to the above-mentioned step of receiving the remote control start instruction. If the remote control termination instruction is received, the remote control is terminated. Therefore, the method, system, electronic device and computer-readable storage medium for remotely controlling a high-definition camera based on a mobile APP proposed in the present invention can solve the problem of low transmission efficiency in the current monitoring image transmission.

[0180] Embodiment 2:

[0181] like Figure 2 , is a functional module diagram of a remote control system for a high-definition camera based on a mobile APP provided by an embodiment of the present invention.

[0182] The remote control system 100 for implementing a high-definition camera based on a mobile APP according to the present invention can be installed in an electronic device. According to the functions implemented, the remote control system 100 for implementing a high-definition camera based on a mobile APP can include a picture freeze instruction sending module 101, a continued motion area judgment module 102, a motion area classification frame selection module 103, a motion window to be sent fitting module 104 and a termination instruction receiving judgment module 105. The module according to the present invention can also be referred to as a unit, which refers to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, which are stored in the memory of the electronic device.

[0183] The freeze frame instruction sending module 101 is used to receive a remote control start instruction, obtain a current video frame and a previous video frame according to the remote control start instruction; determine whether there is a moving target in the current video frame according to the previous video frame; if there is no moving target in the current video frame, send a freeze frame instruction to a pre-built mobile APP terminal;

[0184] The continuous motion region determination module 102 is used to determine whether there is a continuous motion region in the current video frame if there is a moving target in the current video frame;

[0185] The motion region classification frame selection module 103 is used to perform motion region frame selection on the current video frame to obtain a motion window to be sent if there is no continuous motion region in the current video frame; if there is a continuous motion region in the current video frame, perform predictive frame selection on the current video frame using a pre-constructed predicted motion frame set to obtain an iterative window to be sent; remove the iterative window to be sent from the current video frame to obtain a current simplified video frame, perform motion region detection on the current simplified video frame to obtain a current frame motion region; construct a predicted compensation frame, a target motion frame and an initial predicted frame according to the current frame motion region, respectively use the predicted compensation frame and the target motion frame to perform motion region frame selection on the current video frame to obtain a compensated window to be sent and a target window to be sent; calculate a continuation adjustment value according to the iterative window to be sent and the compensated window to be sent, and update the predicted motion frame set using the continuation adjustment value and the initial predicted frame; integrate the iterative window to be sent, the compensated window to be sent and the target window to be sent to obtain a motion window to be sent;

[0186] The moving window to be sent pasting module 104 is used to send the moving window to be sent to the mobile APP end for pasting display to obtain a moving pasting frame;

[0187] The termination instruction reception judgment module 105 is used to judge whether a remote control termination instruction is received; if no remote control termination instruction is received, the process returns to the above step of receiving a remote control start instruction; if a remote control termination instruction is received, the remote control is terminated.

[0188] In detail, each module in the remote control system 100 for realizing a high-definition camera based on a mobile APP in the embodiment of the present invention is used in the same manner as described above. Figure 1 The same technical means as the method for realizing remote control of high-definition cameras based on mobile APP described in the text and the like can produce the same technical effects, which will not be repeated here.

[0189] Embodiment 3:

[0190] like Figure 3 , is a schematic diagram of the structure of an electronic device for implementing a remote control method for a high-definition camera based on a mobile APP provided by an embodiment of the present invention.

[0191] The electronic device 1 may include a processor 10, a memory 11, a bus 12 and a communication interface 13, and may also include a computer program stored in the memory 11 and executable on the processor 10, such as a remote control program for a high-definition camera based on a mobile APP.

[0192] Among them, the memory 11 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, mobile hard disk, multimedia card, card-type memory (for example: SD or DX memory, etc.), magnetic memory, disk, optical disk, etc. The memory 11 may be an internal storage unit of the electronic device 1 in some embodiments, such as a mobile hard disk of the electronic device 1. The memory 11 may also be an external storage device of the electronic device 1 in other embodiments, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 1. Further, the memory 11 may also include both an internal storage unit of the electronic device 1 and an external storage device. The memory 11 can not only be used to store application software and various types of data installed in the electronic device 1, such as the code of the remote control program for realizing a high-definition camera based on a mobile APP, but also can be used to temporarily store data that has been output or is to be output.

[0193] The processor 10 may be composed of an integrated circuit in some embodiments, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and combinations of various control chips, etc. The processor 10 is the control core (Control Unit) of the electronic device, and uses various interfaces and lines to connect various components of the entire electronic device, and executes or executes programs or modules stored in the memory 11 (for example, a remote control program for a high-definition camera based on a mobile APP, etc.), and calls data stored in the memory 11 to execute various functions of the electronic device 1 and process data.

[0194] The bus may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. The bus is configured to realize connection and communication between the memory 11 and at least one processor 10, etc.

[0195] Figure 3 Only an electronic device with components is shown, and those skilled in the art will understand that Figure 3 The structure shown does not constitute a limitation on the electronic device 1, and may include fewer or more components than shown in the figure, or combine certain components, or arrange the components differently.

[0196] For example, although not shown, the electronic device 1 may also include a power source (such as a battery) for supplying power to each component. Preferably, the power source may be logically connected to the at least one processor 10 through a power management system, so that the power management system can realize functions such as charging management, discharging management, and power consumption management. The power source may also include any components such as one or more DC or AC power sources, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators. The electronic device 1 may also include a variety of sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.

[0197] Furthermore, the electronic device 1 may also include a network interface. Optionally, the network interface may include a wired interface and / or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is generally used to establish a communication connection between the electronic device 1 and other electronic devices.

[0198] Optionally, the electronic device 1 may further include a user interface, which may be a display, an input unit (such as a keyboard), or a standard wired interface or a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, and an OLED (Organic Light-Emitting Diode) touch device. The display may also be appropriately referred to as a display screen or a display unit, which is used to display information processed in the electronic device 1 and to display a visual user interface.

[0199] It should be understood that the embodiment is for illustration only and the scope of the patent application is not limited to this structure.

[0200] The remote control program for implementing a high-definition camera based on a mobile APP stored in the memory 11 of the electronic device 1 is a combination of multiple instructions. When running in the processor 10, the following can be achieved:

[0201] Receiving a remote control start instruction, and acquiring a current video frame and a previous video frame according to the remote control start instruction;

[0202] Determining whether there is a moving target in the current video frame according to the previous video frame;

[0203] If there is no moving target in the current video frame, a freeze frame instruction is sent to the pre-built mobile APP terminal;

[0204] If there is a moving target in the current video frame, determining whether there is a continuous motion area in the current video frame;

[0205] If the current video frame does not have a continuous motion area, a motion area frame is selected for the current video frame to obtain a motion window to be sent;

[0206] If there is a continuous motion area in the current video frame, predictive frame selection is performed on the current video frame using a pre-constructed predicted motion frame set to obtain an iterative window to be sent;

[0207] Eliminate the iterative window to be sent in the current video frame to obtain a current simplified video frame, and perform motion region detection on the current simplified video frame to obtain a current frame motion region;

[0208] Constructing a prediction compensation frame, a target motion frame and an initial prediction frame according to the motion region of the current frame, and selecting the motion region of the current video frame using the prediction compensation frame and the target motion frame to obtain a compensation window to be sent and a target window to be sent;

[0209] Calculate a continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and update the predicted motion frame set using the continuation adjustment value and the initial predicted frame;

[0210] Integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent to obtain a moving window to be sent;

[0211] Sending the moving window to be sent to the mobile APP end for fitting display to obtain a moving fitting frame;

[0212] Determine whether a remote control termination instruction is received;

[0213] If the remote control termination instruction is not received, return to the above step of receiving the remote control start instruction;

[0214] If a remote control termination command is received, the remote control is terminated, and the remote control of the high-definition camera based on the mobile APP is completed.

[0215] Specifically, the specific implementation method of the processor 10 for the above instructions can refer to Figure 1 to Figure 2 The description of the relevant steps in the corresponding embodiments will not be repeated here.

[0216] Furthermore, if the module / unit integrated in the electronic device 1 is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. The computer-readable storage medium can be volatile or non-volatile. For example, the computer-readable medium can include: any entity or system that can carry the computer program code, a recording medium, a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, and a read-only memory (ROM).

[0217] The present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor of an electronic device, the computer program can implement:

[0218] Receiving a remote control start instruction, and acquiring a current video frame and a previous video frame according to the remote control start instruction;

[0219] Determining whether there is a moving target in the current video frame according to the previous video frame;

[0220] If there is no moving target in the current video frame, a freeze frame instruction is sent to the pre-built mobile APP terminal;

[0221] If there is a moving target in the current video frame, determining whether there is a continuous motion area in the current video frame;

[0222] If the current video frame does not have a continuous motion area, a motion area frame is selected for the current video frame to obtain a motion window to be sent;

[0223] If there is a continuous motion area in the current video frame, predictive frame selection is performed on the current video frame using a pre-constructed predicted motion frame set to obtain an iterative window to be sent;

[0224] Eliminate the iterative window to be sent in the current video frame to obtain a current simplified video frame, and perform motion region detection on the current simplified video frame to obtain a current frame motion region;

[0225] Constructing a prediction compensation frame, a target motion frame and an initial prediction frame according to the motion region of the current frame, and selecting the motion region of the current video frame using the prediction compensation frame and the target motion frame to obtain a compensation window to be sent and a target window to be sent;

[0226] Calculate a continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and update the predicted motion frame set using the continuation adjustment value and the initial predicted frame;

[0227] Integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent to obtain a moving window to be sent;

[0228] Sending the moving window to be sent to the mobile APP end for fitting display to obtain a moving fitting frame;

[0229] Determine whether a remote control termination instruction is received;

[0230] If the remote control termination instruction is not received, return to the above step of receiving the remote control start instruction;

[0231] If a remote control termination command is received, the remote control is terminated, and the remote control of the high-definition camera based on the mobile APP is completed.

[0232] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation.

[0233] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0234] In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0235] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0236] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. A remote control method for a high-definition camera based on a mobile APP, characterized in that: The method comprises: Receiving a remote control start instruction, and acquiring a current video frame and a previous video frame according to the remote control start instruction; Determining whether there is a moving target in the current video frame according to the previous video frame; If there is no moving target in the current video frame, a freeze frame instruction is sent to the pre-built mobile APP terminal; If there is a moving target in the current video frame, determining whether there is a continuous motion area in the current video frame; If the current video frame does not have a continuous motion area, a motion area frame is selected for the current video frame to obtain a motion window to be sent; If there is a continuous motion area in the current video frame, predictive frame selection is performed on the current video frame using a pre-constructed predicted motion frame set to obtain an iterative window to be sent; Eliminate the iterative window to be sent in the current video frame to obtain a current simplified video frame, and perform motion region detection on the current simplified video frame to obtain a current frame motion region; Constructing a prediction compensation frame, a target motion frame and an initial prediction frame according to the motion region of the current frame, and respectively using the prediction compensation frame and the target motion frame to select the motion region of the current video frame to obtain a compensation window to be sent and a target window to be sent, wherein the prediction compensation frame refers to the compensation sending window of the iterative window to be sent, the target motion frame refers to other non-continuous motion regions appearing in the motion region of the current frame, and the initial prediction frame refers to the first motion prediction frame of the target motion frame; Calculating a continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and updating the predicted motion frame set using the continuation adjustment value and the initial prediction frame, wherein the continuation adjustment value refers to a size adjustment value for adjusting the compensation window to be sent; Integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent to obtain a moving window to be sent; Sending the moving window to be sent to the mobile APP end for fitting display to obtain a moving fitting frame; Determine whether a remote control termination instruction is received; If the remote control termination instruction is not received, return to the above step of receiving the remote control start instruction; If a remote control termination command is received, the remote control is terminated, and the remote control of the high-definition camera based on the mobile APP is completed.

2. The remote control method for a high-definition camera based on a mobile APP as claimed in claim 1, characterized in that: The determining whether the current video frame has a continuous motion area includes: Determine whether there is a historical moving target in the previous video frame; If there is no historical moving target in the previous video frame, then there is no continuous moving area in the current video frame; If there is a historical moving target in the previous video frame, determining whether there is a continuous moving target in the previous video frame that is the same as the moving target in the current video frame; If the previous video frame does not have a continuous motion target that is the same as the motion target in the current video frame, then the current video frame does not have a continuous motion area; If the previous video frame has a continuous motion target that is the same as the motion target in the current video frame, then the current video frame has a continuous motion area.

3. The remote control method for a high-definition camera based on a mobile APP as claimed in claim 1, characterized in that: The step of selecting a motion region of the current video frame to obtain a motion window to be sent includes: Performing inter-frame difference operation on the current video frame and the previous video frame to obtain a current frame motion area; A motion region frame is selected for the motion region of the current frame to obtain a motion window to be sent.

4. The remote control method for a high-definition camera based on a mobile APP as claimed in claim 3, characterized in that: The predictive frame selection of the current video frame using the pre-built predicted motion frame set to obtain an iterative window to be sent includes: Determining whether the continuous motion area is a preset single-target continuous area; If the continued motion region is a single-target continued region, predictive frame selection is performed on the current video frame using the predicted motion frame in the predicted motion frame set to obtain an iterative window to be sent, the number of motion prediction frames in the predicted motion frame set is 1, and the number of iterative windows to be sent is 1; If the continuous motion region is not a single target continuous region, determining whether the predicted motion frame sets overlap; If the predicted motion frame sets do not overlap, then sequentially extracting preset target continuation regions from the continuation motion regions, identifying target continuation motion frames corresponding to the target continuation regions in the predicted motion frame sets, and predictively selecting the target continuation regions using the target continuation motion frames to obtain iterative windows to be sent, where the number of iterative windows to be sent is greater than 1; If the predicted motion frame sets overlap, determining whether there is a preset unconnected continuation area in the continuation motion area; If there is no unconnected continuation area in the continuation motion area, connecting and merging the predicted motion frames in the predicted motion frame set to obtain a connected prediction frame; Using the connected prediction box to predictively select the continuous motion area, to obtain iterative windows to be sent, the number of the iterative windows to be sent is 1; If there is a disconnected continuation area in the continuation motion area, identifying a disconnected motion frame corresponding to the disconnected continuation area in the prediction motion frame set, and predictively selecting the disconnected continuation area by using the disconnected motion frame to obtain a first iterative sending window, wherein the number of the first iterative sending windows is greater than or equal to 1; The unconnected motion frame is removed from the predicted motion frame set to obtain a connected motion frame set, and the unconnected continuation region is removed from the continuation motion region to obtain a connected continuation region; Performing connectivity fusion on the connected motion frame set to obtain a connected prediction frame, using the connected prediction frame to perform predictive frame selection on the connected continuation area to obtain a second iterative sending window, where the number of the second iterative sending windows is 1; The first iteration sending window and the second iteration sending window are aggregated to obtain an iteration waiting-to-send window.

5. The remote control method for a high-definition camera based on a mobile APP as claimed in claim 1, characterized in that: The removing the iterative window to be sent from the current video frame to obtain a current simplified video frame includes: Identifying a window limit point set of the iterative window to be sent; Identify the video frame pixel point of each window limit point in the window limit point set to obtain a video frame pixel point set; The iterative window to be sent is eliminated in the current video frame according to the video frame pixel point set to obtain a current simplified video frame.

6. The remote control method for a high-definition camera based on a mobile APP as claimed in claim 1, characterized in that: The constructing a prediction compensation frame, a target motion frame and an initial prediction frame according to the current frame motion region includes: Extracting a window boundary of an iterative window to be sent in the current video frame; Determine whether the current frame motion area intersects with the window boundary; If the current frame motion area does not intersect with the window boundary, the prediction compensation frame is set to empty; Identify a target boundary point set of the motion region of the current frame, and draw a boundary frame line through each target boundary point in the target boundary point set to obtain a first target boundary frame line set, wherein the boundary frame lines are horizontal and vertical; Each target first boundary frame line in the target first boundary frame line set is moved outward according to the frame selection gap value to obtain a target second boundary frame line set, wherein the frame selection gap value refers to the outward movement distance of the target first boundary frame line; Constructing the target motion frame according to the target second boundary frame line set; Identify the orientation size set of the target motion frame, and query the initial prediction gap value in a pre-constructed orientation size-initial prediction table according to the orientation size set; According to the initial prediction gap value, each target second boundary frame line in the target motion frame is moved outward to obtain an initial prediction frame; If the current frame motion region intersects with the window boundary, identifying a compensation boundary point set of the current frame motion region; Drawing a boundary line through each compensation boundary point in the compensation boundary point set to obtain a compensated first boundary line set; Identify common boundary lines in the compensated first boundary line set, remove the common boundary lines from the compensated first boundary line set, and obtain a boundary line set to be moved outward, wherein the common boundary lines refer to boundary lines that overlap with the window boundary; Each of the boundary frame lines to be moved outward in the boundary frame line set to be moved outward is moved outward according to the frame selection gap value to obtain a second compensation boundary frame line set; The predicted compensation frame is constructed according to the common bounding frame line and the compensated second bounding frame line set.

7. The remote control method for a high-definition camera based on a mobile APP as claimed in claim 1, characterized in that: The calculating of the continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and updating the predicted motion frame set by using the continuation adjustment value and the initial predicted frame, comprises: Obtaining the azimuth growth rate of the compensation window to be sent of the iterative window to be sent; Determining a continuous adjustment value according to the azimuth speed increase, wherein the continuous adjustment value includes an iterative compensation azimuth and an iterative azimuth compensation value; The predicted motion frame to be adjusted corresponding to the iterative window to be sent is extracted from the predicted motion frame set, the predicted motion frame to be adjusted is adjusted using the continued adjustment value to obtain an iterative predicted motion frame, the predicted motion frame to be adjusted is replaced by the iterative predicted motion frame, and the initial predicted frame is added to the predicted motion frame set to complete the update of the predicted motion frame.

8. The remote control method for a high-definition camera based on a mobile APP as claimed in claim 1, characterized in that: The step of integrating the iterative window to be sent, the compensation window to be sent and the target window to be sent to obtain a moving window to be sent includes: Performing window-connected fusion on the iterative window to be sent and the compensation window to be sent to obtain a connected compensation window; Determine whether there is a window handover between the target to-be-sent window and the connected compensation window; If there is a window intersection between the target window to be sent and the connected compensation window, the target window to be sent is connected and merged with the connected compensation window to obtain a moving window to be sent; If there is no window handover between the target window to be sent and the connectivity compensation window, the target window to be sent and the connectivity compensation window are aggregated to obtain a moving window to be sent.

9. The remote control method for a high-definition camera based on a mobile APP as claimed in claim 1, characterized in that: The step of sending the moving window to be sent to the mobile APP end for fitting display to obtain a moving fitting frame includes: Sending the moving window to be sent to the mobile APP end, and identifying a window limit point set of the moving window to be sent; Extracting the last displayed video frame on the mobile APP end, and defining a set of pixel points to be aligned in the last displayed video frame according to the window limit point set; The pixel values ​​of the pixel point set to be fitted are updated using the moving window to be sent to obtain a moving fitted frame.

10. A remote control system for a high-definition camera based on a mobile APP, characterized in that: The system comprises: A freeze frame instruction sending module is used to receive a remote control start instruction, obtain a current video frame and a previous video frame according to the remote control start instruction; determine whether there is a moving target in the current video frame according to the previous video frame; if there is no moving target in the current video frame, send a freeze frame instruction to a pre-built mobile APP terminal; A continuous motion region determination module, configured to determine whether there is a continuous motion region in the current video frame if there is a moving target in the current video frame; The motion region classification frame selection module is used to perform motion region frame selection on the current video frame to obtain a motion window to be sent if there is no continuous motion region in the current video frame; if there is a continuous motion region in the current video frame, perform predictive frame selection on the current video frame using a pre-constructed predicted motion frame set to obtain an iterative window to be sent; remove the iterative window to be sent from the current video frame to obtain a current simplified video frame, perform motion region detection on the current simplified video frame to obtain a current frame motion region; construct a prediction compensation frame, a target motion frame and an initial prediction frame according to the current frame motion region, and respectively use the prediction compensation frame and the target motion frame to perform motion detection on the current video frame; Select the motion region frame to obtain the compensation window to be sent and the target window to be sent; wherein the predicted compensation frame refers to the compensation sending window of the iterative window to be sent, the target motion frame refers to other non-continuous motion regions appearing in the motion region of the current frame, and the initial prediction frame refers to the first motion prediction frame of the target motion frame; calculate the continuation adjustment value according to the iterative window to be sent and the compensation window to be sent, and update the predicted motion frame set using the continuation adjustment value and the initial prediction frame, wherein the continuation adjustment value refers to the size adjustment value of the compensation window to be sent; integrate the iterative window to be sent, the compensation window to be sent and the target window to be sent to obtain the motion window to be sent; A moving window to be sent pasting module, used for sending the moving window to be sent to the mobile APP end for pasting display, and obtaining a moving pasting frame; The termination instruction reception judgment module is used to judge whether a remote control termination instruction is received; if the remote control termination instruction is not received, return to the above step of receiving the remote control start instruction; if the remote control termination instruction is received, terminate the remote control.

Images