A fast movement detection method and device
By determining the coordinate positions of the detection frame and expansion frame of the target object in the image acquisition device, the problem of poor accuracy of fast movement detection in the prior art is solved, and accurate detection of the rapid movement of the target object is achieved.
Patent Information
- Application Number
- CN202110005563.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-01-05
- Publication Date
- 2025-04-04
- Estimated Expiration
- 2041-01-05
AI Technical Summary
In the prior art, the detection results of the fast movement detection method are poor, especially in the remote scene, it is difficult to accurately detect the rapid movement of the target object.
By acquiring the current frame image and the historical frame image in the image acquisition device, the first detection frame and the extended frame coordinate position of the target object is determined, and the second detection frame coordinate position is determined in the current frame image, and whether the target object has rapidly moved is determined based on these coordinate positions.
By comparing the extended box and the second detection box, it is possible to accurately determine whether the target object is moving rapidly, avoiding the influence of the near, far and small effects in the image, and improving the accuracy of the detection results.
Smart Images

Figure CN112669351B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of image processing, and in particular relates to a fast movement detection method and device. Background Art
[0002] Rapid movement refers to the act of moving quickly. Many accidents in public places are often related to the rapid movement of the target object, such as robbery, riots, and fights. Therefore, it is of great significance to detect whether the target object has moved quickly.
[0003] At present, an image acquisition device is often used to acquire an image of a target object, and whether the target object moves rapidly is determined based on the pixel distance moved by the target object per unit time. When the image acquisition device is in an oblique shooting state, the obtained image will have a near-large-far-small effect, that is, the actual distance represented by a unit pixel in the near scene is smaller than that represented by a far scene in the image, which makes it easy to determine whether the target object moves rapidly in the near scene, but it is difficult to accurately detect the rapid movement of the target object in the far scene, thereby affecting the accuracy of the overall detection result. Summary of the invention
[0004] In view of this, an embodiment of the present invention provides a fast movement detection method and device to solve the technical problem that the fast movement detection method in the prior art has poor detection accuracy.
[0005] A first aspect of an embodiment of the present invention provides a fast movement detection method, comprising:
[0006] Determine the coordinate position of a first detection frame corresponding to the target object in a historical frame image before the image acquisition device acquires the current frame image;
[0007] Based on the first detection frame coordinate position and a preset accuracy, determining the extended frame coordinate position corresponding to the target object in the historical frame image;
[0008] Determining a coordinate position of a second detection frame corresponding to the target object in the current frame image;
[0009] Based on the coordinate position of the second detection frame and the coordinate position of the expansion frame, it is determined whether the target object moves quickly.
[0010] A second aspect of an embodiment of the present invention provides a fast movement detection device, comprising:
[0011] A first position determination module, used to determine a first detection frame coordinate position corresponding to the target object in a historical frame image before the image acquisition device acquires a current frame image;
[0012] A second position determination module, configured to determine a coordinate position of an extended frame corresponding to the target object based on the coordinate position of the first detection frame and a preset accuracy;
[0013] A third position determination module, used to determine, in the current frame image, a second detection frame coordinate position corresponding to the target object in the historical frame image;
[0014] A detection processing module is used to determine whether the target object moves quickly based on the coordinate position of the second detection frame and the coordinate position of the expansion frame.
[0015] A third aspect of an embodiment of the present invention provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the computer program.
[0016] A fourth aspect of an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.
[0017] Compared with the prior art, the embodiments of the present invention have the following beneficial effects: the embodiments of the present invention use an image acquisition device to acquire images, and the image acquisition device will acquire a series of images, including a current frame image and a historical frame image, wherein the current frame image refers to the image acquired at the current moment, for example, it can be the latest image acquired by the image acquisition device at the current moment, or it can be the latest image acquired when the frame processing of an existing video is performed; the historical frame image refers to the image corresponding to the previous unit time length or preset number of frames of the current frame image, for example, the historical frame image can be the image of the previous frame of the current frame image, or it can be the image of the 10 frames before the current frame image, and the unit time length can be 3s, 5s, 10s, etc., that is, the historical frame image can be the image 3s, 5s or 10s before the current frame image. Target detection is performed in the historical frame image, and the first detection frame coordinate position corresponding to the target object is determined, and then the extended frame coordinate position corresponding to the target object in the historical frame image is determined according to the first detection frame coordinate position and the preset accuracy, and the second detection frame coordinate position corresponding to the target object is further determined in the current frame image, and then according to the second detection frame coordinate position and the extended frame coordinate position, it is determined whether the target object moves rapidly. In this embodiment, whether the target object is moving quickly can be determined by using the expansion frame and the second detection frame without calculating the moving speed of the target object. Moreover, since the size of the expansion frame is adjusted according to the size of the first detection frame, the influence of the near-big-far-small effect in the image is avoided, and whether the target object is moving quickly can be accurately determined. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0019] Figure 1 The following is a schematic diagram of the implementation process of the fast movement detection method provided by the embodiment of the present invention. Figure 1 ;
[0020] Figure 2 is a schematic diagram of the implementation flow of step S2 in the fast movement detection method provided by an embodiment of the present invention;
[0021] Figure 3 FIG. 1 is a schematic diagram of the implementation process of step S22 in the fast movement detection method provided in an embodiment of the present invention. Figure 1 ;
[0022] Figure 4 FIG. 1 is a schematic diagram of the implementation process of step S22 in the fast movement detection method provided in an embodiment of the present invention. Figure 2 ;
[0023] Figure 5 is a schematic diagram of the implementation flow of step S4 in the fast movement detection method provided in an embodiment of the present invention;
[0024] Figure 6 is a schematic diagram of the implementation flow of step S44 in the fast movement detection method provided by an embodiment of the present invention;
[0025] Figure 7 is a schematic diagram of the implementation flow of step S442 in the fast movement detection method provided by an embodiment of the present invention;
[0026] Figure 8 is a schematic diagram of a fast-movement detection device provided by an embodiment of the present invention;
[0027] Fig. 9 It is a schematic diagram of a terminal device provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0028] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present invention. However, it should be clear to those skilled in the art that the present invention may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present invention.
[0029] In order to illustrate the technical solution of the present invention, a specific embodiment is provided below for illustration.
[0030] Rapid movement refers to the act of moving quickly. Many accidents in public places are often related to the rapid movement of the target object, such as robbery, riots, and fights. Therefore, it is of great significance to detect whether the target object has moved quickly. At present, an image acquisition device is often used to obtain an image of the target object, and whether the target object has moved quickly is determined based on the pixel distance moved by the target object per unit time. When the image acquisition device is in an oblique shooting state, the image obtained will have a near-large-far-small effect, that is, the actual distance represented by the unit pixel in the image is smaller in the near scene than in the far scene. This makes it easy to judge whether the target object has moved quickly in the near scene, but it is difficult to accurately detect the rapid movement of the target object in the far scene, thereby affecting the accuracy of the overall detection result.
[0031] This embodiment fully considers various possible acquisition states of the image acquisition device, and uses the detection frame and the expansion frame to judge whether the target object is moving rapidly, thereby eliminating the near-big-far-small effect that may exist in the images captured by the image acquisition device, and effectively improves the accuracy of the detection results.
[0032] See also Figure 1 In a first aspect of the present embodiment, a fast movement detection method is provided, which may include the following steps:
[0033] Step S1: determining a first detection frame coordinate position corresponding to a target object in a historical frame image before the image acquisition device acquires a current frame image.
[0034] When an image acquisition device is used to acquire images, the image acquisition device will acquire a series of images, including a current frame image and a historical frame image, wherein the current frame image refers to the image acquired at the current moment, for example, it may be the latest image acquired by the image acquisition device at the current moment, or it may be the latest image acquired when the frame processing of an existing video is performed; the historical frame image refers to the image corresponding to the previous unit time length or preset number of frames of the current frame image, for example, the historical frame image may be the image of the previous frame of the current frame image, or it may be the image of the 10 frames before the current frame image, and the unit time length may be 3s, 5s, 10s, etc., that is, the historical frame image may be the image 3s, 5s or 10s before the current frame image. It can be understood that when the image acquisition device continuously acquires images, or when the video acquired by the image acquisition device is processed, the current frame image and the historical frame image are continuously updated, such as when the image acquisition device acquires the next frame image of the current frame image at a preset frequency, the next frame image becomes the latest current frame image, and the current frame image becomes the historical frame image, so the method provided in this embodiment is continuously performed in real time. Target detection is performed in the historical frame image, a first detection frame corresponding to the target object is generated, and the coordinate position of the first detection frame is determined, wherein the coordinate position of the first detection frame is the pixel coordinate position of the detection frame of the target object in the historical frame image. The target object mentioned in this embodiment may be a person, a car or an animal, and the image acquisition device may be a camera or a video camera. When the image acquisition device acquires a video, the video is frame processed, thereby obtaining a series of images.
[0035] Step S2: Based on the first detection frame coordinate position and a preset accuracy, determine the expansion frame coordinate position corresponding to the target object in the historical frame image.
[0036] The preset accuracy is a pre-set parameter, and the user can set it according to the actual application scenario of the image acquisition device. The coordinate position of the expansion frame in this embodiment is adjusted according to the coordinate position of the first detection frame, and the size of the first detection frame determines the size of the expansion frame. When using an oblique image acquisition device, the target object in the captured image is larger when it is near and smaller when it is far away. When the target object is near, the first detection frame corresponding to the target object is larger, and the corresponding expansion frame determined according to the first detection frame is larger. When the target object is far away, the first detection frame corresponding to the target object is smaller, and the corresponding expansion frame determined according to the first detection frame is smaller. It can be understood that the method provided in this embodiment can be applied to oblique image acquisition devices, and can also be applied to top image acquisition devices. After obtaining the coordinate position of the expansion frame in the historical frame image, the coordinate position of the expansion frame is saved.
[0037] Step S3: Determine the coordinate position of the second detection frame corresponding to the target object in the current frame image.
[0038] The second detection frame coordinate position refers to the pixel coordinate position of the detection frame of the target object in the current frame image. It can be understood that when using an image acquisition device for real-time monitoring, the images acquired by the image acquisition device in chronological order are always the historical frame images first and then the current frame images. Therefore, the method provided in this embodiment performs real-time processing according to the order of image acquisition, which can ensure the real-time nature of the detection results.
[0039] Step S4: determining whether the target object moves quickly based on the coordinate position of the second detection frame and the coordinate position of the expansion frame.
[0040] Based on the coordinate position of the second detection frame and the coordinate position of the expansion frame, it is determined whether the target object moves quickly. Since the image acquisition device for acquiring the image is fixed, the position of the expansion frame in the historical frame image can be directly compared with the coordinate position of the second detection frame.
[0041] The beneficial effect of the fast movement detection method provided by the present embodiment is at least that: the present embodiment performs target detection in the historical frame image, determines the first detection frame coordinate position corresponding to the target object, and then determines the extended frame coordinate position corresponding to the target object in the historical frame image based on the first detection frame coordinate position and the preset accuracy, and further determines the second detection frame coordinate position corresponding to the target object in the current frame image, and then determines whether the target object is moving rapidly based on the second detection frame coordinate position and the extended frame coordinate position. In the present embodiment, whether the target object is moving rapidly can be determined by the extended frame and the second detection frame, without calculating the moving speed of the target object, and because the size of the extended frame is adjusted based on the size of the first detection frame, the influence of the near big and far small effect in the image is avoided, and whether the target object is moving rapidly can be accurately determined.
[0042] See also Figure 2 Further, the step S2 determines the extended frame coordinate position corresponding to the target object in the historical frame image based on the first detection frame coordinate position and the preset accuracy, including:
[0043] Step S21: determining the coordinate position of the center point of the first detection frame based on the coordinate position of the first detection frame;
[0044] Step S22: Determine the extended frame coordinate position corresponding to the target object in the historical frame image according to the product of the distance between the coordinate position of the center point of the first detection frame and the coordinate position of the first detection frame and a preset accuracy.
[0045] In the above embodiment, based on the coordinate position of the first detection frame, the coordinate position of the center point of the first detection frame can be determined, and then the distance between the coordinate position of the center point of the first detection frame and the coordinate position of the first detection frame can be determined. The product of the distance and the preset accuracy can be used to determine the corresponding extended frame coordinate position of the target object in the historical frame image.
[0046] In one possible implementation, see Figure 3 The step S22 determines the extended frame coordinate position corresponding to the target object in the historical frame image according to the product of the distance between the coordinate position of the center point of the first detection frame and the coordinate position of the first detection frame and a preset precision, including:
[0047] Step S221: Determine the distances from the coordinate position of the center point of the first detection frame to each side of the first detection frame.
[0048] Step S222: Determine the distances from the center point coordinates of the first detection frame to the sides of the extended frame according to the product of the distances from the center point coordinates of the first detection frame to the sides of the first detection frame and the preset precision.
[0049] Step S223: Determine the coordinate position of the expansion frame corresponding to the target object in the historical frame image according to the shape of the first detection frame and the distances from the coordinates of the center point of the first detection frame to the sides of the expansion frame.
[0050] In the above embodiment, in order to determine the position of the extended frame, the distance from the coordinate position of the center point of the first detection frame to each side of the first detection frame is first determined. For example, when the detection frame is a rectangle, the distance from the center point of the rectangular detection frame to the four sides of the rectangle, y1, y2, x1, x2, can be obtained. The obtained y1, y2, x1, x2 are multiplied by the preset accuracy to obtain y1′, y2′, x1′, x2′, where y1′, y2′, x1′, x2′ are the distances from the coordinates of the center point of the first detection frame to each side of the extended frame. Then, an extended frame with the same shape as the first detection frame is generated according to y1′, y2′, x1′, x2′, and the coordinate position of the extended frame is determined.
[0051] In another possible implementation, see Figure 4 Further, the step S22 determines the extended frame coordinate position corresponding to the target object in the historical frame image according to the product of the distance between the coordinate position of the center point of the first detection frame and the coordinate position of the first detection frame and a preset precision, including:
[0052] Step S224: Determine the distances between the coordinate position of the center point of the first detection frame and the coordinate positions of each vertex of the first detection frame.
[0053] Step S225: Determine the coordinate positions of each vertex of the extended frame corresponding to the target object according to the product of the distance between the coordinate position of the center point of the first detection frame and the coordinate positions of each vertex of the first detection frame and the preset precision.
[0054] Step S226: Connect the coordinate positions of each vertex of the expansion frame to determine the coordinate position of the expansion frame corresponding to the target object in the historical frame image.
[0055] In the above embodiment, the distances between the coordinate position of the center point of the first detection frame and the coordinate positions of each vertex of the first detection frame are determined, such as determining the distance between the coordinate position of the center point of the first detection frame and the coordinate positions of the four vertices of the rectangular detection frame, and then multiplying each determined distance by a preset precision to obtain the distance between the coordinate position of the center point of the first detection frame and each vertex of the extended frame, determine the coordinate positions of each vertex of the extended frame, connect the coordinate positions of each vertex of the extended frame, and thus determine the coordinate position of the extended frame corresponding to the target object. Of course, an extended frame with the same shape as the first detection frame can also be generated based on the distance between the coordinate position of the center point of the first detection frame and each vertex of the extended frame, and the coordinate position of the extended frame can also be determined.
[0056] It can be understood that the shape of the first detection frame can be set by itself. In addition to the common rectangle, it can also be set to any polygon. Of course, it can also be set to a circle. When the shape of the detection frame is a circle, the distance between the coordinate position of the center point of the first detection frame and any point on the circle can be determined. The product of the distance and the preset accuracy is used to determine the distance between the extended frame and the coordinate position of the center point of the first detection frame. A circle is generated with the center point of the first detection frame as the center and the distance between the extended frame and the coordinate position of the center point of the first detection frame as the radius, which is the extended frame, and then the coordinate position of the extended frame is determined.
[0057] See also Figure 5 Further, the step S4 determines whether the target object moves quickly based on the coordinate position of the second detection frame and the coordinate position of the expansion frame, including:
[0058] Step S41: Based on the coordinate position of the second detection frame, determine the coordinate position of the center point of the second detection frame.
[0059] Step S42: Determine whether the coordinate position of the center point of the second detection frame is within the coordinate position of the expansion frame.
[0060] Step S43: If the coordinate position of the center point of the second detection frame is within the coordinate position of the expansion frame, the target object does not move quickly.
[0061] Step S44: If the coordinate position of the center point of the second detection frame is not within the coordinate position of the expansion frame, the target object moves rapidly.
[0062] In the above embodiment, the extended frame coordinate position is based on the position of the target object in the historical frame image and the predicted position of the target object in the current frame image when the target object moves normally. Therefore, whether the target object moves rapidly can be judged based on whether the coordinate position of the center point of the second detection frame is located within the extended frame coordinate position. If the coordinate position of the center point of the second detection frame is located within the extended frame coordinate position, the target object moves normally and does not move rapidly; if the coordinate position of the center point of the second detection frame is not located within the extended frame coordinate position, the target object moves rapidly. It should be noted that when the coordinates of the center point of the second detection frame are located at the extended frame coordinate position, the center coordinate position of the second detection frame is located within the extended frame coordinate position.
[0063] See also Figure 6 Furthermore, in step S44, if the coordinate position of the center point of the second detection frame is not within the coordinate position of the expansion frame, after the target object moves quickly, the method further includes:
[0064] Step S441: Tracking a target object that is moving rapidly in subsequent frame images acquired by the image acquisition device to determine whether the tracked target object continues to move rapidly.
[0065] Step S442: If the tracked target object continues to move quickly, a warning message is issued.
[0066] When the target object moves rapidly, the historical frame image and the current frame image can be used to detect it immediately. Considering that the target object may move rapidly for a short period of time due to accidental events, the target object can be tracked after the rapid movement of the target object is detected, and a warning message is issued when the target object continues to move rapidly. Specifically, the subsequent frame image is used to judge whether the target object continues to move rapidly. At this time, the subsequent frame image can refer to the image corresponding to the unit time length or preset frame number collected after the current frame image, such as the next frame image after the current frame image is collected, or the image 10 frames after the current frame image. The unit time length can be 3s, 5s, 10s, etc., that is, the subsequent frame image can be an image 3s, 5s or 10s after the current frame image, wherein the unit time length and preset frame number between the subsequent frame image and the current frame image, and the unit time length and preset frame number between the current frame image and the historical frame image are the same. When it is determined based on the current frame image and the historical frame image that the target object has moved rapidly, the target object is marked, and based on the second detection frame coordinate position corresponding to the target object in the current frame image and the preset accuracy, the extended frame coordinate position corresponding to the target object in the current frame image is determined, and the third detection frame coordinate position of the target object in the subsequent frame image is determined, and it is determined whether the coordinate position of the center point of the third detection frame is within the extended frame coordinate position determined based on the current frame image. If so, the target object continues to move rapidly, and a warning message is issued at this time. It should be noted that in one possible case, the warning message may also be issued immediately after the target object moves rapidly.
[0067] See also Figure 7 Furthermore, in step S442, if the tracked target object continues to move rapidly, a warning message is issued, including:
[0068] Step S4421: Obtain the time during which the target object being tracked continues to move rapidly.
[0069] Step S4422: If the time for which the tracked target object continues to move rapidly is greater than a preset time threshold, a warning message is issued.
[0070] Because the image acquisition device acquires images at a high frequency, that is, the interval between different frame images is short, in order to more accurately screen out the occurrence of accidental events, the time when the target object continues to move rapidly can be obtained. At this time, the subsequent frame image refers to the multiple frame images acquired by the image acquisition device after the current frame image, and it is judged based on the historical frame image, the current frame image and the multiple subsequent frame images that the target object has moved rapidly. The time of the target object continuously moving rapidly is recorded with the time of the historical frame image as the starting point, and the time of the target object continuously moving rapidly is compared with the preset time threshold. Once the time when the target object continuously moves rapidly is greater than the preset time threshold, a warning message is issued. The preset time threshold can be set according to the actual scenario.
[0071] After determining that the target object is moving rapidly, there may be a variety of situations in which a warning message is issued. For example, the number of rapidly moving target objects in the current frame image is determined. If the number of rapidly moving target objects is greater than or equal to 2, a warning message is issued. Alternatively, when the target object moves rapidly, at least one frame image of the target object before the historical frame image is obtained, and the action of the target object in the image is identified. If the action of the target object meets the preset action, that is, the target object may be involved in robbery, fighting, etc., a warning message is issued at this time. Of course, there may be other possibilities for issuing warning messages, which are not specifically limited in this embodiment.
[0072] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.
[0073] See also Figure 8 Based on the same inventive concept, an embodiment of the present invention further provides a fast movement detection device, comprising:
[0074] A first position determination module 81 is used to determine a first detection frame coordinate position corresponding to a target object in a historical frame image before the image acquisition device acquires a current frame image;
[0075] A second position determination module 82, configured to determine the extended frame coordinate position corresponding to the target object in the historical frame image based on the first detection frame coordinate position and a preset accuracy;
[0076] A third position determination module 83 is used to determine the coordinate position of the second detection frame corresponding to the target object in the current frame image;
[0077] The detection processing module 84 is used to determine whether the target object moves quickly based on the coordinate position of the second detection frame and the coordinate position of the expansion frame.
[0078] Of course, in other embodiments, each module of the fast-moving detection device may further include one or more units for realizing corresponding functions, which will not be elaborated here.
[0079] Fig. 9 Schematic diagram of a terminal device provided by an embodiment of the present invention. Fig. 9 As shown, the terminal device 6 of this embodiment includes: a processor 60, a memory 61, and a computer program 62 stored in the memory 61 and executable on the processor 60, such as a sound reinforcement program based on image recognition. When the processor 60 executes the computer program 62, the steps in the above-mentioned various fast movement detection method embodiments are implemented, such as Figure 1 Alternatively, when the processor 60 executes the computer program 62, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Figure 8 The functions of modules 81 to 84 are shown.
[0080] Exemplarily, the computer program 62 may be divided into one or more modules / units, which are stored in the memory 61 and executed by the processor 60 to implement the present invention. The one or more modules / units may be a series of computer program instruction segments capable of implementing specific functions, which are used to describe the execution process of the computer program 62 in the terminal device 6.
[0081] The terminal device 6 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The terminal device may include, but is not limited to, a processor 60 and a memory 61. Those skilled in the art will appreciate that Fig. 9 It is only an example of the terminal device 6 and does not constitute a limitation on the terminal device 6. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal device may also include input and output devices, network access devices, buses, etc.
[0082] The processor 60 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0083] The memory 61 may be an internal storage unit of the terminal device 6, such as a hard disk or memory of the terminal device 6. The memory 61 may also be an external storage device of the terminal device 6, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device 6. Further, the memory 61 may also include both an internal storage unit and an external storage device of the terminal device 6. The memory 61 is used to store the computer program and other programs and data required by the terminal device. The memory 61 may also be used to temporarily store data that has been output or is to be output.
[0084] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0085] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0086] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0087] In the embodiments provided by the present invention, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0088] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0089] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0090] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.
[0091] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.
Claims
1. A fast movement detection method, characterized in that: include: Determine the coordinate position of a first detection frame corresponding to the target object in a historical frame image before the image acquisition device acquires a current frame image, wherein the image acquisition device is an oblique image acquisition device, and when the target object is near, the first detection frame corresponding to the target object is larger, and when the target object is far away, the first detection frame corresponding to the target object is smaller; Based on the first detection frame coordinate position and a preset accuracy, determining the extended frame coordinate position corresponding to the target object in the historical frame image; Determining a coordinate position of a second detection frame corresponding to the target object in the current frame image; Determining whether the target object moves quickly based on the coordinate position of the second detection frame and the coordinate position of the expansion frame; The step of determining the extended frame coordinate position corresponding to the target object in the historical frame image based on the first detection frame coordinate position and the preset accuracy includes: Based on the coordinate position of the first detection frame, determining the coordinate position of the center point of the first detection frame; The extended frame coordinate position corresponding to the target object in the historical frame image is determined according to the product of the distance between the coordinate position of the center point of the first detection frame and the coordinate position of the first detection frame and a preset accuracy.
2. The fast movement detection method according to claim 1, characterized in that: The step of determining the extended frame coordinate position corresponding to the target object in the historical frame image according to the product of the distance between the first detection frame center point coordinate position and the first detection frame coordinate position and a preset precision comprises: Determine the distances from the coordinate position of the center point of the first detection frame to each side of the first detection frame; Determine the distances from the coordinates of the center point of the first detection frame to the sides of the extended frame according to the product of the distances from the coordinates of the center point of the first detection frame to the sides of the first detection frame and the preset precision; According to the shape of the first detection frame and the distances from the coordinates of the center point of the first detection frame to the sides of the extension frame, the coordinate position of the extension frame corresponding to the target object in the historical frame image is determined.
3. The fast movement detection method according to claim 1, characterized in that: The step of determining the extended frame coordinate position corresponding to the target object in the historical frame image according to the product of the distance between the first detection frame center point coordinate position and the first detection frame coordinate position and a preset precision comprises: Determine the distances between the coordinate positions of the center point of the first detection frame and the coordinate positions of each vertex of the first detection frame; Determine the coordinate positions of each vertex of the extended frame corresponding to the target object according to the product of the distance between the coordinate position of the center point of the first detection frame and the coordinate positions of each vertex of the first detection frame and the preset precision; The coordinate positions of the vertices of the expansion frame are connected to determine the coordinate position of the expansion frame corresponding to the target object in the historical frame image.
4. The fast movement detection method according to any one of claims 1 to 3, characterized in that: The step of determining whether the target object moves quickly based on the coordinate position of the second detection frame and the coordinate position of the expansion frame includes: Based on the coordinate position of the second detection frame, determining the coordinate position of the center point of the second detection frame; Determine whether the coordinate position of the center point of the second detection frame is within the coordinate position of the extended frame; If the coordinate position of the center point of the second detection frame is within the coordinate position of the extended frame, then the target object does not move quickly; If the coordinate position of the center point of the second detection frame is not within the coordinate position of the expansion frame, the target object moves rapidly.
5. The fast movement detection method according to claim 4, characterized in that: After the step of: if the coordinate position of the center point of the second detection frame is not within the coordinate position of the extended frame, then the target object moves rapidly, the method further includes: Tracking the fast-moving target object in subsequent frame images captured by the image acquisition device to determine whether the tracked target object continues to move rapidly; If the tracked target object continues to move rapidly, a warning message is issued.
6. The fast movement detection method according to claim 5, characterized in that: The step of issuing a warning message if the tracked target object continues to move rapidly comprises: Obtaining the time during which the target object being tracked continues to move rapidly; If the target object being tracked continues to move rapidly for a period greater than a preset time threshold, a warning message is issued.
7. A fast moving detection device, characterized in that: include: A first position determination module is used to determine the coordinate position of a first detection frame corresponding to the target object in a historical frame image before the image acquisition device acquires the current frame image, wherein the image acquisition device is an oblique image acquisition device, and when the target object is near, the first detection frame corresponding to the target object is larger, and when the target object is far away, the first detection frame corresponding to the target object is smaller; A second position determination module, configured to determine the extended frame coordinate position corresponding to the target object in the historical frame image based on the first detection frame coordinate position and a preset accuracy; A third position determination module, used to determine the coordinate position of the second detection frame corresponding to the target object in the current frame image; A detection processing module, used for determining whether the target object moves rapidly based on the coordinate position of the second detection frame and the coordinate position of the extended frame; The second position determination module is also used to determine the coordinate position of the center point of the first detection frame based on the coordinate position of the first detection frame; and determine the extended frame coordinate position corresponding to the target object in the historical frame image according to the product of the distance between the coordinate position of the center point of the first detection frame and the coordinate position of the first detection frame and a preset accuracy.
8. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Target tracking method and device, computer readable storage medium and robot
CN111563919A