Method, device, electronic equipment and storage medium for detecting objects thrown from high altitude

Abstract

The present disclosure relates to a method, device, electronic device and storage medium for detecting objects dropped from a high altitude. The detection method comprises: obtaining a thermal imaging image at a high altitude by a thermal imaging camera; determining the position information of the target object in the thermal imaging image when determining that there is a target object in the thermal imaging image; adjusting the shooting parameters of a visible light camera according to the position information; obtaining an image to be detected including the target object by the adjusted visible light camera; and determining whether there is an act of dropping objects from a high altitude in the image to be detected. The embodiments of the present disclosure are less affected by the environment, and are conducive to improving the detection accuracy of the act of dropping objects from a high altitude. In addition, the embodiments of the present disclosure are conducive to reducing the difficulty of hardware wiring and improving the flexibility of detection.

Description

Technical Field

[0001] The present disclosure relates to the field of computer vision technology, and in particular to a method, device, electronic device and storage medium for detecting objects thrown from high altitude. Background Art

[0002] As the height of buildings continues to increase, the number of residents that buildings can accommodate is also growing. On the one hand, the increase in building height will increase the risk of high-altitude objects being thrown, and on the other hand, the increase in the number of residents will increase the probability of high-altitude objects being thrown. Therefore, how to detect high-altitude objects being thrown is an urgent problem to be solved. Summary of the invention

[0003] The present invention proposes a technical solution for detecting objects thrown from high altitudes.

[0004] According to one aspect of the present disclosure, a method for detecting objects dropped from a high altitude is provided, the detection method comprising: acquiring a thermal imaging image at a high altitude by means of a thermal imaging camera; in the case where it is determined that a target object exists in the thermal imaging image, determining position information of the target object in the thermal imaging image; adjusting shooting parameters of a visible light camera according to the position information; acquiring an image to be detected including the target object by means of the adjusted visible light camera; and determining whether there is an act of dropping objects from a high altitude in the image to be detected.

[0005] In a possible implementation, the detection method further includes: in a case where it is determined that there is a high-altitude parabolic behavior in the image to be detected, determining a parabolic position corresponding to a target object in the image to be detected; determining a parabolic window based on the parabolic position; and generating a parabolic record based on the parabolic window and the image to be detected including the target object.

[0006] In a possible implementation, generating a parabolic record based on the parabolic window and the image to be detected including the target object includes: determining a suspected person who throws objects based on the entry and exit of the target floor corresponding to the parabolic window; generating a parabolic record based on the suspected person who throws objects, the parabolic window, and the image to be detected including the target object.

[0007] In a possible implementation, the target object includes: the person who throws the object and / or the thrown object; determining the suspected person who throws the object based on the entry and exit situation of the target floor corresponding to the parabolic window includes: determining the target floor corresponding to the parabolic window; determining the entry and exit situation of people on the target floor, the entry and exit situation of people indicating whether there are people entering and exiting the target floor within a preset time; determining the suspected person who throws the object based on the composition of the target object and the entry and exit situation of people.

[0008] In a possible implementation, the determining of the suspected person who throws objects based on the composition of the target object and the entry and exit of personnel includes: when the entry and exit of personnel is a first person entering and exiting the target floor within a preset time, and the target object includes only the thrown object, determining the first person as a suspected person who throws objects with a first degree of credibility.

[0009] In a possible implementation, determining a suspected person who throws objects based on the composition of the target object and the entry and exit of personnel includes: when the entry and exit of personnel is that a first person enters and exits the target floor within a preset time and the target object includes the person who throws objects, determining the similarity between the person who throws objects and the first person; when it is determined that the similarity between the person who throws objects and the first person is higher than a first preset similarity, determining the first person as a suspected person who throws objects with a second credibility, wherein the second credibility is higher than the first credibility.

[0010] In a possible implementation, determining a suspected person who throws an object based on the composition of the target object and the entry and exit of personnel includes: when the entry and exit of personnel is a first person entering and exiting the target floor within a preset time, and the target object only includes the thrown object, determining a first object in a surveillance image corresponding to the first person, wherein the surveillance image includes: at least one of an elevator surveillance image and a corridor surveillance image; when it is determined that the similarity between the thrown object and the first object is higher than a second preset similarity, determining the first person as a suspected person who throws the object with a third credibility, wherein the third credibility is higher than the first credibility.

[0011] In a possible implementation, determining the entry and exit of personnel on the target floor includes: determining whether there is any personnel entering and exiting the target floor within a preset time based on the surveillance image and / or elevator stop record corresponding to the target floor; wherein the surveillance image includes: at least one of an elevator surveillance image and a corridor surveillance image.

[0012] According to one aspect of the present disclosure, a device for detecting objects dropped from a high altitude is provided, and the detection device includes: a thermal imaging image acquisition module, used to acquire a thermal imaging image at a high altitude through a thermal imaging camera; a position information determination module, used to determine the position information of the target object in the thermal imaging image when it is determined that the target object exists in the thermal imaging image; a shooting parameter adjustment module, used to adjust the shooting parameters of the visible light camera according to the position information; a module for acquiring an image to be detected, used to acquire an image to be detected including the target object through the adjusted visible light camera; and a module for detecting objects dropped from a high altitude, used to determine whether there is an act of dropping objects from a high altitude in the image to be detected.

[0013] According to one aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to call the instructions stored in the memory to execute the above method.

[0014] According to one aspect of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor.

[0015] In the embodiment of the present disclosure, by acquiring a thermal imaging image, when it is determined that there is a target object in the thermal imaging image, the position information of the target object in the thermal imaging image is determined, and then the shooting parameters of the visible light camera are adjusted according to the position information, and then the image to be detected including the target object is acquired through the adjusted visible light camera, and finally it is determined whether there is a high-altitude throwing behavior in the image to be detected. Since the embodiment of the present disclosure adopts a detection method that combines thermal imaging images with visible light images, the detection method provided by the embodiment of the present disclosure is less affected by the environment, which is conducive to improving the detection accuracy of high-altitude throwing behavior. In addition, the detection method provided by the embodiment of the present disclosure can flexibly adjust the shooting parameters of the visible light camera according to the location of the target object, thereby adjusting the focus position of the visible light camera, thereby reducing the number of cameras installed, which is conducive to reducing the difficulty of hardware wiring and improving detection flexibility.

[0016] It should be understood that the above general description and the following detailed description are exemplary and explanatory only and do not limit the present disclosure. Other features and aspects of the present disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used to illustrate the technical solutions of the present disclosure together with the specification.

[0018] Figure 1 A flow chart of a method for detecting objects thrown from high altitude provided according to an embodiment of the present disclosure is shown.

[0019] Figure 2 A flow chart of a method for detecting objects thrown from high altitude provided according to an embodiment of the present disclosure is shown.

[0020] Figure 3 A reference schematic diagram of a method for detecting objects thrown from high altitude provided according to an embodiment of the present disclosure is shown.

[0021] Figure 4 A reference schematic diagram of a method for detecting objects thrown from high altitude provided according to an embodiment of the present disclosure is shown.

[0022] Figure 5 A block diagram of a device for detecting objects dropped from high altitude provided according to an embodiment of the present disclosure is shown.

[0023] Figure 6 A block diagram of an electronic device provided according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0024] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0025] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0026] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0027] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

[0028] In the related technology, one or more visible light cameras are usually used to collect the images to be detected, and then determine whether the high-altitude throwing behavior occurs in the images to be detected. Therefore, this solution is prone to the following problems: 1. The collected images to be detected are easily affected by the environment such as light, rain and snow, which leads to a low detection accuracy of high-altitude throwing behavior. 2. There is no linkage between the cameras, and the internal parameters of each camera are usually fixed values. The shooting of high-altitude throwing behavior is not flexible and the hardware wiring is difficult.

[0029] In view of this, the embodiment of the present disclosure provides a method for detecting objects thrown from a high altitude, which can obtain a thermal imaging image, and when it is determined that there is a target object in the thermal imaging image, determine the position information of the target object in the thermal imaging image, and then adjust the shooting parameters of the visible light camera according to the position information, and then obtain the image to be detected including the target object through the adjusted visible light camera, and finally determine whether there is a high-altitude throwing behavior in the image to be detected. Since the embodiment of the present disclosure adopts a detection method that combines thermal imaging images with visible light images, the detection method provided by the embodiment of the present disclosure is less affected by the environment, which is conducive to improving the detection accuracy of high-altitude throwing behavior. In addition, the detection method provided by the embodiment of the present disclosure can flexibly adjust the shooting parameters of the visible light camera according to the location of the target object, thereby adjusting the focus position of the visible light camera, and then reduce the number of cameras installed, which is conducive to reducing the difficulty of hardware wiring and improving detection flexibility.

[0030] In a possible implementation, the method for detecting objects thrown from a high altitude can be performed by an electronic device such as a server or a terminal device. The terminal device can be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, a dispatching device, etc. In combination with the actual use scenario, the server can wirelessly interact with a thermal imaging camera, a visible light camera, and a dispatching device. The above-mentioned dispatching device can provide a variety of functions for property staff, such as: lighting control, camera scheduling, access control, etc., which are not described in detail in the embodiments of the present disclosure. After the server detects the target object, the focus area of ​​the visible light camera can be adjusted, and then after detecting the behavior of throwing objects from a high altitude, a prompt is sent to the dispatching device. The above-mentioned detection process and camera calling process can also be implemented by the processor in the dispatching device calling the computer-readable instructions stored in the memory according to the actual situation, which is not limited in the embodiments of the present disclosure.

[0031] See also Figure 1 , Figure 1 A flow chart of a method for detecting objects thrown from a high altitude provided in accordance with an embodiment of the present disclosure is shown. Figure 1 As shown, the detection method comprises:

[0032] Step S100, obtaining a high-altitude thermal imaging image by using a thermal imaging camera.

[0033] Exemplarily, the electronic device can obtain thermal imaging images at high altitudes through a thermal imaging camera interacting with the electronic device. The thermal imaging camera can be set on the facade of a building to shoot different windows of the building. The thermal imaging camera can be set to a wide-angle shooting state to increase the detection range of the thermal imaging camera. Exemplarily, the definition of high altitude can be equivalent to the relevant height range in the regulations on high-altitude throwing. For example, if the relevant regulations state that a person throwing objects from the second floor is considered to be throwing objects from high altitude, then the definition of high altitude can be greater than or equal to the height of the second floor (e.g., the height can be 2.8 meters and above).

[0034] Step S200: When it is determined that there is a target object in the thermal imaging image, determine the position information of the target object in the thermal imaging image.

[0035] Exemplarily, the target object may include the person throwing the object and / or the thrown object. Combined with the actual use environment, in the case of high-altitude throwing, the thermal imaging camera will usually capture the target person. However, when the shooting is unclear or the target person is blocked, when the high-altitude throwing occurs, the target object may only include the thrown object. The composition of the target object and the corresponding processing method will be described in detail later. The target object may be an object whose temperature is within a preset temperature range in the thermal imaging image, or an object whose temperature is higher than a preset temperature threshold, such as a human body, a cigarette, etc. The target object may also be the object that has existed in the thermal imaging image for a preset time, which is not limited in the embodiments of the present disclosure. Exemplarily, the developer may set four coordinate systems corresponding to the camera in the relevant technology for the thermal imaging camera, namely, the world coordinate system, the camera coordinate system, the image coordinate system, and the pixel coordinate system. The mapping relationship and transformation process of the above four coordinate systems can refer to the relevant technology, and the embodiments of the present disclosure will not be repeated here. Exemplarily, the position information of the target object can be expressed as pixel coordinate information in a thermal imaging image, that is, pixel coordinate information in a pixel coordinate system corresponding to a thermal imaging camera, and then the pixel coordinate information can be mapped to a world coordinate system for subsequent steps. The disclosed embodiment can detect the target object through a thermal imaging image that is more sensitive to temperature information, thereby improving the adaptability of the detection method to the environment, and can ensure detection accuracy in conditions of low visibility (such as haze weather and at night). In addition, the imaging focus in thermal imaging images is usually greater than the image details, so thermal imaging images can also reduce the computing power loss of electronic equipment when detecting high-altitude parabolic objects (that is, the detection of target objects can be achieved through a small number of pixels).

[0036] Step S300: adjusting the shooting parameters of the visible light camera according to the position information.

[0037] Exemplarily, the developer may also set the above four coordinate systems corresponding to the visible light camera, and the world coordinate system used by the visible light camera is the same as that used by the thermal imaging camera, so that the coordinate information of the visible light camera and the thermal imaging camera in their respective coordinate systems can be converted to each other. In other words, the world coordinate information corresponding to the target object photographed by the thermal imaging camera is similar to or the same as the world coordinate information corresponding to the target object photographed by the visible light camera, so that the visible light camera can photograph the target object according to the world coordinate information of the target object determined by the thermal imaging camera. In one example, the shooting parameters may include: the horizontal angle, vertical angle, focal length, and distance between the lens and the imaging surface (used for zooming to improve image clarity) of the visible light camera. The horizontal angle and vertical angle may be controlled by the platform motor connected to the visible light camera, and the focal length and distance between the lens and the imaging surface may be controlled by the lens motor in the visible light camera. Exemplarily, the control logic of the platform motor and the lens motor can be set as follows: the platform motor adjusts the vertical and horizontal angles of the optical camera to shorten the distance between the world coordinate information corresponding to the center point of the visible light camera shooting and the world coordinate information of the target position in the same world coordinate system, so that the visible light camera can shoot the target object (for example, the above two world coordinate information can be adjusted to be the same, that is, the target object is located at the center of the image to be detected). The lens motor then substitutes the object distance between the target object and the visible light camera (for example, it can be measured by infrared or ultrasonic distance measurement) into the imaging formula in the relevant technology to determine the focal length change value and the distance change value between the lens and the imaging surface, so as to make the target object in the image to be detected clearer, thereby improving the accuracy of the subsequent determination of whether high-altitude throwing behavior has occurred.

[0038] Step S400, obtaining an image to be detected including the target object through the adjusted visible light camera. Exemplarily, the visible light camera may be in a wide-angle shooting state before adjustment to increase the shooting range of the visible light camera, and then after the thermal imaging camera shoots the target object, the visible light camera adjusts the shooting angle and focal length to focus on the target object.

[0039] Step S500, determining whether there is any high-altitude throwing behavior in the image to be detected.

[0040] Exemplarily, the above-mentioned image to be detected can be input into a high-altitude object dropping detection model in the related art to determine whether there is a high-altitude object dropping behavior in the image to be detected, and the embodiments of the present disclosure are not described in detail here. In one example, if no high-altitude object dropping behavior occurs within a preset time, the visible light camera can be adjusted to a wide-angle shooting state to remove the focus on the target object. In one example, the visible light camera can also be adjusted to a wide-angle shooting state after the target object disappears in the thermal imaging camera, and the embodiments of the present disclosure are not limited here.

[0041] See also Figure 2 , Figure 2 A flow chart of a method for detecting objects thrown from a high altitude provided in accordance with an embodiment of the present disclosure is shown. Figure 2 As shown, in a possible implementation manner, the above detection method further includes:

[0042] Step S600, when it is determined that there is a high-altitude throwing behavior in the image to be detected, determine the parabola position corresponding to the target object in the image to be detected. The parabola position may indicate that the thrown object is thrown from the parabola position, that is, the starting position of the high-altitude throwing behavior. Exemplarily, the above-mentioned parabola position may be represented as a set of pixel points in the image to be detected, which may be represented by pixel coordinate information in a pixel coordinate system corresponding to a visible light camera.

[0043] Step S700, determining the parabolic window according to the parabolic position. For example, the developer can determine the pixel points occupied by the window area corresponding to each window in advance according to the image captured by the camera, so as to establish the correspondence between the windows of the building and the pixel points in the image to be detected, and then when the pixel points corresponding to the parabolic position coincide with the pixel points occupied by a preset window area, the window corresponding to the window area is used as the parabolic window, so as to facilitate the subsequent tracing of the high-altitude parabolic behavior.

[0044] Step S800, generating a parabolic record according to the parabolic window and the image to be detected including the target object. Exemplarily, the electronic device may generate a parabolic record with a parabolic window and the image to be detected including the target object, so as to complete the automatic tracing of high-altitude parabolic objects, thereby reducing the cost of manual tracing. The above-mentioned parabolic record may be expressed as an alarm message, for example: the alarm message may be an audible or visual alarm or a pop-up window alarm of the electronic device. In one example, the above-mentioned parabolic window may also correspond to a room number, a unit number, etc., that is, the room number and the unit number may be included in the parabolic record, so that the property staff can query the owner's information or conduct on-site investigations.

[0045] Continue reading Figure 2 As shown, in a possible implementation, step S800 may include:

[0046] Step S810, determine the suspected person who threw the object based on the entry and exit of the target floor corresponding to the object throwing window. In the embodiment of the present disclosure, the electronic device can improve the probability of locking the suspected person who threw the object by determining the entry and exit of the target floor, thereby improving the success rate of tracing. Exemplarily, when it is determined that no one has entered or exited the target floor within a preset time period, the electronic device can recalculate the target floor to prevent errors in the target floor determination stage from resulting in the inability to automatically trace the source. In one example, when it is determined that no one has entered or exited the target floor within a preset time period, the electronic device can also directly generate a throwing record, and the property staff will manually determine whether a false alarm has occurred.

[0047] In a possible implementation, step S810 may include: determining the target floor corresponding to the parasitic window. Exemplarily, each window of the building may also correspond to floor information to accurately locate the parasitic floor. Then the electronic device determines the entry and exit of personnel on the target floor, and the entry and exit of personnel indicates whether there is a person entering and exiting the target floor within a preset time. The preset time may be a preset length of time near the acquisition time of the image to be detected for determining the presence of high-altitude parasitic behavior. In an example, the electronic device may determine whether there is a person entering and exiting the target floor within a preset time based on the surveillance image and / or elevator stop record corresponding to the target floor. Exemplarily, the surveillance image may include: at least one of an elevator surveillance image and a corridor surveillance image. For example: the above-mentioned elevator stop record can be obtained through the IoT data of the elevator. The electronic device then determines the suspected parasitic person based on the composition of the target object and the presence of the person. In the embodiment of the present disclosure, it can be determined whether there is a person who maliciously throws objects to different floors through the entry and exit of personnel on the target floor, and then the parasitic trajectory of the person who throws objects is determined, which is conducive to improving the tracing depth of the high-altitude parasitic behavior. Exemplarily, if no one enters or exits the target floor within a preset time, the electronic device determines that the floor is an uninhabited floor. For example, based on actual conditions, if the floor is a vacant floor or a vacant unit, and there is a behavior of throwing objects from a high altitude, the electronic device can determine that there is a false alarm in this behavior of throwing objects from a high altitude, and there is no need to remind the property staff. For another example, the electronic device can also send the possible false alarm records of throwing objects to the property staff and give prompts to improve the detection accuracy of high-altitude throwing objects. The embodiments of the present disclosure are not limited here. In one example, if the camera shoots multiple buildings at the same time, the corresponding unit information (such as the unit number) can also be set for each floor shot, so as to query the surveillance image and elevator stop record corresponding to the target floor of a specific unit building.

[0048] In a possible implementation, the above-mentioned determination of a suspected person who throws objects based on the composition of the target object and the entry and exit of the personnel may include: when the entry and exit of the personnel is a preset time and there is a first person entering and exiting the target floor, and the target object only includes the thrown object, determining the first person as a suspected person who throws objects with a first credibility. In combination with actual conditions, if the person who throws objects in the image to be detected is blocked by an object or the shot is not clear (for example: the number of pixels covered by the person who throws objects is less than a preset number, etc.), the electronic device determines that the target object only includes the thrown object, and then regards the first person as a suspected person who may throw objects. Exemplarily, the above-mentioned first credibility is used to indicate the possibility that the suspected person who throws objects is the person who throws objects, and the surveillance images with suspected people who throw objects can be sorted according to the credibility in the throwing record.

[0049] In a possible implementation, the above-mentioned determination of the suspected person throwing objects according to the composition of the target object and the entry and exit of the personnel may include: when the entry and exit of the personnel is that there is a first person entering and exiting the target floor within a preset time, and the target object includes the person throwing objects, the similarity between the person throwing objects and the second target object is determined. Then, when it is determined that the similarity between the person throwing objects and the first person is higher than the first preset similarity, the first person is determined to be a suspected person throwing objects with a second credibility. Wherein the above-mentioned second credibility is higher than the second credibility. In combination with the actual situation, if the person throwing objects in the image to be detected is clear enough and has reference value, the electronic device determines that the target object includes the person throwing objects, and then determines whether the person throwing objects and the first person are the same person according to the similarity algorithm in the relevant technology, and then determines the parabolic trajectory of the person throwing objects, which is conducive to improving the tracing depth of the high-altitude throwing behavior. In addition, since the first preset similarity is set in the embodiment of the present disclosure, the probability that the suspected person throwing objects is the person throwing objects can also be increased, which is conducive to improving the tracing efficiency. Exemplarily, the second credibility is used to indicate the possibility that the person suspected of throwing the object is the person throwing the object. In the object throwing record, the surveillance images with the person suspected of throwing the object can be sorted according to the credibility.

[0050] In a possible implementation, the above-mentioned determination of the suspected person throwing objects according to the composition of the target object and the entry and exit of the personnel may include: when the entry and exit of the personnel is that there is a first person entering and exiting the target floor within a preset time, and the target object only includes the thrown object, determining the first object in the surveillance image corresponding to the first person. Then, when it is determined that the similarity between the thrown object and the first object is higher than the second preset similarity, the first person is determined to be a suspected person throwing objects with a third credibility. Among them, the third credibility is higher than the first credibility. Combined with the actual situation, if the thrown object in the image to be detected is clear enough and has reference value, the electronic device determines whether there is a first object in the surveillance image within the same time period with a similarity higher than the second preset similarity to the thrown object. At this time, the probability that the first person is a person throwing objects is high, thereby improving the detection accuracy of the person throwing objects, and the degree of adaptation of the predicted throwing records and the high-altitude throwing behavior. Exemplarily, the above-mentioned third credibility is used to indicate the possibility that the suspected person throwing objects is the person throwing objects, and the surveillance images with suspected people throwing objects can be sorted according to the credibility in the throwing records.

[0051] Continue reading Figure 2 As shown, step S820 generates a throwing record based on the suspected person throwing objects, the throwing window, and the image to be detected including the target object. Exemplarily, after determining the suspected person throwing objects or the person throwing objects, the electronic device can mark the person throwing objects in the image to be detected or the suspected person throwing objects in the monitoring image with a marking box to facilitate manual screening by property staff. For example: When there is a person throwing objects in the image to be detected and a suspected person throwing objects in the monitoring image, the throwing record may include: the image to be detected marked with a person throwing objects box, the monitoring image marked with a suspected person throwing objects box, the floor and / or room number corresponding to the throwing window, etc.

[0052] In a possible implementation, if the above detection method is applied to a server, the detection method may further include: the server sends the parabolic record to a terminal device. Exemplarily, the terminal device may be the above-mentioned dispatching device. After the dispatching device receives the parabolic record, a manual review prompt is generated, and the property staff determines whether the parabolic record is true, and then the staff can send the discrimination information to the server through the above-mentioned dispatching device. The server obtains the discrimination information sent by the dispatching device in response to the parabolic record, and when it is determined that the discrimination information is confirmation of the parabolic information, the parabolic record is saved to the database, thereby improving the accuracy of the archived records. Exemplarily, the above-mentioned discrimination information may include confirmation of the parabolic information and denial of the parabolic information to indicate whether the above-mentioned parabolic record is saved to the database. The above-mentioned database can be used to save the parabolic record for the property staff to trace the person who threw the parabolic.

[0053] See also Figure 3 , Figure 4 , Figure 3 , Figure 4 A reference schematic diagram of a method for detecting high-altitude objects provided according to an embodiment of the present disclosure is shown, as shown in FIG. Figure 1 As shown,

[0054] Exemplarily, the present disclosure provides an application scenario for reference, where a main controller (eg, a server, a scheduling device, etc., i.e. Figure 3 Central control, Figure 4 The intelligent unit in the Figure 3 , Figure 4 The main controller then detects the possibility of parabolic objects based on the coordinate information of the target object in the thermal imaging image captured by the thermal imaging camera (i.e. Figure 3 Thermal imaging detection coordinates, Figure 4 thermal imaging coordinates), calculate the visible light camera (i.e. Figure 3 , Figure 4 For example, a thermal imaging camera can be used to detect whether there are people or suspicious objects (such as burning cigarettes and other heat sources) moving on the facade behind the balcony. When it is determined that the above phenomenon exists, the coordinate information of the target object in the pixel coordinate system of the thermal imaging camera is mapped to the coordinate information of the target object in the world coordinate system of the visible light camera (that is, Figure 4 The main controller can calculate the shooting parameters (i.e. Figure 3 Medium vertical and horizontal shooting angles and zoom range, Figure 4 The main controller can drive the pan / tilt motor to rotate to the position of the target object (i.e. Figure 4 The main controller then uses a visible light camera to obtain a video of the parabolic phenomenon that may be about to occur (i.e. Figure 4 The main controller confirms whether there is parabolic behavior within a period of time. If not, the visible light camera is adjusted to restore the wide-angle shooting state. If yes, the main controller will Figure 3The controller will make a preliminary judgment based on the floor where the object was thrown) and the unit number, and then call the background elevator IoT (Internet of Things) data or monitoring images to confirm the elevator stops and the recent entry and exit records of people. If the main controller determines that no one has entered or exited the target floor recently, it will reconfirm whether the target floor is correct based on the previous image or video to be detected, or the property staff will directly confirm it manually. If the main controller determines that there has been someone entering or exiting the target floor recently, it will determine that the person is a suspected person who threw objects (that is, Figure 3 ) and automatically generates parabolic records (i.e. Figure 3 Records awaiting manual confirmation, Figure 4 Then the staff will confirm whether to save the throwing record to the database (i.e. Figure 3 (manually generated archives).

[0055] It can be understood that the above-mentioned various method embodiments mentioned in the present disclosure can be combined with each other to form a combined embodiment without violating the principle logic. Due to space limitations, the present disclosure will not repeat them. It can be understood by those skilled in the art that in the above-mentioned method of the specific implementation method, the specific execution order of each step should be determined according to its function and possible internal logic.

[0056] In addition, the present disclosure also provides a device for detecting objects dropped from high places, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any method for detecting objects dropped from high places provided by the present disclosure. The corresponding technical solutions and descriptions are referred to in the corresponding records of the method part and will not be repeated here.

[0057] See also Figure 5 , Figure 5 A block diagram of a device for detecting objects dropped from a high altitude according to an embodiment of the present disclosure is shown. Figure 5 As shown, the detection device 100 includes: a thermal imaging image acquisition module 110, which is used to acquire a thermal imaging image at high altitude through a thermal imaging camera; a position information determination module 120, which is used to determine the position information of the target object in the thermal imaging image when it is determined that there is a target object in the thermal imaging image; a shooting parameter adjustment module 130, which is used to adjust the shooting parameters of the visible light camera according to the position information; a to-be-detected image acquisition module 140, which is used to acquire the to-be-detected image including the target object through the adjusted visible light camera; and a high-altitude throwing detection module 150, which is used to determine whether there is a high-altitude throwing behavior in the to-be-detected image.

[0058] In a possible implementation, the detection device further includes: a parabolic record generation module, configured to perform the following steps: when it is determined that there is high-altitude parabolic behavior in the image to be detected, determining a parabolic position corresponding to a target object in the image to be detected; determining a parabolic window based on the parabolic position; and generating a parabolic record based on the parabolic window and the image to be detected including the target object.

[0059] In a possible implementation, generating a parabolic record based on the parabolic window and the image to be detected including the target object includes: determining a suspected person who throws objects based on the entry and exit of the target floor corresponding to the parabolic window; generating a parabolic record based on the suspected person who throws objects, the parabolic window, and the image to be detected including the target object.

[0060] In a possible implementation, the target object includes: the person who throws the object and / or the thrown object; determining the suspected person who throws the object based on the entry and exit situation of the target floor corresponding to the parabolic window includes: determining the target floor corresponding to the parabolic window; determining the entry and exit situation of people on the target floor, the entry and exit situation of people indicating whether there are people entering and exiting the target floor within a preset time; determining the suspected person who throws the object based on the composition of the target object and the entry and exit situation of people.

[0061] In a possible implementation, the determining of the suspected person who throws objects based on the composition of the target object and the entry and exit of personnel includes: when the entry and exit of personnel is a first person entering and exiting the target floor within a preset time, and the target object includes only the thrown object, determining the first person as a suspected person who throws objects with a first degree of credibility.

[0062] In a possible implementation, determining a suspected person who throws objects based on the composition of the target object and the entry and exit of personnel includes: when the entry and exit of personnel is that a first person enters and exits the target floor within a preset time and the target object includes the person who throws objects, determining the similarity between the person who throws objects and the first person; when it is determined that the similarity between the person who throws objects and the first person is higher than a first preset similarity, determining the first person as a suspected person who throws objects with a second credibility, wherein the second credibility is higher than the first credibility.

[0063] In a possible implementation, determining a suspected person who throws an object based on the composition of the target object and the entry and exit of personnel includes: when the entry and exit of personnel is a first person entering and exiting the target floor within a preset time, and the target object only includes the thrown object, determining a first object in a surveillance image corresponding to the first person, wherein the surveillance image includes: at least one of an elevator surveillance image and a corridor surveillance image; when it is determined that the similarity between the thrown object and the first object is higher than a second preset similarity, determining the first person as a suspected person who throws the object with a third credibility, wherein the third credibility is higher than the first credibility.

[0064] In a possible implementation, determining the entry and exit of personnel on the target floor includes: determining whether there is any personnel entering and exiting the target floor within a preset time based on the surveillance image and / or elevator stop record corresponding to the target floor; wherein the surveillance image includes: at least one of an elevator surveillance image and a corridor surveillance image.

[0065] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0066] The embodiment of the present disclosure also provides a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.

[0067] An embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the above method.

[0068] The embodiments of the present disclosure also provide a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0069] The electronic device may be provided as a terminal, a server, or a device in other forms.

[0070] Figure 6 1 shows a block diagram of an electronic device 1900 provided according to an embodiment of the present disclosure. For example, the electronic device 1900 can be provided as a server or a terminal device. Figure 6, the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions executable by the processing component 1922, such as an application. The application stored in the memory 1932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

[0071] The electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output (I / O) interface 1958. The electronic device 1900 may operate based on an operating system stored in the memory 1932, such as a Microsoft Server operating system (Windows Server 2003). TM ), a graphical user interface operating system launched by Apple (Mac OSX TM ), a multi-user, multi-process computer operating system (Unix TM ), a free and open source Unix-like operating system (Linux TM ), an open source Unix-like operating system (FreeBSD TM ) or similar.

[0072] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to perform the above method.

[0073] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0074] Computer readable storage medium can be a tangible device that can hold and store instructions used by an instruction execution device. Computer readable storage medium can be, for example, (but not limited to) an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (non-exhaustive list) of computer readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, for example, a punch card or a convex structure in a groove on which instructions are stored, and any suitable combination thereof. The computer readable storage medium used here is not interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagated by a waveguide or other transmission medium (for example, a light pulse by an optical fiber cable), or an electrical signal transmitted by a wire.

[0075] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0076] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0077] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0078] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0079] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0080] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

[0081] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (SDK) and the like.

[0082] The above description of various embodiments tends to emphasize the differences between the various embodiments. The same or similar aspects can be referenced to each other, and for the sake of brevity, they will not be repeated herein.

[0083] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0084] If the technical solution of this application involves personal information, the product using the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing the personal information. If the technical solution of this application involves sensitive personal information, the product using the technical solution of this application has obtained the individual's separate consent before processing the sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, clear and prominent signs are set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that he or she agrees to the collection of his or her personal information; or on the device that processes personal information, the personal information processing rules are notified by obvious signs / information, and the individual's authorization is obtained through pop-up information or by asking the individual to upload his or her personal information; among them, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

[0085] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A method for detecting objects thrown from high altitude, characterized in that: The detection method comprises: Use thermal imaging cameras to obtain high-altitude thermal imaging images; In the case where it is determined that a target object exists in the thermal imaging image, determining position information of the target object in the thermal imaging image; According to the position information, adjusting shooting parameters of the visible light camera; Acquiring an image to be detected including the target object through the adjusted visible light camera; Determine whether there is any high-altitude throwing behavior in the image to be detected; The detection method further comprises: In the case where it is determined that there is a high-altitude throwing behavior in the image to be detected, determining the throwing position corresponding to the target object in the image to be detected; Determining a parabolic window according to the parabolic position; Determine the target floor corresponding to the parabolic window; Determine the personnel entry and exit situation of the target floor, wherein the personnel entry and exit situation indicates whether there are personnel entering and exiting the target floor within a preset time; According to the composition of the target object and the entry and exit of the personnel, the suspected person throwing the object is identified; Generate a throwing record according to the suspected person throwing objects, the throwing window, and the image to be detected including the target object, wherein the target object includes: the person throwing objects and / or the thrown object; Determining the suspected person throwing the object according to the composition of the target object and the entry and exit of the person includes: When the personnel entry and exit situation is that a first person enters and exits the target floor within a preset time, and the target object only includes the thrown object, the first person is determined to be a suspected object-throwing person with a first credibility.

2. The detection method according to claim 1, characterized in that Determining the suspected person throwing the object according to the composition of the target object and the entry and exit of the person includes: When the personnel entry and exit situation is that a first person enters and exits the target floor within a preset time, and the target object includes a person who throws objects, determining the similarity between the person who throws objects and the first person; When it is determined that the similarity between the person throwing the object and the first person is higher than a first preset similarity, the first person is determined to be a suspected person throwing the object with a second credibility, wherein the second credibility is higher than the first credibility.

3. The detection method according to claim 1, characterized in that Determining the suspected person throwing the object according to the composition of the target object and the entry and exit of the person includes: When the personnel entry and exit situation is that a first person enters and exits the target floor within a preset time, and the target object only includes the thrown object, determining a first object in a surveillance image corresponding to the first person, wherein the surveillance image includes: at least one of an elevator surveillance image and a corridor surveillance image; When it is determined that the similarity between the thrown object and the first object is higher than a second preset similarity, the first person is determined to be a suspected object thrower with a third credibility, wherein the third credibility is higher than the first credibility.

4. The detection method according to claim 1, characterized in that The determining of the entry and exit of personnel on the target floor includes: According to the surveillance image and / or elevator stop record corresponding to the target floor, determine whether there is a person entering or exiting the target floor within a preset time; wherein the surveillance image includes: at least one of an elevator surveillance image and a corridor surveillance image.

5. A device for detecting objects thrown from high altitude, characterized in that: The detection device comprises: A thermal imaging image acquisition module is used to acquire high-altitude thermal imaging images through a thermal imaging camera; a position information determination module, configured to determine position information of the target object in the thermal imaging image when it is determined that the target object exists in the thermal imaging image; A shooting parameter adjustment module, used to adjust the shooting parameters of the visible light camera according to the position information; An image acquisition module to be detected, used to acquire the image to be detected including the target object through the adjusted visible light camera; A high-altitude object dropping detection module is used to determine whether there is an act of high-altitude object dropping in the image to be detected; The detection device also includes: a parabolic record generation module, which is used to perform the following steps: when it is determined that there is a high-altitude parabolic behavior in the image to be detected, determine the parabolic position corresponding to the target object in the image to be detected; determine the parabolic window according to the parabolic position; determine the target floor corresponding to the parabolic window; determine the entry and exit of personnel on the target floor, the entry and exit of personnel indicating whether there is a person entering and exiting the target floor within a preset time; determine a suspected person who throws objects according to the composition of the target object and the entry and exit of personnel; generate a parabolic record according to the suspected person who throws objects, the parabolic window, and the image to be detected including the target object, the target object including: the person who throws objects and / or the thrown object; the determination of the suspected person who throws objects according to the composition of the target object and the entry and exit of personnel includes: when the entry and exit of personnel indicates that there is a first person entering and exiting the target floor within a preset time, and the target object only includes the thrown object, determining the first person as a suspected person who throws objects with a first credibility.

6. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to call the instructions stored in the memory to execute the detection method described in any one of claims 1 to 4.

7. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the detection method according to any one of claims 1 to 4 is implemented.

Images