Data processing method and device, electronic device, readable medium, product

Abstract

The embodiments of the present application disclose a data processing method and device, an electronic device, a readable medium, and a product. The method includes: receiving video stream data of a monitoring screen transmitted in real time, the video stream data including image frames; performing image recognition on the image frames to obtain image recognition results, and determining the first object in the monitoring screen based on the image recognition results; obtaining the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device, the monitoring screen is a monitoring screen for the specified monitoring area; if the location information successfully matches the location information corresponding to the specified monitoring area, the identification information of the first object is corrected according to the first identification information. The technical solution of the embodiment of the present application improves the accuracy of the identification information and greatly optimizes the processing scheme of the identification information.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method, a data processing device, an electronic device, a computer-readable medium, and a computer program product. Background Art

[0002] At present, in scenarios with high safety requirements, operators need to grasp the production safety information in their jurisdiction in real time so that they can issue real-time alarms when abnormalities occur, thereby ensuring production and operation safety. In related technologies, cameras are usually used for monitoring, and intelligent recognition algorithms are run to identify production activities in the monitoring screen to obtain relevant identification information, but in some special cases, the identification information obtained is not accurate.

[0003] It can be seen that how to improve the accuracy of identification information is an urgent problem to be solved. Summary of the invention

[0004] The embodiments of the present application provide a data processing method and device, an electronic device, a readable medium, and a product, which improve the accuracy of identification information.

[0005] In a first aspect, an embodiment of the present application provides a data processing method, the method comprising: receiving video stream data of a monitoring screen transmitted in real time, the video stream data comprising image frames; performing image recognition on the image frames to obtain image recognition results, and determining a first object in the monitoring screen based on the image recognition results; obtaining first identification information of a terminal device in a specified monitoring area and location information reported by the terminal device, the monitoring screen being a monitoring screen for the specified monitoring area; if the location information successfully matches the location information corresponding to the specified monitoring area, correcting the identification information of the first object according to the first identification information.

[0006] In a second aspect, an embodiment of the present application provides a data processing device, which includes: a receiving module, configured to receive video stream data of a monitoring screen transmitted in real time, the video stream data including image frames; an identification and determination module, configured to perform image recognition on the image frames, obtain image recognition results, and determine a first object in the monitoring screen based on the image recognition results; an acquisition module, configured to obtain first identification information of a terminal device in a specified monitoring area and location information reported by the terminal device, the monitoring screen being a monitoring screen for the specified monitoring area; a correction module, configured to correct the identification information of the first object according to the first identification information if the location information successfully matches the location information corresponding to the specified monitoring area.

[0007] In one embodiment of the present application, based on the aforementioned scheme, the data processing device also includes: a first determination module, configured to determine whether there is a reflection phenomenon in the monitoring screen according to the image recognition result; the acquisition module, configured to execute the step of acquiring the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device if it is determined that there is a reflection phenomenon in the monitoring screen.

[0008] In one embodiment of the present application, based on the aforementioned scheme, the image recognition result includes: at least two object features of the first object; the first determination module is specifically configured to: compare the at least two object features for similarity; if the similarity between a preset number of object features is greater than a preset feature similarity threshold, it is determined that there is a reflection phenomenon in the monitoring screen.

[0009] In one embodiment of the present application, based on the aforementioned scheme, the image recognition result includes: a background image content recognition result of an image frame containing the first object; the first determination module is specifically configured to: compare the similarity between the background image content and the preset reflective area image content; if the similarity between the background image content and the preset reflective area image content is greater than a preset area similarity threshold, it is determined that there is a reflection phenomenon in the monitoring screen.

[0010] In one embodiment of the present application, based on the aforementioned scheme, the location information includes: coordinate information and first timestamp information for reporting the coordinate information; the data processing device also includes: a generation module, configured to record the moment when the reflection phenomenon exists and generate second timestamp information if it is determined that there is a reflection phenomenon in the monitoring screen; a comparison module, configured to compare the first timestamp information with the second timestamp information; a matching module, configured to match the coordinate information with the coordinate information corresponding to the designated monitoring area if the time interval between the first timestamp information and the second timestamp information is less than a preset time interval threshold; a second determination module, configured to determine that the location information successfully matches the location information corresponding to the designated monitoring area if the coordinate information successfully matches the coordinate information corresponding to the designated monitoring area.

[0011] In one embodiment of the present application, based on the aforementioned scheme, the identification information includes: the second identification information of the first object; the correction module is specifically configured to: obtain the second identification information of the first object, and determine the second identification information of the second object that matches the first identification information based on a mapping relationship between a preset terminal device identifier and an object identifier; match the second identification information of the second object with the second identification information of the first object; if the match fails, replace the second identification information of the first object with the second identification information of the second object to correct the second identification information of the first object.

[0012] In one embodiment of the present application, based on the aforementioned scheme, the identification information includes: the quantity information of the first object; the correction module is specifically configured to: match the quantity information of the first identification information with the quantity information of the first object; if the match fails, replace the quantity information of the first object with the quantity information of the first identification information to correct the quantity information of the first object.

[0013] In one embodiment of the present application, based on the aforementioned scheme, the acquisition module is specifically configured as follows: sending a request for acquiring location information to a positioning device, the acquisition request carrying third identification information of a specified monitoring area, the third identification information being used to instruct the positioning device to acquire location information that matches the third identification information; and receiving location information that matches the third identification information sent by the positioning device.

[0014] In one embodiment of the present application, based on the aforementioned scheme, the acquisition module is specifically configured to: receive location information sent by a positioning device; wherein, the location information is sent by the positioning device when it monitors that the location information reported by the terminal device matches the location information of a preset reflective area.

[0015] In one embodiment of the present application, based on the aforementioned scheme, the acquisition module is specifically configured as follows: if the location information fails to match the location information corresponding to the designated monitoring area, then the step of acquiring the first identification information of the terminal device in the designated monitoring area and the location information reported by the terminal device is repeated until the acquired location information successfully matches the location information corresponding to the designated monitoring area, or until a preset acquisition count threshold is reached.

[0016] In one embodiment of the present application, based on the aforementioned scheme, the location information is calculated by the positioning device based on positioning measurement data, wherein the positioning measurement data is calculated by the base station based on the ultra-wideband pulse signal sent by the terminal device in real time and sent to the positioning device.

[0017] In a third aspect, an embodiment of the present application provides an electronic device, comprising one or more processors; a storage device for storing one or more programs, so that when the one or more programs are executed by the one or more processors, the electronic device implements the data processing method as described above.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, enables the computer to execute the data processing method as described above.

[0019] In a fifth aspect, an embodiment of the present application provides a computer program product, including computer instructions, which, when executed by a processor, implement the data processing method as described above.

[0020] In the technical solution provided in the embodiments of the present application, since the first identification information of the terminal device in the designated monitoring area and the location information reported by the terminal device are obtained, the identification information of the obtained first object can be corrected based on the obtained first identification information of the terminal device and the location information reported by the terminal device, thereby ensuring the accuracy of the identification information, avoiding the low accuracy of the identification information obtained only by the identification algorithm, and greatly improving the accuracy of the identification information; and, accurate alarms can be issued based on more accurate identification information, ensuring production and operation safety, etc., and providing reasonable support for management within the jurisdiction.

[0021] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a schematic diagram of an exemplary architecture to which the technical solution of the embodiments of the present application can be applied;

[0023] Figure 2 is a flow chart of a data processing method shown in an exemplary embodiment of the present application;

[0024] Figure 3 is a flow chart of a data processing method shown in an exemplary embodiment of the present application;

[0025] Figure 4 yes Figure 3 S3001 in the illustrated embodiment is a flow chart in an exemplary embodiment;

[0026] Figure 5 yes Figure 3 S3001 in the illustrated embodiment is a flow chart in an exemplary embodiment;

[0027] Figure 6is a flow chart of a data processing method shown in an exemplary embodiment of the present application;

[0028] Figure 7 yes Figure 2 S2004 in the illustrated embodiment is a flow chart in an exemplary embodiment;

[0029] Figure 8 yes Figure 2 S2004 in the illustrated embodiment is a flow chart in an exemplary embodiment;

[0030] Fig. 9 It is a schematic diagram of an exemplary architecture to which the technical solution of the embodiments of the present application can be applied;

[0031] Fig.10 is a flow chart of a data processing method shown in an exemplary embodiment of the present application;

[0032] Fig.11 is a flow chart of a data processing method shown in an exemplary embodiment of the present application;

[0033] Fig.12 is a flow chart of a data processing method shown in an exemplary embodiment of the present application;

[0034] Fig.13 is a block diagram of a data processing device shown in an exemplary embodiment of the present application;

[0035] Fig.14 It is a structural diagram of a computer system suitable for implementing an electronic device of an embodiment of the present application. DETAILED DESCRIPTION

[0036] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments that are the same as the present application. Instead, they are only examples of devices and methods that are the same as some aspects of the present application as detailed in the attached claims.

[0037] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0038] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0039] It should be noted that the "multiple" mentioned in this application refers to two or more than two. "And / or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship.

[0040] Before introducing the technical solutions of the embodiments of the present application, the nouns and terms involved in the embodiments of the present application are explained first. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0041] UWB (Ultra Wide Band): It is a wireless carrier communication technology that does not use a sinusoidal carrier but uses nanosecond non-sinusoidal narrow pulses to transmit data, so it occupies a wider spectrum range. UWB technology has many advantages, such as low system complexity, low power spectrum density of transmitted signals, insensitivity to channel fading, low interception capability, and high positioning accuracy. Therefore, it is particularly suitable for high-speed wireless access in dense multipath places such as indoors.

[0042] It is understandable that the distance measurement principle of UWB technology is based on TOF (Time of Flight) distance measurement. The TOF distance measurement method belongs to a two-way distance measurement technology. It mainly uses the flight time of the signal between two transceivers to measure the distance between nodes. For example, the transmitter of module A transmits a pulse signal of request nature at a1 on its timestamp, and module B transmits a response signal at b2. Module A receives it at its own timestamp a2. The flight time of the pulse signal between module A and module B can be calculated by the formula, thereby determining the flight distance. Because in a line-of-sight environment, the distance measurement method based on TOF is linearly related to the distance, so the measurement result will be more accurate.

[0043] The ranging principle based on UWB technology can make the indoor positioning principle of UWB technology more clear. Among them, the indoor positioning principle of UWB technology is very similar to the satellite positioning principle, that is, a preset number of base stations with known coordinates are arranged indoors. The personnel who need to be positioned carry a locatable terminal device (such as a UWB work card). The terminal device transmits an ultra-wideband pulse signal at a certain frequency, and continuously measures the distance with several base stations. The position of the terminal device (that is, the position of the person carrying the terminal device) can be calculated through a certain positioning algorithm.

[0044] At present, in scenarios with high safety requirements, operators need to grasp the information of people in their jurisdiction in real time so that they can issue real-time alarms when abnormalities occur, thereby ensuring production and operation safety. In related technologies, cameras are usually used for monitoring, and intelligent recognition algorithms are run to identify people in the monitoring images to obtain identification information of people, but in some special cases, the identification information obtained is not accurate.

[0045] See also Figure 1 , Figure 1 FIG. 1 is a schematic diagram of a data processing architecture shown in an embodiment of the present application. Figure 1 It can be seen from the data processing architecture shown that the cloud server 102 has logical computing capabilities. Specifically, the cloud server 102 can receive video stream data of the monitoring screen transmitted in real time by the monitoring device 101, wherein the video stream data includes image frames, and then perform image recognition on the image frames to obtain image recognition results, and determine the first object in the monitoring screen based on the image recognition results. Then, the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device can be obtained from the positioning device 103, wherein the monitoring screen is a monitoring screen for the specified monitoring area, and then if the location information successfully matches the location information corresponding to the specified monitoring area, the identification information of the first object is corrected according to the first identification information.

[0046] The cloud server 102 may be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In one embodiment of the present application, the cloud server 102 may also be an independent physical server, or a server cluster or distributed system composed of multiple physical servers.

[0047] Among them, the monitoring device 101 can be any device with a camera function. It is understandable that the monitoring device 101 usually includes a front-end device and a back-end device. The front-end device usually includes components such as a camera, a manual or electric lens, a pan / tilt, a protective cover, an alarm detector, and a multi-function decoder. They each perform their respective functions and establish corresponding connections (transmitting video / audio signals and control and alarm signals) with various devices in the back-end device such as a control center through wired, wireless or optical fiber transmission media; the components included in the front-end device are not necessarily used at the same time, but the camera and lens for realizing the acquisition of monitoring site images are indispensable.

[0048] Among them, the positioning device 103 can be any device with a positioning function. In one embodiment of the present application, the positioning device includes a positioning platform that communicates with a base station. Optionally, the base station is a base station based on UWB technology, that is, the positioning device can realize the positioning of the terminal device through UWB technology. In one embodiment of the present application, the positioning device can also use other indoor positioning technologies, such as RFID (Radio Frequency Identification) technology, geomagnetic positioning technology, Bluetooth positioning technology, etc. In one embodiment of the present application, the positioning device can also use outdoor positioning technology, such as GPS (Global Positioning System) positioning technology, base station positioning technology, etc. In practical applications, the positioning technology can be flexibly selected according to the specific application scenario to realize the positioning of the terminal device.

[0049] It should be noted that the data processing method provided in the embodiments of the present application can be specifically applied to many application scenarios such as smart factories, data centers, and energy management centers.

[0050] based on Figure 1 In the application scenario shown, after adopting the technical solution of the embodiment of the present application, the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device are obtained through the cloud server. Therefore, the cloud server can correct the identification information of the first object obtained based on the obtained first identification information of the terminal device and the location information reported by the terminal device, thereby ensuring the accuracy of the identification information, avoiding the phenomenon of low accuracy of the identification information obtained only by the recognition algorithm, and greatly improving the accuracy of the identification information.

[0051] It should be noted that in the specific implementation of this application, user-related data (such as feature data, location information reported by terminal devices, etc.) is involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0052] The following is a detailed description of various implementation details of the technical solution of the embodiment of the present application:

[0053] See also Figure 2 , Figure 2 is a flowchart of a data processing method shown in an embodiment of the present application. The data processing method can be Figure 1 Executed by the cloud server 102 shown in FIG. Figure 2 As shown, the data processing method at least includes S2001 to S2004, which are described in detail as follows:

[0054] S2001, receiving video stream data of a monitoring screen transmitted in real time, where the video stream data includes image frames.

[0055] The video stream data of the monitoring screen received in the embodiment of the present application is transmitted in real time by the monitoring device, that is, the video stream data received is the video stream data during the monitoring process. It can be understood that the video stream data is formed by multiple image frames, so the video stream data includes image frames, and the number of image frames included in the video stream data is subject to the actual application scenario.

[0056] S2002, performing image recognition on the image frame to obtain an image recognition result, and determining a first object in the monitoring screen based on the image recognition result.

[0057] In the embodiment of the present application, video stream data of the monitoring screen transmitted in real time is received, and then image recognition can be performed on the image frame to obtain an image recognition result, and the first object in the monitoring screen can be determined based on the obtained image recognition result.

[0058] In one embodiment of the present application, a portion of image frames may be selected, and image recognition may be performed on the selected portion of image frames to obtain image recognition results; for example, an image frame may be selected every 30 seconds, and image recognition may be performed on the selected image frame. In this way, considering that the image content of image frames at adjacent moments does not change much, selecting image frames every preset time period can reduce the frequency of image recognition, thereby saving computing resources and reducing system overhead.

[0059] In one embodiment of the present application, image recognition may be performed on each image frame contained in the video stream data to obtain an image recognition result. In this way, since image recognition is performed on each image frame, the phenomenon of inaccurate recognition in special circumstances is avoided, thereby improving the accuracy of image recognition.

[0060] In the embodiment of the present application, the first object may be an object with life characteristics such as a person or an animal; in other embodiments, the first object may also be an object without life characteristics such as an object. It can be understood that the first object is an object in the monitoring screen determined based on the image recognition result, and the purpose of determining the first object is to determine whether to correct the identification information of the first object based on the relevant information obtained later, so as to obtain accurate identification information of the first object.

[0061] The image recognition result in the embodiment of the present application includes but is not limited to at least two object features of the first object, the background image content recognition result of the image frame containing the first object, etc., wherein:

[0062] The object feature refers to a unique or characteristic feature of the first object. It is understandable that when the image recognition result includes the object feature of the first object, the number of the object features is greater than or equal to 2, thereby facilitating the determination of whether there is a reflection phenomenon in the monitoring image.

[0063] The background image content recognition result refers to the background image content recognition result obtained by performing foreground and background separation processing on the image frame containing the first object. It can be understood that when performing foreground and background separation processing on the image frame containing the first object, the foreground image content recognition result and the background image content recognition result containing the first object are usually obtained. Here, it is sufficient to obtain the background image content recognition result. Since the background image content recognition result includes the monitoring environment, it is convenient to determine whether there is a reflection phenomenon in the monitoring picture.

[0064] It should be noted that the image recognition results listed here are two examples. In actual applications, they can be flexibly adjusted according to specific application scenarios.

[0065] S2003, obtaining first identification information of a terminal device in a designated monitoring area and location information reported by the terminal device, wherein the monitoring screen is a monitoring screen for the designated monitoring area.

[0066] In the embodiment of the present application, image recognition is performed on the image frame to obtain an image recognition result, and the first object in the monitoring screen is determined based on the image recognition result, and then the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device can be obtained.

[0067] The first identification information in the embodiment of the present application refers to information that uniquely identifies a terminal device, including but not limited to a name, an identification number, etc. of the terminal device.

[0068] In the embodiment of the present application, the location information reported by the terminal device refers to information used to characterize the location of the terminal device, which includes but is not limited to coordinate information.

[0069] In one embodiment of the present application, the location information reported by the terminal device includes coordinate information; that is, the location information reported by the terminal device only includes coordinate information.

[0070] In one embodiment of the present application, the location information reported by the terminal device includes coordinate information and first timestamp information of the reported coordinate information; that is, in addition to the coordinate information, the location information reported by the terminal device also includes timestamp information corresponding to the reported coordinate information (i.e., first timestamp information).

[0071] In one embodiment of the present application, see Figure 3Before the process of obtaining the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device in S2003, S3001 to S3002 may also be included, which are described in detail as follows:

[0072] S3001, determining whether there is a reflection phenomenon in the monitoring image according to the image recognition result;

[0073] S3002: If it is determined that there is a reflection phenomenon in the monitoring image, the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device are obtained.

[0074] That is, in an optional embodiment, it is possible to first determine whether there is a reflection phenomenon in the monitoring screen based on the image recognition result, and then determine whether to obtain the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device based on the result of determining whether there is a reflection phenomenon in the monitoring screen.

[0075] Among them, in the optional embodiment, the inventor found that if there is a reflection phenomenon in the monitoring screen, the recognition information of the first object obtained by running the intelligent recognition algorithm to identify the first object in the monitoring screen is usually of low accuracy, while in other scenarios, the recognition information of the first object obtained is usually of high accuracy. Therefore, in the optional embodiment, when it is determined according to the image recognition result that there is a reflection phenomenon in the monitoring screen, the first identification information of the terminal device in the specified monitoring area and the position information reported by the terminal device are obtained, and the identification information of the first object is used for correction processing to obtain accurate identification information of the first object; and when it is determined according to the image recognition result that there is no reflection phenomenon in the monitoring screen, it is not necessary to obtain the first identification information of the terminal device in the specified monitoring area and the position information reported by the terminal device, that is, it is not necessary to correct the identification information of the first object.

[0076] In this way, when it is determined according to the image recognition result that there is a reflection phenomenon in the monitoring screen, the relevant information is obtained to correct the identification information of the first object. When it is determined according to the image recognition result that there is no reflection phenomenon in the monitoring screen, there is no need to obtain relevant information to correct the identification information of the first object. This is more in line with the application scenario. Moreover, since the relevant information is obtained only when there is a reflection phenomenon, compared with obtaining the relevant information every time, computing resources can be saved and system overhead can be reduced.

[0077] In one embodiment of the present application, if the image recognition result includes at least two object features of the first object; Figure 4 The process of determining whether there is a reflection phenomenon in the monitoring image according to the image recognition result in S3001 includes S4001 to S4002, which are described in detail as follows:

[0078] S4001, comparing the similarity of at least two object features;

[0079] S4002: If the similarity between the features of a preset number of objects is greater than a preset feature similarity threshold, it is determined that there is a reflection phenomenon in the monitoring image.

[0080] That is, in an optional embodiment, at least two object features may be compared for similarity, and then whether there is a reflection phenomenon in the monitoring image may be determined based on the similarity comparison result. If there are a preset number of object features whose similarity is greater than a preset feature similarity threshold, then it may be determined that there is a reflection phenomenon in the monitoring image; if there are no preset number of object features whose similarity is greater than a preset feature similarity threshold, then it may be determined that there is no reflection phenomenon in the monitoring image.

[0081] Among them, in the optional embodiment, the preset number and the preset feature similarity threshold can be flexibly set according to the specific application scenario.

[0082] For example, suppose that the image recognition result includes multiple object features a1, a2, and a3 of the first object A, and the preset number is 2, and the preset feature similarity threshold is 90%, then a1, a2, and a3 can be compared for similarity respectively; suppose that after the similarity comparison, it is determined that the similarity between a1 and a2 is 95%, the similarity between a1 and a3 is 99%, and the similarity between a2 and a3 is 92%. Obviously, there are 3 object features whose similarities are greater than the preset feature similarity threshold of 90%. At this time, it can be determined that there is reflection in the monitoring screen.

[0083] In this way, by comparing the similarity between the object features, it is possible to quickly and accurately determine whether there is a reflection phenomenon in the monitoring image.

[0084] In one embodiment of the present application, if the image recognition result includes a background image content recognition result of an image frame including a first object; Figure 5 The process of determining whether there is a reflection phenomenon in the monitoring image according to the image recognition result in S3001 includes S5001 to S5002, which are described in detail as follows:

[0085] S5001, comparing the similarity between the background image content and the preset reflective area image content;

[0086] S5002: If the similarity between the background image content and the preset reflective area image content is greater than the preset area similarity threshold, it is determined that there is a reflection phenomenon in the monitoring image.

[0087] That is, in an optional embodiment, the background image content and the preset reflective area image content can be compared for similarity, and then whether there is a reflective phenomenon in the monitoring screen can be determined based on the similarity comparison result. If the similarity between the background image content and the preset reflective area image content is greater than the preset area similarity threshold, then it can be determined that there is a reflective phenomenon in the monitoring screen; if the similarity between the background image content and the preset reflective area image content is less than or equal to the preset area similarity threshold, then it can be determined that there is no reflective phenomenon in the monitoring screen.

[0088] Among them, in the optional embodiment, the preset reflective area image content can be flexibly set according to the specific application scenario, usually an area that is prone to reflection, such as an area corresponding to a brighter wall, floor, etc.

[0089] For example, if the image recognition result includes background image content K1, and the preset reflective area image content is K2, and the preset area similarity threshold is 80%, then the background image content K1 and the preset reflective area image content K2 can be compared for similarity; if after the similarity comparison, it is determined that the similarity between the background image content K1 and the preset reflective area image content K2 is 90%, which is obviously greater than the preset area similarity threshold of 80%. At this time, it can be determined that there is a reflection phenomenon in the monitoring screen.

[0090] In this way, by comparing the similarity between the background image content and the preset reflective area image content, it is possible to quickly and accurately determine whether there is a reflective phenomenon in the monitoring image.

[0091] In one embodiment of the present application, obtaining the location information reported by the terminal device may include the following:

[0092] A location information acquisition request is sent to the positioning device, wherein the acquisition request carries third identification information of a specified monitoring area, and the third identification information is used to instruct the positioning device to acquire location information matching the third identification information; and location information matching the third identification information sent by the positioning device is received.

[0093] That is, in an optional embodiment, the cloud server can actively obtain the location information reported by the terminal device; specifically, a request for obtaining the location information is sent to the positioning device, wherein the request for obtaining the location information carries third identification information of the specified monitoring area, so that the positioning device can obtain the location information that matches the third identification information, that is, the positioning device obtains the location information reported by the terminal device in the specified monitoring area; accordingly, the cloud server receives the location information sent by the positioning device that matches the third identification information, that is, the cloud server receives the location information reported by the terminal device in the specified monitoring area.

[0094] Among them, the third identification information in the optional embodiment refers to information that uniquely identifies the monitoring area, which includes but is not limited to the name and identification number of the monitoring area.

[0095] In one embodiment of the present application, obtaining the location information reported by the terminal device may include the following:

[0096] Receive location information sent by the positioning device; wherein the location information is sent by the positioning device when it detects that the location information reported by the terminal device matches the location information of the preset reflective area.

[0097] That is, in an optional embodiment, the cloud server can passively obtain the location information reported by the terminal device; specifically, when the positioning device obtains the location information reported by the terminal device, the location information reported by the terminal device is compared with the location information of the preset reflective area. If it is determined that the location information reported by the terminal device matches the location information of the preset reflective area, the location information reported by the terminal device is forwarded to the cloud server; accordingly, the cloud server receives the location information reported by the terminal device sent by the positioning device.

[0098] It should be noted that two examples are listed here for obtaining the location information reported by the terminal device. In actual applications, they can be flexibly adjusted according to specific application scenarios.

[0099] S2004: If the location information successfully matches the location information corresponding to the designated monitoring area, the identification information of the first object is corrected according to the first identification information.

[0100] In an embodiment of the present application, first identification information of a terminal device in a specified monitoring area and location information reported by the terminal device are obtained. If the location information successfully matches the location information corresponding to the specified monitoring area, the identification information of the first object can be corrected based on the first identification information.

[0101] In the embodiment of the present application, the identification information of the first object refers to the identification information of the first object obtained by running the intelligent recognition algorithm to identify the first object in the monitoring screen, which includes but is not limited to the second identification information and quantity information of the first object. Among them, the second identification information refers to the relevant information that characterizes and identifies the first object, including but not limited to the name, nickname, ID number, etc. of the first object. Among them, the quantity information refers to the information about the quantity of the first object, and the second identification information of different first objects is different.

[0102] In one embodiment of the present application, if the location information includes coordinate information and first timestamp information for reporting the coordinate information; Figure 6In S2004, before the process of successfully matching the location information with the location information corresponding to the designated monitoring area, S6001 to S6004 may also be included, which are described in detail as follows:

[0103] S6001, if it is determined that there is a reflection phenomenon in the monitoring image, the time when the reflection phenomenon occurs is recorded to generate second timestamp information;

[0104] S6002, comparing the first timestamp information with the second timestamp information;

[0105] S6003, if the time interval between the first timestamp information and the second timestamp information is less than a preset time interval threshold, matching the coordinate information with the coordinate information corresponding to the designated monitoring area;

[0106] S6004: If the coordinate information successfully matches the coordinate information corresponding to the designated monitoring area, it is determined that the position information successfully matches the position information corresponding to the designated monitoring area.

[0107] That is, in an optional embodiment, if it is determined that there is a reflection phenomenon in the monitoring screen, the moment when the reflection phenomenon exists can be recorded and a second timestamp information can be generated. Then, the first timestamp information reported by the terminal device is compared with the recorded second timestamp information, and then, based on the comparison result, it is determined whether to match the coordinate information reported by the terminal device with the coordinate information of the specified monitoring area. Then, based on the matching result, it is determined whether the position information reported by the terminal device successfully matches the position information corresponding to the specified monitoring area.

[0108] Among them, in an optional embodiment, if the time interval between the first timestamp information reported by the terminal device and the recorded second timestamp information is less than the preset time interval threshold, the coordinate information reported by the terminal device can be further matched with the coordinate information of the specified monitoring area. When the coordinate information reported by the terminal device successfully matches the coordinate information of the specified monitoring area, it can be determined that the location information reported by the terminal device successfully matches the location information corresponding to the specified monitoring area. If the time interval between the first timestamp information reported by the terminal device and the recorded second timestamp information is less than the preset time interval threshold, it can be determined that the location information reported by the terminal device fails to match the location information corresponding to the specified monitoring area.

[0109] In one embodiment of the present application, if the location information fails to match the location information corresponding to the specified monitoring area, the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device can be obtained repeatedly until the obtained location information successfully matches the location information corresponding to the specified monitoring area, or until a preset acquisition number threshold is reached.

[0110] Among them, in the optional embodiment, the preset acquisition times threshold can be flexibly set according to the specific application scenario.

[0111] In one embodiment of the present application, if the identification information includes the second identification information of the first object; see Figure 7 The process of correcting the identification information of the first object according to the first identification information in S2004 may include S7001 to S7003, which are described in detail as follows:

[0112] S7001, acquiring second identification information of a first object, and determining second identification information of a second object matching the first identification information according to a mapping relationship between a preset terminal device identification and an object identification;

[0113] S7002, matching the second identification information of the second object with the second identification information of the first object;

[0114] S7003: If the match fails, the second identification information of the first object is replaced with the second identification information of the second object to correct the second identification information of the first object.

[0115] That is, in an optional embodiment, the second identification information of the first object can be obtained, and the second identification information of the second object that matches the first identification information can be determined based on the mapping relationship between the preset terminal device identifier and the object identifier, and then the second identification information of the second object is matched with the second identification information of the first object, and then it is determined whether to correct the second identification information of the first object based on the matching result.

[0116] Among them, in the optional embodiment, the mapping relationship between the preset terminal device identifier and the object identifier can be flexibly set according to the specific application scenario. The first identification information of a terminal device corresponds to a second object, that is, the first identification information of the terminal device and the second object are in a one-to-one relationship; for example, please refer to Table 1 below, which is an example of a mapping relationship table between the preset terminal device identifier and the object identifier. Therefore, according to the mapping relationship between the preset terminal device identifier and the object identifier, the second identification information of the second object that matches the first identification information of the terminal device can be determined.

[0117] First identification information Second object 1 11 2 21 …… ……

[0118] Table 1

[0119] Among them, in the optional embodiment, the second identification information of the first object is the second identification information to be corrected, and the second identification information of the second object determined according to the mapping relationship between the preset terminal device identifier and the object identifier and matching the first identification information is the correct second identification information; therefore, the second identification information of the second object can be matched with the second identification information of the first object, and it can be determined whether to correct the second identification information of the first object based on the matching result.

[0120] Among them, in the optional embodiment, if the second identification information of the second object fails to match the second identification information of the first object, then the second identification information representing the first object is wrong, and the second identification information of the first object needs to be corrected at this time; specifically, the second identification information of the first object can be replaced with the second identification information of the second object to achieve the correction of the second identification information of the first object. If the second identification information of the second object successfully matches the second identification information of the first object, then the second identification information representing the first object is correct, and there is no need to correct the second identification information of the first object at this time.

[0121] For example, assuming that the second identification information of the first object is 21 and the first identification information is 1, then according to the mapping relationship table of preset terminal device identification and object identification shown in Table 1, it is determined that the second identification information of the second object that matches the first identification information 1 is 11. Obviously, the second identification information 11 of the second object fails to match the second identification information 21 of the first object, so the second identification information 11 of the second object is used to replace the second identification information 21 of the first object, thereby realizing the correction processing of the second identification information 11 of the first object.

[0122] In one embodiment of the present application, if the identification information includes the quantity information of the first object; see Figure 8 The process of correcting the identification information of the first object according to the first identification information in S2004 may include S8001 to S8002, which are described in detail as follows:

[0123] S8001, matching the quantity information of the first identification information with the quantity information of the first object;

[0124] S8002: If the match fails, replace the quantity information of the first object with the quantity information of the first identification information to correct the quantity information of the first object.

[0125] That is, in an optional embodiment, the quantity information of the first identification information may be matched with the quantity information of the first object, and then it is determined whether to perform correction processing on the quantity information of the first object according to the matching result.

[0126] Among them, in an optional embodiment, since the first identification information of the terminal device and the second object are in a one-to-one relationship, the quantity information of the first identification information obtained by statistics can be matched with the quantity information of the first object, and it can be determined whether to correct the quantity information of the first object based on the matching result.

[0127] In the optional embodiment, if the quantity information of the first identification information fails to match the quantity information of the first object, the quantity information representing the first object is wrong, and the quantity information of the first object needs to be corrected; specifically, the quantity information of the first object can be corrected by replacing the quantity information of the first object with the quantity information of the first identification information. If the quantity information of the first identification information successfully matches the quantity information of the first object, the quantity information representing the first object is correct, and there is no need to correct the quantity information of the first object.

[0128] For example, assuming that the quantity information of the first object is 5 and the quantity information of the first identification information is 3, obviously, the quantity information 3 of the first identification information fails to match the quantity information 5 of the first object, then the quantity information 3 of the first identification information is used to replace the quantity information 5 of the first object, thereby correcting the quantity information 5 of the first object.

[0129] In the embodiment of the present application, video stream data of a monitoring screen transmitted in real time is received, and image recognition is performed on image frames contained in the video stream data to obtain an image recognition result. Then, the first object in the monitoring screen is determined based on the image recognition result, and at the same time, it is determined whether there is a reflection phenomenon in the monitoring screen based on the image recognition result. If it is determined that there is a reflection phenomenon in the monitoring screen, first identification information of a terminal device in a specified monitoring area and location information reported by the terminal device are obtained. If the location information successfully matches the location information corresponding to the specified monitoring area, the identification information of the first object is corrected according to the first identification information. Therefore, when there is a reflection phenomenon in the monitoring screen, the correction processing of the identification information of the first object is realized, thereby avoiding the phenomenon of low accuracy of the identification information of the first object caused by the reflection phenomenon, and greatly improving the accuracy of the identification information.

[0130] The following is a detailed description of a specific application scenario of the embodiment of the present application:

[0131] See also Fig. 9 , Fig. 9 FIG. 1 is a schematic diagram of a data processing architecture according to an embodiment of the present application. Fig. 9 As shown, the data processing architecture includes:

[0132] Monitoring equipment 901 (which may be a camera device), visual platform 902 (which may be the cloud server mentioned above), positioning platform 903 (which may be a UWB positioning platform), base station 904 (which may be a UWB base station), and terminal device 905 (which may be a UWB work card).

[0133] Optionally, the camera device associated with the monitoring device 901 can be installed on the wall of the monitoring area (such as a data center site) to collect video stream data of the monitoring area, and transmit the collected video stream data of the monitoring area to a camera platform that communicates with the camera device, and then transmit it to the visual platform 902 by the camera platform. Alternatively, the camera device associated with the monitoring device 901 can also directly transmit the collected video stream data of the monitoring area to the visual platform 902.

[0134] Optionally, the visual platform 902 can obtain video stream data of the monitoring screen transmitted in real time by the monitoring device 901, and be used to perform image recognition on the image frames contained in the video stream data to obtain an image recognition result, and determine the first object in the monitoring screen based on the image recognition result; and can obtain the first identification information of the terminal device 905 in the specified monitoring area sent by the positioning platform 903 and the location information reported by the terminal device 905, and be used to match the location information with the location information corresponding to the specified monitoring area. If the location information successfully matches the location information corresponding to the specified monitoring area, the identification information of the first object is corrected according to the first identification information.

[0135] Optionally, the positioning platform 903 is used to receive positioning measurement data from the base station 904 , run a positioning algorithm, and complete calculation of the position of the terminal device 905 , that is, obtain the position information of the terminal device 905 .

[0136] Optionally, the base station 904 is used to receive a positioning signal sent by the terminal device 905 , and measure the positioning signal to obtain positioning measurement data and send it to the positioning platform 903 .

[0137] Optionally, the terminal device 905 is used to send positioning signals to the surrounding base stations 904; it is understandable that the relevant staff can carry the terminal device when working, specifically, the relevant staff can wear a UWB work card when working.

[0138] based on Fig. 9 The data processing architecture shown in the figure, the data processing method is introduced below, and the details are as follows:

[0139] See also Fig.10 , Fig.10 FIG. 1 is a flow chart of a data processing method according to an embodiment of the present application. Fig.10 As shown, the data processing method at least includes S1001 to S1008, which are described in detail as follows:

[0140] S1001, the terminal device sends a UWB positioning signal to the base station.

[0141] Optionally, the UWB work card sends a positioning signal to surrounding base stations, wherein the positioning signal may be a periodic nanosecond-level wireless ultra-wideband pulse signal.

[0142] S1002: The base station sends positioning measurement data to the positioning platform.

[0143] Optionally, the UWB base station receives the positioning signal sent by the UWB work card and measures the arrival time t1 of the UWB work card positioning signal, wherein each UWB base station will obtain the arrival time for each UWB work card positioning signal, and then each UWB base station will send the measured arrival time t1 to the UWB positioning platform.

[0144] Optionally, each UWB base station records the moment when the positioning signal sent by the UWB work card is received to generate first timestamp information.

[0145] S1003, the positioning platform calculates the location information of the terminal device.

[0146] Optionally, the UWB positioning platform calculates the coordinate information (x, y, z) of the UWB work card based on the positioning measurement data (i.e., arrival time t1) received from each UWB base station, and also obtains the first identification information (such as ID number) of the UWB work card, the map identification information (such as ID number) corresponding to the coordinate information of the UWB work card, and the first timestamp information of the UWB work card.

[0147] S1004, the monitoring device transmits the video stream data of the monitoring screen to the visual platform in real time.

[0148] Optionally, the camera device collects video stream data of the monitoring area and transmits the video stream data of the monitoring screen to the UWB visual platform in real time.

[0149] S1005, the visual platform performs image recognition on the image frames contained in the video stream data to obtain image recognition results, and determines the person in the monitoring screen based on the image recognition results.

[0150] Optionally, the UWB vision platform performs frame processing on the video stream data to obtain image frames, and then performs image recognition on the image frames to obtain image recognition results.

[0151] S1006: The visual platform determines that there is a reflection phenomenon in the monitoring image based on the image recognition result, and then sends a request to obtain the position information to the positioning device.

[0152] Optionally, the UWB vision platform can use the following methods to determine whether there is a reflection phenomenon in the monitoring image based on the image recognition result:

[0153] The image recognition result includes at least two features of the person; specifically, at least two features are compared for similarity, and if the similarity between a preset number of features is greater than a preset feature similarity threshold, it is determined that there is a reflection phenomenon in the monitoring image.

[0154] Optionally, if the UWB vision platform determines that there is a reflection phenomenon in the monitoring picture, the time when the reflection phenomenon exists is recorded to generate second timestamp information.

[0155] Optionally, when the UWB visual platform determines that there is a reflection phenomenon in the monitoring picture based on the image recognition result, it can send a request to obtain the location information to the positioning device, wherein the acquisition request carries the third identification information of the specified monitoring area to instruct the positioning device to obtain the location information matching the third identification information. Optionally, the acquisition request can also carry the map identification information corresponding to the specified monitoring area, as well as the specific area information of the specified monitoring area, for example, the specified monitoring area is a rectangular area, so it can include the coordinate information of each vertex of the rectangle, or the specified monitoring area is a circular area, so it can include the coordinate information of the center of the circle and the length of the radius, etc.

[0156] S1007: The positioning platform sends the first identification information of the terminal device in the designated monitoring area and the location information reported by the terminal device to the visual platform.

[0157] Optionally, when the UWB positioning platform receives a request to obtain the location information sent by the UWB visual platform, it sends the first identification information of the UWB work card and the location information of the UWB work card in the specified monitoring area to the UWB visual platform. Optionally, the location information of the UWB work card may include coordinate information (which may be the coordinate information of the center point) and a first timestamp information. Optionally, the UWB positioning platform may also send the map identification information corresponding to the location information of the UWB work card and the specific area information of the location information to the UWB visual platform. For example, the designated monitoring area corresponding to the location information is an area similar to a rectangle, so it can include the coordinate information of each vertex of the rectangle, or the designated monitoring area corresponding to the location information is an area similar to a circle, so it can include the coordinate information of the center of the circle and the length of the radius, etc.

[0158] It is understandable that, since the relevant staff usually move during work, one UWB work card can correspond to multiple location information.

[0159] S1008, the visual platform matches the location information with the location information corresponding to the designated monitoring area. If the location information matches the location information corresponding to the designated monitoring area successfully, the identification information of the person is corrected according to the first identification information.

[0160] Optionally, the identification information of a person may include the second identification information of the person and the number information of the person; wherein the second identification information of the person may be calculated by the UWB vision platform through a face recognition algorithm, and the number information of the person may be calculated by the UWB vision platform through a human body recognition algorithm.

[0161] Optionally, the identification information includes second identification information of the person; specifically, the UWB visual platform obtains the second identification information of the person, and determines the second identification information of the second object that matches the first identification information based on a mapping relationship between a preset terminal device identification and an object identification; then, the second identification information of the second object is matched with the second identification information of the person, and if the match fails, the second identification information of the person is replaced with the second identification information of the second object to correct the second identification information of the person.

[0162] Optionally, the identification information includes: information on the number of personnel; specifically, the UWB vision platform matches the number information of the first identification information with the number information of the personnel, and if the match fails, replaces the number information of the personnel with the number information of the first identification information to correct the number information of the personnel.

[0163] In the embodiment of the present application, when there is reflection in the monitoring screen, the visual platform actively obtains the first identification information of the terminal device in the designated monitoring area and the location information reported by the terminal device to correct the identification information of the person; specifically, the second identification information of the person obtained by the face recognition algorithm can be corrected, thereby improving the confidence of the person identification; the number information of the person obtained by the body recognition algorithm can be corrected, thereby improving the confidence of the number of people, that is, improving the accuracy of the identification information of the person, thereby providing reasonable support for the management within the jurisdiction.

[0164] See also Fig.11 , Fig.11 FIG. 1 is a flow chart of a data processing method according to an embodiment of the present application. Fig.11 As shown, the data processing method at least includes S1101 to S1108, which are described in detail as follows:

[0165] S1101, the terminal device sends a UWB positioning signal to the base station.

[0166] S1102: The base station sends positioning measurement data to the positioning platform.

[0167] S1103, the positioning platform calculates the location information of the terminal device.

[0168] S1104, the monitoring device transmits the video stream data of the monitoring screen to the visual platform in real time.

[0169] S1105, the visual platform performs image recognition on the image frames contained in the video stream data to obtain image recognition results, and determines the person in the monitoring screen based on the image recognition results.

[0170] Optionally, for the specific implementation process of S1101 to S1105, please refer to the introduction of S1001 to S1005 in the aforementioned embodiment, which will not be repeated here.

[0171] S1106: The visual platform determines that a person has entered the preset reflective area based on the image recognition result, and then sends a request to the positioning device to obtain the location information.

[0172] Optionally, the UWB vision platform can use the following methods to determine that a person has entered a preset reflective area based on the image recognition result:

[0173] The image recognition result includes the background image content recognition result of the image frame containing the person; specifically, the background image content is compared with the preset reflective area image content for similarity, and if the similarity between the background image content and the preset reflective area image content is greater than the preset area similarity threshold, it is determined that a person has entered the preset reflective area in the monitoring image. It is understandable that the presence of a reflective phenomenon in the monitoring image can also be determined at the same time.

[0174] Optionally, for other specific implementation processes of S1106, please refer to the introduction of S1006 in the aforementioned embodiment, which will not be repeated here.

[0175] S1107: The positioning platform sends the first identification information of the terminal device in the designated monitoring area and the location information reported by the terminal device to the visual platform.

[0176] S1108, the visual platform matches the location information with the location information corresponding to the designated monitoring area. If the location information successfully matches the location information corresponding to the designated monitoring area, the identification information of the person is corrected according to the first identification information.

[0177] Optionally, for the specific implementation process of S1107 to S1108, please refer to the introduction of S1007 to S1008 in the aforementioned embodiment, which will not be repeated here.

[0178] In the embodiment of the present application, when a person enters a preset reflective area in the monitoring screen, the visual platform actively obtains the first identification information of the terminal device in the designated monitoring area and the location information reported by the terminal device to correct the identification information of the person; specifically, the second identification information of the person obtained by the face recognition algorithm can be corrected to improve the confidence of the person identification, and the number information of the person obtained by the body recognition algorithm can be corrected to improve the confidence of the number of people, that is, the accuracy of the identification information of the person is improved, providing reasonable support for the management within the jurisdiction.

[0179] See also Fig.12 , Fig.12 FIG. 1 is a flow chart of a data processing method according to an embodiment of the present application. Fig.12 As shown, the data processing method at least includes S1201 to S1207, which are described in detail as follows:

[0180] S1201, the terminal device sends a UWB positioning signal to the base station.

[0181] S1202: The base station sends positioning measurement data to the positioning platform.

[0182] S1203, the positioning platform calculates the location information of the terminal device.

[0183] S1204, the monitoring device transmits the video stream data of the monitoring screen to the visual platform in real time.

[0184] S1205, the visual platform performs image recognition on the image frames contained in the video stream data to obtain image recognition results, and determines the person in the monitoring screen based on the image recognition results.

[0185] Optionally, for the specific implementation process of S1201 to S1205, please refer to the introduction of S1001 to S1005 in the aforementioned embodiment, which will not be repeated here.

[0186] S1206: When the positioning platform detects that the location information reported by the terminal device matches the location information of the preset reflective area, the positioning platform sends the first identification information of the terminal device in the designated monitoring area and the location information reported by the terminal device to the visual platform.

[0187] Optionally, when the positioning platform detects that the location information reported by the terminal device matches the location information of the preset reflective area, it indicates that a person has entered the preset reflective area. At this time, the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device can be actively sent to the visual platform.

[0188] S1207, the visual platform matches the location information with the location information corresponding to the designated monitoring area. If the location information matches the location information corresponding to the designated monitoring area successfully, the identification information of the person is corrected according to the first identification information.

[0189] Optionally, for the specific implementation process of S1207, please refer to the introduction of S1008 in the aforementioned embodiment, which will not be repeated here.

[0190] In the embodiment of the present application, when a person enters a preset reflective area in the monitoring screen, the positioning platform actively sends the first identification information of the terminal device in the specified monitoring area and the position information reported by the terminal device, so that the visual platform can correct the identification information of the person based on the received first identification information of the terminal device in the specified monitoring area and the position information reported by the terminal device; specifically, the second identification information of the person obtained by the face recognition algorithm can be corrected, thereby improving the confidence of the person identification, and the number information of the person obtained by the body recognition algorithm can be corrected, thereby improving the confidence of the number of people, that is, improving the accuracy of the identification information of the person, providing reasonable support for the management within the jurisdiction.

[0191] Fig.13 FIG. 1 is a block diagram of a data processing device according to an embodiment of the present application. Fig.13 As shown, the data processing device includes:

[0192] The receiving module 1301 is configured to receive video stream data of a monitoring screen transmitted in real time, where the video stream data includes image frames;

[0193] The recognition and determination module 1302 is configured to perform image recognition on the image frame, obtain an image recognition result, and determine the first object in the monitoring picture based on the image recognition result;

[0194] The acquisition module 1303 is configured to acquire first identification information of a terminal device in a specified monitoring area and location information reported by the terminal device, wherein the monitoring screen is a monitoring screen for the specified monitoring area;

[0195] The correction module 1304 is configured to correct the identification information of the first object according to the first identification information if the location information successfully matches the location information corresponding to the designated monitoring area.

[0196] In one embodiment of the present application, the data processing device further includes:

[0197] A first determination module is configured to determine whether there is a reflection phenomenon in the monitoring picture according to the image recognition result;

[0198] The acquisition module is configured to execute the step of acquiring the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device if it is determined that there is a reflection phenomenon in the monitoring picture.

[0199] In one embodiment of the present application, the image recognition result includes: at least two object features of the first object; the first determination module is specifically configured as follows:

[0200] Comparing at least two object features for similarity;

[0201] If the similarity between the features of a preset number of objects is greater than a preset feature similarity threshold, it is determined that there is a reflection phenomenon in the monitoring image.

[0202] In one embodiment of the present application, the image recognition result includes: a background image content recognition result of an image frame including a first object; and a first determination module, which is specifically configured as follows:

[0203] Compare the similarity between the background image content and the preset reflective area image content;

[0204] If the similarity between the background image content and the preset reflective area image content is greater than the preset area similarity threshold, it is determined that there is a reflection phenomenon in the monitoring image.

[0205] In one embodiment of the present application, the location information includes: coordinate information and first timestamp information for reporting the coordinate information; the data processing device further includes:

[0206] A generating module configured to record the time when the reflection phenomenon exists and generate second timestamp information if it is determined that the reflection phenomenon exists in the monitoring picture;

[0207] a comparison module, configured to compare the first timestamp information with the second timestamp information;

[0208] a matching module configured to match the coordinate information with coordinate information corresponding to a designated monitoring area if the time interval between the first timestamp information and the second timestamp information is less than a preset time interval threshold;

[0209] The second determination module is configured to determine that the position information successfully matches the position information corresponding to the designated monitoring area if the coordinate information successfully matches the coordinate information corresponding to the designated monitoring area.

[0210] In one embodiment of the present application, the identification information includes: second identification information of the first object; the correction module 1304 is specifically configured as follows:

[0211] Acquire second identification information of the first object, and determine second identification information of the second object matching the first identification information according to a mapping relationship between a preset terminal device identification and an object identification;

[0212] matching the second identification information of the second object with the second identification information of the first object;

[0213] If the match fails, the second identification information of the first object is replaced with the second identification information of the second object to correct the second identification information of the first object.

[0214] In one embodiment of the present application, the identification information includes: quantity information of the first object; the correction module 1304 is specifically configured as follows:

[0215] Matching the quantity information of the first identification information with the quantity information of the first object;

[0216] If the match fails, the quantity information of the first object is replaced with the quantity information of the first identification information to correct the quantity information of the first object.

[0217] In one embodiment of the present application, the acquisition module 1303 is specifically configured as follows:

[0218] Sending a location information acquisition request to the positioning device, the acquisition request carrying third identification information of the specified monitoring area, the third identification information being used to instruct the positioning device to acquire location information matching the third identification information;

[0219] Receive location information sent by the positioning device that matches the third identification information.

[0220] In one embodiment of the present application, the acquisition module 1303 is specifically configured as follows:

[0221] Receive location information sent by the positioning device; wherein the location information is sent by the positioning device when it detects that the location information reported by the terminal device matches the location information of the preset reflective area.

[0222] In one embodiment of the present application, the acquisition module 1303 is specifically configured as follows:

[0223] If the location information fails to match the location information corresponding to the specified monitoring area, repeat the steps of obtaining the first identification information of the terminal device in the specified monitoring area and the location information reported by the terminal device until the obtained location information successfully matches the location information corresponding to the specified monitoring area, or until the preset acquisition number threshold is reached.

[0224] In one embodiment of the present application, the location information is calculated by the positioning device based on positioning measurement data, wherein the positioning measurement data is calculated by the base station based on the ultra-wideband pulse signal sent by the terminal device in real time and sent to the positioning device.

[0225] It should be noted that the device provided in the aforementioned embodiment and the method provided in the aforementioned embodiment belong to the same concept, wherein the specific manner in which each module and unit performs the operation has been described in detail in the method embodiment and will not be repeated here.

[0226] An embodiment of the present application also provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by one or more processors, the electronic device implements the above data processing method.

[0227] Fig.14 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown.

[0228] It should be noted that Fig.14 The computer system 1400 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0229] like Fig.14 As shown, the computer system 1400 includes a central processing unit (CPU) 1401, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1402 or the program loaded from the storage part 1408 to the random access memory (RAM) 1403, such as executing the method in the above embodiment. In the RAM 1403, various programs and data required for system operation are also stored. The CPU 1401, the ROM 1402 and the RAM 1403 are connected to each other through the bus 1404. The input / output (I / O) interface 1405 is also connected to the bus 1404.

[0230] The following components are connected to the I / O interface 1405: an input section 1406 including a keyboard, a mouse, etc.; an output section 1407 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1408 including a hard disk, etc.; and a communication section 1409 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1409 performs communication processing via a network such as the Internet. A drive 1410 is also connected to the I / O interface 1405 as needed. A removable medium 1411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1410 as needed so that a computer program read therefrom is installed into the storage section 1408 as needed.

[0231] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 1409, and / or installed from a removable medium 1411. When the computer program is executed by a central processing unit (CPU) 1401, various functions defined in the system of the present application are executed.

[0232] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium can include a data signal propagated in a baseband or as a part of a carrier wave, wherein a computer-readable computer program is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0233] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0234] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0235] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the data processing method as described above is implemented. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0236] Another aspect of the present application also provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the data processing method provided in each of the above embodiments.

[0237] The above content is only a preferred exemplary embodiment of the present application and is not intended to limit the implementation scheme of the present application. A person skilled in the art can easily make corresponding changes or modifications based on the main concept and spirit of the present application. Therefore, the scope of protection of the present application shall be based on the scope of protection required by the claims.

Claims

1. A data processing method, characterized in that: The method comprises: Receiving video stream data of a monitoring screen transmitted in real time, wherein the video stream data includes image frames; Performing image recognition on the image frame to obtain an image recognition result, and determining a first object in the monitoring picture based on the image recognition result; Acquire first identification information of a terminal device carried by the first object and located in a specified monitoring area and location information reported by the terminal device, wherein the monitoring screen is a monitoring screen for the specified monitoring area; If the location information successfully matches the location information corresponding to the designated monitoring area, the identification information of the first object is corrected according to the first identification information; The identification information includes: second identification information of the first object; and the correction processing of the identification information of the first object according to the first identification information includes: Acquire second identification information of the first object, and determine second identification information of a second object matching the first identification information according to a mapping relationship between a preset terminal device identification and an object identification; matching the second identification information of the second object with the second identification information of the first object; If the match fails, the second identification information of the first object is replaced with the second identification information of the second object to correct the second identification information of the first object.

2. The method according to claim 1, characterized in that Before acquiring the first identification information of the terminal device carried by the first object and located in the specified monitoring area and the location information reported by the terminal device, the method includes: Determining whether there is a reflection phenomenon in the monitoring image according to the image recognition result; If it is determined that there is a reflection phenomenon in the monitoring picture, the step of obtaining the first identification information of the terminal device carried by the first object and located in the specified monitoring area and the location information reported by the terminal device is performed.

3. The method according to claim 2, characterized in that The image recognition result includes: at least two object features of the first object; and determining whether there is a reflection phenomenon in the monitoring picture according to the image recognition result includes: Comparing the at least two object features for similarity; If the similarity between the features of a preset number of objects is greater than a preset feature similarity threshold, it is determined that there is a reflection phenomenon in the monitoring image.

4. The method according to claim 2, characterized in that The image recognition result includes: a background image content recognition result of the image frame containing the first object; and determining whether there is a reflection phenomenon in the monitoring picture according to the image recognition result includes: Comparing the similarity between the background image content and the preset reflective area image content; If the similarity between the background image content and the preset reflective area image content is greater than a preset area similarity threshold, it is determined that there is a reflection phenomenon in the monitoring image.

5. The method according to claim 2, characterized in that The location information includes: coordinate information and first timestamp information for reporting the coordinate information; the method further includes: If it is determined that there is a reflection phenomenon in the monitoring image, the time when the reflection phenomenon occurs is recorded to generate second timestamp information; comparing the first timestamp information with the second timestamp information; If the time interval between the first timestamp information and the second timestamp information is less than a preset time interval threshold, matching the coordinate information with the coordinate information corresponding to the designated monitoring area; If the coordinate information successfully matches the coordinate information corresponding to the designated monitoring area, it is determined that the position information successfully matches the position information corresponding to the designated monitoring area.

6. The method according to claim 1, characterized in that The identification information includes: quantity information of the first object; and the correcting process of the identification information of the first object according to the first identification information includes: Matching the quantity information of the first identification information with the quantity information of the first object; If the match fails, the quantity information of the first object is replaced with the quantity information of the first identification information to correct the quantity information of the first object.

7. The method according to claim 1, characterized in that Obtaining the location information reported by the terminal device, including: Sending a location information acquisition request to a positioning device, wherein the acquisition request carries third identification information of a specified monitoring area, and the third identification information is used to instruct the positioning device to acquire location information matching the third identification information; Receive location information sent by the positioning device that matches the third identification information.

8. The method according to claim 1, characterized in that Obtaining the location information reported by the terminal device, including: Receive location information sent by a positioning device; wherein the location information is sent by the positioning device when it detects that the location information reported by the terminal device matches the location information of a preset reflective area.

9. The method according to claim 7 or 8, characterized in that The location information is calculated by the positioning device based on positioning measurement data, wherein the positioning measurement data is calculated by a base station based on an ultra-wideband pulse signal received and sent in real time by the terminal device and sent to the positioning device.

10. The method according to any one of claims 1 to 8, characterized in that The method further comprises: If the location information fails to match the location information corresponding to the designated monitoring area, repeat the steps of obtaining the first identification information of the terminal device in the designated monitoring area and the location information reported by the terminal device until the obtained location information successfully matches the location information corresponding to the designated monitoring area, or until the preset acquisition number threshold is reached.

11. A data processing device, characterized in that: The device comprises: A receiving module, configured to receive video stream data of a monitoring screen transmitted in real time, wherein the video stream data includes image frames; an identification and determination module, configured to perform image recognition on the image frame to obtain an image recognition result, and determine a first object in the monitoring picture based on the image recognition result; an acquisition module configured to acquire first identification information of a terminal device carried by the first object and located in a specified monitoring area and location information reported by the terminal device, wherein the monitoring screen is a monitoring screen for the specified monitoring area; a correction module, configured to correct the identification information of the first object according to the first identification information if the location information successfully matches the location information corresponding to the designated monitoring area; Among them, the identification information includes: the second identification information of the first object; the correction processing of the identification information of the first object according to the first identification information includes: obtaining the second identification information of the first object, and determining the second identification information of the second object that matches the first identification information according to the mapping relationship between the preset terminal device identifier and the object identifier; matching the second identification information of the second object with the second identification information of the first object; if the match fails, replacing the second identification information of the first object with the second identification information of the second object, so as to correct the second identification information of the first object.

12. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, when the one or more programs are executed by the electronic device, the electronic device implements the data processing method as described in any one of claims 1 to 10.

13. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the data processing method according to any one of claims 1 to 10 is implemented.

14. A computer program product comprising computer instructions, characterized in that When the computer instructions are executed by a processor, the data processing method according to any one of claims 1 to 10 is implemented.

Images