Method for associating shooting data and business data of law enforcement recorder

Abstract

The invention relates to the technical field of video shooting, and discloses a law enforcement recorder shooting data and business data association method comprising the following steps: using a video shooting request to determine whether to start the video shooting authority of a law enforcement recorder; when it is judged that the video shooting permission of the law enforcement recorder is started, the video shooting permission of the law enforcement recorder is started, time correction is conducted on the law enforcement recorder through the data collection device, and the video shooting permission is returned to the mobile device; after the law enforcement recorder is unlocked through the electronic control lock, the law enforcement recorder is used for carrying out video shooting; data acquisition is carried out on the law enforcement recorder through data acquisition equipment, and data calling is carried out on the business data management system; and carrying out data pre-association on the shooting data and the business data so as to carry out association confirmation on the pre-association data through the shooting person and the mobile equipment. According to the invention, the efficiency of establishing the incidence relation between the photographer and the shot video and establishing the incidence relation between the shot video and the business data can be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to a method for associating shooting data of a law enforcement recorder with business data, and belongs to the technical field of video shooting. BACKGROUND

[0002] At present, the association of shooting data of a law enforcement recorder with business data mainly refers to two aspects: 1, the association of shooting data of a law enforcement recorder with a person shooting, that is, to which person the shooting data belongs; 2, the association of shooting data of a law enforcement recorder with business data (for example, alarm data), that is, which piece or pieces of shooting data of a law enforcement recorder correspond to the business data.

[0003] The existing technical solution for associating shooting data of a law enforcement recorder with business data is roughly as follows: 1, after shooting video and audio, the law enforcement recorder is connected to a collection station for data collection, and the existing technical solution is that the collection station checks the binding relationship between the law enforcement recorder and the user before collecting data, if the binding relationship exists, all the video and audio data shot in the body are directly attributed to the bound shooter, if the binding relationship does not exist, the user needs to input his own information to complete the binding, and the collection station attributes all the data in the body to the user just set; 2, after data collection is completed, the collection station pushes the collected data to a management background, and the user directly queries his own video file in the management background and associates it with the business data belonging to himself.

[0004] The existing technology has two shortcomings: 1, in establishing the association relationship between the shooter and the shooting video, the existing technology is to associate after shooting, in the scene of using one device by multiple people, the association and binding operation of the law enforcement recorder and the shooter is very frequent, and the user often forgets to change the binding relationship, resulting in that the data is incorrectly attributed to the name of others; 2, after data collection is completed, the shooter needs to query the business data under his own name in the management background, and then find all the videos he shot to select the matching video for association, this way is first operation lag, and when the time span is large, it is difficult to accurately remember which video is shot at that time, and it is easy to cause association error.

[0005] Therefore, the existing technology has low efficiency in establishing the association relationship between the shooter and the shooting video and establishing the association relationship between the shooting video and the business data. SUMMARY

[0006] The present application provides a method for associating shooting data of a law enforcement recorder with business data, which mainly aims to improve the efficiency of establishing the association relationship between the shooter and the shooting video and establishing the association relationship between the shooting video and the business data.

[0007] To achieve the above-mentioned purpose, the present application provides a method for associating shooting data of a law enforcement recorder with business data, which comprises: The data association system of the law enforcement recorder is determined, wherein the data association system includes a business data management system, a mobile device, a law enforcement recorder, an electronic control lock, and a data acquisition device; The pending business is entered into the business data management system and sent to the photographer. The photographer then sends a video shooting request to the data acquisition device through the mobile device. The data acquisition device uses the video shooting request to determine whether to enable the video shooting permission of the law enforcement recorder. When determining to grant video recording permission to the law enforcement recorder, grant video recording permission to the law enforcement recorder, use the data acquisition device to perform time correction on the law enforcement recorder to obtain correction time information, and return video recording permission to the mobile device based on the correction time information; According to the video shooting permissions and the video shooting permission, after unlocking the law enforcement recorder through the electronic control lock, the law enforcement recorder is used to shoot video, and the video is transmitted to the data acquisition device. Based on the correction time information, the captured video is collected by the data acquisition device to obtain the captured data. Based on the captured data, the business data management system is retrieved to obtain the business data. The captured data and the business data are pre-associated to obtain pre-associated data. The pre-associated data is then sent to the mobile device so that the photographer and the mobile device can confirm the association between the pre-associated data, thereby obtaining the data association result between the captured data and the business data.

[0008] Optionally, determining whether to grant video recording permission to the law enforcement recorder based on the video recording request includes: Search for the account of the person who filmed the video that requested the video recording. The regular expression for the photographer's account was determined using the following method: ; Where, represents a regular expression, represents the prefix of a valid account, represents the set of numbers for a valid account, and represents the suffix of a valid account; The regular expression is used to determine whether the photographer's account is legitimate. When the account of the person filming is legitimate, after storing the account of the person filming in the data acquisition device, it is determined that the video recording permission of the law enforcement recorder is enabled. If the account of the person filming is not legitimate, the video recording permission of the law enforcement recorder will not be granted.

[0009] Optionally, the step of using the data acquisition device to perform time correction on the law enforcement recorder to obtain correction time information includes: Retrieve the device time information of the data acquisition device; Retrieve the recording time information from the law enforcement recorder; Obtain the communication protocol between the data acquisition device and the law enforcement recorder; The time delay of the communication protocol is calculated using the following formula: ; Wherein, represents time delay, represents recorder time information, represents data transmission rate of law enforcement recorder, represents detection data packet, represents start time of propagation of detection data packet, and represents end time of propagation of detection data packet; Based on the time delay, the delay time corresponding to the recorder time information is calculated using the following formula: ; Wherein, represents the delay time, represents the recorder time corresponding to the recorder time information, and represents the time delay; Compare whether the delay time matches the device time corresponding to the device time information; When the delay time matches the device time corresponding to the device time information, the time correction of the law enforcement recorder is completed to obtain the corrected time information; When the delay time is inconsistent with the device time corresponding to the device time information, the law enforcement recorder is time-corrected using the communication protocol to obtain corrected time information.

[0010] Optionally, the step of using the communication protocol and the time delay to perform time correction on the law enforcement recorder to obtain correction time information includes: Obtain the current time of the data acquisition device; Based on the current time, the correction time of the law enforcement recorder is calculated using the following formula: ; Wherein, represents the correction time, represents the current time, represents the data packet containing the correction time sent by the data acquisition device to the law enforcement recorder, represents the data transmission rate of the data acquisition device, represents the probe data packet, represents the start time of the propagation of the probe data packet, and represents the end time of the propagation of the probe data packet. The correction time is sent to the law enforcement recorder via the aforementioned communication protocol; The time in the law enforcement recorder is adjusted to the correction time to complete the time correction of the law enforcement recorder and obtain the correction time information.

[0011] Optionally, unlocking the law enforcement recorder via the electronic control lock based on the video recording permission and the video recording authorization includes: Use the video recording permission to switch the law enforcement recorder from off to on. With the law enforcement recorder activated, an unlocking password is entered into the electronic control lock according to the video recording permission. The stored password in the electronically controlled lock is activated using the video recording permission. After activating the stored password in the electronically controlled lock, compare the unlock password with the stored password in the electronically controlled lock to see if they match. When the unlocking password matches the stored password in the electronically controlled lock, the electronically controlled lock is switched from the closed state to the open state. The process of unlocking the law enforcement recorder is completed when the electronically controlled lock is in the open state.

[0012] Optionally, the step of acquiring video data using the data acquisition device based on the correction time information to obtain the captured data includes: Obtain the time scale corresponding to the correction time information in the data acquisition device; Query the video timing of the captured video; Identify the target time point in the video that is after the time scale; Select the target video corresponding to the target time from the captured video; use the target video as the captured data.

[0013] Optionally, the step of retrieving data from the business data management system based on the captured data to obtain business data includes: Query the business time of pending business transactions in the aforementioned business data management system; The target time for acquiring the captured data; The delay between the service time and the target time is calculated using the following formula: ; Among them, represents the delay duration, represents the time it takes for the pending business to be sent to the photographer, represents the time it takes for the photographer to send a video shooting request to the data acquisition device, represents the time it takes for the data acquisition device to return video shooting permission to the mobile device, and represents the time it takes to unlock the law enforcement recorder; When the time interval between the business time and the target time is similar to the delay duration, the business to be processed is transmitted to the data acquisition device to complete the data retrieval from the business data management system and obtain the business data.

[0014] Optionally, the step of pre-associating the captured data and the business data to obtain pre-associated data includes: The text keywords in the business data are identified using a preset speech-to-text model; Divide the text keywords into noun keywords and verb keywords; The video targets in the captured data are detected using a preset target detection model; When a biological target is present in the video target, the target action of the biological target is identified using a preset action recognition model; Based on the target action, the scene probability value between the video target and the verb keyword is calculated using the following formula: ; Wherein, represents the scene probability value, represents the first video target, represents the value of the target action of the first video target, represents the second video target, represents the value of the target action of the second video target, represents the nth video target, represents the value of the target action of the nth video target, represents the first noun keyword, represents the first verb keyword, represents the second noun keyword, represents the second verb keyword, represents the nth noun keyword, represents the nth verb keyword, represents the probability of simultaneous occurrence, represents the probability of simultaneous occurrence; Target data in the captured data is filtered using the scene probability values; The target data and the business data are pre-associated to obtain pre-associated data.

[0015] Optionally, the step of confirming the association between the pre-associated data and the business data through the photographer and the mobile device to obtain the data association result between the shooting data and the business data includes: Obtain the video targets and target actions of the target data, and the noun keywords and verb keywords of the business data from the pre-association data; Select targets from the video targets that match the noun keywords, and select verbs from the target actions that match the verb keywords; Calculate the background index between the target to be confirmed and the verb to be confirmed; Based on the background index in ascending order, the target to be confirmed and the verb to be confirmed are prioritized to obtain a priority sequence; According to the priority sequence, weighting is performed on the target to be confirmed and the verb to be confirmed to obtain the weighting weights of the target to be confirmed and the verb to be confirmed. Generate the target to be confirmed and the verb to be confirmed as a item to be confirmed; The item to be confirmed is sent to the mobile device to receive the confirmation score from the photographer regarding the item to be confirmed. Based on the weighting and the confirmation score, the association confirmation index of the pre-associated data is calculated using the following formula: ; Where, represents the correlation confirmation index, represents the confirmation score of the i-th item to be confirmed, represents the weighting weight of the i-th item to be confirmed in the i-th video frame, represents the number of video frames contained in the target data, and represents the number of items to be confirmed; When the association confirmation index is greater than the preset association confirmation threshold, the pre-associated data is associated with the photographer's account in the data acquisition device to obtain the data association result.

[0016] Optionally, calculating the background index between the target to be confirmed and the verb to be confirmed includes: Query the image coordinates of the target to be confirmed and the verb to be confirmed in the target data; Extract the neighborhood coordinates of the target to be confirmed and the verb to be confirmed from the target data; Based on the image coordinates and the neighborhood coordinates, the background index of the target to be identified and the verb to be identified is calculated using the following formula: ; ; ; Wherein, represents the background index, represents the actual length, represents the pixel length in the image, represents the distance from the object to the camera, represents the focal length, represents the distance from the object to the camera in image coordinates, and represents the distance from the object to the camera in neighborhood coordinates.

[0017] Compared to the problems described in the background technology, this embodiment of the invention verifies the legitimacy of the user's identity by using the video shooting request to determine whether to enable the video shooting permission of the law enforcement recorder. This embodiment of the invention uses the data acquisition device to perform time correction on the law enforcement recorder to ensure that the clock in the law enforcement recorder is consistent with the clock in the data acquisition device. This embodiment of the invention unlocks the law enforcement recorder using the electronic control lock based on the video shooting permission and the video shooting authorization, thereby unlocking the electronic control lock and enabling the use of the law enforcement recorder. Furthermore, this embodiment of the invention retrieves data from the business data management system based on the shooting data to obtain business data, and then calls the business data associated with the shooting data to subsequently associate the alarm business data and video data in the data acquisition device. This embodiment of the invention pre-associates the shooting data and the business data to determine whether the video content matches the key text stated by the person making the report. Furthermore, this embodiment of the invention confirms the association of the pre-associated data by the person shooting and the mobile device, thereby efficiently associating the person shooting and the shot video, and efficiently associating the shot video and the business data. Therefore, the method for associating law enforcement recorder data with business data provided in this embodiment of the invention can improve the efficiency of establishing the association between the photographer and the video, and the association between the video and the business data. Attached Figure Description

[0018] Figure 1 This is a flowchart illustrating a method for associating data captured by a law enforcement recorder with business data according to an embodiment of the present invention. Figure 2 This is a schematic diagram of a module for implementing a method for associating law enforcement recorder data with business data, according to an embodiment of the present invention.

[0019] The objectives, features, and advantages of this invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0020] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0021] This application provides a method for associating data captured by a law enforcement recorder with business data. The execution subject of this method includes, but is not limited to, at least one of the following electronic devices that can be configured to execute the method provided in this application: a server, a terminal, etc. In other words, the method for associating data captured by a law enforcement recorder with business data can be executed by software or hardware installed on a terminal device or a server device. The server includes, but is not limited to, a single server, a server cluster, a cloud server, or a cloud server cluster.

[0022] Example 1: Reference Figure 1 The diagram shown is a flowchart illustrating a method for associating law enforcement recorder data with business data according to an embodiment of the present invention. In this embodiment, the method for associating law enforcement recorder data with business data includes: S1. Determine the data association system of the law enforcement recorder, wherein the data association system includes a business data management system, a mobile device, a law enforcement recorder, an electronic control lock, and a data acquisition device.

[0023] In this embodiment of the invention, the business data management system refers to a system that manages business data such as user alarms; the mobile device refers to a mobile phone device held by the person taking the picture; the law enforcement recorder refers to a device used to record law enforcement videos; the electronic control lock refers to a tool associated with the law enforcement recorder and used to unlock and lock the law enforcement recorder; and the data acquisition device refers to a data processing center that receives and parses video data from the law enforcement recorder.

[0024] S2. The pending business is entered into the business data management system and sent to the photographer. The photographer sends a video shooting request to the data acquisition device through the mobile device. The data acquisition device uses the video shooting request to determine whether to enable the video shooting permission of the law enforcement recorder.

[0025] In this embodiment of the invention, the pending service refers to a service sent by a user requesting the photographer to record video, such as the user's alarm data. The video recording request refers to a request sent by the photographer to the data acquisition device via the mobile device to use the law enforcement recorder.

[0026] Furthermore, in this embodiment of the invention, the video recording request is used to determine whether to enable the video recording permission of the law enforcement recorder in order to verify the legitimacy of the user's identity.

[0027] In one embodiment of the present invention, determining whether to enable video recording permission of the law enforcement recorder using the video recording request includes: querying the account of the person recording the video recording request; and determining the regular expression of the account of the person recording the video recording using the following method: ; Where, represents a regular expression, represents the prefix of a valid account, represents the set of numbers for a valid account, and represents the suffix of a valid account; The regular expression is used to determine whether the videographer's account is legitimate. If the videographer's account is legitimate, the videographer's account is stored in the data acquisition device, and the video recording permission of the law enforcement recorder is enabled. If the videographer's account is not legitimate, the video recording permission of the law enforcement recorder is not enabled.

[0028] The photographer's account refers to the unique login account used by the photographer to communicate between the mobile device and the data acquisition device.

[0029] S3. When it is determined that the video recording permission of the law enforcement recorder is to be enabled, the video recording permission of the law enforcement recorder is enabled, the time of the law enforcement recorder is corrected using the data acquisition device to obtain the corrected time information, and the video recording permission is returned to the mobile device based on the corrected time information.

[0030] This invention provides an embodiment of the invention that uses the data acquisition device to perform time correction on the law enforcement recorder, thereby ensuring that the clock in the law enforcement recorder is consistent with the clock in the data acquisition device.

[0031] In one embodiment of the present invention, the step of using the data acquisition device to perform time correction on the law enforcement recorder to obtain correction time information includes: retrieving the device time information of the data acquisition device; retrieving the recorder time information of the law enforcement recorder; obtaining the communication protocol between the data acquisition device and the law enforcement recorder; and calculating the time delay of the communication protocol using the following formula: ; Wherein, represents time delay, represents recorder time information, represents data transmission rate of law enforcement recorder, represents detection data packet, represents start time of propagation of detection data packet, and represents end time of propagation of detection data packet; Based on the time delay, the delay time corresponding to the recorder time information is calculated using the following formula: ; Wherein, represents the delay time, represents the recorder time corresponding to the recorder time information, and represents the time delay; The delay time is compared with the device time corresponding to the device time information to determine if they are consistent. If they are consistent, the time of the law enforcement recorder is corrected to obtain corrected time information. If they are inconsistent, the time of the law enforcement recorder is corrected to obtain corrected time information using the communication protocol.

[0032] The device time information mainly includes the time scale of the data acquisition device. The time delay refers to the time delay of transmitting the recorder time information from the law enforcement recorder to the data acquisition device. Since the recorder time information records the time before data transmission, and the recorder time information is still the time before data transmission during data transmission, the delay caused by data transmission needs to be considered. The correction time information is the time recorded simultaneously in the data acquisition device and the law enforcement recorder. The data acquisition device needs to record the start time of the person filming the video, which is the correction time information, such as the calculated correction time and the time when the device is operating normally when the delay time is consistent with the device time information.

[0033] Optionally, the process of completing the time correction of the law enforcement recorder and obtaining the corrected time information when the delay time is consistent with the device time corresponding to the device time information means that the time information of the law enforcement recorder is not changed and normal operation is maintained.

[0034] In another embodiment of the present invention, the step of using the communication protocol and the time delay to perform time correction on the law enforcement recorder to obtain correction time information includes: acquiring the current time of the data acquisition device; and calculating the correction time of the law enforcement recorder based on the current time using the following formula: ; Wherein, represents the correction time, represents the current time, represents the data packet containing the correction time sent by the data acquisition device to the law enforcement recorder, represents the data transmission rate of the data acquisition device, represents the probe data packet, represents the start time of the propagation of the probe data packet, and represents the end time of the propagation of the probe data packet. The correction time is sent to the law enforcement recorder via the communication protocol; the time in the law enforcement recorder is adjusted to the correction time, and the time correction of the law enforcement recorder is completed to obtain the correction time information.

[0035] In this embodiment of the invention, the video recording permission refers to permission information that includes a password for unlocking the electronically controlled lock.

[0036] S4. Based on the video shooting permissions and the video shooting permit, after unlocking the law enforcement recorder through the electronic control lock, use the law enforcement recorder to shoot video, obtain the shot video, and transmit the shot video to the data acquisition device.

[0037] In this embodiment of the invention, the law enforcement recorder is unlocked by the electronic control lock according to the video recording permission and the video recording authorization, thereby unlocking the electronic control lock and using the law enforcement recorder.

[0038] In one embodiment of the present invention, unlocking the law enforcement recorder via the electronic control lock according to the video recording permission and the video recording authorization includes: switching the law enforcement recorder from a closed state to an open state using the video recording permission; inputting an unlocking password into the electronic control lock according to the video recording authorization while the law enforcement recorder is in the open state; activating a stored password in the electronic control lock using the video recording permission; comparing the unlocking password with the stored password after activating the stored password; switching the electronic control lock from a closed state to an open state when the unlocking password matches the stored password; and completing the unlocking process of the law enforcement recorder while the electronic control lock is in the open state.

[0039] The storage password refers to the password that is the same as the unlock password, which is transmitted by the data acquisition device to the electronic control lock through the video shooting permission. That is, after the video shooting permission of the law enforcement recorder is enabled, the data acquisition device sends a storage password to the electronic control lock.

[0040] Optionally, the process of inputting the unlocking password into the electronic control lock according to the video recording permission refers to the person recording the video entering the unlocking password into the electronic control lock after receiving the unlocking password to unlock it.

[0041] Furthermore, in this embodiment of the invention, the video being filmed is the video taken by the person filming using the law enforcement recorder. Since the law enforcement recorder has not yet arrived at the law enforcement scene, it may capture some irrelevant video data, which needs to be removed during the subsequent data association process.

[0042] S5. Based on the correction time information, the captured video is collected by the data acquisition device to obtain the captured data. Based on the captured data, the data is retrieved from the business data management system to obtain the business data.

[0043] In one embodiment of the present invention, the step of acquiring data from the captured video using the data acquisition device based on the correction time information to obtain captured data includes: obtaining the time scale corresponding to the correction time information in the data acquisition device; querying the video time of the captured video; identifying a target time after the time scale in the video time; selecting a target video corresponding to the target time in the captured video; and using the target video as captured data.

[0044] Furthermore, in this embodiment of the invention, the business data management system is retrieved based on the captured data to obtain business data, which is then used to call the business data associated with the captured data and subsequently associate the alarm business data with the video data in the data acquisition device.

[0045] In one embodiment of the present invention, the step of retrieving data from the business data management system based on the captured data to obtain business data includes: querying the business time of pending business in the business data management system; obtaining the target time of the captured data; and calculating the delay between the business time and the target time using the following formula: ; Among them, represents the delay duration, represents the time it takes for the pending business to be sent to the photographer, represents the time it takes for the photographer to send a video shooting request to the data acquisition device, represents the time it takes for the data acquisition device to return video shooting permission to the mobile device, and represents the time it takes to unlock the law enforcement recorder; When the time interval between the business time and the target time is similar to the delay duration, the business to be processed is transmitted to the data acquisition device to complete the data retrieval from the business data management system and obtain the business data.

[0046] S6. Perform data pre-association between the shooting data and the business data to obtain pre-association data, and send the pre-association data to the mobile device so that the photographer and the mobile device can confirm the association between the pre-association data to obtain the data association result between the shooting data and the business data.

[0047] In this embodiment of the invention, the video content is determined to match the key text stated by the person making the alarm by pre-correlating the captured data with the business data.

[0048] In one embodiment of the present invention, the step of pre-associating the captured data and the business data to obtain pre-associated data includes: identifying text keywords in the business data using a preset speech-to-text model; classifying the text keywords into noun keywords and verb keywords; detecting video targets in the captured data using a preset target detection model; identifying the target actions of the biological targets when biological targets are present in the video targets using a preset action recognition model; and calculating the scene probability value between the video targets and the verb keywords based on the target actions using the following formula: ; Wherein, represents the scene probability value, represents the first video target, represents the value of the target action of the first video target, represents the second video target, represents the value of the target action of the second video target, represents the nth video target, represents the value of the target action of the nth video target, represents the first noun keyword, represents the first verb keyword, represents the second noun keyword, represents the second verb keyword, represents the nth noun keyword, represents the nth verb keyword, represents the probability of simultaneous occurrence, represents the probability of simultaneous occurrence; The target data in the shooting data is filtered by the scene probability value; the target data and the business data are pre-associated to obtain pre-associated data.

[0049] The target detection model refers to a model for identifying targets, and the action recognition model refers to a model for identifying human or animal limb movements. Furthermore, it should be noted that each verb keyword and its following noun keyword form a combination. For example, in the phrase "on fire," "fire" is the noun following "on fire," so it is either "on fire" or "occurring." If a noun does not have a corresponding action, the action value is 0; if an action does not have a corresponding noun, the noun value is 0. The same applies to combinations. The target data refers to video data that matches the key text stated by the person making the alarm, when the scene probability value is greater than a preset probability threshold.

[0050] Furthermore, in this embodiment of the invention, the photographer and the mobile device confirm the association of the pre-associated data to efficiently associate the photographer with the video and efficiently associate the video with business data.

[0051] In one embodiment of the present invention, the step of confirming the association between the pre-association data by the photographer and the mobile device to obtain the data association result between the shooting data and the business data includes: obtaining the video target and target action of the target data, and the noun keywords and verb keywords of the business data in the pre-association data; selecting a target to be confirmed that matches the noun keywords from the video targets, and selecting a verb to be confirmed that matches the verb keywords from the target actions; querying the image coordinates of the target and the verb to be confirmed in the target data; extracting the neighborhood coordinates of the target and the verb to be confirmed in the target data; and calculating the background index of the target and the verb to be confirmed using the following formula based on the image coordinates and the neighborhood coordinates: ; ; ; Wherein, represents the background index, represents the actual length, represents the pixel length in the image, represents the distance from the object to the camera, represents the focal length, represents the distance from the object to the camera in the image coordinates, and represents the distance from the object to the camera in the neighborhood coordinates. Based on the ascending order of the background indices, the targets to be confirmed and the verbs to be confirmed are prioritized to obtain a priority sequence; based on the priority sequence, weights are assigned to the targets to be confirmed and the verbs to be confirmed to obtain weights; the targets to be confirmed and the verbs to be confirmed are generated as items to be confirmed; the items to be confirmed are sent to the mobile device to receive the confirmation score from the photographer regarding the items to be confirmed; based on the weights and the confirmation scores, the association confirmation index of the pre-associated data is calculated using the following formula: ; Where, represents the correlation confirmation index, represents the confirmation score of the i-th item to be confirmed, represents the weighting weight of the i-th item to be confirmed in the i-th video frame, represents the number of video frames contained in the target data, and represents the number of items to be confirmed; When the association confirmation index is greater than the preset association confirmation threshold, the pre-associated data is associated with the photographer's account in the data acquisition device to obtain the data association result.

[0052] The priority sequence is arranged from high to low, meaning the smaller the background index value, the higher the priority, and the larger the subsequent weighting weight. The weighting weight is a weight divided into equal intervals of 0 to 1. For example, if the priority sequence is high, medium, and low, then the weighting weight is calculated with each weight separated by a certain interval. The confirmation score refers to the number of confirmation options available when the photographer confirms the item on their mobile device, such as yes, ambiguous, or no. The weight of each confirmation option is used as the confirmation score. The item to be confirmed includes the target to be confirmed and the verb to be confirmed. The target to be confirmed and the verb to be confirmed are sent to the photographer for review and confirmation. If the target and verb to be confirmed exist in the field, select "Yes" for confirmation if they do; if the memory is unclear, select "Unclear"; if they do not exist, select "No". Each confirmation option has a weight, with "Yes" having a greater weight than "Unclear", and "Unclear" having a greater weight than "No". The principle for determining the weight of the confirmation option is similar to the principle of assigning weights to the target and verb to be confirmed based on the priority sequence, and will not be elaborated further here. The association confirmation threshold is a threshold determined by a large amount of historical experience, and will not be elaborated further here.

[0053] It should be noted that when calculating the actual length, a reference object with a known height is found in the real scene. Based on the mapping relationship between the actual height of this physical reference object and the image height, the actual lengths of other image objects in the real world are calculated sequentially.

[0054] Compared to the problems described in the background technology, this embodiment of the invention verifies the legitimacy of the user's identity by using the video shooting request to determine whether to enable the video shooting permission of the law enforcement recorder. This embodiment of the invention uses the data acquisition device to perform time correction on the law enforcement recorder to ensure that the clock in the law enforcement recorder is consistent with the clock in the data acquisition device. This embodiment of the invention unlocks the law enforcement recorder using the electronic control lock based on the video shooting permission and the video shooting authorization, thereby unlocking the electronic control lock and enabling the use of the law enforcement recorder. Furthermore, this embodiment of the invention retrieves data from the business data management system based on the shooting data to obtain business data, and then calls the business data associated with the shooting data to subsequently associate the alarm business data and video data in the data acquisition device. This embodiment of the invention pre-associates the shooting data and the business data to determine whether the video content matches the key text stated by the person making the report. Furthermore, this embodiment of the invention confirms the association of the pre-associated data by the person shooting and the mobile device, thereby efficiently associating the person shooting and the shot video, and efficiently associating the shot video and the business data. Therefore, the method for associating law enforcement recorder data with business data provided in this embodiment of the invention can improve the efficiency of establishing the association between the photographer and the video, and the association between the video and the business data.

[0055] Example 2: like Figure 2 The diagram shown is a system functional module diagram of the present invention for associating law enforcement recorder data with business data.

[0056] The system 200 for associating law enforcement recorder data with business data, as described in this invention, can be installed in an electronic device. Depending on the functions implemented, the system may include a system determination module 201, a permission activation module 202, a permission return module 203, a video transmission module 204, a data retrieval module 205, and a data association module 206. The module described in this invention can also be referred to as a unit, which is a series of computer program segments that can be executed by the processor of an electronic device and perform a fixed function, stored in the memory of the electronic device.

[0057] In this embodiment of the invention, the functions of each module / unit are as follows: The system determination module 201 is used to determine the data association system of the law enforcement recorder, wherein the data association system includes a business data management system, a mobile device, a law enforcement recorder, an electronic control lock, and a data acquisition device; The permission enabling module 202 is used to input the pending business into the business data management system and send the pending business to the photographer. The photographer sends a video shooting request to the data acquisition device through the mobile device. The data acquisition device uses the video shooting request to determine whether to enable the video shooting permission of the law enforcement recorder. The permission return module 203 is used to enable the video recording permission of the law enforcement recorder when it is determined that the video recording permission of the law enforcement recorder is enabled, to perform time correction on the law enforcement recorder using the data acquisition device to obtain correction time information, and to return video recording permission to the mobile device based on the correction time information. The video transmission module 204 is used to unlock the law enforcement recorder through the electronic control lock according to the video shooting permission and the video shooting authorization, then use the law enforcement recorder to shoot video, obtain the shot video, and transmit the shot video to the data acquisition device; The data retrieval module 205 is used to collect data from the captured video through the data acquisition device according to the correction time information to obtain the captured data, and retrieve data from the business data management system based on the captured data to obtain business data. The data association module 206 is used to pre-associate the shooting data and the business data to obtain pre-associated data, and send the pre-associated data to the mobile device so that the photographer and the mobile device can confirm the association of the pre-associated data to obtain the data association result between the shooting data and the business data.

[0058] In detail, the modules in the system 200 for associating law enforcement recorder data with business data in this embodiment of the invention employ the same methods as described above. Figure 1 The method used to associate the data captured by the law enforcement recorder with the business data described in the article is the same as the technical means and can produce the same technical effect, so it will not be repeated here.

[0059] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0060] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. A method for linking data captured by a law enforcement recorder with business data, characterized in that, The method includes: The data association system of the law enforcement recorder is determined, wherein the data association system includes a business data management system, a mobile device, a law enforcement recorder, an electronic control lock, and a data acquisition device; The pending business is entered into the business data management system and sent to the photographer. The photographer then sends a video shooting request to the data acquisition device through the mobile device. The data acquisition device uses the video shooting request to determine whether to enable the video shooting permission of the law enforcement recorder. When determining to grant video recording permission to the law enforcement recorder, grant video recording permission to the law enforcement recorder, use the data acquisition device to perform time correction on the law enforcement recorder to obtain correction time information, and return video recording permission to the mobile device based on the correction time information; According to the video shooting permissions and the video shooting permission, after unlocking the law enforcement recorder through the electronic control lock, the law enforcement recorder is used to shoot video, and the video is transmitted to the data acquisition device. Based on the correction time information, the captured video is collected by the data acquisition device to obtain the captured data. Based on the captured data, the business data management system is retrieved to obtain the business data. The captured data and the business data are pre-associated to obtain pre-associated data. The pre-associated data is then sent to the mobile device so that the photographer and the mobile device can confirm the association between the pre-associated data, thereby obtaining the data association result between the captured data and the business data.

2. The method for associating law enforcement recorder data with business data as described in claim 1, characterized in that, The step of determining whether to grant video recording permission to the law enforcement recorder based on the video recording request includes: Search for the account of the person who filmed the video that requested the video recording. The regular expression for the photographer's account was determined using the following method: ； Where, represents a regular expression, represents the prefix of a valid account, represents the set of numbers for a valid account, and represents the suffix of a valid account; The regular expression is used to determine whether the photographer's account is legitimate. When the account of the person filming is legitimate, after storing the account of the person filming in the data acquisition device, it is determined that the video recording permission of the law enforcement recorder is enabled. If the account of the person filming is not legitimate, the video recording permission of the law enforcement recorder will not be granted.

3. The method for associating law enforcement recorder data with business data as described in claim 1, characterized in that, The step of using the data acquisition device to perform time correction on the law enforcement recorder to obtain corrected time information includes: Retrieve the device time information of the data acquisition device; Retrieve the recording time information from the law enforcement recorder; Obtain the communication protocol between the data acquisition device and the law enforcement recorder; The time delay of the communication protocol is calculated using the following formula: ； Wherein, represents time delay, represents recorder time information, represents data transmission rate of law enforcement recorder, represents detection data packet, represents start time of propagation of detection data packet, and represents end time of propagation of detection data packet; Based on the time delay, the delay time corresponding to the recorder time information is calculated using the following formula: ； Wherein, represents the delay time, represents the recorder time corresponding to the recorder time information, and represents the time delay; Compare whether the delay time matches the device time corresponding to the device time information; When the delay time matches the device time corresponding to the device time information, the time correction of the law enforcement recorder is completed to obtain the corrected time information; When the delay time is inconsistent with the device time corresponding to the device time information, the law enforcement recorder is time-corrected using the communication protocol to obtain corrected time information.

4. The method for associating law enforcement recorder data with business data as described in claim 3, characterized in that, The step of using the communication protocol and the time delay to perform time correction on the law enforcement recorder to obtain corrected time information includes: Obtain the current time of the data acquisition device; Based on the current time, the correction time of the law enforcement recorder is calculated using the following formula: ； Wherein, represents the correction time, represents the current time, represents the data packet containing the correction time sent by the data acquisition device to the law enforcement recorder, represents the data transmission rate of the data acquisition device, represents the probe data packet, represents the start time of the propagation of the probe data packet, and represents the end time of the propagation of the probe data packet. The correction time is sent to the law enforcement recorder via the aforementioned communication protocol; The time in the law enforcement recorder is adjusted to the correction time to complete the time correction of the law enforcement recorder and obtain the correction time information.

5. The method for associating law enforcement recorder data with business data as described in claim 1, characterized in that, The step of unlocking the law enforcement recorder via the electronic control lock according to the video recording permission and the video recording authorization includes: Use the video recording permission to switch the law enforcement recorder from off to on. With the law enforcement recorder activated, an unlocking password is entered into the electronic control lock according to the video recording permission. The stored password in the electronically controlled lock is activated using the video recording permission. After activating the stored password in the electronically controlled lock, compare the unlock password with the stored password in the electronically controlled lock to see if they match. When the unlocking password matches the stored password in the electronically controlled lock, the electronically controlled lock is switched from the closed state to the open state. The process of unlocking the law enforcement recorder is completed when the electronically controlled lock is in the open state.

6. The method for associating law enforcement recorder data with business data as described in claim 1, characterized in that, The step of acquiring video data using the data acquisition device based on the correction time information to obtain video data includes: Obtain the time scale corresponding to the correction time information in the data acquisition device; Query the video timing of the captured video; Identify the target time point in the video that is after the time scale; Select the target video corresponding to the target time from the captured video; use the target video as the captured data.

7. The method for associating law enforcement recorder data with business data as described in claim 1, characterized in that, The step of retrieving data from the business data management system based on the captured data to obtain business data includes: Query the business time of pending business transactions in the aforementioned business data management system; The target time for acquiring the captured data; The delay between the service time and the target time is calculated using the following formula: ； Among them, represents the delay duration, represents the time it takes for the pending business to be sent to the photographer, represents the time it takes for the photographer to send a video shooting request to the data acquisition device, represents the time it takes for the data acquisition device to return video shooting permission to the mobile device, and represents the time it takes to unlock the law enforcement recorder; When the time interval between the business time and the target time is similar to the delay duration, the business to be processed is transmitted to the data acquisition device to complete the data retrieval from the business data management system and obtain the business data.

8. The method for associating law enforcement recorder data with business data as described in claim 1, characterized in that, The step of pre-associating the captured data and the business data to obtain pre-associated data includes: The text keywords in the business data are identified using a preset speech-to-text model; Divide the text keywords into noun keywords and verb keywords; The video targets in the captured data are detected using a preset target detection model; When a biological target is present in the video target, the target action of the biological target is identified using a preset action recognition model; Based on the target action, the scene probability value between the video target and the verb keyword is calculated using the following formula: ； Wherein, represents the scene probability value, represents the first video target, represents the value of the target action of the first video target, represents the second video target, represents the value of the target action of the second video target, represents the nth video target, represents the value of the target action of the nth video target, represents the first noun keyword, represents the first verb keyword, represents the second noun keyword, represents the second verb keyword, represents the nth noun keyword, represents the nth verb keyword, represents the probability of simultaneous occurrence, represents the probability of simultaneous occurrence; Target data in the captured data is filtered using the scene probability values; The target data and the business data are pre-associated to obtain pre-associated data.

9. The method for associating law enforcement recorder data with business data as described in claim 1, characterized in that, The step of confirming the association between the pre-associated data and the business data by the photographer and the mobile device to obtain the data association result between the shooting data and the business data includes: Obtain the video targets and target actions of the target data, and the noun keywords and verb keywords of the business data from the pre-association data; Select targets from the video targets that match the noun keywords, and select verbs from the target actions that match the verb keywords; Calculate the background index between the target to be confirmed and the verb to be confirmed; Based on the background index in ascending order, the target to be confirmed and the verb to be confirmed are prioritized to obtain a priority sequence; According to the priority sequence, weighting is performed on the target to be confirmed and the verb to be confirmed to obtain the weighting weights of the target to be confirmed and the verb to be confirmed. Generate the target to be confirmed and the verb to be confirmed as a item to be confirmed; The item to be confirmed is sent to the mobile device to receive the confirmation score from the photographer regarding the item to be confirmed. Based on the weighting and the confirmation score, the association confirmation index of the pre-associated data is calculated using the following formula: ； Where, represents the correlation confirmation index, represents the confirmation score of the i-th item to be confirmed, represents the weighting weight of the i-th item to be confirmed in the i-th video frame, represents the number of video frames contained in the target data, and represents the number of items to be confirmed; When the association confirmation index is greater than the preset association confirmation threshold, the pre-associated data is associated with the photographer's account in the data acquisition device to obtain the data association result.

10. The method for associating law enforcement recorder data with business data as described in claim 9, characterized in that, The calculation of the background index between the target to be confirmed and the verb to be confirmed includes: Query the image coordinates of the target to be confirmed and the verb to be confirmed in the target data; Extract the neighborhood coordinates of the target to be confirmed and the verb to be confirmed from the target data; Based on the image coordinates and the neighborhood coordinates, the background index of the target to be identified and the verb to be identified is calculated using the following formula: ； ； ； Wherein, represents the background index, represents the actual length, represents the pixel length in the image, represents the distance from the object to the camera, represents the focal length, represents the distance from the object to the camera in image coordinates, and represents the distance from the object to the camera in neighborhood coordinates.

Images