An image information recording method, device and medium of a construction scene

Abstract

Some embodiments of the present application provide a construction scene image information recording method, device and medium, relating to the field of image recording, the method comprising: performing first verification on the positioning information of an image acquisition device and the user identity information of a user; in response to the first verification passing, determining the image data acquired by the image acquisition device as valid, and generating a first hash value, the first hash value being related to the positioning information and the identity information; through the image acquisition device, collecting first image data of a construction scene, and generating a watermark field corresponding to the first image data and a second hash value, the second hash value being related to the watermark field; generating a watermark layer based on the watermark field, merging the watermark layer with the first image data to obtain second image data; and writing the first hash value and the second hash value into the second image data to obtain third image data. The present application can improve the credibility of construction information recording and the information security protection capability.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of image recording, in particular to an image information recording method, device and medium for a construction scene. BACKGROUND

[0002] In a construction site, image data of the construction site is an important basis for recording project progress, quality control and completion of acceptance. However, the authenticity, uniqueness and traceability of traditional image data face serious challenges. Images are easy to be forged, tampered with, etc., and are difficult to be used as reliable basis for construction progress, quality control or acceptance process. This not only brings risks to engineering management, but also may cause quality disputes and legal disputes, which seriously restricts the data management and information security protection capability.

[0003] Therefore, it is necessary to propose an image information recording method, device and medium for a construction scene to ensure the authenticity, uniqueness and traceability of the image data of the construction site, and to improve the credibility of construction information recording and information security protection capability. SUMMARY

[0004] The summary includes an image information recording method for a construction scene, comprising: performing first verification on positioning information of an image acquisition device and user identity information of a user; in response to the first verification passing, determining image data acquired by the image acquisition device as valid, and generating a first hash value, the first hash value being related to the positioning information and the user identity information; through the image acquisition device, collecting first image data of a construction scene, and generating a watermark field corresponding to the first image data and a second hash value, the second hash value being related to the watermark field; generating a watermark layer based on the watermark field, merging the watermark layer with the first image data to obtain second image data; and writing the first hash value and the second hash value into the second image data to obtain third image data.

[0005] The summary includes an image information recording device for a construction scene, the device comprising at least one processor and at least one memory; the at least one memory is used to store computer instructions; the at least one processor is used to execute at least part of the computer instructions to realize the image information recording method for a construction scene as described in the above embodiments.

[0006] The summary includes a computer readable storage medium, the storage medium stores computer instructions, when at least part of the computer instructions is executed by a processor, the image information recording method for a construction scene as described in the above embodiments can be realized.

[0007] The summary of the application comprises an image information verification method applied to image data obtained by the method described in the above embodiments, comprising: obtaining image data to be verified; obtaining a first hash value, a second hash value and a third hash value from the image data to be verified; obtaining a data block corresponding to the image data to be verified from a block chain; comparing the first hash value, the second hash value and the third hash value obtained from the image data to be verified with the first hash value, the second hash value and the third hash value in the data block to obtain a verification result of the image data to be verified.

[0008] The beneficial effects of the application include but are not limited to: (1) by verifying the positioning information of the image acquisition device and the identity information of the user, the compliance of the shooting behavior can be ensured, and the occurrence of cheating behaviors such as "shooting on behalf of others" and "shooting after the event" can be avoided; (2) by writing the watermark field and the hash value into the image data, the authenticity of the image data can be double protected, the watermark layer can meet the needs of daily management, and the hash value writing can provide technical verification capability for the image data; (3) by storing the hash value embedded in the image into the block chain, it can be used as a voucher for subsequent image verification, and when the image is tampered with, the abnormality can be found in time. BRIEF DESCRIPTION OF DRAWINGS

[0009] The present specification will be further illustrated in the form of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not limiting, and in these embodiments, the same numbers represent the same structures, wherein:

[0010] Figure 1 is a schematic diagram of an application scenario of an image information recording method of a construction scene according to some embodiments of the present specification;

[0011] Figure 2 is an exemplary flowchart of an image information recording method of a construction scene according to some embodiments of the present specification;

[0012] Figure 3 is an exemplary flowchart of generating a watermark field according to some embodiments of the present specification;

[0013] Figure 4 is an exemplary flowchart of the third verification of the watermark field according to some embodiments of the present specification;

[0014] Figure 5 is an exemplary flowchart of an image information verification method according to some embodiments of the present specification. DETAILED DESCRIPTION

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present specification, the drawings needed in the embodiment description will be briefly introduced below. Obviously, the drawings in the following description are only some examples or embodiments of the present specification, and for those skilled in the art, the present specification can also be applied to other similar scenarios without creative labor on the basis of these drawings. Unless the context clearly indicates otherwise or otherwise stated, the same reference numbers in the drawings represent the same structures or operations.

[0016] Unless the context clearly indicates otherwise or otherwise stated, the words "one", "an", "a", and / or "the" do not specify a singular number, but can also include a plural number. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements explicitly identified, and these steps and elements do not constitute an exclusive list, and the method or device can also include other steps or elements.

[0017] Flowcharts are used in the present specification to illustrate the operations performed by the system according to the embodiments of the present specification. It should be understood that the preceding or subsequent operations are not necessarily performed in sequence. On the contrary, each step can be processed in reverse order or simultaneously. At the same time, other operations can also be added to these processes, or one or more steps of operations can be removed from these processes.

[0018] Figure 1 is a schematic diagram of an application scenario of an image information recording method of a construction scene according to some embodiments of the present specification. In some embodiments, as shown in Figure 1 , the application scenario 100 of the image information recording method of the construction scene can include an image information recording device 110, an image acquisition device 120, and a user 130.

[0019] In some embodiments, the application scenario 100 can include a construction site, a municipal engineering construction site, a road construction site, and the like.

[0020] The image information recording device 110 can be a device for receiving, storing, and processing information. In some embodiments, the image information recording device 110 can include a server 111, which is configured with a processor and a memory, and the like.

[0021] The processor can be used to process data from the image acquisition device or the user. In some embodiments, the processor can include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), an image processing unit (GPU), a physical operation processing unit (PPU), a digital signal processor (DSP), a controller, a microprocessor, and the like, or any combination thereof.

[0022] The memory can be used to store data, instructions, and / or any other information. In some embodiments, the memory can include mass storage, removable storage, or the like, or any combination thereof.

[0023] In some embodiments, the image information recording device 110 can process data and / or information received from the image acquisition device 120 and the user 130. For example, the image information recording device 110 can acquire first image data of a construction scene by the image acquisition device, and generate a watermark field and a second hash value corresponding to the first image data, etc.

[0024] The image acquisition device 120 refers to a device for acquiring image data. For example, the image acquisition device 120 can include a camera 121 or an industrial camera 122 with a watermark function, etc. In some embodiments, the image acquisition device can also record the acquisition time when the image data is acquired, etc.

[0025] In some embodiments, the image acquisition device 120 is equipped with a positioning component and / or a positioning system (such as a Beidou positioning system or a GPS system, etc.) for acquiring the positioning information of the image acquisition device 120 itself.

[0026] In some embodiments, the image acquisition device 120 can be in communication connection with the information recording system. The image acquisition device 120 can also serve as a front end or a client of the information recording system, at this time, the front end or the client is a terminal device with a watermark photographing function.

[0027] The information recording system can be a system for recording image data. In some embodiments, the information recording system can be integrated into the image information recording device 110 or set in the cloud, etc.

[0028] The user 130 refers to a user using the image acquisition device 120. For example, the user 130 can include workers, engineers, or management personnel of a construction site, etc.

[0029] In some embodiments, the user 130 can send a photographing instruction to the image acquisition device 120 through a terminal device of the user to control the image acquisition device 120 to photograph image data. The terminal device can include a mobile phone, a tablet computer, etc.

[0030] In some embodiments, the user 130 can also log in to a front end or a client of the information recording system to control the image acquisition device 120 to photograph image data and view the image data. When the user 130 logs in to the front end or the client of the information recording system, the information recording system can record the user identity information of the user 130.

[0031] In some embodiments, the image information recording method of the construction scene can include: the image information recording device 110 acquires the positioning information of the image acquisition device 120 through the image acquisition device 120, and acquires the user identity information of the user 130 through the information recording system, and performs first verification on the positioning information and the user identity information. In response to the first verification passing, the image information recording device 110 determines the image data acquired by the image acquisition device 120 to be valid, and generates a first hash value. The image information recording device 110 acquires first image data of the construction scene through the image acquisition device 120, generates a watermark field corresponding to the first image data and a second hash value, generates a watermark layer based on the watermark field, merges the watermark layer with the first image data to obtain second image data. The image information recording device 110 writes the first hash value and the second hash value into the second image data to obtain third image data.

[0032] Figure 2 is an exemplary flowchart of the image information recording method of the construction scene according to some embodiments of the present specification. As shown in Figure 2 The image information recording flow 200 of the construction scene includes the following steps. In some embodiments, the image information recording flow 200 of the construction scene can be executed by the processor in the image information recording device.

[0033] Step 210, first verifying the positioning information of the image acquisition device and the user identity information of the user.

[0034] For the description of the image acquisition device and the user, see Figure 1 and related description.

[0035] The positioning information refers to data reflecting the position of the image acquisition device. In some embodiments, the positioning information can be represented by spatial coordinate data, etc. The spatial coordinate data can be coordinates in a spatial coordinate system. The spatial coordinate system can be pre-set.

[0036] In some embodiments, the spatial coordinate data can also be latitude and longitude data, etc.

[0037] In some embodiments, the processor can acquire the positioning information through the positioning component and / or positioning system in the image acquisition device.

[0038] The identity information refers to the information related to the user, also known as the user identity information. In some embodiments, the user identity information can include name, ID code, position and / or duty, etc. In some embodiments, when the user logs in to the front end or client of the information recording system, the processor can acquire the login information submitted by the user when logging in to determine the user identity information corresponding to the user. For the description of the information recording system, see Figure 1 and related description.

[0039] The first verification can be a verification operation of verifying whether the image data is valid. In some embodiments, the image data is valid if the location where the image data is captured is in the area corresponding to the construction task. When the image data acquired by the image acquisition device is valid, the image data can be used as the basis for recording information related to construction progress, quality control, or acceptance process.

[0040] In some embodiments, the processor can determine one or more candidate tasks associated with the user based on the user identity information, and determine the task area of the one or more candidate tasks. The processor can determine whether the image acquisition device is located in the task area of a single candidate task in the one or more candidate tasks based on the positioning information and the task area of the one or more candidate tasks. In response to the image acquisition device being located in the task area of the single candidate task, it is determined that the first verification is passed, and the single candidate task is determined as the target task.

[0041] The candidate task refers to a task associated with the user. For example, the candidate task can include at least one of a task in which the user is a project leader, a collaborative task in which the user is a participant, a task in which the user is authorized to perform quality inspection, and a to-be-inspected task in which the user is responsible for inspection.

[0042] In some embodiments, the processor can query the database based on the user identity information among a plurality of tasks, determine one or more tasks containing the user in the task information as candidate tasks, and acquire the task information of the candidate tasks.

[0043] The task information refers to information related to the execution of a task. In some embodiments, the task information can include one or more of a task number, a task type (such as excavation of a foundation pit, pouring of concrete, binding of reinforcement, installation of machinery and electricity, etc.), the name of a person related to the task (such as a person in charge, a participant, an inspector, etc.), a task area, a task progress, a task deadline, etc.

[0044] In some embodiments, the database can be pre-stored in the memory or the information recording system. The database pre-stores the task information of a plurality of tasks.

[0045] The task area can be a geographic area in which a task is executed in a construction site. In some embodiments, the task area can be represented by a region name, spatial coordinate data, etc. For example only, the task area can be represented by GeoPolygon data, etc.

[0046] GeoPolygon data is a vector data structure used to represent a closed two-dimensional or three-dimensional spatial area, which is formed by connecting a series of ordered coordinate points to form a closed geometric shape.

[0047] In some embodiments, the processor can determine whether the image acquisition device is located in the task area of the single candidate task in the one or more candidate tasks by various feasible manners, such as retrieval, traversal, etc. For example, the processor can traverse each candidate task to determine whether the image acquisition device is located in the task area of the candidate task one by one. For example only, the processor can execute a geographic matching algorithm of “whether a point is in a polygon” (e.g., a ray method, etc.) to determine whether the image acquisition device is located in the task area of the candidate task. In the “whether a point is in a polygon”, the “point” is the positioning information of the image acquisition device, and the “polygon” is the task area of the candidate task.

[0048] The target task refers to the candidate task that passes the first verification. In some embodiments, in response to the image acquisition device being located in the task area of the single candidate task, the processor determines that the first verification of the candidate task is passed, and determines the candidate task as the target task.

[0049] In some embodiments of the present specification, through the positioning information of the image acquisition device and the first verification, it can be effectively ensured that the image acquisition device collects image data in the correct construction task area, and the off-area shooting or cross-project shooting, etc. can be prevented, the compliance of the shooting behavior can be ensured, and the cheating behaviors such as “substitute shooting” or “make-up shooting” can be avoided.

[0050] Step 220, in response to the first verification passing, determining that the image data acquired by the image acquisition device is valid, and generating a first hash value.

[0051] The first hash value can be data for verifying whether the image data acquired by the image acquisition device is valid. In some embodiments, the first hash value can be related to the positioning information of the image acquisition device and the user identity information of the user. For example, the first hash value can be generated based on the identification (such as the task number, etc.) of the target task related to the user, the positioning information, and the current timestamp.

[0052] For example only, the first hash value can be represented by the following formula (1):

[0053] H1 = SHA256 (task_id + gps + timestamp) (1)

[0054] Wherein, H1 is the first hash value, SHA256(·) is a hash algorithm for calculating a 256-bit hash value, task_id refers to the task number of the target task, gps refers to the positioning information (such as spatial coordinate data, etc.) of the image acquisition device, timestamp refers to the timestamp at the time of generating the first hash value, i.e., the current timestamp. “+” represents splicing processing.

[0055] In some embodiments of the present disclosure, the first hash value introduced can serve as a verification credential of the image acquisition device in the task area of the target task, the timestamp when the first hash value is generated can ensure the uniqueness of each verification, and the first hash value can also provide the original data fingerprint matched with the task area for subsequent verification.

[0056] At step 230, the first image data of the construction scene is collected by the image acquisition device, and a watermark field and a second hash value corresponding to the first image data are generated.

[0057] The first image data refers to the image data collected by the image acquisition device and related to the construction task.

[0058] It should be noted that steps 210-220 are used to determine whether the image data acquired by the image acquisition device is valid. If the image data is valid, the processor can generate a first hash value as a verification credential of the valid image data, and perform steps 230-250 on the actual acquired image data related to the construction task (i.e., the first image data) to record and save the image data related to the construction task.

[0059] The watermark field refers to an identifier related to the task information of the target task. In some embodiments, the watermark field can be represented by one or more fields reflecting the task information.

[0060] In some embodiments, the watermark field includes one or more of the identifier of the target task (such as the number or name of the target task), the identifier of the user (such as the name or ID of the user), the positioning information, the first image data acquisition time, the progress of the target task, and the task target of the target task. The task target includes the quality standard or acceptance requirement that the target task needs to achieve.

[0061] In some embodiments, the processor can generate the watermark field based on the task information of the target task. For details of this part, please refer to Figure 3 and related descriptions thereof.

[0062] In some embodiments, generating the watermark field can facilitate the on-site personnel to quickly identify the shooting object, clearly identify the relevant personnel for subsequent accountability, and provide time evidence to prevent post-facto retakes.

[0063] The second hash value can be data for verifying the watermark field. In some embodiments, the second hash value is related to the watermark field. For example, the first hash value can be generated based on the identifier of the target task, the identifier of the user, the device information of the image acquisition device, and the acquisition time of the first image data.

[0064] For example only, the second hash value can be represented by the following formula (2):

[0065] H2 = SHA256(task + user + device + time) (2)

[0066] wherein H2 refers to the second hash value, task refers to the identification of the target task, user refers to the identification of the user, device refers to the device information (such as device number, model and MAC address, etc.) of the image acquisition device, and time refers to the timestamp of the acquisition time of the first image data. The device information can be obtained from the memory.

[0067] In some embodiments of the present specification, by applying the second hash value, the integrity and consistency of the watermark field can be verified, and by binding the four elements of user, device, task and time in the second hash value, it can be prevented that a single element is tampered with, thereby providing an effective original fingerprint for subsequent verification of the watermark field.

[0068] Step 240, generating a watermark layer based on the watermark field, merging the watermark layer with the first image data to obtain second image data.

[0069] The watermark layer can be a layer that displays the watermark field on the image data. In some embodiments, the processor can generate the watermark layer based on the watermark field through an image processing program (such as PhotoShop, etc.).

[0070] The second image data can be the first image data to which the watermark layer is added.

[0071] In some embodiments, the processor can merge the watermark layer with the first image data to obtain the second image data. For example, the processor merges the pixels of the watermark layer with the pixels of the first image data to obtain the second image data.

[0072] In some embodiments, the processor can sum or weighted sum the pixel values of the pixel points in the watermark layer and the pixel values of the pixel points in the first image data to realize pixel merging. For example only, the processor can set different weights for the pixel values of the pixel points in the watermark layer and the pixel values of the pixel points in the first image data, and perform weighted sum of the pixel values to obtain the second image data. Wherein the weight of the pixel value corresponding to the pixel point in the watermark layer can be set to a small value (such as less than 0.3, etc.), so as to avoid that the watermark layer blocks the content of the first image data.

[0073] Step 250, writing the first hash value and the second hash value into the second image data to obtain third image data.

[0074] The third image data can be the second image data to which the first hash value and the second hash value are written.

[0075] In some embodiments, the processor can write the first hash value and the second hash value into the second image data to obtain third image data in a plurality of ways. The plurality of ways of writing can include location-based steganography (LBS), metadata embedding, tail appending, etc.

[0076] By way of example only, the writing process can include the following steps.

[0077] S1: encode the first hash value and the second hash value into binary strings.

[0078] S2: allocate embedding regions for the two binary strings.

[0079] In some embodiments, the embedding regions for the two binary strings can be pre-set based on historical experience. For example, the embedding region for the binary string corresponding to the first hash value can be the pixel region corresponding to the first 128 rows from top to bottom and the first 128 columns from left to right of the second image data, and the embedding region for the binary string corresponding to the second hash value can be the pixel region corresponding to the 129th-256th rows from top to bottom and the 129th-256th columns from left to right of the second image data.

[0080] Taking the binary string (denoted as H1) corresponding to the first hash value as a 64-bit binary string as an example, the R, G, and B values of the pixel point at the first row and the first column of the second image data are obtained, and the last bit of the R, G, and B values of the pixel point is replaced by the first three binary characters of H1 in turn. The R, G, and B values of the pixel point at the first row and the second column of the second image data are obtained, and the last bit of the R, G, and B values of the pixel point is replaced by the binary characters at the 4th-6th positions of H1 in turn. Similarly, the last bit of the R, G, and B values of the pixel point at the first row and the second column of the second image data is replaced by the binary characters at the 4th-6th positions of H1 in turn, until all the binary characters of H1 are written into the last bit of the R, G, and B values of the corresponding pixel points.

[0081] In some embodiments, the writing process of the binary string corresponding to the second hash value is similar to the writing process of the binary string corresponding to the first hash value, except that the embedding regions are different.

[0082] In some embodiments, the above-mentioned way of selecting the pixel points to be steganographically hidden row by row is not the only way, and the processor can also select the pixel points to be steganographically hidden along the diagonal lines of the second image data.

[0083] In some embodiments of the present specification, by verifying the positioning information of the image acquisition device and the identity information of the user, the compliance of the shooting behavior can be ensured, and the occurrence of cheating behaviors such as "substitute shooting" and "make-up shooting" can be avoided. In addition, the watermark field in the image can provide intuitive information display for relevant management personnel and supervisors, facilitating quick identification of basic information of the photo (such as acquisition time, acquisition location, and responsible person, etc.). By writing the watermark field and the hash value into the image data, the authenticity of the image data can be doubly protected, the watermark layer can meet the needs of daily management, and the hash value writing can provide technical verification capability for the image data.

[0084] Figure 3 is an exemplary flowchart of generating a watermark field according to some embodiments of the present specification. As shown in Figure 3 , the flow 300 of generating a watermark field includes the following steps.

[0085] Step 310, obtaining task information of a target task. For more information about the target task and the task information, please refer to Figure 2 and the related description thereof.

[0086] In some embodiments, the processor can obtain the task information of the target task in the database. Since the task information in the database can be updated over time, re-obtaining the task information before the second verification can ensure the accuracy of the task information.

[0087] In some embodiments, the processor can also obtain the task information of the target task from other data sources. The other data sources can include business databases, task management databases, and other databases different from the original database. The task information in the other data sources can be updated over time, and the processor can cross-check the task information obtained from the original database with the task information obtained from the other data sources to improve the accuracy of the task information.

[0088] In some embodiments, the update of the task information includes at least one of the adjustment of the relevant personnel, the update of the construction progress, and the adjustment of the task area.

[0089] Step 320, based on the task information, performing a second verification on whether the user is associated with the target task and whether the image acquisition device is located in the task area of the target task.

[0090] The second verification can be a verification operation of verifying whether the first image data is valid again. In some embodiments, if the user is associated with the target task and the image acquisition device is located in the task area of the target task, the processor can determine that the second verification is passed.

[0091] In some embodiments, the processor can determine whether the user is present in the task-related personnel based on the user identity information and the task-related personnel in the task information. The processor can determine whether the image acquisition device is located in the task area of the target task based on the positioning information and the task area in the task information. The description of the user identity information and the positioning information can be referred to Figure 2 and the related description.

[0092] Step 330, in response to the second verification passing, generating the watermark field.

[0093] The description of generating the watermark field can be referred to Figure 2 and the related description.

[0094] Since the conventional watermark camera has the problem of low reliability of watermark data (for example, the watermark relies on the local data of the image acquisition device, which is easily tampered by human), the user can fake the shooting time by modifying the device system time, or fake the image taken at other places as the construction site image by using virtual software or modifying the location service settings. In some embodiments of the present specification, the association relationship between the user and the target task, the task area and the image acquisition device is verified again before the watermark field is generated, which can effectively improve the reliability of the watermark field.

[0095] In some embodiments, the processor can further perform a third verification on the watermark field, and generate a third hash value.

[0096] The third verification can be a verification operation for verifying the accuracy of the watermark field. In some embodiments, the third verification can include verifying whether the watermark field is consistent with the target field, and if the watermark field is consistent with the target field, the third verification passes.

[0097] In some embodiments, the third hash value is related to the verification result of the third verification.

[0098] The description of the third verification and the generation of the third hash value can be referred to Figure 4 and the related description.

[0099] Figure 4 is an exemplary flowchart of performing a third verification on the watermark field according to some embodiments of the present specification. As Figure 4 shown, the flowchart 400 of performing the third verification on the watermark field includes the following steps.

[0100] Step 410, obtaining a target field corresponding to the watermark field.

[0101] The target field can be a field related to the target task. In some embodiments, the target field can include one or more of a standard name, a status, a deadline, and a responsible person of the target task, a real name, a permission level, and a validity period of the user, registration information, a use status, a location authorization, and a permission level of the image acquisition device, and the like.

[0102] In some embodiments, the image information recording device can also be deployed with one or more of a task management system, a personnel management system, and a device management system, and the like.

[0103] The task management system can store and manage information related to tasks. The personnel management system can store and manage information related to users. The device management system can store and manage information related to image acquisition devices.

[0104] In some embodiments, the processor can obtain the target field through the task management system, the personnel management system, and the device management system based on the task information of the target task.

[0105] At step 420, the watermark field is compared with the target field, and in response to the watermark field being inconsistent with the target field, a type of abnormality of the watermark field is determined, the first image data and the watermark field are re-acquired, and the re-acquired watermark field is re-verified.

[0106] In some embodiments, the processor can compare the watermark field with the target field, and in response to the watermark field being inconsistent with the target field, the third verification fails.

[0107] In some embodiments, the processor can compare the watermark field with the target field in various ways. For example, the processor can compare the watermark field and the target field character by character, or compare the watermark field and the target field by using an edit distance algorithm or a hash comparison method.

[0108] The type of abnormality can be a type of the part of the watermark field that is inconsistent with the target field. In some embodiments, the type of abnormality includes, but is not limited to, at least one of “user name error”, “task number missing”, “insufficient permission”, and “time abnormality”, and the like.

[0109] The task number missing can be that the target task does not exist or has been invalidated in the task management system. In some embodiments, if the name of the target task in the watermark field is inconsistent with the standard name in the target field, or the status in the target field is invalidated, the type of abnormality is “task number missing”.

[0110] Permission denied can be that the user has no permission to use the target task. In some embodiments, if the name of the user in the watermark field is consistent with the real name in the target field, but the permission level of the user in the target field is lower than the permission level of the image acquisition device, the error type is "permission denied".

[0111] Time error can be that the shooting time of the first image data in the watermark field exceeds the deadline of the target field.

[0112] In some embodiments, in response to the third verification failing, the processor can issue an image acquisition instruction to the image acquisition device to reacquire the first image data. After the processor acquires the new first image data, the processor can regenerate the watermark field (such as re-executing steps 230-250) and re-perform the third verification on the reacquired watermark field.

[0113] Step 430, in response to the watermark field being consistent with the target field, the third verification passes.

[0114] Because the watermark field has information static redundancy and cannot reflect real-time changes on site, the scene adaptability is poor. For example, the task state displayed by the watermark field can not match the actual construction progress, or when the construction personnel changes, the watermark field still displays the information of the old user, or when the engineering standard or acceptance requirement changes, the watermark field cannot be updated in time. In some embodiments of the present specification, the verification and updating steps of the watermark field can make the watermark field have better timeliness and be able to more accurately reflect the context information or background information at the time of acquiring the first image data.

[0115] In some embodiments, the third hash value can be generated based on the identification of the target task and the error type of the watermark field.

[0116] For example only, the third hash value can be represented by the following formula (3):

[0117] H3=SHA256(timestamp+taskID+errorField 1-n ) (3)

[0118] Wherein, H3 refers to the third hash value, timestamp refers to the time of generating the third hash value, taskID refers to the name or ID of the target task, errorField 1-n refers to the identification of the first to nth error type, such as "NAME_ERROR (user name error)", "TASK_MISSING (task number missing)", "PERMISSION_DENIED (permission denied)", etc. errorField 1-nrespectively, n is the number of checks, i.e., there are n types of abnormality in sequence. It can be understood that if no abnormality type occurs from the start of the third verification to the passing of the third verification, errorField 1-n is errorField1, indicating "VALIDATION_SUCCESS (validation success)".

[0119] In some embodiments of the present specification, the third hash value can record the watermark verification and watermark erasing process as an audit record of abnormal handling, and provide a complete audit trail for system abnormalities and user operations.

[0120] In some embodiments, the processor can also write the third hash value into the third image data to obtain fourth image data. The way of writing the third hash value is similar to the way of writing the first hash value, except that the embedding area is different.

[0121] In some embodiments, to avoid interference between the hash values written in the image data, the processor can divide an additional embedding area for the third hash value. For example, if the embedding area corresponding to the first hash value is the pixel points corresponding to the first 128 rows from top to bottom and the first 128 columns from left to right of the third image data, and the embedding area corresponding to the second hash value is the pixel points corresponding to the 129th-256th rows from top to bottom and the 129th-256th columns from left to right of the third image data, the processor can use the pixel points corresponding to the 257th-384th rows from top to bottom and the 257th-384th columns from left to right of the third image data as the embedding area of the third hash value.

[0122] The fourth image data can be the third image data with the third hash value written in. The processor can record and save the fourth image data.

[0123] In some embodiments, the first hash value, the second hash value, and the third hash value are located in different areas of the fourth image data.

[0124] In some embodiments of the present specification, by writing different hash values into different image areas, interference between the hash values can be effectively prevented, and all hash values can be extracted from the image data completely.

[0125] In some embodiments of the present specification, by generating a unique hash value at each stage and embedding it in the image data, the operation details of the image data can be saved synchronously into the database and the blockchain, forming a complete traceable chain.

[0126] In some embodiments, the processor can also generate a data block based on the first hash value, the second hash value, and the third hash value, and store the data block into the blockchain.

[0127] In some embodiments, the processor can acquire context information of the first image data, and generate the data block based on the context information, the first hash value, the second hash value, and the third hash value.

[0128] The context information can be data related to acquisition, background, or the first image data. In some embodiments, the context information includes one or more of acquisition location (such as positioning information, etc.), environmental information, verification result (such as passing of multiple verifications, etc.), acquisition process behavior, and construction standard data related to the target task of the first image data. The construction standard data related to the target task can include construction drawings and quality standard files related to the target task, etc.

[0129] The environmental information can be data related to the weather when the first image data is acquired, such as temperature or illumination, etc. In some embodiments, the processor can acquire the environmental information through a third-party platform (such as weather forecast, etc.).

[0130] The acquisition process behavior can be the behavior of the image acquisition device when acquiring the first image data, such as the operation of taking a picture again, etc. In some embodiments, the processor can acquire the acquisition process behavior through a controller deployed inside the image acquisition device.

[0131] In some embodiments, the processor can submit the data block to the blockchain through a contract interface, and the blockchain returns the storage Hash and the on-chain address to the processor after completing the storage, and the processor stores the storage Hash, the on-chain address, and the corresponding image (such as the fourth image data, etc.) to form a mapping relationship between the image, the storage Hash, and the on-chain address, so as to facilitate subsequent query and verification, etc. The contract interface can be a standardized way for the blockchain to interact with the external network.

[0132] In some embodiments, the storage Hash can be generated by the blockchain, specifically by performing hash calculation on the data block. The storage Hash can serve as a unique identifier for this storage operation, facilitating subsequent storage data query and verification.

[0133] The on-chain address can be an identifier of the storage location of the data block in the blockchain, including block number, transaction number, etc. information, facilitating accurate positioning and retrieval.

[0134] In some embodiments of the present specification, writing the context information related to the image into the blockchain can provide more information about the image acquisition process when verifying the image later, so that the image data shooting process can be traced.

[0135] Since the construction scene image information in the prior art is not only easy to be tampered with, but also difficult to identify and track after the image data is modified. In some embodiments of the present specification, the hash value embedded in the image is stored in the blockchain, which can be used as a certificate for subsequent image verification. When the image is tampered with, abnormalities can be found in time.

[0136] Figure 5 is an exemplary flowchart of an image information verification method according to some embodiments of the present specification. As shown in Figure 5 , the flowchart 500 of the image information verification method includes the following steps.

[0137] Step 510, obtaining image data to be verified.

[0138] The image data to be verified refers to the image data waiting to be verified. In some embodiments, the image data to be verified can include the fourth image data described above, etc. For more information about the fourth image data, see Figure 4 and related descriptions.

[0139] In some embodiments, the image data to be verified can be obtained from the memory or database of the image information recording device.

[0140] In some embodiments, the subject requesting verification of the image data to be verified and the scene can include one or more of the following: a quality supervisor requesting authenticity verification of image data submitted by a construction party; a property owner requesting spot check verification of project progress and quality evidence; an audit agency requesting third-party verification of disputed images; a system (such as a task management system, a personnel management system, and a device management system, etc.) requesting verification of the integrity of periodically batched archived image data.

[0141] Step 520, obtaining a first hash value, a second hash value, and a third hash value from the image data to be verified.

[0142] In some embodiments, the processor can obtain the first hash value, the second hash value, and the third hash value from the image data to be verified by various methods (for example, traversing files, pixel reading, etc.). For example only, the processor can read the embedded string data bit by bit according to the embedding area and channel bit corresponding to each hash value, and restore the extracted string data to the first hash value, the second hash value, and the third hash value. The channel bit can be the last bit of the R, G, B value of the pixel point.

[0143] For more information about the first hash value, the second hash value, and the third hash value, see Figure 2 and Figure 3 and related descriptions.

[0144] Step 530, obtaining a data block corresponding to the image data to be verified from the blockchain.

[0145] In some embodiments, the processor can obtain the on-chain address of the image data to be verified from the memory or the like, and request the data block corresponding to the image data to be verified from the blockchain based on the on-chain address, extract the first hash value, the second hash value and the third hash value from the data block.

[0146] In some embodiments, the processor can perform hash calculation on the data block returned by the blockchain, and compare the calculation result with the notarization Hash corresponding to the image data to be verified. If the calculation result is consistent with the notarization Hash, it is determined that the verification is passed. If the calculation result is inconsistent with the notarization Hash, it is indicated that the data block is tampered.

[0147] For more information about the data block, the notarization Hash and the on-chain address, see Figure 4 and related descriptions.

[0148] In step 540, the first hash value, the second hash value and the third hash value obtained from the image data to be verified are compared with the first hash value, the second hash value and the third hash value in the data block, and the verification result of the image data to be verified is obtained.

[0149] In some embodiments, the first hash value, the second hash value and the third hash value obtained from the image data to be verified can be referred to as the first type of hash value, and the first hash value, the second hash value and the third hash value in the data block can be referred to as the second type of hash value.

[0150] In some embodiments, the verification result can include: complete pass, partial anomaly, serious anomaly and need for review. Complete pass means that the first type of hash value and the second type of hash value completely match, and the image data is not tampered. Partial anomaly means that a small part (such as 20% or more) of the first type of hash value and the second type of hash value do not match, and the image data may have slight damage but the core data is complete. Serious anomaly means that a large part (such as 80% or more) of the first type of hash value and the second type of hash value do not match, and the image data may be maliciously tampered. Need for review means that it cannot be determined whether the verification result is true, and further analysis by a technical expert is required.

[0151] In some embodiments, the processor can compare the characters at a specific position of the hash value obtained from the image data to be verified with the characters at the corresponding position of the hash value in the data block bit by bit, and obtain the verification result.

[0152] In some embodiments of the present specification, by comparing and verifying the image data to be verified with the notarization data of the blockchain, it can be determined whether the image data is tampered.

[0153] One or more embodiments of the present specification provide an image information recording device of a construction scene, comprising at least one processor and at least one memory. The at least one memory is configured to store computer instructions, and the at least one processor is configured to execute at least part of the computer instructions to implement the image information recording method of the construction scene as described in the above embodiments.

[0154] The present specification also provides a computer readable storage medium storing computer instructions, which, when at least part of the computer instructions are executed by a processor, can implement the image information recording method of the construction scene as described in the above embodiments.

[0155] In some embodiments, the storage medium can include a mass storage, a removable storage, a volatile read / write memory, a read only memory (ROM), or the like, or any combination thereof. An exemplary mass storage can include a magnetic disk, an optical disk, a solid state disk, or the like. An exemplary removable storage can include a flash drive, a floppy disk, an optical disk, a memory card, a compact disk, a magnetic tape, or the like. An exemplary volatile read / write memory can include a random access memory (RAM). An exemplary RAM can include a dynamic random access memory (DRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), a static random access memory (SRAM), a thyristor random access memory (T-RAM), and a zero-capacitor random access memory (Z-RAM), or the like. An exemplary read only memory can include a mask read only memory (MROM), a programmable read only memory (PROM), an erasable programmable read only memory (PEROM), an electrically erasable programmable read only memory (EEPROM), a compact disk read only memory (CD-ROM), a digital versatile disk read only memory, or the like.

[0156] In addition, some features, structures, or characteristics in one or more embodiments of the present specification can be appropriately combined.

[0157] If the use of the description, definitions, and / or terms in the materials cited in the present specification is inconsistent or conflicts with the description, definitions, and / or terms used in the present specification, the use of the description, definitions, and / or terms in the present specification shall prevail.

Claims

1. An image information recording method for a construction site, characterized by, The method comprises: first verifying positioning information of an image acquisition device and user identity information of a user; in response to the first verification passing, determining image data acquired by the image acquisition device to be valid, and generating a first hash value, the first hash value being related to the positioning information and the user identity information; through the image acquisition device, collecting first image data of a construction scene, and generating a watermark field corresponding to the first image data and a second hash value, the second hash value being related to the watermark field; third verifying the watermark field, and generating a third hash value, the third hash value being related to a verification result of the third verification; generating a watermark layer based on the watermark field, merging the watermark layer with the first image data to obtain second image data; writing the first hash value and the second hash value into the second image data to obtain third image data; writing the third hash value into the third image data to obtain fourth image data.

2. The method of claim 1, wherein, The first verifying the positioning information of the image acquisition device and the user identity information of the user comprises: acquiring the user identity information and the positioning information; based on the user identity information, determining one or more candidate tasks associated with the user; determining a task area of the one or more candidate tasks; based on the positioning information and the task area of the one or more candidate tasks, judging whether the image acquisition device is located in the task area of a single candidate task in the one or more candidate tasks; in response to the image acquisition device being located in the task area of the single candidate task, determining that the first verification passes, and determining the single candidate task as a target task.

3. The method of claim 2, wherein, The first hash value is generated based on an identifier of the target task, the positioning information and a current timestamp.

4. The method of claim 2, wherein, The generating the watermark field corresponding to the first image data comprises: acquiring task information of the target task; based on the task information, second verifying whether the user is associated with the target task and whether the image acquisition device is located in the task area of the target task; in response to the second verification passing, generating the watermark field; the watermark field comprises one or more of an identifier of the target task, an identifier of the user, the positioning information, an acquisition time of the first image data, progress information of the target task and a task target of the target task.

5. The method of claim 4, wherein, The second hash value is generated based on the identifier of the target task, the identifier of the user, device information of the image acquisition device and the acquisition time of the first image data.

6. The method of claim 1, wherein, The third verifying the watermark field comprises: acquiring a target field corresponding to the watermark field; the target field is from one or more of a task management system, a personnel management system and a device management system. comparing the watermark field with the target field, in response to the watermark field being inconsistent with the target field, determining an abnormal type of the watermark field, reacquiring the first image data and the watermark field and re-performing the third verification on the reacquired watermark field; in response to the watermark field being consistent with the target field, the third verification passes.

7. The method of claim 6, wherein, The third hash value is generated based on an identification of a target task and the abnormal type of the watermark field.

8. The method of claim 1, wherein, The first hash value, the second hash value and the third hash value are located in different regions of the fourth image data.

9. The method of claim 2, wherein, The method further comprises: generating a data block based on the first hash value, the second hash value and the third hash value; storing the data block into a block chain.

10. The method of claim 9, wherein, The generating of the data block based on the first hash value, the second hash value and the third hash value comprises: acquiring context information of the first image data; the context information comprises one or more of an acquisition place, environmental information, an acquisition process behavior of the first image data and construction standard data related to the target task; generating the data block based on the context information, the first hash value, the second hash value and the third hash value.

11. An image information recording apparatus for a construction site, characterized by comprising: The apparatus comprises at least one processor and at least one memory; The at least one memory is configured to store computer instructions; The at least one processor is configured to execute at least part of the computer instructions to implement the image information recording method of a construction scene according to any one of claims 1-10.

12. A computer-readable storage medium, characterized in that, The storage medium stores computer instructions, and when at least part of the computer instructions is executed by a processor, the image information recording method of a construction scene according to any one of claims 1-10 can be implemented.

Images