Construction site inspection process management method and device, storage medium and program product

By processing audio and matching text similarity in construction site inspection video files, valid inspection items are identified and coverage is calculated. This solves the problems of authenticity and standardization in the inspection process in existing technologies, and realizes traceability and compliance management of construction site inspections.

CN115146910BActive Publication Date: 2026-02-17KE COM (BEIJING) TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210556294.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-20
Publication Date
2026-02-17
Estimated Expiration
2042-05-20

AI Technical Summary

Technical Problem

Existing site inspection methods cannot confirm whether inspection personnel are actually conducting on-site inspections, nor can they determine whether inspections are carried out according to preset standards, lacking traceability and standardization.

Method used

By acquiring site inspection video files, extracting audio and performing natural language processing, matching text similarity to identify valid inspection items, calculating inspection coverage, and combining video files to confirm the authenticity and compliance of the inspection process.

Benefits of technology

It enables the supervision of the authenticity and compliance of construction site inspections, ensuring that inspection personnel are actually present and conduct inspections according to standards, and provides post-event traceability capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115146910B_ABST
    Figure CN115146910B_ABST
Patent Text Reader

Abstract

The application provides a construction site inspection process management method and device, a storage medium and a program product. The method comprises the following steps: acquiring a construction site inspection video file, and extracting an audio file to obtain a construction site inspection audio file; extracting continuous speech to perform natural language processing to obtain a to-be-matched text; performing text similarity matching on the to-be-matched text and a standard inspection item text; the standard inspection item text corresponds to an inspection item one by one; acquiring a maximum value in the text similarity, and if the maximum value is greater than a preset threshold value, the corresponding inspection item is an effective inspection item; and calculating an inspection coverage rate according to the number of the effective inspection items and the number of the standard inspection item texts. Through the calculation of the inspection coverage rate, the compliance supervision of the construction site inspection can be realized. In addition, according to the collected construction site inspection video file, it can be confirmed whether the inspection engineering personnel actually arrive on the scene, so as to confirm the authenticity of the inspection process, and the after-tracing can be realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the fields of computer and communication technology, and in particular to a method, device, storage medium and program product for managing construction site inspection processes. Background Technology

[0002] During construction, to ensure construction quality and progress, most construction management teams establish engineering inspection teams to conduct regular on-site inspections. These inspection personnel conduct regular on-site inspections, checking each item according to a predetermined procedure and recording the inspection findings on paper inspection forms or online. For any items that fail inspection, photographs are taken as evidence, and rectification orders are issued either on paper or online.

[0003] Existing site inspection methods, even if all items pass inspection, lack photographs of non-compliant items, making it impossible to verify whether inspection personnel actually visited the site. This means the authenticity of the inspection process cannot be confirmed. Some construction projects may pass inspection on the day of the inspection but fail due to subsequent construction issues. In such cases, it's impossible to determine whether inspection personnel missed or made mistakes, meaning existing site inspection methods lack traceability. Furthermore, current methods cannot determine whether inspection personnel conducted each check according to pre-set standards, thus failing to confirm the standardization of the inspection process. Summary of the Invention

[0004] To address the problems in the prior art, this invention provides a method, device, storage medium, and program product for managing the construction site inspection process.

[0005] This invention provides a method for managing construction site inspection processes, comprising: acquiring a construction site inspection video file; extracting audio from the construction site inspection video file to obtain a construction site inspection audio file; extracting continuous speech from the construction site inspection audio file, performing natural language processing on the continuous speech to obtain text to be matched; performing text similarity matching between the text to be matched and standard inspection item text to obtain text similarity; wherein, the standard inspection item text corresponds one-to-one with the inspection item; obtaining the maximum value in the text similarity; if the maximum value in the text similarity is greater than a preset threshold, it indicates that the inspection item corresponding to the corresponding standard inspection item text is a valid inspection item; obtaining the number of valid inspection items, and calculating the inspection coverage rate based on the number of valid inspection items and the number of standard inspection item texts.

[0006] According to a construction site inspection process management method provided by the present invention, the step of performing text similarity matching between the text to be matched and the standard inspection item text to obtain text similarity includes: comparing the lengths of the text to be matched and the standard inspection item text, obtaining the occurrence position of the first character of the shorter text in the longer text, and aligning the text to be matched and the standard inspection item text with the occurrence position; comparing the corresponding characters of the text to be matched and the standard inspection item text, recording a logical value 1 if they are the same, and recording a logical value 0 if they are different or if there is no character in the shorter text, and constructing a first vector according to the character order in the longer text based on the corresponding logical values; assigning weights to the characters in the longer text, and constructing a second vector according to the character order in the longer text based on the corresponding weights; multiplying the logical values ​​of the first vector and the weights of the second vector in sequence and summing them to obtain a first score, adding the weights in the second vector to obtain a second score, and obtaining the text similarity based on the first score and the second score.

[0007] According to a construction site inspection process management method provided by the present invention, the step of assigning weights to words in a longer text includes: assigning a preset weight to words in a preset keyword or preset key words appearing in the longer text, and the weight of other words is less than the preset weight.

[0008] According to a construction site inspection process management method provided by the present invention, the step of obtaining the text similarity based on the first score and the second score includes: dividing the first score and the second score to obtain the text similarity.

[0009] According to a construction site inspection process management method provided by the present invention, the method further includes: segmenting the construction site inspection video file according to the inspection items to obtain an inspection item video list.

[0010] According to a construction site inspection process management method provided by the present invention, the text to be matched corresponding to the valid inspection item is converted from the audio data recorded at the beginning of the valid inspection item; the step of segmenting the construction site inspection video file according to the inspection item to obtain the inspection item video list includes: segmenting the construction site inspection video file according to the generation time of the audio data corresponding to the text to be matched corresponding to the valid inspection item to obtain the inspection item video list.

[0011] According to a construction site inspection process management method provided by the present invention, the method further includes: sending the inspection item video list and / or the inspection coverage rate to a preset terminal.

[0012] This invention also provides a construction site inspection process management device, comprising: a construction site inspection video file acquisition module, used for: acquiring construction site inspection video files; an audio extraction module, used for: extracting audio from the construction site inspection video files to obtain construction site inspection audio files; a text conversion module, used for: extracting continuous speech from the construction site inspection audio files, performing natural language processing on the continuous speech to obtain text to be matched; a text similarity matching module, used for: performing text similarity matching between the text to be matched and standard inspection item texts to obtain text similarity; wherein, the standard inspection item texts correspond one-to-one with inspection items; a valid inspection item acquisition module, used for: acquiring the maximum value in the text similarity, and if the maximum value in the text similarity is greater than a preset threshold, it indicates that the inspection item corresponding to the corresponding standard inspection item text is a valid inspection item; and an inspection coverage calculation module, used for: acquiring the number of valid inspection items, and calculating the inspection coverage based on the number of valid inspection items and the number of standard inspection item texts.

[0013] This invention also provides a construction site inspection process management system, comprising: a video acquisition device, a cloud server, and a construction site inspection process management device, wherein: the video acquisition device is used to acquire video during the inspection process, obtain a construction site inspection video file, and upload the construction site inspection video file to the cloud server; the cloud server is used to store the construction site inspection video file; the construction site inspection process management device is used to download the construction site inspection video file from the cloud server, extract audio from the construction site inspection video file to obtain a construction site inspection audio file; and extract the construction site inspection audio file. The system performs natural language processing on the continuous speech to obtain the text to be matched; it then performs text similarity matching between the text to be matched and the standard inspection item text to obtain the text similarity; wherein, the standard inspection item text corresponds one-to-one with the inspection item; it obtains the maximum value of the text similarity; if the maximum value of the text similarity is greater than a preset threshold, it indicates that the inspection item corresponding to the standard inspection item text is a valid inspection item; it obtains the number of valid inspection items, and calculates the inspection coverage rate based on the number of valid inspection items and the number of standard inspection item texts.

[0014] According to the construction site inspection process management system provided by the present invention, the construction site inspection video file includes construction site information, which is obtained by the video acquisition device by scanning a QR code.

[0015] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of any of the above-described site inspection process management methods.

[0016] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the site inspection process management method described above.

[0017] The present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of any of the above-described site inspection process management methods.

[0018] The construction site inspection process management method, device, storage medium, and program products provided by this invention extract continuous speech during the inspection process to obtain the corresponding text to be matched. The text to be matched is then matched with the standard inspection item text. When the maximum value of the text similarity is greater than a preset threshold, the corresponding inspection item is taken as a valid inspection item. The inspection coverage rate is calculated based on the number of valid training items and the number of standard inspection item texts, which can realize the compliance supervision of construction site inspections. In addition, the actual presence of inspection personnel can be confirmed based on the collected construction site inspection video files, thereby confirming the authenticity of the inspection process and enabling post-event traceability. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0020] Figure 1 This is one of the flowcharts of the construction site inspection process management method provided by the present invention;

[0021] Figure 2 This is a schematic diagram of the process for obtaining the text to be matched in the construction site inspection process management method provided by the present invention;

[0022] Figure 3 This is a schematic diagram of the identification process of effective inspection items in the construction site inspection process management method provided by the present invention;

[0023] Figure 4 This is a schematic diagram of the process of acquiring inspection project videos in the construction site inspection process management method provided by the present invention;

[0024] Figure 5 This is a schematic diagram of the result push in the construction site inspection process management method provided by the present invention;

[0025] Figure 6 This is a schematic diagram of the construction site inspection process management device provided by the present invention;

[0026] Figure 7 This is a schematic diagram of the construction site inspection process management system provided by the present invention;

[0027] Figure 8 This is the second flowchart of the construction site inspection process management method provided by the present invention;

[0028] Figure 9 This is a schematic diagram of the audio and video data uploading process in the construction site inspection process management method provided by the present invention;

[0029] Figures 10-15 This is a schematic diagram of the display interface of the video recorder inspection APP in the construction site inspection process management system provided by the present invention;

[0030] Figure 16 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation

[0031] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0032] The following is combined Figures 1-16 This invention describes a site inspection process management method, apparatus, storage medium, and program product.

[0033] Figure 1 This is one of the flowcharts illustrating the construction site inspection process management method provided by this invention. For example... Figure 1 As shown, the method includes:

[0034] Step 101: Obtain the construction site inspection video file.

[0035] For ease of description, the device that runs the site inspection process management method in this embodiment is referred to as the site inspection process management device.

[0036] When construction inspectors inspect a construction site (such as a home renovation site), they can use video capture equipment to record video, obtaining a site inspection video file. Understandably, the audio from the site is also captured simultaneously with the video. In other words, the site inspection video file includes both audio and video information from the construction site.

[0037] After the video capture device acquires video files for site inspections, it can send these files to a cloud server when connected to the internet, and the site inspection process management device can then download them from the cloud server. Alternatively, the video capture device can directly send the acquired video files to the site inspection process management device when connected to the internet. In this way, the site inspection process management device obtains the video files.

[0038] Step 102: Extract audio from the site inspection video file to obtain the site inspection audio file.

[0039] The construction site inspection process management device can use the ffmpeg (Fast Forward Mpeg) open-source technology to extract audio from construction site inspection video files to obtain construction site inspection audio files.

[0040] Step 103: Extract continuous speech from the construction site inspection audio file, perform natural language processing on the continuous speech to obtain the text to be matched.

[0041] VAD technology can be used to identify continuous speech and silent segments in construction site inspection audio files, removing silences before and after each continuous speech segment to obtain individual continuous speech segments. The construction site inspection process management device then performs natural language processing on the obtained continuous speech segments to obtain the text to be matched.

[0042] Figure 2 This is a schematic diagram of the text acquisition process in the construction site inspection process management method provided by the present invention. For example... Figure 2 As shown, after the audio file of continuous speech is processed by frame segmentation, MFCC (Mel-frequency cepstral coefficients) features are extracted, and then the text to be matched is obtained based on the acoustic model, dictionary and language model.

[0043] Step 104: Perform text similarity matching between the text to be matched and the standard inspection item text to obtain the text similarity; wherein, the standard inspection item text corresponds one-to-one with the inspection item.

[0044] The standard inspection item text can be a description of the inspection item that corresponds one-to-one with the inspection item. For example, the standard inspection item text could be "ground leveling inspection" or "wall hollowing inspection". The text to be matched is then compared with the standard inspection item text to obtain the text similarity score.

[0045] Step 105: Obtain the maximum value in the text similarity. If the maximum value in the text similarity is greater than a preset threshold, it means that the inspection item corresponding to the standard inspection item text is a valid inspection item.

[0046] The standard inspection item text is pre-set. To confirm valid inspection items (i.e., items that have actually been inspected) through text similarity, inspection personnel need to be pre-trained to say similar phrases when inspecting the corresponding items, such as "Perform ground leveling inspection," "Ground leveling inspection begins," "Ground leveling inspection," etc. Of course, if the inspector's words are completely identical to the standard inspection item text, the speech is converted to text to obtain the text to be matched. When the text similarity is calculated between the text to be matched and the corresponding standard inspection item text, the result is very high, reliably identifying which inspection items have been validly inspected. However, since the inspector's words do not necessarily follow the standard inspection item text, a preset threshold is set for text similarity. When the text similarity is greater than the preset threshold, the two texts are considered similar.

[0047] After matching the text to be matched with the standard inspection item text one by one, multiple text similarity results are obtained. There may be more than one text similarity result greater than the preset threshold, but since each text to be matched corresponds to one inspection item, the maximum value among the text similarities can be directly obtained. It is then determined whether the maximum value among the text similarities is greater than the preset threshold. If so, it means that the text to be matched is similar to the standard inspection item text used to calculate the maximum text similarity, indicating that the inspection item corresponding to the standard inspection item text used to calculate the maximum text similarity has been completed. In other words, the inspection item corresponding to the standard inspection item text used to calculate the maximum text similarity is a valid inspection item.

[0048] Step 106: Obtain the number of valid inspection items, and calculate the inspection coverage rate based on the number of valid inspection items and the number of standard inspection item texts.

[0049] After matching each text to be matched from consecutive speech samples with multiple standard inspection item texts one by one, the number of valid inspection items can be obtained based on the number of times the maximum text similarity exceeds a preset threshold. Furthermore, since each standard inspection item text corresponds one-to-one with the inspection item to be checked, the number of standard inspection item texts indicates the number of inspection items that need to be completed. Dividing the number of valid inspection items by the number of inspection items that need to be completed yields the inspection coverage rate.

[0050] The construction site inspection process management method provided by this invention extracts continuous speech during the inspection process to obtain the corresponding text to be matched. The text to be matched is then matched with the standard inspection item text for text similarity. When the maximum value of the text similarity is greater than a preset threshold, the corresponding inspection item is taken as a valid inspection item. The inspection coverage rate is calculated based on the number of valid training items and the number of standard inspection item texts, which can realize the compliance supervision of construction site inspections. In addition, the actual presence of inspection personnel can be confirmed based on the collected construction site inspection video files, thereby confirming the authenticity of the inspection process and enabling post-event traceability.

[0051] According to a construction site inspection process management method provided by the present invention, the step of performing text similarity matching between the text to be matched and the standard inspection item text to obtain text similarity includes: comparing the lengths of the text to be matched and the standard inspection item text, obtaining the occurrence position of the first character of the shorter text in the longer text, and aligning the text to be matched and the standard inspection item text with the occurrence position; comparing the corresponding characters of the text to be matched and the standard inspection item text, recording a logical value 1 if they are the same, and recording a logical value 0 if they are different or if there is no character in the shorter text, and constructing a first vector according to the character order in the longer text based on the corresponding logical values; assigning weights to the characters in the longer text, and constructing a second vector according to the character order in the longer text based on the corresponding weights; multiplying the logical values ​​of the first vector and the weights of the second vector in sequence and summing them to obtain a first score, adding the weights in the second vector to obtain a second score, and obtaining the text similarity based on the first score and the second score.

[0052] Figure 3 This is a schematic diagram illustrating the identification process of effective inspection items in the construction site inspection process management method provided by this invention. For example... Figure 3 As shown, the text to be matched is split into individual characters (arranged in the original order), and the standard inspection item text is also split into individual characters to obtain standard inspection item text groups (arranged in the original order). Text similarity matching is performed between the text to be matched and the standard inspection item texts. If the text similarity result is greater than a preset threshold, the corresponding inspection item is considered a valid inspection item; otherwise, it is considered an invalid inspection item. It is understandable that since there is only one valid inspection item corresponding to a text to be matched, it is only necessary to obtain the maximum value of the text similarity results between the text to be matched and each standard inspection item text, and then compare it with the preset threshold.

[0053] When performing text similarity matching between the text to be matched and the standard inspection item text to obtain the text similarity score, the lengths of the text to be matched and the standard inspection item text are compared. The position of the first character of the shorter text in the longer text is obtained, and the positions of the first character in the shorter text and the standard inspection item text are aligned. The corresponding characters in the text to be matched and the standard inspection item text are compared. If they are the same, a logical value of 1 is recorded. If they are different or there is no character in the shorter text, a logical value of 0 is recorded. The first vector is constructed by the corresponding logical values ​​according to the character order in the longer text. The characters in the longer text can be assigned weights according to a pre-set method, and the second vector is constructed by the corresponding weights according to the character order in the longer text. The logical values ​​of the first vector and the weights of the second vector are multiplied in sequence and summed to obtain the first score. The weights in the second vector are added to obtain the second score. The text similarity score is obtained based on the first score and the second score.

[0054] The construction site inspection process management method provided by this invention obtains a first vector based on the difference between the two by matching the text to be matched and the standard filter items, obtains a second vector based on the weight of the characters, and obtains the text similarity based on the first vector and the second vector. This method comprehensively considers multiple factors that affect the text similarity calculation and improves the accuracy of the text similarity results.

[0055] According to the construction site inspection process management method provided by the present invention, the step of assigning weights to words in a longer text includes: assigning a preset weight to words in a preset keyword or preset key words that appear in the longer text, and the weight of other words is less than the preset weight.

[0056] The weights of words in longer texts can be pre-set. For example, words in preset keywords or pre-defined keywords appearing in a longer text are assigned preset weights, and words in preset keywords have the same weight. To reflect the criticality of these words, their weights can be set to be greater than those of other ordinary words. For instance, the weight of preset keywords or pre-defined keywords appearing in a longer text can be set to greater than 1, with different weights assigned based on their importance. Other words, however, can have a weight of 1.

[0057] The construction site inspection process management method provided by this invention distinguishes the weights of words in the text by assigning preset weights to preset keywords or words in preset keywords that appear in a long text, while other words have a lower preset weight. This helps to obtain more accurate text similarity calculation results.

[0058] According to a construction site inspection process management method provided by the present invention, the step of obtaining the text similarity based on the first score and the second score includes: dividing the first score and the second score to obtain the text similarity.

[0059] When comparing the corresponding characters of the text to be matched and the standard inspection item text, a logical value of 1 is recorded if they are the same, and a logical value of 0 is recorded if they are different or if the shorter text contains no such character. The obtained logical values ​​form a first vector. The logical values ​​of the first vector and the weights of the second vector are multiplied sequentially and summed to obtain the first score. The weights in the second vector are then added to obtain the second score. The first score is related to which logical values ​​are 0; if characters with higher weights correspond to different characters, the first score will be lower. The second score reflects the result when all characters correspond to the same characters. Therefore, the ratio of the first score to the second score reflects the degree of text similarity. The following example illustrates the text similarity calculation process. The text to be matched (only one example is given) and the standard inspection item text (three examples are listed) obtained from natural language processing are shown in Table 1.

[0060] Table 1

[0061]

[0062] The keyword weight settings are shown in Table 2.

[0063] Table 2

[0064]

[0065] 1. Calculation of the match degree with "Start checking for ground hollowness" (text similarity between the text to be matched and the standard inspection item text).

[0066] (1) Compare the lengths of the text to be matched and the standard inspection item text. The text to be matched, “I’m going to start checking for hollow spots in the floor”, is the longer text, and the standard inspection item text, “Start checking for hollow spots in the floor”, is the shorter text. Obtain the position of the first character of the shorter text in the longer text, and align the text to be matched and the standard inspection item text with the position of the first character, as shown in Table 3.

[0067] Table 3

[0068] Text 1 I want open beginning Inspection check land plate null drum Already Text 2 open beginning Inspection check land noodle null drum

[0069] In this context, text 1 is the text to be matched, "I'm going to start checking for hollow spots in the floor," and text 2 is the standard filter text, "Start checking for hollow spots in the floor."

[0070] (2) Compare the corresponding characters of the text to be matched and the standard inspection item text. If they are the same, record the logical value 1. If they are different or there are no characters in the shorter text, record the logical value 0. The logical values ​​are used to form the first vector according to the character order in the longer text, as shown in Table 4.

[0071] Table 4

[0072]

[0073] (3) Assign weights to words in a longer text and construct a second vector according to the word order in the longer text; where keywords in the longer text are assigned weights according to preset weights, and other words are assigned weight 1, as shown in Table 5.

[0074] Table 5

[0075]

[0076] (4) Since the lengths of the first vector and the second vector are both the same as the number of characters in the longer text, the lengths of the first vector and the second vector are the same. The first score is obtained by multiplying the logical values ​​and weights in the first vector and then summing them. The second score is obtained by adding the weights in the second vector. The text similarity is obtained by dividing the first score by the second score, as shown in Table 6.

[0077] Table 6

[0078] First vector 0 0 1 1 1 1 1 0 1 1 0 Second vector 1 1 1 1 1 1 8 1 3 3 1 First score 18 Second score 22 Text similarity 81.8%

[0079] 2. Calculation of matching degree with "Start checking wall leveling"

[0080] (1) Compare the lengths of the text to be matched and the standard inspection item text. The text to be matched, “I’m going to start checking for hollow flooring,” is the longer text, while the standard inspection item text, “Start checking for wall leveling,” is the shorter text. Obtain the position of the first character of the shorter text within the longer text and align the text to be matched and the standard inspection item text with their positions, as shown in Table 7.

[0081] Table 7

[0082] Text 1 I want open beginning Inspection check land plate null drum Already Text 3 open beginning Inspection check wall noodle try to find flat

[0083] Among them, text 1 is the text to be matched, "I'm going to start checking for hollow spots in the floor", and text 3 is the standard filter text, "Start checking for wall leveling".

[0084] (2) Compare the corresponding characters of the text to be matched and the standard inspection item text. If they are the same, record the logical value 1. If they are different or there are no characters in the shorter text, record the logical value 0. The logical values ​​are used to form the first vector according to the character order in the longer text, as shown in Table 8.

[0085] Table 8

[0086]

[0087] (3) Assign weights to words in a longer text and construct a second vector according to the word order in the longer text; where keywords in the longer text are assigned weights according to preset weights, and other words are assigned weight 1, as shown in Table 9.

[0088] Table 9

[0089]

[0090] (4) Multiply the logical values ​​and weights in the first vector and the weights in the second vector in the order of logical values ​​and weights respectively to obtain the first score. Add the weights in the second vector to obtain the second score. Divide the first score and the second score to obtain the text similarity, as shown in Table 10.

[0091] Table 10

[0092]

[0093]

[0094] 3. Calculation of the match with "Start checking for hollow spots in the wall".

[0095] (1) Compare the lengths of the text to be matched and the standard inspection item text. The text to be matched, “I’m going to start checking for hollow floorboards,” is the longer text, while the standard filter item text, “Start checking for hollow walls,” is the shorter text. Obtain the position of the first character of the shorter text within the longer text, and align the text to be matched and the standard inspection item text with their positions, as shown in Table 11.

[0096] Table 11

[0097] Text 1 I want open beginning Inspection check land plate null drum Already Text 4 open beginning Inspection check wall noodle null drum

[0098] In this context, text 1 is the text to be matched, "I'm going to start checking for hollow spots in the floor," and text 4 is the standard filter text, "Start checking for hollow spots in the walls."

[0099] (2) Compare the corresponding characters of the text to be matched and the standard inspection item text. If they are the same, record the logical value 1. If they are different or there are no characters in the shorter text, record the logical value 0. The logical values ​​are used to form the first vector according to the character order in the longer text, as shown in Table 12.

[0100] Table 12

[0101]

[0102] (3) Assign weights to words in a longer text and construct a second vector according to the word order in the longer text; where keywords in the longer text are assigned weights according to preset weights, and other words are assigned weight 1, as shown in Table 13.

[0103] Table 13

[0104]

[0105] (4) Multiply the logical values ​​and weights in the first vector and the weights in the second vector in the order of logical values ​​and weights respectively to obtain the first score. Add the weights in the second vector to obtain the second score. Divide the first score and the second score to obtain the text similarity, as shown in Table 14.

[0106] Table 14

[0107] First vector 0 0 1 1 1 1 0 0 1 1 0 Second vector 1 1 1 1 1 1 8 1 3 3 1 First score 10 Second score 22 Text similarity 45.5%

[0108] Therefore, after matching the text "I'm going to start checking for hollow floor tiles" with the three standard filter items "Start checking for hollow floor tiles", "Start checking for wall leveling", and "Start checking for hollow wall tiles", the resulting text similarity scores were 81.8%, 18.2%, and 45.5%, respectively. The maximum text similarity score was 81.8%. If the preset threshold is 80%, then the maximum text similarity score is greater than the preset threshold, indicating that the inspection item "Hollow Floor Tile Inspection" corresponding to "Start Checking for Hollow Floor Tile" is a valid inspection item.

[0109] The construction site inspection process management method provided by this invention obtains the text similarity by dividing the first score and the second score, thus realizing the convenient acquisition of text similarity results.

[0110] According to a construction site inspection process management method provided by the present invention, the method further includes: segmenting the construction site inspection video file according to the inspection items to obtain an inspection item video list.

[0111] To facilitate independent viewing of videos for each valid inspection item, there is a need to segment the construction site inspection video files to obtain videos for each independent valid inspection item. Therefore, after obtaining the construction site video files, they can be segmented according to inspection items to obtain a list of inspection item videos. One way to segment the construction site video files according to inspection items is to record the time at the beginning of each inspection item during the recording process, and then segment the construction site video file based on the recorded time.

[0112] The construction site inspection process management method provided by this invention divides the construction site inspection video files according to the inspection items to obtain a video list of inspection items, which is conducive to separate management.

[0113] According to a construction site inspection process management method provided by the present invention, the text to be matched corresponding to the valid inspection item is converted from the audio data recorded at the beginning of the valid inspection item; the step of segmenting the construction site inspection video file according to the inspection item to obtain the inspection item video list includes: segmenting the construction site inspection video file according to the generation time of the audio data corresponding to the text to be matched corresponding to the valid inspection item to obtain the inspection item video list.

[0114] Inspection personnel can be trained to speak the standard inspection item text or similar text at the start of an inspection project. For example, if the standard inspection item text is "Start checking for hollow spots on the ground," the inspection personnel can say something like "I'm starting to check for hollow spots on the ground," "Start checking for hollow spots on the ground," or "I'm starting to check for hollow spots on the ground now." When this spoken text is converted to Chinese and matched with the standard inspection item text, a high similarity score (likely the maximum score and exceeding a preset threshold) indicates that the corresponding inspection project is complete; for example, checking for hollow spots on the ground is considered a valid inspection project.

[0115] Inspection personnel can check multiple items during a single inspection. At the start of each inspection item, they will say similar phrases, such as "I'm starting to check the ground leveling," etc. This sequentially identifies each valid inspection item. Therefore, the text to be matched corresponding to a valid inspection item is converted from the audio data recorded at the start of that valid inspection item. The text to be matched for a valid inspection item has the highest text similarity to the standard inspection item text corresponding to that valid inspection item, and this similarity exceeds a preset threshold.

[0116] Since the text to be matched corresponding to a valid inspection item is converted from the audio data recorded at the start of the valid inspection item, the site inspection video file can be segmented based on the audio data corresponding to the text to be matched for each valid inspection item, resulting in a list of inspection item videos. This list includes videos corresponding to each inspection item. When segmenting the site inspection video file based on the audio data corresponding to the text to be matched for each valid inspection item, the segmentation can be based on the generation time of the audio data. Site inspection video files received on the same day from the same construction site can be segmented to obtain the corresponding list of inspection item videos. Site information can be carried within the site inspection video file. The site inspection video file also contains information about the inspection personnel. Therefore, lists of inspection item videos from different dates can be integrated based on the information of the inspection personnel.

[0117] If the video length corresponding to a certain inspection item after segmentation is large, in order to save storage space, the video of the preset duration can be extracted, such as the first 15 minutes of video.

[0118] Figure 4 This is a schematic diagram illustrating the process of acquiring inspection project videos in the construction site inspection process management method provided by this invention. For example... Figure 4As shown, the construction site inspection process management device can obtain construction site inspection video files from the cloud server, extract continuous audio, perform natural language processing to obtain the files to be matched, and match the text to be matched with the standard inspection item texts of each inspection project. The device obtains the maximum text similarity score for each text to be matched. If the score is greater than a threshold, it indicates that the corresponding standard inspection item text represents a valid inspection project, and the construction site inspection video file can be segmented based on the audio to obtain the inspection project video. If the score is less than the threshold, it is not considered, meaning the corresponding audio is not used for segmentation of the construction site inspection video file.

[0119] The construction site inspection process management method provided by this invention converts the text to be matched corresponding to the valid inspection items into audio data recorded at the beginning of the valid inspection items, and segments the construction site inspection video files according to the audio data corresponding to the text to be matched corresponding to the valid inspection items to obtain a list of inspection item videos. The segmentation of inspection item videos can be achieved without additional operations, which improves the ease of segmentation of inspection item videos.

[0120] According to the construction site inspection process management method provided by the present invention, the method further includes: sending the inspection item video list and / or the inspection coverage rate to a preset terminal.

[0121] After obtaining the inspection item video list and inspection coverage, one or both of the inspection item video list and inspection coverage can be sent to the preset terminal.

[0122] Figure 5 This is a schematic diagram illustrating the result push in the construction site inspection process management method provided by this invention. For example... Figure 5 As shown, the inspection quality system score (inspection coverage rate) is sent to the terminals held by the project management team leader and inspection personnel. This allows the project management team leader to conduct overall project quality management, personnel management, and risk item management, while also allowing inspection personnel to conduct individual re-inspections. The list of inspection project videos is sent to the sampling inspection platform (which can be sent to a PC via web) for online sampling inspection and to issue warnings for any violations.

[0123] The construction site inspection process management method provided by this invention, by sending the inspection project video list and / or inspection coverage to a preset terminal, is conducive to further strengthening the management of the inspection process.

[0124] The site inspection process management device provided by the present invention is described below. The site inspection process management device described below and the site inspection process management method described above can be referred to in correspondence.

[0125] Figure 6This is a schematic diagram of the construction site inspection process management device provided by the present invention. Figure 6 As shown, the device includes a construction site inspection video file acquisition module 10, an audio extraction module 20, a text conversion module 30, a text similarity matching module 40, a valid inspection item acquisition module 50, and an inspection coverage calculation module 60, wherein:

[0126] The construction site inspection video file acquisition module 10 is used to: acquire construction site inspection video files;

[0127] The audio extraction module 20 is used to: extract audio from the construction site inspection video file to obtain a construction site inspection audio file;

[0128] The text conversion module 30 is used to: extract continuous speech from the construction site inspection audio file, perform natural language processing on the continuous speech, and obtain the text to be matched;

[0129] The text similarity matching module 40 is used to: perform text similarity matching between the text to be matched and the standard inspection item text to obtain the text similarity; wherein, the standard inspection item text corresponds one-to-one with the inspection item;

[0130] The effective inspection item acquisition module 50 is used to: acquire the maximum value in the text similarity; if the maximum value in the text similarity is greater than a preset threshold, it indicates that the inspection item corresponding to the standard inspection item text is a valid inspection item.

[0131] The inspection coverage calculation module 60 is used to: obtain the number of valid inspection items, and calculate the inspection coverage rate based on the number of valid inspection items and the number of standard inspection item texts.

[0132] The construction site inspection process management device provided by this invention extracts continuous speech during the inspection process to obtain the corresponding text to be matched. The text to be matched is then matched with the standard inspection item text for text similarity. When the maximum value of the text similarity is greater than a preset threshold, the corresponding inspection item is taken as a valid inspection item. The inspection coverage rate is calculated based on the number of valid training items and the number of standard inspection item texts, which can realize the compliance supervision of construction site inspections. In addition, the actual presence of inspection personnel can be confirmed based on the collected construction site inspection video files, thereby confirming the authenticity of the inspection process and enabling post-event traceability.

[0133] According to a construction site inspection process management device provided by the present invention, the text similarity matching module 40 is specifically used for: comparing the lengths of the text to be matched and the standard inspection item text, obtaining the position of the first character of the shorter text in the longer text, aligning the text to be matched and the standard inspection item text with the position of the first character; comparing the corresponding characters of the text to be matched and the standard inspection item text, recording a logical value 1 if they are the same, and recording a logical value 0 if they are different or if there is no character in the shorter text, constructing a first vector according to the character order in the longer text based on the corresponding logical values; assigning weights to the characters in the longer text, constructing a second vector according to the character order in the longer text based on the corresponding weights; multiplying the logical values ​​of the first vector and the weights of the second vector in sequence and summing them to obtain a first score, adding the weights in the second vector to obtain a second score, and obtaining the text similarity based on the first score and the second score.

[0134] The construction site inspection process management device provided by this invention obtains a first vector based on the difference between the two by matching the text to be matched and the standard filter items, obtains a second vector based on the weight of the characters, and obtains the text similarity based on the first vector and the second vector. It comprehensively considers multiple factors affecting the text similarity calculation and improves the accuracy of the text similarity results.

[0135] According to the construction site inspection process management device provided by the present invention, the text similarity matching module 40, when assigning weights to words in a longer text, is specifically used to: assign a value to a word in a preset keyword or preset key word appearing in the longer text according to a preset weight, and the weight of other words is less than the preset weight.

[0136] The construction site inspection process management method provided by this invention distinguishes the weights of words in the text by assigning preset weights to preset keywords or words in preset keywords that appear in a long text, while other words have a lower preset weight. This helps to obtain more accurate text similarity calculation results.

[0137] According to a construction site inspection process management device provided by the present invention, when the text similarity matching module 40 is used to obtain the text similarity based on the first score and the second score, it is specifically used to: divide the first score and the second score to obtain the text similarity.

[0138] The construction site inspection process management method provided by this invention obtains the text similarity by dividing the first score and the second score, thus realizing the convenient acquisition of text similarity results.

[0139] According to a construction site inspection process management device provided by the present invention, the device further includes an inspection project video list acquisition module, which is used to: segment the construction site inspection video file according to the inspection project to obtain an inspection project video list.

[0140] The construction site inspection process management method provided by this invention divides the construction site inspection video files according to the inspection items to obtain a video list of inspection items, which is conducive to separate management.

[0141] According to a construction site inspection process management device provided by the present invention, the text to be matched corresponding to the valid inspection item is converted from the audio data recorded at the beginning of the valid inspection item; the inspection item video list acquisition module, when used to segment the construction site inspection video file according to the inspection item to obtain the inspection item video list, is specifically used to: segment the construction site inspection video file according to the generation time of the audio data corresponding to the text to be matched corresponding to the valid inspection item to obtain the inspection item video list.

[0142] The construction site inspection process management device provided by the present invention converts the text to be matched corresponding to the valid inspection item into audio data recorded at the beginning of the valid inspection item, and segments the construction site inspection video file according to the audio data corresponding to the text to be matched corresponding to the valid inspection item to obtain a list of inspection item videos. The segmentation of inspection item videos can be realized without additional operations, which improves the ease of segmentation of inspection item videos.

[0143] According to the present invention, a construction site inspection process management device further includes a push module for sending the inspection project video list and / or the inspection coverage rate to a preset terminal.

[0144] The construction site inspection process management device provided by the present invention can further enhance the management of the inspection process by sending the inspection project video list and / or inspection coverage to a preset terminal.

[0145] Figure 7 This is a schematic diagram of the construction site inspection process management system provided by the present invention. Figure 7 As shown, the system includes a video acquisition device 1, a cloud server 2, and a construction site inspection process management device 3, wherein:

[0146] The video acquisition device 1 is used to acquire video during the inspection process, obtain the construction site inspection video file, and upload the construction site inspection video file to the cloud server 2;

[0147] The cloud server 2 is used to store the construction site inspection video files;

[0148] The construction site inspection process management device 3 is used to download the construction site inspection video file from the cloud server 2, extract audio from the construction site inspection video file to obtain a construction site inspection audio file; extract continuous speech from the construction site inspection audio file, perform natural language processing on the continuous speech to obtain text to be matched; perform text similarity matching between the text to be matched and the standard inspection item text to obtain text similarity; wherein, the standard inspection item text corresponds one-to-one with the inspection item; obtain the maximum value in the text similarity; if the maximum value in the text similarity is greater than a preset threshold, it indicates that the inspection item corresponding to the corresponding standard inspection item text is a valid inspection item; obtain the number of valid inspection items, and calculate the inspection coverage rate based on the number of valid inspection items and the number of standard inspection item texts.

[0149] The video capture device 1 can be a video recorder, smartphone, etc., and needs to have functions such as audio and video capture and network data upload.

[0150] The construction site inspection process management system provided by this invention extracts continuous speech during the inspection process to obtain the corresponding text to be matched. The text to be matched is then matched with the standard inspection item text for text similarity. When the maximum value of the text similarity is greater than a preset threshold, the corresponding inspection item is taken as a valid inspection item. The inspection coverage rate is calculated based on the number of valid training items and the number of standard inspection item texts, which can realize the compliance supervision of construction site inspections. In addition, the actual presence of inspection personnel can be confirmed based on the collected construction site inspection video files, thereby confirming the authenticity of the inspection process and enabling post-event traceability.

[0151] According to a construction site inspection process management system provided by the present invention, the construction site inspection video file includes construction site information, which is obtained by the video acquisition device 1 by scanning a QR code.

[0152] QR codes can be posted at the construction site. Before recording a site inspection video, inspection personnel scan the QR code to obtain site information, such as order number and site address. After the site inspection video file is generated, it is automatically linked to this site information. Therefore, the site inspection video file sent by video acquisition device 1 carries site information. Additionally, the device identifier of video acquisition device 1 can be used to distinguish different inspection personnel. Video acquisition device 1 also includes device information when sending the site inspection video file; therefore, the site inspection video file also includes the inspection personnel's information.

[0153] The cloud server can connect to the construction site management system to obtain real-time construction site information. Scanning a QR code to obtain construction site information can actually be achieved by accessing the cloud server.

[0154] The construction site inspection process management system provided by this invention obtains construction site information by scanning a QR code and adds the construction site information to the construction site inspection video file, thereby realizing the association between construction site information and construction site inspection video file.

[0155] Figure 8 This is the second flowchart illustrating the construction site inspection process management method provided by this invention. For example... Figure 8 As shown, this method can be implemented based on the construction site inspection process management system provided by this invention. Taking the application of this method to home decoration as an example, it includes the following steps:

[0156] Step 1: Develop standard operating procedures (SOPs) for inspection at each stage (e.g., masonry work, concealed works, mid-term projects, final projects, installation work). The SOPs should include the items to be inspected and the acceptance criteria. A "Renovation Notice" should be posted at the start of construction, containing a QR code for site information.

[0157] Step 2: Initialize the video recorder. Select "Android version" on the video recorder to install the Android application.

[0158] Step 3: Install the construction site inspection application. This application has three main functions: 1) Log in and scan the code to obtain information about the construction personnel and the construction site being inspected; 2) Record inspection videos (collect inspection process data); 3) Automatically upload audio and video records (inspection process data) to the server.

[0159] Step 4: Perform initial setup on the video recorder, including Wi-Fi settings. After initial setup, distribute the video recorders to the inspection personnel. The video recorder can be set to automatically power on when connected to power and automatically connect to the preset Wi-Fi network after powering on.

[0160] Step 5: On-site inspection by engineering personnel. Upon arriving at the construction site entrance, they scan the QR code on the renovation notice using a video recorder and log in using their employee ID and password. The video recorder will then indicate successful login. After donning the video recorder, the engineering personnel can begin the on-site inspection. The video recorder can be worn on their shoulder.

[0161] Step 6: When inspecting individual items, the inspection personnel should verbally announce the instructions. For example, when starting the inspection for hollow flooring, the inspection personnel should say "Start checking for hollow flooring" and then proceed with the inspection.

[0162] Step 7: After completing the inspection of all items, click "Complete Inspection". The inspection process record is saved on the video recorder's memory card. You can view it in the file list.

[0163] Step 8: After finishing their day's inspections and returning home, the engineers charge the video recorder and connect it to the internet. Once the inspection app detects that the environment is connected to Wi-Fi and the device is charging, it begins uploading video footage.

[0164] Figure 9 This is a schematic diagram illustrating the audio and video data uploading process of the construction site inspection process management method provided by this invention. (See diagram below.) Figure 9 As shown, after logging into the video recorder, scanning the QR code to obtain information about the current construction personnel and the inspected construction site, video recording begins, and the recorded audio and video are saved to the memory card. The system checks whether the video recorder is connected to Wi-Fi and power. If so, the recorded audio and video data is uploaded to the cloud server; otherwise, the upload service sleeps for one minute before checking for Wi-Fi and power connection again.

[0165] Step 9: After acquiring the site inspection video files, the site inspection process management device processes the audio and video recordings to generate an "Inspection Quality Score" and an "Inspection Item Video List." The "Inspection Quality Score" is based on the calculated inspection coverage rate and can be directly used as the inspection coverage rate. The "Inspection Quality Score" is sent to the corresponding project inspection team leader for unified management; the "Inspection Item Video List" is sent to centralized quality inspection personnel for secondary online verification.

[0166] Figures 10-15 This is a schematic diagram of the display interface of the video recorder inspection APP in the construction site inspection process management system provided by the present invention. Wherein, Figure 10 This is the interface displayed when logging in; Figure 11 The interface displayed after successful login prompts you to scan and record a video. Figure 12 The interface displayed after clicking the scan button prompts you to scan the QR code on the construction site behind the door. Figure 13 This is the display interface during the recording process. The order information is displayed at the top of the interface for binding the construction site when connected to the internet. Figure 14 The message displayed indicates when recording ends; Figure 15 This is the interface for displaying the file list.

[0167] The construction site inspection process management system provided by this invention allows for a relatively objective and accurate evaluation of the coverage of inspection items by inspection personnel each time they conduct an offline inspection of the construction site. Through centralized sampling inspections by online personnel, a second review of a certain inspection item can be conducted to ensure the quality of the inspection. When a construction site quality dispute occurs, the inspection video recording can be retrieved for immediate retrospective investigation.

[0168] Figure 16 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 16As shown, the electronic device may include: a processor 1610, a communications interface 1620, a memory 1630, and a communication bus 1640, wherein the processor 1610, the communications interface 1620, and the memory 1630 communicate with each other through the communication bus 1640. The processor 1610 can call logical instructions in the memory 1630 to execute a construction site inspection process management method. This method includes: acquiring a construction site inspection video file; extracting audio from the construction site inspection video file to obtain a construction site inspection audio file; extracting continuous speech from the construction site inspection audio file, performing natural language processing on the continuous speech to obtain text to be matched; performing text similarity matching between the text to be matched and standard inspection item texts to obtain text similarity; wherein the standard inspection item texts correspond one-to-one with inspection items; obtaining the maximum value in the text similarity; if the maximum value in the text similarity is greater than a preset threshold, it indicates that the inspection item corresponding to the corresponding standard inspection item text is a valid inspection item; obtaining the number of valid inspection items, and calculating the inspection coverage rate based on the number of valid inspection items and the number of standard inspection item texts.

[0169] Furthermore, the logical instructions in the aforementioned memory 1630 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0170] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the construction site inspection process management method provided by the above methods. The method includes: acquiring a construction site inspection video file; extracting audio from the construction site inspection video file to obtain a construction site inspection audio file; extracting continuous speech from the construction site inspection audio file, performing natural language processing on the continuous speech to obtain text to be matched; performing text similarity matching between the text to be matched and standard inspection item text to obtain text similarity; wherein, the standard inspection item text corresponds one-to-one with the inspection item; acquiring the maximum value in the text similarity; if the maximum value in the text similarity is greater than a preset threshold, it indicates that the inspection item corresponding to the corresponding standard inspection item text is a valid inspection item; acquiring the number of valid inspection items, and calculating the inspection coverage rate based on the number of valid inspection items and the number of standard inspection item texts.

[0171] In another aspect, the present invention also provides a non-transitory computer-readable storage medium storing a computer program thereon. When executed by a processor, the computer program implements the construction site inspection process management method provided by the above methods. The method includes: acquiring a construction site inspection video file; extracting audio from the construction site inspection video file to obtain a construction site inspection audio file; extracting continuous speech from the construction site inspection audio file, performing natural language processing on the continuous speech to obtain text to be matched; performing text similarity matching between the text to be matched and standard inspection item text to obtain text similarity; wherein, the standard inspection item text corresponds one-to-one with the inspection item; acquiring the maximum value in the text similarity; if the maximum value in the text similarity is greater than a preset threshold, it indicates that the inspection item corresponding to the corresponding standard inspection item text is a valid inspection item; acquiring the number of valid inspection items, and calculating the inspection coverage rate based on the number of valid inspection items and the number of standard inspection item texts.

[0172] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0173] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0174] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A construction site inspection process management method characterized by, The method comprises the following steps: acquiring a construction site inspection video file, wherein the construction site inspection video file is bound with construction site information and inspection engineering personnel information; extracting audio from the construction site inspection video file to obtain a construction site inspection audio file; extracting continuous speech from the construction site inspection audio file, and performing natural language processing on the continuous speech to obtain a text to be matched; performing text similarity matching on the text to be matched and standard inspection item texts to obtain a text similarity, wherein the standard inspection item texts correspond to inspection items one by one; acquiring a maximum value in the text similarity, and if the maximum value in the text similarity is greater than a preset threshold value, it is indicated that an inspection item corresponding to the standard inspection item text is a valid inspection item; acquiring the number of valid inspection items, and calculating an inspection coverage rate according to the number of valid inspection items and the number of standard inspection item texts; segmenting the construction site inspection video file according to inspection items to obtain an inspection item video list; sending the inspection item video list and / or the inspection coverage rate to a preset terminal.

2. The worksite inspection process management method of claim 1, wherein, The method comprises the following steps: comparing the lengths of the text to be matched and the standard inspection item texts, acquiring the position of the first word of the shorter text in the longer text, and aligning the text to be matched and the standard inspection item texts according to the position; comparing the corresponding position words of the text to be matched and the standard inspection item texts, recording a logical value 1 if they are the same, recording a logical value 0 if they are different or there is no word in the shorter text, and constructing a first vector from the corresponding logical values according to the word order in the longer text; assigning weights to the words in the longer text and constructing a second vector from the corresponding weights according to the word order in the longer text; multiplying the logical values of the first vector and the weights of the second vector in sequence and then summing to obtain a first score, adding the weights in the second vector to obtain a second score, and obtaining the text similarity according to the first score and the second score.

3. The worksite inspection process management method of claim 2, wherein, The method comprises the following steps: assigning a preset weight to the preset key word or the word in the preset key word in the longer text, and assigning a weight smaller than the preset weight to other words.

4. The construction site inspection process management method according to claim 2, characterized by, The method comprises the following steps: dividing the first score by the second score to obtain the text similarity.

5. The construction site inspection process management method of claim 1, wherein, The text to be matched corresponding to the valid inspection item is converted from audio data recorded at the start of the valid inspection item. The method comprises the following steps: segmenting the construction site inspection video file according to the generation time of the audio data corresponding to the text to be matched corresponding to the valid inspection item to obtain an inspection item video list.

6. A construction site inspection process management device characterized by comprising: The method comprises the following steps: a construction site inspection video file acquisition module is configured to acquire a construction site inspection video file, wherein the construction site inspection video file is bound with construction site information and inspection engineering personnel information; An audio extraction module is configured to perform audio extraction on the site inspection video file to obtain a site inspection audio file; A text conversion module is configured to extract continuous speech from the site inspection audio file, and perform natural language processing on the continuous speech to obtain a text to be matched; A text similarity matching module is configured to perform text similarity matching between the text to be matched and a standard inspection item text to obtain a text similarity, wherein the standard inspection item text corresponds to an inspection item one by one; An effective inspection item acquisition module is configured to obtain a maximum value in the text similarity, and if the maximum value in the text similarity is greater than a preset threshold, it indicates that an inspection item corresponding to the standard inspection item text is an effective inspection item; An inspection coverage rate calculation module is configured to obtain a number of the effective inspection items, and calculate an inspection coverage rate according to the number of the effective inspection items and a number of the standard inspection item texts; An inspection item video list acquisition module is configured to divide the site inspection video file according to inspection items to obtain an inspection item video list; A pushing module is configured to send the inspection item video list and / or the inspection coverage rate to a preset terminal.

7. A non-transitory computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to realize the steps of the site inspection process management method according to any one of claims 1 to 5.

8. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to realize the steps of the site inspection process management method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Mobile inspection analysis device and method thereof, mobile inspection equipment and storage medium

    CN110084530A

  • Trackside equipment inspection message generation method and system

    CN112735425A