Remote quality inspection method and system for engineering construction, electronic equipment and medium

Abstract

The invention provides a remote quality inspection method and system for engineering construction, electronic equipment and a storage medium, and aims to solve the problems that engineering construction management completely depends on site work and the quality is difficult to guarantee, and the method comprises the following steps: after a work order is received, receiving a video connection initiated by site personnel through a site terminal, and matching a remote quality inspector to be responsible for supervision; remote clock-in and sign-in are received, and a quality inspector confirms whether related personnel arrive at the scene or not through the position of the terminal and a video; manual work and AI intelligence are adopted, identity information of related personnel is checked through real-time video pictures, and whether facial features of the related personnel conform to qualification certificates in the validity period or not is verified; detecting whether a constructor carries safety protection equipment or not and whether the number and the model of the equipment are consistent with those of the work order or not for the video picture through AI; after construction, on-site non-standard operation is intervened, guided and corrected through a connection video. According to the invention, the safety, standardization and management efficiency of engineering site construction can be greatly improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of intelligent monitoring and management, and particularly relates to a remote quality inspection method for engineering construction, a remote quality inspection system for engineering construction, an electronic device, and a computer-readable storage medium. Background Art

[0002] The current management of communication engineering construction sites mainly includes management work such as construction safety, progress, and quality, and completely relies on project managers and project supervisors to accompany the work on-site. The professional capabilities, sense of responsibility, etc. of project managers and project supervisors directly affect whether the on-site management of the project is in place. However, in actual communication engineering construction, due to the large number of sites and wide distribution, a large number of project management personnel are required to conduct 100% real-time verification and real-time supervision of all sites (whether relevant personnel are in place, whether the on-site management is standardized, etc.). It is difficult to implement in actual operation, and the effective management of construction sites has always been a difficult problem in the industry. The current management of communication engineering construction sites mainly includes management work such as construction safety, progress, and quality, and completely relies on project managers and project supervisors to accompany the work on-site, which has the following disadvantages:

[0003] 1. It is difficult to manage the construction status of engineering projects in place. Relying on offline manual statistical reports for management is time-consuming and laborious, and it is difficult to control the authenticity. Managers at all levels cannot grasp the overall real-time construction status of engineering projects and cannot intuitively view the on-site implementation status of sites (sub-projects).

[0004] 2. The management of construction sites requires a large amount of manpower and material resources, and it is difficult to implement 100% on-site accompaniment. The scale of engineering construction in the whole province is large and the locations are scattered. A large number of project managers, supervisors, vehicles and other manpower and material resources are required for 100% on-site accompaniment of all construction sites, and it is difficult to implement and implement in place.

[0005] 3. It is difficult to guarantee the management quality of construction sites. The management of construction sites relies on project managers and project supervisors. The professional capabilities and sense of responsibility of on-site accompaniment personnel vary, and there is a lack of control means for the management quality of engineering construction sites, and it is difficult to guarantee management standardization.

[0006] 4. It is difficult to completely cure the problem of non-standard construction. For example, the process of key links such as incomplete arrival of personnel, unlicensed operation of special operations, and inspection of safety measures is not transparent, the quality inspection and control is not in place, problems occur frequently, the document records are incomplete and non-standard, and it is difficult to trace back afterwards, and there are potential hazards in construction management. Summary of the Invention

[0007] In order to at least solve the problem that in the prior art, the management work such as construction safety, progress, and quality completely relies on project managers and project supervisors to accompany the work on-site, and the quality is difficult to guarantee. The present disclosure provides a remote quality inspection method for engineering construction, a remote quality inspection system for engineering construction, an electronic device, and a computer-readable storage medium, which can greatly improve the safety, standardization, and management efficiency of on-site engineering construction.

[0008] In a first aspect, the present disclosure provides a remote quality inspection method for engineering construction, where the

[0009] method includes:

[0010] After a work order is received within the system, receive a video connection initiated by on-site staff through an on-site terminal, and match a remote quality inspector for this construction to be responsible for the real-time supervision of this construction;

[0011] Receive the remote clock-in of on-site staff, and the quality inspector confirms whether all relevant personnel have arrived at the site through the location information and video information of the on-site terminal;

[0012] Adopt a combined manual and AI intelligent review method. Through the real-time video images transmitted back, check the identity information of all relevant personnel, and verify whether their facial features match the valid vocational qualification certificates;

[0013] Use AI intelligence to detect from the real-time video images transmitted back whether construction workers carry safety protection equipment as required, and whether the quantity and model of the equipment to be constructed are consistent with the work order content;

[0014] After construction starts, through the connected video with construction workers, the remote quality inspector intervenes and guides and corrects the non-standard operations on site.

[0015] Further, the method further includes:

[0016] Before high-risk construction, play a construction site safety education video for construction workers through the APP of the on-site terminal, and capture the images of construction workers watching the safety education video through the camera and transmit them back to the remote end. The AI analyzes the video watching situation of on-site personnel. If there are abnormal actions by the viewers, an alarm reminder is sent through the on-site terminal.

[0017] Further, the method further includes:

[0018] After construction is completed, after obtaining the information determined by the safety monitoring personnel that the construction workers have safely returned, terminate the video monitoring;

[0019] Automatically save the video records, clock-in records, and AI recognition records as work order files to the document server and associate them with the corresponding work orders.

[0020] Further, the method further includes:

[0021] Obtain a construction task work order created by the project supervisor and approved through the process. The work order information includes the construction location, on-site construction person in charge, construction content, quantity and model of materials and equipment;

[0022] Dispatch a task work order within the system to the corresponding person in charge, so that the construction person in charge can receive the work order after accessing the system through their mobile terminal and organize the construction team to arrive at the construction site.

[0023] Furthermore, the method further includes:

[0024] When performing video and audio transmission, adopt H264 video encoding and OPUS (a voice encoding format) audio encoding, RTP (Real-Time Transport Protocol) / RTCP (RTP Control Protocol) real-time transport protocol, and DTLS (Datagram Transport Layer Security) encryption technology to ensure the secure and stable transmission of audio and video data.

[0025] In a second aspect, the present disclosure provides a remote quality inspection system for engineering construction, and the system includes:

[0026] A connection and distribution module, which is configured to receive a video connection initiated by on-site staff through an on-site terminal after a work order is received within the system, and match a remote quality inspector for this construction to be responsible for the real-time supervision of this construction;

[0027] A sign-in module, which is configured to receive the remote check-in of on-site staff, and the quality inspector confirms whether all relevant personnel have arrived at the site through the location information and video information of the on-site terminal;

[0028] An identity recognition module, which is configured to adopt a combined manual and AI intelligent review method to check the identity information of all relevant personnel through the real-time video images transmitted back, and verify whether their facial features match the valid vocational qualification certificates;

[0029] An on-site inspection module, which is configured to use AI intelligence to detect through the real-time video images transmitted back whether the construction personnel carry safety protection equipment as required, and whether the quantity and model of the equipment to be constructed are consistent with the work order content;

[0030] A on-site monitoring module, which is configured to, after the construction starts, through the connected video with the construction personnel, the remote quality inspector intervenes and guides the correction of non-standard operations on the site.

[0031] Furthermore, the system further includes a safety education module;

[0032] The safety education module is set to play safety education videos for construction workers through the APP on the on-site terminal before high-risk construction, and capture the pictures of construction workers watching the safety education videos through the camera and transmit them back to the remote end. The AI analyzes the video watching situation of on-site personnel. If there are abnormal actions of the viewers, an alarm reminder is given through the on-site terminal.

[0033] Further, the system further includes an archiving module;

[0034] The archiving module is set to terminate video monitoring after obtaining the information that the construction workers have safely returned determined by the safety monitoring personnel after the construction is completed; and,

[0035] Automatically save the video records, clock-in records, and AI recognition records as work order files to the document server and associate them with the corresponding work orders.

[0036] In a third aspect, the present disclosure provides an electronic device, including a memory and a processor. A computer program is stored in the memory. When the processor runs the computer program stored in the memory, the processor executes the remote quality inspection method for engineering construction as described in any one of the first aspects.

[0037] In a fourth aspect, the present disclosure provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, the remote quality inspection method for engineering construction as described in any one of the first aspects is implemented.

[0038] Beneficial effects:

[0039] The remote quality inspection method for engineering construction, the remote quality inspection system for engineering construction, the electronic device, and the storage medium provided by the present disclosure. Through real-time audio and video transmission, real-time remote visual management is realized. The front-end site uses intelligent terminals to collect on-site environmental information for face recognition, safety equipment detection, clock-in, etc. The background server cluster is equipped with AI algorithms to assist quality inspectors in personnel qualification screening, safety equipment identification, equipment verification and counting, etc., and stop safety violations in real time. A seamless and real-time supervision mechanism is realized to ensure that all construction links strictly follow the preset safety regulations and quality standards; greatly improve the safety, standardization and management efficiency of the communication engineering site. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 It is a schematic flowchart of a remote quality inspection method for engineering construction provided in Embodiment 1 of the present disclosure;

[0041] Figure 2 It is a schematic flowchart of a quality management process for the remote quality inspection method provided in Embodiment 2 of the present disclosure, which is process-oriented and systematic;

[0042] Figure 3 Schematic diagram of a front-end device deployment solution provided in the second embodiment of the present disclosure;

[0043] Figure 4 Schematic diagram of a remote facility deployment solution provided in the second embodiment of the present disclosure;

[0044] Figure 5 Architecture diagram of a remote quality inspection system for engineering construction provided in the third embodiment of the present disclosure;

[0045] Figure 6 Architecture diagram of an electronic device provided in the fourth embodiment of the present disclosure. Detailed implementation manners

[0046] To enable those skilled in the art to better understand the technical solutions of the present disclosure, the present disclosure will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments and drawings described herein are only for explaining the present invention, rather than limiting the present invention.

[0047] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily need to describe a specific order or sequence; and, without conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other arbitrarily.

[0048] Among them, the terms used in the embodiments of the present disclosure are only for the purpose of describing specific embodiments, and are not intended to limit the present disclosure. The singular forms "a", "the", and "said" used in the embodiments of the present disclosure and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.

[0049] In subsequent descriptions, the suffixes such as "module", "component", or "unit" used to represent elements are only for the convenience of explaining the present disclosure, and have no specific meaning in themselves. Therefore, "module", "component", or "unit" can be used interchangeably.

[0050] The technical solutions of the present disclosure and how the technical solutions of the present disclosure solve the above problems existing in the prior art will be described in detail below with specific embodiments. It can be understood that in the embodiments of the present application, the execution subject can execute some or all of the steps in the embodiments of the present application. These steps or operations are only examples, and the embodiments of the present application can also execute other operations or various deformations of the operations. In addition, the various steps can be executed in different orders presented in the embodiments of the present application, and it is possible not to execute all the operations in the embodiments of the present application. And, the following several specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0051] Figure 1 The following is a schematic flowchart of a remote quality inspection method for engineering construction provided in the first embodiment of the present disclosure. As Figure 1 shown, the method includes:

[0052] Step S101: After the work order is received in the system, receive the video connection initiated by the on-site staff through the on-site terminal, and match a remote quality inspector for this construction to be responsible for the real-time supervision of this construction;

[0053] Step S102: Receive the remote check-in of the on-site staff, and the quality inspector confirms whether all relevant personnel have arrived at the site through the location information and video information of the on-site terminal;

[0054] Step S103: Adopt a combined manual and AI intelligent review method to check the identity information of all relevant personnel through the backhauled real-time video images, and verify whether their facial features match the valid professional qualification certificates;

[0055] Step S104: Use AI intelligence to detect through the backhauled real-time video images whether the construction personnel carry safety protection equipment as required, and whether the quantity and model of the equipment to be constructed are consistent with the work order content;

[0056] Step S105: After the construction starts, through the connected video with the construction personnel, the remote quality inspector intervenes and guides the correction of the non-standard operations on the site.

[0057] With the large-scale deployment of 5G networks and the wide application of high-definition video instant communication technology on devices such as mobile phones, the technical conditions for realizing remote visual management and centralized remote supervision of communication engineering construction sites by using these advanced technical means have been available. This can not only empower managers at all levels of all parties in the project to improve their control and supervision efficiency, but also help to further strengthen the refined management of the construction site. The embodiment of the present disclosure realizes a seamless and real-time supervision mechanism by means of 5G remote video technology to ensure that all construction links strictly follow the preset safety regulations and quality standards.

[0058] To achieve this purpose, embodiments of the present disclosure equip on-site terminals with high-definition cameras and 5G capabilities at the construction site, such as smartphones, laptops, and other devices, and through specific applications, such as customized mobile application APPs, or existing applications such as video conferencing, which are not limited here. The APP can use the mobile phone camera and microphone to obtain real-time audio and video data and transmit it to the remote quality inspection center through the 5G network. At the same time, the APP can play the real-time guidance voice of the quality inspector through the mobile phone speaker to provide real-time operation guidelines for on-site construction workers. The mobile phone can be either fixedly installed on a bracket to record the construction process comprehensively or held for face recognition and safety inspection before construction.

[0059] The cloud computer room of the remote quality inspection center is configured with multiple high-performance servers, which respectively undertake various functions such as Web services, database services, file storage management, video distribution, and AI inference. The quality inspectors located at the seats in the remote quality inspection center access the background system through computer terminals. The servers receive the data transmitted by the front-end devices, decode, verify, allocate, and store it, and establish two-way data connection between the site and the quality inspection seats: live broadcast the audio and video of the construction site to the quality inspectors, and transmit the audio and text instructions of the quality inspectors to the workers at the construction site.

[0060] To achieve intelligent remote quality inspection, an AI model suitable for communication engineering projects can be trained using a large amount of on-site construction video materials and run on a remote AI server to achieve the following automated quality inspection functions: identity and qualification verification and on-site check-in; identification of safety protection equipment; verification of the model and quantity of telecommunications installation equipment. When the AI system discovers situations such as potential safety hazards, non-compliance of qualifications, and incorrect equipment and materials, it will pop up a real-time warning. The AI model can be based on existing various large model service platforms, such as Volcano Ark, 360 Brain, etc., or obtained through independent training. The specific training process can be achieved through existing technologies and will not be elaborated here.

[0061] During the process of remote quality inspection, after the work order is received in the system and the construction-related personnel arrive at the site, the on-site staff initiates a video connection with the remote quality inspection center. The center matches a remote quality inspector for this construction according to information such as the construction order number to be responsible for the real-time supervision of this construction, receives the remote check-in of the on-site staff, and the quality inspector confirms whether all relevant personnel have arrived at the site based on the location information and video information of the on-site terminal; specifically, the construction personnel can perform GPS positioning check-in through the APP, such as integrating the data of the mobile phone GPS module through the APP to confirm whether the construction personnel, safety officers, and supervisors have accurately reached the designated electronic fence area. If they have arrived, identify each person to complete the check-in. The quality inspector remotely confirms that all relevant personnel have arrived at the site.

[0062] Then, a construction site inspection is carried out, adopting a joint review method of manual and AI intelligent assistants. Through the real-time video images transmitted back, the AI checks the identity information of construction workers, safety officers, and supervisors, and verifies whether their facial features match the valid vocational qualification certificates. The AI detects whether the safety protection equipment (safety helmets, reflective vests, safety shoes, safety belts, safety hooks, and electrical test pens) is carried as required. The AI identifies whether the quantity and model of the installed equipment are consistent with the work order content. The AI displays the inspection results through a pop-up window, and the results are finally confirmed manually. If the AI identification is incorrect, the manual modification is made.

[0063] Construction process monitoring: Before construction, the construction worker holds an electrical test pen to check whether the construction environment is electrified, and the background records the whole process; after construction starts, the remote quality inspector uses the connected video. For any non-standard operations on-site, through the audio connection, the APP controls the mobile phone speaker to play voice and immediately intervenes and guides for correction.

[0064] Through real-time audio and video transmission, the embodiments of the present disclosure realize real-time remote visual management. The front-end site uses intelligent terminals to collect on-site environmental information, perform face recognition, safety equipment detection, check-in, etc. The background server cluster is equipped with AI algorithms to assist quality inspectors in personnel qualification screening, safety equipment identification, equipment verification and counting, etc., and immediately stop safety violations. A seamless and real-time supervision mechanism is realized to ensure that all construction links strictly follow the preset safety regulations and quality standards; greatly improve the safety, standardization, and management efficiency of the communication engineering site.

[0065] Furthermore, the method further includes:

[0066] Before high-risk construction, through the APP of the on-site terminal, safety education videos for the construction site are played for construction workers, and the images of construction workers watching the safety education videos are captured by the camera and transmitted back to the remote end. The AI analyzes the video-watching situation of on-site personnel. If there are abnormal movements of the viewers, an alarm reminder is given through the on-site terminal.

[0067] The embodiments of the present disclosure can also carry out targeted pre-operation safety education and training at the construction site. Through the APP, safety education videos for the construction site are played, and the images of watching the videos are captured by the camera and transmitted to the background. The AI analyzes the concentration of on-site personnel when watching the videos and whether there are abnormal movements, such as whether there are personnel who do not watch or are inattentive. If so, a warning reminder sound is emitted through the mobile phone speaker. Ensure that safety knowledge reaches front-line construction workers, thereby comprehensively improving the overall management level of the communication engineering site and ensuring construction safety.

[0068] Furthermore, the method further includes:

[0069] After the construction is completed, terminate the video monitoring after obtaining the information that the construction personnel have safely returned as determined by the safety monitoring personnel;

[0070] Automatically save the video records, check-in records, and AI recognition records as work order files to the document server and associate them with the corresponding work orders.

[0071] By archiving the completed construction, the video and voice records generated during the entire construction process will be automatically archived; the written and paper graphic materials formed in each stage of the project from order creation approval, receipt to acceptance will also be automatically archived. All data can be quickly retrieved and played back, strongly supporting the review of construction compliance and problem tracing; in addition, a detailed telecommunications equipment asset file will be automatically generated for easy later management.

[0072] Furthermore, the method further includes:

[0073] Obtain the construction task work order created by the project supervisor and approved through the process. The work order information includes the construction location, on-site construction person in charge, construction content, quantity and model of materials and equipment;

[0074] Dispatch the work order to the corresponding person in charge within the system, so that the construction person in charge can receive the work order after accessing the system through their mobile terminal and organize the construction team to arrive at the construction site.

[0075] Within the system, automated and on-site order dispatching and receiving can also be achieved, including: supervisor computer order dispatching: on the system work order management platform, the project supervisor creates and approves the construction task order through the process, fills in the work order information including the construction location, on-site construction person in charge, construction content, quantity and model of materials and equipment, etc. in detail, and dispatches the work order to the corresponding person in charge; and, construction team mobile phone order receiving: the construction person in charge receives the work order on the mobile phone and organizes the construction team to arrive at the construction site.

[0076] Furthermore, the method further includes:

[0077] When performing video and audio transmission, adopt H264 video encoding, OPUS audio encoding, RTP / RTCP real-time transmission protocol, and DTLS encryption technology to ensure the safe and stable transmission of audio and video data.

[0078] The original audio and video data is collected by a customized dedicated APP or an existing application with corresponding functions by calling the local camera and microphone of the mobile phone, and is efficiently compressed and encoded (H264 protocol for video and Opus protocol for audio) for network transmission. The encoded data is packed according to the Real-Time Transport Protocol (RTP), and the RTCP protocol is used to monitor the video transmission quality, report packet loss situations, and give jitter buffer suggestions to ensure the best real-time communication effect. Finally, the DTLS protocol is used to encrypt the RTP and RTCP traffic to ensure information security during the communication process.

[0079] The session connection between the construction site and the remote quality inspection center is established and maintained through signaling protocols such as WebSocket, HTTPS, and SIP (Session Initialization Protocol), and the STUN (Session Traversal Utilities for NAT) and TURN (Traversal Using Relay NAT) protocols are used to solve the NAT (Network Address Translation) traversal problem to ensure stable communication between both parties.

[0080] Furthermore, the remote quality inspection center supports multi-location and multi-channel video monitoring, and the function of managers accessing the same screen for collaborative supervision; different levels of managers are allowed to view the construction site videos in real time.

[0081] Through a specially designed monitoring interface, the quality inspector can monitor up to 10 construction sites simultaneously, flexibly switch the screen, and supervise the entire process from clock-in, construction site entry inspection, video safety education, construction process monitoring to construction completion confirmation through audio and video interaction, and promptly correct violations.

[0082] The embodiments of the present disclosure cover a series of links from pre-construction approval dispatching, on-site construction supervision to post-construction file management. By using high-definition smartphones and dedicated APPs, and through 5G real-time audio and video transmission, real-time remote visual management is achieved. At the front-end site, smartphones are used to collect on-site environmental information, perform face recognition, safety equipment detection, GPS clock-in, and play safety education videos. The back-end server cluster is equipped with AI algorithms to assist quality inspectors in tasks such as personnel qualification screening, safety equipment identification, and equipment verification and counting, and to stop safety violations in real time. In addition, the embodiments of the present disclosure support functions such as multi-location multi-channel video monitoring and multi-screen access and collaborative supervision by management personnel. Finally, the audio and video materials and document materials of the entire construction process can be automatically archived to form complete construction files and construction equipment asset files, which are convenient for retrieval, review, and traceability. This greatly improves the safety of the construction site, reduces the number of supervisors and their work intensity, effectively improves the construction quality, and enhances the standardization and management efficiency of the construction site.

[0083] Embodiment 2 of the present disclosure also provides a remote quality inspection method for engineering construction, which is applied to the remote construction quality inspection management of communication engineering. It adopts a comprehensive quality supervision system for construction processes, safety node control, and safety training, and uses 5G remote video technology to achieve a seamless and real-time supervision mechanism to ensure that all construction links strictly follow the preset safety regulations and quality standards.

[0084] 1. The quality management process of being process-oriented and systematic is as Figure 1 shown and includes:

[0085] Dispatch by the supervisor's computer: In the system work order management platform, the project supervisor creates and approves the construction task order through the process, and fills in the work order information in detail, including the construction location, on-site construction person in charge, construction content, quantity and model of materials and equipment, etc., and dispatches the task work order to the corresponding person in charge.

[0086] The construction team receives the order on the mobile phone: The construction person in charge receives the work order on the mobile phone and organizes the construction team to arrive at the construction site.

[0087] Remote clock-in: The construction personnel initiate a video through the APP, and the background system intelligently matches a remote quality inspector to be responsible for the real-time supervision of this construction. The construction personnel perform GPS two-factor positioning clock-in through the APP, and the quality inspector remotely verifies that all relevant personnel have arrived at the site.

[0088] Construction site entry inspection: Adopt a combined review method of manual and AI intelligent assistants. Through the real-time video footage transmitted back, the AI checks the identity information of construction workers, safety officers, and supervisors, and verifies whether their facial features match the valid vocational qualification certificates. The AI detects whether safety protection equipment (safety helmets, reflective vests, safety shoes, safety belts, safety hooks, electrical testers) is carried as required. The AI identifies whether the quantity and model of the installed equipment are consistent with the work order content. The AI displays the inspection results through pop-up windows for final confirmation by the manual operator. If the AI identification is incorrect, the manual operator makes modifications.

[0089] Video safety education: Before high-risk construction, play the construction site safety education video through the APP. The camera captures the video-watching footage and transmits it to the background. The AI analyzes the concentration of on-site personnel while watching the video. If a person does not watch or is inattentive, a warning reminder sound is emitted through the mobile phone speaker.

[0090] Construction process monitoring: Before construction, the construction worker holds an electrical tester to check whether the construction environment is energized, and the background records the whole process. After construction starts, the remote quality inspector uses the connected video. For any non-standard operations on-site, through the audio connection, the APP controls the mobile phone speaker to play the voice and immediately intervenes and guides for correction.

[0091] Construction completion and archiving: After construction is completed, the safety monitoring personnel check whether the construction workers have returned safely, then terminate the video monitoring. The video records, attendance records, AI identification records, etc. are automatically saved as archives to the document server and associated with the corresponding work order for convenient subsequent reference and safety accident tracing. Finally, the work order is closed.

[0092] The descriptions of each process and the front-end and back-end deployments are as follows:

[0093] 2. The front-end device deployment plan is as Figure 3 shown and includes:

[0094] Smartphones equipped with high-definition cameras and 5G functions are installed at the construction site, and a customized mobile application APP is installed. The APP uses the mobile phone camera and microphone to obtain real-time audio and video data and transmits it to the remote quality inspection center through the 5G network. At the same time, the APP can play the real-time guidance voice of the quality inspector through the mobile phone speaker to provide real-time operation guidelines for on-site construction workers. The mobile phone can be either fixedly installed on the bracket to record the construction process comprehensively or held for face recognition and pre-construction safety inspections.

[0095] 3. The remote facility deployment plan is as Figure 4 shown and includes:

[0096] The cloud computer room of the remote quality inspection center is equipped with multiple high-performance servers, which undertake multiple functions such as Web services, database services, file storage management, video distribution, and AI reasoning, while the quality inspectors at the remote quality inspection center seats access the backend system through computer terminals. The server receives the data transmitted by the front-end equipment, decodes, verifies, distributes and stores it, and connects the site with the quality inspection seat for two-way data connection: broadcasting the audio and video of the construction site to the quality inspectors, and delivering the audio and text instructions of the quality inspectors to the workers at the construction site.

[0097] 4. Audio and video stream processing and encrypted transmission solution:

[0098] A customized dedicated APP is used to collect raw audio and video data by calling the local camera and microphone of the mobile phone, and then efficiently compresses and encodes the data (video uses H264 protocol and audio uses Opus protocol) for network transmission. The encoded data is packaged according to the Real-time Transport Protocol (RTP), and the RTCP protocol is used to monitor the quality of video transmission, report packet loss, and give jitter buffer suggestions to ensure the best real-time communication effect. Finally, the DTLS protocol is used to encrypt RTP and RTCP traffic to ensure information security during the communication process.

[0099] 5. Audio and video session establishment and penetration technology:

[0100] The session connection between the construction site and the remote quality inspection center is established and maintained through signaling protocols such as WebSocket, HTTPS, and SIP, and the STUN and TURN protocols are used to solve the NAT traversal problem to ensure stable communication between the two parties.

[0101] 6. Two-factor clock-in:

[0102] The APP integrates the data from the mobile phone GPS module to confirm whether the construction workers, safety officers, and supervisors have accurately arrived at the designated electronic fence area, and verifies their corresponding qualification certificates (such as the validity of the climbing permit, safety officer certificate, and supervisor certificate). This mechanism implements a sign-in system based on dual verification of biometric facial recognition and GPS positioning information.

[0103] 7. Manual inspection and interaction:

[0104] Through a specially designed monitoring interface, quality inspectors can monitor up to 10 construction sites at the same time, switch screens flexibly, and supervise the entire process from clock-in, construction site inspection, video safety education, construction process monitoring to construction completion confirmation through audio and video interaction, and correct violations in a timely manner.

[0105] 8. AI video analysis:

[0106] An AI model suitable for communication engineering projects is trained using a large amount of construction site video materials and runs on a remote AI server to achieve the following automated quality inspection functions: identity and qualification verification and on-site check-in; identification of safety protection equipment; verification of the model and quantity of telecommunications installation equipment; when the AI system discovers situations such as safety hazards, non-compliance with qualifications, and incorrect equipment and materials, it will pop up a real-time warning window.

[0107] 9. Multi-party collaborative monitoring:

[0108] Department heads, project managers, project supervisors, and other relevant management personnel can access the system through their respective computer terminals, share the construction site video images with quality inspectors, and jointly participate in the supervision and guidance of communication base station construction.

[0109] 10. File management and traceability:

[0110] Video and voice records generated during the entire construction process will be automatically archived; text and paper graphic materials formed in each stage of the project from order creation approval, check-in to acceptance will also be automatically archived. All data can be quickly retrieved and played back, strongly supporting the review of construction compliance and problem tracing; in addition, a detailed telecommunications equipment asset file will be automatically generated for convenient later management.

[0111] The embodiments of the present disclosure can significantly enhance construction safety, reduce the number of supervisors and their work intensity, effectively improve construction quality, and form complete construction videos and text files for convenient later management.

[0112] Embodiment 3 of the present disclosure also provides a remote quality inspection system for engineering construction, as Figure 5 shown, the system includes:

[0113] A connection and distribution module 11, which is configured to receive a video connection initiated by on-site staff through an on-site terminal after a work order in the system is received, and match a remote quality inspector for this construction to be responsible for the real-time supervision of this construction;

[0114] A check-in module 12, which is configured to receive the remote check-in of on-site staff, and the quality inspector confirms whether all relevant personnel have arrived at the site through the location information and video information of the on-site terminal;

[0115] An identity recognition module 13, which is configured to adopt a combined manual and AI intelligent verification method to check the identity information of all relevant personnel through the real-time video images transmitted back, and verify whether their facial features match the valid vocational qualification certificates;

[0116] An on-site inspection module 14, which is configured to use AI intelligence to detect through the real-time video images transmitted back whether construction personnel carry safety protection equipment as required, and whether the quantity and model of the equipment to be constructed are consistent with the work order content;

[0117] The on-site monitoring module 15 is set to, after the construction starts, through the connected video with the construction workers, the remote quality inspector intervenes and guides the correction of non-standard operations on site.

[0118] Furthermore, the system further includes a safety education module 16;

[0119] The safety education module 16 is set to, before high-risk construction, play the safety education video of the construction site for the construction workers through the APP on the on-site terminal, and capture the pictures of the construction workers watching the safety education video through the camera and transmit them back to the remote end. The AI analyzes the situation of the on-site personnel watching the video. If there are abnormal actions of the viewers, an alarm reminder is given through the on-site terminal.

[0120] Furthermore, the system further includes an archiving module 17;

[0121] The archiving module 17 is set to, after the construction ends, after obtaining the information that the construction workers have safely returned determined by the safety monitoring personnel, terminate the video monitoring; and,

[0122] Automatically save the video record, the check-in record, and the AI recognition record as a work order file to the document server and associate it with the corresponding work order.

[0123] Furthermore, the system further includes a work order dispatching and receiving module 18:

[0124] The work order dispatching and receiving module 18 is set to obtain the construction task work order created by the project supervisor and approved through the process. The work order information includes the construction location, the on-site construction person in charge, the construction content, and the quantity and model of materials and equipment; and,

[0125] Dispatch the work order in the system to the corresponding person in charge, so that the construction person in charge can receive the work order after accessing the system through their mobile terminal and organize the construction team to arrive at the construction site.

[0126] Furthermore, the connection and distribution module 11 is specifically set as:

[0127] When performing video and audio transmission, use H264 video encoding, OPUS audio encoding, RTP / RTCP real-time transmission protocol, and DTLS encryption technology to ensure the safe and stable transmission of audio and video data.

[0128] The remote quality inspection system for engineering construction in the embodiments of the present disclosure is used to implement the remote quality inspection method for engineering construction in Embodiment 1 and Embodiment 2 of the method embodiment. Therefore, the description is relatively simple. For specific details, reference can be made to the relevant descriptions in the previous method embodiments, and details will not be repeated here.

[0129] In addition, as Figure 6As shown in the figure, Embodiment 4 of the present disclosure further provides an electronic device, including a memory 100 and a processor 200. A computer program is stored in the memory 100. When the processor 200 runs the computer program stored in the memory 100, the processor 200 executes the above various possible methods.

[0130] Among them, the memory 100 is connected to the processor 200. The memory 100 can adopt flash memory, read-only memory or other memories, and the processor 200 can adopt a central processing unit or a single-chip microcomputer.

[0131] In addition, Embodiment of the present disclosure further provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium, and the computer program is executed by the processor to perform the above various possible methods.

[0132] The computer-readable storage medium includes volatile or non-volatile, removable or non-removable media implemented in any method or technology for storing information such as computer-readable instructions, data structures, computer program modules or other data. The computer-readable storage medium includes but is not limited to RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash memory or other memory technologies, CD-ROM (Compact Disc Read-Only Memory), digital versatile disc (DVD, Digital Video Disc) or other optical disc storage, magnetic cassette, tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer.

[0133] It can be understood that the above embodiments are merely exemplary embodiments adopted to illustrate the principle of the present disclosure. However, the present disclosure is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and essence of the present disclosure, and these modifications and improvements are also regarded as the protection scope of the present disclosure.

Claims

1. A remote quality inspection method for engineering construction, characterized in that, The method includes: After a work order is received within the system, receive the video connection initiated by on-site staff through the on-site terminal, and match a remote quality inspector for this construction to be responsible for the real-time supervision of this construction; Receive the remote check-in of on-site staff, and the quality inspector confirms whether all relevant personnel have arrived at the site through the location information and video information of the on-site terminal; Adopt a combined manual and AI intelligent review method. Through the real-time video images transmitted back, check the identity information of all relevant personnel, and verify whether their facial features match the valid vocational qualification certificates; Use AI intelligence to detect from the real-time video images transmitted back whether the construction personnel carry safety protection equipment as required, and whether the quantity and model of the equipment to be constructed are consistent with the work order content; After the construction starts, through the connected video with the construction personnel, the remote quality inspector intervenes and guides the correction of non-standard operations on site.

2. The method according to claim 1, wherein The method further includes: Before high-risk construction, play the construction site safety education video for the construction personnel through the APP of the on-site terminal, and capture the video images of the construction personnel watching the safety education video through the camera and transmit them back to the remote end. The AI analyzes the video watching situation of the on-site personnel. If there are abnormal actions by the watching personnel, an alarm reminder is sent through the on-site terminal.

3. The method according to claim 1, wherein The method further includes: After the construction is completed, after obtaining the information determined by the safety monitoring personnel that the construction personnel have safely returned, terminate the video monitoring; Automatically save the video records, check-in records, and AI recognition records as work order files to the document server and associate them with the corresponding work orders.

4. The method according to claim 1, wherein The method further includes: Obtain the construction task work order created by the project supervisor and approved through the process. The work order information includes the construction location, on-site construction person in charge, construction content, quantity and model of materials and equipment; Dispatch the task work order within the system to the corresponding person in charge, so that the construction person in charge receives the work order after accessing the system through their mobile terminal and organizes the construction team to arrive at the construction site.

5. The method according to claim 1, wherein The method further includes: When performing video and audio transmission, adopt H264 video encoding, OPUS audio encoding, Real-Time Transport Protocol (RTP) / Real-Time Transport Control Protocol (RTCP) real-time transport protocol, and Datagram Transport Layer Security (DTLS) encryption technology to ensure the safe and stable transmission of audio and video data.

6. A remote quality inspection system for engineering construction, characterized in that, The system includes: A connection and allocation module, which is set to receive the video connection initiated by on-site staff through the on-site terminal after a work order is received within the system, and match a remote quality inspector for this construction to be responsible for the real-time supervision of this construction; A check-in module, which is set to receive the remote check-in of on-site staff, and the quality inspector confirms whether all relevant personnel have arrived at the site through the location information and video information of the on-site terminal; An identity recognition module, which is set to adopt a combined manual and AI intelligent review method. Through the real-time video images transmitted back, check the identity information of all relevant personnel, and verify whether their facial features match the valid vocational qualification certificates; An incoming inspection module, which is set to use AI intelligent detection on the real-time video images transmitted back to check whether the construction workers carry safety protection equipment as required, and whether the quantity and model of the equipment to be constructed are consistent with the work order content; A site monitoring module, which is set to, after the construction starts, through the connected video with the construction workers, the remote quality inspector intervenes and guides the correction of the non-standard operations on site.

7. The system according to claim 6, wherein The system further includes a safety education module; The safety education module is set to, before high-risk construction, play the safety education video of the construction site for the construction workers through the APP on the on-site terminal, and capture the images of the construction workers watching the safety education video through the camera and transmit them back to the remote end. The AI analyzes the video viewing situation of the on-site personnel. If there are abnormal actions by the viewing personnel, an alarm reminder is sent through the on-site terminal.

8. The system according to claim 6, wherein The system further includes an archiving module; The archiving module is set to, after the construction is completed, after obtaining the information that the construction workers have safely returned determined by the safety monitoring personnel, terminate the video monitoring; and, Automatically save the video record, the check-in record, and the AI recognition record as a work order file to the document server and associate it with the corresponding work order.

9. An electronic device, characterized in that, It includes a memory and a processor. A computer program is stored in the memory. When the processor runs the computer program stored in the memory, the processor executes the remote quality inspection method for engineering construction according to any one of claims 1-5.

10. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium. When the computer program is executed by the processor, it implements the remote quality inspection method for engineering construction according to any one of claims 1-5.

Images