A cable tray installation management system and method
The cable tray installation management system addresses installation errors and safety hazards by using a leveling device and 3D coordinate system for real-time monitoring and error correction, enhancing efficiency and safety through automated and intelligent cable tray installation.
Patent Information
- Application Number
- CN202411486527.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-23
- Publication Date
- 2025-01-03
- Estimated Expiration
- 2044-10-23
AI Technical Summary
Traditional cable tray installation processes rely heavily on manual operation and experience, leading to low efficiency, installation errors, and safety hazards, especially in complex environments where existing image recognition technologies fail to provide comprehensive monitoring and real-time feedback.
A cable tray installation management system and method that utilizes a leveling device to initiate image acquisition, matches real-time image data with pre-deployment signals, and employs a 3D absolute coordinate system to identify spatial displacements, generating prompt voice packages for error correction.
Enables comprehensive, automated, and intelligent monitoring of the installation process, significantly improving accuracy and safety by providing real-time error identification and correction, thus enhancing installation efficiency and reducing costs.
Smart Images

Figure CN119009802B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of building construction management, and in particular to a cable tray installation management system and method. Background Art
[0002] The traditional cable tray installation process mainly relies on manual operation and experience judgment, which not only leads to low installation efficiency, but also prone to installation errors and safety hazards. In order to improve the installation accuracy and efficiency of cable trays, some auxiliary installation technologies based on image recognition have appeared on the market. However, most of these technologies can only provide simple image comparison and location guidance, and cannot achieve comprehensive monitoring and real-time feedback of the installation process.
[0003] In particular, in complex installation environments, such as when multiple cable trays are installed at the same time or when the installation space is limited, existing auxiliary installation technologies often cannot accurately identify the installation intention and installation stage, nor can they provide effective installation guidance and error prompts in a timely manner. This makes it easy for installers to make mistakes in actual operations, and it is difficult to quickly locate and correct the errors after they occur. Summary of the invention
[0004] The main purpose of the present invention is to provide a cable tray installation management system and method, aiming to solve the technical problem that installers are prone to make mistakes in actual operations and it is difficult to quickly locate and correct the errors after making them.
[0005] To achieve the above object, the present invention provides a cable tray installation management method, comprising the following steps:
[0006] Obtaining a pre-deployment signal after leveling using a leveling device, and instructing an image acquisition device to start based on the pre-deployment signal;
[0007] Retrieving the cable tray installation guidance data in the preset database, and adding the image data acquired by the image acquisition device to the first matching queue, and at the same time adding the cable tray installation guidance data to the second matching queue;
[0008] Based on the timestamp when the image acquisition device is turned on as a starting point, the first matching queue and the second matching queue are overlapped and matched;
[0009] Identify the installation intentions of each stage in the first matching queue, and judge the coincidence of the installation intentions with the guidance intentions of each stage in the second matching queue, so as to gradually judge each installation stage. If they cannot coincide, determine the corresponding non-coincident stage part on the second matching queue;
[0010] The cable tray installation guidance data corresponding to the part of the stage that cannot be overlapped is converted into audio to form a prompt voice package, and the prompt voice package is output by the voice broadcasting equipment.
[0011] Furthermore, the step of adding the image data acquired by the image acquisition device to the first matching queue includes:
[0012] The image in the image data is segmented into stages of 10 seconds to obtain a plurality of image sub-data, and the changes of the cable tray in the time period from 0 seconds to 10 seconds in each of the image sub-data are determined, wherein the changes of the cable tray include position changes and shape changes of the cable tray;
[0013] The portion of the image sub-data where the cable tray changes occur is intercepted and retained, and each intercepted image sub-data is arranged one by one in the first matching queue according to the timeline.
[0014] Furthermore, the step of adding the cable tray installation guidance data to the second matching queue includes:
[0015] Identify the installation standard process classification in the cable tray installation guidance data, and split the videos in the cable tray installation guidance data based on the installation standard process classification to obtain each split installation guidance video;
[0016] Arrange each of the installation guide videos in sequence and add them to the second matching queue.
[0017] Furthermore, based on the timestamp when the image acquisition device is turned on as a starting point, the step of performing overlap matching on the first matching queue and the second matching queue includes:
[0018] Based on the label information of each installation guide video in the second matching queue, label recognition is performed on each image sub-data in the first matching queue;
[0019] Through the label recognition, a collection group corresponding to the label information is created on the first matching queue, so that the image labels on the first matching queue are matched one by one with the label information on the second matching queue to achieve overlap.
[0020] Further, identifying the installation intention of each stage in the first matching queue, and judging the coincidence of the installation intention with the guidance intention of each stage in the second matching queue, so as to gradually judge each installation stage, if they cannot coincide, then determining the corresponding non-coincident stage part on the second matching queue, including:
[0021] Using a pre-trained graph processing model to calibrate the people, cable trays and other objects in the image data in the first matching queue, and identifying the spatial displacement of the people, cable trays and other objects to determine the installation intention of the image data;
[0022] By corresponding each set group of the first matching queue to the label information of the second matching queue one by one, the installation intention in the first matching queue is split into each set group, and each set group corresponds to the label information of each second matching queue one by one, so as to achieve the overlap of the first matching queue and the second matching queue;
[0023] If any set of clusters cannot overlap with the label information in the second matching queue, it is determined that the spatial displacement of the people, cable trays, and other objects in the image sub-data at the corresponding position in the first matching queue is inaccurate.
[0024] Further, the step of determining that the spatial displacement of the person, cable tray, or other objects in the image sub-data at the corresponding position in the first matching queue is inaccurate includes:
[0025] The built-in 3D absolute coordinate system can be used to identify the spatial displacement of people, cable trays and other objects.
[0026] Furthermore, the steps of identifying the spatial displacement of people, cable trays and other objects through the built-in three-dimensional absolute coordinate system include:
[0027] Setting a coordinate error interval, and identifying the corresponding displacement amounts of the people, cable trays and other objects in the three-dimensional absolute coordinate system when they are spatially displaced;
[0028] The displacement is compared with the displacements of the characters, cable trays and other objects in the installation guide video corresponding to each tag information in the second matching queue to determine whether the coordinate error interval is exceeded;
[0029] If so, it is determined that the spatial displacement of people, cable trays, and other objects in the image sub-data is inaccurate.
[0030] Furthermore, the prompt information of the prompt voice package includes: installation process error and installation space position error.
[0031] Furthermore, the cable tray installation guidance data corresponding to the part of the stage that cannot overlap is converted into audio to form a prompt voice package, and the voice broadcasting device outputs the prompt voice package, including:
[0032] The installation guidance video in the cable tray installation guidance data is converted into voice to generate a prompt voice package corresponding to the part of the stage that cannot overlap.
[0033] The present invention also provides a cable tray installation management system, including a memory and a processor, wherein the memory stores a system calculation program, and the processor implements the steps of the above-mentioned cable tray installation management method when executing the system calculation program.
[0034] The cable tray installation management system and method provided by the present invention have the following beneficial effects:
[0035] (1) The present invention realizes comprehensive monitoring and management of the cable tray installation process in an automated and intelligent manner, thereby significantly improving installation efficiency and reducing the time and cost of manual operation.
[0036] (2) The present invention can identify installation intentions and stages in real time and match them with a preset database to ensure that each installation step complies with the standard process, thereby greatly improving the accuracy of the installation.
[0037] (3) When errors or non-compliance with standards occur during the installation process, the present invention can immediately identify and generate a prompt voice package, and remind the installer in real time through the voice broadcast device to help him quickly locate and correct the error.
[0038] (4) By reducing errors and hidden dangers during the installation process, the present invention effectively improves the safety of cable tray installation, ensuring the life safety of construction workers and the normal operation of equipment.
[0039] (5) The present invention realizes the digital and intelligent management of the cable tray installation process, which facilitates the subsequent maintenance and upgrading, and also provides strong support for the intelligent transformation of cable laying projects. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] Figure 1 It is a flow chart of a cable tray installation management method in one embodiment of the present invention.
[0041] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0042] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0043] Reference Figure 1 , is a flow chart of a cable tray installation management method proposed by the present invention, comprising the following steps:
[0044] S1, obtaining a pre-deployment signal after leveling using a leveling device, and instructing an image acquisition device to start based on the pre-deployment signal;
[0045] S2, retrieving the cable tray installation guidance data in the preset database, and adding the image data acquired by the image acquisition device to the first matching queue, and at the same time adding the cable tray installation guidance data to the second matching queue;
[0046] S3, based on the timestamp when the image acquisition device is turned on as a starting point, performing overlap matching on the first matching queue and the second matching queue;
[0047] S4, identifying the installation intentions of each stage in the first matching queue, and judging the coincidence of the installation intentions with the guidance intentions of each stage in the second matching queue, so as to gradually judge each installation stage, and if they cannot coincide, determining the corresponding non-coincident stage part in the second matching queue;
[0048] S5, converting the cable tray installation guidance data corresponding to the part of the stage that cannot be overlapped into audio to form a prompt voice package, and the voice broadcasting device outputs the prompt voice package.
[0049] In S1, the system can receive and identify the signal sent by the leveling device after completing the leveling work. The signal includes an electrical signal, a wireless signal or a digital signal, which contains information about the horizontal status of the pre-deployment position of the cable tray. After receiving the pre-deployment signal, the image acquisition device (such as a camera, a video camera, etc.) will be instructed to turn on according to the content of the pre-deployment signal. The image acquisition device is used to capture real-time images during the installation of the cable tray for subsequent image processing and installation monitoring.
[0050] In S2, first, the installation guidance data of the cable tray is retrieved from the preset database. The database contains information such as standard processes, specifications, technical requirements, etc. for cable tray installation, which provides the basis for subsequent installation monitoring and guidance. Secondly, the system adds the image data collected in real time by the image acquisition device (such as a camera) to a data structure called the "first matching queue". This queue is used to temporarily store and manage these image data for subsequent matching and comparison with the installation guidance data. At the same time, the system also adds the cable tray installation guidance data retrieved from the database to another data structure called the "second matching queue". This queue is used to store and manage the installation guidance data for matching and comparison with the real-time collected image data.
[0051] In S3, the system uses the timestamp when the image acquisition device is turned on as the starting point to perform coincidence matching of the first matching queue and the second matching queue. The timestamp is a data that records time, which accurately marks the moment when the image acquisition device starts working. At this point in time, the system starts to collect image data and adds it to the first matching queue. At the same time, the system also retrieves the installation guidance data of the cable tray from the preset database and adds it to the second matching queue. In order to coincidentally match the two queues, the system synchronizes the data in the two queues based on the timestamp when the image acquisition device is turned on. The system will try to correspond and match the image data in the first matching queue with the installation guidance data in the second matching queue in time. Through coincidence matching, the system can effectively compare and analyze the real-time collected image data with the installation guidance data of the cable tray. This helps the system to monitor the installation process of the cable tray in real time and provide accurate installation guidance and error prompts when necessary.
[0052] In S4, the system further processes the data in the first matching queue and the second matching queue. Specifically, the system identifies the installation intentions of each stage in the first matching queue, which usually involves analysis and interpretation of image data to determine the operations or steps being performed by the installer. Then, the system makes a coincidence judgment between the identified installation intentions and the guidance intentions of each stage in the second matching queue. The guidance intentions in the second matching queue are based on the preset cable tray installation guidance data, which represents the standard installation process and steps. By comparing the real-time installation intentions with the standard guidance intentions, the system can determine whether the current installation stage meets expectations. In the process of gradually judging each installation stage, if the system finds that the real-time installation intentions cannot overlap with the standard guidance intentions, this means that there are problems or deviations in the current installation stage. At this time, the system will determine the corresponding non-overlapping stage parts on the second matching queue, which will help the installer to quickly locate the problem and take corresponding corrective measures.
[0053] In S5, the system performs specific processing on the non-overlapping stage parts identified in step S4. These non-overlapping stage parts represent differences or errors between the real-time installation intention and the standard installation instructions. In order to promptly remind the installers and help them correct the errors, the system performs audio conversion on the cable tray installation guidance data corresponding to these non-overlapping stage parts. This means that the system converts these data into voice form to form prompt voice packages. Subsequently, the system outputs these prompt voice packages through a voice broadcast device. The voice broadcast device may be a speaker, headphones, or other device that can play audio. When the installers hear these prompt voices, they can immediately understand the problems or errors in the current installation stage and make corresponding corrections based on the voice prompts.
[0054] In one embodiment, the step of adding the image data acquired by the image acquisition device to the first matching queue includes:
[0055] The image in the image data is segmented into stages of 10 seconds to obtain a plurality of image sub-data, and the changes of the cable tray in the time period from 0 seconds to 10 seconds in each of the image sub-data are determined, wherein the changes of the cable tray include position changes and shape changes of the cable tray;
[0056] The portion of the image sub-data where the cable tray changes occur is intercepted and retained, and each intercepted image sub-data is arranged one by one in the first matching queue according to the timeline.
[0057] In this embodiment, the step of adding the image data collected by the image acquisition device to the first matching queue is described in detail. This process mainly includes the following key steps:
[0058] Image Segmentation:
[0059] The system first divides the continuous image data into 10-second stages. This means that from the beginning of the image data, every 10 seconds will be divided into an independent image sub-data. Such division helps to manage and analyze the image data more effectively in the future.
[0060] Change judgment:
[0061] For each image sub-data, the system determines whether the cable tray has changed during the time period from 0 seconds to 10 seconds. This change may include a change in position (such as movement of the cable tray) or a change in shape (such as bending or twisting of the cable tray).
[0062] Data interception and retention:
[0063] If a change in the cable tray is detected in a certain image sub-data, the system will intercept the changed part of this sub-data and retain this part of the data. This can reduce the amount of data to be processed later while ensuring that only the parts that have actually changed are focused on.
[0064] Queue arrangement:
[0065] Finally, the system will arrange each captured image sub-data into the first matching queue one by one according to the timeline. In this way, the data in the first matching queue is arranged in chronological order and only contains the image data of the part where the cable tray has changed.
[0066] In one embodiment, the step of adding the cable tray installation guidance data to the second matching queue includes:
[0067] Identify the installation standard process classification in the cable tray installation guidance data, and split the videos in the cable tray installation guidance data based on the installation standard process classification to obtain each split installation guidance video;
[0068] Arrange each of the installation guide videos in sequence and add them to the second matching queue.
[0069] In this embodiment, the specific steps of how to add the cable tray installation guidance data to the second matching queue are described. This process mainly includes the following key steps:
[0070] Installation standard process classification identification:
[0071] The system first identifies the installation standard process classification in the cable tray installation guide data. These classifications may include different installation stages, steps or tasks, such as preparation stage, installation stage, commissioning stage, etc.
[0072] Video Splitting:
[0073] Based on the identified installation standard process classification, the system splits the video in the cable tray installation guide data. This means that the system will split a long installation guide video into multiple shorter video clips corresponding to different installation standard process classifications.
[0074] Arrange and add in order:
[0075] After splitting, the system will obtain various installation guide videos, which correspond to different installation standard process categories. Then, the system will arrange these installation guide videos in order according to their corresponding installation process sequence and add them to the second matching queue one by one.
[0076] In one embodiment, based on the timestamp when the image acquisition device is turned on as a starting point, the step of performing overlap matching on the first matching queue and the second matching queue includes:
[0077] Based on the label information of each installation guide video in the second matching queue, label recognition is performed on each image sub-data in the first matching queue;
[0078] Through the label recognition, a collection group corresponding to the label information is created on the first matching queue, so that the image labels on the first matching queue are matched one by one with the label information on the second matching queue to achieve overlap.
[0079] In this embodiment, the specific steps of how to overlap and match the first matching queue and the second matching queue based on the timestamp when the image acquisition device is turned on as the starting point are described. This process mainly includes the following key steps:
[0080] Label information identification:
[0081] The system first identifies the tag information of each installation guide video in the second matching queue. The tag information may include installation phase, steps, tasks, required tools, materials, etc., which are used to describe and classify different installation guide videos.
[0082] Image sub-data label identification:
[0083] Next, the system performs label recognition on each image sub-data in the first matching queue. This is achieved through image analysis technology. The system will recognize label information related to the installation process based on the content in the image sub-data.
[0084] Create a collection group:
[0085] Through tag recognition, the system creates a collection group on the first matching queue that corresponds to the tag information in the second matching queue. This means that the system will group the image sub-data in the first matching queue according to the similarity of the tag information, and each group corresponds to a tag information in the second matching queue.
[0086] To achieve overlap:
[0087] Finally, through tag matching, the system matches the image tags on the first matching queue with the tag information on the second matching queue one by one to achieve overlap. In this way, the image sub-data in the first matching queue establishes a corresponding relationship with the installation guidance video in the second matching queue, providing a basis for subsequent installation monitoring and guidance.
[0088] In one embodiment, identifying the installation intentions of each stage in the first matching queue, and judging the coincidence of the installation intentions with the guidance intentions of each stage in the second matching queue to gradually judge each installation stage, and if they cannot coincide, determining the corresponding non-coincident stage part on the second matching queue, comprises:
[0089] Using a pre-trained graph processing model to calibrate the people, cable trays and other objects in the image data in the first matching queue, and identifying the spatial displacement of the people, cable trays and other objects to determine the installation intention of the image data;
[0090] By corresponding each set group of the first matching queue to the label information of the second matching queue one by one, the installation intention in the first matching queue is split into each set group, and each set group corresponds to the label information of each second matching queue one by one, so as to achieve the overlap of the first matching queue and the second matching queue;
[0091] If any set of clusters cannot overlap with the label information in the second matching queue, it is determined that the spatial displacement of the people, cable trays, and other objects in the image sub-data at the corresponding position in the first matching queue is inaccurate.
[0092] In this embodiment, the specific steps of how to identify the installation intentions of each stage in the first matching queue and determine the overlap between them and the guidance intentions of each stage in the second matching queue are described. This process mainly includes the following key steps:
[0093] Image data calibration and intent recognition:
[0094] Using a pre-trained graph processing model, the system calibrates the image data in the first matching queue. This process involves identifying people, cable trays, and other items in the image and determining their spatial displacement. With this information, the system is able to infer the installation intent of the image data, that is, the goal or task of the current installation phase.
[0095] Installation intention splitting and overlapping:
[0096] The system divides the installation intentions in the first matching queue into various clusters, each of which corresponds to a specific installation stage or task. At the same time, these clusters also correspond one-to-one with the tag information in the second matching queue. In this way, the system achieves the overlap of the first matching queue and the second matching queue, so that each image sub-data is associated with the corresponding installation guide video.
[0097] Coincidence judgment and problem identification:
[0098] The system checks whether each cluster can overlap with the tag information in the second matching queue. If a cluster cannot overlap with the corresponding tag information, the system will determine that the spatial displacement of people, cable trays, and other items in the image sub-data at the corresponding position in the first matching queue is inaccurate. This may mean that there was a deviation or error in the installation process, which needs to be corrected by the installer.
[0099] In one embodiment, the step of determining that the spatial displacement of the person, cable tray, or other object in the image sub-data at the corresponding position in the first matching queue is inaccurate includes:
[0100] The built-in 3D absolute coordinate system can be used to identify the spatial displacement of people, cable trays and other objects.
[0101] In this embodiment, when the system determines that the spatial displacement of people, cable trays, and other objects in the image sub-data of the corresponding position in the first matching queue is inaccurate, it will take specific steps to further analyze and confirm. This step mainly relies on the built-in three-dimensional absolute coordinate system.
[0102] Application of three-dimensional absolute coordinate system:
[0103] The system uses a built-in 3D absolute coordinate system to accurately identify the location of people, cable trays and other items in space. This coordinate system provides a fixed, unified reference frame that enables the system to accurately measure and track the displacement of these objects in space.
[0104] Identification of spatial displacement:
[0105] Through the 3D absolute coordinate system, the system can capture and record the position changes of people, cable trays and other objects in space in real time. These position change data are used to analyze their spatial displacement, that is, how they move in space.
[0106] Determination of inaccuracy:
[0107] If the system finds that the actual spatial displacement is inconsistent with the expected installation intention or guidance intention, it will determine that the spatial displacement of people, cable trays, and other items in the image sub-data at the corresponding position in the first matching queue is inaccurate. This inconsistency may indicate deviations, errors, or anomalies in the installation process.
[0108] In one embodiment, the step of identifying the spatial displacement of people, cable trays and other objects through a built-in three-dimensional absolute coordinate system includes:
[0109] Setting a coordinate error interval, and identifying the corresponding displacement amounts of the people, cable trays and other objects in the three-dimensional absolute coordinate system when they are spatially displaced;
[0110] The displacement is compared with the displacements of the characters, cable trays and other objects in the installation guide video corresponding to each tag information in the second matching queue to determine whether the coordinate error interval is exceeded;
[0111] If so, it is determined that the spatial displacement of people, cable trays, and other objects in the image sub-data is inaccurate.
[0112] In this step, the system uses the built-in 3D absolute coordinate system to accurately monitor and identify the displacement of people, cable trays and other objects in space. The following is a detailed explanation of this step:
[0113] Set the coordinate error interval:
[0114] The system first sets a coordinate error interval, which defines the acceptable deviation range between the spatial displacement of people, cable trays and other objects and the expected displacement during the actual installation process.
[0115] Identify the displacement:
[0116] When people, cable trays and other objects in the 3D absolute coordinate system are displaced in space, the system will identify and calculate their respective displacements in real time. These displacements reflect the actual movement of the objects in space.
[0117] Compare with the installation guide video:
[0118] The system compares the actual displacement identified with the expected displacement of people, cable trays and other items in the installation guide video corresponding to each tag information in the second matching queue. This comparison process is to check whether the actual displacement meets the expected installation guide.
[0119] Determine the displacement accuracy:
[0120] If the difference between the actual displacement and the expected displacement exceeds the set coordinate error range, the system will determine that the spatial displacement of people, cable trays, and other objects in the image sub-data of the corresponding position in the first matching queue is inaccurate. This inaccuracy may mean that there is a deviation or error in the installation process.
[0121] Specifically, the prompt information of the prompt voice package includes: installation process error and installation space position error.
[0122] The installation guidance video in the cable tray installation guidance data is converted into voice to generate a prompt voice package corresponding to the part of the stage that cannot overlap.
[0123] To summarize, first determine the location of the cable tray to be deployed, use a level and other equipment to locate and level the location, and generate a corresponding pre-deployment signal. Use the generated signal to start the corresponding image acquisition device to shoot the video process of the workers installing the cable tray and supervise it. To start the supervision procedure, it is necessary to first retrieve the cable tray installation guidance data from the database to compare the real-time captured video with the installation guidance data. Therefore, the captured image data is added to the first matching queue, and the cable tray installation guidance data of the video nature is added to the second matching queue. Through the overlap of the first matching queue and the second matching queue, it is determined whether the real-time installation of the cable tray is consistent with the installation standard in the database. If it cannot overlap normally, it is determined that the real-time video installation of the cable tray of the part that cannot overlap is not standard, and the second matching queue corresponding to the part that cannot overlap is intercepted, so as to determine the corresponding part of the cable tray installation guidance data through the intercepted corresponding second matching information, and perform voice conversion of this part to prompt the construction personnel.
[0124] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, device, article or method including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, device, article or method. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the presence of other identical elements in the process, device, article or method including the element.
[0125] The above description is only a preferred embodiment of the present invention, and does not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A cable tray installation management method, characterized in that: The following steps are involved: Obtaining a pre-deployment signal after leveling using a leveling device, and instructing an image acquisition device to start based on the pre-deployment signal; Retrieving the cable tray installation guidance data in the preset database, and adding the image data acquired by the image acquisition device to the first matching queue, and at the same time adding the cable tray installation guidance data to the second matching queue; Based on the timestamp when the image acquisition device is turned on as a starting point, the first matching queue and the second matching queue are overlapped and matched; Identify the installation intentions of each stage in the first matching queue, and judge the coincidence of the installation intentions with the guidance intentions of each stage in the second matching queue, so as to gradually judge each installation stage. If they cannot coincide, determine the corresponding non-coincident stage part on the second matching queue; The cable tray installation guidance data corresponding to the part of the stage that cannot be overlapped is converted into audio to form a prompt voice package, and the voice broadcasting device outputs the prompt voice package; The step of performing overlap matching on the first matching queue and the second matching queue based on the timestamp when the image acquisition device is turned on as a starting point comprises: Based on the label information of each installation guide video in the second matching queue, label recognition is performed on each image sub-data in the first matching queue; By means of the label recognition, a collection group corresponding to the label information is created on the first matching queue, so that the image labels on the first matching queue are matched one by one with the label information on the second matching queue to achieve overlap; The steps of identifying the installation intentions of each stage in the first matching queue, and judging the coincidence of the installation intentions with the guidance intentions of each stage in the second matching queue to gradually judge each installation stage, and if they cannot coincide, determining the corresponding non-coincident stage part on the second matching queue, include: Using a pre-trained graph processing model to calibrate the people, cable trays and other objects in the image data in the first matching queue, and identifying the spatial displacement of the people, cable trays and other objects to determine the installation intention of the image data; By corresponding each set group of the first matching queue to the label information of the second matching queue one by one, the installation intention in the first matching queue is split into each set group, and each set group corresponds to the label information of each second matching queue one by one, so as to achieve the overlap of the first matching queue and the second matching queue; If any set of clusters cannot overlap with the tag information in the second matching queue, it is determined that the spatial displacement of the person, cable tray, or other items in the image sub-data at the corresponding position in the first matching queue is inaccurate; The steps of determining that the spatial displacement of the person, cable tray, or other object in the image sub-data at the corresponding position in the first matching queue is inaccurate include: Identify the spatial displacement of people, cable trays and other objects through the built-in 3D absolute coordinate system; The steps for identifying the spatial displacement of people, cable trays and other objects through the built-in 3D absolute coordinate system include: Setting a coordinate error interval, and identifying the corresponding displacement amounts of the people, cable trays and other objects in the three-dimensional absolute coordinate system when they are spatially displaced; The displacement is compared with the displacements of the characters, cable trays and other objects in the installation guide video corresponding to each tag information in the second matching queue to determine whether the coordinate error interval is exceeded; If so, it is determined that the spatial displacement of people, cable trays, and other objects in the image sub-data is inaccurate.
2. The cable tray installation management method according to claim 1, characterized in that: The step of adding the image data acquired by the image acquisition device to the first matching queue comprises: The image in the image data is segmented into stages of 10 seconds to obtain a plurality of image sub-data, and the changes of the cable tray in the time period from 0 seconds to 10 seconds in each of the image sub-data are determined, wherein the changes of the cable tray include position changes and shape changes of the cable tray; The portion of the image sub-data where the cable tray changes occur is intercepted and retained, and each intercepted image sub-data is arranged one by one in the first matching queue according to the timeline.
3. The cable tray installation management method according to claim 2, characterized in that: The step of adding the cable tray installation guidance data to the second matching queue comprises: Identify the installation standard process classification in the cable tray installation guidance data, and split the videos in the cable tray installation guidance data based on the installation standard process classification to obtain each split installation guidance video; Arrange each of the installation guide videos in sequence and add them to the second matching queue.
4. The cable tray installation management method according to claim 1, characterized in that: The prompt information of the prompt voice package includes: installation process error and installation space location error.
5. The cable tray installation management method according to claim 1, characterized in that: The steps of converting the cable tray installation guidance data corresponding to the part of the non-overlapping stage into audio to form a prompt voice package, and outputting the prompt voice package by the voice broadcasting device include: The installation guidance video in the cable tray installation guidance data is converted into voice to generate a prompt voice package corresponding to the part of the stage that cannot overlap.
6. A cable tray installation management system, comprising a memory and a processor, wherein the memory stores a system computing program, characterized in that: When the processor executes the system computing program, the steps of the cable tray installation management method described in any one of claims 1 to 5 are implemented.
Citation Information
Patent Citations
Guiding system and method for quay crane cart based on image recognition
CN108394814A
Method and device for identifying installation state of target component and storage medium
CN113450356A