A station automatic inspection method and electronic equipment based on a BIM model

Abstract

This application discloses an automatic inspection method and electronic device for subway stations based on a BIM model. The method includes: responding to a user's area configuration operation on the inspection task configuration page, determining the area to be inspected; determining the first inspection devices included in the area to be inspected based on the size of the area to be inspected and the position of the first target point of each inspection device; for each visual device, determining the second inspection devices included within its visible area; determining the first visual device matching the area to be inspected based on the first inspection devices included in the area to be inspected and the second visual devices included within the visible areas of each visual device; constructing the inspection task of the first inspection device based on the relationship between the type of inspection device and the task type, and the relationship with the inspection method; and responding to a user's inspection task execution operation, determining the inspection result of the inspection task based on the video data of the first visual device. This achieves automatic inspection of subway stations and improves inspection efficiency.

Description

Technical Field

[0001] This application relates to the field of smart station technology, and in particular to a BIM model-based automatic station inspection method and electronic equipment. Background Technology

[0002] With the continuous development of technologies such as Internet+, the Internet of Things, big data, and cloud computing, the informatization of the urban rail transit industry has entered a stage of rapid development. As a direct window serving urban development and citizens' travel, subway stations have faced considerable pressure in recent years due to increasing passenger volume and expanding demands for passenger safety and comfort.

[0003] Currently, in the daily operation of subway stations, the management of the station environment, equipment and facilities mainly relies on the experience and ability of the relevant personnel. The station manager, station staff and security guards conduct continuous inspections to understand abnormal events in the station in real time and fill in paper inspection records. However, when problems are found, maintenance personnel, station staff or cleaning staff cannot be notified in a timely manner, and abnormal issues cannot be closed in time, resulting in low timeliness. Due to the large number of equipment on site and the large passenger flow, it is easy to miss inspections. Night inspections are prone to accidents due to drowsiness and negligence, resulting in a low safety factor.

[0004] In other inspection scenarios, drones or robots can overcome the problems encountered by manual inspections. However, in the daily operation of subway stations, the environment is filled with numerous devices and has a large passenger flow, making it inconvenient to use drones or robots for inspections. In addition, the inspection cost of drones or robots is relatively high. Summary of the Invention

[0005] This application provides an exemplary embodiment of a BIM model-based automatic station inspection method and electronic device to achieve automatic inspection of subway stations and improve inspection efficiency.

[0006] According to a first aspect of an exemplary embodiment, a BIM model-based automatic station inspection method is provided, comprising: performing the following operations based on the BIM model:

[0007] In response to the user's area configuration operation on the inspection task configuration page, determine the area to be inspected;

[0008] Based on the size of the area to be inspected and the position of the first target point of each inspection device, the first inspection device included in the area to be inspected is determined; the first target point is the position of the inspection device mapped on the plane where the area to be inspected is located.

[0009] For each visual device, identify the second inspection device included within the visible area of ​​that device;

[0010] Based on the first inspection equipment included in the area to be inspected, and the second inspection equipment included in the visible area of ​​each visible equipment, determine the first visible equipment that matches the area to be inspected.

[0011] Based on the primary relationship between the type of inspection equipment and the task type, and the secondary relationship between the type of inspection equipment and the inspection method, construct the inspection task of the first inspection equipment.

[0012] In response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first visual device.

[0013] According to a second aspect of an exemplary embodiment, an electronic device is provided, including a processor and a display;

[0014] The processor is configured to perform the following operations based on the BIM model:

[0015] In response to the user's area configuration operation on the inspection task configuration page, determine the area to be inspected;

[0016] Based on the size of the area to be inspected and the position of the first target point of each inspection device, the first inspection device included in the area to be inspected is determined; the first target point is the position of the inspection device mapped on the plane where the area to be inspected is located.

[0017] For each visual device, identify the second inspection device included within the visible area of ​​that device;

[0018] Based on the first inspection equipment included in the area to be inspected, and the second inspection equipment included in the visible area of ​​each visible equipment, determine the first visible equipment that matches the area to be inspected.

[0019] Based on the primary relationship between the type of inspection equipment and the task type, and the secondary relationship between the type of inspection equipment and the inspection method, construct the inspection task of the first inspection equipment.

[0020] In response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first visual device;

[0021] The monitor is configured to perform the following: based on the BIM model, display the inspection task configuration page and inspection results.

[0022] According to a third aspect of an exemplary embodiment, a BIM model-based automatic station inspection device is provided, including a processing unit and a display unit.

[0023] The processing unit is used to perform the following operations based on the BIM model:

[0024] In response to the user's area configuration operation on the inspection task configuration page, determine the area to be inspected;

[0025] Based on the size of the area to be inspected and the position of the first target point of each inspection device, the first inspection device included in the area to be inspected is determined; the first target point is the position of the inspection device mapped on the plane where the area to be inspected is located.

[0026] For each visual device, identify the second inspection device included within the visible area of ​​that device;

[0027] Based on the first inspection equipment included in the area to be inspected, and the second inspection equipment included in the visible area of ​​each visible equipment, determine the first visible equipment that matches the area to be inspected.

[0028] Based on the primary relationship between the type of inspection equipment and the task type, and the secondary relationship between the type of inspection equipment and the inspection method, construct the inspection task of the first inspection equipment.

[0029] In response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first visual device;

[0030] The display unit is used to: display the inspection task configuration page and inspection results based on the BIM model.

[0031] According to a fourth aspect of an exemplary embodiment, a computer storage medium is provided, which stores computer program instructions that, when executed on a computer, cause the computer to perform the BIM model-based automatic station inspection method of the first aspect.

[0032] In this embodiment, firstly, when constructing an inspection task, the area to be inspected is determined based on the user's area configuration operation on the inspection task configuration page. Secondly, based on the size of the area to be inspected and the position of the first target point of each inspection device, the inspection devices included in the area to be inspected are determined, referred to as the first inspection devices. Thirdly, for each viewing device, the inspection devices included in the viewing area of ​​the viewing device are determined, referred to as the second inspection devices. Then, using the first inspection devices as a link, the association between the area to be inspected, the viewing devices, and the inspection devices is suggested, thereby determining the viewing devices matching the area to be inspected, referred to as the first viewing devices. Finally, based on the first relationship between the type of inspection device and the task type, and the second relationship between the type of inspection device and the inspection method, the inspection task of the first inspection devices is constructed. After the inspection task is constructed, in response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first viewing devices. Compared with manual inspection in related technologies, this method takes into account the relationship between areas, inspection equipment and visual equipment, and realizes automatic inspection of subway stations, thereby improving inspection efficiency. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0034] Figure 1 An exemplary flowchart illustrates a BIM model-based automatic station inspection method provided in an embodiment of this application;

[0035] Figure 2 An exemplary illustration shows a schematic diagram of an inspection device provided in an embodiment of this application in an area to be inspected;

[0036] Figure 3 An exemplary illustration shows a schematic diagram of an inspection device not being inspected in an area provided by an embodiment of this application;

[0037] Figure 4 An exemplary illustration shows a schematic diagram of an inspection device included within the visible area of ​​a visual device, provided by an embodiment of this application.

[0038] Figure 5 An exemplary schematic diagram is shown, illustrating an embodiment of this application, of calculating the vertical distance between the center point of an intersection region and a visible region;

[0039] Figure 6 An exemplary schematic diagram of an intelligent inspection system provided in an embodiment of this application is shown;

[0040] Figure 7 A schematic diagram illustrating the operation mechanism of an intelligent inspection system provided in an embodiment of this application is shown as an example.

[0041] Figure 8 An exemplary diagram illustrates a runtime execution process provided in an embodiment of this application;

[0042] Figure 9 An exemplary schematic diagram of a station automatic inspection device based on a BIM model provided in an embodiment of this application is shown.

[0043] Figure 10 An exemplary schematic diagram of an electronic device provided in an embodiment of this application is shown. Detailed Implementation

[0044] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0045] For ease of understanding, the terms used in the embodiments of this application are explained below:

[0046] (1) Building Information Modeling (BIM) is a new tool for architecture, engineering, and civil engineering. BIM models enable the integration of building information, from design, construction, and operation to the end of the building's entire lifecycle. All information is integrated into a three-dimensional model information database, allowing design teams, construction units, facility operation departments, and owners to collaborate based on the BIM model, effectively improving work efficiency, saving resources, and reducing costs. The core of a BIM model is to create a virtual three-dimensional model of the building project and, using digital technology, provide this model with a complete and realistic building project information database. This database includes not only geometric information, professional attributes, and status information describing building components, but also status information of non-component objects (such as space and movement behavior). Through this three-dimensional model containing building project information, the degree of information integration in building projects is greatly improved, thus providing a platform for information exchange and sharing among stakeholders in building projects.

[0047] (2) Visual equipment refers to terminal equipment that can monitor a certain area, which is called the visible area of ​​the visual equipment. In the application scenario of subway stations, visual equipment usually includes CCTV equipment, cameras, and other equipment alarm acquisition systems. Among them, CCTV equipment refers to the equipment for setting up a closed-circuit television monitoring system, which is a dedicated television system used by specific users through a closed line. The system mainly consists of front-end audio and video acquisition equipment, audio and video transmission equipment, back-end storage, control and display equipment, etc., among which the back-end equipment can be further divided into central control equipment and sub-control equipment. The closed-circuit television monitoring system is a comprehensive security system that spans multiple industries. It can directly observe the situation of the monitored place through remote-controlled cameras and their auxiliary equipment, and simultaneously record the situation of the monitored place. It forms an independent and complete system from camera to image display and recording. The system can be applied to various places, such as streets, residential areas, shopping malls, factory production lines, etc., to provide security and monitoring management.

[0048] (3) Inspection equipment refers to the equipment being inspected. In the context of subway stations, inspection equipment can be escalators, elevators, turnstiles, automatic ticket vending machines, or semi-automatic ticket vending machines.

[0049] In related technologies, the daily inspection of subway stations is mainly done manually, and drone or robot inspections used in other scenarios are not applicable to subway station inspections. Furthermore, considering that in actual subway operations, information such as subsystem information, equipment information, area information, inspection results, and closed-loop management of anomalies cannot be shared, resulting in problems such as "information silos," "information fragmentation," and "information asymmetry," this application provides an automatic station inspection method based on a BIM model to achieve efficient automatic inspection of subway stations.

[0050] To further illustrate the technical solutions provided in the embodiments of this application, a detailed description is provided below in conjunction with the accompanying drawings and specific implementation methods. Although the embodiments of this application provide method operation steps as shown in the following embodiments or drawings, the method may include more or fewer operation steps based on conventional or non-inventive methods. In steps where there is no logically necessary causal relationship, the execution order of these steps is not limited to the execution order provided in the embodiments of this application.

[0051] refer to Figure 1 The flowchart shown illustrates an automatic station inspection method based on a BIM model, which explains the technical solution provided in the embodiments of this application.

[0052] The process involves pre-building a BIM model of the subway station, configuring it, generating inspection tasks, and then responding to user requests to execute these tasks, thus automating the inspection process and determining the inspection results. In the following examples, the positions and dimensions refer to the positions and dimensions of the corresponding equipment models within the BIM model.

[0053] S101: In response to the user's area configuration operation on the inspection task configuration page, determine the area to be inspected.

[0054] S102: Based on the size of the area to be inspected and the position of the first target point of each inspection device, determine the first inspection device included in the area to be inspected; the first target point is the position of the inspection device mapped on the plane where the area to be inspected is located.

[0055] S103: For each visual device, determine the second inspection device included in the visible area of ​​the visual device.

[0056] S104: Based on the first inspection equipment included in the area to be inspected, and the second inspection equipment included in the visible area of ​​each visible equipment, determine the first visible equipment that matches the area to be inspected.

[0057] S105: Based on the first relationship between the type of inspection equipment and the task type, and the second relationship between the type of inspection equipment and the inspection method, construct the inspection task of the first inspection equipment.

[0058] S106: In response to the user's inspection task execution operation, determine the inspection result of the inspection task based on the video data of the first visual device.

[0059] In this embodiment, firstly, when constructing an inspection task, the area to be inspected is determined based on the user's area configuration operation on the inspection task configuration page. Secondly, based on the size of the area to be inspected and the position of the first target point of each inspection device, the inspection devices included in the area to be inspected are determined, referred to as the first inspection devices. Thirdly, for each viewing device, the inspection devices included in the viewing area of ​​the viewing device are determined, referred to as the second inspection devices. Then, using the first inspection devices as a link, the association between the area to be inspected, the viewing devices, and the inspection devices is suggested, thereby determining the viewing devices matching the area to be inspected, referred to as the first viewing devices. Finally, based on the first relationship between the type of inspection device and the task type, and the second relationship between the type of inspection device and the inspection method, the inspection task of the first inspection devices is constructed. After the inspection task is constructed, in response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first viewing devices. Compared with manual inspection in related technologies, this method takes into account the relationship between areas, inspection equipment and visual equipment, and realizes automatic inspection of subway stations, thereby improving inspection efficiency.

[0060] Regarding S101, the electronic device displays the BIM model and can also provide inspection task configuration controls on the BIM model's display page. Responding to user actions on these controls, the inspection task configuration page is displayed. In response to user actions on the inspection task configuration page, the area to be inspected is determined.

[0061] Among them, the area configuration operation can be an area drawn by the user in the BIM model by clicking with the mouse or touching, such as the north hall of the second-floor station hall, and the area to be inspected is a planar area.

[0062] Regarding S102, after determining the inspection area, it is possible to further determine which inspection equipment is included in the area to be inspected. Specifically, the first inspection equipment included in the area to be inspected can be determined based on the size of the area to be inspected and the location of the first target point of each inspection equipment.

[0063] The dimensions of the area to be inspected are the coordinates of each vertex of the planar area of ​​the area to be inspected in the BIM model; the first target point is the position of the inspection equipment mapped onto the plane of the area to be inspected. For example, the area to be inspected is a rectangle, with the four vertices represented by A(x1,y1), B(x2,y2), C(x3,y3), and D(x4,y4), and the first target point represented by O1. Figure 2 This is a schematic diagram of an inspection device in an area to be inspected, provided in an embodiment of this application. Figure 3 This is a schematic diagram illustrating an inspection device not being inspected in an area provided in this application embodiment.

[0064] Optionally, steps A1-A2 can be used to determine the first inspection equipment included in the area to be inspected:

[0065] A1: For each inspection device, calculate the directed angle between the first target point of the inspection device and each vertex.

[0066] For directed angles, counterclockwise can be defined as positive and clockwise as negative. In the example above, the four directed angles calculated are ∠AO1B, ∠BO1C, ∠CO1D, and ∠DO1A.

[0067] A2: If the sum of all directed angles equals the set angle threshold, then the inspection device is determined to be the first inspection device included in the area to be inspected.

[0068] The angle threshold is set to 360 degrees. When the sum of all directed angles equals 360 degrees, the inspection device is considered to be within the inspection area and can be designated as the first inspection device. Conversely, if the sum of all directed angles is 0 degrees, the corresponding inspection device is considered to be outside the inspection area.

[0069] Optionally, the directed angle ∠AO1B can be calculated using vectors as follows:

[0070]

[0071]

[0072] O1A·O1B=(x2-x1)(x2-x3)+(y2-y1)(y2-y3);

[0073] cos∠AO1B=(O1A·O1B) / (|O1A||O1B|).

[0074] As shown above, the various inspection devices included in the area to be inspected can be obtained, which are called the first inspection devices.

[0075] Regarding S103, for each visual device, determine the second inspection device included within the visual area of ​​that device. (Refer to...) Figure 4 , Figure 4 This is a schematic diagram illustrating how to determine the inspection equipment included within the visible area of ​​a visual device, as provided in an embodiment of this application. This process can be achieved through steps B1-B5:

[0076] B1: Calculate the viewpoints of the visual device and the visible area formed by the viewpoints based on the position of the visual device in the BIM model, the horizontal field of view of the visual device, and the height of the visual device.

[0077] In this context, taking a camera as an example, its position in the BIM model can be the origin at the bottom of the camera mounting bracket, denoted by S; the horizontal field of view of the camera is denoted by W; and the height of the camera is denoted by X. In this way, the camera's viewpoints E, F, G, and H, as well as the visible area formed by these four viewpoints, can be calculated. For example, the visible area is the circumcircle of the quadrilateral formed by these four viewpoints.

[0078] B2: For any second inspection device, determine the second target point of the second inspection device.

[0079] The second target point is the position of the second inspection device mapped onto the plane where the base of the visual device is located. (Reference) Figure 4 The second target point is point O2.

[0080] B3: If the second target point is within the visible area, calculate the intersection area between the second inspection device and the target surface.

[0081] The target surface is determined by the viewpoint and the vertices of the viewing device. Figure 4 In the example, there can be two target planes: one is the plane containing XEH, and the other is the plane containing XFG. Figure 4 In the example, the intersection region is an elliptical region that coincides with the plane where XFG is located.

[0082] B4: Determine the vertical distance between the center point of the intersection area and the visible area.

[0083] The vertical distance between the center point of the intersection area and the visible area is the distance between the center point of the intersection area and the horizontal plane where the visible area is located.

[0084] In this process, the normal vector from point O2 to plane XFG can be used to calculate the distance d from point O to plane XFG and the angle a between the normal vector and the vertical direction. Then, based on the Pythagorean theorem, the distance d, and the angle a, the vertical distance d1 between the center point of the intersection area and the visible area can be calculated. Figure 5 This is a schematic diagram illustrating the calculation of the vertical distance between the center point of an intersection region and the visible region, provided as an embodiment of this application, where L represents the plane XFG.

[0085] B5: Calculate the ratio of the vertical distance to the height of the second inspection device. If the ratio is greater than the ratio threshold corresponding to the equipment type of the second inspection device, then the second inspection device is determined to be within the visible area of ​​the visual device.

[0086] Optionally, the vertical distance is represented by d1, and the height of the second inspection device is represented by h. The calculation is p = d1 / h. Each type of second inspection device has a different proportional threshold. For example, the proportional threshold is 50% for escalators, 50% for elevators, 100% for turnstiles, 100% for automatic ticket vending machines, and 100% for semi-automatic ticket vending machines. Therefore, based on the proportional threshold corresponding to the type of second inspection device and its relationship with a determined proportionality, it can be determined whether the second inspection device is within the visible area.

[0087] Based on the BIM model, considering three-dimensional space, the inspection equipment within the camera's field of view is calculated. Compared with calculating the inspection equipment within the field of view in a two-dimensional plane, which lacks information such as the height of the inspection equipment, the calculation of the inspection equipment within the camera's field of view in three-dimensional space is more accurate.

[0088] Regarding S104, through the above embodiments, it is possible to determine which inspection devices are included in the area to be inspected, and which inspection devices are included in the visible area of ​​each visual device. Therefore, in order to establish the association between the area to be inspected, the visual devices, and the inspection devices, the first visual device matching the area to be inspected can be determined based on the first inspection devices included in the area to be inspected and the second inspection devices included in the visible area of ​​each visual device, using the inspection devices as a medium.

[0089] Additionally, the first visual device matching the already determined inspection area can be supplemented in the following way: for example, if the visible area of ​​a visual device within the first range of the inspection area is also within the inspection area, then that visual device can be identified as the first visual device matching the inspection area. In this way, multiple perspectives are considered to determine the first visual device matching the inspection area, ensuring that no first visual device matching the inspection area is overlooked.

[0090] Additionally, the first visual devices matched to the identified inspection area can be filtered in the following way to ensure the accuracy of the matching. For example, first visual devices whose visible areas are not within the inspection area can be removed.

[0091] Regarding S105, in order to construct the inspection task, the inspection task of the first inspection equipment is constructed based on the first relationship between the type of inspection equipment and the task type, and the second relationship between the type of inspection equipment and the inspection method.

[0092] The task types include temporary tasks, daily tasks, and emergency tasks, while the inspection methods include system data collection and inspection methods. This allows us to determine the corresponding task type and inspection method based on the type of the first inspection device, and then combine the task type and inspection method to construct the inspection task for the first inspection device.

[0093] Furthermore, the inspection types mentioned in the above embodiments are all equipment-related inspection types. In actual applications, environmental inspection types may also be included. For environmental inspection types, manual video inspection can be used as the primary inspection method, with video analysis used as a replication method. In other words, inspection personnel complete environmental inspection tasks by watching the monitoring video in the control room.

[0094] Through the above embodiments, the construction of inspection tasks has been realized. Next, when users have inspection needs, they can carry out automatic inspections through the constructed inspection tasks.

[0095] In S106, in response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first visual device.

[0096] When a user has an inspection requirement, the electronic device can respond to the user's inspection task by performing an operation, and then determine the inspection result of the inspection task based on the video data of the first visual device.

[0097] Optionally, after the inspection task is completed, an inspection report can be generated based on the inspection results. This inspection report can be in the form of a visual list.

[0098] If the inspection result is an anomaly, the inspection report will include the inspected area, the name of the inspected equipment, the type of the inspected equipment, the location of the inspected equipment, the anomaly, the cause of the anomaly, and the time of the anomaly. If the inspection result is a missed inspection, the inspection report will include the name of the missed inspection equipment.

[0099] In addition, to remind users, the first inspection equipment in the area to be inspected can be highlighted in the BIM model for users to view.

[0100] Furthermore, to facilitate timely processing of inspection results by maintenance personnel, the results can be sent to terminal devices within a second area of ​​the area to be inspected, such as the terminal devices of security guards currently patrolling that area. The security guards then process the results, and the electronic equipment receives the processing results from the terminal devices for anomaly-related inspections of the inspected equipment. Examples of anomaly-related inspection results include someone falling on an escalator or a turnstile malfunctioning. Therefore, this design allows for timely notification of problems to maintenance, station staff, or cleaning personnel, effectively supporting the safe and orderly operation of the subway.

[0101] In summary, this application's embodiments implement intelligent inspection for the daily operation environment of subways. It primarily utilizes manual video and system data collection, supplemented by video analysis, to comprehensively inspect the on-site environment and equipment without affecting passenger service. This achieves an online, comprehensive, "no blind spots," and "safe and efficient" inspection method, replacing the current system of scheduled on-site inspections by personnel. It solves problems such as low efficiency, incomplete coverage, low safety, difficulty in data analysis, and low data real-time performance of on-site inspections. Furthermore, it can leverage video analysis to assist inspections, improving the level of intelligence and avoiding errors in manual video perception. It eliminates the need for scheduled on-site inspections, reducing the inspection time for station managers and security guards.

[0102] In order to improve the technical solution of this application, Figure 6 This is a schematic diagram of an intelligent inspection system provided in an embodiment of this application. The intelligent inspection system will then be described from the aspects of configuration, execution, and post-inspection analysis.

[0103] First, the configuration process.

[0104] The configuration process involves configuring the station patrol management component, which is mainly divided into patrol item management, view management, and task management. Patrol items are the specific content to be inspected. Metro patrol items are divided into environmental patrol items and equipment patrol items, corresponding to different patrol types. Environmental patrol items can be inspected manually via video, with video analysis as a supplementary method; equipment patrol items are inspected using video and system alarm data collection, with video analysis as a supplementary method. This allows for the classification of patrol items and the setting of patrol methods.

[0105] View management is the organization and management of the physical area division of the subway. Based on BIM, the area to be inspected is determined. At the same time, the CCTV equipment in the area is calculated according to the coordinates. The CCTVs are grouped and sorted to combine the data of the best scanning vision for inspection. The video is previewed and the video order is adjusted to realize the basic data of the area view and provide data support for online inspection.

[0106] Task management categorizes tasks into different types, including temporary tasks, daily tasks, and emergency tasks. Temporary tasks can be created and executed at any time, with decisions made manually, and do not require time triggers. Daily and emergency tasks require time triggers, specifying the start and end times, as well as the inspection cycle. These triggers are periodically pushed to the client, prompting the system to execute. During task management configuration, inspection items, inspection areas, and CCTV equipment are integrated to enable the creation of inspection tasks.

[0107] Second, the runtime execution process.

[0108] During runtime, BIM-based inspection components are involved. For example, during inspection task execution, the BIM model integrates information and data from various subsystems, including video from linked CCTV equipment, alarm data collection, and information such as the location of the inspection equipment, BIM area perspective, and highlighted equipment models. All components execute in tandem. Furthermore, issues discovered through video analysis and system data collection are automatically entered into inspection items and can be pushed to maintenance personnel's terminal devices (wristbands or apps). Real-time uploads to the maintenance system are supported, and inspection item details are updated after the issue is resolved, forming a closed loop.

[0109] Third, the analysis process after the inspection is completed.

[0110] The analysis process after the inspection involves the BIM inspection station recording component, which records historical inspection tasks for statistical analysis. For example, the electronic ledger, which records inspection tasks and details, replaces the paper ledger, solving the problem of difficult data statistical analysis. Data can be filtered according to different query conditions, exported, stored for longer periods, and retrieved more conveniently.

[0111] Figure 7 This is a schematic diagram illustrating the operating mechanism of an intelligent inspection system provided in an embodiment of this application. Figure 8 This is a schematic diagram illustrating a runtime execution process provided in an embodiment of this application. The system integrates data such as inspection area, CCTV video, system acquisition, inspection items, visual devices, and environment based on a BIM model. The system automatically calculates visual devices based on the CCTV equipment's visible area, automatically establishes relationships between device type and inspection items, generates inspection records for the current time period for each inspection item, notifies wristbands or maintenance personnel, backfills processing information into the inspection records, and generates an electronic ledger for data analysis.

[0112] In this embodiment, the management of inspection tasks relies on time triggers, supporting multiple tasks and multiple triggers. Selecting inspection items and areas achieves full coverage, scanning the on-site equipment and environment without blind spots. Inspection tasks can be completed in the vehicle control room. Task execution is combined with the associated virtual scene BIM model, and linked with CCTV equipment, equipment alarm collection, and video analysis, facilitating timely problem detection by the duty station manager. The combination of the BIM model and video increases the interaction between the virtual scene and the real-world image, giving the duty station manager a certain three-dimensional perception and enabling rapid location of the actual position. Alarm information from equipment alarm collection is linked to the BIM model's highlighting and flashing, improving the BIM model's information carrying capacity. The system responds promptly, reporting real-time alarm information to maintenance personnel, who then process and back-upload the information, closing the loop on abnormal inspection items.

[0113] like Figure 9 As shown, based on the same inventive concept, this application provides an automatic station inspection device based on a BIM model, including a processing unit 91 and a display unit 92.

[0114] The processing unit 91 is used to perform the following operations based on the BIM model:

[0115] In response to the user's area configuration operation on the inspection task configuration page, determine the area to be inspected;

[0116] Based on the size of the area to be inspected and the position of the first target point of each inspection device, the first inspection device included in the area to be inspected is determined; the first target point is the position of the inspection device mapped on the plane where the area to be inspected is located.

[0117] For each visual device, identify the second inspection device included within the visible area of ​​that device;

[0118] Based on the first inspection equipment included in the area to be inspected, and the second inspection equipment included in the visible area of ​​each visible equipment, determine the first visible equipment that matches the area to be inspected.

[0119] Based on the primary relationship between the type of inspection equipment and the task type, and the secondary relationship between the type of inspection equipment and the inspection method, construct the inspection task of the first inspection equipment.

[0120] In response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first visual device;

[0121] Display unit 92 is used to: display the inspection task configuration page and inspection results based on the BIM model.

[0122] In one alternative implementation, the size of the area to be inspected is the coordinates of each vertex of the planar area of ​​the area to be inspected in the BIM model;

[0123] Processing unit 91 is specifically used for:

[0124] For each inspection device, calculate the directed angle between the first target point of the inspection device and each vertex;

[0125] If the sum of all directed angles equals the set angle threshold, then the inspection device is determined to be the first inspection device included in the area to be inspected.

[0126] In one optional implementation, the processing unit 91 is specifically used for:

[0127] Based on the location of the visual device in the BIM model, the horizontal field of view of the visual device, and the height of the visual device, calculate the viewpoints of the visual device and the visible area formed by the viewpoints.

[0128] For any second inspection device, determine the second target point of the second inspection device; wherein, the second target point is the position of the second inspection device mapped on the plane where the base of the visual device is located;

[0129] If the second target point is within the visible area, then the intersection area between the second inspection device and the target surface is calculated; where the target surface is determined by the visible point and the vertex of the visible device.

[0130] Determine the vertical distance between the center point of the intersection area and the visible area;

[0131] Calculate the ratio of the vertical distance to the height of the second inspection device. If the ratio is greater than the ratio threshold corresponding to the equipment type of the second inspection device, then the second inspection device is determined to be within the visible area of ​​the visual device.

[0132] In an optional implementation, the processing unit 91 is further configured to:

[0133] If the visible area of ​​a visual device within the first range of the area to be inspected is within the area to be inspected, then a visual device is determined as the first visual device matching the area to be inspected.

[0134] In an optional implementation, the processing unit 91 is further configured to:

[0135] The visible area of ​​the first visual device matching the area to be inspected is determined to be within the area to be inspected.

[0136] In an optional implementation, the processing unit 91 is further configured to:

[0137] Generate an inspection report based on the inspection results;

[0138] If the inspection result is an anomaly, the inspection report will include the inspected area, the name of the inspected equipment, the type of the inspected equipment, the location of the inspected equipment, the anomaly, the cause of the anomaly, and the time of the anomaly.

[0139] If the inspection result is a missed inspection, the inspection report will include the name of the missed equipment.

[0140] In an optional implementation, the processing unit 91 is further configured to:

[0141] In the BIM model, the first inspection equipment included in the area to be inspected is highlighted.

[0142] In an optional implementation, the processing unit 91 is further configured to:

[0143] The inspection results are sent to the terminal devices within the second range of the area to be inspected;

[0144] Receive the processing results of the inspected equipment from the inspection results of the anomaly type from the terminal device.

[0145] Since this device is the same as the device in the method of this application embodiment, and the principle of the device in solving the problem is similar to that of the method, the implementation of the device can be referred to the implementation of the method, and the repeated parts will not be described again.

[0146] like Figure 10 As shown, based on the same inventive concept, this application provides an electronic device including a processor 101 and a display 102.

[0147] Processor 101 is configured to perform the following operations based on the BIM model:

[0148] In response to the user's area configuration operation on the inspection task configuration page, determine the area to be inspected;

[0149] Based on the size of the area to be inspected and the position of the first target point of each inspection device, the first inspection device included in the area to be inspected is determined; the first target point is the position of the inspection device mapped on the plane where the area to be inspected is located.

[0150] For each visual device, identify the second inspection device included within the visible area of ​​that device;

[0151] Based on the first inspection equipment included in the area to be inspected, and the second inspection equipment included in the visible area of ​​each visible equipment, determine the first visible equipment that matches the area to be inspected.

[0152] Based on the primary relationship between the type of inspection equipment and the task type, and the secondary relationship between the type of inspection equipment and the inspection method, construct the inspection task of the first inspection equipment.

[0153] In response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first visual device;

[0154] Display 102 is configured to perform: based on the BIM model, display the inspection task configuration page and inspection results.

[0155] In one alternative implementation, the size of the inspection area is the coordinates of each vertex of the planar area of ​​the inspection area in the BIM model;

[0156] Processor 101 is specifically configured to execute:

[0157] For each inspection device, calculate the directed angle between the first target point of the inspection device and each vertex;

[0158] If the sum of all directed angles equals the set angle threshold, then the inspection device is determined to be the first inspection device included in the area to be inspected.

[0159] In one alternative implementation, the processor 101 is specifically used for:

[0160] Based on the location of the visual device in the BIM model, the horizontal field of view of the visual device, and the height of the visual device, calculate the viewpoints of the visual device and the visible area formed by the viewpoints.

[0161] For any second inspection device, determine the second target point of the second inspection device; wherein, the second target point is the position of the second inspection device mapped on the plane where the base of the visual device is located;

[0162] If the second target point is within the visible area, then the intersection area between the second inspection device and the target surface is calculated; where the target surface is determined by the visible point and the vertex of the visible device.

[0163] Determine the vertical distance between the center point of the intersection area and the visible area;

[0164] Calculate the ratio of the vertical distance to the height of the second inspection device. If the ratio is greater than the ratio threshold corresponding to the equipment type of the second inspection device, then the second inspection device is determined to be within the visible area of ​​the visual device.

[0165] In an alternative implementation, the processor 101 is further configured to:

[0166] If the visible area of ​​a visual device within the first range of the area to be inspected is within the area to be inspected, then a visual device is determined as the first visual device matching the area to be inspected.

[0167] In an alternative implementation, the processor 101 is further configured to:

[0168] The visible area of ​​the first visual device matching the area to be inspected is determined to be within the area to be inspected.

[0169] In an alternative implementation, the processor 101 is further configured to:

[0170] Generate an inspection report based on the inspection results;

[0171] If the inspection result is an anomaly, the inspection report will include the inspected area, the name of the inspected equipment, the type of the inspected equipment, the location of the inspected equipment, the anomaly, the cause of the anomaly, and the time of the anomaly.

[0172] If the inspection result is a missed inspection, the inspection report will include the name of the missed equipment.

[0173] In an alternative implementation, the processor 101 is further configured to:

[0174] In the BIM model, the first inspection equipment included in the area to be inspected is highlighted.

[0175] In an alternative implementation, the processor 101 is further configured to:

[0176] The inspection results are sent to the terminal devices within the second range of the area to be inspected;

[0177] Receive the processing results of the inspected equipment from the inspection results of the anomaly type from the terminal device.

[0178] This application also provides a computer storage medium storing computer program instructions. When the instructions are executed on the computer, the computer performs the steps of the above-described automatic station inspection method based on the BIM model.

[0179] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0180] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0181] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0182] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0183] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A method for automatic station inspection based on BIM model, characterized in that, include: Based on the BIM model, perform the following operations: In response to the user's area configuration operation on the inspection task configuration page, determine the area to be inspected; Based on the size of the area to be inspected and the position of the first target point of each inspection device, the first inspection device included in the area to be inspected is determined. The first target point is the position of the inspection equipment on the plane where the area to be inspected is located; For each visual device, determine the second inspection device included within the visible area of ​​the visual device; Based on the first inspection equipment included in the area to be inspected, and the second inspection equipment included in the visible area of ​​each visible device, determine the first visible device that matches the area to be inspected. Based on the first relationship between the type of inspection equipment and the task type, and the second relationship between the type of inspection equipment and the inspection method, the inspection task of the first inspection equipment is constructed. In response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first visual device; The step of determining, for each visual device, the second inspection device included within the visible area of ​​the visual device includes: Based on the position of the visual device in the BIM model, the horizontal field of view of the visual device, and the height of the visual device, calculate the visible points of the visual device and the visible area formed by the visible points; For any second inspection device, determine the second target point of the second inspection device; wherein, the second target point is the position of the second inspection device mapped on the plane where the base of the visual device is located; If the second target point is within the visible area, then the intersection area between the second inspection device and the target surface is calculated; wherein, the target surface is determined by the visible point and the vertex of the visible device; Determine the vertical distance between the center point of the intersection area and the visible area; Calculate the ratio of the vertical distance to the height of the second inspection device. If the ratio is greater than the ratio threshold corresponding to the device type of the second inspection device, then determine that the second inspection device is within the visible area of ​​the visual device.

2. The method according to claim 1, characterized in that, The size of the area to be inspected is the coordinates of each vertex of the planar area of ​​the area to be inspected in the BIM model; The step of determining the first inspection equipment included in the area to be inspected based on the size of the area to be inspected and the position of the first target point of each inspection equipment includes: For each inspection device, calculate the directed angle between the first target point of the inspection device and each vertex; If the sum of all directed angles equals a set angle threshold, then the inspection device is determined to be the first inspection device included in the area to be inspected.

3. The method according to claim 1, characterized in that, The method further includes: If the visible area of ​​a visual device within the first range of the area to be inspected is within the area to be inspected, then the visual device is determined to be the first visual device matching the area to be inspected.

4. The method according to claim 1, characterized in that, The method further includes: The visible area of ​​the first visual device matching the area to be inspected is determined to be within the area to be inspected.

5. The method according to claim 1, characterized in that, The method further includes: An inspection report is generated based on the inspection results. If the inspection result is of the type of abnormality, the inspection report includes the inspected area, the name of the inspected equipment, the type of the inspected equipment, the location of the inspected equipment, the abnormal phenomenon, the cause of the abnormality, and the time of the abnormality. If the inspection result is a missed inspection, the inspection report includes the name of the missed equipment.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: In the BIM model, the first inspection equipment included in the area to be inspected is highlighted.

7. The method according to any one of claims 1 to 5, characterized in that, The method further includes: The inspection results are sent to the terminal devices within the second range of the area to be inspected; Receive the processing results of the inspected equipment from the inspection results of the anomaly type from the terminal device.

8. An electronic device, characterized in that, Including the processor and display; The processor is configured to perform the following operations based on the BIM model: In response to the user's area configuration operation on the inspection task configuration page, determine the area to be inspected; Based on the size of the area to be inspected and the position of the first target point of each inspection device, the first inspection device included in the area to be inspected is determined. The first target point is the position of the inspection equipment on the plane where the area to be inspected is located; For each visual device, determine the second inspection device included within the visible area of ​​the visual device; Based on the first inspection equipment included in the area to be inspected, and the second inspection equipment included in the visible area of ​​each visible device, determine the first visible device that matches the area to be inspected. Based on the first relationship between the type of inspection equipment and the task type, and the second relationship between the type of inspection equipment and the inspection method, the inspection task of the first inspection equipment is constructed. In response to the user's inspection task execution operation, the inspection result of the inspection task is determined based on the video data of the first visual device; The display is configured to perform the following: based on the BIM model, display the inspection task configuration page and the inspection results; The step of determining, for each visual device, the second inspection device included within the visible area of ​​the visual device includes: Based on the position of the visual device in the BIM model, the horizontal field of view of the visual device, and the height of the visual device, calculate the visible points of the visual device and the visible area formed by the visible points; For any second inspection device, determine the second target point of the second inspection device; wherein, the second target point is the position of the second inspection device mapped on the plane where the base of the visual device is located; If the second target point is within the visible area, then the intersection area between the second inspection device and the target surface is calculated; wherein, the target surface is determined by the visible point and the vertex of the visible device; Determine the vertical distance between the center point of the intersection area and the visible area; Calculate the ratio of the vertical distance to the height of the second inspection device. If the ratio is greater than the ratio threshold corresponding to the device type of the second inspection device, then determine that the second inspection device is within the visible area of ​​the visual device.

9. The electronic device according to claim 8, characterized in that, The size of the inspection area is the coordinates of each vertex of the planar area of ​​the inspection area in the BIM model; The processor is specifically configured to execute: For each inspection device, calculate the directed angle between the first target point of the inspection device and each vertex; If the sum of all directed angles equals a set angle threshold, then the inspection device is determined to be the first inspection device included in the area to be inspected.

Images