Wiring inspection method, wiring inspection device, wiring inspection system, and storage medium

Abstract

The invention discloses a wiring inspection method, a wiring inspection device, a wiring inspection system and a computer readable storage medium. The wiring inspection method comprises the following steps: acquiring multiple pieces of wiring video data corresponding to the wiring process of multiple pieces of power equipment; performing model training through the plurality of wiring video data to obtain a video analysis model; obtaining current wiring video data corresponding to the wiring process of the current power equipment; and performing diagnosis analysis on the current wiring video data through the video analysis model to obtain a wiring inspection result. Therefore, the inspection efficiency is improved, the personal error is reduced, instant wiring guidance can be provided for installation personnel, and correct installation and safe operation of equipment are ensured.

Description

Technical Field

[0001] The present application relates to the technical field of equipment wiring, and in particular to a wiring inspection method, a wiring inspection device, a wiring inspection system and a computer-readable storage medium. Background Art

[0002] With the rapid popularization of distributed photovoltaic power generation and energy storage equipment in the household market, the correct installation and line connection of the equipment have become particularly important. Market data shows that the installation volume of household photovoltaic and energy storage equipment has increased at a double-digit rate each year, which puts higher requirements on the installation quality. Incorrect line connection may not only cause equipment failure, but also cause safety accidents such as fire and leakage, which seriously threaten the safety of users' lives and property. Traditional manual inspection methods are inefficient and prone to errors in the face of growing installation needs. Summary of the invention

[0003] The embodiments of the present application provide a wiring check method, a wiring check device, a wiring check system and a computer-readable storage medium to solve at least one of the above-mentioned technical problems.

[0004] The wiring inspection method of the embodiment of the present application includes:

[0005] Acquire multiple wiring video data corresponding to the wiring process of multiple power equipment;

[0006] Performing model training through the plurality of wiring video data to obtain a video analysis model;

[0007] Obtain current wiring video data corresponding to the wiring process of the current power equipment;

[0008] The video analysis model is used to perform diagnostic analysis on the current wiring video data to obtain a wiring inspection result.

[0009] In some embodiments, the wiring inspection method further includes:

[0010] Acquire a plurality of device operation data of the plurality of power devices after wiring is completed, wherein the plurality of device operation data respectively correspond to the plurality of wiring video data;

[0011] Performing data annotation on the plurality of wiring video data respectively according to the plurality of equipment operation data to annotate wiring conditions of the plurality of wiring video data;

[0012] The method of performing model training through the plurality of wiring video data to obtain a video analysis model includes:

[0013] The video analysis model is obtained by performing model training on the multiple wiring video data after data annotation.

[0014] In some embodiments, after obtaining the operation data of the plurality of electrical devices after wiring is completed, the wiring inspection method further includes:

[0015] Acquire multiple video shooting times corresponding to the multiple wiring video data;

[0016] The plurality of video shooting times are matched with the plurality of equipment operation data respectively, so that the plurality of equipment operation data correspond to the plurality of wiring video data respectively.

[0017] In some embodiments, the model training is performed on the plurality of wiring video data after data annotation to obtain the video analysis model, including:

[0018] Preprocessing the plurality of wiring video data after data annotation, extracting key frames and feature information to generate a data set, wherein the data set includes a training set and a test set;

[0019] Performing model training using the training set to generate an initial video analysis model;

[0020] The initial video analysis model is optimized using the test set to obtain the video analysis model.

[0021] In some embodiments, the performing model training using the training set to generate an initial video analysis model includes:

[0022] The initial video analysis model is generated by performing feature extraction capability training, pattern recognition capability training, error diagnosis capability training and error correction capability training through the training set.

[0023] In some embodiments, the video analysis model comprises a multimodal large model.

[0024] In some embodiments, the performing diagnostic analysis on the current wiring video data by the video analysis model to obtain a wiring inspection result includes:

[0025] The video analysis model is used to diagnose and analyze the current wiring video data to determine whether the wiring is correct, the error location and error type when the wiring is wrong, and the wiring guidance video.

[0026] In some embodiments, the wiring inspection method is applied to a cloud, the cloud is connected to a client for communication, and the acquisition of a plurality of wiring video data corresponding to the wiring process of a plurality of power devices includes:

[0027] receiving the plurality of connection video data uploaded by the client to the cloud;

[0028] The method of performing model training through the plurality of wiring video data to obtain a video analysis model includes:

[0029] Performing model training on the cloud using the plurality of connection video data to obtain the video analysis model;

[0030] The obtaining of current wiring video data corresponding to the wiring process of the current power equipment includes:

[0031] Receiving the current connection video data uploaded by the client to the cloud;

[0032] The step of performing diagnostic analysis on the current wiring video data by using the video analysis model to obtain a wiring inspection result includes:

[0033] The current wiring video data is diagnosed and analyzed in the cloud through the video analysis model to obtain the wiring inspection result, and the wiring inspection result is fed back to the client.

[0034] In certain embodiments, the electric power device comprises a photovoltaic storage device.

[0035] The wiring inspection device of the embodiment of the present application includes:

[0036] A first acquisition module is used to acquire a plurality of wiring video data corresponding to the wiring process of a plurality of power equipment;

[0037] A model training module, used for performing model training through the plurality of wiring video data to obtain a video analysis model;

[0038] The second acquisition module is used to acquire current wiring video data corresponding to the wiring process of the current power equipment;

[0039] The diagnosis and analysis module is used to perform diagnosis and analysis on the current wiring video data through the video analysis model to obtain wiring inspection results.

[0040] The wiring check system of the embodiment of the present application includes one or more processors and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the wiring check method of any of the above embodiments is implemented.

[0041] The computer-readable storage medium of the embodiment of the present application stores a computer program thereon, and when the program is executed by a processor, the wiring inspection method of any of the above embodiments is implemented.

[0042] The wiring inspection method, wiring inspection device, wiring inspection system and computer-readable storage medium of the embodiment of the present application firstly train the model through multiple wiring video data to obtain the video analysis model, and then diagnose and analyze the current wiring video data through the video analysis model to obtain the wiring inspection result. In this way, not only the inspection efficiency is improved and human errors are reduced, but also the installation personnel can be provided with instant wiring guidance to ensure the correct installation and safe operation of the equipment.

[0043] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0045] Figure 1 is a flow chart of a wiring inspection method according to certain embodiments of the present application;

[0046] Figure 2 is a schematic diagram of the wiring of the power equipment of certain embodiments of the present application;

[0047] Figure 3 is a flow chart of a wiring inspection method according to certain embodiments of the present application;

[0048] Figure 4 is a flow chart of a wiring inspection method according to certain embodiments of the present application;

[0049] Figure 5 is a flow chart of a wiring inspection method according to certain embodiments of the present application;

[0050] Figure 6 is a flow chart of a wiring inspection method according to certain embodiments of the present application;

[0051] Figure 7 is a flow chart of a wiring inspection method according to certain embodiments of the present application;

[0052] Figure 8 It is a schematic diagram of data interaction between the client and the cloud in certain implementation modes of the present application;

[0053] Fig. 9 is a module schematic diagram of a wiring inspection device according to certain embodiments of the present application;

[0054] Fig.10 is a module schematic diagram of a wiring inspection device according to certain embodiments of the present application;

[0055] Fig.11is a module schematic diagram of a wiring inspection system of certain embodiments of the present application;

[0056] Fig.12 It is a schematic diagram of the connection status between a computer-readable storage medium and a processor in certain embodiments of the present application.

[0057] Description of reference numerals:

[0058] Wiring inspection device 100, first acquisition module 10, model training module 20, second acquisition module 30, diagnosis analysis module 40, third acquisition module 50, data annotation module 60, fourth acquisition module 70, data matching module 80;

[0059] Client 101, cloud 102;

[0060] Wiring check system 200, processor 210, memory 220;

[0061] Computer readable storage medium 300 , computer program 310 , processor 320 . DETAILED DESCRIPTION

[0062] The following is a further description of the embodiments of the present application in conjunction with the accompanying drawings. The same or similar reference numerals in the accompanying drawings represent the same or similar elements or elements with the same or similar functions from beginning to end. In addition, the embodiments of the present application described below in conjunction with the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the present application.

[0063] With the rapid popularization of distributed photovoltaic power generation and energy storage equipment in the household market, the correct installation and line connection of the equipment have become particularly important. Market data shows that the installation volume of household photovoltaic and energy storage equipment has increased at a double-digit rate each year, which puts higher requirements on the installation quality. Incorrect line connection may not only cause equipment failure, but also cause safety accidents such as fire, leakage, etc., which seriously threaten the safety of users' lives and property. Traditional manual inspection methods are inefficient and prone to errors in the face of growing installation needs. Market surveys show that about 15% of household photovoltaic storage equipment have wiring errors after installation, which is mainly attributed to the following points:

[0064] First, shortage of human resources: the number of professional and technical personnel is limited and cannot meet the rapidly growing installation needs.

[0065] Second, experience dependence: Manual inspection depends on the experience and skill level of the inspector. Different people have different professional qualities and judgments, which leads to inconsistent inspection results.

[0066] Third, high cost: On-site manual inspection requires a lot of time and human resources, especially in remote areas, where the inspection cost is even higher.

[0067] In addition, with the continuous development of technology and the upgrading of equipment, new wiring standards and specifications are also constantly changing, which puts higher demands on the learning and adaptability of technicians. Manual inspection methods are difficult to keep up with the pace of technological development in a timely manner and there is a lag.

[0068] See also Figure 1 The present application embodiment provides a wiring inspection method. The wiring inspection method includes:

[0069] 010: Acquire multiple wiring video data corresponding to the wiring process of multiple power equipment;

[0070] 020: Perform model training through multiple wiring video data to obtain a video analysis model;

[0071] 030: Obtain current wiring video data corresponding to the wiring process of the current power equipment;

[0072] 040: The current wiring video data is diagnosed and analyzed through the video analysis model to obtain the wiring inspection result.

[0073] The wiring inspection method of the embodiment of the present application first trains the model through multiple wiring video data to obtain a video analysis model, and then uses the video analysis model to diagnose and analyze the current wiring video data to obtain the wiring inspection result. In this way, not only the inspection efficiency is improved and human errors are reduced, but also immediate wiring guidance can be provided to the installer to ensure the correct installation and safe operation of the equipment.

[0074] The wiring inspection method of the implementation mode of the present application can not only significantly reduce the inspection cost and improve the inspection efficiency, but also promote the further popularization and application of distributed photovoltaic power generation and energy storage equipment in the household market under the premise of ensuring safety.

[0075] Specifically, in some embodiments, the power equipment includes a photovoltaic storage device. The photovoltaic storage device is an energy system that combines photovoltaic power generation and energy storage functions. The working process of the photovoltaic storage device involves multiple stages such as solar power generation, power conversion and storage, power use and scheduling. Through efficient and intelligent energy management and optimization, the photovoltaic storage device can provide stable, reliable and environmentally friendly power support. In the specific example of the present application, the power equipment can be a household photovoltaic storage device. Of course, in other examples, the power equipment can also be any device that requires power connection, which is not limited here.

[0076] In some embodiments, the wiring process of the power equipment includes the wiring process between the photovoltaic storage device and the electric meter, and between the photovoltaic storage device and the power grid (such as Figure 2The connection between the photovoltaic storage device and the electric meter is used to measure the electric energy generated by the photovoltaic storage device and the electricity consumption. The connection between the photovoltaic storage device and the power grid is used to achieve grid-connected power generation and obtain electricity from the power grid.

[0077] In 010, multiple wiring video data corresponding to the wiring process of multiple power equipment are obtained. Specifically, the wiring process of multiple power equipment can be filmed by a mobile phone camera to obtain the corresponding multiple wiring video data. This process is the basis of model training and requires the collection of a large amount of diverse wiring video data. These wiring video data can cover a variety of situations such as power equipment of different brands and models, different wiring scenarios, and different operators to ensure the diversity and comprehensiveness of the wiring video data, so that the video analysis model obtained by model training through multiple wiring video data has wide applicability and robustness.

[0078] In 020, a video analysis model is obtained by training a model through multiple wiring video data. This process can use machine learning or deep learning frameworks, use the collected wiring video data as training samples, and train a video analysis model that can identify wiring errors and evaluate wiring quality through processes such as feature extraction, model construction, and parameter optimization.

[0079] In 030, current wiring video data corresponding to the wiring process of the current power equipment is obtained. Specifically, the current wiring process of the current power equipment can be filmed in real time by a mobile phone camera to obtain the current wiring video data. The current wiring video data will be input into the video analysis model to perform diagnostic analysis by the trained video analysis model.

[0080] In 040, the video analysis model performs diagnostic analysis on the current wiring video data to obtain a wiring inspection result. In this process, the current wiring video data is input into the video analysis model, and the video analysis model automatically performs diagnostic analysis on the wiring process in the current wiring video data and outputs a wiring inspection result. The wiring inspection result may include whether the wiring is correct, and the error location and error type when the wiring is wrong.

[0081] In the related technologies, the following methods are mainly used to solve the wiring inspection problem of household photovoltaic storage equipment:

[0082] (1) Manual inspection: After the installation is completed, professional technicians will conduct on-site inspections. The disadvantages of this method are: low efficiency: manual inspections take a long time, especially in large-scale installation projects, and the inspection work will take up a lot of human resources; subjective factors have a great influence: the professional level and experience differences of different technicians will lead to inconsistent inspection results, and there is a risk of subjective misjudgment; high cost: a large number of professionals are required to conduct on-site inspections, which increases the total cost of the project.

[0083] (2) Instrument detection: Use professional electrical detection instruments to detect the wiring. The disadvantages of this method include: Equipment dependence: It is necessary to purchase and maintain special detection equipment, which increases costs; Complex operation: The use of detection instruments requires professional training, which is difficult for ordinary installers to master, resulting in reliance on professional technicians for operation; Limitations: Some detection instruments can only detect electrical parameters and cannot fully determine whether the wiring is correct.

[0084] (3) Standardized process: By formulating detailed installation and inspection processes, ensure that each link is carried out according to standards. The limitations of this method are that it is difficult to implement: standardized processes need to be strictly implemented, but in actual operations, due to factors such as the environment and personnel quality, it is difficult to ensure that each link can be carried out completely according to standards; poor flexibility: standardized processes do not have sufficient flexibility to deal with sudden problems and special situations on site.

[0085] The wiring inspection method of the implementation mode of the present application first performs model training through multiple wiring video data to obtain a video analysis model, and then uses the video analysis model to diagnose and analyze the current wiring video data to obtain a wiring inspection result. This not only improves the inspection efficiency and reduces human errors, but also reduces the dependence on professional equipment and personnel. At the same time, it can provide instant guidance when wiring errors occur, helping installers to quickly correct problems and ensure the correct installation and safe operation of the equipment.

[0086] The wiring inspection method of the embodiment of the present application has at least the following advantages:

[0087] First, improving inspection efficiency: Compared with the traditional manual inspection method, the wiring inspection method of the embodiment of the present application can automatically complete the diagnosis and analysis of the wiring process, greatly improving the inspection efficiency.

[0088] Second, reduce human errors: Through machine learning and deep learning technology, the wiring inspection method of the implementation mode of the present application can more accurately identify wiring errors and reduce the errors caused by human judgment.

[0089] Third, provide instant wiring guidance: During the wiring process, the wiring inspection method of the embodiment of the present application can output diagnostic results and correction suggestions in real time, provide instant wiring guidance to the installer, and ensure the correct installation and safe operation of the equipment.

[0090] Fourth, wide applicability: The wiring inspection method of the embodiment of the present application is not only applicable to photovoltaic storage equipment, but can also be extended to other power equipment, and has wide applicability.

[0091] The application scope of the wiring inspection method of the embodiment of the present application includes but is not limited to:

[0092] (1) Installation of household photovoltaic and energy storage equipment: Applicable to the installation process of various household photovoltaic power generation and energy storage equipment, ensuring correct wiring and improving installation quality.

[0093] (2) Installation training: It can be used as a training tool for installers to improve their installation skills by simulating actual wiring scenarios.

[0094] (3) Remote technical support: Technical support personnel can remotely view videos and diagnostic results through the system, provide real-time technical support, and reduce the number and cost of on-site services.

[0095] (4) Equipment maintenance: During equipment maintenance and overhaul, the system conducts wiring checks to ensure continued safe operation of the equipment.

[0096] See also Figure 3 In some embodiments, the wiring inspection method further includes:

[0097] 050: Acquire multiple device operation data of multiple power devices after wiring is completed, wherein the multiple device operation data correspond to multiple wiring video data respectively;

[0098] 060: performing data annotation on multiple wiring video data respectively according to the operation data of multiple devices to annotate the wiring conditions of the multiple wiring video data;

[0099] The model is trained through multiple wiring video data to obtain a video analysis model (i.e., 020), including:

[0100] 021: The model is trained through multiple wiring video data after data annotation to obtain a video analysis model.

[0101] Specifically, for each power device, after completing the wiring work of the power device, the power device is also turned on to obtain the device operation data of the power device. Multiple power devices correspond to multiple device operation data. Among them, the device operation data refers to various data generated by the device during operation. In some embodiments, the device operation data may include real-time parameters such as voltage, current, and power. These data reflect the operating status of the device and are an important basis for judging whether the device is operating normally.

[0102] The plurality of equipment operation data correspond to the plurality of wiring video data one by one. For example, the wiring video data corresponding to the wiring process 1 is the wiring video data 1, the wiring video data corresponding to the wiring process 2 is the wiring video data 2, the wiring video data corresponding to the wiring process 3 is the wiring video data 4... The wiring video data corresponding to the wiring process n is the wiring video data n. The equipment operation data after the completion of the wiring process 1 is the equipment operation data 1, the equipment operation data after the completion of the wiring process 2 is the equipment operation data 2, the equipment operation data after the completion of the wiring process 3 is the equipment operation data 3... The equipment operation data after the completion of the wiring process n is the equipment operation data n. Then the wiring video data 1 corresponds to the equipment operation data 1, the wiring video data 2 corresponds to the equipment operation data 2, the wiring video data 3 corresponds to the equipment operation data 3... The wiring video data n corresponds to the equipment operation data n.

[0103] In the implementation manner of the present application, data annotation is performed on multiple wiring video data respectively according to multiple equipment operation data, that is, data annotation is performed on wiring video data 1 according to equipment operation data 1 to annotate the wiring situation of wiring video data 1; data annotation is performed on wiring video data 2 according to equipment operation data 2 to annotate the wiring situation of wiring video data 2; data annotation is performed on wiring video data 3 according to equipment operation data 3 to annotate the wiring situation of wiring video data 3... data annotation is performed on wiring video data n according to equipment operation data n to annotate the wiring situation of wiring video data n. Among them, if the equipment operation data n is normal, it indicates that the wiring situation corresponding to wiring video data n is normal, and wiring video data n is marked as normal wiring; if the equipment operation data n is abnormal, it indicates that the wiring situation corresponding to wiring video data n is wrong, and wiring video data n is marked as wrong wiring. In the implementation manner of the present application, multiple wiring video data can be automatically annotated according to multiple equipment operation data, which can effectively improve the efficiency of data annotation. In addition, the equipment operation data reflects the actual operation status of the equipment, so the wiring video data can be accurately annotated to ensure the accuracy of data annotation.

[0104] By training the model based on the labeled multiple wiring video data, a video analysis model that can automatically identify and analyze wiring conditions can be obtained. It can be understood that the labeled multiple wiring video data can provide the "correct answer" or "expected output" for the machine learning model. The model performs supervised learning by comparing its predicted results with the actual results in the labeled data to improve its predicted results. Using the labeled multiple wiring video data for model training can learn the common features and rules in the data, improve the accuracy of the model, and help the model make accurate predictions when facing new data.

[0105] See also Figure 4In some embodiments, after obtaining the operation data of multiple devices after the wiring of multiple power devices is completed (ie, 050), the wiring inspection method further includes:

[0106] 070: Obtain multiple video shooting times corresponding to multiple wiring video data;

[0107] 080: Match the shooting time of multiple videos with the multiple device operation data respectively, so that the multiple device operation data correspond to the multiple wiring video data respectively.

[0108] Specifically, the video shooting time corresponding to each wiring video data is obtained, and multiple wiring video data correspond to multiple video shooting times. For example, the video shooting time corresponding to wiring video data 1 is video shooting time T1, the video shooting time corresponding to wiring video data 2 is video shooting time T2, the video shooting time corresponding to wiring video data 3 is video shooting time T3... The video shooting time corresponding to wiring video data n is video shooting time Tn.

[0109] Match multiple video shooting times (T1, T2, T3...Tn) with multiple equipment operation data (1, 2, 3...n) respectively, so that the multiple equipment operation data (1, 2, 3...n) correspond to multiple wiring video data (1, 2, 3...n). For example, if the video shooting time T1 matches the equipment operation data 1, the equipment operation data 1 corresponds to the wiring video data 1; if the video shooting time T2 matches the equipment operation data 2, the equipment operation data 2 corresponds to the wiring video data 2... If the video shooting time Tn matches the equipment operation data n, the equipment operation data n corresponds to the wiring video data n. In this way, through the multiple video shooting times corresponding to the multiple wiring video data, the multiple equipment operation data can be respectively matched with the multiple wiring video data one by one, so that the corresponding wiring video data can be data labeled using each equipment operation data.

[0110] See also Figure 5 In some embodiments, a video analysis model (ie, 021) is obtained by performing model training on a plurality of wiring video data after data annotation, including:

[0111] 0211: Preprocess the labeled video data to extract key frames and feature information to generate a data set, which includes a training set and a test set;

[0112] 0212: Train the model using the training set to generate an initial video analysis model;

[0113] 0213: Optimize the initial video analysis model through the test set to obtain the video analysis model.

[0114] Specifically, in 0211, the multiple wiring video data after data annotation are first preprocessed, such as data cleaning, to remove poor quality video data to ensure the accuracy of the generated data set; then key frames are extracted, such as extracting representative frames from the wiring video data, and the representative frames can be frames containing wiring actions; the extracted key frames are further analyzed to extract feature information, and the feature information can be information such as wiring color, terminal, line direction, connection relationship, etc. The extracted key frames and feature information can be used to generate data sets.

[0115] The data set can be divided into a training set and a test set according to a predetermined ratio. For example, 60% of the data set can be used as a training set and 40% as a test set. Of course, in other examples, 70% of the data set can be used as a training set and 30% as a test set; or 80% of the data set can be used as a training set and 20% as a test set, etc., without limitation. Generally speaking, the proportion of the training set in the data set is higher than that of the test set. The training set is used for the preliminary training of the model, while the test set is used to evaluate the performance of the model and optimize it. Both the training set and the test set include positive samples and negative samples.

[0116] In 0212, the model is trained through the training set to generate an initial video analysis model. First, a deep learning model architecture can be selected, such as a convolutional neural network (CNN), a recurrent neural network (RNN), a complex neural network (Transformer), etc.; then, the training set is input into the model, and the model parameters are adjusted through forward propagation and back propagation algorithms so that the model can accurately identify or predict key information in the video. During the training process, the weights and configurations of the model can be saved regularly for subsequent model evaluation and optimization. It should be noted that the process of model training through a training set is not limited to this, and the above process is only an exemplary description.

[0117] In 0213, the initial video analysis model is verified and optimized through the test set to obtain the video analysis model. Specifically, the initial video analysis model can be evaluated through the test set, hyperparameters are tuned, cross-validated, etc. to determine the final video analysis model. In this way, through repeated adjustments and improvements, the reliability and accuracy of the model can be improved, and the video analysis model has high accuracy and robustness for different environments and devices.

[0118] In some embodiments, the video analysis model comprises a multimodal large model.

[0119] Specifically, the multimodal large model can perform in-depth understanding and analysis of video content, integrate and process information from different modalities (such as vision, audio, text, etc.), and thus provide more comprehensive and accurate video analysis results.

[0120] In some embodiments, model training is performed using a training set to generate an initial video analysis model (i.e., 0212), including:

[0121] The training set is used to train feature extraction capabilities, pattern recognition capabilities, error diagnosis capabilities, and error correction capabilities to generate an initial video analysis model.

[0122] Specifically, in the process of generating the initial video analysis model through model training using the training set, the main training is feature extraction capability training, pattern recognition capability training, error diagnosis capability training and error correction capability training, so as to achieve the improvement of feature extraction, pattern recognition, error diagnosis capability and error correction capability.

[0123] Among them, feature extraction refers to extracting feature information related to wiring from wiring video data. Pattern recognition refers to the classification and identification of wiring behaviors. Behavior classification may include, for example, correct wiring behaviors and incorrect wiring behaviors. Behavior recognition may include further identifying specific wiring behaviors such as plugging, tightening, winding, etc. on the basis of classification. Error diagnosis refers to identifying wiring errors in wiring video data and giving corresponding diagnostic results. The diagnostic results include but are not limited to error types, error locations, etc. Error correction refers to giving correct wiring suggestions or guiding users to make corrections after identifying wiring errors in wiring video data.

[0124] See also Figure 6 In some embodiments, the current wiring video data is diagnosed and analyzed by a video analysis model to obtain a wiring inspection result (ie, 040), including:

[0125] 041: Use the video analysis model to diagnose and analyze the current wiring video data to determine whether the wiring is correct, as well as the error location and error type when the wiring is wrong, and the wiring guidance video.

[0126] Specifically, whether the wiring is correct may include whether the cable is correctly connected to the corresponding terminal, the tightness of the connection point, the wiring sequence, etc. The error position in the case of a wiring error may include the wiring area where the cable with the wiring error is located, and the error type includes that the cable is not correctly connected to the corresponding terminal, the connection is not tight, the wiring sequence is wrong, etc. The wiring guidance video may include a corresponding guidance video for the error position and error type in the case of a wiring error, and demonstrate the correct wiring method in detail to help the installer make timely corrections. The implementation method of the present application improves the intelligence level of wiring inspection, and also provides intuitive guidance and demonstration, which greatly facilitates the operation of the installer and ensures the safe and stable operation of the equipment.

[0127] In one example, the video analysis model is used to diagnose and analyze the current wiring video data to obtain the wiring inspection results: whether the wiring is correct (wiring error), the error location (the wiring area corresponding to two wiring terminals), the error type (loose connection), and the wiring guidance video (a video containing the correct wiring process, in which the error location can be marked).

[0128] See also Figure 7 and Figure 8 In some embodiments, the wiring inspection method is applied to the cloud 102. The cloud 102 is connected to the client 101 for communication. A plurality of wiring video data (ie, 010) corresponding to the wiring process of a plurality of power equipment is obtained, including:

[0129] 011: receiving a plurality of connection video data uploaded by the client 101 to the cloud 102;

[0130] The model is trained through multiple wiring video data to obtain a video analysis model (i.e., 020), including:

[0131] 022: In the cloud 102, a model is trained using multiple connection video data to obtain a video analysis model;

[0132] Obtain the current wiring video data (i.e. 030) corresponding to the wiring process of the current power equipment, including:

[0133] 031: receiving the current connection video data uploaded by the client 101 to the cloud 102;

[0134] The video analysis model is used to diagnose and analyze the current wiring video data to obtain the wiring inspection results (i.e. 040), including:

[0135] 042: In the cloud 102, the current wiring video data is diagnosed and analyzed by the video analysis model to obtain a wiring inspection result, and the wiring inspection result is fed back to the client 101.

[0136] Specifically, the wiring inspection method of the embodiment of the present application is applied to the cloud 102, which can improve the efficiency of wiring inspection and realize remote monitoring and analysis. Figure 8 As shown, the specific working process can be as follows:

[0137] In the model training stage, the client 101 collects multiple wiring video data corresponding to the wiring process of multiple power equipment and uploads them to the cloud 102; the cloud 102 receives the multiple wiring video data; the cloud 102 also receives multiple equipment operation data of multiple power equipment after the wiring is completed; the multiple wiring video data are respectively annotated according to the multiple equipment operation data to annotate the wiring conditions of the multiple wiring video data; the cloud 102 performs model training through the multiple wiring video data after data annotating to obtain a video analysis model. The trained video analysis model is stored in the model library of the cloud 102.

[0138] In the wiring inspection stage, the client 101 collects the current wiring video data corresponding to the wiring process of the current power equipment and uploads it to the cloud 102; the cloud 102 receives the current wiring video data through the wiring inspection interface; the cloud 102 performs diagnostic analysis (i.e., wiring reasoning) on ​​the current wiring video data through the video analysis model to obtain the wiring inspection result, and feeds the wiring inspection result back to the client 101 through the wiring inspection interface. The user can view the wiring inspection results on the client 101, such as whether the wiring is correct, the error location and error type when the wiring is wrong, the wiring guidance video, etc., so as to quickly correct the wiring problem. In this way, efficient and accurate wiring inspection and guidance can be achieved, which greatly improves the safety and reliability of power equipment installation.

[0139] See also Fig. 9 , the embodiment of the present application also provides a wiring inspection device 100. The wiring inspection device 100 includes a first acquisition module 10, a model training module 20, a second acquisition module 30 and a diagnostic analysis module 40. The first acquisition module 10 is used to acquire multiple wiring video data corresponding to the wiring process of multiple power equipment. The model training module 20 is used to perform model training through multiple wiring video data to obtain a video analysis model. The second acquisition module 30 is used to acquire current wiring video data corresponding to the wiring process of the current power equipment. The diagnostic analysis module 40 is used to perform diagnostic analysis on the current wiring video data through the video analysis model to obtain a wiring inspection result.

[0140] See also Fig.10 In some embodiments, the wiring inspection device 100 further includes a third acquisition module 50 and a data annotation module 60. The third acquisition module 50 is used to acquire a plurality of device operation data of a plurality of power devices after wiring is completed, wherein the plurality of device operation data respectively correspond to a plurality of wiring video data. The data annotation module 60 is used to perform data annotation on the plurality of wiring video data respectively according to the plurality of device operation data, so as to annotate the wiring conditions of the plurality of wiring video data. The model training module 20 is specifically used to perform model training through the plurality of wiring video data after data annotation to obtain a video analysis model.

[0141] See also Fig.10 In some embodiments, the wiring inspection device 100 further includes a fourth acquisition module 70 and a data matching module 80. The third acquisition module 50 is used to acquire multiple video shooting times corresponding to the multiple wiring video data. The data matching module 80 is used to match the multiple video shooting times with the multiple device operation data respectively, so that the multiple device operation data correspond to the multiple wiring video data respectively.

[0142] In some embodiments, the model training module 20 is specifically used to: preprocess multiple wiring video data after data annotation, extract key frames and feature information to generate a data set, the data set includes a training set and a test set; perform model training through the training set to generate an initial video analysis model; and optimize the initial video analysis model through the test set to obtain a video analysis model.

[0143] In certain embodiments, the model training module 20 is specifically used to perform feature extraction capability training, pattern recognition capability training, error diagnosis capability training, and error correction capability training through a training set to generate an initial video analysis model.

[0144] In some embodiments, the video analysis model comprises a multimodal large model.

[0145] In some embodiments, the diagnostic analysis module 40 is specifically used to: perform diagnostic analysis on the current wiring video data through a video analysis model to determine whether the wiring is correct, the error location and error type when the wiring is wrong, and the wiring guidance video.

[0146] please Figure 8 and Fig. 9 In some embodiments, the wiring inspection device 100 is applied to the cloud 102. The cloud 102 is in communication with the client 101. The first acquisition module 10 is specifically used to receive multiple wiring video data uploaded by the client 101 to the cloud 102. The model training module 20 is specifically used to perform model training on the cloud 102 through multiple wiring video data to obtain a video analysis model. The second acquisition module 30 is specifically used to receive the current wiring video data uploaded by the client 101 to the cloud 102. The diagnostic analysis module 40 is specifically used to perform diagnostic analysis on the current wiring video data through the video analysis model on the cloud 102, obtain a wiring inspection result, and feed the wiring inspection result back to the client 101.

[0147] In certain embodiments, the electrical power device comprises a photovoltaic storage device.

[0148] It should be noted that the explanation of the wiring inspection method in the aforementioned embodiment is also applicable to the wiring inspection device 100 in the embodiment of the present application, and will not be further described here.

[0149] See also Fig.11 The embodiment of the present application further provides a wiring check system 200. The wiring check system 200 includes one or more processors 210 and a memory 220. The memory 220 stores a computer program, and when the computer program is executed by the processor 210, the wiring check method of any of the above embodiments is implemented.

[0150] For example, when the computer program is executed by the processor 210, the following wiring inspection method is implemented:

[0151] 010: Acquire multiple wiring video data corresponding to the wiring process of multiple power equipment;

[0152] 020: Perform model training through multiple wiring video data to obtain a video analysis model;

[0153] 030: Obtain current wiring video data corresponding to the wiring process of the current power equipment;

[0154] 040: The current wiring video data is diagnosed and analyzed through the video analysis model to obtain the wiring inspection result.

[0155] For another example, when the computer program is executed by the processor 210, the following wiring inspection method is implemented:

[0156] 050: Acquire multiple device operation data of multiple power devices after wiring is completed, wherein the multiple device operation data correspond to multiple wiring video data respectively;

[0157] 060: performing data annotation on multiple wiring video data respectively according to the operation data of multiple devices to annotate the wiring conditions of the multiple wiring video data;

[0158] 021: The model is trained through multiple wiring video data after data annotation to obtain a video analysis model.

[0159] It should be noted that the explanation of the wiring check method in the aforementioned embodiment is also applicable to the wiring check system 200 in the embodiment of the present application, and will not be further described here.

[0160] See also Fig.12 The embodiment of the present application further provides a computer-readable storage medium 300 on which a computer program 310 is stored. When the program is executed by the processor 320, the wiring inspection method of any of the above embodiments is implemented.

[0161] For example, when the program is executed by the processor 320, the following wiring inspection method is implemented:

[0162] 010: Acquire multiple wiring video data corresponding to the wiring process of multiple power equipment;

[0163] 020: Perform model training through multiple wiring video data to obtain a video analysis model;

[0164] 030: Obtain current wiring video data corresponding to the wiring process of the current power equipment;

[0165] 040: The current wiring video data is diagnosed and analyzed through the video analysis model to obtain the wiring inspection result.

[0166] For another example, when the program is executed by the processor 320, the following wiring check method is implemented:

[0167] 050: Acquire multiple device operation data of multiple power devices after wiring is completed, wherein the multiple device operation data correspond to multiple wiring video data respectively;

[0168] 060: performing data annotation on multiple wiring video data respectively according to the operation data of multiple devices to annotate the wiring conditions of the multiple wiring video data;

[0169] 021: The model is trained through multiple wiring video data after data annotation to obtain a video analysis model.

[0170] It should be noted that the explanation of the wiring inspection method in the aforementioned embodiment is also applicable to the computer-readable storage medium 300 in the embodiment of the present application, and will not be elaborated here.

[0171] In summary, the wiring inspection method, wiring inspection device 100, wiring inspection system 200 and computer-readable storage medium 300 of the embodiment of the present application firstly perform model training through multiple wiring video data to obtain a video analysis model, and then perform diagnostic analysis on the current wiring video data through the video analysis model to obtain the wiring inspection result. In this way, not only the inspection efficiency is improved and human errors are reduced, but also immediate wiring guidance can be provided to the installer to ensure the correct installation and safe operation of the equipment.

[0172] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0173] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0174] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable storage medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, a computer-readable storage medium can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples (non-exhaustive list) of computer-readable storage media include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable storage medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0175] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0176] A person of ordinary skill in the art will appreciate that all or part of the steps carried by the method for implementing the above-mentioned embodiment can be completed by instructing the relevant hardware through a program, and the program can be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment. In addition, each functional unit in each embodiment of the present application can be integrated into a processing module, or each unit can exist physically alone, or two or more units can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. The above-mentioned storage medium can be a read-only memory, a disk or an optical disk, etc.

[0177] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application. The scope of the present application is defined by the claims and their equivalents.

Claims

1. A wiring inspection method, characterized in that: include: Acquire multiple wiring video data corresponding to the wiring process of multiple power equipment; Performing model training through the plurality of wiring video data to obtain a video analysis model; Obtain current wiring video data corresponding to the wiring process of the current power equipment; The video analysis model is used to perform diagnostic analysis on the current wiring video data to obtain a wiring inspection result.

2. The wiring inspection method according to claim 1, characterized in that: The wiring inspection method further comprises: Acquire a plurality of device operation data of the plurality of power devices after wiring is completed, wherein the plurality of device operation data respectively correspond to the plurality of wiring video data; Performing data annotation on the plurality of wiring video data respectively according to the plurality of equipment operation data to annotate wiring conditions of the plurality of wiring video data; The method of performing model training through the plurality of wiring video data to obtain a video analysis model includes: The video analysis model is obtained by performing model training on the multiple wiring video data after data annotation.

3. The wiring inspection method according to claim 2, characterized in that: After obtaining the operation data of the plurality of electrical devices after wiring is completed, the wiring inspection method further includes: Acquire multiple video shooting times corresponding to the multiple wiring video data; The plurality of video shooting times are matched with the plurality of equipment operation data respectively, so that the plurality of equipment operation data correspond to the plurality of wiring video data respectively.

4. The wiring inspection method according to claim 2, characterized in that: The method of performing model training on the plurality of wiring video data after data annotation to obtain the video analysis model comprises: Preprocessing the plurality of wiring video data after data annotation, extracting key frames and feature information to generate a data set, wherein the data set includes a training set and a test set; Performing model training using the training set to generate an initial video analysis model; The initial video analysis model is optimized using the test set to obtain the video analysis model.

5. The wiring inspection method according to claim 4, characterized in that: The step of performing model training through the training set to generate an initial video analysis model includes: The initial video analysis model is generated by performing feature extraction capability training, pattern recognition capability training, error diagnosis capability training and error correction capability training through the training set.

6. The wiring inspection method according to claim 1, characterized in that: The video analysis model includes a multimodal large model.

7. The wiring inspection method according to claim 1, characterized in that: The step of performing diagnostic analysis on the current wiring video data by using the video analysis model to obtain a wiring inspection result includes: The video analysis model is used to diagnose and analyze the current wiring video data to determine whether the wiring is correct, the error location and error type when the wiring is wrong, and the wiring guidance video.

8. The wiring inspection method according to claim 1, characterized in that: The wiring inspection method is applied to a cloud, the cloud is connected to a client for communication, and the acquisition of a plurality of wiring video data corresponding to the wiring process of a plurality of power equipment includes: receiving the plurality of connection video data uploaded by the client to the cloud; The method of performing model training through the plurality of wiring video data to obtain a video analysis model includes: Performing model training on the cloud using the plurality of connection video data to obtain the video analysis model; The obtaining of current wiring video data corresponding to the wiring process of the current power equipment includes: Receiving the current connection video data uploaded by the client to the cloud; The step of performing diagnostic analysis on the current wiring video data by using the video analysis model to obtain a wiring inspection result includes: The current wiring video data is diagnosed and analyzed in the cloud through the video analysis model to obtain the wiring inspection result, and the wiring inspection result is fed back to the client.

9. The wiring inspection method according to claim 1, characterized in that: The electric power equipment includes a photovoltaic storage device.

10. A wiring inspection device, characterized in that: include: A first acquisition module is used to acquire a plurality of wiring video data corresponding to the wiring process of a plurality of power equipment; A model training module, used for performing model training through the plurality of wiring video data to obtain a video analysis model; The second acquisition module is used to acquire current wiring video data corresponding to the wiring process of the current power equipment; The diagnosis and analysis module is used to perform diagnosis and analysis on the current wiring video data through the video analysis model to obtain wiring inspection results.

11. A wiring inspection system, characterized in that: The wiring check system includes one or more processors and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the wiring check method according to any one of claims 1 to 9 is implemented.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the wiring inspection method according to any one of claims 1 to 9 is implemented.

Images