An energy intelligent inspection system based on mixed reality

Abstract

The present invention relates to the field of online inspection, and is used to solve the problem that it is difficult to find hidden faults and insufficient utilization of inspection data when displaying through a flat screen during robot inspection. The present invention is specifically an energy intelligent inspection system based on mixed reality. In the present invention, a three-dimensional image of a device is collected by a three-dimensional acquisition device, and the brightness of the image is automatically processed into data, and the brightness of the processed image is judged, so as to automatically decide whether to perform a fill light operation on the image, so as to ensure the brightness of the image during image collection, and then the three-dimensional image is displayed in a three-dimensional display device through mixed reality technology, and the viewing operation of the model is realized by means of input and output interaction, so as to improve the accuracy and comprehensiveness of the viewing of the equipment, and at the same time, the results of each inspection are counted by a data processing system, and the operation status of the equipment is quantitatively analyzed and judged, so as to reduce the number and probability of failures of the equipment during daily operation.

Description

Technical Field

[0001] The present invention relates to the field of online inspection, and in particular to an energy intelligent inspection system based on mixed reality. Background Art

[0002] During the daily maintenance of power stations, regular inspections are required. With the advancement of technology, robot inspections have replaced manual inspections, which can significantly reduce the workload of staff and effectively improve inspection efficiency.

[0003] At present, the inspection technology in the existing technology still has shortcomings. The existing inspection technology is generally implemented through the camera attached to the robot. Therefore, when observing the inspected structure or equipment, personnel can only view it through a flat display device, which makes the viewing angle fixed and greatly reduces the ability to discover hidden faults. At the same time, when inspecting the equipment, there is a lack of sufficient data for in-depth analysis, which makes it difficult to discover equipment operation failures;

[0004] In view of the above technical problems, this application proposes a solution. Summary of the invention

[0005] The present invention proposes an energy intelligent inspection system based on mixed reality to solve the problem that it is difficult to find hidden faults and insufficient utilization of inspection data when robots are inspecting through flat screen displays.

[0006] The purpose of the present invention can be achieved through the following technical solutions:

[0007] An energy intelligent inspection system based on mixed reality, comprising an inspection collection unit, a hybrid processing unit, an input collection unit and an inspection maintenance unit, wherein the inspection collection unit is used to collect information from an energy storage device through a three-dimensional collection device and a parameter collection device to obtain a three-dimensional image and an abnormal operation signal;

[0008] The input acquisition unit is used to acquire input actions of the touchable input and output device, and convert them into electrical signals, and change the output image according to the electrical signals;

[0009] The hybrid processing unit acquires the three-dimensional image and the abnormal operation signal through the inspection collection unit, and displays the three-dimensional image and the abnormal operation signal;

[0010] The inspection and maintenance unit obtains the abnormal operation signal through the hybrid processing unit, performs statistical analysis based on the abnormal operation signal, obtains the operation stability value, and generates the energy storage device abnormal signal or the energy storage device normal signal based on the operation stability value.

[0011] As a preferred embodiment of the present invention, the inspection and acquisition unit acquires the three-dimensional image of the screen through a pair of three-dimensional camera groups. After acquiring the three-dimensional image, the inspection and acquisition unit automatically calculates the overall brightness of the three-dimensional image. If the overall brightness of the picture is greater than or equal to a preset value, no response is made. If the overall brightness of the picture is lower than the preset value, the fill light source is started and the fill light source is adjusted to a brightness greater than or equal to the preset value. After the overall brightness of the picture is greater than or equal to the preset value, the captured three-dimensional image is sent to the hybrid processing unit.

[0012] As a preferred embodiment of the present invention, the method for the inspection and acquisition unit to calculate the overall brightness of the three-dimensional image is:

[0013] S1: collect the brightness of the pixels in the picture and record it as the single point brightness Li, where i=1, 2, 3…, n, and n is a natural number not equal to 0;

[0014] S2: Analyze the single point brightness by formula to generate the lower limit value Lmin of brightness. , where q is the preset weight coefficient, and the value of q is 0.4±0.08;

[0015] S3: Compare the pixel Li in the picture with the lower limit value Lmin of brightness, record the pixel with brightness less than the lower limit value Lmin as a low brightness pixel, and calculate the proportion of the low brightness pixel in all the pixels, and record it as the low brightness proportion;

[0016] S4: The inspection collection unit compares the low brightness ratio with the preset ratio threshold. If the low brightness ratio is greater than the preset ratio threshold, an insufficient screen brightness signal is generated and the fill light source is started. If the low brightness ratio is less than or equal to the preset ratio threshold, no response is made.

[0017] As a preferred embodiment of the present invention, when the inspection and collection unit collects data through the parameter collection device, each parameter collected is classified into a number Cm, where m is a natural number not equal to 0. The inspection and collection unit assigns a weight Am to each parameter classification according to the influence of different parameters on the operating stability of the energy storage device;

[0018] The inspection collection unit compares the parameter classification Cm with the preset parameter operation range. If the parameter classification Cm is within the preset parameter operation range, the parameter classification is assigned a multiplier k, k=0; if the parameter classification Cm is outside the preset parameter operation range, the parameter classification Cm is calculated and assigned a multiplier k, k=1;

[0019] The inspection collection unit generates the parameter over-limit value CX through formula analysis. The inspection collection unit compares the parameter over-limit value CX with the preset over-limit threshold. If the parameter over-limit value CX is less than the preset over-limit threshold, a normal operation signal is generated. If the parameter over-limit value CX is greater than or equal to the preset over-limit threshold, an abnormal operation signal is generated.

[0020] The inspection collection unit sends the abnormal operation signal and the parameter classification Cm outside the preset parameter operation range to the hybrid processing unit.

[0021] As a preferred embodiment of the present invention, after the hybrid processing unit acquires the three-dimensional image, the three-dimensional image is displayed on a touchable input and output device through a hybrid display technology, and the manager slides through the touchable input and output device to achieve translation, rotation, zooming in and out of the image of the energy storage device;

[0022] After obtaining the abnormal operation signal, the hybrid processing unit marks the energy storage device with the abnormal operation with a prominent color on the three-dimensional image. After obtaining the parameter classification Cm, the hybrid processing unit displays the parameter classification Cm on the touchable output device, and at the same time displays the corresponding position on the energy storage device with another prominent color to mark the position where the parameter classification exceeds the limit.

[0023] As a preferred embodiment of the present invention, the inspection and maintenance unit performs an inspection once every preset time interval, obtains an abnormal operation signal through the hybrid processing unit, and counts the energy storage device that obtains the abnormal operation signal, and records the number of maintenance times, and the inspection and maintenance unit counts the energy storage device that does not obtain the abnormal operation signal, and records the number of normal operations;

[0024] The inspection and maintenance unit counts the maximum continuous normal operation times of the energy storage device, which is recorded as LZ, the total number of normal operation times of the energy storage device is recorded as LS, the total number of maintenance times is counted, which is recorded as WS, and the maximum continuous maintenance times is counted, which is recorded as WZ;

[0025] The inspection and maintenance unit generates the operation stability value WD through formula analysis. The operation stability value WD is compared with the preset operation stability value. If the operation stability value WD is less than the preset operation stability value, an energy storage device abnormal signal is generated. If the operation stability value WD is greater than or equal to the preset operation stability value, a normal signal of the energy storage device is generated.

[0026] Compared with the prior art, the present invention has the following beneficial effects:

[0027] 1. In the present invention, when inspecting the equipment, the three-dimensional image of the equipment is collected by the three-dimensional acquisition device, and the three-dimensional image is displayed in the three-dimensional display device through the mixed reality technology, so that the management personnel can directly observe the miniaturized overall model of the equipment, and realize the viewing operation of the model through input and output interaction, which ensures that the management personnel can freely view the equipment status from different angles and different proportions, and improves the accuracy and comprehensiveness of the equipment viewing.

[0028] 2. In the present invention, when collecting three-dimensional images, the brightness of the picture is automatically processed into data, and the brightness of the processed picture is judged, so as to automatically decide whether to perform fill light operation on the picture, thereby ensuring the brightness of the picture during picture collection, avoiding blurring of the picture during picture collection due to insufficient brightness, and improving the clarity of the picture.

[0029] 3. In the present invention, when inspecting the equipment, statistics are collected for each inspection result, and quantitative analysis is performed based on the inspection results. The operating condition of the equipment is judged through quantitative analysis, so that when the operating condition of the equipment deteriorates, it can be replaced or thoroughly overhauled in time, reducing the number and probability of equipment failures during daily operation, improving the operating stability of the equipment and reducing the frequency and load of the inspection process. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to facilitate understanding by those skilled in the art, the present invention is further described below with reference to the accompanying drawings.

[0031] Figure 1 is a system block diagram of the present invention;

[0032] Figure 2 The figure is a flow chart of the method of the present invention. DETAILED DESCRIPTION

[0033] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0034] Example 1

[0035] See also Figure 1 - Figure 2As shown, an energy intelligent inspection system based on mixed reality includes an inspection collection unit, a hybrid processing unit, an input collection unit and an inspection maintenance unit. The inspection collection unit obtains the operating parameters of the energy storage device through a three-dimensional collection device and a parameter collection device, wherein the three-dimensional collection device collects the three-dimensional image of the screen through a pair of three-dimensional camera groups during collection. After collecting the three-dimensional image, the inspection collection unit automatically calculates the overall brightness of the three-dimensional image. If the overall brightness of the picture is greater than or equal to a preset value, no response is made. If the overall brightness of the picture is lower than the preset value, a fill light source is started, and the fill light source is adjusted to a picture brightness greater than or equal to a preset value. After the overall brightness of the picture is greater than or equal to the preset value, the captured three-dimensional image is sent to the hybrid processing unit.

[0036] The method for the inspection acquisition unit to calculate the overall brightness of the three-dimensional image is:

[0037] S1: collect the brightness of the pixels in the picture and record it as the single point brightness Li, where i=1, 2, 3…, n, and n is a natural number not equal to 0;

[0038] S2: Analyze the single point brightness by formula to generate the lower limit value Lmin of brightness. , where q is the preset weight coefficient, and the value of q is 0.4±0.08;

[0039] S3: Compare the pixel Li in the picture with the lower limit value Lmin of brightness, record the pixel with brightness less than the lower limit value Lmin as a low brightness pixel, and calculate the proportion of the low brightness pixel in all the pixels, and record it as the low brightness proportion;

[0040] S4: The inspection collection unit compares the low brightness ratio with the preset ratio threshold. If the low brightness ratio is greater than the preset ratio threshold, an insufficient screen brightness signal is generated and the fill light source is started. If the low brightness ratio is less than or equal to the preset ratio threshold, no response is made.

[0041] The parameter collection device in the inspection and collection unit collects the parameters of the energy storage device through the sensor set in the energy storage device, and classifies each collected parameter into a number Cm, where m is a natural number not equal to 0. The inspection and collection unit assigns a weight Am to each parameter classification according to the influence of different parameters on the operating stability of the energy storage device;

[0042] The inspection collection unit compares the parameter classification Cm with the preset parameter operation range. If the parameter classification Cm is within the preset parameter operation range, the parameter classification is assigned a multiplier k, k=0; if the parameter classification Cm is outside the preset parameter operation range, the parameter classification Cm is calculated and assigned a multiplier k, k=1;

[0043] The inspection collection unit generates the parameter over-limit value CX through formula analysis. The inspection collection unit compares the parameter over-limit value CX with the preset over-limit threshold. If the parameter over-limit value CX is less than the preset over-limit threshold, a normal operation signal is generated. If the parameter over-limit value CX is greater than or equal to the preset over-limit threshold, an abnormal operation signal is generated.

[0044] The inspection collection unit sends the abnormal operation signal and the parameter classification Cm outside the preset parameter operation range to the hybrid processing unit.

[0045] Example 2

[0046] See also Figure 1 - Figure 2 As shown, after the hybrid processing unit acquires the three-dimensional image, the three-dimensional image is displayed on the touch input and output device through the hybrid display technology. The manager slides through the touch input and output device to realize the translation, rotation, zooming in and out of the image of the energy storage device;

[0047] After obtaining the abnormal operation signal, the hybrid processing unit marks the energy storage device with the abnormal operation with a prominent color on the three-dimensional image. After obtaining the parameter classification Cm, the hybrid processing unit displays the parameter classification Cm on the touchable output device, and at the same time displays the corresponding position on the energy storage device with another prominent color to mark the position where the parameter classification exceeds the limit.

[0048] Example 3

[0049] See also Figure 1 - Figure 2 As shown, the input acquisition unit is used to connect to the touchable input and output device. The input acquisition unit is used to collect the touch behavior received on the touchable input and output device, and convert it into an electrical signal, which is sent to the touchable input and output device via the electrical signal. The touchable input and output device then processes the image according to the electrical signal and converts it into a processed image signal, thereby outputting the image signal to achieve dynamic operation of the image.

[0050] Example 4

[0051] See also Figure 1 - Figure 2 As shown, the inspection and maintenance unit obtains the abnormal operation signal through the hybrid processing unit, and counts the energy storage devices that obtain the abnormal operation signal, and records the number of maintenance times. The inspection and maintenance unit counts the energy storage devices that do not obtain the abnormal operation signal, and records the number of normal operations;

[0052] The inspection and maintenance unit performs an inspection once at a preset time interval, and records the number of maintenance times or normal operation times for all energy storage devices during the inspection process;

[0053] The inspection and maintenance unit counts the maximum continuous normal operation times of the energy storage device, which is recorded as LZ, the total number of normal operation times of the energy storage device is recorded as LS, the total number of maintenance times is counted, which is recorded as WS, and the maximum continuous maintenance times is counted, which is recorded as WZ;

[0054] The inspection and maintenance unit generates the operation stability value WD through formula analysis. , and compares the operation stability value WD with the preset operation stability value. If the operation stability value WD is less than the preset operation stability value, an energy storage device abnormal signal is generated. If the operation stability value WD is greater than or equal to the preset operation stability value, an energy storage device normal signal is generated. The inspection and maintenance unit sends the energy storage device abnormal signal and the energy storage device normal signal to the display device, and reminds the abnormal energy storage device through the display device, thereby ensuring that the abnormal energy storage device is replaced or thoroughly overhauled in time, reducing the number of abnormal operations of the energy storage device.

[0055] The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to only specific implementation methods. Obviously, many modifications and changes can be made according to the content of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can understand and use the present invention well. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. An energy intelligent inspection system based on mixed reality, characterized in that: It includes an inspection and collection unit, a hybrid processing unit, an input collection unit and an inspection and maintenance unit. The inspection and collection unit is used to collect data from the energy storage device through a three-dimensional collection device and a parameter collection device to obtain a three-dimensional image and an abnormal operation signal; The input acquisition unit is used to acquire input actions of the touchable input and output device, and convert them into electrical signals, and change the output image according to the electrical signals; The hybrid processing unit acquires the three-dimensional image and the abnormal operation signal through the inspection collection unit, and displays the three-dimensional image and the abnormal operation signal; The inspection and maintenance unit obtains the abnormal operation signal through the hybrid processing unit, performs statistical analysis based on the abnormal operation signal, obtains the operation stability value, and generates the energy storage device abnormal signal or the energy storage device normal signal based on the operation stability value; When the inspection and collection unit collects data through the parameter collection device, each parameter collected is classified into a number Cm, where m is a natural number not equal to 0. The inspection and collection unit assigns a weight Am to each parameter classification according to the influence of different parameters on the operating stability of the energy storage device; The inspection collection unit compares the specific parameters included in the parameter category numbered Cm with the preset parameter operating range. If the specific parameters included in the parameter category numbered Cm are within the preset parameter operating range, a multiplier k is assigned to the parameter category, k=0; if the specific parameters included in the parameter category numbered Cm are outside the preset parameter operating range, the parameter category Cm is calculated to be assigned a multiplier k, k=1; The inspection collection unit generates the parameter over-limit value CX through formula analysis. The inspection collection unit compares the parameter over-limit value CX with the preset over-limit threshold. If the parameter over-limit value CX is less than the preset over-limit threshold, a normal operation signal is generated. If the parameter over-limit value CX is greater than or equal to the preset over-limit threshold, an abnormal operation signal is generated. The inspection collection unit sends the abnormal operation signal and the parameter classification Cm outside the preset parameter operation range to the hybrid processing unit; After the hybrid processing unit acquires the three-dimensional image, the three-dimensional image is displayed on the touch input and output device through the hybrid display technology. The manager slides through the touch input and output device to realize the translation, rotation, zooming in and out of the image of the energy storage device; After obtaining the abnormal operation signal, the hybrid processing unit marks the energy storage device with abnormal operation in a prominent color on the three-dimensional image. After obtaining the parameter classification Cm, the hybrid processing unit displays the parameter classification Cm on the touchable output device, and at the same time displays the corresponding position on the energy storage device in another prominent color to mark the position where the parameter classification exceeds the limit; The inspection and maintenance unit performs an inspection once at a preset time interval. The inspection and maintenance unit obtains an abnormal operation signal through the hybrid processing unit, and counts the energy storage devices that obtain the abnormal operation signal, and records the number of maintenance times. The inspection and maintenance unit counts the energy storage devices that do not obtain the abnormal operation signal, and records the number of normal operations. The inspection and maintenance unit counts the maximum continuous normal operation times of the energy storage device, which is recorded as LZ, the total number of normal operation times of the energy storage device is recorded as LS, the total number of maintenance times is counted, which is recorded as WS, and the maximum continuous maintenance times is counted, which is recorded as WZ; The inspection and maintenance unit generates the operation stability value WD through formula analysis. The operation stability value WD is compared with the preset operation stability value. If the operation stability value WD is less than the preset operation stability value, an energy storage device abnormal signal is generated. If the operation stability value WD is greater than or equal to the preset operation stability value, a normal signal of the energy storage device is generated.

2. The energy intelligent inspection system based on mixed reality according to claim 1 is characterized in that: The inspection and acquisition unit acquires the three-dimensional image of the screen through a pair of three-dimensional camera groups. After acquiring the three-dimensional image, the inspection and acquisition unit automatically calculates the overall brightness of the three-dimensional image. If the overall brightness of the picture is greater than or equal to a preset value, no response is made. If the overall brightness of the picture is lower than the preset value, the fill light source is started and the fill light source is adjusted to a brightness greater than or equal to the preset value. After the overall brightness of the picture is greater than or equal to the preset value, the captured three-dimensional image is sent to the hybrid processing unit.

3. The energy intelligent inspection system based on mixed reality according to claim 2 is characterized in that: The method for the inspection and acquisition unit to calculate the overall brightness of the three-dimensional image is: S1: Collect the brightness of the pixels in the picture and record it as the single point brightness Li, where i=1, 2, 3…, n, and n is a natural number not equal to 0; S2: Analyze the single point brightness by formula to generate the lower limit value Lmin of brightness. , where q is the preset weight coefficient, and the value of q is 0.4±0.08; S3: Compare the pixel Li in the picture with the lower limit value Lmin of brightness, record the pixel with brightness less than the lower limit value Lmin as a low brightness pixel, and calculate the proportion of the low brightness pixel in all the pixels, and record it as the low brightness proportion; S4: The inspection collection unit compares the low brightness ratio with the preset ratio threshold. If the low brightness ratio is greater than the preset ratio threshold, an insufficient screen brightness signal is generated and the fill light source is started. If the low brightness ratio is less than or equal to the preset ratio threshold, no response is made.

Images