Information processing apparatus and method

Abstract

To improve a technique for calculating a fluid flow rate in each pipe of a plurality of pipes to be inspected.SOLUTION: An information processing apparatus has a control unit that calculates a fluid flow rate in each pipe of a plurality of pipes to be inspected. The control unit acquires a plurality of pieces of image data in which the plurality of pipes to be inspected are included within an imaging range and imaging times are different, calculates a frequency spectrum at each pixel on the basis of temporal changes of elements of each pixel in the image data, calculates a frequency at a specific pixel on the basis of the frequency spectrum in the specific pixel constituting each pipe in each image data, and calculates a flow rate of each pipe on the basis of the calculated frequency and a pipe diameter of each pipe.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device and method for calculating the flow rate of a fluid in a plurality of pipes to be inspected. [Background technology]

[0002] Within the premises of steelworks and the like, pipes are installed that supply fluids such as high-temperature gas to factory equipment. From the viewpoint of determining abnormalities in the equipment and saving energy through efficient operation, it is necessary to measure the flow rate of the fluid in such pipes on a regular or irregular basis. Patent Document 1 discloses a method for measuring the flow rate in a pipe, in which the flow rate of the fluid in the pipe is calculated based on the frequency measured by a vibrometer installed on the outer periphery of the pipe. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2022-158898 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the flow rate calculation technique using vibration frequency shown in Patent Document 1 requires that vibration meters be installed directly on the pipes to be inspected, which requires a large number of vibration meters. Furthermore, if the vibration meters are installed in high places, scaffolding must be assembled, ladders must be used, etc., which increases the installation cost and raises safety concerns during inspection work. As such, there is room for improvement in the technique for calculating the flow rate of a fluid in each of multiple pipes to be inspected.

[0005] In view of the above circumstances, an object of the present disclosure is to improve the technology for calculating the flow rate of a fluid in each of a plurality of pipes to be inspected. [Means for solving the problem]

[0006] (1) An information processing device according to an embodiment of the present disclosure includes: An information processing device having a control unit that calculates a flow rate of a fluid in each of a plurality of pipes to be inspected, The control unit A plurality of image data pieces are acquired, each image data piece being captured at a different time, and a frequency spectrum for each pixel is calculated based on the time variation of the element of each pixel in each image data piece. Calculating a frequency at a specific pixel constituting each pipe in each image data based on a frequency spectrum at the specific pixel; The flow rate of each pipe is calculated based on the calculated frequency and the pipe diameter of each pipe.

[0007] (2) An information processing device according to an embodiment of the present disclosure is the information processing device according to (1), The control unit Calculating a frequency at another specific pixel that constitutes a reference portion different from each pipe in the image data based on a frequency spectrum at the other specific pixel; The flow rate of each pipe is calculated based on the differential frequency between the frequency at the specific pixel and the frequency at the other specific pixel, and the pipe diameter of each pipe.

[0008] (3) An information processing device according to an embodiment of the present disclosure is the information processing device according to (1) or (2), a display unit capable of displaying an output image including information indicating the flow rate of each pipe; The control unit The output image is generated by superimposing the calculated flow rate of each pipe on a base image generated based on the plurality of image data.

[0009] (4) An information processing device according to an embodiment of the present disclosure is the information processing device according to (3), The control unit When the flow rate calculated last time for each pipe differs from the flow rate calculated this time, the amount of change in flow rate is also superimposed on the base image to generate the output image.

[0010] (5) An information processing device according to an embodiment of the present disclosure is the information processing device according to any one of (1) to (4), The component of each pixel is luminance.

[0011] (6) A method according to an embodiment of the present disclosure includes: A method for calculating a flow rate of a fluid in each of a plurality of pipes to be inspected, executed by an information processing device, comprising: A plurality of image data are acquired in which a plurality of pipes to be inspected are included in the photographing range and photographed at different times, and a frequency spectrum at each pixel is calculated based on a time change of an element of each pixel in each image data; Calculating a frequency at a specific pixel constituting each pipe in each image data based on a frequency spectrum at the specific pixel; Calculating the flow rate of each pipe based on the calculated frequency and the pipe diameter of each pipe. Includes:

[0012] (7) A method according to one embodiment of the present disclosure is the method according to (6), Calculating a frequency at another specific pixel that constitutes a reference portion different from each pipe in the image data based on a frequency spectrum at the other specific pixel; The flow rate of each pipe is calculated based on the differential frequency between the frequency at the specific pixel and the frequency at the other specific pixel, and the pipe diameter of each pipe.

[0013] (8) A method according to one embodiment of the present disclosure is the method according to (6) or (7), The method further includes generating and displaying an output image in which the calculated flow rate of each pipe is superimposed on a base image generated based on the plurality of image data.

[0014] (9) A method according to one embodiment of the present disclosure is the method according to (8), When the flow rate calculated last time for each pipe differs from the flow rate calculated this time, the amount of change in flow rate is also superimposed on the base image to generate the output image.

[0015] (10) A method according to an embodiment of the present disclosure is a method according to any one of (6) to (9), The component of each pixel is luminance. [Effects of the Invention]

[0016] According to one embodiment of the present disclosure, an improved technique for calculating the flow rate of a fluid in each of a plurality of pipes to be inspected is provided. [Brief explanation of the drawings]

[0017] [Figure 1] FIG. 1 is a conceptual diagram illustrating a system according to an embodiment of the present disclosure. [Figure 2] 1 is a block diagram illustrating a schematic configuration of an information processing device according to an embodiment of the present disclosure. [Figure 3] 10 is a flowchart illustrating an operation of the information processing device. [Figure 4] 10 is an example of an output image according to an embodiment of the present disclosure. [Figure 5] FIG. 10 is a conceptual diagram of a subject to be photographed according to a modified example. [Figure 6] 10 is a graph showing vibration frequencies of a pipe. [Figure 7] 10 is a graph showing the vibration frequency of the reference part. [Figure 8] 10 is a graph showing a differential oscillation frequency. [Figure 9] 1 is a diagram showing a schematic configuration of a piping system according to an embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0018] Hereinafter, embodiments of the present disclosure will be described.

[0019] (Outline of the embodiment) The outline and configuration of a system 1 according to this embodiment will be described with reference to FIG.

[0020] The system 1 according to this embodiment includes an information processing device 10, a camera 20, and a lighting device 30.

[0021] The information processing device 10 is any device used by a user. For example, the information processing device 10 may be a general-purpose electronic device such as a personal computer or a tablet terminal, or a dedicated electronic device.

[0022] The camera 20 includes a high-speed camera, such as a CCD (Charge-Coupled Device) camera or a CMOS (Complementary Metal-Oxide-Semiconductor) camera. The camera 20 captures a plurality of image data sets obtained by capturing images of the capture range at a predetermined time interval (hereinafter also referred to as a frame rate) and transmits them to the information processing device 10. The capture range of each image data set includes a plurality of pipes to be inspected. In FIG. 1, two pipes, pipes 40 and 50, are included in the capture range as an example of the plurality of pipes. The capture times of the plurality of image data sets are different. Here, when calculating the flow rate of a fluid in each of the plurality of pipes to be inspected (hereinafter also referred to as a pipe flow rate), it is preferable that two measurement points, one on the inlet side and one on the outlet side of a bend in each pipe, are included in the capture range. Specifically, for pipe 40, it is preferable that measurement points A and B be included in the capture range. Furthermore, for pipe 50, it is preferable that measurement points C and D be included in the capture range. In this embodiment, it is desirable that the bent portions included in the imaging range include at least parts (including so-called bent pipes) designed so that the flow direction of the fluid flowing through the pipe is changed by 90 degrees.

[0023] The lighting device 30 includes a light source such as a light-emitting diode (LED), an incandescent lamp, a fluorescent lamp, or a halogen lamp. The lighting device 30 provides appropriate light to a subject within the shooting range of the camera 20, improving the quality of image data. It is preferable that the lighting device 30 be flicker-free, which can reduce noise in the calculation of the frequency spectrum.

[0024] First, an overview of this embodiment will be described, and details will be provided later. The information processing device 10 acquires the above-mentioned multiple image data from the camera 20. The information processing device 10 calculates a frequency spectrum for each pixel based on the time change of elements of each pixel in each image data. Next, the information processing device 10 calculates a frequency for a specific pixel that constitutes each pipe in each image data based on the frequency spectrum for that specific pixel. Then, the information processing device 10 calculates the flow rate of each pipe based on the calculated frequency and the pipe diameter of each pipe.

[0025] As described above, according to this embodiment, the information processing device 10 can calculate the flow rate of each pipe based on photographed image data including multiple pipes, eliminating the need to install a vibration meter directly on each pipe. Furthermore, even if the pipe being inspected is located at a high altitude, it is possible to safely calculate the flow rate of fluid in the pipe being inspected. This eliminates the need to install a vibration meter, reducing installation costs and improving safety during inspection work, thereby improving the technology for calculating the flow rate of fluid in each of multiple pipes being inspected.

[0026] (Configuration of information processing device) Next, a description will be given of the configuration of the information processing device 10. As shown in Fig. 2, the information processing device 10 includes a control unit 11, a storage unit 12, an image data acquisition unit 13, an input unit 14, and a display unit 15.

[0027] The control unit 11 includes at least one processor, at least one dedicated circuit, or a combination thereof. The processor may be a general-purpose processor such as a central processing unit (CPU) or a graphics processing unit (GPU), or a dedicated processor specialized for a specific process. The dedicated circuit may be, for example, a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC). The control unit 11 executes processes related to the operation of the information processing device 10 while controlling each unit of the information processing device 10. Specifically, the control unit 11 acquires image data stored in the storage unit 12 and analyzes the vibration state of the subject. In this embodiment, the control unit 11 extracts, from the image data as time-series data, temporal changes (e.g., luminance changes) of elements of each pixel in the image data corresponding to a predetermined window, i.e., a predetermined period, and performs a Fourier transform to calculate vibration information (vibration spectrum).

[0028] The storage unit 12 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a random access memory (RAM) or a read only memory (ROM). The RAM is, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The ROM is, for example, an electrically erasable programmable read only memory (EEPROM). The storage unit 12 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 stores data used in the operation of the information processing device 10 and data obtained by the operation of the information processing device 10.

[0029] The image data acquisition unit 13 controls the camera 20 to acquire a plurality of image data shot at a predetermined frame rate. The image data acquisition unit 13 also stores the acquired image data in the storage unit 12.

[0030] The input unit 14 includes at least one input interface. The input interface may be, for example, a physical key, a capacitance key, a pointing device, or a touch screen integrated with a display. The input interface may also be, for example, a sound sensor that accepts voice input, or a camera that accepts gesture input. The input unit 14 accepts an operation to input data used for the operation of the information processing device 10. The input unit 14 may be connected to the information processing device 10 as an external input device instead of being provided in the information processing device 10. Any connection method may be used, for example, a Universal Serial Bus (USB), a High-Definition Multimedia Interface (HDMI) (registered trademark), or Bluetooth (registered trademark).

[0031] The display unit 15 includes a display that outputs information as a video. The display is, for example, an LCD (liquid crystal display) or an organic EL (electro luminescence) display. The display unit 15 displays and outputs data obtained by the operation of the information processing device 10. The display unit 15 may be connected to the information processing device 10 as an external output device instead of being provided in the information processing device 10. Any connection method may be used, for example, USB, HDMI (registered trademark), or Bluetooth (registered trademark).

[0032] The functions of the information processing device 10 are realized by executing a program according to this embodiment on a processor corresponding to the information processing device 10. That is, the functions of the information processing device 10 are realized by software. The program causes a computer to execute the operations of the information processing device 10, thereby causing the computer to function as the information processing device 10. That is, the computer functions as the information processing device 10 by executing the operations of the information processing device 10 in accordance with the program.

[0033] In this embodiment, the program can be recorded on a computer-readable recording medium. The computer-readable recording medium includes non-transitory computer-readable media, such as a magnetic recording device, an optical disc, a magneto-optical recording medium, or a semiconductor memory. The program can be distributed, for example, by selling, transferring, or lending a portable recording medium, such as a DVD (digital versatile disc) or a CD-ROM (compact disc read only memory), on which the program is recorded. The program can also be distributed by storing the program in the storage of an external server and transmitting the program from the external server to another computer. The program can also be provided as a program product.

[0034] Some or all of the functions of the information processing device 10 may be implemented by a dedicated circuit equivalent to the control unit 11. In other words, some or all of the functions of the information processing device 10 may be implemented by hardware.

[0035] (Operation of information processing device) The operation of the information processing device 10 according to this embodiment will be described with reference to FIG.

[0036] Step S10: The control unit 11 of the information processing device 10 acquires multiple image data captured at different times and calculates the frequency spectrum of each pixel based on the temporal change of each pixel element in each image data. The multiple image data captured at different times are multiple image data captured at a predetermined frame rate and arranged in chronological order. The element of each pixel includes, for example, the luminance of each pixel. In the following embodiment, the explanation will be given assuming that the element of each pixel is the luminance.

[0037] A range of the luminance of each pixel in each image data for which a frequency spectrum is to be calculated (hereinafter also referred to as a target range) may be specified based on an input operation by a user on the input unit 14. For example, any user interface can be used for the input operation. FIG. 4 is a diagram showing an example of such a user interface 100. The user interface 100 includes a base image 110 generated from multiple image data, and objects 141, 142, 143, 151, 152, and 153 superimposed on the base image 110. The object 141 indicates a target range including measurement point A on the pipe 40. The object 142 indicates a target range including measurement point B on the pipe 40. The object 151 indicates a target range including measurement point C on the pipe 50. The object 152 indicates a target range including measurement point D on the pipe 50. These objects 141, 142, 151, and 152 indicate ranges specified based on an input operation by the user on the input unit 14. That is, the user can specify the target range by tapping or the like while checking the user interface 100. With this user interface, the user can set any location of any pipe as the target range.

[0038] The control unit 11 calculates the frequency spectrum of the luminance change of each pixel in each target range of the multiple image data corresponding to a predetermined period. Any method can be used for the frequency spectrum calculation process. For example, the control unit 11 may calculate the frequency spectrum by performing a Fourier transform on the time-series data of the luminance change of each pixel.

[0039] Step S20: The control unit 11 calculates the frequency at a specific pixel that constitutes each pipe in each image data based on the frequency spectrum at the specific pixel. Any method can be used for this calculation process. For example, the control unit 11 may use the maximum peak of the vibration spectrum of each target range as the frequency at the specific pixel. The control unit 11 may also calculate the frequency at the specific pixel from only a predetermined frequency range (e.g., a frequency range below 1000 Hz) of the vibration spectrum of the target range. By doing this, it is possible to remove noise in the high-frequency range, for example.

[0040] Step S30: The control unit 11 calculates the flow rate of each pipe based on the frequency calculated in step S20 and the pipe diameter of each pipe. Any calculation algorithm may be used in this calculation process. For example, the control unit 11 may calculate the flow rate by determining the flow velocity v in the pipe from the Strouhal number St = f × d / v (where d is the pipe diameter [mm], v is the flow velocity in the pipe [mm / s], and St is 0.2) and multiplying this by the cross-sectional area of ​​the flow path. In this case, the control unit 11 calculates the flow rate of each pipe based on the frequency and the pipe diameter of each pipe using the following formula (1):

[0041]

number

[0042] Step S40: The control unit 11 generates an output image including the flow rate information calculated in step S30 and displays the output image on the display unit 15. FIG. 4 is an example of an output image. Objects 143 and 153 include information on the flow rates calculated for the pipes 40 and 50, respectively. In this way, the control unit 11 may generate an output image by superimposing the calculated flow rates of each pipe on the base image 110 generated based on multiple image data, and display the output image on the display unit 15. This allows the user to easily visually grasp the flow rates of each pipe. Note that, for the flow rate displayed and output in FIG. 4, for the pipe 40, the frequency distribution value at measurement point B (the target range shown by object 142) is used. On the other hand, the frequency distribution value at measurement point A (the target range shown by object 141) is used as a reference value for subtracting noise, etc. Similarly, for the flow rate of the pipe 50, the frequency distribution value at measurement point D (the target range shown by object 152) is used. On the other hand, the value of the frequency distribution at measurement point C (the target range shown in object 151) is used as a reference value for subtracting noise, etc.

[0043] As described above, the information processing device 10 according to this embodiment can calculate the flow rate of each pipe based on captured image data including multiple pipes, eliminating the need to install a vibration meter directly on each pipe. Furthermore, even if the pipe being inspected is located at a high altitude, it is possible to safely calculate the flow rate of the fluid in the pipe being inspected. This eliminates the need to install a vibration meter, reducing installation costs and improving safety during inspection work, thereby improving the technology for calculating the flow rate of the fluid in each of multiple pipes being inspected.

[0044] Although the present disclosure has been described based on the drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, the functions included in each component or step can be rearranged so as not to be logically inconsistent, and multiple components or steps can be combined or divided into one.

[0045] For example, as shown in Fig. 4, object 143 and object 153 may also include information on the amount of change since the previous measurement. In other words, control unit 11 may display information on the amount of change in flow rate. Here, when the flow rate calculated previously for each pipe differs from the flow rate calculated this time, control unit 11 may generate the output image by superimposing the amount of change in flow rate on the base image. In this way, the user can visually easily grasp changes in flow rate, abnormalities in flow rate, etc. for each pipe.

[0046] Furthermore, for example, the frequency spectrum of a support member that supports a pipe, a beam of a building, or the like (hereinafter also referred to as a reference portion) may be used to measure the flow rate of the pipe. Specifically, the control unit 11 may calculate the frequency of another specific pixel that constitutes a reference portion different from each pipe in the image data based on the frequency spectrum of the other specific pixel. The control unit 11 may then calculate the flow rate of each pipe based on the differential frequency between the frequency of the specific pixel and the frequency of the other specific pixel, and the pipe diameter of each pipe. In this way, calculation errors due to noise such as building vibration and mechanical vibration can be reduced.

[0047] Figure 5 shows a schematic diagram of a pipe and a reference part captured within the same field of view. The camera 20's field of view in Figure 5 includes the support material 60 and beam 70 as reference parts. Building vibrations can cause noise and affect the flow rate calculation during frequency calculation. As a specific example, Figures 6 to 8 show the frequency spectrum of the pipe, the frequency spectrum of the reference part, and the frequency spectrum of the pipe after noise removal (difference frequency spectrum), respectively. In Figure 6, the frequency responsible for the flow rate calculation is 85 Hz. However, there are also peaks at 230 Hz, 600 Hz, and 900 Hz, which are building or mechanical vibration noises, making it difficult to select the correct frequency for flow rate calculation. Therefore, by capturing a reference part, such as a pipe support material or a building beam, within the camera's field of view and acquiring its vibration frequency, the vibration frequency of the surrounding noise can be obtained. As shown in Figure 8, removing the vibration of the noise source improves the accuracy of the flow rate calculation.

[0048] (Example) FIG. 9 shows the configuration of a piping system 200 according to an embodiment of the present disclosure. The piping system 200 according to this embodiment includes pipes 201, 202, 203, and 204, a compressor 210, a pneumatic device 231 in a building 220, an air cylinder 232, and a nozzle 233. The pipes 201, 202, 203, and 204 shown in FIG. 9 are the targets for which flow rates are to be measured. In this embodiment, the frequency and flow rate were calculated for each measurement point based on multiple image data including the bends of multiple pipes of these targets. Table 1 shows the results of this embodiment. The pipe numbers for pipes 201, 202, 203, and 204 are No. 1, No. 2, No. 3, and No. 4, respectively. For comparison, Table 1 also shows the flow rates obtained using a vortex flowmeter and calculated using a conventional vibrometer.

[0049] [Table 1]

[0050] According to this embodiment, the flow rate could be calculated with high accuracy (with a coincidence rate of 90% or more) in comparison with the flow rate obtained by the vortex flow meter. [Explanation of symbols]

[0051] 1 System 10. Information processing equipment 11 Control section 12 Storage section 13 Image data acquisition unit 14 Input section 15 Display 20 Camera 30 Lighting equipment 40, 50 piping 60 Support Material 70 Beam 100 User Interface 110 Image Data 141, 142, 143, 151, 152, 153 objects 201, 202, 203, 204 Piping 210 Compressor 220 Building 231 Pneumatic equipment 232 Air Cylinder 233 Nozzle

Claims

1. An information processing device having a control unit that calculates a flow rate of a fluid in each of a plurality of pipes to be inspected, The control unit A plurality of image data pieces are acquired, each image data piece being captured at a different time, and a frequency spectrum for each pixel is calculated based on the time variation of the element of each pixel in each image data piece. Calculating a frequency at a specific pixel constituting each pipe in each image data based on a frequency spectrum at the specific pixel; An information processing device that calculates the flow rate of each pipe based on the calculated frequency and the pipe diameter of each pipe.

2. The control unit Calculating a frequency at another specific pixel that constitutes a reference portion different from each pipe in the image data based on a frequency spectrum at the other specific pixel; 2. The information processing apparatus according to claim 1, wherein the flow rate of each pipe is calculated based on a differential frequency between the frequency at the specific pixel and the frequency at the other specific pixel, and the pipe diameter of each pipe.

3. a display unit capable of displaying an output image including information indicating the flow rate of each pipe; The control unit 3. The information processing apparatus according to claim 1, wherein the output image is generated by superimposing the calculated flow rate of each pipe on a base image generated based on the plurality of image data.

4. The control unit 4. The information processing device according to claim 3, wherein when the flow rate calculated previously for each pipe differs from the flow rate calculated this time, the amount of change in flow rate is also superimposed on the base image to generate the output image.

5. The information processing device according to claim 1 , wherein the element of each pixel is luminance.

6. A method for calculating a flow rate of a fluid in each of a plurality of pipes to be inspected, executed by an information processing device, comprising: A plurality of image data are acquired in which a plurality of pipes to be inspected are included in the photographing range and photographed at different times, and a frequency spectrum at each pixel is calculated based on a time change of an element of each pixel in each image data; Calculating a frequency at a specific pixel constituting each pipe in each image data based on a frequency spectrum at the specific pixel; Calculating the flow rate of each pipe based on the calculated frequency and the pipe diameter of each pipe. A method comprising:

7. Calculating a frequency at another specific pixel that constitutes a reference portion different from each pipe in the image data based on a frequency spectrum at the other specific pixel; 7. The method according to claim 6, wherein the flow rate of each pipe is calculated based on a differential frequency between the frequency at the specific pixel and the frequency at the other specific pixel, and the pipe diameter of each pipe.

8. The method according to claim 6 or 7, further comprising generating and displaying an output image in which the calculated flow rate of each pipe is superimposed on a base image generated based on the plurality of image data.

9. The method according to claim 8, characterized in that, when the flow rate calculated previously for each pipe differs from the flow rate calculated this time, the change in flow rate is also superimposed on the base image to generate the output image.

10. The method of claim 6 wherein the component of each pixel is luminance.

Images