Supercharge Your Innovation With Domain-Expert AI Agents!

Method and system for identifying reading of pointer instrument in inspection scene

A technology of meter reading and digital recognition, applied in the field of intelligent robots, can solve problems such as difficult requirements, difficult to effectively identify, and poor practical application, and achieve the effect of ensuring the success rate and accuracy

Pending Publication Date: 2022-03-29
上海蒙帕智能科技股份有限公司 +1
View PDF2 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The patent text (CN111598109A) provides an intelligent recognition method for substation pointer instrument readings, which uses traditional image processing techniques (including image correction, grayscale, edge detection, circle transformation detection dial, Hough line detection and detection pointer) to obtain instrument representation number; the patent text (CN111931776 A) provides a two-pointer meter reading method based on deep learning, uses the deep learning method to locate the meter, then performs Hough circle detection on the meter image, and simultaneously performs ellipse connected domain screening, and combines the two methods to obtain The circular dial of the instrument, the method is limited by the Hough circle detection method is not suitable for the target imaging rotation and flip scene, the actual application is not good
[0004] To sum up, the existing methods for automatic recognition of pointer instrument indications have certain defects. In the actual machine room inspection application, it is easy to recognize the target image due to different lighting, angles, and postures, and it is difficult to recognize when the target image is partially occluded or the image is blurred. It is almost difficult to effectively identify under conditions such as image tilt and image tilt, so it is difficult to meet the requirements of practical applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for identifying reading of pointer instrument in inspection scene
  • Method and system for identifying reading of pointer instrument in inspection scene
  • Method and system for identifying reading of pointer instrument in inspection scene

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0063] Such as figure 1 As shown, the embodiment of the present invention provides a method for identifying pointer instrument readings in an inspection scene, including the following steps:

[0064] Step S101, acquiring the pointer instrument image;

[0065] Step S103, locating pointers and meters in the pointer meter image based on the positioning detection model, and locating the scale indication of the meter in the image;

[0066] Step S105, based on the above positioning data, use the OCR direction detection model to fit the dial image in the pointer instrument image; wherein, the position detection model and the OCR direction detection model are trained by using N sample images with target instruments collected in history;

[0067] Step S107, correcting the dial image based on plane rotation and space flipping to obtain the corrected dial image; specifically, it may include:

[0068] Obtain the horizontal rotation direction of the scale indication based on the OCR dire...

Embodiment 2

[0086] On the basis of the foregoing embodiments, this embodiment may also include the following:

[0087] The OCR direction detection model of the embodiment of the present invention is a classification model composed of a Mobilnet network. There are two types of methods in OCR recognition: one is an end-to-end learning method, and the other is a non-end-to-end method. End-to-end refers to using a network (model) to input pictures and output text recognition results. The non-end-to-end network is composed of multiple networks (models) or parts, specifically: text detection model (ie OCR detection model, output text position result), text direction detection model (ie OCR direction detection model, output text angle result), text recognition model (that is, OCR recognition model, output final text result).

[0088] The OCR direction detection model in the embodiment of the present invention refers to the text direction detection model in the above-mentioned non-end-to-end me...

Embodiment 3

[0093] On the basis of the foregoing embodiments, this embodiment may also include the following:

[0094] In order to facilitate the understanding of the technical solution of this embodiment, this implementation provides a method for identifying pointer instrument readings in an inspection scene in combination with actual application scenarios, so as to describe in detail, as follows figure 2 As shown, the method may include the following steps:

[0095] Step (1) image acquisition, this step is to collect N sample images with target instruments at the inspection site, obtain image data sets after labeling, and divide training sets and test sets for subsequent positioning detection models and OCR models (including OCR direction detection model and OCR recognition model) training, and algorithm testing.

[0096] Step (2) instrument detection, this step includes the detection of the surface of the instrument panel, the detection of the scale indication of the instrument and t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pointer instrument reading identification method and system in an inspection scene. The method comprises the following steps: acquiring a pointer instrument image; positioning a pointer and an instrument in the pointer instrument image based on the positioning detection model, and positioning scale readings of the instrument in the image; based on the positioned data, fitting a dial plate image in the pointer instrument image by adopting an OCR direction detection model; performing correction operation on the dial plate image based on plane rotation and space overturning to obtain a corrected dial plate image; carrying out pointer straight line fitting and scale reading number identification based on the corrected dial plate image, wherein an OCR identification model is adopted in the number identification; on the basis of instrument prior information, a digital recognition result is calibrated; and obtaining the instrument reading based on the calibration result and the pointer straight line fitting result. The instrument can be accurately positioned and corrected, and the success rate and accuracy of final reading of the pointer instrument are guaranteed.

Description

technical field [0001] The invention belongs to the field of intelligent robots, and in particular relates to a method and system for recognizing pointer instrument readings in a patrol inspection scene. Background technique [0002] As important indicating instruments and instruments, pointer instruments are widely used in industrial fields, such as pressure gauges, voltmeters, ammeters, thermometers, etc. These instruments are used in industrial sites to measure and indicate on-site environmental parameters, production index parameters, and equipment operating parameters. The reading and recording of the values ​​of these meters, ie meter reading, is an essential part of the production process. In the traditional industrial production site, the value reading of the instrument is transcribed by workers going to the site, which requires a lot of manpower to complete this task. Moreover, in some complex environments and dangerous production situations, it is more difficult ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06V20/62G06V10/25G06V10/26G06V10/764G06V10/82G06K9/62G06N3/08
CPCG06N3/08G06F18/24
Inventor 李斌山周龙飞韩丹雒厂辉
Owner 上海蒙帕智能科技股份有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More