Image processing device, image processing method, and program
The image processing apparatus and method enhance image alignment accuracy by generating transformed images through affine transformation and selecting highly correlated data, addressing tilting issues in photography.
Patent Information
- Application Number
- JP2023502073
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-02-25
- Filing Date
- 2021-11-24
- Publication Date
- 2024-11-13
- Estimated Expiration
- 2041-11-24
AI Technical Summary
Existing image correction methods fail to accurately align target image data with master image data due to tilting during photography, leading to deviations in position, size, and shape.
An image processing apparatus and method that generates a transformed image group through affine transformation, calculates correlation values, selects the highest correlated image data, and corrects it based on positional deviation between master and target image data.
Improves the accuracy of image data correction by aligning target images with master images, reducing user burden and costs in meter management.
Smart Images

Figure 0007582440000001 
Figure 0007582440000002 
Figure 0007582440000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing device, an image processing method, and a recording medium, and more particularly to an image processing device, an image processing method, and a recording medium for correcting image data acquired from an imaging device. [Background technology]
[0002] There is a known technique for correcting target image data using preregistered reference image data (called master image data). One example of this technique is described in Patent Document 1.
[0003] In the related technology described in Patent Document 1, a two-dimensional barcode added to an analog meter is detected from image data obtained by photographing the analog meter. Then, the target image data is subjected to a primary correction so that the two-dimensional barcode in the target image data has the same size and shape as the two-dimensional barcode in the master image data.
[0004] Furthermore, in the related technology described in Patent Document 1, several areas including a specific pattern (e.g., letters or numbers) drawn on the face of an analog meter are cut out from the primarily corrected image data. Next, a phase-only correlation method is used to calculate the positional shift of the areas cut out from the primarily corrected image data relative to the corresponding areas of the master image data. After that, the image data is secondarily corrected based on the calculated positional shift. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] International Publication No. WO2020 / 175566 [Patent Document 2] JP 2020-166587 A Summary of the Invention [Problem to be solved by the invention]
[0006] Assume that master image data obtained by photographing an object such as an analog meter from the front is registered in advance. When a user holds an imaging device in his / her hand and photographs the same object, the photographing direction may be inclined with respect to the front of the object. In this case, a deviation in the position, size, and shape of the object occurs between the object depicted in the image data of the object and the object depicted in the preregistered master image data. As a result, there is a possibility that the image data of the object cannot be accurately corrected based on the master image data.
[0007] The present invention has been made in consideration of the above problems, and has an object to improve the accuracy of correcting target image data using master image data. [Means for solving the problem]
[0008] An image processing device according to one aspect of the present invention includes a generation means for generating a group of transformed images including multiple transformed image data by affine transforming target image data, a calculation means for calculating a correlation value between the transformed image data included in the group of transformed images and pre-registered master image data, a selection means for selecting, from the transformed image data included in the group of transformed images, the transformed image data having the maximum correlation value, and a correction means for correcting the selected transformed image data based on a positional shift between an object appearing in the master image data and an object appearing in the selected transformed image data.
[0009] In an image processing method according to one aspect of the present invention, a group of transformed images including multiple transformed image data is generated by affine transforming target image data, a correlation value between the transformed image data included in the group of transformed images and pre-registered master image data is calculated, the transformed image data having the maximum correlation value is selected from the transformed image data included in the group of transformed images, and the selected transformed image data is corrected based on the positional shift between an object depicted in the master image data and an object depicted in the selected transformed image data.
[0010] A recording medium according to one aspect of the present invention stores a program for causing a computer to execute the following processes: generating a group of transformed images including multiple transformed image data by affine transforming target image data; calculating a correlation value between the transformed image data included in the group of transformed images and pre-registered master image data; selecting, from the transformed image data included in the group of transformed images, the transformed image data having the maximum correlation value; and correcting the selected transformed image data based on a positional shift between an object appearing in the master image data and an object appearing in the selected transformed image data. Effect of the Invention
[0011] According to one aspect of the present invention, the accuracy of correcting target image data using master image data can be improved. [Brief description of the drawings]
[0012] [Figure 1] 1 is a diagram illustrating the capturing of an object (an analog meter) by an imaging device and the transmission of image data from the imaging device to an image processing device according to any one of the first to third embodiments. [Diagram 2] 1 is a block diagram showing a configuration of an image processing apparatus according to a first embodiment. [Diagram 3] 4 is a flowchart showing the operation of the image processing device according to the first embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of the flow of operations of the image processing device according to the first embodiment. [Diagram 5] FIG. 11 is a block diagram showing the configuration of an image processing device according to a second embodiment. [Figure 6] 10 is a flowchart showing the operation of an image processing device according to a second embodiment. [Figure 7] FIG. 11 is a block diagram showing the configuration of an image processing device according to a third embodiment. [Figure 8] 11 is a flowchart showing the operation of an image processing device according to a third embodiment. [Figure 9]FIG. 1 is a diagram illustrating an example of a hardware configuration of an image processing device according to first to third embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] (Common to all embodiments) FIG. 1 shows a state where a user holds an imaging device and captures an image of a target object (an analog meter is shown as an example in FIG. 1). In FIG. 1, image data of the target captured by the imaging device is transmitted from the imaging device to any one of image processing devices 10, 20, 30 according to any one of the first to third embodiments. In the following, "any one of image processing devices 10, 20, 30" is expressed as "image processing device 10 (20, 30)". The image data transmitted from the imaging device to the image processing device 10 (20, 30) is referred to as "image data of the target" in the following. The image data of the target is obtained by capturing an image of the object (an analog meter in FIG. 1).
[0014] 1, the imaging device is an information device carried by a user. For example, the imaging device is a smartphone or a tablet terminal. The imaging device is connected to an image processing device 10 (20, 30) by wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).
[0015] An application for remotely controlling the image processing device 10 (20, 30) is installed in the imaging device. A user inputs an instruction to the image processing device 10 (20, 30) into a UI (User Interface) of the application, and an instruction command is transmitted from the imaging device to the image processing device 10 (20, 30). This allows the user to remotely control the image processing device 10 (20, 30) using the imaging device.
[0016] In one modified example, the imaging device and the image processing device 10 (20, 30) may be integrated together. In other words, the process executed by the image processing device 10 (20, 30) described later may be realized as a part of the information processing function of the imaging device.
[0017] An object (an analog meter in FIG. 1) is photographed by an imaging device. The type of object is not particularly limited, but examples other than an analog meter include posters, calendars, or the spine of a book, on which characters or symbols are arranged. Other examples include monitors and windows, which provide a view into the scenery. However, the type of object is not limited to the above examples.
[0018] [Embodiment 1] The first embodiment will be described with reference to FIGS.
[0019] (Image processing device 10) 2 is a block diagram showing the configuration of the image processing device 10 according to the present embodiment 1. As shown in FIG. 2, the image processing device 10 includes a generation unit 11, a calculation unit 12, a selection unit 13, and a correction unit 14.
[0020] The generating unit 11 generates a transformed image group including a plurality of transformed image data by performing affine transformation on the target image data. The generating unit 11 is an example of a generating means.
[0021] In one example, the generating unit 11 acquires image data of a target from an imaging device (FIG. 1). The image data of the target is obtained by photographing an object (an analog meter in FIG. 1), i.e., an analog meter is captured in the image data. The generating unit 11 performs a single affine transformation on the target image data, thereby converting the coordinates of the target image data into the coordinates of the conversion destination data by performing a 3×3 matrix operation on the coordinates of the target image data, and obtains a single piece of converted image data. The affine transformation is a combination of a linear transformation (i.e., a matrix operation) and a parallel translation.
[0022] Alternatively, the generating unit 11 may obtain a plurality of pieces of image data from the target image data. In this case, the generating unit 11 generates a plurality of pieces of transformed image data by performing mutually different affine transformations on the obtained target image data.
[0023] Specifically, the generating unit 11 generates a predetermined number of transformed image data from the target image data by a mapping (different affine transformations) that combines image enlargement, reduction, rotation, and translation. The generating unit 11 outputs a transformed image group including the multiple transformed image data thus generated to the calculating unit 12.
[0024] The calculation unit 12 calculates a correlation value between the converted image data included in the converted image group and the master image data registered in advance. The calculation unit 12 is an example of a calculation means.
[0025] In one example, the calculation unit 12 calculates a correlation value between the converted image data and the master image data using a phase-only correlation method. In another example, the calculation unit 12 calculates a correlation coefficient (an example of a correlation value) between pixel values of the converted image data and pixel values of the master image data using any method with hue, luminance value, and / or pattern as parameters. Specifically, the calculation unit 12 can use SAD (Sum of Absolute Difference), SSD (Sum of Squared Difference), or NCC (Normalized Cross-Correlation).
[0026] The calculation unit 12 calculates the correlation value between each converted image data included in the converted image group and the preregistered master image data as described above. After calculating the correlation value for all converted image data included in the converted image group, the calculation unit 12 outputs the correlation value data linked to the corresponding converted image data to the selection unit 13.
[0027] The selection unit 13 selects the converted image data having the maximum correlation value from the converted image data included in the converted image group. The selection unit 13 is an example of a selection means.
[0028] In one example, the selection unit 13 receives data of correlation values calculated for all converted image data included in the converted image group from the calculation unit 12. The selection unit 13 selects one converted image data from among all converted image data included in the converted image group based on the magnitude relationship between the correlation values.
[0029] Specifically, the selection unit 13 selects the converted image data having the largest correlation value with the master image data from among all the converted image data included in the converted image group. The selection unit 13 outputs the selected converted image data to the correction unit 14.
[0030] The correction unit 14 corrects the selected converted image data based on the positional deviation between the object (an analog meter in FIG. 1) shown in the master image data and the object shown in the selected converted image data. The correction unit 14 is an example of a correction means.
[0031] In one example, the correction unit 14 receives the selected transformed image data from the selection unit 13. The correction unit 14 calculates a projective transformation (geometric transformation) matrix between the selected transformed image data and the master image data. Then, the correction unit 14 uses the projective transformation matrix to transform the coordinate system of the selected transformed image data into the coordinate system of the master image data.
[0032] By a calculation using a projective transformation matrix, the selected transformed image data is corrected so that the shape and size of the meter depicted in the selected transformed image data become similar to those of the meter included in the master image data.
[0033] (Operation of image processing device 10) The operation of the image processing device 10 according to the first embodiment will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a flowchart showing the flow of processes executed by each unit of the image processing device 10. Fig. 4 is a diagram for explaining an example of the operation of the image processing device 10.
[0034] As shown in Fig. 4, first, the generating unit 11 of the image processing device 10 acquires image data of a target obtained by photographing an object (an analog meter as an example). A pointer, numbers, and a two-dimensional barcode are arranged on the front (face) of the analog meter. The correction of the image data of this analog meter will be described below.
[0035] As shown in FIG. 3, first, the generating unit 11 generates a converted image group including a plurality of converted image data by performing affine transformation on the image data of the analog meter (S1). In FIG. 4, a converted image group including three converted image data is shown as an example. In one example, the generating unit 11 obtains these three converted image data by performing different affine transformations on specific pattern areas in the image data of the analog meter. The generating unit 11 may detect the pattern area in the converted image data by using a method such as a sliding window method. As shown in FIG. 4, the pattern area may be an area including a specific character or a specific number.
[0036] Next, the calculation unit 12 calculates a correlation value between the converted image data included in the converted image group and the master image data registered in advance (S2).
[0037] Next, the selection unit 13 selects the converted image data having the maximum correlation value from among the converted image data included in the converted image group (S3).
[0038] Thereafter, the correction unit 14 corrects the selected converted image data based on the positional deviation between the object depicted in the master image data and the object depicted in the selected converted image data (S4).
[0039] This is the end of the operation of the image processing device 10 according to the first embodiment.
[0040] (Modification) In one variation, after step S4, the corrected converted image data may be transmitted from the image processing device 10 to a pointer reading device (not shown). The pointer reading device reads the value indicated by the pointer of the analog meter (FIG. 4) from the corrected converted image data by known image recognition technology. In another variation, the image processing device 10 further includes a pointer reading unit. In this case, the pointer reading unit of the image processing device 10 reads the value indicated by the pointer of the analog meter from the corrected converted image data (embodiment 2).
[0041] (Effects of this embodiment) According to the configuration of this embodiment, the generating unit 11 generates a transformed image group including a plurality of transformed image data by performing affine transformation on the target image data. The calculating unit 12 calculates a correlation value between the transformed image data included in the transformed image group and the master image data registered in advance. The selecting unit 13 selects the transformed image data having the maximum correlation value from the transformed image data included in the transformed image group. The correcting unit 14 corrects the selected transformed image data based on the positional deviation between the object shown in the master image data and the object shown in the selected transformed image data.
[0042] In this way, one converted image data is selected from the group of converted images generated from the target image data based on the magnitude of correlation with the master image data. The converted image data having the largest correlation value with the master image data is closest to the master image data in terms of the angle of the imaging device relative to the meter and the distance from the imaging device to the meter. By selecting the converted image data having a high correlation value with the master image data, the accuracy of correcting the target image data using the master image data can be improved.
[0043] [Embodiment 2] A second embodiment will be described with reference to Figures 5 and 6. In the second embodiment, the same members as those in the first embodiment are denoted by the same reference numerals as those in the first embodiment, and the description thereof will be omitted.
[0044] (Image processing device 20) Fig. 5 is a block diagram showing the configuration of an image processing device 20 according to the present embodiment 2. As shown in Fig. 5, the image processing device 20 includes a generation unit 11, a calculation unit 12, a selection unit 13, and a correction unit 14. The image processing device 20 further includes a reading unit 25.
[0045] The reading unit 25 reads the numerical value indicated by the needle of the meter from the corrected converted image data. The reading unit 25 is an example of a reading means.
[0046] In one example, the reading unit 25 receives the corrected converted image data from the correction unit 14. The reading unit 25 may read the numerical value indicated by the needle of the meter from the corrected converted image data by OCR (Optical character recognition), or may use an estimator that performs machine learning. Alternatively, the reading unit 25 may use the image recognition technology described in Patent Document 2.
[0047] The reading unit 25 may transmit information indicating the value indicated by the meter needle to a downstream processing unit (not shown) or an external device (not shown). For example, the reading unit 25 displays the value indicated by the meter needle on the screen of an imaging device (FIG. 1). Alternatively, the reading unit 25 may record the information indicating the value indicated by the meter needle in an external storage device.
[0048] (Operation of image processing device 20) The operation of the image processing device 20 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of processes executed by each unit of the image processing device 20. Fig. 6 is a diagram for explaining an example of the operation of the image processing device 20.
[0049] 6, first, the generating unit 11 performs affine transformation on the image data of the analog meter to generate a transformed image group including a plurality of transformed image data (S201). At this time, the generating unit 11 may calculate a correlation value between a specific pattern area (FIG. 4) in the transformed image data and a corresponding pattern area in the master image data, for example, by using a phase-only correlation method.
[0050] Next, the calculation unit 12 calculates a correlation value between the converted image data included in the converted image group and the preregistered master image data (S202).
[0051] Next, the selection unit 13 selects the converted image data having the maximum correlation value from among the converted image data included in the converted image group (S203).
[0052] Thereafter, the correction unit 14 corrects the selected converted image data based on the positional deviation between the object depicted in the master image data and the object depicted in the selected converted image data (S204).
[0053] The value indicated by the meter needle is read from the corrected converted image data (S205).
[0054] This is the end of the operation of the image processing device 20 according to the second embodiment.
[0055] (Effects of this embodiment) According to the configuration of this embodiment, the generating unit 11 generates a transformed image group including a plurality of transformed image data by performing affine transformation on the target image data. The calculating unit 12 calculates a correlation value between the transformed image data included in the transformed image group and the master image data registered in advance. The selecting unit 13 selects the transformed image data having the maximum correlation value from the transformed image data included in the transformed image group. The correcting unit 14 corrects the selected transformed image data based on the positional deviation between the object shown in the master image data and the object shown in the selected transformed image data.
[0056] In this way, one converted image data is selected from the group of converted images generated from the target image data based on the magnitude of correlation with the master image data. The converted image data having the largest correlation value with the master image data is closest to the master image data in terms of the angle of the imaging device relative to the meter and the distance from the imaging device to the meter. By selecting the converted image data having a high correlation value with the master image data, the accuracy of correcting the target image data using the master image data can be improved.
[0057] Furthermore, according to the configuration of this embodiment, the reading unit 25 reads the value indicated by the needle of the meter from the corrected converted image data. This reduces the workload of the user in managing the meter and reduces the operating costs.
[0058] [Embodiment 3] A third embodiment will be described with reference to Figures 7 and 8. In the third embodiment, the same members as those in the first or second embodiment are denoted by the same reference numerals as those in the first or second embodiment, and the description thereof will be omitted.
[0059] (Image processing device 30) Fig. 7 is a block diagram showing the configuration of an image processing device 30 according to the present embodiment 3. As shown in Fig. 7, the image processing device 30 includes a generation unit 11, a calculation unit 12, a selection unit 13, and a correction unit 14. The image processing device 30 further includes a reading unit 25, a detection unit 36, and a pre-correction unit 37.
[0060] The detection unit 36 detects a two-dimensional barcode (FIG. 4) from the target image data. The detection unit 36 is an example of a detection means.
[0061] In one example, the detector 36 receives image data of a target from an imaging device (FIG. 1). The detector 36 detects a two-dimensional barcode from the target image data using an image analysis technique such as pattern detection. The detector 36 outputs to the pre-correction unit 37 the target image data and information indicating the area of the two-dimensional barcode detected from the target image data.
[0062] The information indicating the area of the two-dimensional barcode is the position coordinates of the area occupied by the two-dimensional barcode in the target image data.
[0063] The pre-correction unit 37 pre-corrects the target image data by affine transformation or homography transformation based on the two-dimensional shape of the two-dimensional barcode. The pre-correction unit 37 is an example of a pre-correction means.
[0064] In one example, the pre-correction unit 37 receives information indicating a region of a two-dimensional barcode detected from the target image data from the detection unit 36. The pre-correction unit 37 corrects the target image data using the information indicating the region of the two-dimensional barcode.
[0065] Specifically, the pre-correction unit 37 performs projective transformation on the target image data so that the position coordinates of the two-dimensional barcode in the master image data correspond to the position coordinates of the two-dimensional barcode in the target image data. The pre-correction unit 37 outputs the target image data corrected in this manner to the generation unit 11.
[0066] In the third embodiment, the generating unit 11 performs affine transformation on the target image data corrected by the pre-correction unit 37, thereby generating a transformed image group including a plurality of transformed image data.
[0067] (Operation of image processing device 30) The operation of the image processing device 30 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of processes executed by each unit of the image processing device 30. Fig. 7 is a diagram for explaining an example of the operation of the image processing device 30.
[0068] As shown in FIG. 7, the detection unit 36 detects a two-dimensional barcode from the target image data (S301).
[0069] The pre-correction unit 37 pre-corrects the target image data by affine transformation or homography transformation based on the two-dimensional shape of the two-dimensional barcode (S302).
[0070] The generating unit 11 generates a transformed image group including a plurality of transformed image data by performing affine transformation on the image data of the analog meter (S303). At this time, the generating unit 11 may calculate a correlation value between a specific pattern area (FIG. 4) in the transformed image data and a corresponding pattern area in the master image data by using, for example, a phase-only correlation method.
[0071] Next, the calculation unit 12 calculates a correlation value between the converted image data included in the converted image group and the master image data registered in advance (S304).
[0072] Next, the selection unit 13 selects the converted image data having the maximum correlation value from among the converted image data included in the converted image group (S305).
[0073] Thereafter, the correction unit 14 corrects the selected converted image data based on the positional deviation between the object depicted in the master image data and the object depicted in the selected converted image data (S306).
[0074] The value indicated by the meter needle is read from the corrected converted image data (S307).
[0075] This is the end of the operation of the image processing device 30 according to the third embodiment.
[0076] (Effects of this embodiment) According to the configuration of this embodiment, the generating unit 11 generates a transformed image group including a plurality of transformed image data by performing affine transformation on the target image data. The calculating unit 12 calculates a correlation value between the transformed image data included in the transformed image group and the master image data registered in advance. The selecting unit 13 selects the transformed image data having the maximum correlation value from the transformed image data included in the transformed image group. The correcting unit 14 corrects the selected transformed image data based on the positional deviation between the object shown in the master image data and the object shown in the selected transformed image data.
[0077] In this way, one converted image data is selected from the group of converted images generated from the target image data based on the magnitude of correlation with the master image data. The converted image data having the largest correlation value with the master image data is closest to the master image data in terms of the angle of the imaging device relative to the meter and the distance from the imaging device to the meter. By selecting the converted image data having a high correlation value with the master image data, the accuracy of correcting the target image data using the master image data can be improved.
[0078] Furthermore, according to the configuration of this embodiment, the reading unit 25 reads the value indicated by the needle of the meter from the corrected converted image data. This reduces the workload of the user in managing the meter and reduces the operating costs.
[0079] Furthermore, according to the configuration of this embodiment, the detection unit 36 detects a two-dimensional barcode from the target image data. The pre-correction unit 37 pre-corrects the target image data by affine transformation or homography transformation based on the two-dimensional shape of the two-dimensional barcode. This makes the shape and size of the target in the pre-corrected target image data closer to the shape and size of the target in the master image data. Therefore, the target image data can be corrected more accurately than when it is not pre-corrected.
[0080] (Hardware configuration) Each of the components of the image processing devices 10, 20, and 30 described in the first to third embodiments is represented by a functional block. Some or all of these components are realized by an information processing device 900 as shown in Fig. 9. Fig. 9 is a block diagram showing an example of the hardware configuration of the information processing device 900.
[0081] As shown in FIG. 9, an information processing device 900 includes, for example, the following configuration.
[0082] ·CPU(Central Processing Unit)901 ROM (Read Only Memory) 902 ·RAM(Random Access Memory)903 Program 904 loaded into RAM 903 A storage device 905 for storing a program 904 A drive device 907 for reading and writing data from the recording medium 906 A communication interface 908 for connecting to a communication network 909 An input / output interface 910 for inputting and outputting data Bus 911 connecting each component Each of the components of the image processing apparatuses 10, 20, and 30 described in the first to third embodiments is realized by the CPU 901 reading and executing a program 904 that realizes these functions. The program 904 that realizes the functions of each component is, for example, stored in advance in the storage device 905 or the ROM 902, and is loaded into the RAM 903 by the CPU 901 and executed as necessary. The program 904 may be supplied to the CPU 901 via the communication network 909, or may be stored in advance in the recording medium 906, and the drive device 907 may read out the program and supply it to the CPU 901.
[0083] According to the above configuration, the image processing devices 10, 20, and 30 described in the first to third embodiments are realized as hardware, and therefore it is possible to achieve the same effects as those described in the above embodiments.
[0084] [Additional Notes] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.
[0085] (Appendix 1) A generating means for generating a transformed image group including a plurality of transformed image data by performing an affine transformation on the target image data; a calculation means for calculating a correlation value between the converted image data included in the converted image group and a preregistered master image data; a selection means for selecting, from the converted image data included in the converted image group, the converted image data having the maximum correlation value; a correction means for correcting the selected converted image data based on a positional deviation between an object depicted in the master image data and an object depicted in the selected converted image data; An image processing device comprising:
[0086] (Appendix 2) The generating means generates a predetermined number of converted image data from a specific pattern area in the image data by a mapping that combines enlargement, reduction, rotation, and translation. 2. The image processing device according to claim 1 .
[0087] (Appendix 3) The generating means calculates the correlation value between pixel values of a specific pattern area in the converted image data and pixel values of a corresponding pattern area in the master image data. 3. The image processing device according to claim 1 or 2.
[0088] (Appendix 4) The pattern area is an area containing specific letters or specific numbers. 4. The image processing device according to claim 2 or 3.
[0089] (Appendix 5) The correction means performs projective transformation on the selected transformed image data so that position coordinates of the object in the master image data correspond to position coordinates of the object in the selected transformed image data. 5. The image processing device according to claim 1,
[0090] (Appendix 6) The apparatus further includes a reading means for reading a numerical value indicated by a pointer provided on the object from the corrected converted image data. 6. The image processing device according to claim 1,
[0091] (Appendix 7) The generating means repeats generating a predetermined number of converted image data from the image data until a correlation value between at least one converted image data included in the converted image group and preregistered master image data exceeds a threshold value. 7. The image processing device according to claim 6,
[0092] (Appendix 8) a detector for detecting a two-dimensional barcode from the image data of the object; and a pre-correction unit for pre-correcting the image data of the object by the affine transformation or homography transformation based on the two-dimensional shape of the two-dimensional barcode. 8. The image processing device according to claim 1,
[0093] (Appendix 9) generating a transformed image group including a plurality of transformed image data by performing an affine transformation on the target image data; Calculating a correlation value between an object appearing in the converted image data included in the converted image group and an object appearing in a preregistered master image data; Selecting the converted image data having the maximum correlation value from the converted image data included in the converted image group; The selected converted image data is corrected based on a positional deviation between an object depicted in the master image data and an object depicted in the selected converted image data. Image processing methods.
[0094] (Appendix 10) A process of generating a transformed image group including a plurality of transformed image data by performing an affine transformation on the target image data; A process of calculating a correlation value between the converted image data included in the converted image group and preregistered master image data; A process of selecting, from the converted image data included in the converted image group, the converted image data having the maximum correlation value; correcting the selected converted image data based on a positional deviation between an object depicted in the master image data and an object depicted in the selected converted image data; A program for causing a computer to execute the following.
[0095] (Appendix 11) The generating means repeats generating a predetermined number of converted image data from the image data until the numerical value indicated by the pointer of the object is successfully read from the corrected converted image data. 7. The image processing device according to claim 1,
[0096] (Appendix 12) The generating means generates the transformed image group including the plurality of transformed image data by performing affine transformation on the pre-corrected image data. 9. The image processing device according to claim 8,
[0097] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-mentioned embodiments (and examples). Various modifications that can be understood by a person skilled in the art can be made to the configurations and details of the above-mentioned embodiments (and examples) within the scope of the present invention.
[0098] This application claims priority to Japanese Patent Application No. 2021-028035, filed on February 25, 2021, the disclosure of which is incorporated herein in its entirety. [Industrial Applicability]
[0099] The present invention can be used, for example, in an image processing device that reads the numerical value indicated by the needle of an analog meter from image data obtained by photographing the meter. [Explanation of symbols]
[0100] 10 Image processing device 11 Generation part 12 Calculation section 13 Selection section 14 Correction section 20 Image processing device 25 Reading unit 30 Image processing device 36 Detection unit 37 Pre-correction section
Claims
1. A generating means for generating a transformed image group including a plurality of transformed image data by performing an affine transformation on the target image data; a calculation means for calculating a correlation value between the converted image data included in the converted image group and a preregistered master image data; a selection means for selecting, from the converted image data included in the converted image group, the converted image data having the maximum correlation value; a correction means for correcting the selected converted image data based on a positional deviation between an object depicted in the master image data and an object depicted in the selected converted image data; An image processing device comprising:
2. The generating means generates a predetermined number of converted image data from a specific pattern area in the image data by a mapping that combines enlargement, reduction, rotation, and translation.
2. The image processing device according to claim 1,
3. The generating means calculates the correlation value between pixel values of a specific pattern area in the converted image data and pixel values of a corresponding pattern area in the master image data.
3. The image processing device according to claim 1, wherein the first and second inputs are input to the image processing device.
4. The pattern area is an area containing specific letters or specific numbers.
4. The image processing device according to claim 2, wherein the first and second inputs are input to the image processing apparatus.
5. The correction means performs projective transformation on the selected transformed image data so that position coordinates of the object in the master image data correspond to position coordinates of the object in the selected transformed image data.
5. The image processing device according to claim 1,
6. The apparatus further includes a reading means for reading a numerical value indicated by the pointer of the object from the corrected converted image data.
6. The image processing device according to claim 1,
7. The generating means repeats generating a predetermined number of converted image data from the image data until a correlation value between at least one converted image data included in the converted image group and preregistered master image data exceeds a threshold value.
7. The image processing device according to claim 6,
8. a detector for detecting a two-dimensional barcode from the image data of the object; and a pre-correction unit for pre-correcting the image data of the object based on the two-dimensional shape of the two-dimensional barcode before performing the affine transformation.
8. The image processing device according to claim 1,
9. The generating means repeats generating a predetermined number of converted image data from the image data until the numerical value indicated by the pointer of the object is successfully read from the corrected converted image data.
7. The image processing device according to claim 1,
10. The generating means generates the transformed image group including the plurality of transformed image data by performing affine transformation on the pre-corrected image data.
9. The image processing device according to claim 8,
11. generating a transformed image group including a plurality of transformed image data by performing an affine transformation on the target image data; Calculating a correlation value between the converted image data included in the converted image group and preregistered master image data; Selecting the converted image data having the maximum correlation value from the converted image data included in the converted image group; The selected converted image data is corrected based on a positional deviation between an object depicted in the master image data and an object depicted in the selected converted image data. Image processing methods.
12. A process of generating a transformed image group including a plurality of transformed image data by performing an affine transformation on the target image data; A process of calculating a correlation value between the converted image data included in the converted image group and preregistered master image data; A process of selecting, from the converted image data included in the converted image group, the converted image data having the maximum correlation value; correcting the selected converted image data based on a positional deviation between an object depicted in the master image data and an object depicted in the selected converted image data; A program for causing a computer to execute the following.
Citation Information
Patent Citations
System for forming numeral data based on image information in measuring instrument display
JP2003065812A
Meter reading operation device and method, and meter reading operation system
JP2020166587A
Image processing device, image processing method, and recording medium
WO2020175566A1
