Information processing device, reading system, reading method, and reading program

Abstract

This information processing device (100) comprises: an acquisition unit (120) that acquires images indicating a plurality of numbers of a meter (300); an identification unit (140) that identifies an image of each digit on the basis of the images; an estimation unit (150) that estimates a value indicated by the image of each digit on the basis of the image of each digit; a determination unit (160); and an output unit (170) that outputs the value of the meter (300). The determination unit (160): subtracts, for each of the second or higher digits, the value at the first decimal place from the value of a target digit when all digits below the target digit are 9 or greater; rounds off the value obtained by subtraction; calculates a remainder by dividing the value obtained by rounding off by 10; determines the value of the target digit as the calculated value; rounds off the value of the target digit when all digits below the target digit are not 9 or greater; calculates a remainder by dividing the value obtained by rounding off by 10; determines the value of the target digit as the calculated value; and determines the value of the meter (300) by combining the values of the respective digits.

Description

Information processing device, reading system, reading method, and reading program

[0001] The present disclosure relates to an information processing device, a reading system, a reading method, and a reading program.

[0002] Meters that display multiple numbers are known. The multiple numbers are also called indicated values, meter values, or pointer values. A technique for reading the multiple numbers has been proposed (see Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2003-242444

[0004] The above technology may encounter problems. The problem will be explained using diagrams. FIG. 16 is a diagram illustrating an example of the prior art. FIG. 16 shows multiple numbers. Digits are defined starting from the right digit. For example, the rightmost digit is the first digit. For example, suppose that template matching is performed on images of each digit, and the numbers are obtained starting from the left digit, as follows: "9.9, 0.9, 2.0, 0.0, 9.9." Patent Document 1 describes that if the calculated value of the next lower digit is between 9.1 and 9.9, the "correction value = {calculated value of the corresponding digit - decimal value of the least significant digit (0.1 to 0.9)}" is corrected to an integer value rounded to the nearest integer. For example, suppose the calculation of the second digit is attempted. The correction value for the second digit is -0.9 (= 0.0 - 0.9). Then, "-0.9" is rounded to "-1." Therefore, the second digit becomes "-1." As described above, the technique of Patent Document 1 may calculate undesirable figures.

[0005] The purpose of this disclosure is to improve reading accuracy.

[0006] According to one aspect of the present disclosure, there is provided an information processing device. The information processing device includes an acquisition unit that acquires an image obtained by capturing only a plurality of digits on a meter, an identification unit that identifies an image of each digit based on the image, an estimation unit that estimates a value indicated by the image of each digit based on the image of each digit, a determination unit that determines a value of the meter based on the value indicated by the image of each digit, and an output unit that outputs the value of the meter. For each of the digits from the second digit onward, if all digits lower than a target digit are 9 or greater, the determination unit subtracts the value of the target digit by the value of the first digit to one decimal place, rounds the value obtained by the subtraction, calculates a remainder when the rounded value is divided by 10, and determines the value of the target digit to be the calculated value. If all digits lower than the target digit are not 9 or greater, the determination unit rounds the value of the target digit by the value of the first digit to one decimal place, calculates a remainder when the rounded value is divided by 10, and determines the value of the target digit to be the calculated value. The information processing device includes: an acquisition unit that acquires an image obtained by capturing only a plurality of digits on a meter, an identification unit that identifies an image of each digit based on the image, an estimation unit that estimates a value indicated by the image of each digit based on the image of each digit, a determination unit that determines a value of the meter based on the value indicated by the image of each digit, and an output unit that outputs the value of the meter.

[0007] According to the present disclosure, reading accuracy can be improved.

[0008] 1 is a diagram illustrating a reading system according to a first embodiment. 2 is a diagram illustrating hardware included in an information processing device according to the first embodiment. 3 is a block diagram illustrating functions of an information processing device according to the first embodiment. 4 is a diagram illustrating an example of an estimation method using a trained model according to the first embodiment. 5 is a flowchart illustrating an example of processing executed by the information processing device according to the first embodiment. 6 is a flowchart illustrating an example of a decision processing according to the first embodiment. 7 is a diagram illustrating a specific example (part 1) of the first embodiment. 8 is a diagram illustrating a comparative example. 9 is a diagram illustrating a specific example (part 2) of the first embodiment. 10 is a diagram illustrating a specific example (part 3) of the first embodiment. 11 is a block diagram illustrating functions of an information processing device according to a second embodiment. 12 is a flowchart illustrating an example of processing executed by the information processing device according to the second embodiment. 13 is a flowchart illustrating an example of a decision processing according to the second embodiment. 14 is a diagram illustrating a specific example of the second embodiment. 15 is a block diagram illustrating functions of an information processing device according to a third embodiment. 16 is a diagram illustrating an example of a conventional technique.

[0009] Hereinafter, an embodiment will be described with reference to the drawings.

[0010] 1 is a diagram showing a reading system according to embodiment 1. The reading system includes an information processing device 100 and an imaging device 200. The information processing device 100 and the imaging device 200 communicate with each other via a network.

[0011] For example, the information processing device 100 is a device that executes a reading method, or a server.

[0012] For example, the imaging device 200 is a camera, a smartphone, or a tablet terminal. When the imaging device 200 is a camera, the imaging device 200 may be included in the information processing device 100. For example, the information processing device 100 including the imaging device 200 is a smartphone or a tablet terminal. The imaging device 200 captures an image of the meter 300.

[0013] The meter 300 is also called a counter meter. The meter 300 is a mechanical analog meter. The meter 300 includes a plurality of numbers. In other words, the meter 300 includes a plurality of number display portions on which a plurality of numbers are displayed. A drum indicating each digit rotates upward or downward.

[0014] Next, the hardware of the information processing device 100 will be described. Fig. 2 is a diagram showing the hardware of the information processing device of embodiment 1. The information processing device 100 is also called a computer. The information processing device 100 has a processor 101, a volatile storage device 102, and a non-volatile storage device 103.

[0015] The processor 101 controls the entire information processing device 100. For example, the processor 101 is a central processing unit (CPU) or a field programmable gate array (FPGA). The processor 101 may be a multiprocessor. The information processing device 100 may also include a processing circuit.

[0016] The volatile storage device 102 is a main storage device of the information processing device 100. For example, the volatile storage device 102 is a random access memory (RAM). The nonvolatile storage device 103 is an auxiliary storage device of the information processing device 100. For example, the nonvolatile storage device 103 is a hard disk drive (HDD) or a solid state drive (SSD).

[0017] Next, a description will be given of functions of the information processing device 100. Fig. 3 is a block diagram showing functions of the information processing device of embodiment 1. The information processing device 100 has a storage unit 110, an acquisition unit 120, a detection unit 130, an identification unit 140, an estimation unit 150, a determination unit 160, and an output unit 170.

[0018] The storage unit 110 may be realized as a storage area secured in the volatile storage device 102 or the non-volatile storage device 103. Some or all of the acquisition unit 120, detection unit 130, identification unit 140, estimation unit 150, determination unit 160, and output unit 170 may be realized by a processing circuit. Furthermore, some or all of the acquisition unit 120, detection unit 130, identification unit 140, estimation unit 150, determination unit 160, and output unit 170 may be realized as program modules executed by the processor 101. For example, the program executed by the processor 101 is also referred to as a reading program or a reading program product. For example, the reading program is recorded on a recording medium.

[0019] The storage unit 110 stores various information.

[0020] The acquisition unit 120 acquires an image including a plurality of numbers on the meter 300. For example, the acquisition unit 120 acquires the image from the imaging device 200. Alternatively, for example, the acquisition unit 120 acquires the image from the storage unit 110.

[0021] The detection unit 130 detects an image area showing multiple numbers based on the image. For example, the detection unit 130 detects the image area using template matching, a detection method using features, or a detection method using a trained model. Furthermore, if a landmark is present near the multiple numbers, the detection unit 130 detects the image area based on the landmark.

[0022] Here, the acquisition unit 120 may acquire an image obtained by capturing an image of only the numbers on the meter 300. For example, the acquisition unit 120 acquires the image from the storage unit 110 or the imaging device 200. When the acquisition unit 120 acquires the image, the information processing device 100 does not need to include the detection unit 130.

[0023] The identification unit 140 identifies an image of each digit based on the image or the image area. In other words, the identification unit 140 identifies an image of each number based on the image or the image area. For example, the identification unit 140 identifies an image of each digit based on the width of each digit. Also, for example, the identification unit 140 identifies an image of each digit based on position information of each digit measured in advance. Note that the image of each digit may be expressed as the image area of ​​each digit.

[0024] The estimation unit 150 estimates the value indicated by the image of each digit based on the image of each digit. In other words, the estimation unit 150 estimates the rotation amount of each drum based on the image of each digit. For example, the estimation unit 150 estimates the value indicated by the image of each digit using a trained model. When a trained model is used, the acquisition unit 120 acquires the trained model from the storage unit 110. The acquisition unit 120 may acquire the trained model from an external device. Note that the external device is a device that exists outside the information processing device 100. For example, the external device is a cloud server, an external memory, etc. The external device is not shown in the drawing.

[0025] A case where a trained model is used will be described. FIG. 4 is a diagram showing an example of an estimation method using the trained model of the first embodiment. For example, the estimation unit 150 estimates x and y using an image showing a state between "3" and "4" and the trained model. Note that x and y are two-dimensional coordinates on a unit circle. The estimation unit 150 estimates the value v indicated by the image using the estimated x and y and equation (1).

[0026]

[0027] This allows the estimation unit 150 to estimate the value "3.7" indicated by the image. Similarly, the estimation unit 150 estimates x and y using an image indicating a state between "9" and "0" and the trained model. The estimation unit 150 estimates the value v indicated by the image using the estimated x and y and equation (1). This allows the estimation unit 150 to estimate the value "9.6" indicated by the image.

[0028] The estimation unit 150 may estimate the value indicated by the image of each digit using template matching, as in Patent Document 1.

[0029] The determination unit 160 determines the value of the meter 300 based on the value indicated by the image of each digit. Specifically, for each of the digits from the second digit onwards, if all digits lower than the target digit are 9 or greater, the determination unit 160 subtracts the value of the target digit by the value of the first decimal place of the first digit, rounds off the value obtained by the subtraction, calculates the remainder when the rounded value is divided by 10, and determines the value of the target digit to be the calculated value. For each of the digits from the second digit onwards, if all digits lower than the target digit are not 9 or greater, the determination unit 160 rounds off the value of the target digit, calculates the remainder when the rounded value is divided by 10, and determines the value of the target digit to be the calculated value. Note that this process is performed in order from the second digit to the higher digits. Furthermore, when processing the third digit and beyond, if it is determined whether all of the lower digits are 9 or greater, the original number estimated by the estimation unit 150 is not used, and the value already determined by the determination unit 190 is used.

[0030] The remainder when dividing by 10 is a value greater than or equal to 0 and less than 10. For example, the remainder when dividing -1 by 10 is 9. Also, for example, the remainder when dividing 10 by 10 is 0. The formula for finding the remainder when dividing by 10 is written as "mod10".

[0031] The determination unit 160 combines the values ​​of each digit to determine the value of the meter 300. The value of the first digit is used as is, including the decimal point. For the values ​​of the second digit and beyond, the integer values ​​of each digit determined by the determination unit 190 are used. For example, if the values ​​of each digit are "1.0, 2.0, 3.0, 4.5" from the most significant digit, the determination unit 160 determines the value of the meter 300 to be "1234.5."

[0032] The output unit 170 outputs the value of the meter 300. For example, the output unit 170 outputs the value of the meter 300 to the storage unit 110. Also, for example, the output unit 170 outputs the value of the meter 300 to a display.

[0033] Next, the processing executed by the information processing device 100 will be described using a flowchart. FIG. 5 is a flowchart showing an example of the processing executed by the information processing device of embodiment 1. (Step S11) The acquisition unit 120 acquires an image including the meter 300. (Step S12) The detection unit 130 detects an image area showing multiple numbers based on the image. (Step S13) The identification unit 140 identifies an image of each digit based on the image area. (Step S14) The estimation unit 150 estimates a value indicated by the image of each digit based on the image of each digit. (Step S15) The determination unit 160 determines the value of the meter 300 based on the value indicated by the image of each digit. (Step S16) The output unit 170 outputs the value of the meter 300.

[0034] FIG. 6 is a flowchart showing an example of the determination process of the first embodiment. The process of FIG. 6 corresponds to step S15. (Step S21) The determination unit 160 selects the second digit, which is the target digit. (Step S22) The determination unit 160 determines whether all digits lower than the target digit are 9 or greater. If all are 9 or greater, the process proceeds to step S23. If not all are 9 or greater, the process proceeds to step S25. (Step S23) The determination unit 160 subtracts the value of the target digit by the value of the first digit to the first decimal place. (Step S24) The determination unit 160 rounds off the value obtained by the subtraction. Then, the process proceeds to step S26.

[0035] (Step S25) The determination unit 160 rounds off the value of the target digit. (Step S26) The determination unit 160 calculates the remainder when the value obtained by rounding is divided by 10. (Step S27) The determination unit 160 determines the calculated value as the value of the target digit. (Step S28) The determination unit 160 determines whether all digits except the first digit have been selected. If all digits have not been selected, the process proceeds to step S29. If all digits have been selected, the process proceeds to step S30.

[0036] (Step S29) The determination unit 160 increments the target digit. For example, if the target digit is the second digit, the determination unit 160 changes the target digit to the third digit. Then, the process proceeds to step S22. (Step S30) The determination unit 160 combines the values ​​of each digit to determine the value of the meter 300.

[0037] Next, a specific example will be described. Fig. 7 is a diagram showing a specific example (part 1) of the first embodiment. The estimation unit 150 estimates the values ​​indicated by the images of the digits as "9.9, 0.9, 2.0, 0.0, 9.9".

[0038] The determination unit 160 performs a determination process for the second digit. Because the digit lower than the target digit (i.e., the second digit) (i.e., the first digit) is 9 or greater, the determination unit 160 subtracts the value of the second digit by the value of the first digit to the first decimal point. This results in -0.9 (= 0.0 - 0.9). The determination unit 160 rounds off the value "-0.9" obtained by the subtraction. The determination unit 160 calculates the remainder when the value "-1" obtained by rounding is divided by 10. This results in 9 (= -1 mod 10). The determination unit 160 determines the value of the second digit to be the calculated value "9".

[0039] The determination unit 160 performs a determination process for the third digit. Because the digits lower than the third digit (i.e., the first and second digits) are all 9 or greater, the determination unit 160 subtracts the value of the third digit by the value of the first digit to one decimal place. This results in 1.1 (=2.0-0.9). The determination unit 160 rounds off the value "1.1" obtained by the subtraction. The determination unit 160 calculates the remainder when the value "1" obtained by rounding is divided by 10. This results in 1 (=1 mod 10). The determination unit 160 determines the value of the third digit to be the calculated value "1".

[0040] The determination unit 160 performs a determination process for the fourth digit. Because the digits lower than the fourth digit (i.e., the first to third digits) are not all 9 or greater, the determination unit 160 rounds off the value of the target digit (i.e., the fourth digit). The determination unit 160 calculates the remainder when the value "1" obtained by rounding is divided by 10. This results in 1 (=1 mod 10). The determination unit 160 determines the value of the fourth digit to be the calculated value "1".

[0041] The determination unit 160 performs a determination process for the fifth digit. Because the digits lower than the fifth digit (i.e., the first to fourth digits) are not all 9 or greater, the determination unit 160 rounds the value of the fifth digit. Here, when a value of 9.5 or greater is rounded, the value is calculated as "0." Normally, when a value of 9.5 or greater is rounded, the value is calculated as "10." However, on a meter, the digit after 9 is 0. Therefore, when a value of 9.5 or greater is rounded, the value is calculated as "0." The determination unit 160 calculates the remainder when the value "0" obtained by rounding is divided by 10. This results in 0 (= 0 mod 10). The determination unit 160 determines the value of the fifth digit to be the calculated value "0."

[0042] The determination unit 160 combines the values ​​of each digit to determine the value of the meter 300 as "1199.9".

[0043] As described above, the information processing device 100 does not output undesirable numbers such as "-1" as the value of the meter 300. Therefore, according to the first embodiment, the information processing device 100 can improve the reading accuracy.

[0044] Here, a comparative example is shown. Fig. 8 is a diagram showing a comparative example. For example, assume that the meter in the left diagram of Fig. 8 obtains "0.4, 9.7, 9.5, 9.6" through information processing. The meter value is determined using truncation of the decimal point. The meter value is "999.6". This value is correct. On the other hand, the meter value is determined using rounding. The meter value is "9.6". This value is incorrect.

[0045] For example, suppose that the meter in the right diagram of FIG. 8 has obtained "0.1, 0.9, 2.1, 3.7" through information processing. The meter value is determined using truncation of the decimal point. The meter value is "23.7". This value is incorrect. On the other hand, the meter value is determined using rounding. The meter value is "123.7". This value is correct.

[0046] In this way, depending on the circumstances, the method of truncating the decimal point may be correct. On the other hand, the method of truncating the decimal point may be incorrect. Also, depending on the circumstances, the method of rounding off may be correct. On the other hand, the method of rounding off may be incorrect. Therefore, it is not preferable to adopt either the method of truncating the decimal point or the method of rounding off. The information processing device 100 can output a correct value even in a case such as that shown in FIG. 8. A proof will be provided below.

[0047] 9 is a diagram showing a specific example (part 2) of embodiment 1. The estimation unit 150 estimates the values ​​indicated by the images of the digits as "0.4, 9.7, 9.5, 9.6."

[0048] The determination unit 160 performs a determination process for the second digit. Because the digit lower than the second digit (i.e., the first digit) is 9 or greater, the determination unit 160 subtracts the value of the second digit by the value of the first digit to the first decimal place. As a result, 8.9 (= 9.5 - 0.6) is obtained. The determination unit 160 rounds off the value "8.9" obtained by the subtraction. The determination unit 160 calculates the remainder when the value "9" obtained by rounding is divided by 10. As a result, 9 (= 9 mod 10) is obtained. The determination unit 160 determines the value of the second digit to be the calculated value "9".

[0049] The determination unit 160 performs a determination process for the third digit. Because the digits lower than the third digit (i.e., the first and second digits) are 9 or greater, the determination unit 160 subtracts the value of the third digit by the value to the first decimal place of the first digit. As a result, 9.1 (= 9.7 - 0.6) is obtained. The determination unit 160 rounds off the value "9.1" obtained by the subtraction. The determination unit 160 calculates the remainder when the value "9" obtained by rounding is divided by 10. As a result, 9 (= 9 mod 10) is obtained. The determination unit 160 determines the value of the third digit to be the calculated value "9".

[0050] The determination unit 160 performs a determination process for the fourth digit. Because the digits lower than the fourth digit (i.e., the first to third digits) are 9 or greater, the determination unit 160 subtracts the value of the fourth digit by the value to the first decimal place of the first digit. As a result, -0.2 (= 0.4 - 0.6) is obtained. The determination unit 160 rounds off the value "-0.2" obtained by the subtraction. The determination unit 160 calculates the remainder when the value "0" obtained by rounding is divided by 10. As a result, 0 (= 0 mod 10) is obtained. The determination unit 160 determines the value of the fourth digit to be the calculated value "0".

[0051] The determination unit 160 combines the values ​​of each digit to determine the value "999.6" for the meter 300. In this way, the information processing device 100 can output the correct value.

[0052] 10 is a diagram showing a specific example (part 3) of embodiment 1. The estimation unit 150 estimates the values ​​"0.1, 0.9, 2.1, 3.7" indicated by the images of the digits.

[0053] The determination unit 160 performs a process to determine the second digit. Because the digit lower than the second digit (i.e., the first digit) is not 9 or greater, the determination unit 160 rounds off the value of the second digit. The determination unit 160 calculates the remainder when the value "2" obtained by rounding is divided by 10. As a result, 2 (= 2 mod 10) is obtained. The determination unit 160 determines the value of the second digit to be the calculated value "2".

[0054] The determination unit 160 performs a determination process for the third digit. Because the digits lower than the third digit (i.e., the first and second digits) are not all 9 or greater, the determination unit 160 rounds off the value of the third digit. The determination unit 160 calculates the remainder when the value "1" obtained by rounding is divided by 10. This results in 1 (=1 mod 10). The determination unit 160 determines the value of the third digit to be the calculated value "1".

[0055] The determination unit 160 performs a determination process for the fourth digit. Because the digits lower than the fourth digit (i.e., the first to third digits) are not all 9 or greater, the determination unit 160 rounds off the value of the fourth digit. The determination unit 160 calculates the remainder when the value "0" obtained by rounding is divided by 10. As a result, 0 (= 0 mod 10) is obtained. The determination unit 160 determines the value of the fourth digit to be the calculated value "0".

[0056] The determination unit 160 combines the values ​​of each digit to determine the value "123.7" for the meter 300. In this way, the information processing device 100 can output the correct value.

[0057] As described above, the information processing device 100 can output a correct value even in the case shown in Fig. 8. Therefore, the reading accuracy of the information processing device 100 is high.

[0058] Second Embodiment Next, a second embodiment will be described. In the second embodiment, differences from the first embodiment will be mainly described. Furthermore, in the second embodiment, descriptions of the commonalities between the first embodiment and the second embodiment will be omitted.

[0059] There are cases where the meter 300 indicates an abnormal value due to aging or other reasons. Reading an abnormal value is undesirable. Therefore, in the second embodiment, a method for preventing the reading of an abnormal value will be described.

[0060] 11 is a block diagram showing the functions of the information processing device of embodiment 2. The information processing device 100 further includes a determination unit 180. Part or all of the determination unit 180 may be realized by a processing circuit. Alternatively, part or all of the determination unit 180 may be realized as a program module executed by the processor 101. The functions of the determination unit 180 will be described later.

[0061] Next, the processing executed by the information processing device 100 will be described using a flowchart. Fig. 12 is a flowchart showing an example of the processing executed by the information processing device of embodiment 2. The processing in Fig. 12 differs from the processing in Fig. 5 in that steps S15a and S15b are executed. Therefore, steps S15a and S15b will be described in Fig. 12. Further, a description of the processing other than steps S15a and S15b will be omitted.

[0062] (Step S15a) The output unit 170 determines whether or not an error has been detected. If an error has been detected, the process proceeds to step S15b. If an error has not been detected, the process proceeds to step S16. (Step S15b) The output unit 170 outputs the error. For example, the output unit 170 outputs the error to a display.

[0063] Next, the determination process will be described using a flowchart. Fig. 13 is a flowchart showing an example of the determination process according to the second embodiment. The process in Fig. 13 differs from the process in Fig. 6 in that step S21a is executed. Therefore, step S21a will be described in Fig. 13. Description of the process other than step S21a will be omitted.

[0064] (Step S21a) The determination unit 180 determines whether the value of the first decimal place of the target digit is outside a predetermined range. If the value is outside the range, the process proceeds to step S22. If the value is within the range, the determination unit 180 determines that the value of the target digit is an error. Then, the process proceeds to step S15a.

[0065] Next, a specific example will be described. FIG. 14 is a diagram showing a specific example of the second embodiment. FIG. 14 shows the value of the meter 300. The third digit is between 2 and 3. Furthermore, the second digit is not between two digits, but is instead showing a 6. Therefore, if the meter 300 is normal, the third digit should show either 2 or 3. However, the third digit is between 2 and 3. Therefore, it can be said that the third digit (i.e., the third digit drum) shows an abnormal value due to aging or the like. The information processing device 100 outputs an error to prevent an abnormal value from being read. A specific example will be described below.

[0066] The predetermined range is from 3 to 7. The estimation unit 150 estimates the values ​​indicated by the images of the digits as "0.0, 2.5, 6.0, 1.5".

[0067] The determination process for the second digit is performed. The determination unit 180 determines that the value "0" in the first decimal place of the second digit is outside the range. The determination unit 160 rounds off the value of the second digit because the digit lower than the second digit (i.e., the first digit) is not 9 or greater. The determination unit 160 calculates the remainder when the value "6" obtained by rounding is divided by 10. As a result, 6 (= 6 mod 10) is obtained. The determination unit 160 determines the value of the second digit to be "6".

[0068] A determination process for the third digit is performed. The determination unit 180 determines that the value "5" in the first decimal place of the third digit is within the range. Therefore, the determination unit 180 determines that the value of the third digit is an error. The output unit 170 outputs an error. The output unit 170 may output information indicating that the third digit is an error.

[0069] According to the second embodiment, the information processing device 100 outputs an error when the meter 300 indicates an abnormal value, thereby enabling the information processing device 100 to prevent an abnormal value from being read.

[0070] Embodiment 3 Next, embodiment 3 will be described. In embodiment 3, differences from embodiments 1 and 2 will be mainly described. Furthermore, in embodiment 3, descriptions of matters common to embodiments 1 and 2 will be omitted.

[0071] In the above description, the estimation unit 150 estimates the value indicated by the image of each digit using a trained model. In the third embodiment, a case where the trained model is generated will be described.

[0072] 15 is a block diagram showing the functions of the information processing device of embodiment 3. The information processing device 100 further includes a learning generation unit 190. Part or all of the learning generation unit 190 may be realized by a processing circuit. Alternatively, part or all of the learning generation unit 190 may be realized as a program module executed by the processor 101.

[0073] The acquisition unit 120 acquires an image showing a number of a certain digit as training data. For example, the acquisition unit 120 acquires the training data from the storage unit 110 or an external device. The acquisition unit 120 may acquire a plurality of images showing the number display portion of the digit as training data. Note that instead of the acquisition unit 120 acquiring the training data, the training data generation unit 190 may automatically generate the training data. For example, the training data generation unit 190 generates images of numbers in which the font, blur, brightness, contrast, position, etc. of the numbers are randomly adjusted.

[0074] The learning generation unit 190 uses the training data to generate a trained model that estimates the value indicated by the image of each digit. Note that, for example, supervised learning is used in the training. For example, the learning generation unit 190 uses a correct answer label. The learning generation unit 190 may store the trained model in the storage unit 110.

[0075] According to the third embodiment, the information processing device 100 can generate a trained model.

[0076] Embodiment 4. In the first to third embodiments, the case where they are realized by one device has been described. However, the first to third embodiments may be realized by a plurality of devices. For example, the imaging device 200 has an acquisition unit 120 and a detection unit 130. The information processing device 100 has an identification unit 140 and the like. In this way, the first to third embodiments may be realized by a plurality of devices.

[0077] The embodiments are merely examples, and various modifications are possible within the scope of the present disclosure. Furthermore, the features of the respective embodiments can be combined with each other as appropriate.

[0078] REFERENCE SIGNS LIST 100 Information processing device, 101 Processor, 102 Volatile storage device, 103 Non-volatile storage device, 110 Storage unit, 120 Acquisition unit, 130 Detection unit, 140 Identification unit, 150 Estimation unit, 160 Decision unit, 170 Output unit, 180 Judgment unit, 190 Learning generation unit, 200 Imaging device, 300 Meter.

Claims

1. An acquisition unit that acquires an image obtained by capturing only the multiple numbers on the meter, Based on the aforementioned image, an identification unit identifies the image of each digit, An estimation unit that estimates the value indicated by the image of each digit based on the image of each digit, A determination unit that determines the value of the meter based on the values ​​shown in the images of each digit, An output unit that outputs the value of the meter, It has, The aforementioned determination unit, for each of the digits from the second digit onward, If all the digits lower than the target digit are 9 or greater, the value of the target digit is subtracted by the value of the first decimal place, the resulting value is rounded, the remainder is calculated when the rounded value is divided by 10, and the value of the target digit is determined to be the calculated value. If all the digits lower than the target digit are not 9 or greater, the value of the target digit is rounded, the remainder obtained by dividing the rounded value by 10 is calculated, and the value of the target digit is determined to be the calculated value. The values ​​of each of the aforementioned digits are combined to determine the value of the meter. Information processing device.

2. It further has a detection unit, The acquisition unit acquires an image containing the plurality of numbers, The detection unit detects the image region showing the plurality of digits based on the image, The identifying unit identifies the image of each digit based on the image region. The information processing apparatus according to claim 1.

3. The system further includes a determination unit that determines whether the value of the first decimal place of the target digit is outside a predetermined range. The output unit outputs an error if the value of the first decimal place of the target digit falls within the specified range. The information processing apparatus according to claim 1 or 2.

4. It further has a learning generation unit, The acquisition unit acquires an image showing a certain digit as training data, The learning generation unit generates a trained model that estimates the value represented by each digit of the image using the training data. The information processing apparatus according to claim 1 or 2.

5. A reading system including two or more devices, An acquisition unit that acquires an image obtained by capturing only the multiple numbers on the meter, Based on the aforementioned image, an identification unit identifies the image of each digit, An estimation unit that estimates the value indicated by the image of each digit based on the image of each digit, A determination unit that determines the value of the meter based on the values ​​shown in the images of each digit, An output unit that outputs the value of the meter, Equipped with, The aforementioned determination unit, for each of the digits from the second digit onward, If all the digits lower than the target digit are 9 or greater, the value of the target digit is subtracted by the value of the first decimal place, the resulting value is rounded, the remainder is calculated when the rounded value is divided by 10, and the value of the target digit is determined to be the calculated value. If all the digits lower than the target digit are not 9 or greater, the value of the target digit is rounded, the remainder obtained by dividing the rounded value by 10 is calculated, and the value of the target digit is determined to be the calculated value. The values ​​of each of the aforementioned digits are combined to determine the value of the meter. Reading system.

6. One or more devices, By capturing only the multiple numbers on the meter, an image is obtained. Based on the aforementioned image, identify the image for each digit, Based on the images of each digit, estimate the value indicated by the images of each digit. Based on the values ​​shown in the images of each digit, the value of the meter is determined. Output the value of the aforementioned meter, When determining the value of the meter, for each of the digits from the second digit onward, If all the digits lower than the target digit are 9 or greater, the value of the target digit is subtracted by the value of the first decimal place, the resulting value is rounded, the remainder is calculated when the rounded value is divided by 10, and the value of the target digit is determined to be the calculated value. If all the digits lower than the target digit are not 9 or greater, the value of the target digit is rounded, the remainder obtained by dividing the rounded value by 10 is calculated, and the value of the target digit is determined to be the calculated value. The values ​​of each of the aforementioned digits are combined to determine the value of the meter. How to read it.

7. In an information processing device, By capturing only the multiple numbers on the meter, an image is obtained. Based on the aforementioned image, identify the image for each digit, Based on the images of each digit, estimate the value indicated by the images of each digit. Based on the values ​​shown in the images of each digit, the value of the meter is determined. Output the aforementioned meter value, This is a read program that executes processing, When determining the value of the meter, for each of the digits from the second digit onward, If all the digits lower than the target digit are 9 or greater, the value of the target digit is subtracted by the value of the first decimal place, the resulting value is rounded, the remainder is calculated when the rounded value is divided by 10, and the value of the target digit is determined to be the calculated value. If all the digits lower than the target digit are not 9 or greater, the value of the target digit is rounded, the remainder obtained by dividing the rounded value by 10 is calculated, and the value of the target digit is determined to be the calculated value. The values ​​of each of the aforementioned digits are combined to determine the value of the meter. A reading program.