Measurement unit automatic reading system, method for automatic reading of measurement unit, and program
The system addresses the challenge of varying meter formats by using markers to correct image data, enabling precise and efficient automatic reading of measuring instruments.
Patent Information
- Application Number
- JP2023077168
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-09
- Publication Date
- 2024-11-21
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing automatic reading systems struggle to accurately recognize measured values from various types of measuring instruments due to differences in position, orientation, and format, leading to inefficiencies in reading analog and digital meters.
An automatic measuring instrument reading system that utilizes markers on the instruments to determine positional and orientation information, allowing for precise detection and reading of measured values through image processing and correction.
Enables high-accuracy and efficient automatic reading of measuring instrument values by correcting image data based on marker information, improving recognition accuracy and efficiency.
Smart Images

Figure 2024162025000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an automatic measuring instrument reading system, an automatic measuring instrument reading method, and a program. [Background technology]
[0002] Conventionally, there has been known an automatic reading device that captures an image of the scales and numerical values of various measuring instruments (meters) for electricity, gas, water, etc., and reads the measured values (scales and numerical values) based on the captured image (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2006-84418 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the camera, which is the imaging means, is in a different position and attitude relative to the target measuring instrument, and the format, position, direction, size, etc. of the measurement value to be read varies depending on the type of measuring instrument, such as analog types that indicate the measurement value with a needle scale and digital types that indicate the measurement value with numbers, making it difficult to accurately recognize measurement values for various measuring instruments.
[0005] Therefore, the present disclosure has been made in consideration of the above technical problems, and its purpose is to provide an automatic measuring instrument reading system, an automatic measuring instrument reading method, and a program that can automatically read the measurement values of a measuring instrument efficiently and with high accuracy. [Means for solving the problem]
[0006] The automatic meter reading system according to the present disclosure comprises: A process of acquiring image data of the measuring instrument; A process of detecting a marker provided on a measuring instrument from the image data; obtaining instrument information associated with the detected marker; a control unit that executes a process of detecting and reading a measurement value from the image data of the measuring instrument based on the measuring instrument information, The measuring instrument information includes position information of the measurement value reading area of the measuring instrument relative to the marker. Also, based on the marker, a camera as an imaging means obtains the position and orientation of the target measuring instrument, and corrects the reading area as a measurement value to the positive direction.
[0007] The method for automatically reading a meter disclosed herein comprises: A process of acquiring image data of the measuring instrument; A process of detecting a marker provided on a measuring instrument from the image data; obtaining instrument information associated with the detected marker; a control unit executes a process of detecting and reading a measurement value from the image data of the measuring instrument based on the measuring instrument information; The measuring instrument information includes position information of a measurement value reading area of the measuring instrument relative to the marker.
[0008] The program in this disclosure is A process of acquiring image data of the measuring instrument; A process of detecting a marker provided on a measuring instrument from the image data; obtaining instrument information associated with the detected marker; and detecting and reading a measurement value from the image data of the measuring instrument based on the measuring instrument information. The measuring instrument information includes position information of a measurement value reading area of the measuring instrument relative to the marker. Effect of the Invention
[0009] According to the automatic measuring instrument reading system, the automatic measuring instrument reading method, and the program disclosed herein, it becomes possible to automatically read the measurement values of a measuring instrument with high accuracy and efficiency. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an automatic measuring instrument reading system according to an embodiment of the present disclosure. [Diagram 2] 4A to 4C are diagrams illustrating examples of marker arrangement on a measuring instrument in the present embodiment. [Diagram 3] 13A and 13B are diagrams illustrating other examples of arrangement of markers on a measuring instrument in the present embodiment. [Figure 4] 10A to 10C are diagrams showing other examples of arrangements of markers on a measuring instrument in the present embodiment. [Diagram 5] 13A and 13B are diagrams illustrating other examples of arrangement of markers on a measuring instrument in the present embodiment. [Figure 6] 1 is a block diagram showing an example of the configuration of an information processing device and a camera according to an embodiment of the present invention. [Figure 7] FIG. 4 is a flowchart illustrating an example of a method for automatically reading a measuring instrument according to the present embodiment. [Figure 8] 11 is a diagram illustrating an example of how a marker is recognized by a camera. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.
[0012] An automatic measuring instrument reading system according to one embodiment of the present invention comprises a control unit that executes a process of acquiring image data of a measuring instrument, a process of detecting a marker attached to the measuring instrument from the image data, a process of acquiring measuring instrument information associated with the detected marker, and a process of detecting and reading measurement values from the image data of the measuring instrument based on the measuring instrument information, wherein the measuring instrument information includes position information of the measurement value reading area of the measuring instrument relative to the marker.
[0013] As shown in Fig. 1, a measuring instrument (meter) 10 is photographed by a camera 20 to obtain image data. A marker 30 is provided on the measuring instrument 10, and the image data includes a measurement value reading area 11 (hereinafter also simply referred to as the reading area) that includes the measurement value to be read, and the marker 30.
[0014] Measuring instrument 10 may be a digital type (see FIG. 2) in which the measured value is displayed as a numerical value, or an analog type (see FIG. 3) in which a needle rotates (swings) around a fulcrum or moves (slides) in one axial direction. Measuring instrument 10 may be a meter that measures and displays water, gas, electricity, temperature (air temperature, water temperature, etc.), humidity, speed, acceleration, length, height, depth, weight, etc., but the type is not particularly limited.
[0015] In the measuring instrument 10, an area showing numerical values and scales as measurement values is a reading area 11 to be read from the image of the camera. The reading area 11 is a region of interest (ROI) in image processing. There may be only one reading area 11 or multiple reading areas 11 in one measuring instrument 10.
[0016] Measuring instrument 10 is installed outdoors or indoors. If outdoors, measuring instrument 10 is installed on the ground, a wall, a pillar, etc. near the object to be measured. If indoors, measuring instrument 10 is installed on the floor, a wall, a ceiling, etc. near the object to be measured. Measuring instrument 10 may be located away from the object to be measured.
[0017] The camera 20 (imaging unit) may be any imaging device capable of acquiring image data including the reading area 11 and the marker 30 of the measuring instrument 10. The camera 20 may be an IP camera, an edge AI camera, a glasses-type such as AR glasses, a goggle-type, a head-mounted information processing terminal, a smartphone, a tablet terminal, a meter reading terminal, or a camera that is integrated with an information processing device, or may not be. The camera 20 may be a manual type that an operator carries around, or may be fixed to a wall surface or the like that can capture the reading area 11 and the marker 30 of the measuring instrument 10. The camera 20 in FIG. 1 is installed at a height above the measuring instrument 10, with the imaging direction facing diagonally downward.
[0018] Regarding the camera 20, one camera 20 capable of photographing one or more measuring instruments 10 may be installed, but multiple cameras 20 capable of photographing one or more measuring instruments 10 from different angles may also be installed. Even if one camera cannot photograph, image data can be obtained by photographing with another camera. This is effective, for example, when a transparent cover (glass, acrylic, etc.) of the measuring instrument 10 reflects light and makes it difficult to read the measured value.
[0019] Image data captured by the camera 20 is transmitted to an information processing device 40 (information management device). The camera 20 and the information processing device 40 may be formed integrally, or may be formed as separate devices. The camera 20 and the information processing device 40 may be connected by wire with a communication cable, or may be connected wirelessly via a network such as short-distance wireless communication or the Internet. The camera 20 may be a network camera (IP camera).
[0020] Camera 20 can capture continuous images for a predetermined period of time in response to a user's (system administrator, worker, etc.) operation or based on preset information. For example, camera 20 may be set to capture images only at a preset date, time, and duration (period). The setting information is stored, for example, in storage unit 42 of information processing device 40. Camera 20 can capture still images and videos. Camera 20 may be able to change the capture range (camera orientation) in response to a user's operation or based on preset information.
[0021] Marker 30 is provided near reading area 11 of measuring instrument 10. For example, marker 30 in Figs. 1 and 2 is affixed to upper surface 12 of measuring instrument 10 (a surface that is the same as or parallel to reading area 11). Marker 30 is preferably placed on the same surface as reading area 11 or on a surface that is parallel to reading area 11, but is not limited to this. Marker 30 is placed at a position where reading area 11 and marker 30 are included in the shooting range of camera 20.
[0022] The marker 30 may be, for example, an ARUco marker or an AprilTag, but is not limited thereto, and may be other AR markers (AR tags) such as ARTag, ARToolkit, ARToolkitPlus, RUNE-Tag, and reacTIVison. The marker 30 may be a QR code or a barcode. The marker 30 is, for example, a square as a whole. The marker 30 has a matrix structure in which a plurality of square pixels are arranged two-dimensionally, and each pixel is displayed in white or black. The shape and the drawn figure of the marker 30 are not limited thereto. The marker 30 may be a color marker having a color other than white or black, or may be printed using invisible ink (including invisible ink, IR transmitting ink, ultraviolet ray reactive ink, infrared ray absorbing ink, etc.). With such a configuration, it is possible to correspond to various interiors with high design quality and to make the marker less noticeable. The marker 30 may be a specific figure other than an AR marker. The graphic shape may be, for example, a circle, a star, an ellipse, a triangle, a rectangle, a pentagon, or other polygon, and may include symbols and characters.
[0023] At least one marker 30 may be arranged on each measuring instrument 10 as shown in Figures 2 and 3, but multiple markers may also be arranged as shown in Figures 4 and 5. When multiple markers 30 are arranged, for example, two markers may be arranged adjacent to each other as shown in Figure 4, or two markers may be arranged adjacent to each other as shown in Figure 5. When two markers are arranged adjacent to each other, the two markers may be arranged at positions sandwiching the reading area 11 (on both the left and right sides and / or both the top and bottom sides of the reading area).
[0024] The markers 30 may be configured so that information of one measuring instrument 10 is displayed by combining multiple markers 30. In other words, multiple markers 30 may be used as one set. For example, multiple markers may be stored in association with one measuring instrument 10. This allows the amount of information that can be expressed by multiple markers to be greater than the amount of information that can be expressed by one marker.
[0025] The markers 30 are composed of planar stickers or the like on which unique two-dimensional images are printed, and each marker 30 is associated with various information. Each marker and the information associated with the marker are stored in a database (such as the storage unit 42). For example, the markers 30 can be photographed by the camera 20 to obtain identification information unique to each marker 30 and identification information unique to the associated measuring instrument 10. Note that one camera 20 may be configured to read multiple markers 30, for example, 100 or more. By using an edge AI camera or the like as a camera, the recognized markers can be counted by an algorithm that is implemented on the edge or cloud and that reads multiple markers simultaneously.
[0026] The position where the marker 30 is placed may be the outer or inner surface of the protective cover (such as a cover glass) of the measuring device 10, as long as it is a position that does not overlap (hide) the scale, and is preferably in the vicinity of the scale. In addition, it is preferable that the surfaces of the marker 30 and the reading area 11 are parallel, and it is preferable that the left-right direction of the measuring device is parallel to one of the sides of the marker (the left-right direction of the marker).
[0027] The information processing device 40 is an information processing device used by a system administrator or the like when operating and managing various services, and may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing technology. The information processing device 40 may be built into the camera 20.
[0028] As shown in FIG. 6, the information processing device 40 includes, for example, a control unit 41, a storage unit 42, an output unit 43, a communication unit 44, and an input unit 45, which are connected to each other via a bus 46. The information processing device 40 can communicate with the camera 20 via the communication unit 44. The information processing device 40 can acquire image data from the camera 20. The information processing device 40 can also send control signals to the camera 20 to instruct it to start, stop, change the shooting direction, or change the shooting range. When the information processing device 40 receives various request signals or based on information stored in the storage unit, the control unit 41 executes processing according to a program, and outputs the processing results (for example, various information such as generated images and sounds) from the output unit as appropriate, transmits them to the camera 20 or other information processing devices (such as a smartphone or tablet terminal held by an operator), or stores them in the storage unit 42. Note that a part of the above program may be transmitted to another information processing device and executed on the other information processing device.
[0029] The control unit 41 is responsible for transferring data between each unit and controlling the entire information processing device 40, and is realized by the CPU (Central Processing Unit) and GPU (Graphics Processing Unit) executing programs stored in a specified memory (storage unit).
[0030] The storage unit 42 has a nonvolatile storage device which is a read-only storage area in which a system program is stored, and a volatile storage device which is a rewritable storage area used as a work area for arithmetic processing by the control unit 41. The nonvolatile storage device is realized, for example, by a ROM (Read Only Memory), a flash memory, or a hard disk, while the volatile storage device is realized by a RAM (Random Access Memory), a VRAM (Video Random Access Memory), or the like.
[0031] The memory unit 42 can store information about the measuring instrument 10, information about the camera 20, information about the marker 30, etc. The measuring instrument information about the measuring instrument 10 can include identification information (meter ID) unique to each measuring instrument, model number, manufacturer information, number of scale marks, type of scale mark (digital, analog, etc.), scale unit, measurement target (electricity, gas, water, temperature, etc.), map positioning information, reading area information, etc. The map positioning information can be information on the position coordinates of the measuring instrument 10 that can be obtained using a GPS or the like. The reading area information can include information on the relative position and attitude (tilt, angle) of the reading area with respect to the marker 30, the number, position, attitude, size (area, length, width, radius, etc.) of the reading areas, etc.
[0032] The relative position of the reading area 11 with respect to the marker 30 can be indicated by coordinate information (x1, y1) of the center point or any or all of the four corners (e.g., the lower left point) of the reading area 11 in a marker coordinate system that has the center point or any of the four corners of the marker 30 as the origin. The marker coordinate system and the position and orientation information of the reading area may be expressed in two dimensions or three dimensions.
[0033] The information on the relative orientation of the reading area 11 with respect to the marker 30 can be, for example, the angle between one side (e.g., the bottom side) of the rectangular reading area and the x-axis in the marker coordinate system (0° if parallel). When one measuring instrument 10 has multiple reading areas (e.g., multiple scales), position information and orientation information of each reading area with respect to the marker 30 is stored. When one measuring instrument 10 is provided with multiple markers 30, it is preferable to store position information and orientation information of the reading area with respect to each marker 30. Such position information and orientation information of the reading area with respect to the marker 30 can be registered (stored in a memory unit) when the user places the marker 30 on the measuring instrument 10.
[0034] In this embodiment, the position and inclination (attitude) of the camera 20 relative to the marker 30 during manual shooting can be calculated using the image positions of the four corners of the marker 30, which is a two-dimensional code. Then, based on the information on the position and attitude of the camera 20 relative to the marker 30, the image data is corrected to the positive direction (the front, that is, the image seen from a direction perpendicular to the marker), so that the position and attitude of the reading area (ROI area) can be recognized more accurately. For example, even if the marker 30 is photographed by the camera 20 from an oblique direction, rather than from directly in front, the distance and inclination from the camera 20 can be calculated and the image data can be corrected to that when photographed from directly in front.
[0035] The storage unit 42 can store information received from the camera 20 and information generated based on that information. The generated information is, for example, various types of information such as the type of the measuring instrument 10, information about the measurement values, and the like.
[0036] The storage unit 42 may store information about an information processing device (such as a smartphone or a tablet terminal) that transmits the output data.
[0037] The output unit 43 is composed of a speaker for outputting sound, a display for displaying images, a touch panel, and the like.
[0038] The communication unit 44 can connect the information processing device 40 to not only the camera 20 but also to a network including the Internet. The communication unit 44 may include a short-range communication interface such as Bluetooth (registered trademark) or BLE (Bluetooth Low Energy). Through the communication unit 44, output data can be transmitted to another information processing device, and signals can be received from another information processing device.
[0039] The input unit 45 can be a keyboard, a mouse, a touch panel, or a microphone for voice input.
[0040] The information processing device 40 can simultaneously recognize a plurality of markers 30 included in the image data. When the information processing device 40 acquires image data from the camera 20, the information processing device 40 refers to the storage unit and acquires information corresponding to the markers 30.
[0041] The information processing device 40 and the camera 20 may include only a part of the configuration shown in the figure, or may include other configurations. In addition, each functional unit may be configured by a combination of multiple devices (hardware) such as AR glasses and a tablet terminal.
[0042] 7 shows a method for automatically reading the measurement value of the measuring instrument 10 using image data (video video or still images) captured by the camera 20. First, markers 30 are placed (attached) on the measuring instrument 10 in advance, and information on each marker 30 is associated with information on the measuring instrument 10 and stored in a memory unit. One or more markers may be printed on a sheet of paper or a sticker mount, and placed on the measuring instrument 10 by gluing or the like. Position information and orientation information of the reading area 11 relative to the markers 30 are registered in the memory unit.
[0043] The control unit of the information processing device 40 acquires image data from the camera 20 (S1). For example, the information processing device 40 may continuously acquire images captured by the camera 20 in real time, or may repeatedly acquire image data at regular intervals (10 seconds, 1 minute, 10 minutes, 1 hour, 1 day, 1 week, 1 month, 1 year, etc.). In this case, the interval at which image data is acquired may be changed depending on the time of day (morning, afternoon, every hour, etc.).
[0044] The control unit of the information processing device 40 detects all of the markers 30 included in the acquired image data (S2). That is, image recognition processing is used to detect whether or not any markers 30 are captured within the shooting range of the camera 20, and how many markers are captured. Note that, if multiple markers 30 are provided on one measuring instrument 10, it is sufficient to detect at least one marker 30.
[0045] Next, the control unit of the information processing device 40 acquires measuring device information based on the detected marker 30 (S3). The measuring device information is, for example, identification information of the measuring device, and the type of measuring device 10, the unit of the measurement value, etc. can be acquired from the storage unit based on the identification information.
[0046] Furthermore, the control unit of the information processing device 40 acquires position information and orientation information of the reading area 11 based on the information associated with the marker 30 (S4). This makes it possible to recognize with high accuracy, for example, the position and direction of the reading area 11 as viewed from the center of the marker 30.
[0047] Then, the control unit of the information processing device 40 reads the measurement values from the reading area 11 of the image data based on the acquired information (S5). At this time, since there is information on the position, orientation, and type of measurement value of the reading area 11, the reading error of the measurement values is reduced, and it is possible to read accurate measurement values with high precision.
[0048] 8 shows how the position and orientation of the marker 30 relative to the camera 20 are estimated by photographing and recognizing the marker 30 with the camera 20 (mounted in the AR glasses). For example, a control unit (mounted in the AR glasses, or mounted in an information processing device that communicates via a communication unit) acquires information on the three-dimensional position and orientation of the camera in real space as necessary, acquires information on the relative three-dimensional position and three-dimensional angle of the marker with respect to the camera, and calculates the three-dimensional position and orientation of the marker in real space.
[0049] The control unit calculates the three-dimensional position and orientation of the marker 30 on the camera coordinate system based on the image data of the captured marker. In this case, the position and orientation of the marker are determined using a point constituting one of the corners of the square marker and two sides (edges) perpendicular to the corner of the point as reference elements (reference point, reference line). The control unit can also calculate the three-dimensional relative positional relationship (coordinate transformation matrix (R, T)) between the user terminal coordinate system and the marker coordinate system. This allows the control unit to correct the image data of the marker 30 captured obliquely to image data captured from the front (perpendicular to the marker 30). Since image data of the marker from the front can be generated based on image data captured obliquely, the accuracy of information recognition of the marker 30 can be improved.
[0050] The control unit may also store information on the position and orientation of the marker in the real space coordinate system calculated based on the image data of the captured marker in the storage unit. The control unit can also estimate the position coordinates (image capture position coordinates) and orientation of the camera and the user terminal including the camera by solving a so-called PnP problem (Perspective n-Point), which determines an image of an object whose position and shape are known, and the position and orientation of the camera that captured the image.
[0051] As described above, the automatic measuring instrument reading system and the automatic measuring instrument reading method of this embodiment include a control unit that executes the process of acquiring image data of a measuring instrument, the process of detecting markers provided on the measuring instrument from the image data, the process of acquiring measuring instrument information associated with the detected markers, and the process of detecting and reading measured values from the image data of the measuring instrument based on the measuring instrument information (reading process), where the measuring instrument information includes position information of the measurement value reading area of the measuring instrument relative to the markers. With this configuration, the measured values of the measuring instrument can be automatically read efficiently with high accuracy.
[0052] In the present embodiment, the measuring device information may include orientation information of the measurement value reading area of the measuring device relative to the marker. In this case, for example, the measurement value can be read in consideration of the relative angle between the marker and the reading area, thereby improving the accuracy of reading the measurement value.
[0053] In this embodiment, the image data may be corrected to image data of the measurement value reading area viewed from the front based on position information and attitude information of the camera photographing the measuring instrument with respect to the marker. In this way, even if the marker and measuring instrument are photographed obliquely, the image data can be corrected to image data of the measurement area viewed from the front before reading the measurement values, thereby improving the accuracy of reading the measurement values.
[0054] In the present embodiment, a measuring instrument information storage unit may be provided in which information on a plurality of measuring instruments is stored in advance, and information on the measurement value reading area of the measuring instrument stored in the measuring instrument information storage unit may be acquired based on identification information of the measuring instrument associated with the marker. In this way, by acquiring the identification information from the marker, various information on the measuring instrument associated with the identification information may be acquired.
[0055] In this embodiment, a single measuring instrument may be provided with multiple markers, and the measurement value may be detected and read based on position information of the measurement value reading area relative to the multiple markers. This can improve the accuracy of identifying the position of the measurement value reading area compared to using only one marker.
[0056] In addition, in this embodiment, a single measuring instrument may be provided with multiple markers, and the multiple markers may be combined to display information about the single measuring instrument. This can increase the amount of information that can be displayed compared to when only one marker is used.
[0057] In the present embodiment, the plurality of markers may be arranged on either side of the measurement value reading area, thereby making it possible to further increase the accuracy of recognizing the position of the measurement value reading area.
[0058] In the present embodiment, the marker may be an AR marker. This allows a large amount of information to be stored with a simple configuration, making it possible to manage information related to the measuring device in detail.
[0059] In addition, in this embodiment, the measuring device may be provided with a plurality of cameras capable of photographing the measuring device from different angles, which increases the possibility of obtaining clear image data from one angle even if the image data from one angle is unclear due to reflection or the like.
[0060] In this embodiment, the marker may have a colored portion that is composed of a color other than black and white, and the control unit may acquire information about the measuring device based on the difference in color of the colored portion. This allows the marker to accommodate a variety of interior designs, compared to a case where the marker is only black and white. In addition, the amount of information about the marker is increased, so that information about the measurement value can be managed in more detail.
[0061] In this embodiment, the marker may be made of invisible ink, which cannot be seen by the naked eye and therefore prevents the marker from impairing the appearance of the measuring device.
[0062] In addition, in this embodiment, the control unit may generate output data for outputting the acquired various information as images, sounds, etc. For example, the read measurement values and various information related to the measuring device may be displayed on the lens (display unit) of the AR glasses or the touch panel of the tablet terminal.
[0063] Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field of the present disclosure can conceive of various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure.
[0064] The device described in this specification may be realized as a single device, or may be realized by a plurality of devices (e.g., cloud servers) partially or entirely connected by a network. For example, the control unit and the storage unit of a server may be realized by different servers connected to each other by a network. In addition, the information processing performed by the above-mentioned device, server, etc. may include, for example, a part of processing by so-called machine learning such as deep learning. In addition, the device may be a terminal device (information processing device) called an edge device, itself equipped with artificial intelligence / AI capable of making decisions.
[0065] In addition, an external light that irradiates infrared light, ultraviolet light, or the like may be irradiated toward at least one of the markers in the management target area, the specific color area, and the specific pattern area. In this case, the markers to be detected can be efficiently detected with high accuracy by making the markers to be detected from a material that reflects the light of a special wavelength of the light. Such a lighting device may be installed near the installation position of the above-mentioned camera, or may be integrated with the camera to capture and irradiate. It is preferable that the external light is installed in a position that does not directly irradiate the camera. By preventing the light of the external light from being directly irradiated onto the camera, it is possible to prevent the detection of the markers, etc. from being hindered.
[0066] The series of processes performed by the device described in this specification may be realized using any of software, hardware, and a combination of software and hardware. It is possible to create a computer program for realizing each function of the user terminal and server according to this embodiment and to install it in a PC or the like. It is also possible to provide a computer-readable recording medium in which such a computer program is stored. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, etc. The above computer program may also be distributed, for example, via a network, without using a recording medium.
[0067] In addition, the processes described herein using flowchart diagrams do not necessarily have to be performed in the order shown. Some process steps may be performed in parallel. Additional process steps may be employed, and some process steps may be omitted.
[0068] In addition, the effects described in this specification are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects.
[0069] Note that the following configurations also fall within the technical scope of the present disclosure. (Item 1) A process of acquiring image data of the measuring instrument; A process of detecting a marker provided on a measuring instrument from the image data; obtaining instrument information associated with the detected marker; a control unit that executes a process of detecting and reading a measurement value from the image data of the measuring instrument based on the measuring instrument information, 4. An automatic measuring instrument reading system, wherein the measuring instrument information includes position information of a measurement value reading area of the measuring instrument relative to the marker. (Item 2) 2. The automatic measuring instrument reading system according to item 1, wherein the measuring instrument information includes attitude information of a measurement value reading area of the measuring instrument relative to the marker. (Item 3) 3. The automatic measuring instrument reading system according to claim 1 or 2, wherein the image data is corrected to image data of the measurement value reading area viewed from the front based on position information and orientation information of the camera photographing the measuring instrument with respect to the marker. (Item 4) a measuring instrument information storage unit in which information regarding the plurality of measuring instruments is stored in advance; 3. The automatic measuring instrument reading system according to item 1 or 2, further comprising: acquiring information on the measurement value reading area of the measuring instrument stored in the measuring instrument information storage unit based on identification information of the measuring instrument associated with the marker. (Item 5) Multiple markers are provided on one measuring instrument, 3. The automatic measuring instrument reading system according to item 1 or 2, wherein the measurement values are detected and read based on position information of a measurement value reading area relative to the plurality of markers. (Item 6) Multiple markers are provided on one measuring instrument, 3. The automatic measuring instrument reading system according to item 1 or 2, wherein the information of the one measuring instrument is indicated by combining the plurality of markers. (Item 7) 6. The automatic measurement instrument reading system according to item 4 or 5, wherein the plurality of markers are arranged on both sides of the measurement value reading area. (Item 8) 3. The automatic measuring instrument reading system according to claim 1 or 2, wherein the marker is an AR marker. (Item 9) 3. The automatic measuring instrument reading system according to item 1 or 2, comprising a plurality of cameras capable of photographing the measuring instrument from different angles. (Item 10) A process of acquiring image data of the measuring instrument; A process of detecting a marker provided on a measuring instrument from the image data; obtaining instrument information associated with the detected marker; a control unit executes a process of detecting and reading a measurement value from the image data of the measuring instrument based on the measuring instrument information; 4. A method for automatically reading a measuring instrument, comprising: the measuring instrument information including position information of a measurement value reading area of the measuring instrument relative to the marker. (Item 11) A process of acquiring image data of the measuring instrument; A process of detecting a marker provided on a measuring instrument from the image data; obtaining instrument information associated with the detected marker; and detecting and reading a measurement value from the image data of the measuring instrument based on the measuring instrument information. The measuring instrument information includes position information of a measurement value reading area of the measuring instrument relative to the marker. [Explanation of symbols]
[0070] 10. Measuring Instruments 11 Reading area 20 Camera 30 Marker 40 Information processing device (information management device)
Claims
1. A process of acquiring image data of the measuring instrument; A process of detecting a marker provided on a measuring instrument from the image data; obtaining measurement instrument information associated with the detected marker; a control unit that executes a process of detecting and reading a measurement value from the image data of the measuring instrument based on the measuring instrument information, 10. An automatic measuring instrument reading system, wherein the measuring instrument information includes position information of a measurement value reading area of the measuring instrument relative to the marker.
2. The automatic measuring instrument reading system according to claim 1 , wherein the measuring instrument information includes orientation information of a measurement value reading area of the measuring instrument relative to the marker.
3. 3. The automatic measuring instrument reading system according to claim 1, wherein the image data is corrected to image data of the measurement value reading area viewed from the front based on position information and orientation information of a camera photographing the measuring instrument with respect to the marker.
4. a measuring instrument information storage unit in which information about the plurality of measuring instruments is stored in advance; 3. The automatic measuring instrument reading system according to claim 1, wherein information on the measurement value reading area of the measuring instrument stored in the measuring instrument information storage unit is acquired based on identification information of the measuring instrument associated with the marker.
5. A single measuring instrument is provided with multiple markers, 3. The automatic measuring instrument reading system according to claim 1, wherein the measurement values are detected and read based on position information of measurement value reading areas relative to the plurality of markers.
6. A single measuring instrument is provided with multiple markers, 3. The automatic measuring instrument reading system according to claim 1, wherein the information of the one measuring instrument is indicated by combining the plurality of markers.
7. 6. The automatic measuring instrument reading system according to claim 4, wherein the plurality of markers are arranged on both sides of the measurement value reading area.
8. The automatic measuring instrument reading system according to claim 1 or 2, wherein the marker is an AR marker.
9. 3. The automatic measuring instrument reading system according to claim 1, further comprising a plurality of cameras capable of photographing the measuring instrument from different angles.
10. A process of acquiring image data of the measuring instrument; A process of detecting a marker provided on a measuring instrument from the image data; obtaining measurement instrument information associated with the detected marker; a control unit executes a process of detecting and reading a measurement value from the image data of the measuring instrument based on the measuring instrument information; 10. The method for automatically reading a measuring instrument, wherein the measuring instrument information includes position information of a measurement value reading area of the measuring instrument relative to the marker.
11. A process of acquiring image data of the measuring instrument; A process of detecting a marker provided on a measuring instrument from the image data; obtaining measurement instrument information associated with the detected marker; and detecting and reading a measurement value from the image data of the measuring instrument based on the measuring instrument information. The measuring instrument information includes position information of a measurement value reading area of the measuring instrument relative to the marker.
Citation Information
Patent Citations
Automatic reading apparatus for measuring instrument
JP2006084418A
