Communication device and information processing method

Abstract

To provide a communication device and an information processing method capable of inputting multiple types of commands.SOLUTION: A flow meter communication device 100 includes: a communication module 160 for communicating with a server; an image sensor unit 150 for photographing a display unit of a measuring device (meter 200); and a control microcomputer 110 for using an OCR function to read a measured value from an image captured by the image sensor unit and transmits it to the server, and for reading predetermined information from an image 600 captured by the image sensor unit 150 and executing processing on the information. When the control microcomputer reads a predetermined character string from the image 600 captured by the image sensor unit 150 by using the OCR function, the control microcomputer shifts to a command input mode, and then executes a command corresponding to the character string read from the image 600 captured by the image sensor unit 150.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to a technique for measuring the amount of electricity, gas, water, etc. used and transmitting the measured values ​​to a server. [Background technology]

[0002] Conventionally, meter reading meters for measuring the amount of electricity, gas, water, etc. used have been installed in homes, offices, etc. Japanese Patent Application Laid-Open Publication No. 2003-209628 (Patent Document 1) discloses an automatic meter reading system capable of presenting information such as meter reading results to users. According to Patent Document 1, the automatic meter reading system includes a terminal network control device located outdoors and a terminal network control device located indoors. The terminal network control device also includes a display for displaying information. The terminal network control device displays information such as the gas meter reading results received from the terminal network control device on the display, making it possible to present information such as the meter reading results to users. According to Patent Document 1, the terminal network control device transmits the information to a center via a telephone line. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-209628 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to provide a communication device and method that allows input of multiple types of commands. [Means for solving the problem]

[0005] According to one aspect of the present invention, a communication device is provided that includes a communication unit for communicating with a server, a camera for photographing the display unit of a measuring device, and a control unit that uses an OCR function to read measurement values ​​from the image captured by the camera and send them to the server, and to read specified information from the image captured by the camera and perform processing on the information. [Effects of the Invention]

[0006] As described above, the present invention provides a communication device and a method thereof that allow input of a plurality of types of commands. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a conceptual diagram illustrating an overall configuration of a network system according to a first embodiment. [Figure 2] FIG. 2 is an image diagram showing how to use the communication terminal and the measurement device according to the first embodiment. [Figure 3] FIG. 2 is a conceptual diagram showing a display unit of the measurement device according to the first embodiment. [Figure 4] FIG. 10 is an image diagram showing a display unit of another type of measuring device. [Figure 5] 2 is a block diagram showing main functions of a communication terminal according to the first embodiment; FIG. [Figure 6] FIG. 2 is a conceptual diagram showing (A) a measuring device according to a first embodiment and (B) the periphery of a display unit. [Figure 7] 1A and 1B are conceptual diagrams showing a setting mode and an operation mode according to a first embodiment. [Figure 8] 5 is a flowchart showing a process of the communication terminal according to the first embodiment; [Figure 9] FIG. 2 is a block diagram showing main functions of a server according to the first embodiment. [Figure 10] FIG. 10 is an image diagram showing an example of a character string indicating a control command. [Figure 11]10A and 10B are conceptual diagrams showing a setting mode and an operation mode according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. The names and functions of the components are also the same. Therefore, detailed description thereof will not be repeated. First Embodiment

[0009] First, the overall configuration of a network system 1 according to this embodiment will be described with reference to Fig. 1. The network system 1 according to this embodiment mainly includes a measurement device 200, a communication device 100, a network 500, a center-side network control device 400, a center server 300, and a card 600 on which text such as numbers and letters, images, etc. are written.

[0010] The measuring device 200 is a meter for measuring the charges for electricity, gas, water, etc., and in particular displays the cumulative measured value as the measurement result.

[0011] Communication device 100 is a device that can be attached later near measurement device 200. Communication device 100 uses a camera or OCR (Optical Character Reader) function to read the measurement value displayed by measurement device 200, and transmits the measurement value to server 300 using a communication antenna.

[0012] The server 300 acquires metered values ​​from the communication device 100 via a network 500 such as the Internet, and calculates charges for electricity, gas, water, etc. for each home, office, or building.

[0013] In this way, network system 1 according to this embodiment can provide accurate measurement values ​​to server 300 by retrofitting communication device 100 to measuring device 200, even if measuring device 200 is not previously connected to a network. In particular, communication device 100 according to this embodiment does not have a complex operation unit, but can use a camera to read a string of characters, such as multiple numbers, letters, and symbols, written on card 600, and accept input of various control commands corresponding to the string. These functions will be described in detail below.

[0014] 2(A), the measuring device 200 is a general device for measuring the amount of electricity, gas, or water used. The measuring device 200 is provided with a display unit 230 that is used by an operator to check the amount of usage up to that point when reading the meter. The display unit 230 may be a rotary analog display or a digital display.

[0015] In this embodiment, communication device 100 is attached to the front of measurement device 200. More specifically, as shown in Figures 2(A) and 2(B), communication device 100 is held in a state where camera 150 of communication device 100 faces display unit 230 on the front of measurement device 200. In this state, communication device 100 is fixed to measurement device 200 with a jig such as a cable tie, as shown in Figure 2(C).

[0016] The measuring device 200 generally has a circular housing with a rectangular display unit 230 as shown in FIG. 3, or a rectangular housing with a rectangular display unit 230 as shown in FIG. 4.

[0017] Next, one embodiment of the hardware configuration of communication device 100 will be described with reference to Fig. 5. Communication device 100 mainly includes a control microcomputer 110, a storage unit 120, an image sensor unit (i.e., a camera 150), a communication module 160, and a wireless interface 165.

[0018] Microcomputer 110 controls each unit of communication device 100 in accordance with a program in ROM or a program stored in storage unit 120. Microcomputer 110 according to this embodiment recognizes a string of numbers and letters from an image captured by camera 150, for example, by executing an application program with an OCR function.

[0019] The storage unit 120 stores the control program, images captured by the camera 170, recognized measurement values, and text data of recognized character strings.

[0020] The communication module 160 and the wireless interface 165 transmit various types of information to the center server 300 in accordance with instructions from the microcomputer 110 .

[0021] Camera 150 periodically, for example, once a month, follows instructions from microcomputer 110 and server 300 to capture images of display unit 230 of measuring device 200 in front of it or of a card presented in front of camera 150, and stores the captured image data in storage unit 120. In this embodiment, microcomputer 110 uses an OCR function based on the captured image to read out numeric strings as measurement values, character strings indicating control commands, and the like.

[0022] 6, the communication device 100 according to the present embodiment is mounted so that the imaging range 150X of the camera 150 includes the measurement value display area 230X of the display unit 230. As a result, every time an image is captured by the camera 150, the microcomputer 110 identifies the measurement value display area 230X and the character recognition range 230Y included in the imaging range 150X, and executes an application program for the OCR function in the storage unit 120 to recognize numbers as measurement values ​​and transmit them to the server 300.

[0023] In particular, in this embodiment, as shown in Fig. 7(A), within a predetermined time after turning on the power, or during operation mode, a meter reader, serviceman, or the like presents a transition card 601 so as to block the display unit 230. That is, when the transition card 601, on which a predetermined number for transitioning to the command input mode is written, is held in front of the camera 150, the microcomputer 110 recognizes the number by using the OCR function based on the image of the camera 150, and transitions to the command input mode.

[0024] Thereafter, a meter reader or serviceman presents a setting card so as to block the display unit 230. That is, when the setting card 602, on which predetermined numbers specifying various commands are written, is held up in front of the camera 150, the microcomputer 110 recognizes the numbers using the OCR function based on the image from the camera 150, and accepts input of the commands corresponding to the numbers.

[0025] After that, if a predetermined time has passed without another card being presented, microcomputer 110 ends the command input mode and transitions to the normal operation mode. Alternatively, if a meter reader, service person, or the like holds a transition card with a predetermined number for operation mode transition written thereon or the above-mentioned transition card 601 in front of camera 150 again so as to block display unit 230, microcomputer 110 recognizes the number based on the image from camera 150, thereby ending the command input mode and transitioning to the normal operation mode.

[0026] In the normal operation mode, as shown in Fig. 7(B), the microcomputer 110 periodically activates the camera 150 to capture still images and stores the image data in the storage unit 120. Based on the captured image, the microcomputer 110 uses the OCR function to read out a numeric string as a measurement value and uploads it to the server 300 together with the date and time of the image capture.

[0027] The communication device 100 may also include a display unit, which is a digital display that displays text and images in accordance with instructions from the microcomputer 110.

[0028] Furthermore, communication device 100 may have a simple operation unit. Examples of the operation unit include a button for turning the power on / off and a button for starting camera 150 to take a picture. Instead of operating with the user's fingers, camera 150 may be started to take a picture when microcomputer 110 detects a predetermined situation by using a six-axis sensor, a magnet, or the like.

[0029] The control process of the communication device 100 according to the present embodiment will be described in detail below. Referring to Fig. 8, the microcomputer 110 of the communication device 100 according to the present embodiment executes the following process in accordance with a program stored in the ROM or a program stored in the storage unit 120.

[0030] First, as shown in FIG. 2, communication device 100 is attached to the front of display unit 230 of measurement device 200 in a shipped state (step S100).

[0031] When the power supply of the communication device 100 is turned on (step S102), the microcomputer 110 activates the camera 150 and starts capturing an image of the front (step S104). At this time, the microcomputer 110 determines whether or not it recognizes a predetermined character string of numbers written on the transition card 601 based on the image captured by the camera 150 (step S104).

[0032] As shown in FIG. 7(A), when the microcomputer 110 recognizes a predetermined character string of numbers written on the transition card 601 via the camera 150, the microcomputer 110 transitions to the setting mode (step S112).

[0033] Microcomputer 110 recognizes the character string of numbers on setting card 602 that is subsequently presented (step S114), reads out a control command corresponding to the character string from storage unit 120, and executes the control command (step S116). For example, microcomputer 110 activates communication module 160 to measure the strength of communication radio waves, starts communication with server 300, recognizes a measurement value from an image captured by camera 150 using the OCR function and transmits it to server 300, transmits predetermined information corresponding to setting card 602 to server 300, and inputs, resets, or updates various setting conditions.

[0034] When the microcomputer 110 has completed the execution of the command (step S118), it repeats the process from step S104.

[0035] In step S116, if a predetermined time elapses without inputting a numeric string on the setting card 602, or if the numeric string on the card for transitioning to the operation mode is recognized (step S122), the microcontroller 110 transitions to the normal operation mode (step S130), as shown in Figure 7(B).

[0036] In step S104, if a predetermined time elapses without inputting a character string of numbers on the transition card 601 (step S124), the microcomputer 110 transitions to the normal operation mode (step S130), as shown in FIG. 7(B).

[0037] In step S130, the microcomputer 110 periodically activates the camera 150 at each meter reading date and time, for example, once a month or once a week, to capture a frontal image. The microcomputer 110 then uses the OCR function to identify the measurement value display area 230X and character recognition range 230Y from the captured image, reads the measurement value, and stores it in the memory unit 120 in association with the acquisition date and time. The microcomputer 110 transmits the numerical value of the measurement value and the acquisition date and time to the center server 300 via the communication module 160.

[0038] Even during such an operation mode, microcomputer 110 may periodically start camera 150, for example, every minute, and repeat the process from step S104. That is, microcomputer 110 may start camera 150 and execute step S104 at a predetermined timing other than when the power is turned on for the first time, or when a predetermined operation button is pressed, for example.

[0039] Next, a description will be given of the configuration of the center server 300. As shown in Fig. 9, the center server 300 includes a CPU (Central Processing Unit) 310, a memory 320, an operation unit 340, and a communication interface 360 ​​as main components.

[0040] CPU 310 controls each unit of server 300 by executing a program stored in memory 320. For example, CPU 310 executes a program stored in memory 320 and performs various processes, which will be described later, by referring to various data.

[0041] Memory 320 is realized by various types of RAM (Random Access Memory), various types of ROM (Read Only Memory), etc., and may be included in server 300, may be detachable from various interfaces of server 300, or may be a recording medium of another device accessible from server 300. Memory 320 stores programs executed by CPU 310, data generated by execution of programs by CPU 310, input data, other databases used for the service according to this embodiment, etc.

[0042] For example, the memory 320 stores meter reading data for each home. The meter reading data includes, for each customer, the customer's identification information, the customer's address, the measurement value history, the assigned worker, and the communication address of the worker's terminal.

[0043] The operation unit 340 receives commands from a service manager, operator, service technician, etc., and inputs the commands to the CPU 310 .

[0044] The communication interface 360 ​​transmits data from the CPU 310 to the center-side network control device 400, the communication device 100, and other devices via the Internet, a carrier network, a router, etc. Conversely, the communication interface 360 ​​receives data from the center-side network control device 400, the communication device 100, and other devices via the Internet, a carrier network, a router, etc., and passes the data to the CPU 310.

[0045] For example, in this embodiment, the CPU 310 adds the measurement value and measurement date and time received from the communication device 100 to the meter reading data in the memory 320, and stores the setting information received from the communication device 100 in the memory 320. <Second embodiment>

[0046] In the above embodiment, when the communication device 100 recognizes a string of numbers indicating the transition card 601, the device transitions to the setting mode. However, this is not a limitation. For example, a single card may contain a predetermined string of numbers indicating a control command and a string of numbers indicating the content of the control command. The two strings may be written side by side in a single horizontal row, or may be written in multiple rows.

[0047] For example, as shown in Figure 10, a control command card has a seven-digit number written on it, and if the first three digits are a predetermined number, such as "999," this indicates that the card is a control command. In this case, the remaining four digits indicate the type of control command.

[0048] Of course, other positions or digits may indicate that the card is a control command card or indicate the content of the control command.

[0049] Alternatively, rather than being limited to numbers, specific letters or symbols written in a specific position may indicate that the card is a control command card, or specific letters or symbols written in a specific position may indicate the content of the control command.

[0050] In this embodiment, as shown in FIG. 11A, within a predetermined time after power-on or during operation mode, a meter reader, service technician, or the like presents a control command card 603 so as to block the display unit 230. That is, the control command card 603, on which a first character string consisting of a predetermined number of digits indicating a control command and a second character string consisting of a plurality of digits indicating the content of the control command are printed side by side, is held up in front of the camera 150. The microcomputer 110 then uses the OCR function based on the image from the camera 150 to recognize the first character string and enter a control command input mode, and recognizes the second character string and accepts input of the corresponding control command. If a predetermined time has passed without another control command card 603 being presented, the command input mode is terminated and the system transitions to the normal operation mode.

[0051] 11(B), in the normal operation mode, the microcomputer 110 periodically activates the camera 150 to capture still images and stores the image data in the storage unit 120. Based on the captured images, the microcomputer 110 uses the OCR function to read out text such as numbers, letters, and symbols as measurement values, and uploads the text to the server 300 together with the date and time of the image capture.

[0052] More specifically, the control process of the communication device 100 according to the present embodiment will be described in detail. Referring to Fig. 8, the microcomputer 110 of the communication device 100 according to the present embodiment executes the following process in accordance with the program in the ROM and the program stored in the storage unit 120.

[0053] First, as shown in FIG. 2, communication device 100 is attached to the front of display unit 230 of measurement device 200 in a shipped state (step S100).

[0054] When the power supply of the communication device 100 is turned on (step S102), the microcomputer 110 activates the camera 150 and starts capturing an image of the front (step S104). At this time, the microcomputer 110 determines whether or not the first character string of numbers written on the control instruction card 603 is recognized based on the image captured by the camera 150 (step S104).

[0055] As shown in FIG. 11(A), when the microcomputer 110 recognizes the first character string on the control instruction card 603 via the camera 150 (step S112), the microcomputer 110 transitions to the setting mode (step S114).

[0056] Based on the second character string written following the control command card 603, the microcomputer 110 reads out a control command corresponding to the character string from the storage unit 120 and executes the control command (step S116). For example, the microcomputer 110 activates the communication module 160 to measure the strength of the communication radio wave, starts communication with the server 300, recognizes a measurement value from an image captured by the camera 150 using the OCR function and transmits the value to the server 300, transmits predetermined information corresponding to the control command card 603 to the server 300, and inputs, resets, or updates various setting conditions.

[0057] When the microcomputer 110 has completed the execution of the command (step S118), it repeats the process from step S104.

[0058] In step S116, if a predetermined time elapses without the input of a numeric string from another control command card 603, or if the numeric string from a card for transitioning to operation mode is recognized (step S122), the microcontroller 110 transitions to normal operation mode (step S130), as shown in Figure 11 (B).

[0059] In step S104, if a predetermined time elapses without inputting a character string of numbers on the control command card 603 (step S124), the microcomputer 110 transitions to the normal operation mode (step S130), as shown in FIG. 11(B).

[0060] In step S130, the microcomputer 110 periodically activates the camera 150 at each meter reading date and time, for example, once a month or once a week, to capture a frontal image. The microcomputer 110 then uses the OCR function to identify the measurement value display area 230X and character recognition range 230Y from the captured image, reads the measurement value, and stores it in the memory unit 120 in association with the acquisition date and time. The microcomputer 110 transmits the numerical value of the measurement value and the acquisition date and time to the center server 300 via the communication module 160.

[0061] Even during such an operation mode, microcomputer 110 may periodically start camera 150, for example, every minute, and repeat the process from step S104. That is, microcomputer 110 may start camera 150 and execute step S104 at a predetermined timing other than when the power is turned on for the first time, or when a predetermined operation button is pressed, for example. <Third embodiment>

[0062] In the above embodiment, transition cards 601, setting cards 602, and control command cards 603 are prepared with predetermined character strings of numbers written on them, but the present invention is not limited to this configuration.

[0063] For example, instead of the transition card 601, an application program on a smartphone, tablet, or other device held by the worker may display a string of numbers on the screen of the terminal to transition to the setting mode, and the string may be recognized by the communication device 100. Similarly, instead of the setting card 602, an application program on a smartphone, tablet, or other device may display a string of numbers on the screen of the terminal to specify a setting command, and the string may be recognized by the communication device 100. Similarly, instead of the control command card 603, an application program on a smartphone, tablet, or other device may display a first string of numbers indicating that a control command is to be input and a second string of numbers for specifying the control command itself, and the strings may be recognized by the communication device 100.

[0064] Alternatively, instead of the transition card 601, the worker may write a string of numbers for transitioning to the setting mode in a notebook or the like, and have the string recognized by the communication device 100. Similarly, instead of the setting card 602, the worker may write a string of numbers for transitioning to the setting mode in a notebook or the like, and have the string recognized by the communication device 100. Similarly, instead of the control command card 603, the worker may write a first string of numbers indicating that a control command is being input and a second string of numbers for specifying the control command itself in a notebook or the like, and have the strings recognized by the communication device 100. <Fourth embodiment>

[0065] Some or all of the roles of the devices in the network system 1 in the above-described embodiment may be performed by other devices. For example, in the above-described embodiment, the communication device 100 uses the OCR function to recognize a measurement value, recognize a character string of numbers, identify the corresponding control command, and execute the control command.

[0066] However, the communication device 100 may transmit the recognized numeric character string to the center server 300. In this case, the CPU 310 of the center server 300 may transmit a control command corresponding to the numeric character string to the communication device 100, the microcomputer 110 of the communication device 100 may execute the control command, or the CPU 310 of the server 300 may execute the control command.

[0067] Furthermore, the CPU 310 of the center server 300 may read out the measurement value and identify the character string of numbers from the captured image transmitted by the communication device 100. <Summary>

[0068] In the above embodiment, a communication device is provided that includes a communication unit for communicating with a server, a camera for photographing the display unit of the measuring device, and a control unit that uses an OCR function to read measurement values ​​from the image captured by the camera and send them to the server, and reads specified information from the image captured by the camera and performs processing on the information.

[0069] Preferably, the control unit uses the OCR function to read a predetermined character string from an image captured by the camera, transitions to a command input mode, and then executes a command corresponding to the character string read from the image captured by the camera.

[0070] Preferably, when the control unit reads text including a first character string from an image captured by the camera by using the OCR function, it executes a command corresponding to a second character string included in the text.

[0071] In the above embodiment, an information processing method for a communication device that reads a measurement value by photographing a display unit of a measurement device is provided, which includes the steps of: reading a measurement value from an image photographed by a camera using an OCR function and transmitting the read measurement value to a server; The method further comprises a step of reading predetermined information from an image captured by the camera using the OCR function and executing processing on the information.

[0072] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0073] 1: Network system 100: Communication equipment 110: Microcomputer 120: Storage section 150: Camera 150X: Shooting range 160: Communication module 165: Wireless interface 170: Camera 200: Measuring equipment 230:Display section 230X: Display area 230Y: Character recognition range 300: Center server 310: CPU 320: Memory 340:Operation unit 360: Communication interface 400: Center side network control device 500: Network 600: Card 601: Transition Card 602: Setting card 603: Control command card

Claims

1. a communication unit for communicating with the server; a camera for photographing the display unit of the measuring device; a control unit for reading a measurement value from an image captured by the camera and transmitting the measurement value to the server by using an OCR function, and for reading predetermined information from the image captured by the camera and executing processing on the information, The control unit uses an OCR function to read a specified character string from an image captured by the camera, transitions to a command input mode, and then executes a command corresponding to the character string read from the image captured by the camera.

2. a communication unit for communicating with the server; a camera for photographing the display unit of the measuring device; a control unit for reading a measurement value from an image captured by the camera and transmitting the measurement value to the server by using an OCR function, and for reading predetermined information from the image captured by the camera and executing processing on the information, A communication device in which the control unit, when reading text including a first string from an image captured by the camera by using an OCR function, executes a command corresponding to a second string included in the text.

3. An information processing method for a communication device that reads a measurement value by photographing a display unit of a measurement device, comprising: reading the weight value from the image captured by the camera using an OCR function and transmitting the weight value to a server; An information processing method comprising the steps of: using an OCR function to read a predetermined character string from an image captured by the camera, transitioning to a command input mode, and then executing a command corresponding to the character string read from the image captured by the camera.

4. An information processing method for a communication device that reads a measurement value by photographing a display unit of a measurement device, comprising: reading the weight value from the image captured by the camera using an OCR function and transmitting the weight value to a server; An information processing method comprising: when text including a first character string is read from an image captured by the camera by utilizing an OCR function, executing a command corresponding to a second character string included in the text.

Images