A meter identification method and system
Patent Information
- Application Number
- CN202311701170.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-12
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2043-12-12
AI Technical Summary
而由于录像机与摄像机之间无法进行会话,因此,对于摄像机发送至录像机的需要进行表计识别的图片,录像机无法确定通过何种方式对该图片进行表计识别
[0013]This application provides a meter identification method and system. The meter identification method is applied to a meter identification system including a video recorder and one or more cameras. When a first camera is added to the meter identification system, a user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are used to at least indicate the position of a preset accessory of the meter in the first image. The camera wakes up and goes into sleep mode according to the wake-up plan, and captures a second image after waking up. The second image and the configured calibration set ID are sent to the video recorder according to the communication address. In response to the calibration set ID and the second image, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image. Since the user terminal, when the first camera is integrated into the meter identification system, is configured with a calibration set ID, a wake-up plan, and a recorder's communication address, the calibration set ID identifies the first camera. Therefore, the camera can wake up and go into sleep mode according to the wake-up plan, and capture a second image after waking up. The camera does not need to be in continuous operation, achieving low power consumption. Furthermore, when the recorder receives the second image and the configured calibration set ID from the camera via the communication address, it can identify the camera that sent the second image through the calibration set ID. Moreover, since the recorder stores the calibration set ID and corresponding calibration parameters of the first camera, when performing meter identification on the second image captured by the camera, it can determine the calibration parameters corresponding to the calibration set ID received when receiving the second image. These calibration parameters are the calibration parameters corresponding to the camera that sent the second image, allowing the recorder to identify the second image according to the determined calibration parameters and obtain the meter readings in the second image. As can be seen, under the premise of meeting the low power consumption requirements of the camera, the video recorder can determine the calibration parameters corresponding to the camera that captured the second image through the calibration set ID, thereby indirectly realizing the conversation between the video recorder and the camera, so that the camera and the video recorder establish a connection and can complete data transmission. Thus, without affecting the low power consumption requirements in the meter recognition scenario, the video recorder and the camera can be connected.
Smart Images

Figure CN117876648B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of video information acquisition and analysis methods, and in particular to a meter identification method and system. Background Technology
[0002] In meter identification scenarios, cameras used to capture meter images, such as macro cameras, are mostly in sleep mode to reduce power consumption. Furthermore, cameras cannot maintain heartbeat messages in sleep mode, preventing communication between the recorder and the camera. Since different cameras are installed at different locations and angles, the images captured by different cameras contain different meters, typically requiring different identification methods for meter identification. Because the recorder and camera cannot communicate, the recorder cannot determine the appropriate method for meter identification of images sent from the camera. In existing technologies, enabling the recorder to perform meter identification on received images usually requires the camera to be in a continuous operating state to establish a communication between the recorder and camera, thus preventing the camera from reducing its own power consumption. Therefore, existing technologies cannot achieve interoperability between the recorder and camera without compromising the low-power requirements of meter identification scenarios. Summary of the Invention
[0003] The purpose of this application is to provide a meter identification method and system to achieve interoperability between a video recorder and a camera without affecting the low power consumption requirements in meter identification scenarios. The specific technical solution is as follows:
[0004] This application provides a meter identification method applied to a meter identification system. The meter identification system includes a video recorder and one or more cameras. When a first camera joins the meter identification system, a user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera joins the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are at least used to indicate the position of a preset accessory of the meter in the first image.
[0005] The method includes: the camera wakes up and goes into sleep mode according to the wake-up plan, and after waking up, it captures a second image and sends the second image and a configured calibration set ID to the video recorder according to the communication address; in response to the calibration set ID and the second image, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
[0006] This application embodiment also provides a meter identification system, the system including a video recorder and one or more cameras. When a first camera joins the meter identification system, a user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera joins the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are at least used to indicate the position of a preset accessory of the meter in the first image.
[0007] The camera is used to wake up and go into sleep according to the wake-up plan, and after waking up, it takes a second picture and sends the second picture and the configured calibration set ID to the video recorder according to the communication address; the video recorder is used to respond to the calibration set ID and the second picture, determine the calibration parameters corresponding to the calibration set ID, and identify the second picture according to the determined calibration parameters to obtain the meter reading in the second picture.
[0008] This application embodiment also provides a camera applied to a meter identification system, wherein the camera is any one of the cameras included in the meter identification system; the meter identification system further includes a video recorder, wherein when the first camera joins the meter identification system, the user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image; when the first camera joins the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly, wherein the calibration parameters are the first images captured by the first camera. The parameters obtained by calibrating the meter in the image, and the calibration parameters are at least used to indicate the position of the preset accessories of the meter in the first image; the camera includes: a memory for storing computer programs; a processor for executing the program stored in the memory, waking up and sleeping according to the wake-up plan, and capturing a second image after waking up, and sending the second image and the configured calibration set ID to the video recorder according to the communication address, so that the video recorder responds to the calibration set ID and the second image, determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter reading of the meter in the second image.
[0009] This application embodiment also provides a video recorder applied to a meter identification system. The meter identification system further includes one or more cameras. When a first camera joins the meter identification system, a user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera joins the meter identification system, the video recorder obtains the calibration set ID of the first camera and the corresponding calibration parameters of the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera. The calibration parameters are used to indicate at least the position of the preset accessories of the meter in the first image; the video recorder includes: a memory for storing computer programs; a processor for executing the program stored in the memory, responding to the calibration set ID and the second image, determining the calibration parameters corresponding to the calibration set ID, and identifying the second image according to the determined calibration parameters to obtain the meter reading of the meter in the second image; wherein, the second image and the calibration set ID are obtained by the camera being woken up and put into sleep mode according to the wake-up plan, and the second image is captured after being woken up, and the second image and the configured calibration set ID are sent to the video recorder according to the communication address.
[0010] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements any of the meter identification methods described above.
[0011] This application also provides a computer program product containing instructions that, when run on a computer, cause the computer to execute any of the meter identification methods described above.
[0012] Beneficial effects of the embodiments in this application:
[0013] This application provides a meter identification method and system. The meter identification method is applied to a meter identification system including a video recorder and one or more cameras. When a first camera is added to the meter identification system, a user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are used to at least indicate the position of a preset accessory of the meter in the first image. The camera wakes up and goes into sleep mode according to the wake-up plan, and captures a second image after waking up. The second image and the configured calibration set ID are sent to the video recorder according to the communication address. In response to the calibration set ID and the second image, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image. Since the user terminal, when the first camera is integrated into the meter identification system, is configured with a calibration set ID, a wake-up plan, and a recorder's communication address, the calibration set ID identifies the first camera. Therefore, the camera can wake up and go into sleep mode according to the wake-up plan, and capture a second image after waking up. The camera does not need to be in continuous operation, achieving low power consumption. Furthermore, when the recorder receives the second image and the configured calibration set ID from the camera via the communication address, it can identify the camera that sent the second image through the calibration set ID. Moreover, since the recorder stores the calibration set ID and corresponding calibration parameters of the first camera, when performing meter identification on the second image captured by the camera, it can determine the calibration parameters corresponding to the calibration set ID received when receiving the second image. These calibration parameters are the calibration parameters corresponding to the camera that sent the second image, allowing the recorder to identify the second image according to the determined calibration parameters and obtain the meter readings in the second image. As can be seen, under the premise of meeting the low power consumption requirements of the camera, the video recorder can determine the calibration parameters corresponding to the camera that captured the second image through the calibration set ID, thereby indirectly realizing the conversation between the video recorder and the camera, so that the camera and the video recorder establish a connection and can complete data transmission. Thus, without affecting the low power consumption requirements in the meter recognition scenario, the video recorder and the camera can be connected.
[0014] Of course, implementing any product or method of this application does not necessarily require achieving all of the above advantages at the same time. Attached Figure Description
[0015] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other embodiments can be obtained based on these drawings.
[0016] Figure 1 A schematic flowchart illustrating a meter identification method for cameras provided in an embodiment of this application;
[0017] Figure 2 A data interaction diagram illustrating the meter identification method provided in this application embodiment;
[0018] Figure 3 Another data interaction diagram for the meter identification method provided in the embodiments of this application;
[0019] Figure 4 This is another data interaction diagram of the meter identification method provided in the embodiments of this application;
[0020] Figure 5 A schematic flowchart of a meter identification method for a video recorder provided in an embodiment of this application;
[0021] Figure 6 A schematic diagram of the calibration interface provided in the embodiments of this application;
[0022] Figure 7 Another schematic diagram of the calibration interface provided in the embodiments of this application;
[0023] Figure 8 This is a schematic diagram of a meter type in the meter identification method provided in the embodiments of this application;
[0024] Figure 9 A schematic diagram of a mode switching interface for a video recorder provided in an embodiment of this application;
[0025] Figure 10 Another schematic diagram of the mode switching interface for a video recorder provided in this application embodiment;
[0026] Figure 11 A network scenario topology diagram for the meter identification method provided in this application embodiment;
[0027] Figure 12 A schematic diagram of the structure of a meter identification device provided in an embodiment of this application;
[0028] Figure 13 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0029] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art based on this application are within the scope of protection of this application.
[0030] To more clearly explain the meter identification method provided in this application, the relevant concepts involved in this document will be briefly explained below:
[0031] Hibernation: The device module enters a non-working and power-consuming mode, while only the wake-up module remains operational.
[0032] Meter identification: By acquiring image data of meters, an algorithmic analysis of meter readings is performed to obtain the meter value.
[0033] Low power consumption: A technology that consumes less power during device operation. Low power consumption can be achieved by putting the device into sleep mode when it is not in use and waking it up when it is in use.
[0034] Macro camera: A low-power camera used in meter reading scenarios to capture images at set intervals. A macro camera is a camera whose focal length meets preset focal length conditions. These preset focal length conditions can be expressed in the form of a numerical range or a numerical value. For example, preset focal length conditions can be set to 50mm-105mm, 85mm-105mm, 60mm, 100mm, 200mm, etc.
[0035] Calibration: The rule parameter configuration of the meter identification algorithm. Each meter's calibration parameter corresponds to a calibration set ID as a unique identifier.
[0036] To achieve interoperability between a video recorder and a camera without compromising low power consumption requirements in meter identification scenarios, this application provides a meter identification method and system. The meter identification method provided in this application will be described first by way of example.
[0037] This application provides a meter identification method applied to a meter identification system. The meter identification system includes a video recorder and one or more cameras. When a first camera is added to the meter identification system, a user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the meter identification system, the video recorder obtains the calibration set ID of the first camera and the corresponding calibration parameters of the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are used to at least indicate the position of a preset accessory of the meter in the first image. Figure 1 As shown, the method includes:
[0038] S101, the camera wakes up and goes into sleep mode according to the wake-up plan, and after waking up, it takes a second picture and sends the second picture and the configured calibration set ID to the recorder according to the communication address.
[0039] S102, in response to the calibration set ID and the second image, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
[0040] In this embodiment, the meter identification method is applied to a meter identification system including a video recorder and one or more cameras. When a first camera is added to the meter identification system, the user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the meter identification system, the video recorder obtains the calibration set ID of the first camera and the corresponding calibration parameters of the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are used to at least indicate the position of the preset accessories of the meters in the first image. The camera wakes up and goes into sleep mode according to the wake-up plan, and captures a second image after waking up. It then sends the second image and the configured calibration set ID to the video recorder according to the communication address. In response to the calibration set ID and the second image, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image. Since the user terminal, when the first camera is integrated into the meter identification system, is configured with a calibration set ID, a wake-up plan, and a recorder's communication address, the calibration set ID identifies the first camera. Therefore, the camera can wake up and go into sleep mode according to the wake-up plan, and capture a second image after waking up. The camera does not need to be in continuous operation, achieving low power consumption. Furthermore, when the recorder receives the second image and the configured calibration set ID from the camera via the communication address, it can identify the camera that sent the second image through the calibration set ID. Moreover, since the recorder stores the calibration set ID and corresponding calibration parameters of the first camera, when performing meter identification on the second image captured by the camera, it can determine the calibration parameters corresponding to the calibration set ID received when receiving the second image. These calibration parameters are the calibration parameters corresponding to the camera that sent the second image, allowing the recorder to identify the second image according to the determined calibration parameters and obtain the meter readings in the second image. As can be seen, under the premise of meeting the low power consumption requirements of the camera, the video recorder can determine the calibration parameters corresponding to the camera that captured the second image through the calibration set ID, thereby indirectly realizing the conversation between the video recorder and the camera, so that the camera and the video recorder establish a connection and can complete data transmission. Thus, without affecting the low power consumption requirements in the meter recognition scenario, the video recorder and the camera can be connected.
[0041] The following section will illustrate the meter identification method provided in this application by describing the data interaction process between the user terminal, the video recorder, and the camera in a specific application scenario.
[0042] The meter identification method provided in this application is applied to a meter identification system, which includes a video recorder and one or more cameras. If the meter identification system includes one camera, that camera can be used as the first camera. If the meter identification system includes multiple cameras, any one of the multiple cameras can be used as the first camera. Therefore, the following will take any one of the cameras included in the meter identification system, i.e., the first camera, as an example to illustrate the process of configuring the calibration set ID, wake-up plan, and communication address of the video recorder for the camera when it is added to the meter identification system, and controlling the camera to capture the first image.
[0043] With the first camera integrated into the meter recognition system, the data interaction diagram between the user terminal and the first camera can be as follows: Figure 2 As shown, Figure 2 In the example shown, the user terminal is a mobile application (APP), and the first camera is a macro camera. In other possible examples, the user terminal can also be any electronic device capable of implementing the meter identification method of this application, such as a tablet computer or a laptop computer, and the first camera can also be a low-power camera of other types besides a macro camera. This application does not limit the device types of the user terminal and the first camera.
[0044] See Figure 2 When the first camera is added to the meter identification system, the user terminal (i.e., the mobile app) configures the calibration set ID, wake-up plan, and video recorder communication address for the first camera (i.e., the macro camera). Since the first camera's addition to the meter identification system can be considered its first activation within the system, the user terminal's configuration of the calibration set ID, wake-up plan, and video recorder communication address can be seen as the user terminal configuring parameters for the first camera. Therefore, the above process can be considered as the user terminal waking up, activating, and configuring parameters for the camera during its first activation.
[0045] When the first camera is integrated into the meter identification system, the user terminal can obtain basic information about the first camera and automatically generate, or manually input by the user, a calibration set ID for the first camera, thereby configuring the camera's parameters. During parameter configuration, the user terminal can send basic parameters, including timed wake-up parameters, network parameters, and the recorder's port configuration parameters, to the first camera. The timed wake-up parameters are the wake-up plan configured by the user terminal for the first camera, which wakes and sleeps according to the plan. The network parameters are the calibration set ID configured by the user terminal to identify the first camera. The recorder's port configuration parameters are the recorder's communication address, through which the first camera can send information to the recorder. When configuring the first camera's parameters, the user terminal can also send a capture command to the first camera to control it to capture a first image, i.e., to control the first camera to capture a calibration image.
[0046] The calibration parameters for the first camera are obtained by calibrating the first image (i.e., the calibration image) captured by the first camera. This allows for the configuration of the calibration parameters and enables meter identification in the second image captured by the first camera based on these parameters. The calibration parameters are obtained by calibrating the meters in the first image captured by the first camera, and these parameters at least indicate the position of the meter's preset accessories in the first image. The specific process of calibrating the first image to obtain the calibration parameters will be described later and will not be repeated here.
[0047] Since meter identification in the meter identification system is performed using a video recorder, it is necessary to store the calibration parameters corresponding to all cameras in the system within the video recorder. Furthermore, in order for the video recorder to determine the correspondence between the stored calibration parameters and the cameras, the video recorder also needs to obtain the camera's calibration set ID, and then store the corresponding camera's calibration set ID and calibration parameters within the video recorder.
[0048] In the context of meter identification and analysis, cameras in a meter identification system can play different roles, providing different data and parameters to the video recorder. Consequently, the video recorder needs to implement different functions, and the methods by which the video recorder obtains the camera's calibration set ID and the camera's corresponding calibration parameters are also different.
[0049] In one possible embodiment, the camera can provide the recorder with its corresponding calibration parameters and calibration set ID. The camera can also serve as an analysis data source, providing the recorder with analysis data, specifically the second image required for meter identification analysis. Therefore, the recorder needs to store the received camera-related calibration parameters and calibration set ID, and perform meter identification analysis on the received analysis data, i.e., the second image. In this embodiment, the recorder can obtain and store the camera's calibration set ID and corresponding calibration parameters by receiving and storing the camera-related calibration parameters and calibration set ID sent by the camera. This acquisition method will be referred to as Method 1 below.
[0050] In another possible embodiment, the camera can serve solely as a data source for analysis, providing the video recorder with analytical data, specifically the second image required for meter identification analysis. In this case, the video recorder needs to configure the camera's calibration parameters and perform meter identification analysis on the second image. In this embodiment, the video recorder can obtain and store the camera's calibration set ID and corresponding calibration parameters by receiving the first image captured by the camera and the camera's calibration set ID, and by calibrating the first image. This acquisition method will be referred to as Method Two below.
[0051] The following will take any one of the cameras included in the meter identification system, namely the first camera, as an example to illustrate the specific process by which the video recorder obtains the camera's calibration set ID and the corresponding calibration parameters of the camera through the above-mentioned methods one and two, and stores them accordingly when the camera is added to the meter identification system.
[0052] Method 1: The first camera sends the captured first image to the user terminal, so that the user terminal can calibrate the meter in the first image to obtain calibration parameters, and send the calibration parameters back to the first camera; the video recorder receives the calibration set ID and calibration parameters sent by the first camera according to the communication address and stores them accordingly.
[0053] See Figure 2 , Figure 3When the first camera is integrated into the meter recognition system, after capturing a first image (i.e., a calibration image) in response to a capture command sent by the user terminal (i.e., a mobile APP), the first camera (i.e., a macro camera) sends the first image to the user terminal. The user terminal can calibrate the meters in the first image to obtain the calibration parameters corresponding to the first camera. Since the calibration set ID of the first camera is configured by the user terminal, the user terminal can also determine the calibration set ID of the first camera, thereby generating the calibration set ID and calibration parameters. Before the first camera goes into sleep mode, the user terminal sends the calibration set ID and calibration parameters of the first camera to the first camera. The first camera saves the received calibration set ID and calibration parameters, thus achieving calibration set saving. In this process, since the user terminal has already configured the calibration set ID for the first camera when configuring the parameters of the first camera, in one possible implementation, the user terminal can also only send the calibration parameters of the first camera to the first camera. The first camera can still provide the recorder with its own corresponding calibration set ID and calibration parameters.
[0054] After the user terminal configures the parameters of the first camera, the first camera may enter a sleep state. However, since the user terminal has sent the calibration set ID and corresponding calibration parameters of the first camera to the first camera before the first camera went into sleep mode, the first camera has already saved its own calibration set ID and corresponding calibration parameters.
[0055] See Figure 3 After the first camera enters sleep mode, the low-power module can perform real-time monitoring to wake it up and put it back into sleep mode according to the wake-up plan configured by the user terminal. When the first camera is woken up, it can capture a second image, thus realizing the wake-up image capture function. Furthermore, the first camera can send a message composed of the second image, the calibration set ID corresponding to the first camera, and calibration parameters to the recorder via the data reporting module, according to the recorder's communication address. This allows the recorder to obtain the calibration set ID and calibration parameters of the first camera through the first camera.
[0056] When the video recorder receives the second image, the calibration set ID corresponding to the first camera, and the calibration parameters sent by the first camera, it saves the calibration parameters corresponding to the first camera to the video recorder's local calibration set library. It also uses the calibration set ID of the first camera as the identifier for the calibration parameters stored in the calibration set library, thus achieving corresponding storage of the calibration set ID and the calibration parameters of the first camera. Furthermore, since the video recorder receives the second image captured by the first camera at the same time as receiving the calibration set ID and corresponding calibration parameters, it can also perform meter readings on the second image to obtain the meter readings shown in the second image.
[0057] Using this embodiment, the user terminal can calibrate the first image to obtain calibration parameters, and then send these calibration parameters to the first camera. The recorder receives the calibration parameters and calibration set ID corresponding to the first camera and stores them accordingly. This ensures that when a camera joins the meter recognition system, the recorder can obtain the calibration parameters and calibration set ID corresponding to that camera. Consequently, the recorder can store the calibration parameters and calibration set IDs corresponding to all cameras in the meter recognition system, allowing it to perform meter recognition analysis on the second image based on the stored calibration set IDs and corresponding calibration parameters. Furthermore, in this process, the recorder does not need to perform calibration on the first image, only on the second image, thus reducing the use of the recorder's computing resources.
[0058] Method 2: The first camera sends the captured first image to the user terminal, so that the user terminal sends the first image and calibration set ID to the video recorder; the video recorder receives the calibration set ID and the first image sent by the user terminal; the video recorder calibrates the first image, obtains calibration parameters, and stores the received calibration set ID and calibration parameters accordingly.
[0059] See Figure 4 When the first camera is integrated into the meter recognition system, after capturing a first image (i.e., a calibration image) in response to a capture command sent by the user terminal (i.e., a mobile app), the first camera (i.e., a macro camera) sends the first image to the user terminal. During the parameter configuration process for the first camera, the user terminal has already configured a calibration set ID for it; that is, the user terminal has already generated the calibration set ID for the first camera. After receiving the first image sent by the first camera, the user terminal can send the first image and the calibration set ID of the first camera to the recorder.
[0060] After receiving the first image and the calibration set ID of the first camera sent by the user terminal, the video recorder can calibrate the first image to obtain calibration parameters, i.e., the video recorder performs meter parameter calibration. Since the first image was captured by the first camera, the calibration parameters obtained by the video recorder from calibrating the first image are the calibration parameters corresponding to the first camera. Therefore, the video recorder obtains the calibration set ID of the first camera and the corresponding calibration parameters. Furthermore, the video recorder can store the first image, the calibration set ID of the first camera, and the calibration parameters in the video recorder's local calibration set library.
[0061] Using this embodiment, a user terminal can receive a first image sent by a first camera and send the first image and the calibration set ID of the first camera to a video recorder. The video recorder calibrates the received first image to obtain calibration parameters and stores them as calibration parameters corresponding to the received calibration set ID. This allows the video recorder to obtain the calibration parameters and calibration set ID of any camera added to the meter identification system. Consequently, the video recorder can store the calibration parameters and calibration set IDs of all cameras in the meter identification system, enabling it to perform meter identification analysis on the second image based on the stored calibration set IDs and corresponding calibration parameters. Furthermore, in this process, the camera does not need to send calibration parameters to the video recorder, thus reducing the amount of data required for the camera to send messages and reducing the bandwidth occupied by the camera transmitting messages to the video recorder.
[0062] Using either method one or method two described above, the video recorder can obtain the calibration set IDs and corresponding calibration parameters of all cameras included in the meter identification system, and store the calibration set IDs and corresponding calibration parameters of each camera in the calibration set library. This allows the video recorder to perform meter identification on the received second image based on its stored calibration set IDs and corresponding calibration parameters. The following is an exemplary description of the specific process of the video recorder's meter identification of the second image, specifically, an exemplary description of the aforementioned steps S101-S102.
[0063] See Figure 3 , Figure 4 The low-power module of the camera (i.e., macro camera) can monitor the camera itself in real time to wake up and go into sleep mode according to the wake-up plan configured by the user terminal. When the camera is woken up, it can capture a second image, thus realizing the wake-up image capture function. Furthermore, the camera can obtain its own stored calibration set ID by listening to host parameters. At this point, the camera can send the second image and the camera's calibration set ID to the recorder via the data reporting module according to the recorder's communication address, thus realizing the aforementioned S101.
[0064] See you again Figure 3 , Figure 4 When the recorder receives the second image and calibration set ID from the camera, it can perform calibration set matching in the calibration set library based on the calibration set ID, determine the calibration parameters corresponding to the calibration set ID, and then use an algorithm model to perform meter recognition analysis on the second image according to the calibration parameters determined by the calibration set ID, obtaining the meter readings in the second image. Furthermore, the recorder can save and upload the meter readings to the platform server, thus achieving... Figure 3 , Figure 4 The results are reported. This process achieves the aforementioned S102. The meter result can refer to the meter reading in the second image, or it can refer to the state of the meter in the second image.
[0065] The process of the video recorder performing meter recognition analysis on the second image using an algorithm model based on the calibration parameters determined by the calibration set ID can be as follows: Figure 5 As shown, calibration information (i.e., the calibration parameters determined based on the calibration set ID), calibration image (i.e., the aforementioned first image), and test image (i.e., the aforementioned second image) can be input into the meter recognition algorithm library. The algorithm library then performs meter readings on the second image based on the determined calibration parameters and the first image, i.e., meter recognition. The meter reading information output by the algorithm library is used as the meter reading result in the second image. The calibration parameters can be stored in the form of a JSON file.
[0066] If the recorder obtains the camera's calibration set ID and calibration parameters using the aforementioned method one (i.e., by receiving and storing the camera's corresponding calibration parameters and calibration set ID), then during the process of obtaining the camera's calibration set ID and calibration parameters, the camera will send the second image, the camera's calibration set ID, and calibration parameters to the recorder according to the recorder's communication address. However, during the recorder's meter reading of the second image, the camera will only send the second image and the camera's calibration set ID to the recorder according to the recorder's communication address. The content of the information sent by the camera to the recorder differs in these two processes, indicating that the information received by the recorder may contain different information. If the recorder cannot distinguish whether the received information contains the camera's calibration parameters, it cannot determine whether the currently received information needs to be saved. If the recorder saves all received information to the calibration set library, it may result in the calibration set library storing a large amount of useless information, increasing the recorder's load.
[0067] Based on this, in one possible embodiment, the video recorder is equipped with a listening port corresponding to the communication address; the meter identification method provided in this application further includes: in response to the information received by the video recorder through the communication address, the listening port determines whether the information contains calibration parameters; if the information contains calibration parameters, the video recorder stores the received calibration set ID and calibration parameters in the calibration set library; if the information does not contain calibration parameters, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
[0068] See Figure 3 , Figure 4 When configuring camera parameters, the user terminal assigns a video recorder's communication address to the camera. The video recorder is equipped with a corresponding listening port for this communication address, enabling it to act as an alarm server and trigger alarms for information received through this address. When the video recorder receives information through this communication address, the listening port determines whether the received information contains calibration parameters. If the received information contains calibration parameters, the video recorder stores the received calibration set ID and corresponding calibration parameters in the calibration set library. If the received information does not contain calibration parameters, the video recorder can determine the calibration parameters corresponding to the calibration set ID in the received information by matching calibration set IDs in the calibration set library, and then identify the second image according to the determined calibration parameters to obtain the meter readings in the second image.
[0069] By using this embodiment, the video recorder can determine whether the received information contains the camera's calibration parameters by setting a listening port on the communication address used by the camera when sending information. This allows the video recorder to save the calibration parameters and calibration set ID when the received information contains calibration parameters, and to perform meter recognition on the second image when the received information does not contain calibration parameters. This reduces the load on the video recorder and improves the efficiency of meter recognition.
[0070] In Method 1, the calibration parameters are obtained by the user terminal calibrating the first image. In Method 2, the calibration parameters are obtained by the video recorder calibrating the first image. In this example, the calibration can be achieved by the user accessing the video recorder through the user terminal, or by the user calibrating the first image on the video recorder's own display screen. While the entities executing the calibration process differ between Method 1 and Method 2, the process of calibrating the first image is the same in both methods. The process of obtaining the calibration parameters by calibrating the first image will be illustrated below.
[0071] Display the calibration interface; the calibration interface includes a first image, drawing controls, and a confirmation control; in response to a drawing operation on the drawing controls, draw the outline pattern of the preset accessories in the meter on the first image according to the drawing operation; in response to a confirmation operation on the confirmation controls, calculate the position of the outline pattern in the first image as a calibration parameter.
[0072] For example, the calibration interface can be found here. Figure 6 , Figure 7 . Figure 6 , Figure 7 The left side of the image shows the first picture displayed on the calibration interface.
[0073] The "preset accessories" refer to the necessary accessories for identifying the meter readings in the first image. For example, when the meter in the first image is a pointer meter, such as... Figure 6 As shown in the first image on the left, when identifying the meter reading pointer, it is necessary to know the meter position, pointer position, center position, and scale position of the pointer. In this example, the preset accessories refer to the meter, pointer, center of the meter, and scale.
[0074] When the meter in the first picture is a digital meter, such as Figure 7 As shown in the first image on the left, when identifying this digital meter, it is only necessary to obtain the position of the digital meter. The algorithm can then identify the number at that position to obtain the meter reading. In this example, the preset accessory refers to the meter.
[0075] Users can input drawing operations by clicking the drawing control in the calibration interface and drawing on the first image. This allows them to draw the outline of a preset component of the meter in the first image displayed on the calibration interface, thus obtaining the outline pattern of the preset component of the meter in the first image. For example, as shown... Figure 6 The drawing buttons following "Position Box," "Center," and "Scale" in the image can be considered as drawing controls. They can be used to draw the outlines of the preset components of the reading pointer in the first image: the meter, the center of the meter, and the scale. The polygon button following "Pointer" allows drawing the polygon outline of the preset component pointer in the first image, and the rectangle button allows drawing the rectangular outline of the preset component pointer in the first image. Both the polygon and rectangle buttons can be considered as drawing controls.
[0076] After drawing, the user can confirm the drawing by clicking the confirmation control in the calibration interface. This allows the position of the outline pattern in the first image to be calculated and used as calibration parameters. For example, as shown... Figure 6 , Figure 7The save button after "meter calibration" can be regarded as a confirmation control, and the delete button can be used to delete the incorrectly drawn outline pattern.
[0077] Using this embodiment, the outline pattern of the preset component of the meter in the first image can be drawn using the drawing controls in the calibration interface. After the drawing is completed, the position of the outline pattern in the first image is calculated through a confirmation operation, serving as a calibration parameter. This allows for the calibration of the first image and the acquisition of calibration parameters, which represent the position of the preset component of the meter in the first image. Furthermore, the display of the first image through the calibration interface allows users to calibrate it more clearly and intuitively, facilitating the determination of the accuracy of the drawn outline pattern of the preset component of the meter in the first image, thus obtaining more accurate calibration parameters.
[0078] As explained above, different meter types may have different types of preset accessories, and the outline patterns of different preset accessories may also be different. Therefore, different drawing methods may be needed when drawing the outline patterns of different preset accessories, and the drawing controls corresponding to different drawing methods may be different. Therefore, to facilitate the drawing of different preset accessories corresponding to different meter types, in one possible embodiment, the calibration interface further includes a meter type selection control; the method further includes: in response to a type selection operation on the meter type selection control, identifying the meter type selected by the type selection operation as the target meter type; determining the types of preset accessories possessed by the meter of the target meter type as the target accessory types; and adjusting the drawing controls displayed in the calibration interface to drawing controls for the target accessory types.
[0079] Using this embodiment, the user can input a type selection operation through the meter type selection control, and use the meter type selected in the type selection operation as the target meter type. Based on the types of preset accessories that the target meter type has, i.e., the target accessory types, the drawing controls displayed in the calibration interface are adjusted to draw the drawing controls for the target accessory types. This allows the calibration interface to display the corresponding drawing controls according to the different meter types selected by the user, making it convenient for the user to use the drawing controls to calibrate the meter in the first image, and also making it convenient for the user to determine which parts of the meter need to be calibrated.
[0080] See Figure 6 , Figure 7 The selection box after "Subtype" in the figure is the meter type selection control. Users can click the meter type selection control according to the meter type in the first image displayed on the left side of the calibration interface, and select the meter type in the first image displayed on the left side of the calibration interface as the target meter type. That is, the user enters a type selection operation, and the meter type selected by the type selection operation, i.e., the target meter type is the meter type in the first image displayed on the left side of the calibration interface.
[0081] If the target meter type is a reading pointer, then the target accessory types are meter, pointer, meter center, and scale. The corresponding drawing controls can include: position box drawing sub-control, center drawing sub-control, scale drawing sub-control, and pointer drawing sub-control. Among them, the position box drawing sub-control is used to draw the position box of the meter, the center drawing sub-control is used to draw the position of the meter's center, the scale drawing sub-control is used to draw the position of the meter's scale, and the pointer drawing sub-control is used to draw the position of the meter's pointer.
[0082] For example, such as Figure 6 As shown, Figure 6 In the first image, the meter type is pointer meter, meaning the target meter type is pointer meter. When identifying this pointer meter, it's necessary to know its position, pointer position, center position, and scale position. Therefore, if the target meter type is pointer meter, a position box drawing sub-control (the drawing button after the position box) needs to be used to draw the position box of the pointer's location. The drawn position box of the pointer's location can be shown as follows: Figure 6 As shown in the rectangle box; use the center drawing sub-control (i.e., the draw button after the center) to draw the position of the center of the reading pointer. The position of the center of the drawn reading pointer can be shown as follows. Figure 6 The solid circle at the center of the reading pointer indicates the position of the pointer's scale. Use the scale drawing sub-control (the drawing button after the scale) to draw the position of the reading pointer's scale. The drawn position of the reading pointer's scale can be shown as follows: Figure 6 The position of the pointer is shown as a point on the scale of the reading pointer. In other possible instances, the position of the scale can also be represented by a short line segment. The pointer's position can be drawn using a pointer drawing sub-control, i.e., a polygonal or rectangular button behind the pointer. The position of the drawn reading pointer can be as follows: Figure 6 The triangle box in the image shows the outline. Additionally, both the center and scale sub-controls have corresponding delete buttons to remove incorrectly drawn outlines.
[0083] If the target meter type is a digital meter, then the target accessory type is a meter, and the corresponding drawing controls can include: a position box drawing sub-control; wherein, the position box drawing sub-control is used to draw the position box where the meter is located.
[0084] It is understandable that, in the first image, the meter type is a digital meter. Only the location of this digital meter needs to be obtained; the algorithm can then identify the number at that location to obtain the reading of the target meter. For example, as shown... Figure 7 As shown, Figure 7The meter in the first image is an LED digital meter, a type of digital meter. A position box drawing sub-control is needed to draw the position box of the LED digital meter's value. The resulting position box of the digital meter can be drawn as follows: Figure 7 The rectangular box in the image is shown.
[0085] If the target meter type is a status meter, then the target accessory types are meter and status indicator. The corresponding drawing controls can include: a position box drawing sub-control and a status indicator drawing sub-control; wherein, the position box drawing sub-control is used to draw the position box of the meter's location, and the status indicator drawing sub-control is used to draw the location of the indicator that indicates the status of the meter.
[0086] For example, a status meter can be a status meter that uses multiple indicator lights to indicate its status. Different indicator lights represent different states of the status meter. When an indicator light is lit, the status meter is in the state indicated by that indicator light. For instance, a status meter has three indicator lights representing the three states of running, stopping, and fault. When the running indicator light is lit, the status meter is in the running state. In this example, the target meter is a status meter that uses multiple indicator lights to indicate its status. The indicators that indicate the status of the target meter are the indicator lights. It is understood that the status indicated by the indicator lights is usually marked around the indicator lights. Therefore, when identifying this status meter, it is necessary to know the location of the status meter and the location of the indicator lights representing the current status of the status meter. Therefore, when calibrating the status meter, it is necessary to use the position box drawing sub-control to draw the position box of the status meter's location, and use the status indicator drawing sub-control to draw the position box of the illuminated indicator light's location. Since the status indicated by the indicator light is usually marked around the indicator light, when drawing the position box of the illuminated indicator light's location, the status mark indicated by the illuminated indicator light can also be included in the position box.
[0087] If the target meter type is a level meter, then the target accessory types are meter, liquid level, and scale. The corresponding drawing controls can include: a position box drawing sub-control, a liquid level drawing sub-control, and a scale drawing sub-control. Among them, the position box drawing sub-control is used to draw the position box of the meter, the liquid level drawing sub-control is used to draw the position of the liquid level of the meter, and the scale drawing sub-control is used to draw the position of the scale of the meter.
[0088] Understandably, when the meter type in the first image is a level gauge, meter identification requires knowing the meter's position, the liquid level's location, and the scale position. Therefore, when the meter type control is a level gauge, a position box drawing sub-control is needed to draw the position box of the level gauge, a liquid level drawing sub-control is needed to draw the liquid level's location, and a scale drawing sub-control is needed to draw the scale position.
[0089] Since when the target meter type is a meter with a scale, such as a reading pointer or a level meter, it is necessary to determine the scale value corresponding to the scale before meter identification can be performed, in one possible embodiment, the preset accessory is a scale. The method further includes: in response to a scale value configuration operation for the outline pattern of the drawn scale, identifying the scale value configured by the scale value configuration operation, and displaying the scale value in the calibration interface corresponding to the outline pattern of the scale; calculating the position of the outline pattern in the first image as a calibration parameter, including: calculating the position of the outline pattern of the scale in the first image, and using the determined position of the scale and the configured scale value as calibration parameters.
[0090] Users can draw the meter's scale using the scale drawing sub-control. After obtaining the points corresponding to the meter's scale in the first image, they can enter the scale value next to a drawn point. This is called the scale value configuration operation, which will then display the corresponding scale value next to the scale's outline pattern. Furthermore, when obtaining calibration parameters, it is necessary to calculate the position of the scale's outline pattern in the first image. The determined scale position and the configured scale value are used as calibration parameters.
[0091] By using this embodiment, the scale value corresponding to the scale can be calibrated through the scale value configuration operation, so that the calibration parameters include the scale value corresponding to the scale. This allows the video recorder to identify the reading of the meter in the second image when the meter in the second image contains a scale.
[0092] In the calibration interface, to display the first image more clearly and facilitate its calibration, appropriate adjustments can be made to the first image. Therefore, in one possible embodiment, the calibration interface may display image adjustment controls, which allow adjustment of the style of the first image in the calibration interface. See also... Figure 6 , Figure 7The top right corner of the first image in the diagram has image adjustment controls, which can include: pan, zoom in, zoom out, and adaptive controls. The pan control allows the first image to be panned; the zoom in control allows the first image to be zoomed in; the zoom out control allows the first image to be zoomed out; and the adaptive control allows the size of the first image to be adjusted to match the size of the display box on the left.
[0093] The calibration interface can also display the calibration set ID of the camera that captured the first image, for example, such as... Figure 6 , Figure 7 The calibration set ID in the image is the calibration set ID of the camera that captured the first image.
[0094] Since the first image may include multiple meters, the calibration interface can also display a meter name control, allowing different meters in the first image to be named and easily distinguished. For example... Figure 6 , Figure 7 As shown, users can enter text in the input box after the meter name to perform a naming operation. In response to the naming operation, the user terminal or video recorder can recognize the name entered in the naming operation and use it as the name of the meter in the first picture, thereby naming the meter in the first picture.
[0095] If the first image includes multiple meters, the user can click [the appropriate button] after calibrating one of the meters in the first image. Figure 6 , Figure 7 The "Add" button shown allows you to calibrate one of the uncalibrated meters in the first image, thus obtaining the calibration parameters for multiple meters in the first image. During meter identification by the video recorder, these calibration parameters can be used to identify meters in the second image captured by the same camera that captured the first image, yielding the meter readings for multiple meters in the second image. Furthermore, a single meter may contain multiple readings, which the user can then use to... Figure 7 The polygonal and rectangular buttons following the region of interest shown calibrate multiple readings of interest to the user on the meter.
[0096] As explained above, different meter types may correspond to different preset accessories, resulting in different information represented by the calibration parameters. Therefore, the video recorder needs to use different identification methods when identifying different meter types. Thus, in one possible embodiment, the video recorder identifies the sub-image at the location in the second image according to the position represented by the determined calibration parameters and the identification algorithm corresponding to the meter type represented by the determined calibration parameters, thereby obtaining the meter reading in the second image.
[0097] In this embodiment, when the meter type is a reading pointer, the position information represented by the calibration parameters may include: the position of the meter in the second image, the position of the meter pointer in the second image, the position of the meter scale in the second image and the scale value corresponding to the scale, and the position of the meter center in the second image. When the meter type is a digital meter, the position information represented by the calibration parameters may include: the position of the meter in the second image. Therefore, different meter types correspond to different recognition methods. Thus, different recognition algorithms need to be called according to the position information in the calibration parameters corresponding to different meter types to identify the sub-images corresponding to the position information in the second image, thereby obtaining the meter reading.
[0098] The meter identification method provided in this application can be used to read meter data from various types of meters; that is, the target meter type in this document can be various different meter types. For example, such as... Figure 8 As shown, the meter types can be pointer meters or digital meters. Pointer meters include two categories: reading meters and status pointer / knob meters. Digital meters can include: LED digital meters, mechanical numerical meters, and intelligent digital meters. Reading meters include: SF6 meters, ammeters, voltmeters, pressure gauges, 6L2 power factor meters, 6L2 power meters, 6L2 frequency meters, oil level gauges, leakage current reading meters, main transformer oil temperature gauges, on-load tap changers, and FJZD pressure and temperature gauges. Status pointer / knob meters include: rotary on / off pointers, translational on / off pointers, and non-8-directional rotary switches. Figure 8 The images shown are only a portion of the possible target meter types, except for... Figure 8 In addition to the example shown, the meter type can also be a status meter or a level meter.
[0099] A video recorder may include different analysis modes, each corresponding to a different application scenario. For example, when the video recorder's analysis mode is camera analysis mode, it can perform meter readings on second images sent by the camera; when the video recorder's analysis mode is timed capture mode, it can perform image recognition on images captured at specific times; and when the video recorder's analysis mode is offline mode, it can perform image recognition on image resources sent by a video recorder recognition platform or the video recorder's network terminal. Offline mode refers to a situation where no camera is connected to the video recorder, i.e., no camera is sending a second image to the video recorder. Based on this, in one possible embodiment, in response to the second image and calibration set ID sent by the camera, the video recorder displays a mode switching interface. This interface displays an analysis mode control, which represents the analysis scenario for the second image. The analysis mode control is set to camera analysis mode. In camera analysis mode, the second image is recognized according to the determined calibration parameters to obtain the meter reading.
[0100] See Figure 9 , Figure 9 This is a schematic diagram of a possible mode switching interface, such as... Figure 9 As shown, the mode switching interface displays an analysis mode control. When the analysis mode control is adjusted to the camera analysis mode, the recorder can perform meter recognition on the second image sent by the camera.
[0101] See Figure 9 The mode switching interface can also display a task switch control; in response to the second image and calibration set ID sent by the camera, the mode switching interface is displayed, including: in response to the second image and identifier sent by the camera, the mode switching interface is displayed and the task switch control is turned on.
[0102] In this embodiment, the word "Engine 1001" needs to be displayed on the mode switching interface. This means that the algorithm for meter identification in the recorder has been loaded. Then, the task switch control in the upper right corner is turned on, so that the analysis mode control is displayed on the interface and the analysis mode control is set to the camera analysis mode.
[0103] See Figure 9 When the task switch control is enabled, the mode switching interface can also display a basic configuration control and a mode switching save control. The basic configuration control displays the recorder's operating status; the mode switching save control saves the settings for the mode switching interface. Figure 9 The save button is shown in the image.
[0104] While identifying the meters and obtaining their readings, the video recorder can also identify whether the meters are damaged, have stains, or are otherwise unsafe, i.e., it performs defect identification on the meters. Therefore, in one possible embodiment, the video recorder's mode switching interface also displays a defect analysis switch control; the method further includes: if the defect analysis switch control is in the on state, performing defect identification on the second image to obtain the defect identification result of the meter.
[0105] In this embodiment, the second image is a second image sent by the camera and received by the recorder in camera analysis mode. After configuring the recorder in analysis mode, i.e., setting the recorder to camera analysis mode, the defect analysis switch control can be turned on. This allows the recorder to simultaneously identify meter readings in the second image and perform defect identification on the meters in the second image according to a preset defect identification algorithm, thereby obtaining the meter readings and the defect identification results.
[0106] If there is only one second image, then only one defect analysis switch control will be used to control whether the recorder performs defect analysis on the meters in that second image. If there are multiple second images, then one defect analysis switch control can be used to control whether the recorder performs defect analysis on all target meters in all second images, or each second image can have its own defect analysis switch control, with each switch control used to control whether the recorder performs defect identification on the meters in the second image corresponding to that switch control.
[0107] For example, the settings of the defect analysis switch control can be as follows: Figure 10 As shown, the file management system contains all relevant information for the second images and configuration controls for them: the second image's sequence number, filename, calibration set ID, defect analysis switch control, and meter reading analysis switch control. Defect identification of the target meter in each second image can be configured based on the defect analysis switch control corresponding to each second image in the file management system. If the defect analysis switch control corresponding to the second image is turned on, the recording machine will perform defect identification on the meter in the second image to be identified. Figure 10 The diagram shows the defect analysis switch control of the video recorder in image import analysis mode (i.e., the aforementioned offline mode), and the diagram shows the defect analysis switch control of the video recorder in camera analysis mode. Figure 10 Similarly, I will not go into details here.
[0108] Furthermore, when the recorder is in camera analysis mode, the defect identification switch control can be set to the normally open state, so that when the recorder is in camera analysis mode, it can simultaneously identify meter readings and identify defects, that is, defect identification is performed by default when the recorder is in camera analysis mode.
[0109] By using this embodiment, when the defect identification switch control is in the on state, the meter in the second image can be identified by both reading and defect identification. This can detect whether the meter is damaged, has stains or other damage, making it easier to obtain the meter's usage status in a timely manner and to carry out timely repairs if the meter is damaged.
[0110] Figure 11 A network scenario topology diagram for the meter identification method provided in the embodiments of this application, such as... Figure 11As shown, in a meter recognition scenario, when a camera is added to the meter recognition system—that is, after the camera is first turned on in the system—the user terminal (i.e., the mobile app) activates and configures the camera by accessing the camera's (i.e., the macro camera's) AP (Access Point Wireless) network, configuring parameters such as the calibration set ID, wake-up plan, and the recorder's communication address. Afterward, the camera automatically wakes up according to the wake-up plan configured by the user terminal, takes a second image, and uploads the captured second image and calibration set ID to the recorder. The recorder, using pre-configured calibration parameters or those uploaded by the camera, determines the calibration parameters corresponding to the calibration set ID based on the calibration set ID, and performs meter calculation analysis on the second image according to the calibration parameters to obtain the meter recognition result—the meter reading in the second image. The meter recognition result is saved locally on the recorder and uploaded to the platform server. See also... Figure 11 The communication between the platform server and the WIFI router, the macro camera and the WIFI router, and the user terminal (i.e., the mobile APP) and the WIFI router are all through the local area network. The video recorder communicates with the WIFI router or the platform server through a wired connection. Since the camera (i.e., the macro camera) supports AP mode, the camera and the user terminal can be connected through the macro camera's AP network.
[0111] This application embodiment also provides a meter identification system, which includes a video recorder and one or more cameras. When a first camera is added to the meter identification system, a user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are used to at least indicate the position of the preset accessories of the meters in the first image. The camera is used to wake up and go into sleep according to the wake-up plan, and captures a second image after waking up, and sends the second image and the configured calibration set ID to the video recorder according to the communication address. The video recorder is used to respond to the calibration set ID and the second image, determine the calibration parameters corresponding to the calibration set ID, and identify the second image according to the determined calibration parameters to obtain the meter readings in the second image.
[0112] Corresponding to the aforementioned meter identification method, this application also provides a meter identification device, such as... Figure 12As shown, this is applied to a meter identification system, which includes a video recorder and one or more cameras. When the first camera joins the meter identification system, the user terminal configures the calibration set ID, wake-up plan, and communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera joins the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are used to indicate at least the position of the preset accessories of the meter in the first image.
[0113] The device includes: a transmitting module 121, used for the camera to wake up and go into sleep according to a wake-up plan, and after waking up, to capture a second image and send the second image and the configured calibration set ID to the video recorder according to the communication address;
[0114] The identification module 122 is used to respond to the calibration set ID and the second image. The video recorder determines the calibration parameters corresponding to the calibration set ID and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
[0115] In one possible embodiment, the first camera sends the captured first image to the user terminal, so that the user terminal calibrates the meter in the first image to obtain calibration parameters, and sends the calibration parameters to the first camera; when the first camera joins the meter identification system, the video recorder obtains the calibration set ID of the first camera and the corresponding calibration parameters of the first camera in the following way and stores them accordingly, including: the video recorder receives the calibration set ID and calibration parameters sent by the first camera according to the communication address and stores them accordingly.
[0116] In one possible embodiment, the video recorder is equipped with a listening port corresponding to a communication address; the device further includes: a judgment module, used to determine whether the information received by the video recorder through the communication address contains calibration parameters in response to the information received by the video recorder; if the information contains calibration parameters, the video recorder stores the received calibration set ID and calibration parameters in the calibration set library; if the information does not contain calibration parameters, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
[0117] In one possible embodiment, the first camera sends the captured first image to the user terminal, so that the user terminal sends the first image and calibration set ID to the video recorder; when the first camera is added to the meter identification system, the video recorder obtains and stores the calibration set ID and corresponding calibration parameters of the first camera in the following ways: the video recorder receives the calibration set ID and the first image sent by the user terminal; the video recorder calibrates the first image to obtain calibration parameters, and stores the received calibration set ID and calibration parameters accordingly.
[0118] In one possible embodiment, the calibration parameters are obtained by the user terminal or the video recorder calibrating the first image in the following manner: displaying a calibration interface; the calibration interface includes the first image, a drawing control, and a confirmation control; in response to a drawing operation on the drawing control, drawing the outline pattern of a preset accessory in the meter on the first image according to the drawing operation; in response to a confirmation operation on the confirmation control, calculating the position of the outline pattern in the first image as the calibration parameters.
[0119] In one possible embodiment, the calibration interface further includes a meter type selection control; the device further includes: an identification module, configured to identify the meter type selected by the type selection operation in response to the type selection operation of the meter type selection control, as the target meter type; a determination module, configured to determine the preset accessory types possessed by the meter of the target meter type, as the target accessory types; and a drawing module, configured to adjust the drawing control displayed in the calibration interface to a drawing control for drawing the target accessory types.
[0120] In one possible embodiment, the preset accessory is a scale, and the device further includes: a scale value configuration module, used to respond to a scale value configuration operation for the outline pattern of the drawn scale, identify the scale value configured by the scale value configuration operation, and display the scale value in the calibration interface corresponding to the outline pattern of the scale; calculate the position of the outline pattern in the first image as a calibration parameter, including: calculating the position of the outline pattern of the scale in the first image, and using the determined position of the scale and the configured scale value as calibration parameters.
[0121] This application also provides an electronic device, such as... Figure 13 As shown, it includes:
[0122] Memory 131 is used to store computer programs;
[0123] When the processor 132 executes the program stored in the memory 131, and when the electronic device is the aforementioned camera, it performs the following steps:
[0124] This system is applied to a meter identification system. The camera is any camera included in the system. The system also includes a video recorder. When the first camera is added to the system, the user terminal configures a calibration set ID, a wake-up plan, and the video recorder's communication address for the first camera, and controls the first camera to capture a first image. When the first camera is added, the video recorder obtains and stores the calibration set ID and corresponding calibration parameters of the first camera. The calibration parameters are obtained by calibrating the meters in the first image captured by the first camera, and at least indicate the position of a preset accessory of the meter in the first image. The camera is used to wake up and go into sleep mode according to the wake-up plan, and after waking up, captures a second image. It then sends the second image and the configured calibration set ID to the video recorder according to the communication address. The video recorder responds to the calibration set ID and the second image, determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
[0125] In this embodiment, if the meter identification system includes only one camera, then the camera provided in this embodiment is the camera included in the meter identification system; if the meter identification system includes multiple cameras, then the camera provided in this embodiment is any one of the multiple cameras included in the meter identification system, and the structure of the other cameras in the meter identification system is similar to the structure of the camera provided in this embodiment.
[0126] In one possible embodiment, the processor is further configured to, when executing the program stored in the memory, send the captured first image to the user terminal, so that the user terminal calibrates the meter in the first image to obtain calibration parameters, and sends the calibration parameters to the camera; and send the calibration set ID and calibration parameters to the video recorder according to the communication address, so that the video recorder receives the calibration set ID and calibration parameters sent by the camera according to the communication address and stores them accordingly.
[0127] In one possible embodiment, the processor is further configured to send the captured first image to the user terminal when executing a program stored in the memory, so that the user terminal sends the first image and the calibration set ID to the video recorder.
[0128] When the electronic device is the aforementioned video recorder, the following steps are performed:
[0129] The video recorder is used in a meter identification system, which also includes one or more cameras. When the first camera is added to the meter identification system, the user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the meter identification system, the video recorder obtains the calibration set ID of the first camera and the corresponding calibration parameters of the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are used to at least indicate the position of the preset accessories of the meters in the first image. The video recorder is used to determine the calibration parameters corresponding to the calibration set ID in response to the calibration set ID and the second image, and to identify the second image according to the determined calibration parameters to obtain the meter readings in the second image. The second image and the calibration set ID are obtained by the camera being woken up and put into sleep mode according to the wake-up plan, capturing the second image after waking up, and sending the second image and the configured calibration set ID to the video recorder according to the communication address.
[0130] In one possible embodiment, the processor is further configured to, when executing the program stored in the memory, receive and store the calibration set ID and calibration parameters sent by the first camera according to the communication address; wherein, the calibration set ID and calibration parameters are obtained by the first camera sending a captured first image to the user terminal, so that the user terminal calibrates the meter in the first image to obtain calibration parameters, and sends the calibration parameters to the first camera, and the first camera sends the calibration set ID and calibration parameters to the video recorder according to the communication address; the video recorder is also configured to have a listening port corresponding to the communication address; the processor is further configured to, when executing the program stored in the memory, in response to the information received by the video recorder through the communication address, determine whether the information contains calibration parameters; if the information contains calibration parameters, the video recorder stores the received calibration set ID and calibration parameters into the calibration set library; if the information does not contain calibration parameters, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
[0131] In one possible embodiment, the processor is further configured to, when executing a program stored in memory, receive a calibration set ID and a first image sent by a user terminal; calibrate the first image to obtain calibration parameters, and store the received calibration set ID and calibration parameters accordingly; the calibration set ID and the first image are obtained by a first camera sending a captured first image to the user terminal, and the user terminal sending the first image and the calibration set ID to a video recorder; the video recorder is configured to calibrate the first image to obtain calibration parameters in the following manner: displaying a calibration interface; the calibration interface includes a first image, a drawing control, and a confirmation control; in response to a drawing operation on the drawing control, drawing the outline pattern of a preset accessory in the meter on the first image according to the drawing operation; in response to a confirmation operation on the confirmation control, calculating the position of the outline pattern in the first image as a calibration parameter. The calibration interface also includes a meter type selection control; the video recorder is further configured to: in response to a type selection operation on the meter type selection control, identify the meter type selected by the type selection operation as the target meter type; determine the preset accessory types possessed by the meter of the target meter type as the target accessory types; adjust the drawing control displayed in the calibration interface to a drawing control for drawing the target accessory types; the preset accessory is a scale, and the video recorder is further configured to: in response to a scale value configuration operation on the outline pattern of the drawn scale, identify the scale value configured by the scale value configuration operation, and display the scale value in the calibration interface corresponding to the outline pattern of the scale; calculate the position of the outline pattern in the first image as a calibration parameter, including: calculating the position of the outline pattern of the scale in the first image, and using the determined position of the scale and the configured scale value as calibration parameters.
[0132] Furthermore, the aforementioned electronic device may also include a communication bus and / or a communication interface, with the processor 132, the communication interface, and the memory 131 communicating with each other via the communication bus.
[0133] The communication bus mentioned in the above electronic devices can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in the diagram, but this does not mean that there is only one bus or one type of bus.
[0134] The communication interface is used for communication between the aforementioned electronic devices and other devices.
[0135] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.
[0136] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.
[0137] In another embodiment provided in this application, a computer-readable storage medium is also provided, which stores a computer program that, when executed by a processor, implements the steps of any of the above-described meter identification methods.
[0138] In another embodiment provided in this application, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to execute any of the meter identification methods described above.
[0139] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a solid-state drive (SSD), etc.
[0140] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0141] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the embodiments of apparatus, electronic devices, computer-readable storage media, and computer program products are basically similar to the method embodiments, and therefore the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.
[0142] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application are included within the scope of protection of this application.
Claims
1. A meter identification method, characterized in that, Applied to a meter identification system, the meter identification system includes a video recorder and one or more cameras. When the first camera joins the meter identification system, the user terminal configures the calibration set ID, wake-up plan and communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are used to indicate at least the position of the preset accessories of the meter in the first image. The method includes: The camera wakes up and goes into sleep mode according to the wake-up plan, and after waking up, it takes a second picture and sends the second picture and the configured calibration set ID to the recorder according to the communication address; In response to the calibration set ID and the second image, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
2. The method according to claim 1, characterized in that, The first camera sends the captured first image to the user terminal, so that the user terminal can calibrate the meter in the first image to obtain calibration parameters, and then send the calibration parameters to the first camera; When the first camera is added to the meter identification system, the video recorder obtains and stores the calibration set ID of the first camera and the corresponding calibration parameters of the first camera in the following ways: The video recorder receives the calibration set ID and calibration parameters sent by the first camera according to the communication address and stores them accordingly.
3. The method according to claim 2, characterized in that, The video recorder is equipped with a listening port corresponding to the communication address; The method further includes: In response to information received by the video recorder through the communication address, the monitoring port determines whether the information contains calibration parameters; If the information contains calibration parameters, the recorder will store the received calibration set ID and calibration parameters into the calibration set library. If the information does not contain calibration parameters, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
4. The method according to claim 1, characterized in that, The first camera sends the captured first image to the user terminal, so that the user terminal sends the first image and the calibration set ID to the video recorder; When the first camera is added to the meter identification system, the video recorder obtains and stores the calibration set ID of the first camera and the corresponding calibration parameters of the first camera in the following ways: The video recorder receives the calibration set ID and the first image sent by the user terminal; The video recorder calibrates the first image to obtain calibration parameters, and stores the received calibration set ID and the calibration parameters accordingly.
5. The method according to claim 1, characterized in that, The calibration parameters are obtained by the user terminal or the video recorder calibrating the first image in the following manner, including: The calibration interface is displayed; the calibration interface includes the first image, drawing controls, and confirmation controls; In response to a drawing operation on the drawing control, the outline pattern of a preset accessory in the meter is drawn on the first image according to the drawing operation; In response to a confirmation operation on the confirmation control, the position of the outline pattern in the first image is calculated as a calibration parameter.
6. The method according to claim 5, characterized in that, The calibration interface also includes a meter type selection control; The method further includes: In response to a type selection operation on the meter type selection control, the meter type selected by the type selection operation is identified as the target meter type; The types of preset accessories that the target meter type possesses are determined as the target accessory types; Adjust the drawing controls displayed in the calibration interface to be used for drawing the target accessory type.
7. The method according to claim 5, characterized in that, The preset accessory is a scale, and the method further includes: In response to a scale value configuration operation for the outline pattern of the drawn scale, the scale value configured by the scale value configuration operation is identified, and the scale value is displayed in the calibration interface corresponding to the outline pattern of the scale. The calculation of the position of the contour pattern in the first image, as a calibration parameter, includes: The position of the outline pattern of the scale in the first image is calculated, and the determined position and configured scale value are used as calibration parameters.
8. A meter identification system, characterized in that, The system includes a video recorder and one or more cameras. When the first camera is added to the meter identification system, the user terminal configures the calibration set ID, wake-up plan and communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are used to indicate at least the position of the preset accessories of the meter in the first image. The camera is used to wake up and go into sleep according to the wake-up plan, and after waking up, it takes a second picture and sends the second picture and the configured calibration set ID to the recorder according to the communication address; The video recorder is used to respond to the calibration set ID and the second image, determine the calibration parameters corresponding to the calibration set ID, and identify the second image according to the determined calibration parameters to obtain the meter readings in the second image.
9. A camera, characterized in that, This system is applied to a meter identification system, where the camera is any one of the cameras included in the system. The system also includes a video recorder. When the first camera is added to the system, the user terminal configures a calibration set ID, a wake-up plan, and the communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the system, the video recorder acquires the calibration set ID of the first camera and the corresponding calibration parameters and stores them. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters at least indicate the position of a preset accessory of the meter in the first image. The camera includes: Memory, used to store computer programs; When the processor executes the program stored in the memory, it wakes up and goes into sleep according to the wake-up plan, and after waking up, it takes a second picture and sends the second picture and the configured calibration set ID to the video recorder according to the communication address, so that the video recorder responds to the calibration set ID and the second picture, determines the calibration parameters corresponding to the calibration set ID, and identifies the second picture according to the determined calibration parameters to obtain the meter reading in the second picture.
10. The camera according to claim 9, characterized in that, The processor is also configured to, when executing the program stored in the memory, send the captured first image to the user terminal, so that the user terminal calibrates the meter in the first image to obtain calibration parameters, and sends the calibration parameters to the camera; and send the calibration set ID and calibration parameters to the video recorder according to the communication address, so that the video recorder receives the calibration set ID and calibration parameters sent by the camera according to the communication address and stores them accordingly.
11. The camera according to claim 9, characterized in that, The processor is also used to send the captured first image to the user terminal when executing the program stored in the memory, so that the user terminal sends the first image and the calibration set ID to the video recorder.
12. A video recorder, characterized in that, The video recorder is applied to the meter identification system, which also includes one or more cameras. When the first camera is added to the meter identification system, the user terminal configures the calibration set ID, wake-up plan, and communication address of the video recorder for the first camera, and controls the first camera to capture a first image. When the first camera is added to the meter identification system, the video recorder obtains the calibration set ID of the first camera and the calibration parameters corresponding to the first camera and stores them accordingly. The calibration parameters are parameters obtained by calibrating the meters in the first image captured by the first camera, and the calibration parameters are at least used to indicate the position of the preset accessories of the meters in the first image. The video recorder includes: Memory, used to store computer programs; When the processor executes the program stored in the memory, in response to the calibration set ID and the second image, it determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter reading in the second image; wherein, the second image and the calibration set ID are obtained by the camera being woken up and put into sleep mode according to the wake-up plan, and the second image is captured after being woken up, and the second image and the configured calibration set ID are sent to the video recorder according to the communication address.
13. The video recorder according to claim 12, characterized in that, The processor is further configured to, when executing a program stored in the memory, receive and store the calibration set ID and calibration parameters sent by the first camera according to the communication address; wherein, the calibration set ID and calibration parameters are obtained by the first camera sending a captured first image to the user terminal, so that the user terminal calibrates the meter in the first image to obtain calibration parameters, and sends the calibration parameters to the first camera, and the first camera sends the calibration set ID and calibration parameters to the video recorder according to the communication address; The video recorder is also equipped with a listening port corresponding to the communication address; the processor is also used to execute the program stored in the memory, and in response to the information received by the video recorder through the communication address, the listening port determines whether the information contains calibration parameters; if the information contains calibration parameters, the video recorder stores the received calibration set ID and calibration parameters into the calibration set library; if the information does not contain calibration parameters, the video recorder determines the calibration parameters corresponding to the calibration set ID, and identifies the second image according to the determined calibration parameters to obtain the meter readings in the second image.
14. The video recorder according to claim 12, characterized in that, The processor is also configured to, when executing a program stored in the memory, receive a calibration set ID and a first image sent by the user terminal; calibrate the first image to obtain calibration parameters, and store the received calibration set ID and the calibration parameters accordingly; the calibration set ID and the first image are obtained by the first camera sending the captured first image to the user terminal, and the user terminal sending the first image and the calibration set ID to the video recorder. The video recorder is used to calibrate the first image to obtain the calibration parameters in the following manner: Display a calibration interface; the calibration interface includes the first image, a drawing control, and a confirmation control; in response to a drawing operation on the drawing control, draw the outline pattern of a preset accessory in the meter on the first image according to the drawing operation; in response to a confirmation operation on the confirmation control, calculate the position of the outline pattern in the first image as a calibration parameter; The calibration interface also includes a meter type selection control; the video recorder is further configured to: in response to a type selection operation on the meter type selection control, identify the meter type selected by the type selection operation as the target meter type; determine the preset accessory types of the meter of the target meter type as the target accessory types; and adjust the drawing control displayed in the calibration interface to a drawing control for drawing the target accessory types. The preset accessory is a scale, and the video recorder is further configured to: in response to a scale value configuration operation for the outline pattern of the drawn scale, identify the scale value configured by the scale value configuration operation, and display the scale value in the calibration interface corresponding to the outline pattern of the scale; the calculation of the position of the outline pattern in the first image as a calibration parameter includes: calculating the position of the outline pattern of the scale in the first image, and using the determined position of the scale and the configured scale value as calibration parameters.
Citation Information
Patent Citations
Camera system, camera body, and camera head
CN1746763A
Data communication system
JP2003110560A