System and Method for measuring amount of electricity used based on image recognition

Abstract

A system is provided that offers a function to numerically check the amount of electricity being consumed in real time through a camera of a mobile terminal, including a mobile phone, by recognizing the turntable of a mechanical electricity meter. The system is characterized by comprising a mechanical electricity meter, an image sensor that senses the mechanical electricity meter to generate image information, and a terminal that processes the image information based on image recognition to extract a turntable area, calculates the rotational speed of the turntable in the extracted turntable area, and calculates the current amount of electricity used by the mechanical electricity meter using the calculated rotational speed.

Description

Technology Field

[0001] The present invention relates to a power consumption measurement technology, and more specifically, to a system and method for measuring the power consumption of a mechanical power meter using image recognition technology. Background Technology

[0002] Technology for automatically reading meters for water, electricity, and gas in households is becoming widely adopted. By replacing conventional mechanical meters with electronic smart meters, this automatic metering technology enables remote reading and / or self-diagnostic functions to detect abnormal situations.

[0003] However, since replacing mechanical meters that have not yet reached the end of their lifespan with smart meters presents significant time and / or cost issues, the majority of households are still using mechanical meters.

[0004] In particular, regarding electricity meters used for measuring usage, the proportion of mechanical meters that cannot be remotely read is significantly high. Specifically, meter readers visit in person at regular intervals to manually calculate electricity consumption by referring to the values ​​on the analog meter's display.

[0005] In addition, the speed of a rotating disc on a specific part of the instrument panel can be checked to roughly determine whether power is being used and the level of real-time usage. However, when determining power usage based on the rotation speed of the disc, only a superficial determination is possible, such as power usage being 0 if the rotation speed is 0, high power usage if the speed is fast, and low power usage if the speed is slow.

[0006] Therefore, it is impossible to determine actual real-time power usage based on numerical values, and it is also difficult to provide a self-diagnostic function capable of detecting abnormal situations, such as that of an electronic meter.

[0007] To address the inconvenience of such mechanical electricity meters, remote metering methods are being proposed, such as a method in which a camera module is mounted in a position where the meter readings can be captured, the meter value is obtained and transmitted from the captured image, and the electricity usage for a certain period is calculated through image-based character recognition.

[0008] However, most existing automatic meter reading methods based on image recognition recognize the analog dial of mechanical electricity meters and calculate the difference in numbers over a certain period to determine the amount of electricity consumed, just as in conventional methods. To elaborate, existing image recognition-based automatic electricity estimation methods have been proposed by recognizing and transmitting the value in the corresponding analog number range or by calculating and displaying the electricity bill through a power usage calculation module.

[0009] Therefore, there is a disadvantage in that it is difficult to determine real-time power consumption, estimate the appliances / equipment using that electricity, or identify abnormal conditions in measuring equipment.

[0010] Since conventional mechanical power meters display the measured power on an analog dial, the amount of power consumed can only be calculated based on the difference when a change in the numerical value occurs.

[0011] However, there is a functional disadvantage in that the time required for numerical changes based on usage is long, making it difficult to numerically check the amount of electricity currently being used in homes and buildings in real time, and in particular, it is impossible to quantify and determine the amount of electricity used based on the speed of the turntable.

[0012] Furthermore, unlike electronic power meters, mechanical power meters lack the ability to detect abnormal situations through self-diagnosis or determine abnormal conditions in real time, making it difficult to visually identify internal failures of the meter or problems in the power distribution facilities. Prior art literature

[0013] 1. Republic of Korea Published Patent No. 10-2020-0013136 The problem to be solved

[0014] The present invention is proposed to resolve the problems according to the background technology above, and aims to provide a system and method that provide a function to numerically check the amount of electricity being consumed in real time through a camera of a mobile terminal, including a mobile phone, by recognizing the image of the turntable of a mechanical electricity meter.

[0015] In addition, another objective of the present invention is to provide a system and method capable of estimating power consumption based on rotational speed, visually displaying household appliances, or indicating an abnormal situation when the rotational speed is irregular. means of solving the problem

[0016] To achieve the above-mentioned objectives, the present invention provides a system that provides a function to numerically check the amount of electricity being consumed in real time through a camera of a mobile terminal, including a mobile phone, by recognizing the rotating plate of a mechanical electricity meter.

[0017] The above system is,

[0018] Mechanical power meter;

[0019] An image sensor that senses the above mechanical power meter and generates image information; and

[0020] The device is characterized by including a terminal that processes the image information based on image recognition to extract a rotating plate area, calculates the rotational speed of the rotating plate in the extracted rotating plate area, and calculates the current power consumption of the mechanical power meter using the calculated rotational speed.

[0021] In addition, the terminal is characterized by including: an extraction module that performs object recognition through a pre-trained image recognition model from the image information to extract the rotating plate area and detects the movement of the rotating plate using rotating plate feature points in the extracted rotating plate area; and an estimation module that calculates the rotational speed based on the rotating plate feature points and calculates the current power consumption using the rotational speed.

[0022] In addition, the estimation module is characterized by verifying the uniformity of the rotational speed and, based on the verification result, generating abnormal situation notification information or calculating the current power consumption.

[0023] In addition, the estimation module is characterized by determining that the rotational speed is uniform if it is within a certain range for a preset period of time, and calculating the current power consumption.

[0024] In addition, the estimation module is characterized by determining that the rotational speed lacks uniformity and generating the situation notification information if the rotational speed is not within a certain range for a preset period of time.

[0025] In addition, the terminal is characterized by including a display unit that outputs the current power consumption or status notification information.

[0026] In addition, the estimation module is characterized by matching the current power consumption amount with the power consumption capacity of the home appliance and displaying the corresponding appliance on the display unit.

[0027] In addition, the rotational speed is characterized by being calculated through the matching of identical feature points between each rotating plate feature point and information on the movement distance of identical rotating plate feature points over a certain period of time.

[0028] On the other hand, another embodiment of the present invention provides an image recognition-based power consumption measurement system characterized by comprising: a mechanical power meter; an image sensor that senses the mechanical power meter and generates image information; a terminal that transmits the image information externally; and a management server that receives the image information from the terminal via a communication network, processes the image information based on image recognition to extract a rotating plate area, calculates the rotational speed of the rotating plate in the extracted rotating plate area, calculates the current power consumption of the mechanical power meter using the calculated rotational speed, and transmits information related to the calculated current power consumption to the terminal.

[0029] On the other hand, another embodiment of the present invention provides a method for measuring power consumption based on image recognition, characterized by comprising: (a) a step in which an image sensor senses a mechanical power meter and generates image information; and (b) a step in which a terminal processes the image information based on image recognition to extract a rotating plate area, calculates the rotational speed of the rotating plate in the extracted rotating plate area, and calculates the current power consumption of the mechanical power meter using the calculated rotational speed.

[0030] Additionally, the above step (b) is characterized by comprising: (b-1) a step in which an extraction module performs object recognition through a pre-trained image recognition model from the image information to extract the rotating plate area, and detects the movement of the rotating plate using rotating plate feature points in the extracted rotating plate area; and (b-2) a step in which an estimation module calculates the rotational speed based on the rotating plate feature points and calculates the current power consumption using the rotational speed.

[0031] Additionally, the above step (b-2) is characterized by including the step of the estimation module verifying the uniformity of the rotational speed and generating abnormal situation notification information or calculating the current power consumption based on the verification result.

[0032] Additionally, the above step (b-2) is characterized by including a step of calculating the current power consumption by determining that the rotational speed is uniform if the estimation module determines that the rotational speed is uniform when the rotational speed is within a predetermined range for a predetermined period of time.

[0033] Additionally, the above step (b-2) is characterized by including the step of generating the situation notification information by determining that the rotational speed is non-uniform if the estimation module is not within a certain range for a predetermined period of time.

[0034] In addition, the above method is characterized by including, after step (b-2), a step in which the estimation module matches the current power consumption amount with the power consumption capacity of the home appliance and displays the corresponding appliance on the display unit.

[0035] On the other hand, another embodiment of the present invention provides a method for measuring power consumption based on image recognition, characterized by comprising: (a) a step in which an image sensor senses a mechanical power meter and generates image information; (b) a step in which a terminal transmits the image information to the outside; and (c) a step in which a management server receives the image information from the terminal through a communication network, processes the image information based on image recognition to extract a rotating plate area, calculates the rotational speed of the rotating plate in the extracted rotating plate area, calculates the current power consumption of the mechanical power meter using the calculated rotational speed, and transmits information related to the calculated current power consumption to the terminal. Effects of the invention

[0036] According to the present invention, by providing information that can detect power usage and / or abnormal situations in real time using a terminal such as a mobile phone, users can individually estimate power usage during peak hours of power usage and in situations where excessive power usage is a concern, thereby providing convenience for real-time electricity saving and / or design.

[0037] In addition, another advantage of the present invention is that, despite being a mechanical power meter, it is possible to provide information that enables checking the status of the meter and / or inspecting the power distribution facilities within the building through the detection of abnormal situations. Brief explanation of the drawing

[0038] FIG. 1 is a block diagram of an image recognition-based power consumption measurement system according to an embodiment of the present invention. Figure 2 is a detailed configuration block diagram of the terminal shown in Figure 1. FIG. 3 is a flowchart showing the process of measuring power consumption based on image recognition according to an embodiment of the present invention. FIG. 4 is an example of a screen showing information related to the amount of power used when photographing a power meter according to an embodiment of the present invention. Figure 5 is an example of power consumption by household appliance according to an embodiment of the present invention. FIG. 6 is a block diagram of an image recognition-based power consumption measurement system according to another embodiment of the present invention. Specific details for implementing the invention

[0039] The present invention is capable of various modifications and may have various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the invention to specific embodiments, and it should be understood that the invention includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the invention.

[0040] When describing each drawing, similar reference numerals are used for similar components.

[0041] Terms such as first, second, etc., may be used to describe various components, but said components should not be limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another.

[0042] For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component. The term "and / or" includes a combination of a plurality of related described items or any of a plurality of related described items.

[0043] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which this invention pertains.

[0044] Terms such as those defined in commonly used dictionaries should be interpreted as having meanings consistent with their meanings in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0045] A power consumption measurement system and method based on image recognition according to an embodiment of the present invention will be described in detail below with reference to the attached drawings.

[0046] FIG. 1 is a block diagram of an image recognition-based power consumption measurement system (100) according to an embodiment of the present invention. Referring to FIG. 1, the power consumption measurement system (100) may be configured to include a mechanical power meter (110), an image sensor (120) that senses the mechanical power meter (110) to generate image information, a terminal (130) that processes image information based on image recognition to extract a rotating plate area, calculates the rotational speed of the rotating plate in the extracted rotating plate area, and calculates the current power consumption of the mechanical power meter (110) using the calculated rotational speed.

[0047] The mechanical power meter (110) is the most widely used induction-based mechanical power meter. The mechanical power meter (110) commonly includes a rotating plate area (111) on the front that can estimate real-time power usage by rotation speed and an analog number (measurement value) area (112) that displays power usage.

[0048] The image sensor (120) performs the function of sensing the front of the mechanical power meter (110) to generate image information. Accordingly, the image sensor (120) can be a CCD (Charge-Coupled Device) camera, a CMOS (complementary metal-oxide semiconductor) camera, an IP (Internet Protocol) camera, etc.

[0049] In FIG. 1, for ease of understanding, the image sensor terminal (130) performs the function of processing the image information based on image recognition to extract a rotating plate area, calculating the rotational speed of the rotating plate in the extracted rotating plate area (111), and calculating the current power consumption of the mechanical power meter (110) using the calculated rotational speed.

[0050] In FIG. 1, the image sensor (120) and the terminal (130) are shown separately, but the image sensor (120) may be configured in the terminal (130). Additionally, the terminal (130) may be configured with a communication circuit, memory, microprocessor, etc.

[0051] FIG. 2 is a detailed block diagram of the terminal (130) illustrated in FIG. 1. Referring to FIG. 2, the terminal (130) may be configured to include an extraction module (210) that processes image information based on image recognition to extract a rotating plate area, an estimation module (220) that calculates a rotational speed in the extracted rotating plate area (111) and calculates the current power consumption of the mechanical power meter (110) using the calculated rotational speed, and a display unit (230) that displays the current power consumption.

[0052] The extraction module (210) extracts a turntable area by performing object recognition through a pre-trained image recognition model (i.e., an object recognition model) from image information of the power meter (110). Additionally, the extraction module (210) detects the movement of the turntable using turntable feature points (201) in the extracted turntable area (111). Generally, the turntable feature points (201) refer to points marked on the edge (i.e., the outer surface) of the turntable, which is a disc. The turntable feature points (201) are marked at regular intervals on the edge.

[0053] A pre-trained image recognition model is a model generated by learning a large amount of image information in advance. Training can be performed using machine learning or AI (Artificial Intelligence) learning. AI learning can be performed using Artificial Neural Networks (ANN).

[0054] Artificial neural networks have a structure consisting of multiple hidden layers between the input and output layers. Each layer is composed of multiple nodes; the input layer receives the values ​​of independent variables, the hidden layers perform numerous complex calculations using these values, and the output layer outputs the results of the analysis. This is a method in which the machine independently learns processing rules from the data and performs processing without humans providing procedures or rules for data processing. Deep Neural Networks (DNN), Convolutional Neural Networks (CNN), and Recurrent Neural Networks (RNN) can be used.

[0055] The estimation module (220) detects the movement of the turntable based on image feature points (201) in the extracted turntable area (111) and calculates the rotation speed of the turntable. To elaborate, the extraction of the turntable area can utilize a pre-trained image recognition module that has been pre-labeled for the turntable area of ​​various power meter images and the corresponding images, and additionally, to enhance the recognition performance of the turntable, turntable recognition can be performed by utilizing the turntable movement detection information within the extracted area.

[0056] The rotary plate extracted in this way recognizes the rotary plate feature points (201) extracted from the rotary plate and the edge of the rotary plate, and can calculate the speed of the rotary plate feature points (201), that is, the rotation speed of the rotary plate, through matching identical feature points between each rotary plate feature point (201) and information on the distance traveled by identical rotary plate feature points over a certain period of time. Each feature point of the rotary plate can utilize an object tracking method that matches the nearest identical feature point when moving over time, and can calculate the rotation speed of the rotary plate in terms of the speed of the feature points by estimating the distance traveled per hour of identical feature points within the rotary plate edge area.

[0057] Additionally, the estimation module (220) calculates the current power consumption of the mechanical power meter (110) using the calculated rotation speed of the turntable. Of course, it is converted into an electricity bill based on the current power consumption. The calculation of power consumption according to rotation speed utilizes a logic and metering values ​​within the system that can calculate power consumption by speed, based on the method of calculating power consumption in existing mechanical power meters where the speed of the turntable varies according to the power consumption (the speed of the turntable increases as the power consumption increases).

[0058] Additionally, the estimation module (220) can determine the uniformity of the rotation speed of the turntable and, if an irregular rotation speed of the turntable is detected, provide abnormal situation information to the display unit (230), thereby inducing a power meter malfunction or an inspection of household appliances.

[0059] The display unit (230) displays the current amount of power used (i.e., power consumption), electricity charges, etc. The display may be a combination of text, voice, and graphics. To this end, the display unit (230) may be configured to include a display and a sound system.

[0060] Displays can be LCD (Liquid Crystal Display), LED (Light Emitting Diode) display, OLED (Organic LED) display, touch screen, flexible display, Micro LED, Mini LED, etc. In the case of touch screens, they can also be used as an input method.

[0061] FIG. 3 is a flowchart showing the process of measuring power consumption based on image recognition according to an embodiment of the present invention. Referring to FIG. 3, an image sensor (120) captures the front of a mechanical power meter (110) to acquire image information (step S310).

[0062] Subsequently, the extraction module (210) of the terminal (130) extracts a rotating plate area from the image information (step S320). Of course, a pre-trained image recognition model may be used to extract an object (i.e., a rotating plate area) from the image information.

[0063] Afterwards, the extraction module (210) detects the movement of the rotating plate using the movement of the rotating plate feature points in the extracted rotating plate area (step S330).

[0064] Afterwards, the estimation module (220) of the terminal (130) calculates the rotation speed of the turntable using the turntable feature points according to the movement of the turntable (step S340).

[0065] Subsequently, the estimation module (220) checks whether the calculated rotational speed is within a certain range for a predetermined period of time to verify the uniformity of the rotational speed (step S350). For example, if the rotational speed is approximately 0.5 to 10.0 rpm (Revolutions Per Minute) about three times at intervals of about 1 minute, it is determined to be normal, and if it deviates from this, it is determined to be an abnormal situation. That is, the uniformity of the rotational speed calculated during video recording is determined to check whether the rotational speed is irregular or regular.

[0066] If, as a result of verification in step S350, the calculated rotational speed is not within a certain range for a preset period of time, the estimation module (220) determines that the calculated rotational speed is irregular rotation without uniformity, generates abnormal situation notification information, and outputs it to the display unit (230) as a combination of text, voice, and graphics.

[0067] In contrast, if the calculated rotational speed is within a certain range for a predetermined period of time as confirmed in step S350, the estimation module (220) calculates the current amount of power used using the calculated rotational speed and calculates the electricity charge accordingly (step S360).

[0068] Subsequently, the estimation module (220) outputs the amount of power used and the corresponding electricity bill through the display unit (230) (step S370). Of course, the estimation module (220) can convert the amount of power used according to the calculated rotation speed of the turntable into power consumption and provide the amount of power used in real time in numerical and electricity bill units.

[0069] In addition, depending on the amount of power used, the device using power can be displayed on the display unit (230) of the terminal (130) by matching it with the power consumption capacity of the home appliance currently operating in the house.

[0070] Of course, regarding the diagnosis of abnormal situations that are difficult to provide with existing mechanical power meters, it is designed to detect irregularities in real-time rotational speed and provide notifications for abnormal checks when there are intermittent changes in rotational speed.

[0071] FIG. 4 is an example of a screen showing information related to power consumption when photographing a power meter according to an embodiment of the present invention. Referring to FIG. 4, information related to power consumption may be configured to include power consumption, electricity charges, operating appliances, and whether there is an abnormality. In addition, power consumption, corresponding electricity charges, appliances expected to operate, and whether there is an abnormality based on the determination of the uniformity of the rotation speed of the turntable can be provided in real time according to the rotation speed of the turntable.

[0072] FIG. 5 is an example of power consumption by home appliance according to an embodiment of the present invention. Referring to FIG. 5, as an example of general power consumption by home appliance, since power consumption may differ even among appliances of the same type, several examples of appliances that are expected based on the power consumption displayed in real time are provided together. Based on this information, the user can refer to the appliances actually operating in the home to help estimate the correlation between real-time power consumption and the appliances consuming power.

[0073] FIG. 6 is a block diagram of an image recognition-based power consumption measurement system (600) according to another embodiment of the present invention. Referring to FIG. 6, the power consumption measurement system (600) may be configured to include a mechanical power meter (110), an image sensor (120) that senses the mechanical power meter (110) and generates image information, a terminal (130) that transmits image information to the outside, a management server (650) that receives image information from the terminal (130) through a communication network (640), processes the image information based on image recognition to extract a rotating plate area, calculates the rotation speed of the rotating plate in the extracted rotating plate area, and calculates the current power consumption of the mechanical power meter (110) using the calculated rotation speed.

[0074] FIG. 6 is similar to FIG. 1, except that the terminal (130) performs the function of transmitting video information to the management server (650) via the communication network (640), and the management server (650) processes the video information to calculate the current power consumption of the mechanical power meter (110) and transmits information related to the current power consumption back to the terminal (130) so that it is displayed on the screen.

[0075] Of course, for this to happen, the management server (650) stores the unique information of the mechanical power meter (110), the phone number of the terminal (130), user information, etc., in advance as a database. In addition, the extraction module and estimation module described in FIG. 2 are configured in the management server (650).

[0076] The communication network (640) refers to a connection structure capable of exchanging information between each node, such as multiple terminals and servers, and can be a public switched telephone network (PSTN), a public switched data network (PSDN), an integrated services digital network (ISDN), a broadband integrated services digital network (BISDN), a local area network (LAN), a metropolitan area network (MAN), a wide area network (WLAN), etc.

[0077] However, the present invention is not limited thereto and may be wireless communication networks such as CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), Wibro (Wireless Broadband), WiFi (Wireless Fidelity), DLNA (Digital Living Network Alliance), Zigbee, Z-wave, HSDPA (High Speed ​​Downlink Packet Access) networks, Trunked Radio System (TRS), Digital Trunked Radio System (D-TRS), Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra-wide Band, Wireless USB (Wireless Universal Serial Bus), Near Field Communication (NFC) networks, satellite broadcasting networks, analog broadcasting networks, DMB (Digital Multimedia Broadcasting) networks, etc. Alternatively, it may be a combination of these wired communication networks and wireless communication networks.

[0078] Additionally, the steps of the method or algorithm described in connection with the embodiments disclosed herein may be implemented in the form of program instructions that can be executed through various computer means, such as a microprocessor, a processor, a CPU (Central Processing Unit), etc., and recorded on a computer-readable medium. The computer-readable medium may include program (instruction) code, data files, data structures, etc., either alone or in combination.

[0079] The program (instruction) code recorded on the above medium may be those specifically designed and configured for the present invention, or those known and available to those skilled in the art of computer software. Examples of computer-readable recording media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs, DVDs, and Blu-rays; and semiconductor memory devices specifically configured to store and execute program (instruction) code, such as ROM (Read Only Memory), RAM (Random Access Memory), and flash memory.

[0080] Here, examples of program (instruction) code include not only machine code, such as that generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter, etc. The aforementioned hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa. Explanation of the symbols

[0081] 100,600: Power consumption measurement system 110: Mechanical power meter 111: Turntable area 112: Analog number area 120: Image sensor 130: Terminal 201: Rotating plate feature points 210: Extraction Module 220: Estimation Module 230: Display unit 640: Communication network 650: Management Server

Claims

Claim 1 A mechanical power meter (110); an image sensor (120) that senses the mechanical power meter (110) and generates image information; and a terminal (130) that processes the image information based on image recognition to extract a rotating plate area, calculates the rotational speed of the rotating plate in the extracted rotating plate area (111), and calculates the current power consumption of the mechanical power meter (110) using the calculated rotational speed; wherein the terminal (130) includes an extraction module (210) that extracts the rotating plate area (111) by performing object recognition through a pre-learned image recognition model from the image information, and detects the movement of the rotating plate using a rotating plate feature point (201) in the extracted rotating plate area (111); A power consumption measurement system based on image recognition, comprising: an estimation module (220) that calculates the rotational speed based on the rotational plate feature point (201) and calculates the current power consumption using the rotational speed; wherein the estimation module (220) checks the uniformity of the rotational speed and generates abnormal situation notification information or calculates the current power consumption according to the result of the check, and the terminal (130) includes a display unit (230) that outputs the current power consumption or situation notification information. Claim 2 delete Claim 3 delete Claim 4 A power consumption measurement system based on image recognition according to claim 1, wherein the estimation module (220) determines that the rotational speed is uniform if it is within a certain range during a preset period of time, and calculates the current power consumption amount. Claim 5 A power consumption measurement system based on image recognition according to claim 1, wherein the estimation module (220) determines that the rotational speed is not uniform if it is not within a certain range during a preset period of time and generates the situation notification information. Claim 6 delete Claim 7 In claim 1, the image recognition-based power consumption measurement system is characterized in that the estimation module (220) matches the current power consumption amount with the power consumption capacity of the home appliance and displays the corresponding appliance on the display unit (230). Claim 8 A power consumption measurement system based on image recognition according to claim 1, wherein the rotational speed is calculated through matching identical feature points between each rotating plate feature point (201) and information on the distance traveled by identical rotating plate feature points over a certain period of time. Claim 9 ◈Claim 9 was abandoned upon payment of the registration fee.◈ Mechanical power meter (110); image sensor (120) that senses the mechanical power meter (110) and generates image information; terminal (130) that transmits the image information to the outside; The system includes a management server (650) that receives image information from the terminal (130) via a communication network (640), processes the image information based on image recognition to extract a rotating plate area (111), calculates the rotational speed of the rotating plate in the extracted rotating plate area (111), calculates the current power consumption of the mechanical power meter (110) using the calculated rotational speed, and transmits information related to the calculated current power consumption to the terminal (130); wherein the terminal (130) includes an extraction module (210) that extracts the rotating plate area (111) by performing object recognition through a pre-trained image recognition model from the image information, and detects the movement of the rotating plate using a rotating plate feature point (201) in the extracted rotating plate area (111); A power consumption measurement system based on image recognition, comprising: an estimation module (220) that calculates the rotational speed based on the rotational plate feature point (201) and calculates the current power consumption using the rotational speed; wherein the estimation module (220) checks the uniformity of the rotational speed and generates abnormal situation notification information or calculates the current power consumption according to the result of the check, and the terminal (130) includes a display unit (230) that outputs the current power consumption or situation notification information. Claim 10 (a) a step in which an image sensor (120) senses a mechanical power meter (110) to generate image information; and (b) a step in which a terminal (130) processes the image information based on image recognition to extract a rotating plate area, calculates the rotational speed of the rotating plate in the extracted rotating plate area (111), and calculates the current power consumption of the mechanical power meter (110) using the calculated rotational speed; wherein step (b) comprises: (b-1) a step in which an extraction module (210) performs object recognition through a pre-trained image recognition model from the image information to extract the rotating plate area (111), and detects the movement of the rotating plate using a rotating plate feature point (201) in the extracted rotating plate area (111); and (b-2) a step in which an estimation module (220) calculates the rotational speed based on the rotating plate feature point (201) and calculates the current power consumption using the rotational speed; wherein step (b-2) includes a step in which the estimation module (220) checks the uniformity of the rotational speed and generates abnormal situation notification information or calculates the current power consumption according to the result of the check; and after step (b-2), a step in which the estimation module (220) matches the current power consumption with the power consumption capacity of the home appliance and displays the corresponding appliance on a display unit (230); characterized by an image recognition-based power consumption measurement method. Claim 11 delete Claim 12 delete Claim 13 In claim 10, the above step (b-2) is characterized by including the step of calculating the current power consumption amount by determining that the rotational speed is uniform if the estimation module (220) determines that the rotational speed is uniform when the rotational speed is within a predetermined range for a predetermined time. Claim 14 In claim 10, the above step (b-2) is characterized by including the step of generating the situation notification information by determining that the rotational speed is non-uniform if the estimation module (220) does not have the rotational speed within a predetermined range for a predetermined time. Claim 15 delete Claim 16 A method for measuring power consumption based on image recognition, characterized in that, in claim 10, the rotational speed is calculated through matching identical feature points between each rotating plate feature point (201) and information on the distance traveled by identical rotating plate feature points over a certain period of time. Claim 17 ◈Claim 17 was abandoned upon payment of the registration fee.◈ (a) a step in which an image sensor (120) senses a mechanical power meter (110) to generate image information; (b) a step in which a terminal (130) transmits the image information to the outside; and (c) a step in which a management server (650) receives the image information from the terminal (130) through a communication network (640), processes the image information based on image recognition to extract a rotating plate area (111), calculates the rotational speed of the rotating plate in the extracted rotating plate area (111), calculates the current power consumption of the mechanical power meter (110) using the calculated rotational speed, and transmits information related to the calculated current power consumption to the terminal (130); wherein step (b) comprises: (b-1) a step in which an extraction module (210) performs object recognition through a pre-trained image recognition model from the image information to extract the rotating plate area (111), and detects the movement of the rotating plate using a rotating plate feature point (201) in the extracted rotating plate area (111); and (b-2) a step in which an estimation module (220) calculates the rotational speed based on the rotating plate feature point (201) and calculates the current power consumption using the rotational speed; wherein step (b-2) includes a step in which the estimation module (220) checks the uniformity of the rotational speed and generates abnormal situation notification information or calculates the current power consumption according to the result of the check; and after step (b-2), a step in which the estimation module (220) matches the current power consumption with the power consumption capacity of the home appliance and displays the corresponding appliance on a display unit (230); characterized by an image recognition-based power consumption measurement method.

Images