Electronic Device and Method for Managing and Maintaining Power Facilities Including Choke Points

Abstract

According to various embodiments, an electronic device for managing and maintaining power equipment including a choke point includes a processor, wherein the processor acquires three-dimensional modeling data for a choke point of power equipment; extracts location information, depth information, and surrounding environment information of the choke point based on the three-dimensional modeling data; inputs the three-dimensional modeling data into an artificial intelligence model to output a risk level of the choke point corresponding to the three-dimensional modeling data; receives temperature, humidity, and vibration data from a sensor installed at the choke point, and monitors the condition of the choke point in real time using the received data and the three-dimensional modeling data; establishes a maintenance plan for the choke point based on the risk level output result and the real-time monitoring result; and may be configured to provide work instructions to a worker using augmented reality technology according to the maintenance plan. According to various embodiments, a method of operation of an electronic device for the management and maintenance of power equipment including a choke point may include: acquiring three-dimensional modeling data for a choke point of power equipment; extracting location information, depth information, and surrounding environment information of the choke point based on the three-dimensional modeling data; inputting the three-dimensional modeling data into an artificial intelligence model to output a risk level of the choke point corresponding to the three-dimensional modeling data; receiving temperature, humidity, and vibration data from a sensor installed at the choke point and monitoring the state of the choke point in real time using the received data and the three-dimensional modeling data; establishing a maintenance plan for the choke point based on the risk level output result and the real-time monitoring result; and providing work instructions to a worker using augmented reality technology according to the maintenance plan. Various other embodiments are also possible.

Description

Technology Field

[0001] The present invention belongs to the field of power facility management and maintenance technology and relates to a 3D modeling-based system and method for effectively managing choke points, which have a high probability of major failures that may occur due to external factors such as road excavation and equipment deterioration. In addition, the present invention relates to a technology that supports more efficient power facility maintenance by utilizing information and communication technology (ICT) and the Internet of Things (IoT). Background Technology

[0003] In the maintenance and restoration of power facilities, conventional as-built drawings are provided in a 2D format. These drawings make it difficult to visually represent detailed information about the facilities and limit managers' ability to intuitively understand the on-site situation. In particular, for facilities located at major choke points, such as substations, there is a high probability of major failures occurring due to external factors such as deterioration, road excavation, and natural disasters. Since such choke points are where multiple circuits converge or are closely linked to facilities of other organizations (e.g., gas pipes, water pipes, etc.), a rapid and accurate response is essential in the event of a failure.

[0004] Existing management methods primarily record equipment status using photographic and video data captured by drones or DSLR cameras; however, these methods only provide two-dimensional planar information, making it difficult to intuitively grasp the three-dimensional structure or specific locations of the equipment. For example, in complex equipment structures such as substations or manholes connected by multiple lines, it is difficult to clearly understand the interrelationships between equipment or their specific locations using photographs alone.

[0005] Furthermore, under the existing method, when maintenance personnel are replaced, it may take a significant amount of time for the new person to fully understand the site, and there is a possibility that they may not be able to comprehensively grasp the condition of the equipment. In particular, existing drawings created at the time of completion are often not updated or do not reflect the state of deterioration, which can lead to discrepancies with actual site conditions. This can cause additional problems during maintenance work or reduce work efficiency.

[0006] In addition, existing systems fail to provide the accurate information necessary to pre-calculate on-site data related to excavation work or to utilize it for calculating final payments. Furthermore, since data such as excavation volume, distance between facilities, and location depth directly affect construction costs and schedules, more precise and reliable data management is required.

[0007] Therefore, there is a need for technology that 3D models key equipment such as choke points to provide visually clear and intuitive information, thereby increasing the efficiency and accuracy of maintenance and repair work. Prior art literature

[0008] Korean Published Patent Application No. 10-2022-0077242 (June 9, 2022) Korean Registered Patent Application No. 10-2022-0077232 (June 9, 2022) Korean Registered Patent Application No. 10-1683256 (November 30, 2016) The problem to be solved

[0009] Accordingly, the technical problem that the present invention aims to solve is created to solve the aforementioned problem, and aims to provide an electronic device for the management and maintenance of power facilities including a choke point and a method of operation thereof.

[0010] The present invention also aims to digitize as-built drawings by 3D modeling major facilities including choke points (e.g., substations, multi-circuit manholes, etc.) and to provide an intuitive and systematic management environment.

[0011] In addition, the purpose is to provide a method for calculating the amount of excavation at a construction site in advance based on 3D modeling data and utilizing this for calculating the final payment and construction planning.

[0012] The technical problems that the present invention aims to solve are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art to which the present invention belongs from the description below. means of solving the problem

[0014] An electronic device for managing and maintaining power equipment including a choke point according to the present invention for solving the above technical problem includes a processor, wherein the processor acquires three-dimensional modeling data for a choke point of power equipment; extracts location information, depth information, and surrounding environment information of the choke point based on the three-dimensional modeling data; inputs the three-dimensional modeling data into an artificial intelligence model to output a risk level of the choke point corresponding to the three-dimensional modeling data; receives temperature, humidity, and vibration data from a sensor installed at the choke point, and monitors the condition of the choke point in real time using the received data and the three-dimensional modeling data; establishes a maintenance plan for the choke point based on the risk level output result and the real-time monitoring result; and may be configured to provide work instructions to a worker using augmented reality technology according to the maintenance plan.

[0015] A method of operation of an electronic device for the management and maintenance of power equipment including a choke point according to the present invention may include: a step of acquiring three-dimensional modeling data for a choke point of power equipment; a step of extracting location information, depth information, and surrounding environment information of the choke point based on the three-dimensional modeling data; a step of inputting the three-dimensional modeling data into an artificial intelligence model to output a risk level of the choke point corresponding to the three-dimensional modeling data; a step of receiving temperature, humidity, and vibration data from a sensor installed at the choke point and monitoring the state of the choke point in real time using the received data and the three-dimensional modeling data; a step of establishing a maintenance plan for the choke point based on the risk level output result and the real-time monitoring result; and a step of providing work instructions to a worker using augmented reality technology according to the maintenance plan. Various other embodiments are also possible. Effects of the invention

[0017] The present invention overcomes the limitations of existing 2D drawings through 3D modeling drawings and allows for a more intuitive understanding of the site situation. Data generated by drone photography and 3D modeling software precisely represents information such as the location, depth, and length of the equipment and includes metadata to improve the accuracy of drawing management.

[0018] In addition, the deterioration status or risk factors of chokepoint equipment can be visually checked, allowing for faster and more accurate maintenance and accident recovery work. Furthermore, by automating the calculation of excavation volume and final payment at construction sites, the efficiency of construction supervision and cost management can be enhanced.

[0019] Finally, there is an advantage in that effective implementation and operation are possible by initially performing modeling work on key chokepoint facilities and gradually expanding it to the entire facility.

[0020] The effects of the present invention are not limited to those described above, and potential effects expected from the technical features of the present invention will be clearly understood from the description below. Brief explanation of the drawing

[0022] FIG. 1 illustrates a block diagram of an electronic device and network according to various embodiments of the present invention. FIG. 2 is a block diagram of an electronic device according to various embodiments. FIG. 3 is a block diagram of a program module according to various embodiments. FIG. 4 is a flowchart illustrating how an electronic device operates according to various embodiments. FIG. 5 is a drawing showing an example of measuring the excavation area and depth using three-dimensional modeling data according to various embodiments. FIG. 6 is a drawing showing an example of identifying the location of underground facilities through three-dimensional modeling and analyzing whether there is interference with choke points according to various embodiments. Specific details for implementing the invention

[0023] Hereinafter, various embodiments of this document are described with reference to the accompanying drawings. The embodiments and the terms used therein are not intended to limit the technology described in this document to specific embodiments and should be understood to include various modifications, equivalents, and / or substitutions of said embodiments. In relation to the description of the drawings, similar reference numerals may be used for similar components. A singular expression may include a plural expression unless the context clearly indicates otherwise. In this document, expressions such as "A or B" or "at least one of A and / or B" may include all possible combinations of items listed together. Expressions such as "first," "second," "first," or "second" may modify said components regardless of order or importance and are used only to distinguish one component from another and do not limit said components. When it is mentioned that a certain (e.g., 1st) component is "(functionally or telecommunicationally) connected" or "connected" to another (e.g., 2nd) component, said certain component may be directly connected to said other component or connected through another component (e.g., 3rd component).

[0024] In this document, "configured to" may be used interchangeably with, depending on the context, for example, hardware- or software-wise, "suitable for," "capable of," "modified to," "made to," "capable of," or "designed to." In some cases, the expression "device configured to" may mean that the device is "capable of" in conjunction with other devices or components. For example, the phrase "processor configured to perform A, B, and C" may mean a dedicated processor for performing the corresponding operations (e.g., an embedded processor), or a general-purpose processor capable of performing the corresponding operations by executing one or more software programs stored in a memory device (e.g., a CPU or application processor).

[0025] An electronic device according to various embodiments of the present document may include, for example, at least one of a smartphone, a tablet PC, a desktop PC, a laptop PC, a netbook computer, a workstation, and a server.

[0026] Referring to FIG. 1, an electronic device (101) within a network environment (100) in various embodiments is described. The electronic device (101) may include a bus (110), a processor (120), a memory (130), an input / output interface (150), a display (160), and a communication interface (170). In some embodiments, the electronic device (101) may omit at least one of the components or additionally include other components. The bus (110) may include a circuit that connects the components (110-170) to each other and transmits communication (e.g., control messages or data) between the components. The processor (120) may include one or more of a central processing unit, an application processor, or a communication processor (CP). The processor (120) may, for example, perform operations or data processing regarding the control and / or communication of at least one other component of the electronic device (101).

[0027] Memory (130) may include volatile and / or non-volatile memory. Memory (130) may store instructions or data related to at least one other component of the electronic device (101), for example. According to one embodiment, memory (130) may store software and / or programs (140). Programs (140) may include, for example, a kernel (141), middleware (143), an application programming interface (API) (145), and / or application programs (or "applications") (147), etc. At least part of the kernel (141), middleware (143), or API (145) may be referred to as an operating system. The kernel (141) can control or manage system resources (e.g., bus (110), processor (120), or memory (130), etc.) used to execute operations or functions implemented in other programs (e.g., middleware (143), API (145), or application program (147)). Additionally, the kernel (141) can provide an interface that controls or manages system resources by accessing individual components of the electronic device (101) from the middleware (143), API (145), or application program (147).

[0028] Middleware (143) may act as an intermediary to enable, for example, an API (145) or an application program (147) to communicate with the kernel (141) to exchange data. Additionally, middleware (143) may process one or more work requests received from the application program (147) according to priority. For example, middleware (143) may process the one or more work requests by assigning a priority to at least one of the application programs (147) to use the system resources of the electronic device (101) (e.g., bus (110), processor (120), or memory (130), etc.). The API (145) is an interface for the application (147) to control functions provided by the kernel (141) or middleware (143), and may include at least one interface or function (e.g., command) for, for example, file control, window control, image processing, or character control. The input / output interface (150) can, for example, transmit commands or data input from a user or other external device to other component(s) of the electronic device (101), or output commands or data received from other component(s) of the electronic device (101) to the user or other external device.

[0029] The display (160) may include, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, a micro-electromechanical system (MEMS) display, or an electronic paper display. The display (160) may display various content (e.g., text, images, videos, icons, and / or symbols, etc.) to a user, for example. The display (160) may include a touch screen and may receive touch, gesture, proximity, or hovering input using, for example, an electronic pen or a part of the user's body. The communication interface (170) may establish communication between, for example, the electronic device (101) and an external device (e.g., a first external electronic device (102), a second external electronic device (104), or a server (106)). For example, the communication interface (170) can be connected to a network (162) via wireless or wired communication to communicate with an external device (e.g., a second external electronic device (104) or a server (106)).

[0030] Wireless communication may include cellular communication using at least one of, for example, LTE, LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications). According to one embodiment, wireless communication may include at least one of, for example, WiFi (wireless fidelity), Bluetooth, Bluetooth Low Energy (BLE), Zigbee, NFC (near field communication), Magnetic Secure Transmission, Radio Frequency (RF), or Body Area Network (BAN). According to one embodiment, wireless communication may include GNSS. GNSS may be, for example, GPS (Global Positioning System), Glonass (Global Navigation Satellite System), Beidou Navigation Satellite System (hereinafter "Beidou"), or Galileo, the European global satellite-based navigation system. Hereinafter, in this document, "GPS" may be used interchangeably with "GNSS". Wired communication may include at least one of, for example, USB (universal serial bus), HDMI (high definition multimedia interface), RS-232 (recommended standard 232), power line communication, or POTS (plain old telephone service).The network (162) may include at least one of a telecommunications network, for example, a computer network (e.g., LAN or WAN), the Internet, or a telephone network.

[0031] Each of the first and second external electronic devices (102, 104) may be the same or a different type of device as the electronic device (101). According to various embodiments, all or part of the operations performed on the electronic device (101) may be performed on one or more other electronic devices (e.g., electronic devices (102, 104), or a server (106). According to one embodiment, when the electronic device (101) needs to perform a function or service automatically or upon request, the electronic device (101) may request at least some of the associated functions from another device (e.g., electronic devices (102, 104), or a server (106)) instead of performing the function or service itself or additionally. The other electronic device (e.g., electronic devices (102, 104), or a server (106)) may perform the requested function or additional functions and transmit the result to the electronic device (101). The electronic device (101) may provide the requested function or service by processing the received result as is or additionally. For this purpose, for example, cloud computing, distributed computing, or client-server computing technologies may be used.

[0033] FIG. 2 is a block diagram of an electronic device (201) according to various embodiments. The electronic device (201) may include, for example, all or part of the electronic device (101) shown in FIG. 1. The electronic device (201) may include one or more processors (e.g., AP) (210), a communication module (220), a subscriber identification module (224), a memory (230), a sensor module (240), an input device (250), a display (260), an interface (270), an audio module (280), a camera module (291), a power management module (295), a battery (296), an indicator (297), and a motor (298). The processor (210) may, for example, run an operating system or an application to control a number of hardware or software components connected to the processor (210) and perform various data processing and operations. The processor (210) may be implemented as, for example, a system on chip (SoC). According to one embodiment, the processor (210) may further include a graphics processing unit (GPU) and / or an image signal processor. The processor (210) may also include at least some of the components shown in FIG. 2 (e.g., a cellular module (221)). The processor (210) may process commands or data received from at least one of the other components (e.g., non-volatile memory) by loading them into volatile memory and store the resulting data in non-volatile memory.

[0034] The communication module (220) (e.g., communication interface (170)) may have the same or similar configuration. The communication module (220) may include, for example, a cellular module (221), a WiFi module (223), a Bluetooth module (225), a GNSS module (227), an NFC module (228), and an RF module (229). The cellular module (221) may, for example, provide voice calls, video calls, text services, or internet services through a communication network. According to one embodiment, the cellular module (221) may perform identification and authentication of an electronic device (201) within a communication network using a subscriber identification module (e.g., a SIM card) (224). According to one embodiment, the cellular module (221) may perform at least some of the functions that the processor (210) can provide. According to one embodiment, the cellular module (221) may include a communication processor (CP). According to some embodiments, at least some (e.g., two or more) of the cellular module (221), WiFi module (223), Bluetooth module (225), GNSS module (227), or NFC module (228) may be included in a single integrated chip (IC) or IC package. The RF module (229) may transmit and receive communication signals (e.g., RF signals), for example. The RF module (229) may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to other embodiments, at least one of the cellular module (221), WiFi module (223), Bluetooth module (225), GNSS module (227), or NFC module (228) may transmit and receive RF signals through a separate RF module.The subscriber identification module (224) may include, for example, a card or an embedded SIM containing the subscriber identification module, and may include unique identification information (e.g., ICCID (integrated circuit card identifier)) or subscriber information (e.g., IMSI (international mobile subscriber identity)).

[0035] Memory (230) (e.g., memory (130)) may include, for example, internal memory (232) or external memory (234). Internal memory (232) may include, for example, at least one of volatile memory (e.g., DRAM, SRAM, or SDRAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, flash memory, hard drive, or solid-state drive (SSD). External memory (234) may include a flash drive, for example, CF (compact flash), SD (secure digital), Micro-SD, Mini-SD, xD (extreme digital), MMC (multi-media card), or Memory Stick. External memory (234) may be functionally or physically connected to the electronic device (201) through various interfaces.

[0036] The sensor module (240) can, for example, measure physical quantities or detect the operating state of the electronic device (201) and convert the measured or detected information into an electrical signal. The sensor module (240) may include at least one of, for example, a gesture sensor (240A), a gyroscope sensor (240B), a barometric pressure sensor (240C), a magnetic sensor (240D), an accelerometer sensor (240E), a grip sensor (240F), a proximity sensor (240G), a color sensor (240H) (e.g., an RGB (red, green, blue) sensor), a biosensor (240I), a temperature / humidity sensor (240J), an illuminance sensor (240K), or a UV (ultra violet) sensor (240M). Additionally or generally, the sensor module (240) may include, for example, an e-nose sensor, an electromyography (EMG) sensor, an electro-encyclogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris sensor, and / or a fingerprint sensor. The sensor module (240) may further include a control circuit for controlling at least one of the sensors included therein. In some embodiments, the electronic device (201) may further include a processor configured to control the sensor module (240) as part of or separately from the processor (210), so as to control the sensor module (240) while the processor (210) is in a sleep state.

[0037] The input device (250) may include, for example, a touch panel (252), a (digital) pen sensor (254), a key (256), or an ultrasonic input device (258). The touch panel (252) may use at least one of, for example, capacitive, resistive, infrared, or ultrasonic methods. Additionally, the touch panel (252) may further include a control circuit. The touch panel (252) may further include a tactile layer to provide a tactile response to the user. The (digital) pen sensor (254) may, for example, be part of the touch panel or include a separate recognition sheet. The key (256) may include, for example, a hardware button, an optical key, or a keypad. The ultrasonic input device (258) can detect ultrasonic waves generated from the input tool through a microphone (e.g., microphone (288)) and verify data corresponding to the detected ultrasonic waves.

[0038] A display (260) (e.g., display (160)) may include a panel (262), a holographic device (264), a projector (266), and / or a control circuit for controlling these. The panel (262) may be implemented, for example, in a flexible, transparent, or wearable manner. The panel (262) may be composed of a touch panel (252) and one or more modules. According to one embodiment, the panel (262) may include a pressure sensor (or force sensor) capable of measuring the intensity of pressure for a user's touch. The pressure sensor may be implemented integrally with the touch panel (252) or as one or more sensors separate from the touch panel (252). The holographic device (264) may display a three-dimensional image in mid-air using light interference. The projector (266) may display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the electronic device (201). The interface (270) may include, for example, HDMI (272), USB (274), optical interface (276), or D-sub (D-subminiature) (278). The interface (270) may include, for example, the communication interface (170) shown in FIG. 1. Additionally or alternatively, the interface (270) may include, for example, a mobile high-definition link (MHL) interface, an SD card / multi-media card (MMC) interface, or an infrared data association (IrDA) standard interface.

[0039] The audio module (280) can, for example, convert sound and electrical signals bidirectionally. At least some components of the audio module (280) may be included in, for example, the input / output interface (145) shown in FIG. 1. The audio module (280) may process sound information input or output through, for example, a speaker (282), a receiver (284), earphones (286), or a microphone (288), etc. The camera module (291) is, for example, a device capable of capturing still images and video, and according to one embodiment, may include one or more image sensors (e.g., a front sensor or a rear sensor), a lens, an image signal processor (ISP), or a flash (e.g., an LED or a xenon lamp, etc.). The power management module (295) may, for example, manage the power of the electronic device (201). According to one embodiment, the power management module (295) may include a power management integrated circuit (PMIC), a charging IC, or a battery or fuel gauge. The PMIC may have wired and / or wireless charging methods. Wireless charging methods include, for example, magnetic resonance methods, magnetic induction methods, or electromagnetic wave methods, and may further include additional circuits for wireless charging, for example, coil loops, resonant circuits, or rectifiers. A battery gauge may measure, for example, the remaining charge of the battery (296), voltage, current, or temperature during charging. The battery (296) may include, for example, a rechargeable battery and / or a solar cell.

[0040] The indicator (297) can display a specific state of the electronic device (201) or a part thereof (e.g., processor (210)), for example, a boot state, a message state, or a charging state. The motor (298) can convert an electrical signal into a mechanical vibration and can generate vibration or haptic effects. The electronic device (201) is, for example, DMB (digital multimedia broadcasting), DVB (digital video broadcasting), or mediaFlo TM It may include a mobile TV support device (e.g., GPU) capable of processing media data according to standards such as ). Each of the components described in this document may consist of one or more components, and the name of the component may vary depending on the type of electronic device. In various embodiments, the electronic device (e.g., electronic device (201)) may have some components omitted, may include additional components, or may be composed of some of the components combined into a single entity, which can perform the same function as the components prior to combination.

[0041] In various embodiments of the present invention, the electronic device (201) (or electronic device (101)) may include a housing comprising a front, a rear, and a side that surrounds the space between the front and the rear. A touchscreen display (e.g., display (260)) is placed inside the housing and may be exposed through the front. A microphone (288) is placed inside the housing and may be exposed through a portion of the housing. At least one speaker (282) is placed inside the housing and may be exposed through another portion of the housing. A hardware button (e.g., key (256)) may be placed in another portion of the housing or configured to be displayed on the touchscreen display. A wireless communication circuit (e.g., communication module (220)) may be located inside the housing. The processor (210) (or processor (120)) is located within the housing and may be electrically connected to the touchscreen display, the microphone (288), the speaker (282), and the wireless communication circuit. The memory (230) (or memory (130)) is located within the housing and may be electrically connected to the processor (210).

[0042] In various embodiments of the present invention, the memory (230) is configured to store a first application program including a first user interface for receiving text input, and the memory (230) stores instructions that, at execution, cause the processor (210) to perform a first operation and a second operation, the first operation is to receive a first type of user input through the button while the first user interface is not displayed on the touchscreen display, and after receiving the first type of user input, to receive a first user utterance through the microphone (288), provide first data regarding the first user utterance to an external server including an automatic speech recognition (ASR) and intelligence system, and after providing the first data, to receive at least one command from the external server to perform a task generated by the intelligence system in response to the first user utterance, and the second operation is to perform the first on the touchscreen display 1. While the user interface is being displayed, the first user input is received through the button, and after receiving the first type of user input, the second user utterance is received through the microphone (288), and second data regarding the second user utterance is provided to the external server, and after providing the second data, data regarding text generated by automatic speech recognition from the second user utterance is received from the server, but the command generated by the intelligent system is not received, and the text can be entered into the first user interface.

[0043] In various embodiments of the present invention, the button may include a physical key located on the side of the housing.

[0044] In various embodiments of the present invention, the first type of user input may be one of a single press of the button, two presses of the button, three presses of the button, holding down after one press of the button, or two presses of the button and holding down.

[0045] In various embodiments of the present invention, the instructions may further cause the processor to display the first user interface along with a virtual keyboard. The button may not be part of the virtual keyboard.

[0046] In various embodiments of the present invention, the instructions may further cause the processor (210) to receive data for text generated by ASR from the first user utterance in the first operation from the external server.

[0047] In various embodiments of the present invention, the first application program may include at least one of a note application program, an email application program, a web browser application program, or a calendar application program.

[0048] In various embodiments of the present invention, the first application program includes a message application, and the instructions may further cause the processor (210) to automatically transmit the input text through the wireless communication circuit when a selected time period has elapsed after the text has been input.

[0049] In various embodiments of the present invention, the instructions further cause the processor (210) to perform a third operation, the third operation being to receive a second type of user input through the button while displaying the first user interface on the touchscreen display, receive a third user utterance through the microphone after receiving the second type of user input, provide third data regarding the third user utterance to the external server, and after providing the third data, receive at least one command from the external server to perform a task generated by the intelligent system in response to the third user utterance.

[0050] In various embodiments of the present invention, the instructions further cause the processor (210) to perform a fourth operation, the fourth operation may receive a second type of user input through the button while the first user interface is not displayed on the touchscreen display, receive a fourth user utterance through the microphone (288) after receiving the second type of user input, provide fourth data for the fourth user utterance to the external server, receive at least one command from the external server to perform a task generated by the intelligent system in response to the fourth user utterance after providing the fourth data, receive a fifth user utterance through the microphone, provide fifth data for the fifth user utterance to the external server, and receive at least one command from the external server to perform a task generated by the intelligent system in response to the fifth user utterance after providing the fifth data.

[0051] In various embodiments of the present invention, the first type of user input and the second type of user input are different from each other and may be selected from one of a single press of the button, a double press of the button, a triple press of the button, a press held after a single press of the button, or a double press and a press held of the button.

[0052] In various embodiments of the present invention, the memory (230) is further configured to store a second application program including a second user interface for receiving text input, and the instructions further cause the processor (210) to perform a third operation when executed, and the third operation is, While displaying the second user interface, the first type of user input is received through the button, and After the first type of user input is received, a third user utterance is received through the microphone, and third data regarding the third user utterance is provided to the external server. After providing the third data, data regarding text generated by ASR from the third user utterance is received from the external server, and the command generated by the intelligent system is not received, and the text is entered into the second user interface, and when the selected time period is exceeded after entering the text, the entered text can be automatically transmitted through the wireless communication circuit.

[0053] In various embodiments of the present invention, the memory (230) is configured to store a first application program including a first user interface for receiving text input, and the memory (230) stores instructions that, at execution, cause the processor (210) to perform a first operation and a second operation, and the first operation is, A first type of user input is received through the button above, and after receiving the first type of user input, a first user utterance is received through the microphone (288), and first data regarding the first user utterance is provided to an external server including automatic speech recognition (ASR) and an intelligence system, and after providing the first data, at least one command is received from the external server to perform a task generated by the intelligence system in response to the first user utterance. The second operation above receives a second type of user input through the button, and after receiving the second type of user input, receives a second user utterance through the microphone (288), provides second data regarding the second user utterance to the external server, and after providing the second data, receives data regarding text generated by ASR from the second user utterance from the server, while not receiving commands generated by the intelligent system, and can input the text into the first user interface.

[0054] In various embodiments of the present invention, the instructions may further cause the processor (210) to display the first user interface together with a virtual keyboard, and the buttons may not be part of the virtual keyboard.

[0055] In various embodiments of the present invention, the instructions may further cause the processor (210) to receive data for text generated by the ASR from the first user utterance within the first operation from the external server.

[0056] In various embodiments of the present invention, the first application program may include at least one of a note application program, an email application program, a web browser application program, or a calendar application program.

[0057] In various embodiments of the present invention, the first application program includes a message application, and the instructions may further cause the processor (210) to automatically transmit the input text through the wireless communication circuit when a selected time period has elapsed after the text has been input.

[0058] In various embodiments of the present invention, the instructions may further cause the processor (210) to perform the first operation independently of the display on the display of the first user interface.

[0059] In various embodiments of the present invention, the instructions may further cause the processor (210) to perform the second operation when at least one of the electronic device is locked or the touchscreen display is turned off.

[0060] In various embodiments of the present invention, the instructions may further cause the processor (210) to perform the second operation while displaying the first user interface on the touchscreen display.

[0061] In various embodiments of the present invention, the memory (230) may store an instruction that, at execution, causes the processor (210) to receive a user utterance through the microphone (288) and to perform at least one of automatic speech recognition (ASR) or natural language understanding (NLU) to transmit information related to whether to perform natural language understanding on the text obtained by performing ASR on the data for the user utterance, along with data for the user utterance, and if the information indicates that natural language understanding will not be performed, to receive the text for the data for the user utterance from the external server, and if the information indicates that natural language understanding will be performed, to receive a command obtained as a result of performing natural language understanding on the text from the external server.

[0063] FIG. 3 is a block diagram of a program module according to various embodiments. According to one embodiment, the program module (310) (e.g., program (140)) may include an operating system that controls resources related to an electronic device (e.g., electronic device (101)) and / or various applications running on the operating system (e.g., application programs (147)). The operating system is, for example, Android TM , iOS TM , Windows TM , Symbian TM , Tizen TM , or Bada TMIt may include. Referring to FIG. 3, the program module (310) may include a kernel (320) (e.g., kernel (141)), middleware (330) (e.g., middleware (143)), API (360) (e.g., API (145)), and / or an application (370) (e.g., application program (147)). At least a portion of the program module (310) may be preloaded onto an electronic device or downloaded from an external electronic device (e.g., electronic device (102, 104), server (106), etc.).

[0064] The kernel (320) may include, for example, a system resource manager (321) and / or a device driver (323). The system resource manager (321) may perform control, allocation, or reclamation of system resources. According to one embodiment, the system resource manager (321) may include a process management unit, a memory management unit, or a file system management unit. The device driver (323) may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an IPC (inter-process communication) driver. The middleware (330) may, for example, provide functions commonly required by the application (370) or provide various functions to the application (370) via an API (360) so that the application (370) can use limited system resources within the electronic device. According to one embodiment, the middleware (330) may include at least one of a runtime library (335), an application manager (341), a window manager (342), a multimedia manager (343), a resource manager (344), a power manager (345), a database manager (346), a package manager (347), a connectivity manager (348), a notification manager (349), a location manager (350), a graphics manager (351), or a security manager (352).

[0065] The runtime library (335) may include, for example, library modules used by the compiler to add new functions through a programming language while the application (370) is running. The runtime library (335) may perform input / output management, memory management, or arithmetic function processing. The application manager (341) may, for example, manage the lifecycle of the application (370). The window manager (342) may manage GUI resources used on the screen. The multimedia manager (343) may identify the format required for the playback of media files and perform encoding or decoding of the media files using a codec that matches the format. The resource manager (344) may manage the source code or memory space of the application (370). The power manager (345) may, for example, manage the capacity or power of the battery and provide power information required for the operation of the electronic device. According to one embodiment, the power manager (345) may be linked with the BIOS (basic input / output system). The database manager (346) can, for example, create, search, or change the database to be used in the application (370). The package manager (347) can manage the installation or update of the application distributed in the form of a package file.

[0066] The connectivity manager (348) can manage wireless connections, for example. The notification manager (349) can provide events to the user, such as arrival messages, appointments, and proximity notifications, for example. The location manager (350) can manage location information of the electronic device, for example. The graphics manager (351) can manage graphic effects or related user interfaces to be provided to the user, for example. The security manager (352) can provide system security or user authentication, for example. According to one embodiment, the middleware (330) may include a telephony manager for managing voice or video call functions of the electronic device or a middleware module capable of forming a combination of the functions of the aforementioned components. According to one embodiment, the middleware (330) may provide modules specialized for each type of operating system. The middleware (330) may dynamically delete some existing components or add new components. The API (360) is, for example, a set of API programming functions and may be provided in different configurations depending on the operating system. For example, in the case of Android or iOS, one set of APIs may be provided per platform, and in the case of Tizen, two or more sets of APIs may be provided per platform.

[0067] The application (370) may include, for example, a home (371), a dialer (372), an SMS / MMS (373), an IM (instant message) (374), a browser (375), a camera (376), an alarm (377), a contact (378), a voice dialer (379), an email (380), a calendar (381), a media player (382), an album (383), a watch (384), a healthcare application (e.g., measuring exercise volume or blood sugar, etc.), or an application for providing environmental information (e.g., atmospheric pressure, humidity, or temperature information). According to one embodiment, the application (370) may include an information exchange application capable of supporting information exchange between an electronic device and an external electronic device. The information exchange application may include, for example, a notification relay application for transmitting specific information to an external electronic device, or a device management application for managing an external electronic device. For example, a notification delivery application may transmit notification information generated by another application of the electronic device to an external electronic device, or receive notification information from an external electronic device and provide it to the user. A device management application may install, delete, or update functions of an external electronic device communicating with the electronic device (e.g., turning on / off of the external electronic device itself (or some components) or adjusting the brightness (or resolution) of a display), or applications running on the external electronic device. According to one embodiment, the application (370) may include an application specified according to the attributes of the external electronic device (e.g., a health management application for a mobile medical device). According to one embodiment, the application (370) may include an application received from an external electronic device.At least a portion of the program module (310) may be implemented (e.g., executed) by software, firmware, hardware (e.g., processor (210)), or a combination of at least two of these, and may include a module, program, routine, instruction set, or process for performing one or more functions.

[0069] FIG. 4 is a flowchart illustrating how an electronic device operates according to various embodiments.

[0070] FIG. 5 is a drawing showing an example of measuring the excavation area and depth using three-dimensional modeling data according to various embodiments.

[0071] FIG. 6 is a drawing showing an example of identifying the location of underground facilities through three-dimensional modeling and analyzing whether there is interference with choke points according to various embodiments.

[0073] In operation 401, according to various embodiments, the processor (120) of the electronic device (100) can acquire three-dimensional modeling data for a choke point of power equipment. The processor (120) can capture the choke point using various equipment such as a drone, a DSLR camera, a 3D scanner, and LiDAR, and can generate three-dimensional modeling data by processing the captured image data. Specifically, through drone photography, a wide area can be captured quickly and efficiently, and choke points in hard-to-reach areas can also be captured. Additionally, the processor (120) can acquire image data of the choke point using a camera mounted on a drone and generate three-dimensional modeling data by processing the acquired image data. Through DSLR camera photography, images with higher resolution than drone photography can be acquired and utilized to generate precise three-dimensional modeling data. The processor (120) can generate three-dimensional modeling data using high-resolution images captured with a DSLR camera. The choke point can be scanned using a 3D scanner, and three-dimensional modeling data can be generated based on the scanned data. A 3D scanner is a device that measures the shape of an object using a laser or light, and can acquire accurate and detailed 3D modeling data. A LiDAR (Light Detection and Ranging) sensor can be used to scan choke points, and 3D modeling data can be generated based on the scanned data. LiDAR is a sensor that measures the distance to an object using laser pulses, and can scan a wide area quickly and accurately, and is particularly effective for capturing choke points obscured by vegetation or obstacles. The processor (120) can selectively use the data acquired using the various devices mentioned above according to the situation, or fuse them to generate more precise and complete 3D modeling data.

[0075] In operation 403, according to various embodiments, the processor (120) of the electronic device (100) can extract location information, depth information, and surrounding environment information of the choke point based on three-dimensional modeling data. The location coordinates of the choke point can be extracted from the three-dimensional modeling data and linked with GPS information to determine the exact location. Specifically, the depth information of the choke point can be extracted from the three-dimensional modeling data to accurately determine the burial depth of the underground facility. The surface of the choke point can be extracted from the three-dimensional modeling data, and depth information can be calculated by analyzing the elevation information of the surface. For example, depth information can be extracted by calculating the distance to the lowest point of the choke point relative to the ground surface. Information regarding the terrain, buildings, vegetation, roads, etc., around the choke point can be extracted from the three-dimensional modeling data to determine the surrounding environment information. This information can be utilized for the accessibility of the choke point, the difficulty of maintenance work, and the establishment of safety management plans.

[0076] According to one embodiment, the processor (120) of the electronic device (100) can calculate the earthwork volume of the choke point using three-dimensional modeling data.

[0077] FIG. 5 illustrates an example of measuring the excavation area and depth using three-dimensional modeling data. A processor (120) can extract a polygon representing the excavation area from the three-dimensional modeling data and calculate the area of ​​the polygon. The excavation area can be extracted from the three-dimensional modeling data based on the ground surface and the excavation boundary line, and even irregularly shaped excavation areas can be accurately calculated. The excavation depth can be measured from the three-dimensional modeling data. The excavation depth can be calculated by measuring the distance between the ground surface and the bottom of the excavation in the three-dimensional modeling data, and the average excavation depth can also be calculated by measuring the depth at various points. The earthwork volume can be calculated using the measured excavation area and excavation depth.

[0078] Specifically, the excavation area and depth of a chalk point can be measured from 3D modeling data, and the earthwork volume can be calculated using this information. Earthwork volume refers to the amount of soil generated in civil engineering works such as excavation, embankment, and transportation, and is an essential element for construction planning and management. Polygons representing the excavation area can be extracted from 3D modeling data, and the area of ​​these polygons can be calculated. The excavation area can be extracted from the 3D modeling data based on the ground surface and the excavation boundary line, and even irregularly shaped excavation areas can be accurately calculated. The excavation depth can be measured from the 3D modeling data. The excavation depth can be calculated by measuring the distance between the ground surface and the bottom of the excavation from the 3D modeling data, and the average excavation depth can also be calculated by measuring the depth at various points. The earthwork volume can be calculated using the measured excavation area and excavation depth. Various formulas can be used to calculate earthwork volumes, such as the section method, contour method, and TIN (Triangulated Irregular Network)-based volume calculation methods. Based on the calculated earthwork volumes, plans for soil transportation and waste disposal can be established. Furthermore, analyzing changes in earthwork volumes allows for monitoring construction progress and detecting unexpected issues. The earthwork volume calculation function is useful for predicting the required amount of soil and estimating construction costs during the planning phase. Additionally, this function can be utilized to monitor construction progress and during the settlement process after completion.

[0080] In operation 405, according to various embodiments, the processor (120) of the electronic device (100) can predict the risk level of a choke point by analyzing 3D modeling data using artificial intelligence technology. Specifically, an artificial intelligence model can be trained using feature information extracted from 3D modeling data. An artificial intelligence model that predicts the risk level of a choke point can be trained using past accident case data, sensor data, weather data, maintenance history data, power equipment design data, etc. Various artificial intelligence models can be utilized; for example, a deep learning-based Convolutional Neural Network (CNN) model can be used to extract image features of a choke point from 3D modeling data, and a Recurrent Neural Network (RNN) model can be used to analyze time-series sensor data to predict the risk level. The trained artificial intelligence model can receive new 3D modeling data as input and predict the risk level of a choke point. For example, the artificial intelligence model can predict the risk level by analyzing the degree of aging of the choke point, risk factors in the surrounding environment, possibility of external impact, corrosion, cracks, deformation, etc., from the 3D modeling data.

[0081] According to one embodiment, the processor (120) of the electronic device (100) can analyze whether there is interference with underground facilities around the choke point using three-dimensional modeling data.

[0082] Figure 6 illustrates an example of identifying the location of an underground facility (red line) through 3D modeling and analyzing whether there is interference with a choke point. Information such as the location, depth, type, and size of the underground facility can be extracted from the 3D modeling data. This information can be obtained through an underground facility management system, a Geographic Information System (GIS), design drawings, etc. The shortest distance between the choke point and the underground facility can be calculated from the 3D modeling data, and a warning of interference can be issued if it is closer than a set safety distance. Using the 3D modeling data, the intersection of the choke point and the underground facility can be analyzed, and depth information of the intersection point can be provided.

[0083] Specifically, 3D modeling data can be used to identify the location information of underground facilities (gas pipes, water pipes, communication cables, sewer pipes, etc.) around a choke point, and to determine whether interference occurs by analyzing the distance and depth between the choke point and the underground facilities. Information such as the location, depth, type, and size of underground facilities can be extracted from the 3D modeling data. This information can be obtained through underground facility management systems, Geographic Information Systems (GIS), design drawings, etc. For example, the shortest distance between a choke point and an underground facility can be calculated from the 3D modeling data, and a warning of interference can be issued if the distance is closer than a set safety distance. Using 3D modeling data, the intersection of a choke point and an underground facility can be analyzed, and depth information at the intersection point can be provided. The results of the interference analysis can be visually displayed alongside the 3D modeling data. For example, points where interference occurs can be marked in red, or points with a possibility of interference can be marked in yellow. Changes in the choke point can be predicted to forecast the possibility of interference with underground facilities in advance. For example, the likelihood of interference with underground facilities can be calculated by predicting settlement and deformation of choke points. The interference analysis function is effective in preventing collisions with underground facilities and reducing the possibility of safety accidents during the construction planning phase. Furthermore, the interference analysis function can help prevent damage to underground facilities and improve work efficiency during maintenance operations.

[0085] In operation 407, according to various embodiments, the processor (120) of the electronic device (100) can receive temperature, humidity, and vibration data from sensors installed at the choke point and monitor the state of the choke point in real time using the received data and 3D modeling data. Specifically, data can be received in real time from various sensors installed at the choke point. The state of the choke point can be monitored using various sensors such as temperature sensors, humidity sensors, vibration sensors, deformation sensors, gas sensors, acoustic sensors, and image sensors. The state of the choke point can be determined more accurately by fusing sensor data and 3D modeling data. For example, if a temperature change is detected in the temperature sensor data, the location where the temperature change occurred can be accurately identified using 3D modeling data, and the cause can be identified by analyzing image data at that location. Abnormal signs of the choke point can be detected in real time by analyzing sensor data. For example, an impact applied to the choke point can be detected by analyzing vibration sensor data, and the location where the impact was applied can be identified using 3D modeling data.

[0087] According to one embodiment, the processor (120) of the electronic device (100) can generate a digital twin of a choke point using three-dimensional modeling data and simulate various maintenance scenarios using the digital twin. Specifically, a digital twin of a choke point can be generated based on three-dimensional modeling data. A digital twin is a virtual model having the same shape, size, and attributes as an actual choke point, which replicates a real-world choke point in a virtual world. By using three-dimensional modeling data, a digital twin that accurately reflects the shape, size, material, and attributes of the choke point can be generated. Sensor data, maintenance history data, etc., can be linked to the digital twin to reflect the actual state of the choke point in real time. Various maintenance scenarios can be simulated using the digital twin. For example, simulations of specific part replacement, cable laying, accident occurrence, excavation, and repair can be performed. Various environmental conditions (temperature, humidity, wind, earthquake, etc.) can be applied to the digital twin to perform simulations. Through this, various situations that may occur in the actual environment can be predicted, and maintenance plans can be optimized. By analyzing simulation results, the efficiency, safety, and cost of maintenance operations can be evaluated. For example, simulation results can be used to determine the optimal work sequence and provide safety training to workers. Digital twin-based simulations can be utilized for maintenance planning, worker training, safety management, and decision support, and can help predict and prevent risks that may occur in real-world environments.

[0089] According to one embodiment, the processor (120) of the electronic device (100) can establish an optimal maintenance plan based on simulation results. An optimal maintenance plan can be established by analyzing simulation results for various maintenance scenarios and, specifically, evaluating the efficiency, safety, and cost of each scenario. A maintenance plan can be established by considering various variables such as work time, cost, safety, environmental impact, resource utilization, and work difficulty. An optimal maintenance plan can be derived using various optimization algorithms such as genetic algorithms, simulated annealing, and linear programming. The established maintenance plan can be evaluated according to various criteria, and the plan can be modified if necessary. For example, the plan can be evaluated based on work efficiency, safety score, cost efficiency, etc., and the work sequence, resource allocation, work method, etc., can be modified according to the evaluation results. In addition, the maintenance plan can be adjusted according to real-time situational changes (e.g., weather changes, equipment failure, absence of workers, etc.). For example, if the working environment deteriorates due to sudden heavy rain, the plan can be flexibly adjusted, such as by postponing the work schedule or changing the work method. Simulation-based maintenance planning optimization can contribute to maximizing maintenance work efficiency, reducing costs, and minimizing the possibility of safety accidents.

[0091] According to one embodiment, the processor (120) of the electronic device (100) can support multiple workers in sharing 3D modeling data and collaborating to establish a maintenance plan. Specifically, it can support multiple workers in accessing 3D modeling data, sharing information in real time, and establishing a maintenance plan through a cloud-based platform, a web-based system, a mobile application, etc. It can support sharing 3D modeling data, sensor data, maintenance history data, work plans, etc., among the workers. It can provide collaboration tools that allow workers to annotate 3D modeling data, exchange opinions, or share work plans. For example, it can support real-time communication among workers by providing chat functions, video conferencing functions, file sharing functions, etc. It can manage data access rights, modification rights, etc., by setting permissions for each worker. It can assign tasks and manage work progress by considering each worker's role, expertise, location, etc. Collaboration functions can facilitate information sharing and communication among workers and help increase the efficiency of establishing maintenance plans. In addition, through collaboration, various opinions can be reflected and better maintenance plans can be established.

[0093] According to one embodiment, the processor (120) of the electronic device (100) can control a robot that performs maintenance work using three-dimensional modeling data. Specifically, the robot's path can be planned using three-dimensional modeling data, and work instructions can be transmitted to the robot to automate maintenance work. Various types of robots (e.g., mobile robots, drones, robot arms) can be controlled to perform maintenance work. A path for the robot to approach a choke point can be planned using three-dimensional modeling data. For example, a path can be planned to avoid obstacles and move along a safe path. Work instructions can be transmitted to the robot to automatically perform various maintenance tasks, such as cable replacement, parts cleaning, painting, and inspection. Multiple robots can be controlled simultaneously to perform collaborative work. For example, collaborative work can be performed using a drone to inspect a choke point, a mobile robot to transport parts, and a robot arm to replace parts. The robot control function can help increase the efficiency of maintenance work and ensure the safety of workers. In addition, robots can be used to automate dangerous tasks, repetitive tasks, and work in hard-to-reach areas.

[0095] In operation 409, according to various embodiments, the processor (120) of the electronic device (100) can establish a maintenance plan for choke points based on risk prediction results and real-time monitoring results. Specifically, an optimal maintenance plan can be established by comprehensively analyzing the risk predicted by an artificial intelligence model, real-time monitoring results based on sensor data, past maintenance history, power equipment operation data, weather data, etc. For choke points with high risk, a preventive maintenance plan can be established, and for choke points with low risk, a regular inspection plan can be established. For choke points where abnormal signs are detected by analyzing real-time monitoring results, an immediate maintenance plan can be established. When establishing a maintenance plan, an optimized plan can be established by considering work time, cost, safety, etc. For example, the order of maintenance work for multiple choke points can be optimized to minimize travel distance and shorten work time.

[0097] According to one embodiment, three-dimensional modeling data can be obtained through drone photography or DSLR camera photography. Specifically, drone photography can photograph a wide area quickly and efficiently, and can also photograph choke points in areas that are difficult to access. A processor (120) can obtain image data of a choke point using a camera mounted on a drone and process the obtained image data to generate three-dimensional modeling data. DSLR camera photography is advantageous for generating precise three-dimensional modeling data because it can obtain images with higher resolution than drone photography. A processor (120) can generate three-dimensional modeling data using high-resolution images taken with a DSLR camera. An electronic device (100) can generate three-dimensional modeling data by processing image data obtained through drone photography or DSLR camera photography, and may use both shooting methods in parallel as needed.

[0099] According to one embodiment, power equipment may include underground cables, transformers, and switchgear. Specifically, underground cables are power cables buried underground and are vulnerable to external impacts, leakage, corrosion, etc., requiring periodic inspection and maintenance. An electronic device (100) can identify the buried location, depth, and surrounding environment information of the underground cables using 3D modeling data, and can diagnose whether the cable is damaged or whether leakage has occurred. A transformer is a device that converts voltage, and there are risk factors such as overload, insulation breakdown, and temperature rise. An electronic device (100) can identify the shape, size, and location information of the transformer using 3D modeling data, and can detect whether the transformer is operating abnormally or overheating. A switchgear is a device that opens and closes power circuits, and problems such as poor contact, arc generation, and insulation damage may occur. An electronic device (100) can check the operating status of the switchgear, the wear status of contact parts, and the insulation status using 3D modeling data, and can respond quickly when an abnormality occurs.

[0101] In operation 411, according to various embodiments, the processor (120) of the electronic device (100) may provide work instructions to a worker using augmented reality technology according to a maintenance plan. Specifically, work instructions may be provided using augmented reality technology on the worker's smartphone, tablet PC, AR glasses, etc. When the worker wears AR glasses and looks at the choke point, the location, depth, surrounding environment information, work sequence, necessary tools, precautions, etc. of the choke point may be displayed in the worker's field of vision based on 3D modeling data. By providing work instructions using augmented reality technology, the worker can easily and quickly check the information needed at the site, reduce work errors, and increase work efficiency. By visually providing the worker with hazardous areas, precautions, etc. using augmented reality technology, it may also contribute to preventing safety accidents.

[0103] According to various embodiments, an electronic device for managing and maintaining power equipment including a choke point comprises a processor, wherein the processor acquires three-dimensional modeling data for a choke point of power equipment; extracts location information, depth information, and surrounding environment information of the choke point based on the three-dimensional modeling data; inputs the three-dimensional modeling data into an artificial intelligence model to output a risk level of the choke point corresponding to the three-dimensional modeling data; receives temperature, humidity, and vibration data from a sensor installed at the choke point, and monitors the condition of the choke point in real time using the received data and the three-dimensional modeling data; establishes a maintenance plan for the choke point based on the risk level output result and the real-time monitoring result; and may be configured to provide work instructions to a worker using augmented reality technology according to the maintenance plan.

[0104] According to various embodiments, the processor may be further configured to calculate the earthwork volume of the choke point using the three-dimensional modeling data.

[0105] According to various embodiments, the processor may be further configured to analyze whether there is interference with underground facilities around the choke point using the three-dimensional modeling data.

[0106] According to various embodiments, the processor may be further configured to generate a digital twin of a choke point using the three-dimensional modeling data and to simulate various maintenance scenarios using the digital twin.

[0107] According to various embodiments, the processor may be further configured to establish an optimal maintenance plan based on the simulation results.

[0108] According to various embodiments, the processor may be further configured to control a robot that performs maintenance work using the three-dimensional modeling data.

[0109] According to various embodiments, the three-dimensional modeling data can be obtained through drone photography or DSLR camera photography.

[0110] According to various embodiments, the power equipment may include an underground cable, a transformer, and a switchgear.

[0111] According to various embodiments, a method of operation of an electronic device for the management and maintenance of power equipment including a choke point may include: a step of acquiring three-dimensional modeling data for a choke point of power equipment; a step of extracting location information, depth information, and surrounding environment information of the choke point based on the three-dimensional modeling data; a step of inputting the three-dimensional modeling data into an artificial intelligence model to output a risk level of the choke point corresponding to the three-dimensional modeling data; a step of receiving temperature, humidity, and vibration data from a sensor installed at the choke point and monitoring the state of the choke point in real time using the received data and the three-dimensional modeling data; a step of establishing a maintenance plan for the choke point based on the risk level output result and the real-time monitoring result; and a step of providing work instructions to a worker using augmented reality technology according to the maintenance plan.

[0113] As used in this document, the terms “module” or “part” include a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. “Module” or “part” may be a component formed integrally or a minimum unit or part thereof that performs one or more functions. “Module” or “part” may be implemented mechanically or electronically and may include, for example, an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), or programmable logic device known or to be developed that performs certain operations, and may be executed by a processor (120). At least part of the device (e.g., modules or functions thereof) or method (e.g., operations) according to various embodiments may be implemented as instructions stored in a computer-readable storage medium (e.g., memory (130)) in the form of a program module. When the above instruction is executed by a processor (e.g., processor (120)), the processor may perform a function corresponding to the above instruction. Computer-readable recording media may include a hard disk, a floppy disk, a magnetic medium (e.g., magnetic tape), an optical recording medium (e.g., CD-ROM, DVD, magneto-optical medium (e.g., floptical disk), built-in memory, etc. Instructions may include code generated by a compiler or code that can be executed by an interpreter. A module or program module according to various embodiments may include at least one of the aforementioned components, some of which may be omitted, or additionally include other components. Operations performed by a module, program module, or other components according to various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0114] Furthermore, the embodiments disclosed in this document are presented for the purpose of explaining and understanding the disclosed technical content and are not intended to limit the scope of this disclosure. Accordingly, the scope of this disclosure should be interpreted to include all modifications or various other embodiments based on the technical concept of this disclosure.

Claims

Claim 1 An electronic device for the management and maintenance of power equipment including a choke point, comprising a processor, wherein the processor acquires three-dimensional modeling data for a choke point of power equipment; extracts location information, depth information, and surrounding environment information of the choke point based on the three-dimensional modeling data; inputs the three-dimensional modeling data into an artificial intelligence model to output a risk level of the choke point corresponding to the three-dimensional modeling data; receives temperature, humidity, and vibration data from a sensor installed at the choke point, and monitors the condition of the choke point in real time using the received data and the three-dimensional modeling data; establishes a maintenance plan for the choke point based on the risk level output result and the real-time monitoring result; and is configured to provide work instructions to a worker using augmented reality technology according to the maintenance plan. Claim 2 In claim 1, the electronic device is further configured such that the processor calculates the earthwork volume of the choke point using the three-dimensional modeling data. Claim 3 In claim 1, the electronic device is further configured such that the processor analyzes whether there is interference with underground facilities around the choke point using the three-dimensional modeling data. Claim 4 An electronic device according to claim 1, wherein the processor is further configured to generate a digital twin of a choke point using the three-dimensional modeling data and to simulate various maintenance scenarios using the digital twin. Claim 5 In claim 1, the electronic device, wherein the processor is further configured to establish an optimal maintenance plan based on the simulation results. Claim 6 In claim 1, the processor is an electronic device further configured to control a robot that performs maintenance work using the three-dimensional modeling data. Claim 7 An electronic device according to claim 1, wherein the three-dimensional modeling data is obtained through drone photography or DSLR camera photography. Claim 8 In claim 1, the above power facility is an electronic device including an underground cable, a transformer, and a switch. Claim 9 A method of operation of an electronic device for the management and maintenance of power facilities including a choke point, comprising: a step of acquiring three-dimensional modeling data for a choke point of power facilities; a step of extracting location information, depth information, and surrounding environment information of the choke point based on the three-dimensional modeling data; a step of inputting the three-dimensional modeling data into an artificial intelligence model to output a risk level of the choke point corresponding to the three-dimensional modeling data; a step of receiving temperature, humidity, and vibration data from a sensor installed at the choke point and monitoring the state of the choke point in real time using the received data and the three-dimensional modeling data; a step of establishing a maintenance plan for the choke point based on the risk level output result and the real-time monitoring result; and a step of providing work instructions to a worker using augmented reality technology according to the maintenance plan.

Images