Electronic device for detecting anomalies in operating environment of mobile vehicles, and method for operating same

Abstract

Disclosed are an electronic device for detecting abnormalities in an operating environment of mobile vehicles, and a method for operating same. According to one embodiment, a method for operating an electronic device may comprise the steps of: collecting data related to operation from one or more mobile vehicles; generating monitoring information on the basis of anomaly information about the one or more mobile vehicles generated from the data related to operation; and determining, on the basis of the monitoring information, whether at least a portion of the anomaly information has been generated by one or more specific segments of a track on which the one or more mobile vehicles operate.

Description

Electronic device for detecting abnormalities in the operating environment of mobile devices and its operating method

[0001] An electronic device for detecting anomalies in the operating environment of mobile devices and an operating method thereof are disclosed.

[0002] Unmanned transport vehicles, such as automated guided vehicles (AGVs) and autonomous mobile robots (AMRs), are being used in a variety of industries. Examples include overhead hoist transport (OHTs) used within semiconductor wafer manufacturing facilities (fabs) and robots used to automate product transport in logistics warehouses.

[0003] Systems utilizing unmanned transport vehicles can experience malfunctions due to problems with the unmanned transport vehicles themselves or the environment in which they operate. To eliminate or prevent these malfunctions, unmanned transport vehicles and the environment in which they operate (e.g., tracks) can be maintained in two ways. These two methods can include maintenance performed whenever a breakdown occurs (i.e., breakdown maintenance (BM)) and preventive maintenance (i.e., PM). Breakdown maintenance, which involves performing maintenance whenever the system breaks down, can lead to significant human and material losses due to unexpected breakdowns. Preventive maintenance can manage the lifespan of each component based on mileage, inspecting and replacing components when they reach a predetermined mileage. Preventive maintenance can present challenges as it is difficult to precisely determine the period during which preventive maintenance is performed.

[0004] The background technology described above is possessed or acquired during the process of deriving the present disclosure, and cannot necessarily be said to be a publicly known technology disclosed to the general public prior to the filing of the present disclosure.

[0005] The present disclosure provides a method and device for determining whether an abnormality has occurred based on data related to operation collected by mobile devices.

[0006] The present disclosure provides a method and device for determining whether abnormalities are caused by moving objects or the operating environment of moving objects.

[0007] The present disclosure provides a method and device for providing information on maintenance of mobile devices or their operating environments through a user interface.

[0008] According to one embodiment, a method of operating an electronic device may include the steps of collecting data related to operation from one or more mobiles, generating monitoring information based on anomaly information about the one or more mobiles generated from the data related to operation, and determining based on the monitoring information whether at least a portion of the anomaly information is generated by one or more specific segments of a track on which the one or more mobiles are operated.

[0009] According to one embodiment, the step of collecting data related to the operation may collect data related to the one or more mobiles obtained from a plurality of sensors included in the one or more mobiles and data related to the operation environment of the one or more mobiles.

[0010] According to one embodiment, the step of generating the monitoring information may generate the monitoring information by arranging abnormal information about the one or more moving objects by segment included in the track.

[0011] According to one embodiment, the monitoring information may be generated based on a grid having as axes the properties of the one or more moving objects and the properties of segments of the track.

[0012] According to one embodiment, the step of determining whether the abnormality has occurred by one or more specific segments may determine that at least a portion of the abnormality information has occurred by one or more specific segments based on the abnormality information and threshold criteria for the one or more specific segments.

[0013] According to one embodiment, the operating method may further include a step of determining a segment in which a bottleneck occurs based on data related to the operation, and a step of providing the segment in which the bottleneck occurs through a user interface.

[0014] According to one embodiment, the data related to the operation may include one or more of data related to driving of the one or more mobile objects and data related to the work performed by the one or more mobile objects.

[0015] According to one embodiment, the method may further include a step of determining whether an abnormality occurring in one or more specific segments is caused by one or more of a specific drive and a specific task based on data related to the drive and data on the work content.

[0016] According to one embodiment, the method may further include the step of identifying a segment through which the one or more mobile objects pass based on data related to the driving and nodes through which the one or more mobile objects pass, and the step of updating monitoring information for the identified segment.

[0017] According to one embodiment, the method may further include transmitting a control command to an idle vehicle to obtain information about one or more specific segments.

[0018] According to one embodiment, the method may further include updating mileage for maintenance for a plurality of segments of the track based on data related to the operation.

[0019] According to one embodiment, a maintenance check order for one or more specific segments may be provided with priority over other segments through a user interface.

[0020]

[0021] According to one embodiment, the method may further include a step of determining, based on the monitoring information, whether at least a portion of the abnormal information was generated by one or more specific mobile objects.

[0022] According to one embodiment, the method may further include updating mileage for maintenance of one or more of the mobile devices based on data related to the operation.

[0023] According to one embodiment, a maintenance inspection order for one or more specific mobiles may be provided with priority over other mobiles through a user interface.

[0024] According to one embodiment, a method of operating an electronic device may include a step of collecting data related to operation from one or more mobiles, a step of generating monitoring information by arranging anomaly information about the one or more mobiles generated from the data related to operation by segment of a track on which the one or more mobiles operate, and a step of determining, based on the monitoring information, whether at least a portion of the anomaly information is generated by one or more specific segments of the track or one or more specific mobiles.

[0025] According to one embodiment, a computer-readable recording medium can store one or more computer programs including instructions for executing any one of the methods described above.

[0026] According to one embodiment, an electronic device includes a processor that controls one or more mobile devices, wherein the processor collects data related to operation from the one or more mobile devices, generates monitoring information based on anomaly information about the one or more mobile devices generated from the data related to operation, and determines based on the monitoring information whether at least a portion of the anomaly information is generated by one or more specific segments of a track on which the one or more mobile devices are operated.

[0027] According to one embodiment, the processor can collect data related to the one or more mobiles obtained from a plurality of sensors included in the one or more mobiles and data related to the operating environment of the one or more mobiles.

[0028] According to one embodiment, the processor may generate the monitoring information by arranging abnormal information about the one or more moving objects by segment included in the track.

[0029] According to one embodiment of the present disclosure, an electronic device can determine whether an abnormality has occurred by collecting operation-related data from mobile devices.

[0030] According to one embodiment of the present disclosure, an electronic device can determine whether abnormalities are caused by moving objects or the operating environment of moving objects.

[0031] According to one embodiment of the present disclosure, an electronic device can provide information on maintenance of mobile devices or the operating environment of mobile devices through a user interface.

[0032] FIG. 1 is a drawing for explaining an automation system using mobile bodies according to one embodiment of the present disclosure.

[0033] FIG. 2 is a diagram illustrating an electronic device or mobile device for detecting an anomaly according to one embodiment of the present disclosure.

[0034] FIG. 3 and FIG. 4 are diagrams for explaining the determination of an abnormality occurrence based on monitoring information according to one embodiment of the present disclosure.

[0035] FIG. 5 is a diagram for explaining anomaly detection based on data related to driving and data on work content according to one embodiment of the present disclosure.

[0036] FIG. 6 and FIG. 7 are drawings for explaining a user interface according to one embodiment of the present disclosure.

[0037] FIG. 8 is a drawing for explaining an operation method of an electronic device according to one embodiment of the present disclosure.

[0038] Hereinafter, embodiments will be described in detail with reference to the attached drawings. However, the scope of the patent application is not limited or restricted by these embodiments. The same reference numerals in each drawing represent the same components.

[0039] The embodiments described below may be modified in various ways. The embodiments described below are not intended to be limiting in their specific form, and should be understood to encompass all modifications, equivalents, and alternatives thereof.

[0040] While terms like "first" and "second" may be used to describe various components, these terms should be understood only to distinguish one component from another. For example, a "first" component may be referred to as a "second" component, and similarly, a "second" component may also be referred to as a "first" component.

[0041] The terms used in the examples are used only to describe specific embodiments and are not intended to limit the embodiments. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this specification, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among the phrases, or all possible combinations thereof. In this specification, it should be understood that the terms "comprise" or "have" and the like specify the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0042] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the embodiments pertain. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined herein.

[0043] In addition, when describing with reference to the attached drawings, identical components will be assigned the same reference numerals regardless of the drawing numbers, and redundant descriptions thereof will be omitted. When describing embodiments, if a detailed description of a related known technology is judged to unnecessarily obscure the gist of the embodiment, the detailed description will be omitted.

[0044] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0045]

[0046] FIG. 1 is a drawing for explaining an automation system using mobile bodies according to one embodiment of the present disclosure.

[0047] Referring to FIG. 1, an automated system (100) that processes work using a plurality of moving bodies (131, 133, 135) is illustrated.

[0048] Referring to FIG. 1, the electronic device (110) may include a processor (111) and a memory (113). Only components related to the present embodiments are illustrated in the electronic device (110) illustrated in FIG. 1. Therefore, it will be apparent to those skilled in the art that the electronic device (110) may further include other general components in addition to the components illustrated in FIG. 1.

[0049] The processor (111) may perform an overall function for controlling the electronic device (110). The processor (111) may control the electronic device (110) overall by executing programs and / or commands stored in the memory (113). The processor (111) may be implemented as a central processing unit (CPU), a graphics processing unit (GPU), an application processor (AP), etc., provided in the electronic device (110), but is not limited thereto.

[0050] The memory (113) may be hardware that stores data processed and data to be processed within the electronic device (110). In addition, the memory (113) may store applications, drivers, etc. to be driven by the electronic device (110). The memory (113) may include volatile memory such as dynamic random access memory (DRAM) and / or nonvolatile memory.

[0051] The electronic device (110) may be configured using a server or the like, but the present invention is not necessarily limited thereto. Furthermore, depending on the operating environment, the electronic device (110) may not be implemented as a separate device but may be configured in combination with one or more mobile devices.

[0052] Referring to FIG. 1, a plurality of mobiles (131, 133, 135) and an electronic device (110) can communicate via a network (120). The plurality of mobiles (131, 133, 135) and the electronic device (110) can transmit and receive various data and / or commands via the network (120). For example, the electronic device (110) can receive battery status from the plurality of mobiles (131, 133, 135). For example, the electronic device (110) can receive operation-related data from the plurality of mobiles (131, 133, 135). For example, the electronic device (110) can transmit control commands to the plurality of mobiles (131, 133, 135). The network (120) can include a wired network and a wireless network. For example, the network (120) may include various communication networks such as a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), Bluetooth, and wireless fidelity (Wi-Fi). However, the above-described network (120) is merely an example and the present disclosure is not limited thereto.

[0053] Referring to FIG. 1, a schematic workspace (160) is illustrated in which a plurality of moving objects (131, 133, 135) perform a plurality of tasks (141, 143, 145). The workspace (160) may include a plurality of moving objects (131, 133, 135), a plurality of tasks (141, 145, 147), and a plurality of charging stations (170, 180). The workspace (160) may include a plurality of intersections (151, 152, 153, 154, 155, 156, 157).

[0054] The plurality of mobile objects (131, 133, 135) may be automated guided vehicles (AGVs) and autonomous mobile robots (AMRs). While the present disclosure describes the mobile objects as being unmanned guided vehicles or autonomous mobile robots that perform the task of transporting objects, the present disclosure is not limited thereto. For example, the mobile objects may be robots, autonomous vehicles, and drones that perform specific tasks.

[0055] The plurality of tasks (141, 145, 147) may have various meanings, such as objects requiring transport work or locations where specific tasks are performed. The plurality of tasks (141, 143, 145) may be assigned to the plurality of moving objects (131, 133, 135). For example, the task (141) may be assigned to the moving object (131). The plurality of moving objects (131, 133, 135) may be assigned the plurality of tasks (141, 145, 147) through various methods (i.e., various task assignment policies).

[0056] Multiple intersections (151, 152, 153, 154, 155, 156, 157) may indicate points where a segment splits or merges into at least two.

[0057] A point where multiple intersections (151, 152, 153, 154, 155, 156, 157) and multiple tasks can occur can be called a node.

[0058] Referring to FIG. 1, a workspace (160) may include a track along which a plurality of moving objects (131, 133, 135) move. The track may include a plurality of segments divided by two adjacent nodes. The plurality of segments may be paths along which the plurality of moving objects (131, 133, 135) move. Although the plurality of segments in the workspace (160) are shown as being unidirectional, this is merely an example and it will be apparent to those skilled in the art that the segments may be bidirectional. The track may be a guide rail along which the plurality of moving objects (131, 133, 135) can move, but the present disclosure is not limited thereto. For example, the track may refer to a road surface (e.g., a road, a corridor, etc.) without a separate rail installed on which the plurality of moving objects (131, 133, 135) can freely pass.

[0059] A plurality of mobile objects (131, 133, 135) can move by using batteries. In order to maintain a state in which the plurality of mobile objects (131, 133, 135) can perform a task, a plurality of charging stations (170, 180) may need to be placed on one side of the work space (160). When the plurality of mobile objects (131, 133, 135) are assigned a charging task, they can visit the plurality of charging stations (170, 180) to charge their batteries. Assignment of the charging task to the plurality of mobile objects (131, 133, 135) can be performed by the electronic device (110) via the network (120). The electronic device (110) can utilize a charging policy to assign the charging task while minimizing the impact on the task.

[0060] Anomaly detection may be required for multiple moving objects (131, 133, 135) and tracks. Anomalies may refer to abnormal problems that may occur in moving objects or tracks. For example, anomalies may refer to abnormal problems that may affect the performance of the automated system (100), such as excessive vibrations during movement of the moving object, reduced braking ability of the moving object, excessive noise during movement of the moving object, and increased gaps between segments.

[0061] A method for detecting anomalies in multiple moving objects (131, 133, 135) and tracks may involve a visual inspection by a field engineer. This method requires the field engineer to walk around the work area (160) and visually inspect the entire section, which is time-consuming and can lead to human error, such as not detecting anomalies.

[0062] Additionally, a method for detecting track abnormalities may utilize a separate inspection device. The inspection device may be implemented in various ways. For example, the inspection device may be implemented as a separate device from a human-controlled mobile device. For example, the inspection device may be implemented as a sensor mounted on the mobile device. If the inspection device is implemented as a separate device from the mobile device, track abnormalities can be detected through separate operation, rather than measuring the impact on the actual mobile device while performing its task. However, the impact on the mobile device may vary depending on whether the mobile device is loaded with an object, its acceleration and deceleration status, etc. For example, if the mobile device (131) makes a left turn while loaded with an object, an impact may occur on the mobile device (131), but if the mobile device (131) makes a left turn while unloaded, an impact may not occur on the mobile device (131). Therefore, using a separate inspection device may make it difficult to accurately determine the actual impact on the mobile device. Furthermore, if the inspection device is controlled by a human, rather than by the automated system (100), human error may occur. Additionally, while performing an inspection using an inspection device, the efficiency of the automated system (100) may be reduced because the inspection device may interfere with logistics processing.

[0063] Below, we will describe a method for detecting anomalies using a mobile object rather than a separate inspection device.

[0064]

[0065] FIG. 2 is a diagram illustrating an electronic device or mobile device for detecting an anomaly according to one embodiment of the present disclosure.

[0066] Referring to FIG. 2, a mobile device (200), an electronic device (210), and a user terminal (230) communicating via a network (220) are illustrated. Descriptions of the network (220) and the electronic device (210) will be omitted as they have been described above with reference to FIG. 1. The electronic device (210) can communicate with more mobile devices via the network (220), but only one mobile device (200) is illustrated for convenience of explanation. However, it will be apparent to those skilled in the art that the descriptions of the mobile device (200), the electronic device (210), and the user terminal (230) described in the present disclosure can be equally applied even when there are one or more mobile devices.

[0067] The mobile body (200) may include a control module (201), a sensor module (203), a motor driver (207), and a communication module (209). It will be apparent to those skilled in the art that the mobile body (200) may further include general-purpose components other than the components illustrated in FIG. 2. According to one embodiment, the mobile body (200) may further include an anomaly detection module (205). The anomaly detection module may be included in either the electronic device (210) or the mobile body (200). For example, when the mobile body (200) includes the anomaly detection module (205), the electronic device may not include the anomaly detection module (213). For example, when the electronic device (210) includes the anomaly detection module (213), the mobile body (200) may not include the anomaly detection module (205).

[0068] The control module (201) can control the mobile body (200) according to the control command received from the electronic device (210). The control module (201) can control the mobile body (200) in general. For example, the control module (201) can control the movement of the mobile body, such as acceleration, deceleration, and steering of the mobile body. For example, the control module (201) can control the mobile body (200) to perform a task assigned to the mobile body (200). For example, the control module can control the mobile body (200) to load or unload an object according to the task assigned to the mobile body (200).

[0069] The sensor module (203) can detect the operating status (e.g., power or temperature) of the mobile body (200) or the external environmental status, and generate an electrical signal or data value corresponding to the detected status. For example, the sensor module (203) can collect data related to operation, such as acceleration data, deceleration data, vibration data, steering data, and data on the loading status of an object of the mobile body (200). The sensor module (203) can include a plurality of sensors for collecting data related to operation from the mobile body (200). The plurality of sensors can include a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a temperature sensor, a humidity sensor, a LiDAR sensor, a camera, a vibration sensor, or an illuminance sensor.

[0070] Operation-related data acquired from the sensor module (203) may be transmitted to an electronic device (210) or a control module (201) via a network (220). According to one embodiment, operation-related data acquired from the sensor module (203) may be transmitted to an anomaly detection module (205).

[0071] Data related to operation may include data related to the mobile body (200) acquired from multiple sensors and data related to the operating environment of the mobile body (200). Data related to operation may be acquired at regular intervals, in real time, or when specific conditions (e.g., when a task is assigned) are satisfied. Data related to the mobile body (200) may be data about the mobile body itself, regardless of the operating environment. For example, data related to the mobile body (200) may include data such as data related to the steering of the mobile body (200), data related to the temperature of the mobile body (200), and data related to the speed of the mobile body (200). Data related to the mobile body (200) may include data related to the driving of the mobile body (200). For example, data related to the driving may include data such as the wheel angle of the mobile body (200), the steering angle of the mobile body (200), and the speed of the mobile body (200).

[0072] Data related to the operating environment may be data acquired from outside the mobile body (200). For example, it may include data regarding the segment in which the mobile body (200) moves and data regarding the surrounding environment of the mobile body (200). Data related to the operating environment may include data regarding the work performed by the mobile body (200). For example, data regarding the work performed by the mobile body (200) may include data regarding whether the mobile body is loading or unloading an object.

[0073] The motor driver (207) can control a plurality of motors included in the mobile body (200). The motor driver (207) can adjust the rotation speed and direction of the plurality of motors. The plurality of motors can include a motor related to the movement of the mobile body (200) and a motor related to the performance of a task of the mobile body (200). The motor driver (207) can receive a control input from the control module (201), supply power to the motor according to the control input, and control the current and voltage to adjust the rotation speed and direction of the motor.

[0074] The communication module (209) can support the establishment of a direct (e.g., wired) communication channel or wireless communication channel between a mobile device (200) and an electronic device (210), and the performance of communication through the established communication channel.

[0075] The anomaly detection module (205) can receive various data acquired during operation of the mobile device (200) from the sensor module (203). According to one embodiment, the anomaly detection module (205) can include an artificial intelligence model. The artificial intelligence model can be a model trained to detect anomalies using data acquired by the mobile device (200) as input. In other words, the artificial intelligence model can detect anomalies based on data related to operation and generate anomaly information. According to one embodiment, the anomaly detection module (205) can perform scoring based on various data acquired during operation. The anomaly detection module (205) can score items related to anomalies using various data acquired during operation, and determine anomalies if the scoring result is higher than a threshold score. In other words, the anomaly detection module (205) can generate anomaly information based on data related to operation.

[0076] Anomaly information may include information about the vehicle in which the anomaly was detected and information about the segment in which the anomaly was detected. For example, if an anomaly is detected in operation-related data acquired as the vehicle (200) passes through segment #1, the anomaly information may include information about the vehicle (200) and information about segment 1.

[0077] The method of generating abnormal information based on the data related to the operation described above is only an example and the present disclosure is not limited thereto.

[0078] When the mobile device (200) detects an abnormality using the abnormality detection module (205), it can transmit a notification that an abnormality has occurred to the electronic device (210). The mobile device (200) can transmit abnormality information to the electronic device (210) along with the notification.

[0079] The electronic device (210) may include a communication module (211). Since the description of the communication module (209) is equally applicable, a description of the communication module (209) will be omitted. The electronic device (210) may receive data related to operation acquired by the mobile device (200) through the communication module (211). According to one embodiment, when the mobile device (200) includes an anomaly detection module (205), the electronic device (210) may receive a notification along with the anomaly information.

[0080] According to one embodiment, the electronic device (210) may further include an anomaly detection module (213). According to one embodiment, the anomaly detection module (213) may be implemented as a separate device outside of the electronic device (210).

[0081] Since the description of the anomaly detection module (205) of the mobile body (200) can be equally applied to the anomaly detection module (213), the description will be omitted.

[0082] The electronic device (210) can generate monitoring information based on abnormal information generated from operation-related data. The monitoring information will be described later in FIG. 3.

[0083] The electronic device (210) can process operation-related data received from the mobile device (200) to generate various information. The various information generated by processing the operation-related data may include mileage information for maintenance of the mobile device and / or segment. The electronic device (210) can provide monitoring information and various processed information to a user terminal (230) connected to the electronic device (210) via a network (220) through a user interface. The electronic device (210) can provide various information about the automated system to the user through the user interface.

[0084] A user terminal (230) can connect to an electronic device (210) via a network (220). The user terminal (230) can display various information about the automation system through a user interface provided by the electronic device (210). The user terminal (230) can include various wearable devices such as a mobile phone, a smart phone, a tablet, an e-book device, a laptop, a personal computer, a desktop, a smart watch, smart glasses, or a head-mounted display (HMD).

[0085] Below, we will explain monitoring information generated based on abnormal information generated from an electronic device (210) or a mobile device (200).

[0086]

[0087] FIG. 3 and FIG. 4 are diagrams for explaining the determination of an abnormality occurrence based on monitoring information according to one embodiment of the present disclosure.

[0088] An electronic device may receive operation-related data from one or more mobile devices and generate abnormality information based on the operation-related data. However, this is merely an example, and the present disclosure is not limited thereto. For example, the electronic device may receive operation-related data from one or more mobile devices and abnormality information generated based on the operation-related data. The abnormality information may include data determined to be abnormal among the operation-related data. The operation-related data may include data related to the mobile devices and data related to the operating environment of the mobile devices. The operation-related data will be omitted for description as it has been described above with reference to FIG. 2.

[0089] Electronic devices can generate abnormal information from operation-related data in various ways. For example, if certain operation-related data falls outside the normal range, the electronic device may determine that data as abnormal. For example, if vibration-related data among operation environment-related data deviates from the normal range, the data may be determined as abnormal. For example, if temperature-related data among moving objects deviates from the normal range, the data may be determined as abnormal. However, these are merely examples, and the present disclosure is not limited thereto.

[0090] Electronic devices can generate monitoring information based on anomaly information. This monitoring information can include anomaly information for each mobile device segmented by segment. In other words, electronic devices can manage monitoring information by segment, rather than by node coordinates. Managing monitoring information by segment can improve anomaly detection capabilities compared to managing it by node coordinates.

[0091] Monitoring information can be provided in various ways. For example, monitoring information can be managed grid-based, as described below. For example, monitoring information can be managed matrix-based. However, this is merely an example, and the present disclosure is not limited thereto. For example, it will be apparent to those skilled in the art that monitoring information can be managed in various formats (e.g., graphs) in addition to grids or matrices. However, for convenience of explanation, the present disclosure will describe monitoring information grid-based.

[0092] Referring to FIG. 3, monitoring information (300) generated by arranging abnormal information for one or more moving objects by segment included in a track is illustrated. The monitoring information (300) may be generated based on a grid or matrix with the attributes of one or more moving objects and the attributes of segments as axes. The attributes of one or more moving objects may include attributes such as the ID of the moving object, the model of the moving object, the manufacturer of the moving object, the weight of the moving object, the driving direction of the moving object, or a combination thereof. The attributes of the segments may include attributes such as the ID of the segment, the shape of the segment, the speed limit of the segment, the length of the segment, or a combination thereof. However, for the convenience of explanation, in the present disclosure, the monitoring information (300) generated based on a grid with the ID of the moving object and the ID of the segment as axes will be described. However, it will be apparent to those skilled in the art that the following description may also be applied to monitoring information generated based on a grid with other attributes as axes.

[0093] The points displayed in the monitoring information (300) may indicate an anomaly. For example, referring to the cells representing vehicle #1 and segment #2, two points are displayed. This may mean that an anomaly occurred twice when analyzing the data acquired when vehicle #1 passed through segment #2. Similarly, referring to the cells representing vehicle #2 and segment #2, three points are displayed. This may mean that an anomaly occurred three times when analyzing the data acquired when vehicle #2 passed through segment #2. However, this is merely an example, and the monitoring information (300) may display the number of times an anomaly occurred in each cell, instead of points. For example, referring to the cells representing vehicle #1 and segment #2, the number 2 may be displayed, instead of two points.

[0094] The electronic device can determine, based on the monitoring information (300), whether at least some of the abnormal information included in the monitoring information (300) was caused by a specific segment. The electronic device can determine, based on the monitoring information (300), whether the abnormality is caused by a segment or a moving object.

[0095] The electronic device can determine, based on the abnormality information and threshold criteria for one or more specific segments, whether at least a portion of the abnormality information is caused by one or more specific segments.

[0096] In one embodiment, the threshold criterion may be a threshold number of times. The electronic device may determine whether the number of abnormalities obtained for a specific segment under specific conditions is greater than or equal to the threshold number. The specific conditions may include conditions such as a certain period of time (e.g., 1 day), the number of times driven (e.g., 100 times driven), and the operating state of the vehicle (e.g., acceleration, deceleration). If the number of abnormalities displayed for a specific segment is greater than or equal to the threshold number, the electronic device may determine that at least some of the abnormality information is caused by the specific segment. For example, assuming the threshold number is 10, since the number of abnormalities displayed for segment #2 is 12, which is greater than or equal to the threshold number, the electronic device may determine that the abnormalities displayed for segment #2 are caused by the segment, not by one or more vehicles. In other words, the electronic device may determine whether an abnormality has occurred for a specific segment based on the number of abnormalities.

[0097] According to one embodiment, the electronic device can determine whether an anomaly has occurred for a particular segment using the number of anomalies and / or data values.

[0098] For example, the threshold criterion may be whether the number of anomalies acquired for a specific segment is greater than or equal to a first threshold value, and whether the data values ​​of the anomalies greater than or equal to the first threshold value are in the top K%. That is, the electronic device may determine that an anomaly has occurred for a specific segment if the number of anomalies acquired for a specific segment is greater than or equal to the first threshold value, and all of the anomalies in the top K% (where K is a positive number) based on the data values ​​of these anomalies are greater than or equal to the second threshold value.

[0099] For example, a threshold criterion may be whether the average value of the top K% of the anomalies obtained for a specific segment is within the 3 sigma range of the normal state. That is, the electronic device may determine that an anomaly has occurred for a specific segment if the average value of the anomalies corresponding to the top K% (K is a positive number) of the anomalies obtained for the specific segment, based on the data value, is outside the 3 sigma range based on the data value of the normal state.

[0100] However, this is only an example, and it will be apparent to those skilled in the art that electronic devices can determine threshold criteria based on numerical values ​​such as maximum value, mean value, median value, variance, standard deviation, and percentile.

[0101] According to one embodiment, if the electronic device determines that an abnormality detected based on monitoring information (300) is caused by a specific segment, the electronic device may transmit a control command to the idle vehicle to acquire information about the specific segment. For example, the idle vehicle that has received the control command may collect data using a plurality of sensors while passing through the specific segment and transmit the collected data to the electronic device. For example, the idle vehicle that has received the control command may move to a segment adjacent to the specific segment and transmit an image captured of the specific segment using a camera or the like to the electronic device.

[0102] Referring to FIG. 4, monitoring information (400) generated by arranging abnormal information for one or more moving objects by segment included in a track is illustrated. The monitoring information (400) can be generated based on a grid or matrix with the attributes of one or more moving objects and the attributes of the segments as axes. The description of the attributes of one or more moving objects and the attributes of the segments is omitted as described above. In the present disclosure, for the convenience of explanation, the monitoring information (400) generated based on a grid with the ID of the moving object and the ID of the segment as axes will be described. However, it will be apparent to those skilled in the art that the following description can also be applied to monitoring information generated based on a grid with other attributes as axes.

[0103] The points displayed in the monitoring information (400) may indicate an anomaly. For example, referring to the cell representing vehicle #2 and segment #1, two points are displayed. This may mean that an anomaly occurred twice when analyzing the data acquired when vehicle #2 passed through segment #1. Similarly, referring to the cell representing vehicle #2 and segment #2, three points are displayed. This may mean that an anomaly occurred three times when analyzing the data acquired when vehicle #2 passed through segment #2. However, this is merely an example, and the monitoring information (400) may display the number of anomalies that occurred in each cell, instead of points. For example, referring to the cell representing vehicle #2 and segment #1, the number 2 may be displayed, instead of two points.

[0104] The electronic device can determine, based on the monitoring information (400), whether at least some of the abnormal information included in the monitoring information (400) was caused by a specific segment. The electronic device can determine, based on the monitoring information (400), whether the abnormality is caused by a segment or a moving object.

[0105] The electronic device can determine, based on the abnormality information and threshold criteria for a particular mobile object, whether at least a portion of the abnormality information was caused by the particular mobile object.

[0106] In one embodiment, the threshold criterion may be a threshold number of occurrences. The electronic device may determine whether the number of occurrences of an anomaly indicated for a specific mobile device is greater than or equal to the threshold number. If the number of occurrences of an anomaly indicated for a specific mobile device is greater than or equal to the threshold number, the electronic device may determine that at least some of the anomaly information is caused by the specific mobile device. For example, assuming the threshold number is 10, since the number of occurrences of an anomaly indicated for mobile device #2 is greater than or equal to the threshold number of occurrences of 13, the electronic device may determine that at least some of the anomaly information is caused by mobile device #2.

[0107] A detailed description of the threshold criteria will be omitted, as described above in FIG. 3. Furthermore, the method for determining whether an abnormality has occurred in a specific segment described above in FIG. 3 can be equally applied to determining whether an abnormality has occurred in a specific moving object, and thus a detailed description thereof will be omitted.

[0108] In one embodiment, the electronic device may determine a system problem if no rule is found for the abnormal information included in the monitoring information (400). For example, if an abnormality occurs for all segments and all vehicles, the electronic device may determine that the problem is system-wide, rather than a problem with a specific segment or vehicle.

[0109] Operation-related data may include data about a moving object acquired from multiple sensors and data related to the operating environment. Therefore, it may be difficult to determine whether an anomaly is caused by a moving object or a segment based solely on anomaly information generated from the operation-related data. An electronic device can manage anomaly information for one or more moving objects in a grid based on segment attributes and moving object attributes, thereby determining whether at least some of the anomaly information is caused by the moving object or segment. Therefore, inspections only need to be performed on moving objects or segments determined to have problems, thereby reducing the time and manpower required for inspections.

[0110]

[0111] FIG. 5 is a diagram for explaining anomaly detection based on data related to driving and data on work content according to one embodiment of the present disclosure.

[0112] Referring to FIG. 5, a portion of a track is illustrated. Referring to FIG. 5, a portion of the track may include nodes 0 to 3. A portion of the track may include segments #1 (510) to #3 (530). A moving object (500) may be moving from node 0 toward node 1.

[0113] While the mobile device (500) is passing through a segment, the electronic device cannot identify which segment it is currently passing through (i.e., which segment number it is). When the mobile device (500) completely passes through a segment, the electronic device can identify which segment it has just completely passed through by using the start node identified when entering the segment and the end node identified when passing through the segment. For example, when the mobile device (500) completely passes through segment #2 (520), the electronic device can identify that the segment it has just completely passed through is segment #1 (510) by using the identified start node, node 1, and the identified end node, node 2. Therefore, the electronic device may not be able to identify whether the mobile device (500) is passing through segment #2 (520) or segment #3 (530) after passing through node 1 until the mobile device (500) has completely passed through the segment.

[0114] The electronic device can identify the segment in which the mobile body (500) is moving by using data related to the operation of the mobile body (500). For example, the electronic device can identify whether the mobile body (500) is passing through segment #2 (520) or segment #3 (530) by using data related to operation received from the mobile body (500) after the mobile body (500) passes through node #1. For example, the electronic device can identify whether the mobile body is passing through segment #2 (520) or segment #3 (530) after passing through node #1 by using a steering angle included in the data related to operation. For example, if the steering angle changes to the left, the electronic device can identify that the mobile body (500) is passing through segment #2 (520). If the steering angle changes to the right, the electronic device can identify that the mobile body (500) is passing through segment #3 (530).

[0115] The electronic device can identify the segment through which the mobile object (500) passes based on data related to the drive and the nodes through which the mobile object (500) passes, even if the mobile object (500) has not yet completely passed through the segment. The electronic device can update monitoring information for the identified segment even if the mobile object (500) has not yet completely passed through the identified segment.

[0116] According to one embodiment, the electronic device can further determine whether the abnormality was caused by a specific drive or a specific task based on one or more of data related to the drive and data about the task content.

[0117] Electronic devices can use data related to motion to determine whether an anomaly has occurred during a specific motion of a vehicle. For example, an electronic device can use data related to motion to determine that a detected anomaly is due to high-speed driving. For example, an electronic device can use data related to motion to determine that a detected anomaly is due to the vehicle's direction of travel.

[0118] Electronic devices can use data about the operation to determine whether an anomaly has occurred while the vehicle is performing a specific task. For example, an electronic device can use data related to a specific task to determine that an anomaly detected was caused by the vehicle loading an object.

[0119] Based on data related to the operation and the task itself, the electronic device can further determine whether the anomaly was caused by a specific operation or task. For example, based on data related to the operation and the task itself, the electronic device can determine that the detected anomaly was caused by the mobile vehicle loading an object and moving laterally.

[0120] According to one embodiment, the electronic device may provide feedback for one or more mobile objects or segments based on one or more of data related to driving and data about the task content. For example, the electronic device may provide feedback for one or more mobile objects through a user interface. As described above, the electronic device may further determine whether the abnormality is caused by a specific driving or a specific task based on one or more of the data related to driving and data about the task content. Accordingly, the electronic device may provide feedback to the user that an abnormality may occur in the mobile object or segment when one or more of the specific driving or specific tasks are performed. For example, the electronic device may provide feedback to the user that an abnormality may occur when the mobile object turns right while carrying an object in segment #1. A user interface for notifying the occurrence of an abnormality will be described below.

[0121]

[0122] FIG. 6 and FIG. 7 are drawings for explaining a user interface according to one embodiment of the present disclosure.

[0123] Referring to FIG. 6, a user interface (600) provided by an electronic device is illustrated. The electronic device can provide information about the automated system to a user terminal connected to the electronic device using the user interface (600). The user interface (600) can display maintenance information (610) and an area (620). For convenience of explanation, the present disclosure will describe regular inspection dates and status information for mobile devices. However, it will be apparent to those skilled in the art that the description herein can also be applied to regular inspection dates and status information for segments.

[0124] Maintenance information (610) may include regular inspection dates and status information for mobile devices. The regular inspection date may be determined based on mileage updated by data related to the operation of the mobile device. The regular inspection date may vary for each component of the mobile device. That is, even for components within the same mobile device, the regular inspection date may vary. For example, components such as wheels, front motors, front motor reducers, and hoist grippers within the same mobile device may have different regular inspection dates. The regular inspection date may be determined based on mileage for multiple items related to the operation of the mobile device. For example, the regular inspection date may be determined based on mileage for the operating time of the mobile device and mileage for the distance traveled by the mobile device. The electronic device may determine the regular inspection date as an earlier date as the mileage for multiple items approaches a target value.

[0125] Maintenance information (610) may further include vehicle status information. The vehicle status information may be based on the monitoring information described in FIGS. 3 and 4 . That is, the vehicle status information may include information on vehicles requiring immediate maintenance, regardless of the mileage described above. In other words, if at least some of the abnormal information is determined to be caused by a specific vehicle based on the monitoring information, the status information for the specific vehicle may be marked as requiring immediate maintenance. For example, referring to FIG. 6 , vehicle #50 may be marked as requiring immediate maintenance based on the monitoring information, even though it has 100 days left until its regular inspection date.

[0126] Area (620) may be an area where various information generated by processing operation-related data is displayed in a report format. For example, when a vehicle is selected from maintenance information (610), detailed information about the vehicle may be displayed in area (620). For example, various trend information generated by processing accumulated operation-related data may be displayed in area (620). For example, area (620) may display summary information generated by processing accumulated operation-related data. For example, area (620) may display information about tasks performed by vehicles.

[0127] The user interface (600) can provide maintenance information (610) in ascending or descending order based on any one of the mobile ID, regular inspection date, and mobile status information. By providing maintenance information (610) in ascending or descending order based on the mobile status information, the user interface can enable the user to recognize that maintenance is required for a specific mobile even if the regular inspection date has not yet been reached. In other words, the electronic device can provide an inspection order for specific mobiles requiring maintenance with priority over other mobiles through the user interface (600).

[0128] Although not shown in FIG. 6, according to one embodiment, the user interface (600) may include the monitoring information described in FIGS. 3 and 4.

[0129] Referring to FIG. 7, a user interface (700) is illustrated that displays segments (711, 713, 715, 717) in which a bottleneck occurs on a track (710).

[0130] An electronic device can determine a segment where a bottleneck occurs based on operation-related data received from one or more vehicles. The operation-related data received from one or more vehicles may include data on which segments the vehicles traveled in over time. Accordingly, the electronic device can synthesize the operation-related data received from one or more vehicles to determine a segment where a bottleneck occurs due to a congestion of vehicles.

[0131] An electronic device may display segments where a bottleneck occurs at a specific time through a user interface (700). For example, the electronic device may display segments (711, 713, 715, 717) where a bottleneck occurs through the user interface (700). The electronic device may emphasize the segments (711, 713, 715, 717) by applying various visual effects to the segments (711, 713, 715, 717).

[0132] The user interface (700) may include an area (720). Area (720) may be an area where various information about the track (710) is displayed. For example, area (720) may display information about the time when a bottleneck occurs. For example, area (720) may display information (e.g., average speed) about vehicles passing through segments (711, 713, 715, 717) where a bottleneck occurs during the time when the bottleneck occurs. For example, area (720) may display information about the amount of travel by segment. For example, area (720) may display feedback about the segment described in FIG. 5. For example, area (720) may provide advanced information about a specific segment where an anomaly is detected. For example, the advanced information may include information about the detection of an anomaly in a specific case, such as the model of the vehicle where the anomaly is detected, the speed of the vehicle, the steering of the vehicle, and whether or not an object is loaded.

[0133]

[0134] FIG. 8 is a drawing for explaining an operation method of an electronic device according to one embodiment of the present disclosure.

[0135] In the following embodiments, the steps may be performed sequentially, but are not necessarily sequential. For example, the order of the steps may be changed, and at least two steps may be performed in parallel. Steps (810) to (830) may be performed by at least one component of the electronic device.

[0136] At step (810), the electronic device may collect operation-related data from one or more mobile devices.

[0137] In step (820), the electronic device may generate monitoring information based on abnormal information about one or more moving objects generated from data related to operation.

[0138] In step (830), the electronic device can determine, based on the monitoring information, whether at least a portion of the abnormal information is caused by one or more specific segments of a track on which one or more moving objects are running.

[0139] Since the matters described above through FIGS. 1 to 7 are applied to each step illustrated in FIG. 8, a more detailed description is omitted.

[0140] According to one embodiment of the present disclosure, by collecting operation-related data through a mobile device performing a task rather than an inspection device, only significant anomalies that may occur in the mobile device and its operating environment can be detected. Furthermore, according to one embodiment of the present disclosure, not only anomalies occurring in the mobile device itself but also anomalies occurring in the operating environment in which the mobile device operates can be detected. Furthermore, according to one embodiment of the present disclosure, there is no need for additional investment in separate inspection equipment, and there is no need to control an area for inspection, so the performance of the automated system is not reduced.

[0141]

[0142] Meanwhile, the method according to the present invention can be written as a program that can be executed on a computer and implemented in various recording media such as a magnetic storage medium, an optical reading medium, and a digital storage medium.

[0143] Implementations of the various technologies described herein may be implemented as digital electronic circuitry, or as computer hardware, firmware, software, or combinations thereof. Implementations may be implemented as a computer program product, i.e., a computer program tangibly embodied in an information carrier, e.g., a machine-readable storage medium (computer-readable medium) or a radio signal, for processing by the operation of a data processing device, e.g., a programmable processor, a computer, or multiple computers, or for controlling the operation thereof. A computer program, such as the computer program(s) described above, may be written in any form of programming language, including compiled or interpreted languages, and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program may be deployed to be processed on one computer or multiple computers at a single site, or to be distributed across multiple sites and interconnected by a communications network.

[0144] Processors suitable for processing a computer program include, for example, both general-purpose and special-purpose microprocessors, and any one or more processors of any type of digital computer. Typically, a processor will receive instructions and data from read-only memory or random-access memory, or both. Components of a computer may include at least one processor for executing instructions and one or more memory devices for storing instructions and data. Typically, a computer may include, or be coupled to receive data from, transmit data to, or both, one or more mass storage devices, such as magnetic, magneto-optical, or optical disks, for storing data. Information carriers suitable for embodying computer program instructions and data include, for example, semiconductor memory devices, magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as compact disk read only memory (CD-ROM), digital video disks (DVD), magneto-optical media such as floptical disks, read only memory (ROM), random access memory (RAM), flash memory, erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), etc. The processor and memory may be supplemented by, or included in, special purpose logic circuitry.

[0145] Additionally, the computer-readable medium may be any available medium that can be accessed by a computer, and may include both computer storage media and transmission media.

[0146] While this specification contains details of a number of specific implementations, these should not be construed as limitations on the scope of any invention or what may be claimed, but rather as descriptions of features that may be unique to particular embodiments of particular inventions. Certain features described herein in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments, either individually or in any suitable subcombination. Furthermore, although features may operate in a particular combination and may initially be described as being claimed as such, one or more features from a claimed combination may in some cases be excluded from that combination, and the claimed combination may be modified into a subcombination or variation of a subcombination.

[0147] Likewise, while operations are depicted in the drawings in a particular order, this should not be construed as requiring that those operations be performed in the particular or sequential order depicted to achieve desired results, or that all depicted operations be performed. In certain instances, multitasking and parallel processing may be advantageous. Furthermore, the separation of the various device components of the embodiments described above should not be construed as requiring such separation in all embodiments, and it should be understood that the program components and devices described may generally be integrated together in a single software product or packaged into multiple software products.

[0148] Meanwhile, the embodiments of the present invention disclosed in this specification and drawings are merely specific examples presented to aid understanding and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical concepts of the present invention are possible in addition to the embodiments disclosed herein.

Claims

1. In the method of operating an electronic device, A step of collecting operation-related data from one or more moving objects; A step of generating monitoring information based on anomaly information about one or more moving objects generated from data related to the above operation; and A step of determining whether at least a part of the abnormal information is caused by one or more specific segments of a track on which one or more mobile objects are operated based on the monitoring information. including, How it works.

2. In paragraph 1, The step of collecting data related to the above operation is: Collecting data related to one or more mobile objects obtained from a plurality of sensors included in the one or more mobile objects and data related to the operating environment of the one or more mobile objects. How it works.

3. In paragraph 1, The steps for generating the above monitoring information are: Generating the monitoring information by arranging the abnormal information for the one or more moving objects by segment included in the track, How it works.

4. In paragraph 2, The above monitoring information is: A matrix generated based on the properties of one or more of the above moving objects and the properties of the segments of the track as axes, How it works.

5. In paragraph 1, The step of determining whether it occurred by one or more of the above specific segments is: Based on the above abnormal information and threshold criteria for the one or more specific segments, determining that at least a portion of the above abnormal information is caused by the one or more specific segments, How it works.

6. In paragraph 1, A step of determining a segment in which a bottleneck occurs based on data related to the above operation; and Further comprising a step of providing the segment in which the above bottleneck occurs through a user interface, How it works.

7. In paragraph 1, Data related to the above operation is: Containing at least one of data related to driving of the one or more mobile bodies and data on the work performed by the one or more mobile bodies, How it works.

8. In paragraph 7, Further comprising a step of determining whether an abnormality occurring in one or more specific segments is caused by one or more of a specific drive and a specific task based on data related to the drive and data on the work content. How it works.

9. In paragraph 7, A step of identifying a segment through which one or more moving objects pass based on data related to the driving and nodes through which one or more moving objects pass; and Further comprising the step of updating monitoring information for the identified segment; How it works.

10. In paragraph 1, Further comprising the step of transmitting a control command to obtain information about said one or more specific segments for the idle mobile body. How it works.

11. In paragraph 1, Further comprising a step of updating mileage for maintenance of a plurality of segments of the track based on data related to the above operation. How it works.

12. In paragraph 1, Providing a maintenance check order for one or more specific segments with priority over other segments through a user interface; How it works.

13. In paragraph 1, Further comprising a step of determining whether at least a part of the abnormal information was generated by one or more specific mobile objects based on the monitoring information. How it works.

14. In paragraph 1, Further comprising a step of updating mileage for maintenance of one or more of the mobile devices based on data related to the operation. How it works.

15. In paragraph 13, Providing a maintenance inspection order for one or more specific mobiles with priority over other mobiles through a user interface; How it works.

16. In the method of operating an electronic device, A step of collecting operation-related data from one or more moving objects; A step of generating monitoring information by arranging anomaly information about one or more moving objects generated from data related to the operation by segment of the track on which the one or more moving objects are operated; and A step of determining whether at least a part of the abnormal information is caused by one or more specific segments of the track or one or more specific moving objects based on the monitoring information. including, How it works.

17. A computer-readable recording medium storing one or more computer programs including commands for executing the method of any one of claims 1 to 16.

18. In electronic devices, A processor that controls one or more moving objects Including, The above processor, Collecting operation-related data from one or more of the above-mentioned moving objects, generating monitoring information based on anomaly information about the one or more moving objects generated from the operation-related data, and determining based on the monitoring information whether at least a portion of the anomaly information is generated by one or more specific segments of the track on which the one or more moving objects are operated. Electronic devices.

19. In paragraph 18, The above processor, Collecting data related to one or more mobile objects obtained from a plurality of sensors included in the one or more mobile objects and data related to the operating environment of the one or more mobile objects. Electronic devices.

20. In paragraph 18, The above processor, Generating the monitoring information by arranging the abnormal information for the one or more moving objects by segment included in the track, Electronic devices.

Images