Dual-processing based individual analysis device and method using artificial intelligence and smart farm monitoring system using the same

Abstract

The present invention provides a dual-processing-based individual analysis device and method using artificial intelligence, and a smart farm monitoring system using the same. [Solution] The method in the smart farm monitoring system 10 includes the steps of collecting target data including video data and sensing data linked to the individual being monitored using an edge device 200, performing an initial analysis using the edge device to input the target data into a first model based on pre-trained artificial intelligence and outputting first analysis data linked to the individual's behavioral patterns, and transmitting the first analysis data and the target data to a main server when the first analysis data meets pre-set detailed analysis conditions.

Description

[Technical Field]

[0001] The present application relates to an AI-based dual-processing system for monitoring and analyzing livestock behavior in a smart farm environment. [Background technology]

[0002] As the integration of agriculture and ICT technology accelerates, a paradigm shift from traditional agricultural and livestock farming methods to smart farms is gaining momentum. In particular, the world's leading smart farm countries are making serious efforts to integrate ICT technologies such as the Internet of Things, nanotechnology, big data, cloud computing, robots, and drones into the agricultural and livestock industries, and some countries are already achieving farm intelligence by utilizing a variety of systems that calculate yields, diagnose pests and diseases, measure soil moisture, measure indicator conditions, diagnose harvest times, and monitor crop conditions.

[0003] Meanwhile, in the case of smart farms in the dairy sector, the continuous development of breeding techniques has led to an increase in the size of ruminants, and the breeding environment has also changed from the existing simple pole structures to large, dry spaces with manure areas. Furthermore, industrial integration has led to the generalization of large-scale breeding in the livestock industry. The ultimate goal of modern large-scale ruminant breeding systems is to improve the quality of beef cattle and the quantity and quality of milk produced by dairy cows, while also ensuring the health and well-being of livestock. To achieve these goals, research into the physiological behavior of ruminants, as well as environmental optimization and management, are essential.

[0004] Over the past few decades, research into ruminant behavior and the environmental influences on ruminants has become an essential part of livestock and veterinary medicine. To achieve these goals, traditional physiological research on ruminants has made it increasingly important to consider ruminant behavior and rearing environment. Ruminant behavior includes responses to other ruminants and other objects, and is related to overall responses and adaptations to various internal and external conditions. Systematic observation of ruminant behavior has revealed that ruminants primarily exhibit feeding behavior, resting behavior, social behavior, herd behavior, estrus behavior, reproductive behavior, and offspring-related behavior. Considering ruminant behavior plays an important role in improving productivity, one of the aforementioned goals. Furthermore, various environmental indicators, such as cleanliness of the rearing environment, temperature, humidity, and standing density per unit area, have emerged as important factors to consider in livestock productivity. For example, the design of feed and water areas affects the health and physiological state of ruminants.

[0005] Furthermore, much research has been conducted into regulating the physiological state and breeding environment of ruminants, and regulations have been applied to the breeding environment of ruminants. However, as the scale of breeding expands, more manpower is required to observe all ruminants. Although sensor products can play a supporting role to some extent, they have limitations in that they are cumbersome to have to attach various sensors to each animal, which may increase stress on the ruminants, and also place a heavy economic burden on farmers as the scale of breeding expands. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Korean Patent Registration No. 10-1329022 Summary of the Invention [Problem to be solved by the invention]

[0007] The present application aims to solve the problems of the prior art described above and to provide a dual-processing-based individual analysis device and method using artificial intelligence that can efficiently monitor and analyze the behavior of individuals in a smart farm environment, and a smart farm monitoring system using the same. However, the technical objectives to be achieved by the embodiments of the present application are not limited to the above-mentioned technical objectives, and other technical objectives may exist. [Means for solving the problem]

[0008] As a technical means for achieving the above technical objectives, a dual-processing-based individual analysis method using artificial intelligence according to one embodiment of the present application includes the steps of: collecting target data including video data and sensing data associated with an individual to be monitored using an edge device; performing an initial analysis using the edge device to input the target data into a pre-trained first model based on artificial intelligence and output first analysis data associated with the individual's behavioral pattern; and transmitting the first analysis data and the target data to a main server when the first analysis data satisfies predetermined detailed analysis conditions.

[0009] The first analysis data may include information on the presence or absence and appearance position of the individual reflected in the video data. The first analysis data may also include first classification information for the individual's behavior type. The detailed analysis conditions may include a condition that the first classification information corresponds to a predetermined abnormal behavior or important behavior. The second analysis data may also include second classification information for the individual's behavior type. Also, the number of classes in the second classification information may be greater than the number of classes in the first classification information. The first model may be a lightweight model constructed in consideration of resource information of the edge device. The second model may include a plurality of models that are constructed in advance based on a plurality of different network structures. The second analysis data may be determined in consideration of the degree of agreement of the output data of each of the plurality of models.

[0010] Meanwhile, a dual-processing-based individual analysis method using artificial intelligence according to one embodiment of the present application may include: performing an initial analysis using an edge device, in which target data including video data and sensing data associated with an individual to be monitored is input into a first model based on pre-trained artificial intelligence, and first analysis data associated with a behavioral pattern of the individual is output; and receiving the first analysis data and the target data from the edge device as a result of the first analysis data satisfying a predetermined detailed analysis condition; and performing a detailed analysis, in which at least one of the first analysis data and the target data is input into a second model based on pre-trained artificial intelligence, and deriving second analysis data associated with the behavioral pattern of the individual. In addition, the step of performing the detailed analysis may determine the second analysis data by taking into consideration the degree of agreement of output data of each of the plurality of models.

[0011] Meanwhile, a smart farm monitoring system according to one embodiment of the present application may include an edge device that collects target data including video data and sensing data associated with an individual to be monitored, performs an initial analysis by inputting the target data into a first model based on pre-trained artificial intelligence and outputting first analysis data associated with the individual's behavioral pattern, and transmits the first analysis data and the target data to a main server if the first analysis data satisfies predetermined detailed analysis conditions, and the main server that performs a detailed analysis by inputting at least one of the first analysis data and the target data into a second model based on pre-trained artificial intelligence and deriving second analysis data associated with the individual's behavioral pattern.

[0012] The above-described solutions are merely exemplary and should not be construed as limiting the present application. In addition to the exemplary embodiments described above, there may be additional embodiments in the drawings and detailed description of the invention. [Effects of the Invention]

[0013] According to the above-mentioned means for solving the problem of the present application, it is possible to provide a dual-processing-based individual analysis device and method using artificial intelligence that can efficiently monitor and analyze the behavior of individuals in a smart farm environment, and a smart farm monitoring system using the same.

[0014] According to the above-mentioned solution to the problem of the present application, a dual data processing pipeline is used to perform basic data analysis at the edge and selectively transmit important data to the server side for advanced analysis, thereby maximizing data processing efficiency and minimizing server load and data transmission costs even in resource-constrained environments.

[0015] According to the above-mentioned solution to the problem of the present application, a smart farm monitoring system can be constructed to accommodate various types of livestock and various rearing environments, and the system can assist in taking appropriate measures quickly by continuously detecting the health status, stress level, etc. of each individual being monitored.

[0016] According to the above-mentioned solution to the problem of the present application, the smart farm monitoring system is realized through a modular design for farms of various sizes and different types of smart farms, making it easy to integrate between systems, and administrators can customize and individualize the elements required for each smart farm for each individual system. However, the effects obtained by the present invention are not limited to the above-mentioned effects, and other effects may also exist. [Brief explanation of the drawings]

[0017] [Figure 1]1 is a schematic configuration diagram of a smart farm monitoring system according to an embodiment of the present application. [Figure 2] FIG. 1 is a conceptual diagram illustrating the operational flow of a smart farm monitoring system according to an embodiment of the present application. [Figure 3] This is a conceptual diagram to explain an artificial intelligence-based individual identification method using video data linked to the individual being monitored. [Figure 4] FIG. 2 is a schematic configuration diagram of a main server of a smart farm monitoring system according to an embodiment of the present application. [Figure 5] FIG. 1 is a schematic configuration diagram of an edge device of a smart farm monitoring system according to an embodiment of the present application. [Figure 6] 1 is a flowchart illustrating an operation of a dual-processing-based individual analysis method using artificial intelligence according to an embodiment of the present disclosure, which is performed using an edge device. [Figure 7] 10 is a flowchart illustrating an operation of a dual-processing-based individual analysis method using artificial intelligence according to an embodiment of the present disclosure, which is performed using a main server. [Figure 8] 10 is a detailed operational flowchart of a detailed analysis process for deriving second analysis data associated with an individual's behavioral pattern. DETAILED DESCRIPTION OF THE INVENTION

[0018] Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present application. However, the present application may be embodied in various different forms and is not limited to the embodiments described herein. In order to clearly explain the present application in the drawings, parts that are not relevant to the description will be omitted, and similar parts will be designated by similar reference numerals throughout the specification. Throughout this specification, when a part is said to be "coupled" to another part, this includes not only "directly coupled" but also "electrically coupled" or "indirectly coupled" via another element in between. Throughout this specification, when an element is referred to as being "on," "above," "at the top," "below," "below," or "below the bottom" of another element, this includes not only when the element is in contact with the other element, but also when there is another element between the two elements. Throughout this specification, when a part "comprises" a certain element, this means that it can further include other elements, rather than excluding other elements, unless specifically stated to the contrary.

[0019] The present application relates to a dual-processing-based individual analysis device and method using artificial intelligence, and a smart farm monitoring system using the same. FIG. 1 is a schematic diagram of a smart farm monitoring system according to an embodiment of the present application.

[0020] 1, a smart farm monitoring system 10 according to an embodiment of the present application may include a main server 100, an edge device 200, and a user terminal 300. Also, referring to Fig. 1, the smart farm monitoring system 10 may include a measurement module 21 on the edge device 200 side that measures and transmits various sensing data for a target space to be monitored (e.g., a farm, a livestock barn, a smart farm, etc.), and a camera module 22 that captures and transmits image data for the target space.

[0021] The measurement module 21, the camera module 22, the main server 100, the edge device 200, and the user terminal 300 can communicate with each other via a network 20. The network 20 refers to a connection structure that allows information exchange between nodes such as terminals and servers, and examples of the network 20 include, but are not limited to, a 3GPP (registered trademark) (3rd Generation Partnership Project) network, a LTE (Long Term Evolution) network, a 5G network, a WIMAX (World Interoperability for Microwave Access) network, the Internet, a LAN (Local Area Network), a Wireless LAN (Wireless Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), a Wi-Fi network, a Bluetooth (registered trademark) network, a satellite broadcasting network, an analog broadcasting network, and a DMB (Digital Multimedia Broadcasting) network.

[0022] The user terminal 300 may be any type of wireless communication device, such as a smartphone, a smartpad, a tablet PC, a personal communication system (PCS), a global system for mobile communication (GSM), a personal digital cellular (PDC), a personal handyphone system (PHS), a personal digital assistant (PDA), an international mobile telecommunication (IMT)-2000, a code division multiple access (CDMA)-2000, a wireless code division multiple access (W-CDMA), or a wireless broadband internet (Wibro) terminal.

[0023] For reference, in the description of the embodiments of the present application, the user terminal 300 may be a terminal owned by the manager of the target space (e.g., farm, livestock barn, smart farm, etc.) managed through the smart farm monitoring system 10 disclosed in the present application. The data processing pipeline and system architecture of the smart farm monitoring system 10 disclosed herein will now be described with reference to FIG. FIG. 2 is a conceptual diagram illustrating the operation flow of a smart farm monitoring system according to an embodiment of the present application.

[0024] Referring to FIG. 2, a smart farm monitoring system 10 according to an embodiment of the present application may include edge devices 200 disposed corresponding to each target space to be monitored, and a main server 100 that acquires data collected in each target space from the edge devices 200, analyzes the acquired data, and provides analysis results.

[0025] Specifically, the edge device 200 may collect target data including video data and sensing data associated with the individual being monitored, and perform an initial analysis by inputting the collected target data into a first model based on pre-trained artificial intelligence to output first analysis data associated with the individual's behavioral pattern. In addition, the edge device 200 may transmit the first analysis data and the target data to the main server 100 if the first analysis data satisfies a predetermined detailed analysis condition.

[0026] In other words, the edge device 200 disclosed in the present application is capable of collecting target data collected through the measurement module 21 and camera module 22 installed in the target space to monitor the behavior, location, health status, etc. of individuals that are present in the target space and are to be monitored (e.g., livestock living in the target space such as mature cows (milking cows), calving cows, growing cows, dairy cows, stock cattle, calves, pigs, horses, chickens, sheep, etc., and crops cultivated in the target space), applying initial data processing, and performing basic analysis (initial analysis) that takes into account resource information (e.g., computing power, etc.) of the edge device 200 using a first model (lightweight model) that has been trained in advance.

[0027] For reference, the initial data processing of the target data can include a wide range of preprocessing operations, such as noise removal, data normalization, and initial classification of the data.

[0028] In addition, the edge device 200 can operate to distinguish between normal and abnormal situations occurring in the target space based on the analysis results of the first model (lightweight model), or selectively transmit the collected target data and / or the first analysis data initially analyzed by the first model to the main server 100 based on the results of identifying important situations, and can apply predetermined selection criteria for important data to select the data to be transmitted to the main server 100, thereby optimizing and compressing the selected data.

[0029] In addition, the main server 100 can input at least one of the first analysis data and the target data received from the edge device 200 into a second model based on pre-trained artificial intelligence to perform a detailed analysis to derive second analysis data linked to the individual's behavioral pattern.

[0030] In other words, the main server 100 disclosed in the present application can perform the following functions: receiving data from the edge device 200; performing an artificial intelligence-based advanced analysis (detailed analysis) of the received data using a pre-trained second model, which is difficult to perform at the edge device 200 end when taking into account the resources of the edge device 200; and providing the results of the performed advanced analysis (detailed analysis) to the user terminal 300.

[0031] Meanwhile, as shown in FIG. 2, for example, when the smart farm monitoring system 10 is configured to analyze and manage data collected through edge devices 200 placed in each of a plurality of target spaces (e.g., smart farms such as "Farm A" and "Farm B" in FIG. 2), the user terminal 300 can be owned by each of the administrators corresponding to each target space, but is not limited to this.

[0032] Below, the functions and operations of the main server 100 and edge device 200 of the smart farm monitoring system 10 disclosed in the present application will be described in detail. The process of selective data transmission through data collection, initial analysis (basic analysis), and selection and optimization of important data using the edge device 200 will be described first, and the process of performing detailed analysis (advanced analysis) on the main server 100 side using data received from the edge device 200 and providing the analysis results to the user terminal 300 will be described later.

[0033] First, the edge device 200 can collect target data including video data and sensing data associated with an individual to be monitored using the edge device 200.

[0034] In addition, the edge device 200 can use the edge device 200 to perform an initial analysis in which target data is input into a first model based on pre-trained artificial intelligence and first analysis data linked to the behavioral patterns of the individual is output.

[0035] Meanwhile, the edge device 200 disclosed herein may perform an initial analysis using a first model, which is a lightweight model constructed in consideration of resource information of the edge device 200. In this regard, the first model may be an edge target model to which a lightweight design is applied so that even the edge device 200 corresponding to equipment with limited computing power can operate efficiently, taking into consideration the processor performance, memory capacity, processing speed, etc. of the edge device 200.

[0036] For example, the first model may be set to have a relatively small amount of processable input data compared to the second model used for detailed analysis (high-level analysis) in the main server 100, or may include multiple layers and have a smaller number of layers than the number of layers in the second model, or may be designed not to include relatively complex functions, or may have a relatively small number of repetitions of a given operation, but is not limited to these.

[0037] According to an embodiment of the present application, the first model may be a model having a relatively small confidence value, which indicates the reliability of the class predicted by the model, set compared to the second model. In this regard, a model having a higher confidence value may have a higher accuracy in the prediction result for the class. However, in the case of the edge device 200, considering resources, it is more important to detect the occurrence of a specific important situation (e.g., a specific type of behavior of an individual) without missing it than to provide a highly accurate analysis result. Therefore, a confidence value that can strictly prevent non-diagnosis (missing an important situation / event) even if the possibility of misdiagnosis (wrong class classification) is relatively high may be applied to the first model.

[0038] In other words, according to one embodiment of the present application, the confidence value (e.g., first threshold) applied to the first model (lightweight model) for initial analysis can be set to a lower value than the confidence value (e.g., second threshold) applied to the second model (server-side model) for detailed analysis. Specifically, the edge device 200 can derive the presence / absence information and appearance position information of the individual reflected in the video data as the first analysis data.

[0039] In this regard, FIG. 3 is a conceptual diagram illustrating an AI-based individual identification method using video data linked to an individual being monitored.

[0040] Referring to FIG. 3, the edge device 200 recognizes an individual present in a target image 1, which means a specific frame included in video data, using a first model of the video analysis model type, and identifies a first boundary area B-1 containing the recognized individual, thereby deriving information on the presence or absence and appearance position of the individual.

[0041] For example, the edge device 200 may use the first model of the video analysis model type to perform analysis operations such as identifying a bounding box corresponding to an individual appearing in the target image 1, identifying key points indicating specific body parts of the individual, or segmentation to classify (understand) the object type of each part making up the target image 1, but is not limited to these.

[0042] Also, referring to FIG. 3, the edge device 200 can recognize a predetermined identification object (e.g., an object such as an ear tag, a sensor, a tag, or an identification tag attached to the ear of an individual) and identify a second boundary area B-2 containing the recognized identification object within the first boundary area B-1.

[0043] Meanwhile, according to one embodiment of the present application, the edge device 200 may derive shape information of an object in the target image 1 identified using a first model, which is an AI-based image analysis model, as first analysis data. In this regard, the shape information of the object may specifically include at least one of color information and partition pattern information of the object, and the main server 100, which has acquired the shape information of the object as the first analysis data, may operate to identify individuals appearing in the first analysis data or image data linked to the first analysis data by using a database (not shown) that matches individual identification information corresponding to each of a plurality of individuals active in the target space with tag identification information assigned to each type of shape information for each of a plurality of objects generated so that the shape information is distinguishable from one another.

[0044] As another example, the edge device 200 may derive first classification information on the individual's behavior type as first analysis data. Furthermore, if the first analysis data satisfies a predetermined detailed analysis condition, the edge device 200 may transmit the first analysis data and target data to the main server 100.

[0045] In this regard, according to one embodiment of the present application, when the first classification information corresponds to a predetermined abnormal behavior or important behavior, the edge device 200 can determine that the detailed analysis conditions are met and transmit the first analysis data and target data to the main server 100.

[0046] Furthermore, the abnormal or important behaviors described above can be set to include, for example, riding (breeding behavior), ingestion (feed intake, water intake), abnormal behaviors caused by illness or stress, etc., if the individual is a dairy cow among livestock, but are not limited thereto and can of course be set in a variety of ways depending on the type of individual located in the target space. Next, the main server 100 will be described.

[0047] The main server 100 inputs target data including video data and sensing data associated with the individual being monitored into a first model based on pre-trained artificial intelligence, and performs an initial analysis using the edge device 200 to output first analysis data associated with the individual's behavioral pattern.As a result, the main server 100 can receive from the edge device 200 the first analysis data and target data derived as a result of the first analysis data satisfying predetermined detailed analysis conditions.

[0048] In addition, the main server 100 can input at least one of the first analysis data and the target data into a second model based on pre-trained artificial intelligence to perform a detailed analysis to derive second analysis data linked to the individual's behavioral pattern.

[0049] Specifically, the main server 100 may operate to determine the second analysis data by using a second model including a plurality of models pre-constructed based on each of a plurality of different network structures, taking into consideration the degree of agreement of output data of each of the plurality of models. Meanwhile, the plurality of models having different network structures may mean, for example, that one of the plurality of models is designed based on a Convolutional Neural Network (CNN) and another of the plurality of models is designed based on a Transformer architecture, but is not limited thereto. Various types of artificial intelligence algorithms or architectures, such as a deep learning network, a machine learning algorithm, and a supervised / unsupervised learning algorithm, which are known in the art or can be developed in the future, may be applied to each of the plurality of models that may be included in the second model disclosed herein.

[0050] In this regard, according to one embodiment of the present application, the main server 100 may generate a dataset including at least a portion of the target data and the first analysis data received from the edge device 200 as data to be analyzed for the second model.

[0051] Furthermore, the main server 100 can individually input the same data set generated for each of the multiple models included in the second model, and obtain the prediction results for each of the multiple models.

[0052] In addition, the main server 100 may verify whether prediction results derived through each of the multiple models are consistent with each other. Specifically, if all prediction results derived through each of the multiple models are consistent with each other, the main server 100 may determine the prediction result commonly derived through the multiple models as second analysis data of the second model. Alternatively, if at least some of the prediction results derived through the multiple models are inconsistent with each other, the main server 100 may remove the existing prediction results derived through each of the multiple models and perform a detailed analysis again using data newly transmitted from the edge device 200 (i.e., target data and first analysis data).

[0053] Meanwhile, in relation to such a multiple AI model approach, the smart farm monitoring system 10 disclosed in the present application has a second model including multiple models, each of which has the same data set and performs an independent analysis. As a result of the analysis, the result is deemed reliable only if all of the multiple models predict the same class; if only one model predicts a specific class, the result is deemed to be an incorrect answer. Therefore, considering that it is important to minimize erroneous results and ultimately provide accurate results with high reliability in a commercial environment such as a smart farm, the second model, unlike the first model, can be understood to have adopted an approach that uses various models to increase the reliability of the results rather than relying on a single model. In addition, the main server 100 can transmit the second analysis data derived through the detailed analysis performed by the main server 100 to the user terminal 300 .

[0054] FIG. 4 is a schematic configuration diagram of a main server of a smart farm monitoring system according to an embodiment of the present application. Referring to FIG. 4, the main server 100 may include a data receiving unit 110, a detailed analysis unit 120, and an analysis information providing unit .

[0055] The data receiving unit 110 can receive from the edge device 200 the first analysis data and target data derived as a result of the first analysis data satisfying preset detailed analysis conditions as a result of performing an initial analysis using the edge device 200, in which target data including video data and sensing data associated with the individual being monitored is input into a first model based on pre-trained artificial intelligence and first analysis data associated with the individual's behavioral pattern is output.

[0056] The detailed analysis unit 120 may perform a detailed analysis by inputting at least one of the first analysis data and the target data into a second model based on pre-trained artificial intelligence to derive second analysis data associated with the individual's behavioral pattern.

[0057] Specifically, the detailed analysis unit 120 can operate to determine second analysis data using a second model including multiple models pre-constructed based on each of multiple different network structures, taking into account the degree of similarity of the output data of each of the multiple models.

[0058] In this regard, according to one embodiment of the present application, the detailed analysis unit 120 may generate a dataset including at least a portion of the target data and the first analysis data received from the edge device 200 as analysis target data for the second model.

[0059] Furthermore, the detailed analysis unit 120 can individually input the same data set generated for each of the multiple models included in the second model, and obtain the prediction results for each of the multiple models.

[0060] In addition, the detailed analysis unit 120 may verify whether the prediction results derived through each of the plurality of models are consistent with each other. Specifically, if the prediction results derived through each of the plurality of models are consistent with each other, the detailed analysis unit 120 may determine the prediction result commonly derived through the plurality of models as second analysis data of the second model. Alternatively, if at least some of the prediction results derived through the plurality of models are inconsistent with each other, the detailed analysis unit 120 may remove the existing prediction results derived through each of the plurality of models and perform a detailed analysis again using data newly transmitted from the edge device 200 (i.e., target data and first analysis data). The analysis information providing unit 130 may transmit the second analysis data derived through the detailed analysis performed by the main server 100 to the user terminal 300 .

[0061] FIG. 5 is a schematic configuration diagram of an edge device of a smart farm monitoring system according to an embodiment of the present application. Referring to FIG. 5 , the edge device 200 may include a collection unit 210 and an initial analysis unit 220.

[0062] The collection unit 210 can collect target data including video data and sensing data linked to the individual being monitored using the edge device 200.

[0063] The initial analysis unit 220 can use the edge device 200 to perform an initial analysis in which target data is input into a first model based on pre-trained artificial intelligence and first analysis data linked to the behavioral patterns of individuals is output.

[0064] For example, the initial analysis unit 220 may perform the initial analysis using a first model, which is a lightweight model constructed in consideration of resource information of the edge device 200.

[0065] Specifically, the initial analysis unit 220 may derive presence / absence information and appearance position information of an individual reflected in the video data as the first analysis data. As another example, the initial analysis unit 220 may derive first classification information on the behavior type of the individual as the first analysis data.

[0066] The communication unit 230 may transmit the first analysis data and the target data to the main server 100 if the first analysis data meets a predetermined detailed analysis condition.

[0067] Specifically, according to one embodiment of the present application, if the first classification information corresponds to a pre-set abnormal behavior or important behavior, the communication unit 230 can determine that the detailed analysis conditions are met and transmit the first analysis data and target data to the main server 100.

[0068] The following briefly describes the operation flow of the present invention based on the above detailed description. FIG. 6 is a flowchart illustrating an operation of a dual-processing-based individual analysis method using artificial intelligence according to an embodiment of the present disclosure, which is performed using an edge device.

[0069] 6 may be performed by the above-described edge device 200. Therefore, even if omitted below, the description of the edge device 200 may be equally applied to the description of the dual processing-based individual analysis method using AI.

[0070] Referring to FIG. 6, in operation S11, the collection unit 210 may collect target data including image data and sensing data associated with an individual to be monitored using the edge device 200.

[0071] Next, in step S12, the initial analysis unit 220 can use the edge device 200 to perform an initial analysis in which target data is input into a pre-trained artificial intelligence-based first model and first analysis data linked to the individual's behavioral pattern is output.

[0072] For example, in operation S12, the initial analysis unit 220 may perform the initial analysis using a first model, which is a lightweight model constructed in consideration of resource information of the edge device 200.

[0073] Specifically, in step S12, the initial analysis unit 220 may derive presence / absence information and appearance position information of the individual reflected in the video data as first analysis data. As another example, in step S12, the initial analysis unit 220 may derive first classification information for the individual's behavior type as the first analysis data.

[0074] Next, in step S13, the communication unit 230 may transmit the first analysis data and the target data to the main server 100 if the first analysis data meets a preset detailed analysis condition.

[0075] Specifically, according to one embodiment of the present application, in step S13, if the first classification information corresponds to a pre-set abnormal behavior or important behavior, the communication unit 230 determines that the detailed analysis conditions have been met and can transmit the first analysis data and target data to the main server 100.

[0076] In the above description, steps S11 to S13 may be further divided into additional steps or combined into fewer steps depending on the embodiment of the present application. Also, some steps may be omitted as necessary, and the sequence between steps may be changed.

[0077] FIG. 7 is a flowchart illustrating an operation of a dual-processing-based individual analysis method using artificial intelligence according to an embodiment of the present invention, which is performed using a main server. 7 can be performed by the above-described main server 100. Therefore, even if omitted below, the description of the main server 100 can be equally applied to the description of the double-processing-based individual analysis method using AI.

[0078] Referring to FIG. 7, in step S21, the data receiving unit 110 performs an initial analysis using the edge device 200, inputting target data including video data and sensing data associated with the individual being monitored into a pre-trained artificial intelligence-based first model and outputting first analysis data associated with the individual's behavioral pattern. As a result, the first analysis data may receive from the edge device 200 first analysis data and target data derived as a result of the first analysis data satisfying predetermined detailed analysis conditions.

[0079] Next, in step S22, the detailed analysis unit 120 may perform a detailed analysis by inputting at least one of the first analysis data and the target data into a pre-trained artificial intelligence-based second model to derive second analysis data associated with the individual's behavioral pattern.

[0080] Specifically, in step S22, the detailed analysis unit 120 can operate to determine second analysis data using a second model including a plurality of models pre-constructed based on each of a plurality of different network structures, taking into account the degree of similarity of the output data of each of the plurality of models.

[0081] In addition, according to one embodiment of the present application, in step S22, the detailed analysis unit 120 derives second analysis data including second classification information for the individual's behavior type, and the number of classes of the derived second classification information may be set to be larger than the number of classes of the above-mentioned first classification information.

[0082] In the above description, steps S21 and S22 may be further divided into additional steps or combined into fewer steps depending on the embodiment of the present application. Also, some steps may be omitted as necessary, and the sequence between steps may be changed.

[0083] FIG. 8 is a detailed operational flowchart of a detailed analysis process for deriving second analysis data associated with an individual's behavioral pattern. The detailed analysis process for deriving the second analysis data associated with the individual behavioral pattern shown in Figure 8 can be performed by the above-described main server 100. Therefore, even if the following content is omitted, the content described about the main server 100 can be equally applied to the description of the individual analysis method based on dual processing using artificial intelligence.

[0084] Referring to FIG. 8, in operation S221, the detailed analysis unit 120 may generate a data set including at least a portion of the target data and the first analysis data received from the edge device 200 as analysis target data for the second model.

[0085] Next, in step S222, the detailed analysis unit 120 may individually input the same data set generated in step S221 into each of the plurality of models included in the second model. Next, in step S223, the detailed analysis unit 120 can obtain the prediction results of each of the multiple models. Next, in step S224, the detailed analysis unit 120 may verify whether the prediction results derived through each of the multiple models are consistent with each other.

[0086] If the judgment result of step S224 indicates that the prediction results derived through each of the multiple models are all consistent, in step S225, the detailed analysis unit 120 can determine the prediction results commonly derived through the multiple models as the second analysis data of the second model.

[0087] Alternatively, if the determination result of step S224 indicates that at least some of the prediction results derived through the multiple models do not match each other, in step S226, the detailed analysis unit 120 may remove the existing prediction results derived through each of the multiple models and perform detailed analysis again using newly transmitted data from the edge device 200 (in other words, the target data and the first analysis data).

[0088] In the above description, steps S221 and S226 may be further divided into additional steps or combined into fewer steps depending on the embodiment of the present application. Also, some steps may be omitted as necessary, and the sequence between steps may be changed.

[0089] A dual-processing-based individual analysis method using artificial intelligence according to an embodiment of the present disclosure may be embodied in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention, or those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include not only machine language code, such as that produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter, etc. The above hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, or vice versa.

[0090] The above-described method for analyzing individuals based on dual processing using artificial intelligence may also be implemented in the form of a computer program or application that is stored in a recording medium and executed by a computer.

[0091] The above description of the present application is for illustrative purposes only, and those skilled in the art will understand that the present application may be easily modified into other specific forms without changing the technical concept or essential features of the present application. Therefore, the above-described embodiments are illustrative in all respects and are not limiting. For example, each component described as a single component may be implemented in a distributed form, and similarly, each component described as a distributed component may be implemented in a combined form. The scope of the present application is defined by the claims that follow rather than the above detailed description, and all modifications and variations that fall within the meaning and scope of the claims and their equivalents are included within the scope of the present application. [Explanation of symbols]

[0092] 10:Smart Farm Monitoring System 100: Main server 110: Data receiving unit 120: Detailed analysis department 130:Analysis information provision department 200: Edge devices 210: Collection Department 220: Initial analysis department 230: Communications Department 21: Measurement module 22: Camera module 300: User terminal 20: Network

Claims

1. In a double processing-based individual analysis method using artificial intelligence, collecting target data including video data and sensing data associated with the individual being monitored using an edge device; performing an initial analysis using the edge device, inputting the target data into a first model based on pre-trained artificial intelligence and outputting first analysis data associated with a behavior pattern of the individual; transmitting the first analysis data and the target data to a main server when the first analysis data satisfies a predetermined detailed analysis condition; Including, The main server At least one of the first analysis data and the target data is input to a second model based on pre-trained artificial intelligence to perform a detailed analysis to derive second analysis data associated with the individual's behavioral pattern; The first analysis data is The video data includes information on the presence or absence of the individual and information on its appearance position. An analytical method characterized by:

2. The first analysis data is The first classification information for the individual's behavior type is included; The detailed analysis conditions are: The first classification information includes a condition corresponding to a predetermined abnormal behavior or an important behavior. The analytical method according to claim 1 .

3. The second analysis data is The second classification information includes second classification information for the individual's behavior type, and the number of classes in the second classification information is greater than the number of classes in the first classification information. The analytical method according to claim 2.

4. The first model is a lightweight model constructed in consideration of resource information of the edge device. The analytical method according to claim 1 .

5. the second model includes a plurality of models constructed in advance based on a plurality of network structures different from each other, The second analysis data is The degree of coincidence of the output data of each of the plurality of models is taken into consideration when determining the degree of coincidence. The analytical method according to claim 1 .

6. In a double processing-based individual analysis method using artificial intelligence, receiving the first analysis data and the target data from the edge device as a result of the first analysis data satisfying a predetermined detailed analysis condition as a result of performing an initial analysis using an edge device, the initial analysis including inputting target data including video data and sensing data associated with the individual to be monitored into a first model based on pre-trained artificial intelligence and outputting first analysis data associated with a behavioral pattern of the individual; and performing a detailed analysis to input at least one of the first analysis data and the target data into a second model based on pre-trained artificial intelligence to derive second analysis data associated with the individual's behavioral pattern, The first analysis data is The video data includes information on the presence or absence of the individual and information on its appearance position. An analytical method characterized by:

7. the second model includes a plurality of models constructed in advance based on a plurality of network structures different from each other, The step of performing the detailed analysis includes: determining the second analysis data in consideration of the degree of agreement of the output data of each of the plurality of models; The analytical method according to claim 6.

8. The first analysis data is The first classification information for the individual's behavior type is included; The detailed analysis conditions are: The first classification information includes a condition corresponding to a predetermined abnormal behavior or an important behavior. The analytical method according to claim 6.

9. The second analysis data is The second classification information includes second classification information for the individual's behavior type, and the number of classes in the second classification information is greater than the number of classes in the first classification information. The analytical method according to claim 8.

10. In the smart farm monitoring system, an edge device that collects target data including video data and sensing data associated with an individual to be monitored, performs an initial analysis by inputting the target data into a first model based on pre-trained artificial intelligence to output first analysis data associated with a behavioral pattern of the individual, and transmits the first analysis data and the target data to a main server when the first analysis data satisfies a pre-set detailed analysis condition; the main server inputting at least one of the first analysis data and the target data into a second model based on pre-trained artificial intelligence to perform a detailed analysis to derive second analysis data associated with the individual's behavioral pattern, The first analysis data is The video data includes information on the presence or absence of the individual and information on its appearance position. A monitoring system characterized by:

Images