Digital augmented reality workshop visual monitoring system

Through digital augmented reality technology, real-time monitoring of workshop production progress, product quality and personnel operations, the problem that traditional monitoring methods are difficult to fully understand is solved, more intuitive and scientific evaluation and early warning are achieved, and the production management and safety guarantee level is improved.

CN118917529AInactive Publication Date: 2024-11-08SEC ZHILIAN TECH (JIANGSU) CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202410950098.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-16
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Traditional workshop monitoring methods are difficult to fully understand the production progress and product quality, resulting in lag in production and quality failure, and lack of monitoring personnel operations, which increases safety hazards.

Method used

Design a digital augmented reality workshop visual monitoring system, through preprocessing module, regional production progress monitoring module, regional product quality monitoring module, regional personnel operation monitoring module, workshop three-dimensional model building module, augmented reality fusion display module and monitoring analysis and early warning feedback The module monitors and analyzes the production progress, product quality and personnel operations of each production sub-region in the workshop in real time, generates abnormal signals and provides early warnings.

Benefits of technology

Improve the intuitiveness and scientificity of production progress evaluation, timely discover production lag and quality problems, and improve the production management level; through detailed product quality evaluation and operation monitoring, the risks of defective products and safety accidents are reduced, and operation standardization is promoted. and improve production efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118917529A_ABST
    Figure CN118917529A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of workshop monitoring, and particularly discloses a digital augmented reality workshop visual monitoring system. Comprising a preprocessing module, a regional production progress monitoring module, a regional product quality monitoring module, a regional personnel operation monitoring module, a workshop three-dimensional model construction module, an augmented reality fusion display module, a monitoring analysis early warning feedback module, an early warning terminal and a database. According to the invention, the production progress of each monitoring sub-time period in the current operation time period corresponding to each production sub-region of the workshop is monitored and analyzed, and the production progress data of each monitoring sub-time period in the current operation time period corresponding to each production sub-region is overlaid and displayed in the workshop three-dimensional model in real time; according to the method, the evaluation of the workshop production progress is more visual, scientific and reliable to a certain extent, and the lag of the production progress can be found in time through early warning analysis, so that corresponding measures can be taken for adjustment and improvement, the smooth operation of a production plan is ensured, and the production management level of an enterprise is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of workshop monitoring, and in particular to a digital augmented reality workshop visualization monitoring system. Background Art

[0002] Digital augmented reality is a cutting-edge technology that combines virtual information with the real world. It provides users with an enhanced and immersive experience by superimposing computer-generated virtual content such as images, videos, audio, 3D models, etc. on the real physical environment, showing great application potential in the industrial field. Especially in workshop production, its importance is becoming increasingly prominent.

[0003] As the core area of ​​industrial production, the operation efficiency and quality of the workshop are directly related to the competitiveness of the enterprise. With the increasing complexity of production processes and the continuous improvement of production accuracy and efficiency requirements, traditional monitoring methods have gradually exposed many limitations. In the past, workshop monitoring often relied on simple video monitoring and limited sensor data, which often provided one-sided and non-intuitive information. For example, in a complex production line, it is difficult to fully understand the operating status of the equipment and the operation of the workers only through a camera with a fixed viewing angle.

[0004] At present, it is difficult to grasp the real-time production progress and product quality status of the entire workshop through visual monitoring and management. This can easily lead to untimely discovery of problems in the production process, causing serious delays in production progress and substandard product quality, and reducing production efficiency. In addition, there is a lack of monitoring and analysis of personnel operations in the production area, and problems with irregular operations of personnel cannot be discovered in time, leading to increased safety hazards and potential accident risks.

[0005] In order to solve the above defects, a technical solution is now provided. Summary of the invention

[0006] The purpose of the present invention is to provide a digital augmented reality workshop visualization monitoring system to solve the problems raised in the above background.

[0007] The object of the present invention can be achieved by the following technical solutions: A digital augmented reality workshop visualization monitoring system, comprising: a preprocessing module, used to obtain the production area and current operation period of the workshop, and divide the workshop production area in a way of equally dividing the uniformly set spatial layout to obtain each production sub-area of ​​the workshop, and divide the current operation period in a way of equally dividing the uniformly set time period to obtain each monitoring sub-period in the current operation period;

[0008] The regional production progress monitoring module is used to obtain the production processes corresponding to each production sub-area of ​​the workshop, and monitor and analyze each production process of each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and obtain the production progress evaluation coefficient of each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop;

[0009] The regional product quality monitoring module is used to monitor and analyze the quality of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and obtain the product quality evaluation coefficient of each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop;

[0010] The regional personnel operation monitoring module is used to monitor and analyze the personnel operations in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and obtain the personnel operation standard evaluation coefficient in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop;

[0011] A workshop 3D model building module is used to build a 3D model of the layout of each production sub-area of ​​the workshop to obtain a 3D model of each production sub-area of ​​the workshop; wherein the 3D model building is carried out through a specified modeling tool;

[0012] The augmented reality fusion display module is used to superimpose the real-time data of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period on the three-dimensional model in an intuitive way for display through digital augmented reality technology;

[0013] The monitoring analysis and early warning feedback module is used to analyze the production progress evaluation coefficient, product quality evaluation coefficient, and personnel operation specification evaluation coefficient of each monitoring sub-period in the current operation period of each production sub-area of ​​the workshop, and obtain the abnormal signal of each production sub-area of ​​the workshop corresponding to the current operation period;

[0014] The early warning terminal is used to receive abnormal signals from each production sub-area of ​​the workshop corresponding to the current operation period and perform corresponding processing; the database is used to store the estimated output of each production sub-area of ​​the workshop corresponding to the monitoring day, store the various sizes of qualified products, and store the frequency of personnel operation in each production sub-area.

[0015] Preferably, each production process of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period is monitored and analyzed, and the specific execution steps are as follows:

[0016] Through the camera, each circulating product of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop is monitored to obtain the image of each circulating product of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and the image of each circulating product of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop is matched with the image of the finished product of each production process. If the image of a circulating product of a production process matches the image of the finished product of the production process, the circulating product is recorded as a qualified product. Otherwise, the circulating product is recorded as a semi-finished product. Thus, the number of qualified products and the number of semi-finished products of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are statistically obtained and marked as respectively. i represents the number of each production sub-area, i=1,2,....,m, m represents the total number of production sub-area numbers, j represents the number of each monitoring sub-period, j=1,2,....,n, n represents the total number of monitoring sub-period numbers, f represents the number of each production process, f=1,2,....,g, g represents the total number of production process numbers;

[0017] The number of circulating products of each production process in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop is monitored by cameras and counters, and the number of circulating products of each production process in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop is obtained, which is recorded as Extract the estimated production of each production sub-area of ​​the workshop on the corresponding monitoring day from the database, obtain the actual time period of the current operation period, and match the actual time period of the current operation period with the estimated production impact value corresponding to each set actual time period to obtain the estimated production impact value of the current operation period;

[0018] Divide the estimated output of each production sub-area of ​​the workshop on the corresponding monitoring day by the data of the actual time period on the actual monitoring day to obtain the estimated output of each production sub-area of ​​the workshop on the corresponding monitoring day;

[0019] The estimated output of each production sub-area in the workshop for each actual period of the monitoring day is subtracted from the estimated output impact value of the current operation period to obtain the estimated output of each production sub-area in the workshop for the current operation period;

[0020] The estimated output of each production sub-area of ​​the workshop corresponding to the current operation period is calculated by dividing the data of the actual monitoring sub-period in the current operation period, and the estimated output of each production sub-area of ​​the workshop corresponding to each monitoring sub-period in the current operation period is obtained, which is recorded as

[0021] Get the actual output of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period, recorded as According to the formula Calculate the production progress evaluation coefficient of each monitoring sub-period in the current operation period for each production sub-area of ​​the workshop a1, a2, and a3 represent the set influencing factors respectively. Preferably, the quality of each product in each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period is monitored and analyzed, and the specific execution steps are as follows:

[0022] The apparent images of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are collected by the camera to obtain the apparent images of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop;

[0023] Extract the number of damaged parts and scratches of each product from the apparent image of each product in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and mark them as The damaged areas and scratch depths of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area are extracted, and the damaged areas and scratch depths corresponding to each product are accumulated to obtain the total damaged areas and scratch depths of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area in the workshop, which are marked as p represents the number of each product, p = 1, 2, ...., v, v represents the total number of product numbers;

[0024] According to the formula Calculate the product integrity index of each production area in the workshop corresponding to each monitoring sub-period in the current operation period b1, b2, b3, and b4 represent the set weight factors respectively;

[0025] Extract the dimensions of each product from the apparent images of each product in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and record them as At the same time, the dimensions of qualified products are extracted from the database and recorded as A' k , k represents the number of each dimension, k=1,2,....,l, l represents the total number of dimension item numbers, where the dimensions include but are not limited to: length, width, thickness;

[0026] According to the formula Calculate the product size matching index of each production area in the workshop corresponding to each monitoring sub-period in the current operation period z is represented as a natural constant, x1 and x2 are respectively represented as set correction factors;

[0027] According to the formula Calculate the product quality assessment coefficient of each production area in the workshop corresponding to each monitoring sub-period in the current operation period b5 and b6 represent the set exponential factors respectively.

[0028] Preferably, the personnel operations in each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period are monitored and analyzed, and the specific execution steps are as follows:

[0029] The operation images of each operator in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are collected by an intelligent high-definition camera to obtain the operation images of each operator in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop;

[0030] The protective equipment wearing images of each operator are extracted from the operation images of each operator in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and compared with the set protective equipment wearing images. If the protective equipment wearing image of a certain operator is consistent with the set protective equipment wearing image, it is determined that the protective equipment of the operator is worn correctly. Otherwise, it is determined that the protective equipment of the operator is worn abnormally. Thus, the number of personnel wearing protective equipment correctly and the number of personnel wearing protective equipment abnormally in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop are obtained, and they are recorded as Among them, protective equipment includes but is not limited to: helmets, gloves, goggles;

[0031] According to the formula Calculate the personnel operation safety protection assessment index of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period c1 and c2 represent the set weight factors respectively; extract the action frequency of each operator from the operation image of each operator in each monitoring sub-period in the current operation period of each production sub-area of ​​the workshop, and compare it with the operation action frequency of the personnel in each production sub-area stored in the database. If the action frequency of a certain operator in a certain production sub-area of ​​the workshop corresponding to a certain monitoring time point in the current operation period is consistent with the operation action frequency of the personnel in the production sub-area, then the operation action of the personnel is determined to be standard; otherwise, the operation action of the personnel is determined to be non-standard. Thus, the number of standard action personnel and the number of non-standard action personnel in each monitoring sub-period in the current operation period of each production sub-area of ​​the workshop are statistically obtained, and they are marked as According to the formula Calculate the personnel operation smoothness evaluation index of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period c3 and c4 represent the set weight factors respectively; the distance between adjacent operators is extracted from the operation images of each operator in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and compared with the set reference distance interval of the personnel operation in each production sub-area; if the distance between adjacent operators in a production sub-area of ​​the workshop corresponding to a certain monitoring time point in the current operation period is within the set reference distance interval of the personnel operation in the production sub-area, then it is determined that the distance between the adjacent operators meets the requirements; otherwise, it is determined that the distance between the adjacent operators does not meet the requirements; thus, the number of adjacent operators whose distances meet the requirements and the number of adjacent operators whose distances do not meet the requirements in each production sub-area of ​​the workshop corresponding to each monitoring sub-period in the current operation period are statistically obtained, and they are marked as According to the formula Calculate the personnel concentration evaluation index of each production sub-area in the workshop corresponding to each monitoring sub-period in the current operation period c5 and c6 represent the set weight factors respectively;

[0032] According to the formula Calculate the personnel operation standard evaluation coefficient of each production sub-area of ​​the workshop corresponding to each monitoring sub-period in the current operation period d1 and d2 represent the set evaluation factors respectively.

[0033] Preferably, analysis is performed based on the production progress evaluation coefficient, product quality evaluation coefficient, and personnel operation specification evaluation coefficient of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period. The specific analysis method is as follows:

[0034] Through analysis, the comprehensive production progress assessment coefficient, comprehensive product quality assessment coefficient, and comprehensive personnel operation standard assessment coefficient of each production sub-area of ​​the workshop corresponding to the current operation period are obtained;

[0035] The comprehensive production progress evaluation coefficient of each production sub-area of ​​the workshop corresponding to the current operation period is compared with the set comprehensive production progress evaluation coefficient threshold. If the comprehensive production progress evaluation coefficient of a production sub-area of ​​the workshop corresponding to the current operation period is less than the set comprehensive production progress evaluation coefficient threshold, it is determined that the production progress of the production sub-area of ​​the workshop corresponding to the current operation period is lagging, and a production progress lag signal is generated and sent to the early warning terminal;

[0036] Compare the comprehensive product quality assessment coefficient of each production sub-area of ​​the workshop corresponding to the current operation period with the set comprehensive product quality assessment coefficient threshold. If the comprehensive product quality assessment coefficient of a production sub-area of ​​the workshop corresponding to the current operation period is less than the set comprehensive product quality assessment coefficient threshold, it is determined that the product quality of the production sub-area of ​​the workshop corresponding to the current operation period does not meet the standard, and a product quality non-standard signal is generated and sent to the early warning terminal;

[0037] The comprehensive personnel operation standard evaluation coefficient of each production sub-area of ​​the workshop corresponding to the current operation period is compared with the set comprehensive personnel operation standard evaluation coefficient threshold. If the comprehensive personnel operation standard evaluation coefficient of a production sub-area of ​​the workshop corresponding to the current operation period is less than the set comprehensive personnel operation standard evaluation coefficient threshold, it is determined that the personnel operation of the production sub-area of ​​the workshop corresponding to the current operation period is not standardized, and a personnel operation non-standard signal is generated and sent to the early warning terminal;

[0038] The abnormal signals of each production sub-area of ​​the workshop corresponding to the current operation period are jointly constituted by the production progress delay signal, the product quality substandard signal and the personnel operation irregularity signal.

[0039] Beneficial effects of the present invention:

[0040] The present invention monitors and analyzes the production progress of each monitoring sub-period in the current operating period corresponding to each production sub-area of ​​the workshop, and superimposes the production progress data of each monitoring sub-period in the current operating period corresponding to each production sub-area in real time on the three-dimensional model of the workshop, which makes the evaluation of the production progress of the workshop more intuitive, scientific and reliable to a certain extent, and can timely discover the lag in production progress through early warning analysis, so as to take corresponding measures to adjust and improve, thereby ensuring the smooth implementation of the production plan and improving the production management level of the enterprise.

[0041] The present invention monitors and analyzes the product quality of each monitoring sub-period in the current operating period corresponding to each production sub-area of ​​the workshop, and superimposes and displays the product quality data of each monitoring sub-period in the current operating period corresponding to each production sub-area on the three-dimensional model of the workshop in real time, so as to conduct product quality assessment more intuitively, meticulously and comprehensively to a certain extent, reduce the subjectivity and error of human judgment, and can timely discover quality fluctuations and trends, which is helpful to quickly take corrective measures, reduce the generation of defective products, and improve product quality stability.

[0042] The present invention monitors and analyzes the personnel operations in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and superimposes and displays the personnel operation data of each monitoring sub-period in the current operation period corresponding to each production sub-area in real time on the three-dimensional model of the workshop, so as to more intuitively and quickly understand and grasp the personnel operation situation to a certain extent, so as to make decisions and adjustments more effectively. At the same time, through early warning analysis, it can effectively improve the safety protection level of the operating personnel and reduce the risk of safety accidents caused by improper protection; promote the standardization and normalization of operations, improve production efficiency and the stability of product quality; can reasonably optimize the personnel layout, avoid excessive crowding or dispersion of personnel, improve work coordination efficiency, and reduce potential safety hazards and production obstacles; timely discover and correct irregular behaviors in operations, prevent potential production accidents and safety risks, and ensure the smooth progress of workshop production. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The present invention will be further described below in conjunction with the accompanying drawings.

[0044] Figure 1 It is a system block diagram of the present invention. DETAILED DESCRIPTION

[0045] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0046] See also Figure 1 As shown, the present invention is a digital augmented reality workshop visualization monitoring system, including a preprocessing module, a regional production progress monitoring module, a regional product quality monitoring module, a regional personnel operation monitoring module, a workshop three-dimensional model building module, an augmented reality fusion display module, a monitoring analysis early warning feedback module, an early warning terminal and a database.

[0047] Among them, the preprocessing module is connected with the regional production progress monitoring module, the regional product quality monitoring module, and the regional personnel operation monitoring module respectively; the database is connected with the regional production progress monitoring module, the regional product quality monitoring module, and the regional personnel operation monitoring module respectively; the regional production progress monitoring module is connected with the workshop three-dimensional model construction module and the monitoring analysis and early warning feedback module respectively; the regional product quality monitoring module is connected with the workshop three-dimensional model construction module and the monitoring analysis and early warning feedback module respectively; the regional personnel operation monitoring module is connected with the workshop three-dimensional model construction module and the monitoring analysis and early warning feedback module respectively; the workshop three-dimensional model construction module is connected with the augmented reality fusion display module; and the monitoring analysis and early warning feedback module is connected with the early warning terminal.

[0048] The preprocessing module is used to obtain the production area and current operation period of the workshop, and divide the production area of ​​the workshop in an equal manner according to a uniformly set spatial layout to obtain the production sub-areas of the workshop, and divide the current operation period in an equal manner according to a uniformly set time period to obtain the monitoring sub-periods in the current operation period.

[0049] In a specific embodiment, the present invention achieves more refined monitoring and management by subdividing the workshop production area and the current operation time period, and can more accurately detect production progress, product quality, and personnel operation problems.

[0050] The regional production progress monitoring module is used to obtain the production processes corresponding to each production sub-area of ​​the workshop, and monitor and analyze each production process of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period. The specific execution steps are as follows:

[0051] Through the camera, each circulating product of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop is monitored to obtain the image of each circulating product of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and the image of each circulating product of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop is matched with the image of the finished product of each production process. If the image of a circulating product of a production process matches the image of the finished product of the production process, the circulating product is recorded as a qualified product. Otherwise, the circulating product is recorded as a semi-finished product. Thus, the number of qualified products and the number of semi-finished products of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are statistically obtained and marked as respectively. i represents the number of each production sub-area, i=1,2,....,m, m represents the total number of production sub-area numbers, j represents the number of each monitoring sub-period, j=1,2,....,n, n represents the total number of monitoring sub-period numbers, f represents the number of each production process, f=1,2,....,g, g represents the total number of production process numbers;

[0052] The number of circulating products of each production process in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop is monitored by cameras and counters, and the number of circulating products of each production process in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop is obtained, which is recorded as Extract the estimated production of each production sub-area of ​​the workshop on the corresponding monitoring day from the database, obtain the actual time period of the current operation period, and match the actual time period of the current operation period with the estimated production impact value corresponding to each set actual time period to obtain the estimated production impact value of the current operation period;

[0053] Divide the estimated output of each production sub-area of ​​the workshop on the corresponding monitoring day by the data of the actual time period on the actual monitoring day to obtain the estimated output of each production sub-area of ​​the workshop on the corresponding monitoring day;

[0054] The estimated output of each production sub-area in the workshop for each actual period of the monitoring day is subtracted from the estimated output impact value of the current operation period to obtain the estimated output of each production sub-area in the workshop for the current operation period;

[0055] The estimated output of each production sub-area of ​​the workshop corresponding to the current operation period is calculated by dividing the data of the actual monitoring sub-period in the current operation period, and the estimated output of each production sub-area of ​​the workshop corresponding to each monitoring sub-period in the current operation period is obtained, which is recorded as

[0056] Get the actual output of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period, recorded as According to the formula Calculate the production progress evaluation coefficient of each monitoring sub-period in the current operation period for each production sub-area of ​​the workshop a1, a2, and a3 are respectively represented as the set influencing factors. In a specific embodiment, the present invention monitors and analyzes the production progress of each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and superimposes the production progress data of each monitoring sub-period in the current operation period corresponding to each production sub-area on the three-dimensional model of the workshop in real time, so as to make the evaluation of the workshop production progress more intuitive, scientific, and reliable to a certain extent, and timely discover the lag in production progress through early warning analysis, so as to take corresponding measures to adjust and improve, ensure the smooth implementation of the production plan, and improve the production management level of the enterprise.

[0057] The regional product quality monitoring module is used to monitor and analyze the quality of each product in each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period. The specific execution steps are as follows:

[0058] The apparent images of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are collected by the camera to obtain the apparent images of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop;

[0059] Extract the number of damaged parts and scratches of each product from the apparent image of each product in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and mark them as The damaged areas and scratch depths of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area are extracted, and the damaged areas and scratch depths corresponding to each product are accumulated to obtain the total damaged areas and scratch depths of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area in the workshop, which are marked as p represents the number of each product, p = 1, 2, ...., v, v represents the total number of product numbers;

[0060] According to the formula Calculate the product appearance integrity index of each production area in the workshop corresponding to each monitoring sub-period in the current operation period b1, b2, b3, and b4 represent the set weight factors respectively;

[0061] Extract the dimensions of each product from the apparent images of each product in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and record them as At the same time, the dimensions of qualified products are extracted from the database and recorded as A' k , k represents the number of each dimension, k=1,2,....,l, l represents the total number of dimension item numbers, where the dimensions include but are not limited to: length, width, thickness;

[0062] According to the formula Calculate the product size matching index of each production area in the workshop corresponding to each monitoring sub-period in the current operation period z is represented as a natural constant, x1 and x2 are respectively represented as set correction factors;

[0063] According to the formula Calculate the product quality assessment coefficient of each production area in the workshop corresponding to each monitoring sub-period in the current operation period b5 and b6 represent the set exponential factors respectively.

[0064] In a specific embodiment, the present invention monitors and analyzes the product quality of each monitoring sub-period in the current operating period corresponding to each production sub-area of ​​the workshop, and superimposes the product quality data of each monitoring sub-period in the current operating period corresponding to each production sub-area in the workshop in real time on the three-dimensional model of the workshop, so as to a certain extent, the product quality assessment is carried out more intuitively, meticulously and comprehensively, the subjectivity and error of human judgment are reduced, quality fluctuations and trends can be discovered in time, which helps to quickly take corrective measures, reduce the production of defective products, and improve product quality stability.

[0065] The regional personnel operation monitoring module is used to monitor and analyze the personnel operations in each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period. The specific execution steps are as follows:

[0066] The operation images of each operator in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are collected by an intelligent high-definition camera to obtain the operation images of each operator in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop;

[0067] The protective equipment wearing images of each operator are extracted from the operation images of each operator in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and compared with the set protective equipment wearing images. If the protective equipment wearing image of a certain operator is consistent with the set protective equipment wearing image, it is determined that the protective equipment of the operator is worn correctly. Otherwise, it is determined that the protective equipment of the operator is worn abnormally. Thus, the number of personnel wearing protective equipment correctly and the number of personnel wearing protective equipment abnormally in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop are obtained, and they are recorded as Among them, protective equipment includes but is not limited to: helmets, gloves, goggles;

[0068] According to the formula Calculate the personnel operation safety protection assessment index of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period c1 and c2 represent the set weight factors respectively; extract the action frequency of each operator from the operation image of each operator in each monitoring sub-period in the current operation period of each production sub-area of ​​the workshop, and compare it with the operation action frequency of the personnel in each production sub-area stored in the system repository. If the action frequency of a certain operator in a certain production sub-area of ​​the workshop corresponding to a certain monitoring time point in the current operation period is consistent with the operation action frequency of the personnel in the production sub-area, then the operation action of the personnel is determined to be standard; otherwise, the operation action of the personnel is determined to be non-standard. Thus, the number of standard action personnel and the number of non-standard action personnel in each monitoring sub-period in the current operation period of each production sub-area of ​​the workshop are statistically obtained, and they are marked as According to the formula Calculate the personnel operation smoothness evaluation index of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period c3 and c4 represent the set weight factors respectively; the distance between adjacent operators is extracted from the operation images of each operator in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and compared with the set reference distance interval of the personnel operation in each production sub-area; if the distance between adjacent operators in a production sub-area of ​​the workshop corresponding to a certain monitoring time point in the current operation period is within the set reference distance interval of the personnel operation in the production sub-area, then it is determined that the distance between the adjacent operators meets the requirements; otherwise, it is determined that the distance between the adjacent operators does not meet the requirements; thus, the number of adjacent operators whose distances meet the requirements and the number of adjacent operators whose distances do not meet the requirements in each production sub-area of ​​the workshop corresponding to each monitoring sub-period in the current operation period are statistically obtained, and they are marked as

[0069] According to the formula Calculate the personnel concentration evaluation index of each production sub-area in the workshop corresponding to each monitoring sub-period in the current operation period c5 and c6 represent the set weight factors respectively;

[0070] According to the formula Calculate the personnel operation standard evaluation coefficient of each production sub-area of ​​the workshop corresponding to each monitoring sub-period in the current operation period d1 and d2 represent the set evaluation factors respectively.

[0071] In a specific implementation, the present invention monitors and analyzes the personnel operations in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and superimposes the personnel operation data of each monitoring sub-period in the current operation period corresponding to each production sub-area in real time on the three-dimensional model of the workshop, so as to understand and grasp the personnel operation situation more intuitively and quickly to a certain extent, so as to make decisions and adjustments more effectively. At the same time, through early warning analysis, the safety protection level of the operating personnel can be effectively improved, and the risk of safety accidents caused by improper protection can be reduced; the standardization and normalization of operations can be promoted, and the production efficiency and the stability of product quality can be improved; the personnel layout can be reasonably optimized to avoid excessive density or dispersion of personnel, improve work coordination efficiency, and reduce potential safety hazards and production obstacles; irregular behaviors in operations can be discovered and corrected in a timely manner, potential production accidents and safety risks can be prevented, and the smooth progress of workshop production can be ensured.

[0072] A workshop 3D model building module is used to build a 3D model of the layout of each production sub-area of ​​the workshop to obtain a 3D model of each production sub-area of ​​the workshop; wherein the 3D model building is carried out through a specified modeling tool;

[0073] The augmented reality fusion display module is used to superimpose the real-time data of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period on the three-dimensional model in an intuitive way for display through digital augmented reality technology;

[0074] The monitoring analysis and early warning feedback module is used to analyze the production progress evaluation coefficient, product quality evaluation coefficient, and personnel operation standard evaluation coefficient of each monitoring sub-period in the current operation period of each production sub-area of ​​the workshop. The specific analysis method is as follows: According to the formula Calculate the comprehensive production progress evaluation coefficient α of each production sub-area corresponding to the current operation period i ;

[0075] According to the formula Calculate the comprehensive product quality assessment coefficient β of each production sub-area corresponding to the current operation period i ;

[0076] According to the formula Calculate the comprehensive personnel operation standard evaluation coefficient γ for each production sub-area corresponding to the current operation period i ; Compare the comprehensive production progress assessment coefficient of each production sub-area of ​​the workshop corresponding to the current operation period with the set comprehensive production progress assessment coefficient threshold. If the comprehensive production progress assessment coefficient of a production sub-area of ​​the workshop corresponding to the current operation period is less than the set comprehensive production progress assessment coefficient threshold, it is determined that the production progress of the production sub-area of ​​the workshop corresponding to the current operation period is lagging, and a production progress lag signal is generated and sent to the early warning terminal;

[0077] Compare the comprehensive product quality assessment coefficient of each production sub-area of ​​the workshop corresponding to the current operation period with the set comprehensive product quality assessment coefficient threshold. If the comprehensive product quality assessment coefficient of a production sub-area of ​​the workshop corresponding to the current operation period is less than the set comprehensive product quality assessment coefficient threshold, it is determined that the product quality of the production sub-area of ​​the workshop corresponding to the current operation period does not meet the standard, and a product quality non-standard signal is generated and sent to the early warning terminal;

[0078] The comprehensive personnel operation standard evaluation coefficient of each production sub-area of ​​the workshop corresponding to the current operation period is compared with the set comprehensive personnel operation standard evaluation coefficient threshold. If the comprehensive personnel operation standard evaluation coefficient of a production sub-area of ​​the workshop corresponding to the current operation period is less than the set comprehensive personnel operation standard evaluation coefficient threshold, it is determined that the personnel operation of the production sub-area of ​​the workshop corresponding to the current operation period is not standardized, and a personnel operation non-standard signal is generated and sent to the early warning terminal;

[0079] The abnormal signals of each production sub-area of ​​the workshop corresponding to the current operation period are jointly constituted by the production progress delay signal, product quality substandard signal and personnel operation irregularity signal.

[0080] The early warning terminal is used to receive abnormal signals corresponding to the current operation period of each production sub-area of ​​the workshop and perform corresponding processing; in a specific embodiment, if the abnormal signal corresponding to the current operation period of a production sub-area of ​​the workshop is a production progress lag signal, a red warning light alarm is issued through the alarm in the early warning terminal, and personnel are arranged to execute the production progress;

[0081] If the abnormal signal of a production sub-area in the workshop corresponding to the current operation period is a signal that the product quality does not meet the standard, the alarm in the early warning terminal will sound a yellow warning light alarm, and personnel will be arranged to carry out product quality execution processing;

[0082] If the abnormal signal corresponding to the current operation period in a production sub-area of ​​the workshop is a signal of irregular operation of personnel, the blue warning light will be alarmed through the alarm in the early warning terminal, and personnel will be arranged to execute the personnel operation.

[0083] The database is used to store the estimated output of each production sub-area of ​​the workshop on the corresponding monitoring day, store the various sizes of qualified products, and store the frequency of personnel operation in each production sub-area.

[0084] The specific sizes of the impact factors, weight factors, correction factors, exponential factors and evaluation factors involved in this application are not given. Their sizes are customized by technical personnel in this field according to actual use and stored in the database; and the formulas involved are all customized empirical formulas, which are pre-stored in the database.

[0085] The above contents are merely examples and explanations of the structure of the present invention. The technicians in this technical field may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the structure of the invention or exceed the scope defined by the claims, they should all fall within the protection scope of the present invention.

Claims

1. A digital augmented reality workshop visualization monitoring system, characterized in that: include: The preprocessing module is used to obtain the production area and current operation period of the workshop, and divide the production area of ​​the workshop in an evenly set spatial layout to obtain the production sub-areas of the workshop, and divide the current operation period in an evenly set time period to obtain the monitoring sub-periods in the current operation period; The regional production progress monitoring module is used to obtain the production processes corresponding to each production sub-area of ​​the workshop, and monitor and analyze each production process of each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and obtain the production progress evaluation coefficient of each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop; The regional product quality monitoring module is used to monitor and analyze the quality of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and obtain the product quality evaluation coefficient of each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop; The regional personnel operation monitoring module is used to monitor and analyze the personnel operations in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and obtain the personnel operation standard evaluation coefficient in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop; The workshop 3D model building module is used to build a 3D model of the layout of each production sub-area of ​​the workshop to obtain a 3D model of each production sub-area of ​​the workshop; The augmented reality fusion display module is used to superimpose the real-time data of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period on the three-dimensional model in an intuitive way for display through digital augmented reality technology; The monitoring analysis and early warning feedback module is used to analyze the production progress evaluation coefficient, product quality evaluation coefficient, and personnel operation specification evaluation coefficient of each monitoring sub-period in the current operation period of each production sub-area of ​​the workshop, and obtain the abnormal signal of each production sub-area of ​​the workshop corresponding to the current operation period; The early warning terminal is used to receive abnormal signals corresponding to the current operation period of each production sub-area of ​​the workshop and perform corresponding processing; The database is used to store the estimated output of each production sub-area of ​​the workshop on the corresponding monitoring day, store the various sizes of qualified products, and store the frequency of personnel operation in each production sub-area.

2. A digital augmented reality workshop visualization monitoring system according to claim 1, characterized in that: The specific steps of monitoring and analyzing each production process of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period are as follows: Through the camera, each circulating product of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop is monitored to obtain the image of each circulating product of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and the image of each circulating product of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop is matched with the image of the finished product of each production process. If the image of a circulating product of a production process matches the image of the finished product of the production process, the circulating product is recorded as a qualified product. Otherwise, the circulating product is recorded as a semi-finished product. Thus, the number of qualified products and the number of semi-finished products of each production process in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are statistically obtained and marked as respectively. i represents the number of each production sub-area, i=1,2,....,m, m represents the total number of production sub-area numbers, j represents the number of each monitoring sub-period, j=1,2,....,n, n represents the total number of monitoring sub-period numbers, f represents the number of each production process, f=1,2,....,g, g represents the total number of production process numbers; The number of circulating products of each production process in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop is monitored by cameras and counters, and the number of circulating products of each production process in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop is obtained, which is recorded as Extract the estimated production of each production sub-area of ​​the workshop on the corresponding monitoring day from the database, obtain the actual time period of the current operation period, and match the actual time period of the current operation period with the estimated production impact value corresponding to each set actual time period to obtain the estimated production impact value of the current operation period; Divide the estimated output of each production sub-area of ​​the workshop on the corresponding monitoring day by the data of the actual time period on the actual monitoring day to obtain the estimated output of each production sub-area of ​​the workshop on the corresponding monitoring day; The estimated output of each production sub-area in the workshop for each actual period of the monitoring day is subtracted from the estimated output impact value of the current operation period to obtain the estimated output of each production sub-area in the workshop for the current operation period; The estimated output of each production sub-area of ​​the workshop corresponding to the current operation period is calculated by dividing the data of the actual monitoring sub-period in the current operation period, and the estimated output of each production sub-area of ​​the workshop corresponding to each monitoring sub-period in the current operation period is obtained, which is recorded as Get the actual output of each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period, recorded as According to the formula Calculate the production progress evaluation coefficient of each monitoring sub-period in the current operation period for each production sub-area of ​​the workshop a1, a2, and a3 represent the set impact factors respectively.

3. A digital augmented reality workshop visualization monitoring system according to claim 1, characterized in that: The specific steps of monitoring and analyzing the quality of each product in each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period are as follows: The apparent images of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are collected by the camera to obtain the apparent images of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop; The number of damaged parts and scratches of each product is extracted from the apparent image of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop, and the area of ​​each damaged part and the depth of each scratch of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are extracted from it. The area of ​​each damaged part and the depth of each scratch corresponding to each product are accumulated to obtain the total damaged area and total scratch depth of each product in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop. Through comprehensive analysis, the product integrity index of each production area in the workshop corresponding to each monitoring sub-period in the current operation period is obtained. The dimensions of each product are extracted from the apparent images of each product in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and the dimensions of each qualified product are extracted from the database. Through comprehensive analysis, the product size matching index of each monitoring sub-period in each production area of ​​the workshop corresponding to the current operation period is obtained. According to the formula Calculate the product quality assessment coefficient of each production area in the workshop corresponding to each monitoring sub-period in the current operation period b5 and b6 represent the set exponential factors respectively.

4. The digital augmented reality workshop visualization monitoring system according to claim 1 is characterized in that: The specific steps of monitoring and analyzing the personnel operations in each monitoring sub-period in each production sub-area of ​​the workshop corresponding to the current operation period are as follows: The operation images of each operator in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop are collected by an intelligent high-definition camera to obtain the operation images of each operator in each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop; The protective equipment wearing images of each operator are extracted from the operation images of each operator in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and compared with the set protective equipment wearing images. If the protective equipment wearing image of a certain operator is consistent with the set protective equipment wearing image, it is determined that the operator is wearing the protective equipment correctly. Otherwise, it is determined that the operator is wearing the protective equipment abnormally. Thus, the number of personnel wearing protective equipment correctly and the number of personnel wearing protective equipment abnormally in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop are obtained by statistics. Through comprehensive analysis, the personnel operation safety protection evaluation index of each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop is obtained. The action frequency of each operator is extracted from the operation image of each operator in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and compared with the operation action frequency of the personnel in each production sub-area stored in the database. If the action frequency of a certain operator in a certain production sub-area of ​​the workshop at a certain monitoring time point in the current operation period is consistent with the operation action frequency of the personnel in the production sub-area, the operation action of the personnel is determined to be standard. Otherwise, the operation action of the personnel is determined to be non-standard. Thus, the number of personnel with standard actions and the number of personnel with non-standard actions in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop are obtained by statistics. Through comprehensive analysis, the personnel operation fluency evaluation index of each production sub-area of ​​the workshop corresponding to each monitoring sub-period in the current operation period is obtained. The distance between adjacent operators is extracted from the operation images of operators in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop, and compared with the set reference distance interval of operators in each production sub-area. If the distance between adjacent operators in a production sub-area of ​​the workshop corresponding to a certain monitoring time point in the current operation period is within the set reference distance interval of operators in the production sub-area, then the distance between adjacent operators is determined to be in compliance; otherwise, the distance between adjacent operators is determined to be incompliance. Thus, the number of adjacent operators in each monitoring sub-period in the current operation period in each production sub-area of ​​the workshop that is in compliance and the number of adjacent operators that are incompliance are obtained by statistics. Through comprehensive analysis, the personnel concentration evaluation index of each production sub-area of ​​the workshop corresponding to each monitoring sub-period in the current operation period is obtained. According to the formula Calculate the personnel operation standard evaluation coefficient of each production sub-area in the workshop corresponding to each monitoring sub-period in the current operation period d1 and d2 represent the set evaluation factors respectively.

5. The digital augmented reality workshop visualization monitoring system according to claim 1 is characterized in that: The analysis is based on the production progress evaluation coefficient, product quality evaluation coefficient, and personnel operation standard evaluation coefficient of each monitoring sub-period in the current operation period corresponding to each production sub-area of ​​the workshop. The specific analysis method is as follows: Through analysis, the comprehensive production progress assessment coefficient, comprehensive product quality assessment coefficient, and comprehensive personnel operation standard assessment coefficient of each production sub-area of ​​the workshop corresponding to the current operation period are obtained; The comprehensive production progress evaluation coefficient of each production sub-area of ​​the workshop corresponding to the current operation period is compared with the set comprehensive production progress evaluation coefficient threshold. If the comprehensive production progress evaluation coefficient of a production sub-area of ​​the workshop corresponding to the current operation period is less than the set comprehensive production progress evaluation coefficient threshold, it is determined that the production progress of the production sub-area of ​​the workshop corresponding to the current operation period is lagging, and a production progress lag signal is generated and sent to the early warning terminal; Compare the comprehensive product quality assessment coefficient of each production sub-area of ​​the workshop corresponding to the current operation period with the set comprehensive product quality assessment coefficient threshold. If the comprehensive product quality assessment coefficient of a production sub-area of ​​the workshop corresponding to the current operation period is less than the set comprehensive product quality assessment coefficient threshold, it is determined that the product quality of the production sub-area of ​​the workshop corresponding to the current operation period does not meet the standard, and a product quality non-standard signal is generated and sent to the early warning terminal; The comprehensive personnel operation standard evaluation coefficient of each production sub-area of ​​the workshop corresponding to the current operation period is compared with the set comprehensive personnel operation standard evaluation coefficient threshold. If the comprehensive personnel operation standard evaluation coefficient of a production sub-area of ​​the workshop corresponding to the current operation period is less than the set comprehensive personnel operation standard evaluation coefficient threshold, it is determined that the personnel operation of the production sub-area of ​​the workshop corresponding to the current operation period is not standardized, and a personnel operation non-standard signal is generated and sent to the early warning terminal; The abnormal signals of each production sub-area of ​​the workshop corresponding to the current operation period are jointly constituted by the production progress delay signal, the product quality substandard signal and the personnel operation irregularity signal.

Citation Information

Patent Citations

  • Virtual augmented reality 3D interactive system for factory and implementation method thereof

    CN107172047A

  • Steel hot rolling management and control system and method based on digital twinning

    CN114372341A

  • Intelligent workshop real-time monitoring method based on digital twinning

    CN116414081A

  • Multi-dimensional intelligent factory affair monitoring system based on Internet of Things technology

    CN116843497A

  • Monitoring system based on glass production process

    CN117873009A