Large-screen visualization system for industrial production equipment and intelligent manufacturing environment

Abstract

The invention provides a large-screen visualization system for industrial production equipment and an intelligent manufacturing environment, which is used for creating a large-screen visualization system for the industrial production equipment and the intelligent manufacturing environment, providing a set of specific system architecture design scheme for the large-screen visualization system and introducing application of a three-dimensional visualization engine. The method has the advantages of light weight in the aspect of scheme deployment and convenience and high efficiency in the aspect of application, so that the high-quality data visualization requirement of an industrial production environment can be met.

Description

Technical Field

[0001] The present application relates to the field of intelligent manufacturing, and specifically to a large-screen visualization system for industrial production equipment and intelligent manufacturing environments. Background Art

[0002] In the field of smart factories or smart manufacturing, data visualization has become one of the important means to improve production efficiency.

[0003] Traditional data visualization systems often lack effective binding and real-time update mechanisms for device data, resulting in delayed data display and affecting decision-making efficiency. Faced with massive amounts of data, managers and business personnel at different levels have different focuses on system data. In industrial production environments, real-time monitoring of production data and effective analysis of data are becoming increasingly important. Under traditional software development methods, in order to display real-time or multi-dimensional data on the portal homepage, back-end developers are usually required to modify the code, and front-end engineers are required to adjust the interface style. This process is not only cumbersome, but also accompanied by high time and economic costs.

[0004] In addition, there are currently a variety of reporting and business intelligence (BI) tools on the market that can realize the design of large-screen data visualization, but they often have problems such as complex operation, slow response, and difficult maintenance, which make it difficult to meet the high-efficiency needs of modern industrial production. The shortcomings are: 1. Most existing reporting and BI tools are large in size and not light and flexible enough; 2. The large-screen visualization pages created using these tools often have poor performance, and it is difficult to achieve a fast response of all pages within one second. This is because these pages are usually directly connected to the database and may contain complex logical operations, resulting in slow front-end loading speed; 3. The large-screen visualization pages generated using reporting and BI tools have a low degree of modularity and are difficult to reuse.

[0005] That is to say, in the face of industrial production environments, although there are mature data visualization systems, related reporting tools and BI tools on the market, there is still room for improvement in the implementation effects, and it is difficult to meet the needs of lightweight, convenient and efficient high-quality data visualization. Summary of the invention

[0006] The present application provides a large-screen visualization system for industrial production equipment and intelligent manufacturing environments, which is used to create a large-screen visualization system for industrial production equipment and intelligent manufacturing environments, and provides a specific system architecture design solution for them. It also introduces the application of a three-dimensional visualization engine, which has the advantages of lightweight in terms of solution deployment, and convenient and efficient in application, thereby meeting the high-quality data visualization needs of the industrial production environment.

[0007] In a first aspect, the present application provides a large-screen visualization system for industrial production equipment and intelligent manufacturing environments, wherein the large-screen visualization system for industrial production equipment and intelligent manufacturing environments includes a data source layer, a data processing layer, and a three-dimensional visualization layer;

[0008] The data source layer includes various industrial production equipment deployed on-site in the manufacturing environment, various sensors and databases deployed on various industrial production equipment, which are used to collect and record initial industrial data in real time and transmit the initial industrial data to the data processing layer;

[0009] The data processing layer includes a data receiving module, a data cleaning module and a data conversion module, which are used to clean, convert and pre-process the received initial industrial data, and transmit the processed target industrial data to the three-dimensional visualization layer;

[0010] The three-dimensional visualization layer includes a three-dimensional visualization engine, which is used to load the received target industrial data into the three-dimensional visualization model obtained by the digital twin model created in advance by the physical factory, display it on a large screen, and conduct comprehensive monitoring and analysis in combination with preset key indicators.

[0011] In the second aspect, the present application provides a processing method for a large-screen visualization system for industrial production equipment and an intelligent manufacturing environment. The large-screen visualization system for industrial production equipment and an intelligent manufacturing environment includes a data source layer, a data processing layer, and a three-dimensional visualization layer. The data source layer includes various industrial production equipment deployed on-site in the manufacturing environment, various sensors and databases deployed on various industrial production equipment, the data processing layer includes a data receiving module, a data cleaning module, and a data conversion module. The three-dimensional visualization layer includes a three-dimensional visualization engine. The processing method for a large-screen visualization system for industrial production equipment and an intelligent manufacturing environment includes:

[0012] The data source layer collects and records the initial industrial data in real time and transmits the initial industrial data to the data processing layer;

[0013] The data processing layer cleans, converts and preprocesses the received initial industrial data, and transmits the processed target industrial data to the 3D visualization layer;

[0014] The three-dimensional visualization layer loads the received target industrial data into the three-dimensional visualization model obtained by the digital twin model created in advance by the physical factory, displays it on a large screen, and conducts comprehensive monitoring and analysis in combination with preset key indicators.

[0015] In a third aspect, the present application provides a computer-readable storage medium, which stores a plurality of instructions, and the instructions are suitable for loading by a processor to execute the method provided in the second aspect of the present application.

[0016] From the above content, it can be concluded that the present application has the following beneficial effects:

[0017] This application creates a large-screen visualization system for industrial production equipment and intelligent manufacturing environments, provides a specific system architecture design solution, and introduces the application of a three-dimensional visualization engine. While it has the advantages of lightweight in solution deployment, it also has the advantages of convenience and efficiency in application, thus meeting the high-quality data visualization needs of industrial production environments. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0019] Figure 1 A schematic diagram of the system architecture of a large-screen visualization system for industrial production equipment and intelligent manufacturing environment in this application;

[0020] Figure 2 This is a schematic diagram of an example of a large-screen visualization system for industrial production equipment and intelligent manufacturing environments in this application;

[0021] Figure 3 This is another example schematic diagram of a large-screen visualization system for industrial production equipment and intelligent manufacturing environments in this application. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0023] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described here can be implemented in an order other than that illustrated or described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or modules is not necessarily limited to those steps or modules clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products or devices. The naming or numbering of steps in this application does not mean that the steps in the method flow must be executed in the time / logical sequence indicated by the naming or numbering. The process steps that have been named or numbered can change the execution order according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved.

[0024] The division of modules in this application is a logical division. There may be other division methods when it is implemented in actual applications. For example, multiple modules can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection between modules can be electrical or other similar forms, which are not limited in this application. In addition, the modules or submodules described as separate components may or may not be physically separated, may or may not be physical modules, or may be distributed in multiple circuit modules, and some or all of the modules may be selected according to actual needs to achieve the purpose of the present application.

[0025] first, Figure 1 A schematic diagram of the system architecture of a large-screen visualization system for industrial production equipment and intelligent manufacturing environment is shown in the present application. Figure 1 It is easy to see that the large-screen visualization system for industrial production equipment and intelligent manufacturing environment provided by the present application can specifically include three major system components, namely, the data source layer, the data processing layer and the three-dimensional visualization layer. For the work of these three parts, the core system workflow shown below can be combined to help understand:

[0026] (1) The data source layer includes various industrial production equipment deployed on-site in the manufacturing environment, various sensors deployed on various industrial production equipment, and databases, which are used to collect and record initial industrial data in real time and transmit the initial industrial data to the data processing layer;

[0027] It can be understood that the main purpose of setting up the data source layer is to collect on-site industrial data for the system. For the convenience of explanation, the industrial data collected by this link or the data source layer is recorded as initial industrial data, which is distinguished from the target industrial data for subsequent processing.

[0028] Among them, the specific number and type of industrial production equipment are obviously adjusted according to the specific manufacturing environment site where the application scheme is deployed. For these devices, corresponding sensors are needed to collect the initial industrial data required by this application. These industrial data are used to indicate the equipment status, working status and environmental status of these devices.

[0029] It is worth noting that the sensors deployed on industrial production equipment referred to here can be directly deployed on the industrial production equipment, or deployed in the surrounding environment of the industrial production equipment. They can also be the original sensors of the industrial production equipment itself or unit modules with built-in sensing functions. These are all possible in actual situations.

[0030] After the sensor collects the initial industrial data, it can be directly transmitted or transmitted through the corresponding equipment / device to the database for storage, and then transmitted by the database or itself to the rear data processing layer for further data processing.

[0031] (2) The data processing layer includes a data receiving module, a data cleaning module and a data conversion module, which are used to clean, convert and pre-process the received initial industrial data and transmit the processed target industrial data to the three-dimensional visualization layer;

[0032] As for the data processing layer, it can be understood that its main purpose is to process the initial industrial data collected by the data source layer into target industrial data for subsequent three-dimensional visualization operations. Therefore, its data processing can also be understood as secondary data processing.

[0033] In the architectural design of the present application, the data processing layer may include a data receiving module responsible for data receiving, a data cleaning module responsible for data cleaning operations, and a data conversion module responsible for data conversion and data preprocessing. The three are processed in sequence and finally output to obtain the target industrial data in a preset data format that is easy to load / carry out three-dimensional display.

[0034] (3) The 3D visualization layer includes a 3D visualization engine, which is used to load the received target industrial data into the 3D visualization model obtained by pre-creating the digital twin model of the physical factory, display it on a large screen, and conduct comprehensive monitoring and analysis in combination with preset key indicators.

[0035] It can be understood that the three-dimensional visualization layer designed in the present application is equipped with the three-dimensional visualization engine preset in the present application, and can also be understood as a three-dimensional visualization platform. It has already used digital twin technology in advance. On the basis of the specific manufacturing environment / physical factory in which the present application solution is deployed, a digital twin model has been created to obtain a three-dimensional visualization model. In this way, through the three-dimensional visualization model, environmental display and indicator display can be carried out, and data can be updated with the target industrial data collected in real time to reflect the real-time situation of the production environment, and combined with the preset key indicators in terms of factory assets, facilities, energy efficiency, security, etc., a good condition foundation is provided for comprehensive monitoring and analysis.

[0036] In terms of specific implementation, this application can design and customize the hardware solution of the three-dimensional visualization layer according to specific application scenarios and requirements. For example, a high-performance graphics processor (Graphics Processing Unit, GPU), multi-screen display controller, touch interaction device, etc. can be used to build a customized large-screen data visualization system. These hardware solutions can provide better performance and user experience.

[0037] In this way, while solving the problems of poor real-time performance, slow response speed, and insufficient flexibility in data display in the existing data visualization system, the complex production data of the production environment can be displayed on the large screen in an intuitive and interactive way, realizing multi-dimensional analysis and comprehensive display, giving full play to the value of the data, and making it convenient for relevant users (or managers) in front of the large screen to conduct real-time monitoring of the production environment and make timely decision analysis.

[0038] In addition, the system of this application realizes seamless connection from data source to end user by integrating modules such as data collection, processing, analysis and visual display, and realizes real-time collection, processing, binding and display of data, thereby effectively improving the response speed of the system and user experience, and opening the large-screen page in seconds to ensure that users can obtain the latest production status information, and then make timely and accurate decisions, greatly improving work efficiency.

[0039] In addition, it should be understood that, in actual situations, in addition to the above three major system components, the large-screen visualization system for industrial production equipment and intelligent manufacturing environments provided by this application may also include other system components, such as power supply layers, etc., which may involve related structures required to maintain the normal operation of the system, as well as related structures for additional system function services. Considering that these are not the focus of this application, this application will not elaborate on these other system components in detail.

[0040] In short, for the above Figure 1Corresponding to the solution content of the implementation example, this application creates a large-screen visualization system for industrial production equipment and intelligent manufacturing environment, provides a specific system architecture design solution for it, and introduces the application of a three-dimensional visualization engine. While it has the advantage of lightweight in solution deployment, it also has the advantages of convenience and efficiency in application, thus meeting the high-quality data visualization needs of the industrial production environment.

[0041] Next, we will further introduce the specific solution settings that can be adopted in practical applications of the large-screen visualization system for industrial production equipment and intelligent manufacturing environments provided in this application.

[0042] For the data source layer, as an exemplary embodiment, the various sensors involved may include different types of sensors such as temperature sensors, pressure sensors, and flow sensors. Of course, the specific sensor types and their quantities can be adjusted according to actual conditions. Here, the focus is on listing some relatively practical sensors.

[0043] In addition, the data source layer can specifically transmit the initial industrial data to the data processing layer based on the pre-established industrial Internet of Things through communication protocols such as the MQTT protocol, OPC UA protocol, or SSL / TLS protocol.

[0044] Among them, Message Queuing Telemetry Transport (MQTT) is a machine-to-machine (M2M) / Internet of Things (IoT) connection protocol, designed as an extremely lightweight publish / subscribe message transmission protocol. It is very useful for remote connections that require a small code footprint and / or where network bandwidth is very valuable. It is designed for constrained devices and low-bandwidth, high-latency or unreliable networks. It is more suitable for the lightweight usage scenarios of this application and serves data transmission, monitoring and control.

[0045] The Open Platform Communications Unified Architecture (OPC UA) communication protocol is used to implement data exchange and communication between devices in industrial automation systems. It provides a standardized, secure, and scalable communication mechanism that enables seamless data exchange and communication between different devices. It is also more suitable for the use scenarios of this application, serving data transmission, monitoring, and control.

[0046] Secure Socket Layer / Transport Layer Security (SSL / TLS) is a protocol that provides secure communications, ensuring confidentiality and integrity during transmission between devices at both ends, while verifying identity. In this way, in terms of the security of the system of the present application, data encryption transmission and access control mechanisms can be supported between the data source layer and the data processing layer to ensure data security and prevent data from being intercepted or tampered with during transmission. User authentication and permission allocation can also be performed to ensure system security and data confidentiality, ensuring that only authorized users can access sensitive data.

[0047] Of course, in practical applications, other types of communication protocols may also be involved, which can be adaptively set according to actual needs.

[0048] In addition, continuing to focus on the three-dimensional visualization layer, as an exemplary embodiment, the three-dimensional visualization model constructed by the three-dimensional visualization layer may include:

[0049] 1. Pre-defined mapping relationships between different types of industrial data sources and standardized API interfaces of different visualization components. The visualization components that are not passed include text boxes, charts, and graphics;

[0050] It can be understood that it is necessary to define a clear mapping relationship between data sources and visualization components (which may involve data types, data ranges, display formats, etc.), and establish corresponding data mapping tables or rules. In this way, in real-time application processes, the data fields of the data processing layer can be matched one-to-one with the visualization components / elements (such as text boxes, charts, graphics, etc.) in the three-dimensional visualization model, thereby promoting efficient and convenient data update effects.

[0051] For example, data from a sensor can be bound to a specific dashboard component.

[0052] Thus, in terms of the real-time performance of the system of the present application, it can be seen from the settings here that the present application helps to ensure the accuracy and timeliness of the data through real-time binding and dynamic updating of data, and can simultaneously process data streams from multiple data sources, maintaining the real-time performance of data display even in the case of huge amounts of data.

[0053] In addition, it can also be seen here that in terms of the scalability of the system of the present application, the system of the present application adopts a modular design (not only involving the visualization components here, but also the communication between other system components and the communication between different modules belonging to the same system components). The functional modules can communicate through standardized API interfaces. In actual applications, this is easy to expand and maintain, so that the system can flexibly add, remove, update or maintain corresponding functional modules according to needs.

[0054] 2. Introduce a cache mechanism during data mapping;

[0055] It can be understood that the setting of the cache mechanism helps to avoid frequent data requests and optimize performance, while optimizing the data binding and rendering process to ensure smooth operation in high data volumes and complex scenarios.

[0056] 3. Use event-driven mechanism or polling mechanism to update data;

[0057] It can be understood that an event-driven mechanism or a polling mechanism is used to implement dynamic data update logic through a corresponding scripting language (such as C#) to ensure that data changes at the data source layer can ultimately be reflected in the 3D visualization model in real time and its visualization components can be updated instantly.

[0058] 4. Set up exception handling logic.

[0059] It can be understood that the 3D visualization model sets or implements exception handling logic / rules / strategies, which helps ensure that the system can still operate stably in the event of network delays or data loss.

[0060] Furthermore, as an exemplary embodiment, the visualization interface of the three-dimensional visualization model can be specifically set through a variety of data visualization interfaces such as a dashboard, a line chart, a bar chart and a heat map to display corresponding numerical data, image data or video data.

[0061] In specific operations, one or more visualization interfaces are displayed based on the graphics rendering capabilities of the three-dimensional visualization engine in combination with corresponding user interface (UI) designs, and the data inputs or data variables involved in these visualization interfaces may involve data of types such as numerical data, image data, or video data. At the same time, in the visualization interface, they may also be reflected in the form of numerical data, image data, or video data.

[0062] In this way, in terms of the flexibility of the system of the present application, users can customize data views according to their needs. It not only supports common numerical data, but can also process various types of data such as images and videos, and provides rich data display methods, which helps to improve the convenience of system use and user experience in terms of user sensory aspects.

[0063] In addition, as an exemplary embodiment, the visualization interface of the three-dimensional visualization model can be specifically configured with interactive functions / capabilities, and through screen touch operations (meaning that the device itself has a touch screen) or operation instructions entered by an input device (other devices such as a touch screen, mouse, keyboard, or voice outside the device), viewing operations, filtering operations, or zooming operations and other operations can be performed on the visualization components in the visualization interface to meet business needs of switching views and viewing data of different dimensions.

[0064] It can be understood that under the settings here, the present application also specifically designs a user-friendly interactive interface for the three-dimensional visualization layer or the three-dimensional visualization model, so that in actual applications, it can support users to obtain the required visualization information through operations such as viewing, filtering or zooming, and the three-dimensional visualization model can capture the user input content through its corresponding input management system, and update the specific data display in real time according to the captured specific user operations.

[0065] In addition, reference Figure 2 and Figure 3 The example schematic diagrams of the large-screen visualization system of the present application for industrial production equipment and intelligent manufacturing environment respectively show a specific manufacturing environment site to which the present application scheme is applicable.

[0066] Specifically, as an exemplary embodiment, the present application can be directed to a specific manufacturing environment site (corresponding to the operation area of ​​the quality inspection center of a steel plant) Figure 2 On this basis, the visualization interface of the 3D visualization model can specifically include a virtual factory environment image area, a processing information area corresponding to different processing lines, a full-month statistics area corresponding to different operators, an alarm information area corresponding to different equipment alarms, an area corresponding to the processing volume statistics for each day of a week, and a process statistics area corresponding to different process outputs. The different processes specifically involve stretching, bending, impact, hardness, metallography, magnetic measurement, hole expansion, drop hammer, fracturing and sample preparation.

[0067] Among them, from Figure 2 It can be seen that in the operating area of ​​the quality inspection center of the steel plant, specific industrial production equipment may be involved, such as measuring table, loading hopper line scanning, loading robot, waste hopper, scanning marking, sorting platform, sorting robot, transfer platform, sorting trolley, machining center, laser marking, material frame and tensile testing machine.

[0068] from Figure 3 It can be seen that, under the user-friendly interactive interface design, the virtual factory environment image area is located in the upper middle position of the overall interface, the processing information area is located in the lower left position of the overall interface, the monthly statistics area is located in the lower position of the overall interface next to the processing information area, the alarm information area is located in the lower position of the overall interface next to the monthly statistics area, the processing volume statistics area is located in the lower position of the overall interface next to the alarm information area, that is, in the lower right position of the overall interface, and the process statistics areas are respectively located in the upper middle position on the left side and the upper middle position on the right side of the overall interface.

[0069] For a series of areas other than the virtual factory environment image area, they are usually represented by numerical variables (mainly output), and additional variables such as corresponding time can also be identified.

[0070] It can be understood that the embodiment here is the visualization interface setting involved in the present application scheme, focusing on the specific manufacturing environment of the operation area of ​​the quality inspection center of the steel plant, and providing a set of specific friendly interface design solutions. It has better adaptability to the specific application scenario, and takes into account both the visualization display effect and the visualization operation effect, so it has better practical significance.

[0071] In addition, as an exemplary embodiment, for the large-screen visualization system of industrial production equipment and intelligent manufacturing environment, a cross-platform application framework can be used to create the application programs involved.

[0072] It can be understood that in terms of cross-platform support of the system of the present application, the system can specifically support multiple operating system platforms such as Windows, Linux, macOS and mobile devices (smartphones, tablets, laptops, personal digital assistants (PDA), etc.), and can also be compatible with various industrial equipment to provide a unified development and deployment environment.

[0073] The cross-platform application framework adopted can specifically adopt Electron, Flutter and other cross-platform application development frameworks, allowing the developers of the system of this application to use Web technologies (such as HTML, CSS, JavaScript, etc.) or languages ​​​​such as Dart to build specific cross-platform applications of this application. These frameworks can generate applications that run on Windows, macOS, Linux and mobile devices, meeting the application requirements of data visualization solutions supported by multiple platforms.

[0074] In addition, as an exemplary embodiment, the visualization interface of the three-dimensional visualization engine of the present application is specifically configured based on the Unity product, Unreal Engine product or CryEngine product, in combination with Tableau product, Power BI product, QlikView product, ECharts product, Highcharts product or D3.js product.

[0075] Three-dimensional visualization engines such as Unity products, Unreal Engine products and CryEngine products have high-performance rendering capabilities, rich component libraries and flexible interactive design functions, which can meet the complex data visualization needs of this application.

[0076] Business intelligence tools such as Tableau products, Power BI products, and QlikView products can provide powerful data visualization capabilities, support custom dashboards, interactive charts, and real-time data updates. These tools have easy-to-use interfaces and rich component libraries, which can quickly build complex data visualization projects.

[0077] Open source JavaScript libraries such as ECharts, Highcharts, and D3.js can create rich data visualization effects on web pages. These libraries provide flexible APIs and a large number of chart types, and are suitable for building visualization solutions based on web services.

[0078] In addition, in specific software development work, you can use Java (in conjunction with Swing, JavaFX, etc.), C# (using WPF, WinForms, etc.) or other programming languages ​​and frameworks that support graphical interface development to build a visual interface or visualization system, which has higher customizability and flexibility.

[0079] In addition, for the 3D visualization layer, or the 3D visualization model / system, cloud services such as Amazon Web Services, Microsoft Azure, Google Cloud Platform, etc. can be used to build and deploy specific application services. These cloud services provide rich data storage, computing, and analysis resources, easy-to-integrate visualization tools, and API interfaces.

[0080] In addition, you can also choose to use Software as a Service (SaaS) solutions, such as online data analysis platforms such as Looker and Mode Analytics. These services provide comprehensive data visualization capabilities and support multiple data sources and customized dashboards.

[0081] In addition, as an exemplary embodiment, for the three-dimensional visualization layer and the data processing layer, the former belongs to the front end and the latter belongs to the back end. In this regard, the present application can also be designed for a solution that separates data processing and visualization, specifically using Python (Pandas, NumPy and other libraries), R language or other data analysis tools for back-end data processing and cleaning. The processed data can be sent to the front-end visualization system through API interface, database query or file transfer.

[0082] In addition, in terms of real-time data stream processing, you can also use message queue systems such as Apache Kafka and RabbitMQ, or use real-time data processing frameworks such as Apache Flink or Spark Streaming to process real-time data streams. These real-time data stream mechanisms can handle high-concurrency data streams and push the processing results to the front-end visualization system in real time for visualization processing.

[0083] In addition, in actual situations, the above-mentioned series of solutions can be combined according to actual needs to form a hybrid solution. For example, Unity can be used as the main visualization engine, and WebGL technology can be combined to achieve Web display; or native development technology can be used to process core data, and the Unity engine can be used for front-end display.

[0084] The above is an introduction to the large-screen visualization system for industrial production equipment and intelligent manufacturing environment provided by the present application. Correspondingly, the present application also provides a processing method for the large-screen visualization system for industrial production equipment and intelligent manufacturing environment. The large-screen visualization system for industrial production equipment and intelligent manufacturing environment is applied to the large-screen visualization system for industrial production equipment and intelligent manufacturing environment. The large-screen visualization system for industrial production equipment and intelligent manufacturing environment includes a data source layer, a data processing layer and a three-dimensional visualization layer. The data source layer includes various industrial production equipment deployed on-site in the manufacturing environment, various sensors and databases deployed on various industrial production equipment, the data processing layer includes a data receiving module, a data cleaning module and a data conversion module, and the three-dimensional visualization layer includes a three-dimensional visualization engine. On this basis, the processing method for the large-screen visualization system for industrial production equipment and intelligent manufacturing environment includes the following steps:

[0085] 1) The data source layer collects and records the initial industrial data in real time and transmits the initial industrial data to the data processing layer;

[0086] 2) The data processing layer cleans, converts and preprocesses the received initial industrial data, and transmits the processed target industrial data to the 3D visualization layer;

[0087] 3) The three-dimensional visualization layer loads the received target industrial data into the three-dimensional visualization model obtained by the digital twin model created in advance by the physical factory, displays it on a large screen, and conducts comprehensive monitoring and analysis in combination with preset key indicators.

[0088] As an exemplary embodiment, the various sensors include a temperature sensor, a pressure sensor, and a flow sensor;

[0089] The data source layer transmits the initial industrial data to the data processing layer through the MQTT protocol, OPC UA protocol or SSL / TLS protocol based on the pre-established industrial Internet of Things.

[0090] As another exemplary embodiment, for a three-dimensional visualization model, there are:

[0091] The mapping relationship between different types of industrial data sources and standardized API interfaces of different visualization components is pre-defined. The visualization components that are not passed include text boxes, charts, and graphics;

[0092] In the data mapping process, a cache mechanism is introduced;

[0093] Use event-driven mechanism or polling mechanism to update data;

[0094] Set up exception handling logic.

[0095] As another exemplary embodiment, the visualization interface of the three-dimensional visualization model is specifically configured through a dashboard, a line chart, a bar chart, and a heat map to display corresponding numerical data, image data, or video data.

[0096] As another exemplary embodiment, the visualization interface of the three-dimensional visualization model is configured with an interactive function, which performs viewing operations, filtering operations or zooming operations on the visualization components in the visualization interface through screen touch operations or operation instructions entered by an input device to meet business needs of switching views and viewing data of different dimensions.

[0097] As another exemplary embodiment, for the specific manufacturing environment site of the quality inspection center operation area of ​​a steel plant, the visualization interface of the three-dimensional visualization model includes a virtual factory environment image area, processing information areas corresponding to different processing lines, a full-month statistics area corresponding to different operators, an alarm information area corresponding to different equipment alarms, a processing volume statistics area corresponding to each day of a week, and a process statistics area corresponding to different process outputs. The different processes specifically involve stretching, bending, impact, hardness, metallography, magnetic measurement, hole expansion, drop hammer, fracturing and sample preparation.

[0098] As another exemplary embodiment, the visualization interface of the three-dimensional visualization engine is configured based on Unity products, Unreal Engine products or CryEngine products, in combination with Tableau products, Power BI products, QlikView products, ECharts products, Highcharts products or D3.js products.

[0099] As another exemplary embodiment, a cross-platform application framework is specifically used to create the application programs involved in a large-screen visualization system for industrial production equipment and intelligent manufacturing environments.

[0100] The technicians in the related field can clearly understand that for the convenience and simplicity of description, the specific working process of the processing method for the large-screen visualization system of industrial production equipment and intelligent manufacturing environment described above can refer to the following. Figure 1 The description of the large-screen visualization system for industrial production equipment and intelligent manufacturing environment in the corresponding embodiments will not be repeated here.

[0101] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0102] To this end, the present application provides a computer-readable storage medium, which stores multiple instructions, which can be loaded by a processor to execute the steps of the processing method of the present application for a large-screen visualization system for industrial production equipment and an intelligent manufacturing environment. For specific operations, please refer to the description of the processing method for a large-screen visualization system for industrial production equipment and an intelligent manufacturing environment, which will not be repeated here.

[0103] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0104] Since the instructions stored in the computer-readable storage medium can execute the steps of the processing method of the large-screen visualization system for industrial production equipment and intelligent manufacturing environment of the present application, the beneficial effects that can be achieved by the processing method of the large-screen visualization system for industrial production equipment and intelligent manufacturing environment of the present application can be achieved. Please see the previous description for details and will not be repeated here.

[0105] The large-screen visualization system for industrial production equipment and intelligent manufacturing environment, the processing method for the large-screen visualization system for industrial production equipment and intelligent manufacturing environment, and the computer-readable storage medium provided by this application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method of this application and its core idea; at the same time, for technical personnel in this field, according to the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on this application.

Claims

1. A large-screen visualization system for industrial production equipment and intelligent manufacturing environments, characterized in that: The large-screen visualization system for industrial production equipment and intelligent manufacturing environment includes a data source layer, a data processing layer and a three-dimensional visualization layer; The data source layer includes various industrial production equipment deployed on-site in the manufacturing environment, various sensors and databases deployed on the various industrial production equipment, which are used to collect and record initial industrial data in real time and transmit the initial industrial data to the data processing layer; The data processing layer includes a data receiving module, a data cleaning module and a data conversion module, which are used to clean, convert and pre-process the received initial industrial data, and transmit the processed target industrial data to the three-dimensional visualization layer; The three-dimensional visualization layer includes a three-dimensional visualization engine, which is used to load the received target industrial data into a three-dimensional visualization model obtained by a digital twin model pre-created by a physical factory, display it on a large screen, and conduct comprehensive monitoring and analysis in combination with preset key indicators.

2. The large-screen visualization system for industrial production equipment and intelligent manufacturing environment according to claim 1 is characterized in that: The various sensors include temperature sensors, pressure sensors and flow sensors; The data source layer specifically transmits the initial industrial data to the data processing layer through the MQTT protocol, the OPC UA protocol or the SSL / TLS protocol based on the pre-established industrial Internet of Things.

3. The large-screen visualization system for industrial production equipment and intelligent manufacturing environment according to claim 1 is characterized in that: For the three-dimensional visualization model, there are: A mapping relationship between different types of industrial data sources and standardized API interfaces of different visualization components is predefined, and the visualization components that are not passed include text boxes, charts, and graphics; In the data mapping process, a cache mechanism is introduced; Use event-driven mechanism or polling mechanism to update data; Set up exception handling logic.

4. The large-screen visualization system for industrial production equipment and intelligent manufacturing environment according to claim 1 is characterized in that: The visualization interface of the three-dimensional visualization model is specifically set up through a dashboard, a line chart, a bar chart and a heat map to display corresponding numerical data, image data or video data.

5. The large-screen visualization system for industrial production equipment and intelligent manufacturing environment according to claim 4 is characterized in that: The visualization interface of the three-dimensional visualization model is configured with an interactive function. Through screen touch operations or operation instructions entered by an input device, viewing operations, filtering operations or zooming operations are performed on the visualization components in the visualization interface to meet business needs of switching views and viewing data of different dimensions.

6. The large-screen visualization system for industrial production equipment and intelligent manufacturing environment according to claim 5 is characterized in that: For the specific manufacturing environment of the quality inspection center of the steel plant, the various industrial production equipment include measuring table, loading hopper line scanning, loading robot, waste hopper, scanning marking, sorting platform, sorting robot, transfer platform, sorting trolley, machining center, laser marking, material frame and tensile testing machine; The visualization interface of the three-dimensional visualization model includes a virtual factory environment image area, a processing information area corresponding to different processing lines, a full-month statistics area corresponding to different operators, an alarm information area corresponding to different equipment alarms, a processing volume statistics area corresponding to each day of a week, and a process statistics area corresponding to different process outputs. The different processes specifically involve stretching, bending, impact, hardness, metallography, magnetic measurement, hole expansion, drop hammer, fracturing and sample preparation.

7. The large-screen visualization system for industrial production equipment and intelligent manufacturing environment according to claim 5 is characterized in that: The visualization interface of the three-dimensional visualization engine is specifically configured based on the Unity product, the Unreal Engine product or the CryEngine product, in combination with the Tableau product, the Power BI product, the QlikView product, the ECharts product, the Highcharts product or the D3.js product.

8. The large-screen visualization system for industrial production equipment and intelligent manufacturing environment according to claim 1 is characterized in that: The large-screen visualization system for industrial production equipment and intelligent manufacturing environments specifically uses a cross-platform application framework to create the applications involved.

9. A processing method for a large-screen visualization system for industrial production equipment and intelligent manufacturing environments, characterized in that: The large-screen visualization system for industrial production equipment and intelligent manufacturing environment includes a data source layer, a data processing layer and a three-dimensional visualization layer. The data source layer includes various industrial production equipment deployed on-site in the manufacturing environment, various sensors and databases deployed on the various industrial production equipment, the data processing layer includes a data receiving module, a data cleaning module and a data conversion module, the three-dimensional visualization layer includes a three-dimensional visualization engine, and the processing method of the large-screen visualization system for industrial production equipment and intelligent manufacturing environment includes: The data source layer collects and records initial industrial data in real time, and transmits the initial industrial data to the data processing layer; The data processing layer cleans, converts and pre-processes the received initial industrial data, and transmits the processed target industrial data to the three-dimensional visualization layer; The three-dimensional visualization layer loads the received target industrial data into the three-dimensional visualization model obtained by the digital twin model created in advance by the physical factory, displays it on a large screen, and conducts comprehensive monitoring and analysis in combination with preset key indicators.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor to execute the method of claim 9.

Images