Equipment manufacturing state monitoring system and method

Abstract

The invention discloses an equipment manufacturing state monitoring system and method, and relates to the technical field of industrial manufacturing monitoring. The mobile camera device is deployed based on the manufacturing process of the target device, the video data of the corresponding process of the deployed site is collected through the mobile camera device, the video data uploaded by the mobile camera device is received through the monitoring management platform, and the incidence relation between the video data and the manufacturing process is established according to the binding relation. And displaying the manufacturing explosion diagram of the target equipment to a manufacturing supervisor through the display terminal based on the manufacturing process of the target equipment, associating corresponding video data at each node of the manufacturing explosion diagram according to the association relationship, and correspondingly displaying the video data. According to the invention, whole-process visualization, process accurate tracing and remote real-time interaction of the equipment manufacturing process are realized, the problems of information isolated island, insufficient visualization depth, tracing difficulty and the like in a traditional manufacturing supervision mode are effectively solved, and the quality management and control efficiency and transparency of equipment manufacturing are remarkably improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of industrial manufacturing monitoring, in particular to a device manufacturing state monitoring system and method. BACKGROUND

[0002] Currently, in the field of high-end equipment manufacturing such as nuclear power, aerospace, heavy machinery, the device manufacturing process is complex, the process is numerous, and the quality requirement is strict. The traditional device manufacturing state supervision mode mainly relies on the supervision personnel to regularly go to the manufacturing plant for on-site inspection, communicate the progress through telephone or email, and record based on paper or discrete electronic documents.

[0003] Although there are some industrial video monitoring schemes in the prior art, they mostly focus on the safety monitoring of fixed points, or only realize simple video stream viewing, and cannot meet the advanced needs of process transparency, traceability and remote collaboration of high-end equipment manufacturing. SUMMARY

[0004] Therefore, it is necessary to provide a device manufacturing state monitoring system and method in view of the above technical problems.

[0005] The present application adopts the following technical solutions: The present application provides a device manufacturing state monitoring system, comprising: a plurality of mobile camera devices, a monitoring management platform and a display terminal; Each mobile camera device is deployed at a corresponding site of a different manufacturing process of a target device, and the mobile camera device is used to collect video data of the corresponding process at the deployed site; The monitoring management platform is used to obtain the manufacturing process of the target device, and when the manufacturing process has an existing binding relationship with the mobile camera device, the existing binding relationship of the manufacturing process is obtained; when the manufacturing process does not have a binding relationship, display information for prompting the binding is displayed to the supervision personnel, and the binding relationship between the mobile camera device and the manufacturing process is established in response to the operation instruction of the supervision personnel; and is also used to receive the video data uploaded by the mobile camera device and establish the association relationship between the video data and the manufacturing process according to the binding relationship; The display terminal is used to display the manufacturing explosion diagram of the target device to the supervision personnel based on the manufacturing process of the target device, and each node of the manufacturing explosion diagram is associated with the corresponding video data according to the association relationship, so as to display the associated video data in response to the operation instruction of the supervision personnel; each node of the manufacturing explosion diagram corresponds to a manufacturing process.

[0006] Optionally, the mobile camera device is at least one of a 5G mobile camera, a 5G law enforcement recorder and a 5G handheld video terminal; The mobile camera equipment accesses the monitoring management platform through the built-in 5G module, and uploads the collected video data to the monitoring management platform in an encrypted manner.

[0007] Optionally, the monitoring management platform comprises a video storage server, a video decoding server, an interface service module and a dynamic process binding module. The video storage server is configured to store audio and video data in a distributed storage architecture for long-term and temporary storage. The video decoding server supports multiple streaming media protocols and is configured to decode video data. The interface service module is configured to exchange data with the manufacturing execution system of the equipment, and obtain the manufacturing process of the target equipment from the manufacturing execution system. The dynamic process binding module is configured to obtain an existing binding relationship of the manufacturing process or establish a binding relationship between the mobile camera equipment and the manufacturing process, and obtain a mapping relationship table comprising an equipment ID, a manufacturing process ID and a timestamp.

[0008] Optionally, the monitoring management platform is further configured to add / change a process state label for the video data according to the binding relationship and the real-time process state. The process state label comprises "in progress" indicating that the corresponding manufacturing process is being performed, and "completed" indicating that the corresponding manufacturing process has been performed. When the process state label of the video data is "in progress", the display terminal associates the video data collected by the mobile camera equipment bound to the manufacturing process in real time through the node of the manufacturing explosion diagram corresponding to the manufacturing process. When the process state label of the video data is "completed", the display terminal associates the video data collected by the mobile camera equipment bound to the manufacturing process historically through the node of the manufacturing explosion diagram corresponding to the manufacturing process.

[0009] Optionally, the monitoring management platform is further configured to associate the video data collected and not associated with any manufacturing process with the corresponding manufacturing process through rule matching or in response to an operation instruction of the inspector.

[0010] Optionally, a plurality of mobile camera equipment is deployed at each manufacturing process. The monitoring management platform is configured to display all available mobile camera equipment deployed at the manufacturing process to the inspector, and display display information prompting binding for the manufacturing process without a binding relationship. The available mobile equipment excludes mobile camera equipment in a maintenance or scrap state from all mobile camera equipment deployed at the manufacturing process.

[0011] The application provides a device manufacturing state monitoring device, comprising: Video data of corresponding procedures of a deployed site is collected by mobile camera equipment; the mobile camera equipment is deployed at corresponding sites of different manufacturing procedures of a target device; The manufacturing procedures of the target device are acquired through a monitoring management platform; when the manufacturing procedures have existed binding relationship with the mobile camera equipment, the existing binding relationship of the manufacturing procedures is acquired; when the manufacturing procedures do not have binding relationship, display information of binding is displayed to a supervisor, and the binding relationship between the mobile camera equipment and the manufacturing procedures is established in response to the operation instruction of the supervisor; The video data uploaded by the mobile camera equipment is received, and the association relationship between the video data and the manufacturing procedures is established according to the binding relationship; The manufacturing explosion diagram of the target device is displayed to the supervisor through a display terminal based on the manufacturing procedures of the target device; each node of the manufacturing explosion diagram corresponds to a manufacturing procedure, and each node of the manufacturing explosion diagram is associated with corresponding video data according to the association relationship, so that the associated video data is displayed in response to the operation instruction of the supervisor.

[0012] The above-mentioned at least one technical scheme adopted by the application can achieve the following beneficial effects: The mobile camera equipment is deployed based on the manufacturing procedures of a target device, video data of corresponding procedures of a deployed site is collected by the mobile camera equipment, the manufacturing procedures of the target device are acquired through a monitoring management platform, when the manufacturing procedures have existed binding relationship with the mobile camera equipment, the existing binding relationship of the manufacturing procedures is acquired; when the manufacturing procedures do not have binding relationship, the binding relationship between the mobile camera equipment and the manufacturing procedures is established based on the interaction with a supervisor, so that the video data uploaded by the mobile camera equipment is received, and the association relationship between the video data and the manufacturing procedures is established according to the binding relationship, so that the manufacturing explosion diagram of the target device is displayed to the supervisor through a display terminal based on the manufacturing procedures of the target device, and each node of the manufacturing explosion diagram is associated with corresponding video data according to the association relationship, so that the associated video data is displayed in response to the operation instruction of the supervisor. The application realizes the whole-process visualization of the device manufacturing process, the accurate procedure traceability and the remote real-time interaction, effectively solves the problems of "information island", insufficient visualization depth and traceability difficulty in the traditional supervision mode, and significantly improves the quality control efficiency and transparency of the device manufacturing. BRIEF DESCRIPTION OF DRAWINGS

[0013] The accompanying drawings, which are included to provide a further understanding of the application and constitute a part of this application, illustrate certain illustrative embodiments of the application and together with the description serve to explain the application. In the drawings:

[0014] Figure 1A device manufacturing state monitoring system provided by the present application; Figure 2 A device manufacturing state monitoring system provided by the present application; Figure 3 A process of binding a work procedure with a video provided by the present application; Figure 4 A manufacturing process provided by the present application Figure 3 D display interface schematic diagram; Figure 5 A multi-terminal video monitoring and remote technical support interface provided by the present application; Figure 6 A device manufacturing state monitoring method provided by the present application. DETAILED DESCRIPTION

[0015] In order to make the purpose, technical scheme and advantages of the present application clearer, the technical scheme of the present application will be described clearly and completely below by combining the specific embodiments of the present application with the corresponding drawings. Obviously, the described embodiments are only some of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0016] At present, the traditional device manufacturing state supervision method has the following significant defects: Poor real-time performance: unable to continuously perceive the manufacturing process in real time, difficult to discover and handle abnormal problems in the production process in time.

[0017] Low visualization: managers cannot remotely and intuitively understand the real-time state of key devices and key procedures, and lack the immersive monitoring experience.

[0018] Difficult to trace back: the manufacturing process data (especially video data) has weak correlation with specific manufacturing procedures and product batches, and once a problem occurs, it is difficult to quickly and accurately trace back the historical records and locate the problem source.

[0019] Information island: the existing video monitoring system is mostly an independent security system, which is separated from the business platforms such as manufacturing execution system and quality management system, and the data cannot be effectively fused and linked, forming an information island.

[0020] The primary objective of this invention is to overcome the shortcomings of existing technologies and provide an intelligent monitoring system and method capable of enabling visualization of the entire equipment manufacturing process, traceability of procedures, and remote interactivity. This invention utilizes a dynamic process binding mechanism to deeply correlate video data with the manufacturing process and adaptively switches video display modes based on the process status, thereby improving quality control efficiency and process transparency.

[0021] The technical solutions provided by the various embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0022] Figure 1 This is a schematic diagram of an equipment manufacturing status monitoring system according to the present invention. The equipment manufacturing status monitoring system includes: multiple mobile camera devices, a monitoring and management platform, and a display terminal.

[0023] Each mobile camera is deployed at a corresponding site in a different manufacturing process of the target equipment. The mobile cameras are used to collect video data of the corresponding process at the site where they are deployed.

[0024] The monitoring and management platform is used to acquire the manufacturing process of the target equipment. When the manufacturing process already has a binding relationship with the mobile camera, it acquires the existing binding relationship. When the manufacturing process does not have a binding relationship, it displays a binding prompt to the supervisor and, in response to the supervisor's operation instructions, establishes a binding relationship between the mobile camera and the manufacturing process. It is also used to receive video data uploaded by the mobile camera and establish an association between the video data and the manufacturing process based on the binding relationship.

[0025] The display terminal is used to display the manufacturing exploded view of the target equipment to the supervisor based on the manufacturing process of the target equipment. Each node of the manufacturing exploded view is associated with corresponding video data according to the association relationship, so as to display the associated video data in response to the operation instructions of the supervisor. Each node of the manufacturing exploded view corresponds to a manufacturing process.

[0026] Specifically, Figure 2 This is a schematic diagram of a device manufacturing status monitoring system architecture according to the present invention. The system architecture includes: Perception Layer: This layer includes at least one of various mobile camera devices that support 5G networks, such as 5G mobile cameras, 5G law enforcement recorders, and 5G handheld video terminals. These devices are used to collect audio and video data from the manufacturing site and connect to the monitoring and management platform via a built-in 5G module. The collected video data is then uploaded to the monitoring and management platform in an encrypted manner. The mobile camera devices support H.265 / H.264 encoding and have the ability to resume interrupted downloads and local caching.

[0027] Platform layer (i.e., monitoring and management platform): As the central hub of the system, it may include: Video storage server: Adopts a distributed storage architecture for long-term and temporary storage of audio and video data.

[0028] Video decoding server: integrates tools such as FFmpeg, supports multiple streaming media protocols such as RTSP, RTMP, and WebRTC, and realizes video stream transcoding and distribution.

[0029] Interface Service Module: Provides API interfaces for bidirectional data exchange with the manufacturing execution systems of external devices, synchronizing basic data such as project, process, and product equipment matching relationships.

[0030] Dynamic Process Binding Module: This module dynamically associates the mobile camera devices in the perception layer with the manufacturing process, establishing a mapping relationship between "device-manufacturing process-video". For example, it can generate a mapping table including device ID, manufacturing process ID, and timestamp.

[0031] Application layer: Provides a multi-terminal visual interactive interface, which may include: Large screen display module: used to visualize the equipment manufacturing process in the form of a 3D exploded view of equipment manufacturing. The process nodes in the process are embedded with video access interfaces. These video access interfaces dynamically link to real-time video streams or historical video data according to the completion status of the associated process.

[0032] Mobile App: Provides functions such as video search, process binding, equipment repair reporting, quality supervision record uploading, and remote two-way audio and video calls.

[0033] Web management platform: Provides functions such as system user management, role and permission management, monitoring equipment lifecycle management, and process progress management.

[0034] The core of the equipment manufacturing status monitoring system of this invention lies in the introduction of a dynamic process binding mechanism. Figure 3 This invention provides a flowchart illustrating the process binding and video association mechanism, which includes: Pre-capture binding: Before the monitoring equipment starts collecting data, it is bound to one or more specified manufacturing processes to generate a binding record.

[0035] Post-capture binding: For audio and video data that has been collected but not associated with a process, it is associated with the corresponding manufacturing process through manual selection or rule matching.

[0036] During the binding process, in one or more embodiments of the present invention, the monitoring and management platform is used to display all available mobile camera devices deployed in the site of a manufacturing process that does not have a binding relationship to the supervisor, and to display binding prompts; wherein, the available mobile devices are those mobile camera devices in a maintenance or scrapped state excluded from all mobile camera devices deployed in the site of the manufacturing process. That is, the system can automatically filter out devices in a "maintenance" or "scrapped" state to ensure the effectiveness of the operation.

[0037] Furthermore, in one or more embodiments of the present invention, the monitoring and management platform is also used to add / modify process status tags for video data based on the binding relationship and real-time process status. The process status tags include "In Progress," indicating that the corresponding manufacturing process is currently being executed, and "Completed," indicating that the corresponding manufacturing process has been completed. When the process status tag of the video data is "In Progress," the display terminal associates the real-time video data collected by the mobile camera device bound to the manufacturing process with the node of the manufacturing exploded view corresponding to the manufacturing process; when the process status tag of the video data is "Completed," the display terminal associates the historically collected video data by the mobile camera device bound to the manufacturing process with the node of the manufacturing exploded view corresponding to the manufacturing process.

[0038] The video display mode is adaptively set by using process status labels, and the display mode of video data is dynamically associated with the process status. When a process is not completed, the real-time video stream of that process is displayed; when a process is completed, the historical video recordings associated with that process are displayed.

[0039] In addition, the application layer also integrates a remote technical support module, which provides a two-way audio and video call entry point on the video playback interface, supporting on-site personnel to establish real-time audio and video conversations with remote experts, and the conversation content can be recorded and stored.

[0040] In terms of security mechanisms, the system uses AES-256 encryption to transmit data, implements access control based on the RBAC model, and supports multi-factor authentication to ensure data security and controllable access.

[0041] For the deployment and implementation of equipment manufacturing status monitoring systems: First, 5G mobile cameras can be deployed in equipment manufacturing workshops and key workstations, and supervisors can be equipped with 5G law enforcement recorders and 5G handheld video terminals. All these devices connect to the internet via built-in 5G modules, transmitting the collected audio and video data in an encrypted manner to the platform layer located in the data center or enterprise headquarters.

[0042] The platform layer deploys multiple servers that collaborate and divide tasks. Video streams are received and distributed via streaming media services such as SRS, and distributed storage is performed using object storage systems such as Minio (e.g., temporary storage for 30 days, and long-term storage of critical segments). Application servers handle business logic processing and synchronize data with the existing manufacturing execution system through defined API interfaces, automatically retrieving basic data such as projects, contracts, processes, and products.

[0043] The data processing flow for dynamic process binding is as follows: The system achieves process binding and video association through the following steps: Device registration and status management: When a monitoring device is connected, it registers its device ID, type, and status information with the platform.

[0044] Process information synchronization: Process data is synchronized from the manufacturing execution system on a regular basis via API interface.

[0045] Binding relationship establishment: Establish a mapping relationship table of "device ID-manufacturing process ID-timestamp".

[0046] Video tag generation: Add metadata tags to video files based on the binding relationship.

[0047] Status monitoring and display switching: Real-time monitoring of process status changes synchronized from the manufacturing execution system; when the status changes from "in progress" to "completed", the display mode of all video resources bound to that process is automatically triggered, switching from real-time video stream to historical video data.

[0048] At the application layer, users can access the system through different terminals: On the large screen: A nationwide map of manufacturing sites is displayed, along with exploded 3D renderings of specific equipment (such as pressure vessels (RV) and steam generators (SG)). Each node in the exploded rendering represents a manufacturing process, and a camera icon on a node indicates that the equipment is attached. Users can click on the icon to view real-time footage of that process (if the process is not yet complete) or historical recordings (if the process is already completed). Figure 4 A manufacturing process provided by the present invention Figure 3 D. Schematic diagram of the display interface.

[0049] PC Web client: Administrators can manage user permissions, manage equipment lifecycle (from warehousing, requisition, access, maintenance to scrapping), and manually maintain process progress.

[0050] Mobile App: On-site supervisors can scan the equipment's QR code or manually select to bind the process. When a fault is found, they can report the fault with one click. When needed, they can use the "Remote Technical Support" function in the app to establish two-way audio and video calls with experts at the rear.

[0051] Typical process of dynamic process binding: Manufacturing plant workers begin work in the equipment manufacturing workshop, and the system process is initiated (corresponding to...). Figure 3 (The "Start" node in the middle). Audio and video data are collected through 5G mobile cameras deployed on the manufacturing site.

[0052] The system first determines whether the audio / video data has been bound to a specific process: Scenario 1: The process has already been bound ( Figure 3 (Right-side path): The system directly retrieves existing binding information and automatically enters the video association processing flow. Figure 3 Part 2b).

[0053] Scenario 2: Unbound process ( Figure 3 Left-hand path): Manufacturing plant staff enter the process binding process ( Figure 3 Part 2a): Binding method selection: Select the binding method according to the process progress.

[0054] Pre-shoot binding: for the upcoming new procedure.

[0055] Select the manufacturing process to be executed and the monitoring equipment to be used. The system will automatically check the equipment status (filter out equipment under maintenance and scrapped equipment) and generate a binding record after confirmation.

[0056] Post-capture binding: Add binding to videos that have been captured but not yet associated. Select the corresponding historical video file, associate it with the corresponding manufacturing process, and generate a binding record.

[0057] System automatic processing flow: After the binding information is confirmed, the system proceeds to video association processing. Figure 3 Part 2b): Automatically associate audio and video data with process information, add process status tags to video data, and persistently store the binding relationship.

[0058] The system automatically controls the display mode based on the process status. Figure 3 Node to be determined): In progress: Displays a real-time video stream for remote, real-time monitoring by supervisors.

[0059] The process is complete: historical video recordings are displayed for supervisors to review and verify.

[0060] Supervision personnel usage process: The supervisors viewed the video playback interface ( Figure 3 The 2c section allows users to view manufacturing process videos in real time, initiate remote technical support when quality issues are discovered, and control and analyze playback of videos of key processes.

[0061] Implementation of remote technical support: Figure 5 This invention provides a schematic diagram of a multi-terminal video monitoring and remote technical support interface. This function is a key interactive module deeply embedded in the monitoring business process, implemented based on the WebRTC protocol to ensure low-latency communication. When a user triggers the "Call Support" button on the video playback interface, the application layer sends a service request carrying the current video source information and process context to the platform layer. The platform layer's signaling service intelligently routes requests based on the expert's skills, workload, and project relevance, establishing a point-to-point communication link. Simultaneously with the establishment of the audio and video call, the system can push the real-time monitoring video stream from the site as a shared medium to the expert, enabling the expert to simultaneously observe the problem screen and achieve immersive collaboration where "what you see is what you talk about." The entire session is uniformly managed by the platform; the call content is automatically bound to and recorded with associated process and project information, forming a traceable knowledge base. This function elevates one-way monitoring to two-way interaction, providing precise context for remote collaboration by utilizing existing process binding information. It is a core technical element for shortening problem response cycles and achieving intelligent decision support.

[0062] To further illustrate this, let's take the monitoring of the entire manufacturing process of the nuclear power pressure vessel cylinder section as an example: Scenario: A nuclear power project's pressure vessel has entered the shell section manufacturing stage, involving four key processes: "shell section rolling," "longitudinal seam welding," "heat treatment," and "non-destructive testing." The manufacturing plant is located in another region, and the Shanghai Nuclear Engineering Research & Design Institute's supervision team needs to remotely monitor the entire manufacturing process.

[0063] Specific implementation process: Phase 1: Process preparation and equipment integration.

[0064] Equipment deployment: The manufacturing plant staff deployed three 5G mobile cameras in the cylinder manufacturing workshop, pointing them at the plate rolling machine, welding station and heat treatment furnace respectively.

[0065] Process binding: At 8:00 a.m., before the “segment winding” process begins, staff use handheld terminals to select the “segment winding” process, and the system displays a list of available equipment (automatically filtering out cameras that are under maintenance).

[0066] Staff selected camera number 001, confirmed the binding, and the system generated a binding record (corresponding to...). Figure 2 (Binding paths before shooting) The same process is used to bind "longitudinal seam welding" to camera 002 and "heat treatment" to camera 003.

[0067] Phase Two: Real-time monitoring of the manufacturing process.

[0068] Real-time monitoring: Shanghai supervisors can view the forming process of the cylinder section in the plate rolling machine (real-time video stream), the operating status of the longitudinal seam automatic welding equipment (real-time video stream), and the temperature instrument readings of the heat treatment furnace (real-time video stream) in real time through the system's large screen.

[0069] Progress tracking: On the system's 3D manufacturing exploded view, the "Cylinder Section Rolling" node displays a green camera icon (process in progress).

[0070] Phase 3: Process conversion and mode switching.

[0071] Process completion: At 14:30 in the afternoon, the "tube section rolling" process was completed, and the staff updated the process status in the manufacturing execution system.

[0072] Automatic switching: When the system detects a status change, the "Rolling of Sections" node icon on the exploded view of the large screen turns blue (the process has been completed). The video associated with this node automatically switches from real-time stream to historical recording, allowing supervisors to replay key segments of the entire rolling process.

[0073] Phase 4: Handling quality anomalies.

[0074] Problem discovered: During the "longitudinal seam welding" process, the supervisor discovered abnormal welding machine parameters through real-time video.

[0075] Remote Support: Click the "Call Support" button on the video interface to establish a two-way video call with on-site technicians.

[0076] Collaborative processing: Remote experts mark problem areas using an electronic whiteboard and guide adjustments to welding parameters.

[0077] Process Log: The entire technical support session is automatically recorded and archived by the system.

[0078] Phase 5: Completion traceability and acceptance.

[0079] Full-process traceability: After all processes are completed, supervisors can view historical videos of the roll forming process (08:00-14:30), real-time monitoring records of longitudinal seam welding (including remote support segments), full-time video recordings of the heat treatment process, and on-site records of non-destructive testing through the timeline.

[0080] based on Figure 1The equipment manufacturing status monitoring system shown in this invention deploys mobile cameras based on the manufacturing process of the target equipment. These mobile cameras collect video data of the corresponding processes at the deployment site. The monitoring and management platform obtains the manufacturing process of the target equipment. When a manufacturing process already has a binding relationship with a mobile camera, this binding relationship is retrieved. When no binding relationship exists, a binding relationship is established between the mobile camera and the manufacturing process based on interaction with the supervisor. This allows the system to receive video data uploaded by the mobile camera and establish an association between the video data and the manufacturing process based on the binding relationship. A manufacturing exploded view of the target equipment is then displayed to the supervisor via a display terminal, based on the manufacturing process. At each node of the exploded view, corresponding video data is associated according to the association relationship, responding to the supervisor's operational commands to display the associated video data. This invention achieves full visualization of the equipment manufacturing process, precise process traceability, and remote real-time interaction, effectively solving problems such as "information silos," insufficient visualization depth, and traceability difficulties in traditional supervision models, significantly improving the efficiency and transparency of quality control in equipment manufacturing.

[0081] Full-process visualization and traceability: By dynamically binding process steps, video data is deeply integrated with manufacturing processes, realizing the transformation from "watching videos" to "watching processes", making the entire manufacturing process transparent, and any problem can be accurately traced back to the specific process, video record and related quality documents.

[0082] Deep integration of business and monitoring: Through deep integration with the manufacturing execution system, the integration of business data (projects, processes, products) and monitoring data (video) has been achieved, solving the problem of information silos and laying the foundation for data-based intelligent analysis and decision support.

[0083] Adaptive Interaction and Intelligent Decision Support: The system can adaptively switch video display modes according to the process status, and combined with the remote technical support function embedded in the video screen, it realizes immersive remote collaboration of "what you see is what you talk about", which greatly improves the speed of problem response and decision-making efficiency.

[0084] Improve management efficiency and quality: By utilizing 5G networks and mobile devices, supervisors and managers can remotely monitor and guide manufacturing plants located in various locations remotely, in real time, and intuitively through multiple terminals without being physically present on-site. This strengthens the supervisory and deterrent effect on suppliers and standardizes the supervision process.

[0085] Figure 6 This is a schematic diagram of a method for monitoring the manufacturing status of equipment according to the present invention, which specifically includes the following steps: S101: Collect video data of the corresponding processes at the deployed site using mobile camera equipment; each mobile camera equipment is deployed at the corresponding site of different manufacturing processes of the target equipment.

[0086] S102: Obtain the manufacturing process of the target equipment through the monitoring and management platform. If the manufacturing process already has a binding relationship with the mobile camera equipment, obtain the existing binding relationship of the manufacturing process. If the manufacturing process does not have a binding relationship, display the binding information to the supervisor and, in response to the supervisor's operation instructions, establish the binding relationship between the mobile camera equipment and the manufacturing process.

[0087] S103: Receive video data uploaded by the mobile camera device and establish the association between the video data and the manufacturing process based on the binding relationship.

[0088] S104: Display the exploded manufacturing diagram of the target equipment to the supervisor through the display terminal based on the manufacturing process of the target equipment; each node of the exploded manufacturing diagram corresponds to a manufacturing process, and each node of the exploded manufacturing diagram is associated with corresponding video data according to the association relationship, so as to display the associated video data in response to the operation instructions of the supervisor.

[0089] For specific limitations on equipment manufacturing status monitoring methods, please refer to the limitations on equipment manufacturing status monitoring methods mentioned above, which will not be repeated here.

[0090] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the methods described above. Any references to memory, storage, databases, or other media used in the embodiments provided by this invention can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0091] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this invention.

Claims

1. An apparatus manufacturing status monitoring system, characterized by, The method comprises the following steps: A plurality of mobile camera devices, a monitoring management platform and a display terminal are included; Each mobile camera device is deployed at a corresponding site of a target device in different manufacturing processes, and is used to collect video data of the corresponding process at the site; The monitoring management platform is used to obtain the manufacturing processes of the target device, and when a manufacturing process has an existing binding relationship with a mobile camera device, the existing binding relationship of the manufacturing process is obtained; when a manufacturing process does not have a binding relationship, display information prompting binding is displayed to the supervisor, and a binding relationship between the mobile camera device and the manufacturing process is established in response to the operation instruction of the supervisor; the monitoring management platform is also used to receive the video data uploaded by the mobile camera device and establish an association relationship between the video data and the manufacturing process according to the binding relationship; The display terminal is used to display the manufacturing explosion diagram of the target device to the supervisor based on the manufacturing process of the target device, and each node of the manufacturing explosion diagram is associated with corresponding video data according to the association relationship, so that the associated video data is displayed in response to the operation instruction of the supervisor; Each node of the manufacturing explosion diagram corresponds to a manufacturing process.

2. The system for monitoring the state of manufacture of a device according to claim 1, wherein, The mobile camera device is at least one of a 5G mobile camera, a 5G law enforcement recorder and a 5G handheld video terminal; The mobile camera device accesses the monitoring management platform through a built-in 5G module, and uploads the collected video data to the monitoring management platform in an encrypted manner.

3. The system for monitoring the state of manufacture of a device according to claim 1, wherein, The monitoring management platform comprises a video storage server, a video decoding server, an interface service module and a dynamic process binding module; The video storage server is used to store audio and video data for a long time and temporarily using a distributed storage architecture; The video decoding server supports multiple streaming media protocols and is used to realize decoding of video data; The interface service module is used for bidirectional data exchange with the manufacturing execution system of the device, and obtains the manufacturing process of the target device from the manufacturing execution system; The dynamic process binding module is used to obtain the existing binding relationship of the manufacturing process or establish the binding relationship between the mobile camera device and the manufacturing process, and obtain a mapping relationship table including device ID, manufacturing process ID and timestamp.

4. The system for monitoring the state of manufacture of a device according to claim 1, wherein, The monitoring management platform is also used to add / change process state labels for video data according to the binding relationship and the real-time process state; The process state label includes "in progress" representing that the corresponding manufacturing process is being executed and "completed" representing that the corresponding manufacturing process has been executed; When the process state label of the video data is "in progress", the display terminal associates the video data collected in real time by the mobile camera device bound to the manufacturing process through the node of the manufacturing explosion diagram corresponding to the manufacturing process; When the process state label of the video data is "completed", the display terminal associates the video data collected historically by the mobile camera device bound to the manufacturing process through the node of the manufacturing explosion diagram corresponding to the manufacturing process.

5. The system for monitoring the state of manufacture of a device according to claim 1, wherein, The monitoring management platform is also used to associate the video data that has been collected and does not have an association relationship with any manufacturing process with the corresponding manufacturing process through rule matching or in response to the operation instruction of the supervisor.

6. The system for monitoring the state of manufacture of a device according to claim 1, wherein, A plurality of mobile camera devices are deployed at each manufacturing process site. The monitoring management platform is used to display all available mobile camera devices deployed in the site of the manufacturing process to the inspector, and display display information prompting the binding when there is no binding relationship for the manufacturing process; The available mobile device is all mobile camera devices deployed in the site of the manufacturing process excluding mobile camera devices in maintenance or scrap state.

7. A method of manufacturing status monitoring of a device, characterized by, Comprise: Collecting video data of the corresponding process of the deployed site by the mobile camera device; Each mobile camera device is deployed in the corresponding site of the different manufacturing process of the target device; Obtaining the manufacturing process of the target device through the monitoring management platform, when the manufacturing process has existed the binding relationship with the mobile camera device, obtaining the existing binding relationship of the manufacturing process; when the manufacturing process does not exist the binding relationship, displaying the display information prompting the binding to the inspector, and establishing the binding relationship between the mobile camera device and the manufacturing process in response to the operation instruction of the inspector; Receiving the video data uploaded by the mobile camera device and establishing the association relationship between the video data and the manufacturing process according to the binding relationship; Displaying the manufacturing explosion diagram of the target device to the inspector based on the manufacturing process of the target device through the display terminal; each node of the manufacturing explosion diagram corresponds to a manufacturing process, and each node of the manufacturing explosion diagram is associated with the corresponding video data according to the association relationship, so as to display the associated video data in response to the operation instruction of the inspector.

Images