A crane group remote monitoring and diagnosing system and a method of use

Abstract

The application provides a crane group remote monitoring and diagnosing system, comprising: multiple head-mounted monitoring modules, a remote monitoring and diagnosing platform, and multiple groups of expert terminals, the head-mounted monitoring module is used for collecting the identity information of the wearer and monitoring the crane information of the camera, the information input and output ports of the remote monitoring and diagnosing platform are respectively connected with multiple head-mounted monitoring modules through the Internet, the information input and output ports of the remote monitoring and diagnosing platform are also respectively connected with multiple groups of expert terminals through the Internet, and the remote monitoring and diagnosing platform can be used for remotely adapting and connecting the head-mounted monitoring module and the expert terminal. The application establishes a video link between the head-mounted device and the expert terminal, so that the expert can remotely assist the maintenance personnel in diagnosing, maintaining or repairing, the professional degree and speed of the maintenance personnel in maintaining and repairing the crane can be improved, and the maintenance ability of the maintenance personnel can be improved at the maximum speed.

Description

Technical Field

[0001] This invention relates to the field of remote monitoring and diagnostic technology for cranes, and in particular to a remote monitoring and diagnostic system for crane groups and its usage method. Background Technology

[0002] A crane is a multi-action lifting machine that vertically lifts and horizontally moves heavy objects within a certain range. It is widely used in mining and factory workshops.

[0003] Cranes are used for lifting and moving heavy objects for extended periods, so their service life is generally short. However, proper maintenance and repair can help extend the service life of cranes. At present, there are few qualified crane diagnostic, maintenance and repair personnel. Due to their inherent advantages, cranes are used in large quantities, which means that not every crane in a fleet can be equipped with a qualified diagnostic, maintenance and repair personnel.

[0004] In view of this, a remote monitoring and diagnostic system for crane groups and its usage method are designed to solve the above problems. Summary of the Invention

[0005] To address the shortcomings of existing technologies, this invention provides a remote monitoring and diagnostic system and method for crane groups, which enables experts to remotely assist maintenance personnel in diagnosis, maintenance, and repair based on the content of monitoring cameras on the head-mounted devices worn by maintenance personnel.

[0006] According to an embodiment of the present invention, a remote monitoring and diagnostic system for crane groups is provided, comprising: multiple head-mounted monitoring modules, a remote monitoring and diagnostic platform, and multiple expert terminals. The head-mounted monitoring modules are used to collect the identity information of the wearers and the crane information monitored by the cameras. The information input and output ports of the remote monitoring and diagnostic platform are respectively connected to the multiple head-mounted monitoring modules via the Internet. The information input and output ports of the remote monitoring and diagnostic platform are also respectively connected to the multiple expert terminals via the Internet. The remote monitoring and diagnostic platform can be used to remotely adapt to and interface with the head-mounted monitoring modules and the expert terminals.

[0007] Preferably, the head-mounted monitoring module includes a pupil acquisition module for collecting pupil information of maintenance personnel, a voice recognition module, a monitoring camera module, a head-mounted device information storage module, and a first processing module. The information output and input ports of the first processing module are respectively connected to the pupil recognition module, the voice recognition module, the monitoring camera module, and the head-mounted device information storage module. The information output and input ports of the first processing module are also connected to a first wireless data transceiver module. The information output and input ports of the first wireless data transceiver module are connected to a remote monitoring and diagnostic platform via the Internet.

[0008] More preferably, the remote monitoring and diagnostic platform includes a data processing module that is connected to a first data wireless transceiver module and multiple expert terminals via the Internet. The information output port of the data processing module is connected to a head-mounted user authentication module. The information output port of the data processing module is connected to an expert information storage module and an information switching module, respectively. The information output port of the expert information storage module is connected to the information switching module. The information output and input ports of the second processing module are connected to a diagnostic assistance expert search module. The information output and input ports of the diagnostic assistance expert search module are connected to multiple expert information storage modules to be assisted. The information input ports of the expert information storage modules to be assisted are connected to the information switching module. The information output port of the information switching module is connected to multiple expert information storage modules that have already been assisted.

[0009] More preferably, the data processing module includes a second wireless data transceiver module, a second processing module, and a data input module. The second wireless data transceiver module communicates with the first wireless data transceiver module and multiple expert terminals via the Internet. The information output and input ports of the second wireless data transceiver module are connected to the second processing module, and the information input port of the second processing module is connected to the data input module.

[0010] More preferably, the head-mounted device authentication module includes a head-mounted device identity information storage module and a head-mounted device authentication module, wherein the information output and input ports of the second processing module are connected to the head-mounted device authentication module, and the information output and input ports of the head-mounted device authentication module are connected to the head-mounted device identity information storage module.

[0011] More preferably, the information output and input ports of the first processing module are respectively connected to the camera information storage module and the projection module.

[0012] More preferably, the power ports of the pupil acquisition module, the first processing module, the pupil recognition module, the voice recognition module, the monitoring camera module, the head-mounted device information storage module, the first data wireless transceiver module, the camera information storage module, and the projection module are connected to a power module.

[0013] In a further preferred embodiment, the pupil acquisition module, the first processing module, the pupil recognition module, the voice recognition module, the monitoring camera module, the head-mounted device information storage module, the first data wireless transceiver module, the camera information storage module, and the projection module are independently powered by the power module.

[0014] According to an embodiment of the present invention, a method for using a remote monitoring and diagnostic system for a crane group is also provided, comprising the following steps:

[0015] Before using the system, experts send a registration request to the platform through their expert terminals. The registration request contains various data information. The second processing module uses big data search to verify whether the registration request information sent by the expert is accurate. If it is inaccurate, it will prompt that the registration is not successful. If it is accurate, it will prompt that the registration is successful. At the same time, the expert information is saved to the expert information storage module.

[0016] Before the system is used, each maintenance personnel using the system is issued a head-mounted device. At the same time, the head-mounted device information storage module stores the device number, and the pupil recognition module records the pupil information of the maintenance personnel using the head-mounted device.

[0017] When the system is in use, experts who can participate in remote monitoring and diagnosis can clock in via expert terminal, and the clock-in information is synchronously saved in the expert information storage module.

[0018] When the system is in use, maintenance personnel connect with experts for remote assisted diagnosis. The pupil acquisition module collects the maintenance personnel's information and the pupil recognition module identifies it. The voice recognition module then prompts whether the recognition was successful. After successful recognition, the voice recognition module begins to collect ambient voice. Upon receiving the start signal voice, the monitoring camera module turns on and verifies the identity of the person wearing the device through the head-mounted identity verification module. After successful verification, the diagnostic assistance expert search module searches for and matches the corresponding checked-in experts. The maintenance personnel and experts establish a video call. The monitoring camera module collects video of the crane maintenance process and transmits it to the expert. The expert then uses the monitoring to assist the maintenance personnel in diagnosis and maintenance, achieving the purpose of remote monitoring and diagnosis.

[0019] During the above process, after the video link between the maintenance personnel and the expert is established, the information switching module switches the expert information from the corresponding group's pending expert information storage module to the corresponding group's assisted expert information storage module, facilitating quick retrieval by the diagnostic assistance expert search module.

[0020] Preferably, the video call content between maintenance personnel and experts will be saved in the camera information storage module. When maintenance personnel need to review the video, they can project it to the corresponding location through the projection module.

[0021] Compared with the prior art, the present invention has the following beneficial effects:

[0022] 1. This invention establishes a video link between maintenance personnel and experts through a head-mounted device and an expert terminal, enabling experts to remotely assist maintenance personnel in diagnosing, maintaining, or repairing cranes based on the content monitored by the head-mounted device. This improves the professionalism and speed of maintenance personnel in maintaining and repairing cranes, while maximizing the improvement of maintenance personnel's maintenance capabilities.

[0023] 2. During the maintenance process of this invention, the auxiliary diagnostic and maintenance videos of maintenance personnel and experts will be saved and can be displayed by projection during the review, which has a good review effect.

[0024] 3. This invention activates the head-mounted device through pupil recognition. During pupil recognition, the surrounding environment of the eyes also needs to be detected. The head-mounted device will only be activated if the eyes are open naturally and the recognition is correct, without any foreign objects around them, thus avoiding the problem of others misusing or retrieving video information.

[0025] 4. The head-mounted device of the present invention has a built-in power module, which provides an independent working power for other modules in the head-mounted device, so that the head-mounted device only needs to be worn on the head and does not require an external power supply, thereby improving portability and safety, and eliminating the limitation of external power supply, thus improving the system's performance. Attached Figure Description

[0026] Figure 1 This is a schematic diagram of the structure of a remote monitoring and diagnostic system for a crane group according to the present invention;

[0027] Figure 2 This is a schematic diagram of the head-mounted monitoring module structure in a remote monitoring and diagnostic system for crane groups according to the present invention;

[0028] Figure 3 This is a schematic diagram of the remote monitoring and diagnostic platform structure in a crane group remote monitoring and diagnostic system according to the present invention.

[0029] In the diagram: 1. Head-mounted monitoring module; 101. Pupil acquisition module; 102. First processing module; 103. First wireless data transceiver module; 104. Head-mounted device information storage module; 105. Projection module; 106. Monitoring camera module; 107. Power supply module; 108. Camera information storage module; 109. Voice recognition module; 110. Pupil recognition module;

[0030] 2. Remote monitoring and diagnostic platform; 201. Second data wireless transceiver module; 202. Head-mounted device authentication module; 203. Head-mounted device identity information storage module; 204. Assisted expert information storage module; 205. Expert information storage module to be assisted module; 206. Second processing module; 207. Diagnostic assistance expert search module; 208. Information switching module; 209. Expert information storage module; 210. Data input module;

[0031] 3. Expert terminal. Detailed Implementation

[0032] The technical solutions of the present invention will be further described below with reference to the accompanying drawings and embodiments.

[0033] Example 1:

[0034] Please see Figure 1-3 The present invention provides the following technical solution: a remote monitoring and diagnostic system for crane groups, comprising: multiple head-mounted monitoring modules 1, a remote monitoring and diagnostic platform 2, and multiple expert terminals 3. The head-mounted monitoring modules 1 are used to collect the identity information of the wearers and the crane information monitored by the cameras. The information input and output ports of the remote monitoring and diagnostic platform 2 are respectively connected to the multiple head-mounted monitoring modules 1 via the Internet. The information input and output ports of the remote monitoring and diagnostic platform 2 are also respectively connected to the multiple expert terminals 3 via the Internet. The remote monitoring and diagnostic platform 2 can be used to remotely adapt to and interface with the head-mounted monitoring modules 1 and the expert terminals 3.

[0035] Specifically, the head-mounted monitoring module 1 includes a pupil acquisition module 101 for collecting pupil information of maintenance personnel, a voice recognition module 109, a monitoring camera module 106, a head-mounted device information storage module 104, and a first processing module 102. The information output and input ports of the first processing module 102 are respectively connected to the pupil recognition module 110, the voice recognition module 109, the monitoring camera module 106, and the head-mounted device information storage module 104. The information output and input ports of the first processing module 102 are also connected to a first wireless data transceiver module 103. The information output and input ports of the first wireless data transceiver module 103 are connected to the remote monitoring and diagnostic platform 2 via the Internet.

[0036] Specifically, the remote monitoring and diagnostic platform 2 includes a data processing module that is connected to the first data wireless transceiver module 103 and multiple expert terminals 3 via the Internet. The information output port of the data processing module is connected to a head-mounted user authentication module. The information output port of the data processing module is connected to an expert information storage module 209 and an information switching module 208, respectively. The information output port of the expert information storage module 209 is connected to the information switching module 208. The information output and input ports of the second processing module 206 are connected to a diagnostic assistance expert search module 207. The information output and input ports of the diagnostic assistance expert search module 207 are connected to multiple sets of expert information storage modules 205 to be assisted. The information input ports of the expert information storage modules 205 to be assisted are connected to the information switching module 208. The information output port of the information switching module 208 is connected to multiple sets of assisted expert information storage modules 204.

[0037] Specifically, the data processing module includes a second wireless data transceiver module 201, a second processing module 206, and a data input module 210. The second wireless data transceiver module 201 communicates with the first wireless data transceiver module 103 and multiple expert terminals 3 via the Internet. The information output and input ports of the second wireless data transceiver module 201 are connected to the second processing module 206, and the information input port of the second processing module 206 is connected to the data input module 210.

[0038] To provide a more accurate authentication method, in a further embodiment, the head-mounted device authentication module includes a head-mounted device identity information storage module 203 and a head-mounted device authentication module 202. The information output and input ports of the second processing module 206 are connected to the head-mounted device authentication module 202, and the information output and input ports of the head-mounted device authentication module 202 are connected to the head-mounted device identity information storage module 203.

[0039] To facilitate the storage of video information provided by experts for remote assistance and to facilitate review by maintenance personnel, in a further embodiment, the information output and input ports of the first processing module 102 are respectively connected to the video information storage module 108 and the projection module 105.

[0040] To facilitate the free movement of the head-mounted monitoring module 1, in a further embodiment, the power ports of the pupil acquisition module 101, the first processing module 102, the pupil recognition module 110, the voice recognition module 109, the monitoring camera module 106, the head-mounted device information storage module 104, the first data wireless transceiver module 103, the camera information storage module 108, and the projection module 105 are connected to a power module 107, which is a rechargeable power supply.

[0041] The pupil acquisition module 101, the first processing module 102, the pupil recognition module 110, the voice recognition module 109, the monitoring camera module 106, the head-mounted device information storage module 104, the first data wireless transceiver module 103, the camera information storage module 108, and the projection module 105 are independently powered by the power module 107.

[0042] Example 2:

[0043] The present invention also provides a remote monitoring and diagnostic method for a crane group remote monitoring and diagnostic system, comprising the following steps:

[0044] Before using the system, experts can send a registration request to the platform through expert terminal 3. The registration request includes login information, password, identity information, and crane diagnostic expertise. After receiving the registration request from expert terminal 3, the second data wireless transceiver module 201 transmits it to the second processing module 206. The second processing module 206 uses big data search to verify whether the registration request information sent by the expert is accurate. If it is inaccurate, the second processing module 206 sends a "registration failed" message to expert terminal 3 through the second data wireless transceiver module 201, indicating that the expert's registration request has failed. If it is accurate, the second processing module 206 sends a "registration passed" message to expert terminal 3 through the second data wireless transceiver module 201, indicating that the expert's registration request has passed. At the same time, the expert's contact information, identity information, and crane diagnostic expertise are saved to the expert information storage module 209.

[0045] Before the system is used, each maintenance personnel using the system is issued a head-mounted device. At the same time, the head-mounted device information storage module 104 stores the device number, and the pupil recognition module 110 records the pupil information of the maintenance personnel using the head-mounted device.

[0046] When the system is in use, experts who can participate in remote monitoring and diagnosis can log in and check in through expert terminal 3. The check-in information is synchronously saved in expert information storage module 209.

[0047] When the system is in use, if maintenance personnel need remote assistance from experts during crane maintenance, they can point their eyes at the pupil acquisition module 101. The pupil acquisition module 101 collects the maintenance personnel's pupil information and the surrounding environment of their eyes and transmits it to the first processing module 102. The first processing module 102 will only transmit the pupil data collected by the pupil acquisition module 101 to the pupil recognition module 110 for recognition if the eyes are naturally open and there are no foreign objects around them. If the recognition is incorrect, the first processing module 102 will broadcast a "recognition failed" message through the voice recognition module 109. If the recognition is successful, the first processing module 102 will broadcast a "recognition successful" message through the voice recognition module 109.

[0048] Simultaneously, the voice recognition module 109 begins collecting ambient voice data. Upon receiving the voice message "Initiate remote diagnosis by an expert in a certain field," it transmits the data to the first processing module 102. The first processing module 102 controls the monitoring camera module 106 to open and simultaneously extracts the device code stored in the head-mounted device information storage module 104. The video connection request and the device code are then remotely transmitted to the second processing module 206 via the first data wireless transceiver module 103 and the second data wireless transceiver module 201. The second processing module 206 transmits the data to the head-mounted device authentication module 202. The head-mounted device authentication module 202 extracts the content from the head-mounted device identity information storage module 203 and compares it to determine if the device has the same device number. If not, it sends "Recognition failed, request not allowed" and transmits it to the voice recognition module 109 via the second processing module 206, the second data wireless transceiver module 201, the first data wireless transceiver module 103, and the first processing module 102 for broadcast.

[0049] If the equipment has the same number, the second processing module 206 transmits the instruction to the diagnostic assistance expert search module 207. The diagnostic assistance expert search module 207 searches for the expert information storage module 205 in the corresponding field. After finding the expert information that meets the conditions, it feeds it back to the second processing module 206. The second processing module 206 sends a video connection request to the expert terminal 3 according to the expert information. The maintenance personnel establish a video call with the expert. The monitoring camera module 106 collects video of the crane maintenance process and transmits it to the expert. The expert assists the maintenance personnel in diagnosis and maintenance based on the monitoring, thus achieving the purpose of remote monitoring and diagnosis.

[0050] During the above process, after the video link between the maintenance personnel and the expert is established, the information switching module 208 switches the expert information from the corresponding group of experts to be assisted information storage module 205 to the corresponding group of assisted expert information storage module 204, so as to facilitate the quick retrieval by the diagnostic assistance expert search module 207.

[0051] The video call content between maintenance personnel and experts will be saved in the camera information storage module 108. When maintenance personnel need to review the video, they can project it to the corresponding location through the projection module 105.

[0052] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A method for using a remote monitoring and diagnostic system for a crane group, characterized in that, Includes the following steps: Before the system is used, the expert sends a registration request to the platform through the expert terminal (3). The registration request contains various data information. The second processing module (206) checks and judges whether the registration request information sent by the expert is accurate through big data search. If it is not accurate, it prompts that the registration is not successful. If it is accurate, it prompts that the registration is successful. At the same time, the expert information is saved to the expert information storage module (209). Before the system is used, each maintenance personnel using the system is issued a head-mounted device. At the same time, the head-mounted device information storage module (104) stores the device number, and the pupil recognition module (110) records the pupil information of the maintenance personnel using the head-mounted device. When the system is in use, experts participating in remote monitoring and diagnosis work will clock in via expert terminal (3), and the clock-in information will be stored synchronously in expert information storage module (209); When the system is in use, when maintenance personnel connect with experts to achieve remote assisted diagnosis, the pupil acquisition module (101) collects the maintenance personnel information and the pupil recognition module (110) recognizes it. The voice recognition module (109) prompts whether the recognition is successful or not. After successful recognition, the voice recognition module (109) starts to collect environmental voice. When the start signal voice is received, the monitoring camera module (106) turns on and performs identity verification through the head-mounted identity verification module. After successful verification, the diagnostic assistance expert search module (207) searches for and matches the corresponding experts who have checked in. The maintenance personnel and experts establish a video call. The monitoring camera module (106) collects the video of the crane maintenance process and transmits it to the experts. The experts assist the maintenance personnel in diagnosis and maintenance based on the monitoring, thus achieving the purpose of remote monitoring and diagnosis. During the above process, after the video link between the maintenance personnel and the expert is established, the information switching module (208) switches the expert information from the corresponding group of expert information storage module (205) to the corresponding group of expert information storage module (204), so as to facilitate the quick retrieval of the diagnostic assistance expert search module (207). The system includes: multiple head-mounted monitoring modules (1), a remote monitoring and diagnostic platform (2), and multiple expert terminals (3). The head-mounted monitoring modules (1) are used to collect the identity information of the wearer and the information of the monitoring camera crane. The information input and output ports of the remote monitoring and diagnostic platform (2) are connected to the multiple head-mounted monitoring modules (1) via the Internet. The information input and output ports of the remote monitoring and diagnostic platform (2) are also connected to the multiple expert terminals (3) via the Internet. The remote monitoring and diagnostic platform (2) can be used to remotely adapt and interface the head-mounted monitoring modules (1) and the expert terminals (3). The head-mounted monitoring module (1) includes a pupil acquisition module (101) for collecting pupil information of maintenance personnel, a voice recognition module (109), a monitoring camera module (106), a head-mounted device information storage module (104), and a first processing module (102). The information output and input ports of the first processing module (102) are respectively connected to the pupil recognition module (110), the voice recognition module (109), the monitoring camera module (106), the monitoring camera module (106), and the head-mounted device information storage module (104). The information output and input ports of the first processing module (102) are also connected to a first data wireless transceiver module (103). The information output and input ports of the first data wireless transceiver module (103) are connected to the remote monitoring and diagnostic platform (2) via the Internet. The remote monitoring and diagnostic platform (2) includes a data processing module that is connected to the first data wireless transceiver module (103) and multiple expert terminals (3) via the Internet. The information output port of the data processing module is connected to the head-mounted identity verification module. The information output port of the data processing module is connected to an expert information storage module (209) and an information switching module (208) respectively. The information output port of the expert information storage module (209) is connected to the information switching module (208). The information output and input ports of the second processing module (206) are connected to a diagnostic assistance expert search module (207). The information output and input ports of the diagnostic assistance expert search module (207) are connected to multiple sets of expert information storage modules (205) to be assisted. The information input port of the expert information storage module (205) to be assisted is connected to the information switching module (208). The information output port of the information switching module (208) is connected to multiple sets of assisted expert information storage modules (204). The data processing module includes a second wireless data transceiver module (201), a second processing module (206), and a data input module (210). The second wireless data transceiver module (201) communicates with the first wireless data transceiver module (103) and multiple expert terminals (3) via the Internet. The information output and input ports of the second wireless data transceiver module (201) are connected to the second processing module (206), and the information input port of the second processing module (206) is connected to the data input module (210). The power ports of the pupil acquisition module (101), the first processing module (102), the pupil recognition module (110), the voice recognition module (109), the monitoring camera module (106), the head-mounted device information storage module (104), the first data wireless transceiver module (103), the camera information storage module (108), and the projection module (105) are connected to a power module (107).

2. The method of using the remote monitoring and diagnostic system for crane groups according to claim 1, characterized in that, The head-mounted device authentication module includes a head-mounted device identity information storage module (203) and a head-mounted device authentication module (202). The information output and input ports of the second processing module (206) are connected to the head-mounted device authentication module (202), and the information output and input ports of the head-mounted device authentication module (202) are connected to the head-mounted device identity information storage module (203).

3. The method of using the remote monitoring and diagnostic system for crane groups according to claim 1, characterized in that, The information output and input ports of the first processing module (102) are respectively connected to the camera information storage module (108) and the projection module (105).

4. The method of using the remote monitoring and diagnostic system for crane groups according to claim 1, characterized in that, The pupil acquisition module (101), the first processing module (102), the pupil recognition module (110), the voice recognition module (109), the monitoring camera module (106), the head-mounted device information storage module (104), the first data wireless transceiver module (103), the camera information storage module (108), and the projection module (105) are independently powered by the power module (107).

5. The method of using the remote monitoring and diagnostic system for crane groups according to claim 1, characterized in that, The video call content between maintenance personnel and experts will be saved in the camera information storage module (108). When maintenance personnel need to review the video, they can project it to the corresponding location through the projection module (105) for review.

Images