A real-time data transmission device and method for nondestructive testing
By integrating data acquisition, processing, transmission and visualization modules in non-destructive testing equipment, using WebRTC and IM technology to realize direct real-time data transmission between non-destructive testing equipment and remote terminals, the problems of low data acquisition efficiency and poor sharing in traditional equipment are solved. Significantly improves work efficiency and data accuracy.
Patent Information
- Application Number
- CN202310062603.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-01-17
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2043-01-17
AI Technical Summary
In the field of non-destructive testing, traditional equipment lacks real-time data transmission function, resulting in frequent mobile phone movement to obtain data, which is inefficient, high cost, and poor data accuracy and sharing.
A device including data acquisition, processing, transmission and visualization module was designed, using WebRTC and IM instant communication technology to realize direct real-time data transmission between the non-destructive testing equipment and the remote terminal, supporting real-time measurement data, images, audio and video. Collect, process and transmit.
It realizes direct real-time data transmission between non-destructive testing equipment and remote terminals, reduces labor costs, improves work efficiency and data accuracy, enhances data sharing, and avoids data loss.
Smart Images

Figure CN116233078B_ABST
Abstract
Description
Background Art
[0002] With the rapid development of technology, the field of industrial nondestructive testing has entered the era of information processing dominated by computer control, and is currently developing towards digitalization, automation, intelligence and imaging. With the development of nondestructive testing technology, users have wider and more stringent demands for data. During the transmission and storage process, the acquired data must maintain a low error rate; in terms of sources, the data sources are more extensive and even scattered across the country; in terms of data types, the data types have become more diverse, including text, pictures, videos, audio and other forms.
[0003] Traditional nondestructive testing equipment only has basic functions such as measurement, collection, storage, and display, but does not have the function of real-time data transmission. Data transmission often requires the use of USB ports or RS232 ports. After the on-site measurement is completed, the staff needs to connect the receiver to computers, mobile phones and other terminals through USB cables and other data cables to realize data transmission. This mode of data transmission via data cables often requires multiple staff members to go to the measurement site in person to read and record the data, and the measurement data stored in the equipment can generally only be obtained after the measurement is completed. When there are multiple measurement locations or objects to be tested in different areas are tested at the same time, the staff needs to move back and forth to obtain the test data, which has low work efficiency, extremely high intensity, high labor costs, reduced data accuracy during the recording process and is very easy to lose, and poor data sharing.
[0004] With the development of the field of nondestructive testing, some equipment has used Bluetooth transmission technology or wireless LAN to achieve short-distance transmission of data to mobile terminals, and then transmitted to remote terminals with the help of the mobile terminal's 5G network. This method uses the indirect data transmission mode of "nondestructive testing equipment-mobile terminal-remote terminal" and requires at least two people to be at the measurement site in person, one to operate the instrument and equipment, and the other to operate the mobile terminal. For remote locations or long distances, real-time transmission is even more impossible. When encountering difficulties during the measurement process and requiring expert guidance, the experts must be on-site for guidance, which is costly and time-consuming. In order to obtain the real-time situation of the detection site, view the scene at the operation site, confirm the information of the object to be tested (or the point to be tested), issue operation instructions to the operator, and make diagnostic analysis of the test results, remote workers can only indirectly use mobile terminals to achieve this through audio or video.
[0005] The realization of a direct real-time data transmission mode of "non-destructive testing equipment-remote terminal" is a new development trend of non-destructive testing equipment. It assists the staff in the field of non-destructive testing to realize remote real-time monitoring of the measurement process, and transmits a variety of test data, image data captured by the display screen, and audio and video data recorded on site in real time, so that remote staff can watch the measurement process of non-destructive testing equipment in real time on the Web application terminal and mobile phone mobile terminal, remotely guide on-site operations, obtain and record the data, screenshots, audio and video files obtained by the equipment, analyze and process the data, and realize rapid diagnosis of non-destructive testing. Therefore, labor costs are reduced, work efficiency is improved, data accuracy and sharing are improved, and it is not easy to lose. Summary of the invention
[0006] In view of this, the purpose of the embodiments of the present application is to provide a real-time data transmission device and method for non-destructive testing, which is used to collect and process and analyze various data obtained during the non-destructive testing process in real time, send them to designated personnel and display them, and significantly solve the practical problems of high work intensity, low work efficiency, low data accuracy, and poor data sharing in the non-destructive testing industry.
[0007] To achieve the above object, the present invention provides the following technical solutions:
[0008] According to a first aspect of the present invention, there is provided a real-time data transmission device for nondestructive testing, the device comprising a data acquisition module, a data processing module, a data transmission module and a data visualization module;
[0009] The data acquisition module is used to communicate interactively with the nondestructive testing equipment according to different instructions received, and to acquire different types of data combinations;
[0010] The data processing module is used to detect the received data and determine whether it conforms to the preset data structure. If it conforms, it is handed over to the corresponding processing module for processing, otherwise the data is discarded;
[0011] The data transmission module is used to establish a data transmission channel based on WebRTC real-time communication and IM instant messaging between the communication requester and the target party;
[0012] The data visualization module is used to display the received original data and the processed data sent by the data processing module.
[0013] As a further solution of the present invention, the data acquisition module includes a measurement data acquisition module, an image acquisition module and a sound acquisition module; the measurement data acquisition module is connected to a probe, the image acquisition module is connected to a camera, the sound acquisition module is connected to a microphone, the measurement data collected by the probe is transmitted to the measurement data acquisition module, the video data collected by the camera is transmitted to the image acquisition module, and the audio data collected by the microphone is transmitted to the sound acquisition module.
[0014] As a further solution of the present invention, when the data acquisition module collects and obtains different types of data combinations, the data acquisition module collects binary raw data. The data acquisition module is also used to collect and obtain different types of data combinations according to different instruction combinations obtained, wherein different types of data combinations include measurement data collected by the probe, video data collected by the camera, and audio data collected by the microphone.
[0015] As a further solution of the present invention, the data processing module includes an instruction data processing module, a raw data processing module and a received data processing module; the instruction data processing module is used to process the received instruction data, parse the instruction type according to the instruction format, and distribute the instructions according to the type; the raw data processing module is used to preliminarily process the raw data including measurement data, pictures, videos, and audio; the received data processing module is used to receive data collected, processed and sent by the second client, parse it according to the data type, and send it to the data visualization module for display after parsing.
[0016] As a further solution of the present invention, the raw data processing module parses the collected binary raw data into corresponding decimal measurement values according to preset rules, uses the least squares method to fit the calibration data, generates a calibration curve, and brings the measurement value into the curve to obtain the closest value.
[0017] As a further solution of the present invention, the raw data preliminarily processed by the raw data processing module is also used to encapsulate and generate JSON data, image data, video data, and audio data respectively as standby data for transmission or display.
[0018] As a further solution of the present invention, the data transmission module is further used to send the data received from the second client to the receiving data processing module in the data processing module for processing.
[0019] As a further solution of the present invention, the data visualization module is used to display the original data and the data sent by the second client.
[0020] According to a second aspect of the present invention, a method for real-time data transmission for non-destructive testing is provided. The method is performed based on the above-mentioned real-time data transmission device for non-destructive testing. The method is applied to real-time data transmission between a non-destructive testing device client and other clients. The method for real-time data transmission for non-destructive testing includes the following steps:
[0021] Obtain a connection establishment request initiated by any client to the nondestructive testing device, and the data transmission module of the nondestructive testing device receives the request and forwards it to the nondestructive testing device;
[0022] After receiving the request, the nondestructive testing device determines whether to accept the request to establish a connection. If the request to establish a connection is accepted, the data transmission module of the nondestructive testing device establishes a data transmission channel based on WebRTC real-time communication and IM instant messaging for both parties; if the request is not accepted, a rejection instruction is sent back and the connection request is disconnected;
[0023] After the data transmission channel is established, any client or any non-destructive testing device sends a heartbeat signal to the other party at regular intervals. When the heartbeat signal sent by the other client or any non-destructive testing device is not received within the accumulated preset time, it is determined that the other party is offline; if the offline end is the non-destructive testing device end, the established data transmission channel is disconnected; if the offline end is not the non-destructive testing device end, the data transmission channel is maintained until the measurement is completed.
[0024] As a further solution of the present invention, any client is any one of the nondestructive testing equipment or the mobile client, and the mobile client is a mobile phone or a computer.
[0025] According to a third aspect of an embodiment of the present invention, there is provided a computer device, including:
[0026] Processor; and
[0027] A storage device is used to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the real-time data transmission method for non-destructive testing as described in the first aspect of the above embodiment.
[0028] According to a fourth aspect of the present invention, there is provided a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the real-time data transmission method for non-destructive testing as described in the first aspect of the above embodiment.
[0029] The technical solution provided by the embodiment of the present invention may have the following beneficial effects:
[0030] Through the above technical solution, the real-time data transmission method for non-destructive testing of the present invention realizes direct data transmission between "non-destructive testing equipment and remote terminal", and uses remote wireless transmission to record the measured data and send it to the staff who need to receive the data in real time. After receiving the data with the help of the Web terminal or the mobile terminal, subsequent data analysis can be carried out to realize long-distance real-time transmission.
[0031] The present invention discloses a nondestructive testing device using a real-time data transmission method. The built-in camera and microphone of the device can realize remote audio and video calls. Not only can the entire measurement process be viewed remotely and operation instructions can be given, but also the recording or video of the measurement process or the intercepted measurement interface can be sent to the other party. In summary, a real-time data transmission method and device for nondestructive testing can significantly reduce labor costs, improve work efficiency, improve data accuracy and sharing, and is not easy to lose.
[0032] These and other aspects of the present application will be more concise and understandable in the following description of the embodiments. It should be understood that the above general description and the following detailed description are only exemplary and explanatory and cannot limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or the prior art description. Obviously, the drawings described below are only some embodiments of the present application. In the drawings:
[0034] Figure 1 It is a flow chart of a method for real-time transmission of data for non-destructive testing in an exemplary embodiment of the present invention;
[0035] Figure 2 It is a structural block diagram of a real-time data transmission device for non-destructive testing in an exemplary embodiment of the present invention;
[0036] Figure 3 It is a schematic diagram of data transmission between a real-time data transmission device for non-destructive testing and a client in an exemplary embodiment of the present invention;
[0037] Figure 4 It is a working schematic diagram of a real-time data transmission device for non-destructive testing in an exemplary embodiment of the present invention;
[0038] Figure 5 A schematic diagram of the structure of a computer device suitable for implementing an exemplary embodiment of the present invention.
[0039] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0040] Below, the present application is further described in conjunction with the accompanying drawings and specific implementation methods. It should be noted that, under the premise of no conflict, the various embodiments or technical features described below can be arbitrarily combined to form a new embodiment.
[0041] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0042] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0043] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.
[0044] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.
[0045] The realization of the direct real-time data transmission mode of "non-destructive testing equipment-remote terminal" is a new development trend of non-destructive testing equipment. It assists the staff in the field of non-destructive testing to realize remote real-time monitoring of the measurement process, and transmits a variety of test data, image data captured by the display screen, and audio and video data recorded on site in real time, so that remote staff can watch the measurement process of non-destructive testing equipment in real time on the Web application terminal and mobile phone mobile terminal, remotely guide on-site operations, obtain and record the data, screenshots, audio and video files obtained by the equipment, analyze and process the data, and realize rapid diagnosis of non-destructive testing. Therefore, labor costs are reduced, work efficiency is improved, data accuracy and sharing are improved, and it is not easy to lose.
[0046] Based on the above reasons, the embodiments of the present application provide a real-time data transmission device and method for non-destructive testing, which is used to collect and process and analyze various data obtained during the non-destructive testing process in real time, send them to designated personnel and display them, and significantly solve the practical problems of high work intensity, low work efficiency, low data accuracy, and poor data sharing in the non-destructive testing industry.
[0047] In some embodiments, the real-time data transmission method for non-destructive testing can be applied to a computer device, which can be a PC, a portable computer, a mobile terminal, or other device with display and processing functions, but is certainly not limited thereto.
[0048] Please refer to Figure 2 , Figure 3 and Figure 4 As shown, Figure 2 This is a structural block diagram of the real-time data transmission device for non-destructive testing in this application. Figure 3 This is a schematic diagram of data transmission between the real-time data transmission device for non-destructive testing and the client in this application; Figure 4 This is a working schematic diagram of the real-time data transmission device for non-destructive testing in this application.
[0049] In an embodiment of the present application, a real-time data transmission device for non-destructive testing is provided, and the device includes a data acquisition module, a data processing module, a data transmission module, and a data visualization module.
[0050] The data acquisition module is used to communicate interactively with the nondestructive testing equipment according to different received instructions to acquire different types of data combinations.
[0051] In some embodiments, the data acquisition module includes a measurement data acquisition module, an image acquisition module and a sound acquisition module; the measurement data acquisition module is connected to a probe, the image acquisition module is connected to a camera, and the sound acquisition module is connected to a microphone. The measurement data collected by the probe is transmitted to the measurement data acquisition module, the video data collected by the camera is transmitted to the image acquisition module, and the audio data collected by the microphone is collected by the microphone device from the analog signal in the environment into raw data encoded in PCM mode, wherein the PCM data records the intensity of the original waveform. Before PCM pulse encoding is performed, analog-to-digital conversion is also required, that is, the raw audio data obtained in the device is transmitted to the sound acquisition module.
[0052] The data acquisition module interacts and communicates with the nondestructive testing equipment according to different instructions, and controls the data acquisition module to collect binary raw data. During the measurement process, the user can send different instruction combinations to the data acquisition module as needed to obtain different types of data combinations, wherein different types of data combinations include measurement data collected by the probe, video data collected by the camera, and audio data collected by the microphone.
[0053] The data processing module is used to detect the received data and determine whether it conforms to the preset data structure. If it conforms, it is handed over to the corresponding processing module for processing; otherwise, the data is discarded.
[0054] In some embodiments, the data processing module includes an instruction data processing module, a raw data processing module and a received data processing module; the instruction data processing module is used to process the received instruction data, parse the instruction type according to the instruction format, and distribute the instructions according to the type; the raw data processing module is used to preliminarily process the raw data including measurement data, pictures, videos, and audio; the received data processing module is used to receive data collected, processed and sent by the second client, parse it according to the data type, and send it to the data visualization module for display after parsing.
[0055] In this embodiment, the instruction data processing module is used to process the received instruction data, parse the instruction type according to the instruction format, and distribute the instructions according to the type to realize different functions. For example, after initiating the measurement, the nondestructive testing device will send an invitation to watch to the other client. After receiving the instruction, the other client will display it according to the instruction format. After agreeing to the invitation, it will draw the same measurement interface as the device, and receive the data sent by the other device in real time to realize synchronous online viewing and measurement.
[0056] In this embodiment, the raw data processing module is used to preliminarily process raw data composed of measurement data, pictures, videos, audio, etc. For the collected raw data, the raw data processing module parses the collected binary raw data into corresponding decimal measurement values according to certain rules. In order to reduce data jitter, the least squares method is used to fit the calibration data, generate a calibration curve, and bring the measured value into the curve to take the closest value. For the collected audio, video and pictures, preliminary processing is performed to crop the oversized audio, video and pictures. The processing method for cropping oversized audio includes but is not limited to ANS audio noise reduction, AGC automatic gain control, AEC echo suppression, silence detection, mixing and sound special effects processing. Since the original sound collected by the device often contains background noise, it affects the subjective experience of the audience and reduces the audio compression efficiency. After noise suppression processing, the role of noise suppression is to detect the background fixed frequency noise and eliminate the background noise. In some embodiments, the encoding technology used in the video can be spatial redundancy, temporal redundancy, encoding redundancy, visual redundancy, etc. When the analog signal in the environment is collected by a microphone device into raw data encoded in PCM mode, audio encoding refers to the use of an encoder to compress the raw audio data. Common encoders include MP3 encoding, AAC encoding, WAV encoding, and OGG encoding. AAC encoding is used in this embodiment. Since the sound and the picture are processed separately during the collection, preprocessing, and encoding process, but the sound and the picture need to be displayed at the same time during actual playback, the audio and video encoded data are packaged into one file in this embodiment. The commonly used file encapsulation formats are MPEG and WAV.
[0057] Furthermore, the raw data preliminarily processed by the raw data processing module is encapsulated to generate JSON data, image data, video data, and audio data as standby data for transmission or display.
[0058] In this embodiment, the received data processing module is used to receive data collected, processed and sent by the second client, parse it according to the data type, and perform decoding operations on the received audio and video data to obtain video pixel data (generally YUV420 or ARGB format) and audio sampling data (generally PCM data). After parsing, it is sent to the data visualization module for display.
[0059] The data transmission module is used to establish a data transmission channel based on WebRTC real-time communication and IM instant messaging between the communication requester and the target party.
[0060] In some embodiments, when a communication connection request instruction is received, the request is sent to the target party. After the target party agrees to the request, the data transmission module establishes a data transmission channel based on WebRTC real-time communication and IM instant messaging for both parties. The IM instant messaging transmits the JSON, pictures, videos, and audio data generated by the original data processing module, and realizes the transmission of online audio and video streams based on WebRTC real-time communication technology. Both parties realize real-time online audio and video viewing in the webRTC channel. The channel transmits the encoded data of the audio and video screen to the server by pushing the stream, and the server further forwards the data. The forwarding can be On Demand Upload, live streaming, local files or low-latency transmission. The corresponding channel obtains the audio and video images of the other party by pulling the stream. Pulling the stream mainly obtains audio and video data from file download, live streaming, local files and low-latency transmission. The volume of audio and video data is usually large, and it is a continuous multimedia flow when transmitted. Therefore, it is transmitted through streaming technology and follows the streaming protocol. The most vulnerable impact of audio and video during transmission: network jitter, that is, the data packets that should have been sent / received are not sent / received, resulting in network jitter. Whether the network is jittering can be determined from whether the packet loss rate increases, whether the RTT is extended, or whether the sending rate decreases. Among them, RTT is used to describe the sending and receiving time, which is used to indicate network delay, and the sending rate is used to indicate the bandwidth, that is, the amount of data allowed to be sent and received by the network port. In order to solve network jitter and improve stability, a buffer space is set in the audio and video processing process, which is JitterBuffer. It connects the codec on one end and the network protocol stack on the other end, acting as an intermediate warehouse between production and consumers.
[0061] In addition, when the two parties do not communicate online through audio and video, the data transmission module is a chat session channel for the exchange of various messages such as typed text, pictures, voice, etc. The data to be sent by the user is divided and packaged in the form of a data stream, and then a continuous, bidirectional data transmission channel with strict data correctness guarantee is established through the virtual circuit established between the two machines. The data transmission module receives the data from the second client and sends it to the receiving data processing module in the data processing module for processing.
[0062] The data visualization module is used to display the received raw data and the processed data sent by the data processing module. Among them, the data visualization module is used to display the raw data and the data sent by the second client to the user. For the received raw measurement data, the numbers at the corresponding positions in the page layout are replaced, and the changes in the statistical values brought by the data are synchronously displayed. When the data exceeds the limit or an abnormality occurs, the number is displayed in different colors to prompt the user. The video pixel data and audio sampling data processed by the data processing module must be rendered before they can be displayed. Generally, OpenGL, Direct3D, etc. can be used for video rendering, and then sent to the corresponding window or View (SurfaceView or TextureView, etc.) for display. Since each audio frame and video frame has the same initial value of the timestamp (PTS), the PTS marks the timestamp of rendering and displaying this frame data. So we can fix the audio duration, make its PTS grow steadily, and use it as a reference time axis, and display the video frames with similar PTS with the reference time. If the match is consistent, the audio is synchronized.
[0063] For example, when the data transmission module of the nondestructive testing device receives a video call request initiated by other clients, it uploads the call request to the nondestructive testing device, and after being processed by its data processing module, it is sent to the data visualization module for display. The user controls the device through the UI interactive interface and issues an instruction on whether to accept the request. If an instruction to reject the request is issued, the connection request is disconnected. If an instruction to agree to the request is issued, the data transmission module establishes a data transmission channel based on WebRTC real-time communication and IM instant messaging for both parties, and the two parties successfully establish a video call. If the device chooses to display only the measurement data, other clients can synchronously watch the measurement interface displayed by the data visualization module of the device, dynamically see the real-time measurement data collected by the probe, and can also communicate with the device through audio and video. If the device chooses to display the measurement data and the measurement scene at the same time, the device will synchronously transmit the measurement interface and the camera synchronous shooting screen, so that the other party can watch the entire measurement process in real time. At the same time, when the data transmission channel is established, the audio and video data collected by other clients are transmitted to the device through the channel in real time after data processing. The data is processed by the receiving data processing module of the device and sent to the data visualization module for display.
[0064] When displaying the measurement data to other clients, the nondestructive testing equipment can save the measurement data and choose to send it to the other party. It can also take screenshots of important moments in the measurement interface, or record the entire measurement process for saving and sending. The recorder no longer needs to go to the site to record data. This scenario can also be used to achieve expert remote guidance of the measurement process. When encountering problems and requiring expert guidance, you can establish a call with the expert, who can watch the measurement process through a video call and provide real-time guidance.
[0065] In the case of non-video calls, after the device establishes a data transmission channel with other clients, when the device starts measuring, it will send a viewing invitation instruction to other clients. When other clients agree to enter and watch, the measurement data is transmitted in real time through the data communication channel, processed by the data processing module, and displayed in real time through the data visualization display module of the client.
[0066] A nondestructive testing device using a real-time data transmission method in an embodiment of the present invention can realize remote audio and video calls using the built-in camera and microphone of the device. Not only can the entire measurement process be viewed remotely and operation instructions given, but also the audio and video recordings or intercepted measurement interfaces of the measurement process can be sent to the other party.
[0067] See also Figures 1 to 4As shown, an embodiment of the present invention further provides a method for real-time data transmission for non-destructive testing, which is performed based on the above-mentioned real-time data transmission device for non-destructive testing. The method is applied to real-time data transmission between a non-destructive testing device client and other clients. The method for real-time data transmission for non-destructive testing includes the following steps:
[0068] Obtain a connection establishment request initiated by any client to the nondestructive testing device, and the data transmission module of the nondestructive testing device receives the request and forwards it to the nondestructive testing device;
[0069] After receiving the request, the nondestructive testing device determines whether to accept the request to establish a connection. If the request to establish a connection is accepted, the data transmission module of the nondestructive testing device establishes a data transmission channel based on WebRTC real-time communication and IM instant messaging for both parties; if the request is not accepted, a rejection instruction is sent back and the connection request is disconnected;
[0070] After the data transmission channel is established, any client or any non-destructive testing device sends a heartbeat signal to the other party at regular intervals. When the heartbeat signal sent by the other client or any non-destructive testing device is not received within the accumulated preset time, it is determined that the other party is offline; if the offline end is the non-destructive testing device end, the established data transmission channel is disconnected; if the offline end is not the non-destructive testing device end, the data transmission channel is maintained until the measurement is completed.
[0071] In the embodiment of the present invention, any client refers to any one of mobile clients such as non-destructive testing equipment, mobile phones, computers, etc.
[0072] Compared with the traditional non-destructive testing field, most of the measurement data recording methods are on-site transcription or short-range Bluetooth transmission to a third party. Data sharing is poor, data accuracy is poor and easy to lose. The real-time data transmission method for non-destructive testing of the present invention realizes direct data transmission from "non-destructive testing equipment to remote terminal", and uses remote wireless transmission to record the measurement data and send it instantly to the staff who need to receive the data. Subsequent data analysis can be carried out after receiving the data with the help of the Web terminal or the mobile terminal, realizing long-distance real-time transmission.
[0073] In summary, a real-time data transmission method and device for non-destructive testing can significantly reduce labor costs, improve work efficiency, improve data accuracy and sharing, and is not easily lost.
[0074] It should be noted that the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.
[0075] In addition, in an exemplary embodiment of the present invention, a computer device capable of implementing the above-mentioned real-time data transmission method for non-destructive testing is also provided.
[0076] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as devices, methods or program products. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: complete hardware embodiments, complete software embodiments (including firmware, microcode, etc.), or embodiments combining hardware and software aspects, which may be collectively referred to herein as "circuits", "modules" or "devices".
[0077] Refer to the following Figure 5 A computer device according to such an embodiment of the present invention will be described. Figure 5 The computer device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0078] like Figure 5 As shown, the computer device is in the form of a general computing device. The components of the computer device may include but are not limited to: at least one processor 401, at least one memory 402, a bus 403 connecting different device components (including the memory 402 and the processor 401), and a display 404.
[0079] The memory stores program codes, which can be executed by the processor 401, so that the processor 401 executes the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification.
[0080] In an embodiment of the present application, the computer device is configured to execute the following method:
[0081] Obtain a connection establishment request initiated by any client to the nondestructive testing device, and the data transmission module of the nondestructive testing device receives the request and forwards it to the nondestructive testing device;
[0082] After receiving the request, the nondestructive testing device determines whether to accept the request to establish a connection. If the request to establish a connection is accepted, the data transmission module of the nondestructive testing device establishes a data transmission channel based on WebRTC real-time communication and IM instant messaging for both parties; if the request is not accepted, a rejection instruction is sent back and the connection request is disconnected;
[0083] After the data transmission channel is established, any client or any non-destructive testing device sends a heartbeat signal to the other party at regular intervals. When the heartbeat signal sent by the other client or any non-destructive testing device is not received within the accumulated preset time, it is determined that the other party is offline; if the offline end is the non-destructive testing device end, the established data transmission channel is disconnected; if the offline end is not the non-destructive testing device end, the data transmission channel is maintained until the measurement is completed.
[0084] The memory 402 may include readable media in the form of volatile memory, such as random access memory (RAM) and / or cache memory, and may further include read-only memory (ROM).
[0085] Memory 402 may also include a program / utility having a set (at least one) of program modules, such program modules including but not limited to: operating means, one or more application programs, other program modules and program data, each of which or some combination may include the implementation of a network environment.
[0086] Bus 403 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures.
[0087] The computer device can also communicate with one or more external devices (e.g., keyboards, pointing devices, Bluetooth devices, etc.), can also communicate with one or more devices that enable users to interact with the computer device, and / or communicate with any device (e.g., routers, modems, etc.) that enables the computer device to communicate with one or more other computing devices. Such communication can be carried out through an input / output (I / O) interface. In addition, the computer device can also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs) and / or public networks, such as the Internet) through a network adapter. The network adapter communicates with other modules of the computer device through bus 403. It should be understood that other hardware and / or software modules can be used in conjunction with the computer device, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID devices, tape drives, and data backup storage devices, etc.
[0088] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the exemplary embodiments described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiment of the present invention.
[0089] In an exemplary embodiment of the present invention, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible embodiments, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to perform the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.
[0090] In an exemplary embodiment of the present invention, a program product for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited to this. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution device, an apparatus or a device.
[0091] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor device, device or component, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0092] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, wherein readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution device, apparatus, or device.
[0093] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.
[0094] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).
[0095] The present invention provides a real-time data transmission method for nondestructive testing, which realizes direct data transmission between "nondestructive testing equipment and remote terminal", records the measured data by remote wireless transmission and sends it to the staff who need to receive the data in real time. After receiving the data through the Web terminal or the mobile terminal, subsequent data analysis can be performed, realizing long-distance real-time transmission.
[0096] The present invention discloses a nondestructive testing device using a real-time data transmission method. The built-in camera and microphone of the device can realize remote audio and video calls. Not only can the entire measurement process be viewed remotely and operation instructions can be given, but also the recording or video of the measurement process or the intercepted measurement interface can be sent to the other party. In summary, a real-time data transmission method and device for nondestructive testing can significantly reduce labor costs, improve work efficiency, improve data accuracy and sharing, and is not easy to lose.
[0097] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A real-time data transmission device for non-destructive testing, characterized in that: The device includes a data acquisition module, a data processing module, a data transmission module and a data visualization module; The data acquisition module is used to interact and communicate with the nondestructive testing equipment according to different instructions received, and to collect and obtain different types of data combinations; when the data acquisition module collects and obtains different types of data combinations, the data acquisition module collects binary raw data, and the data acquisition module is also used to collect and obtain different types of data combinations according to different instruction combinations obtained, wherein different types of data combinations include measurement data collected by the probe, video data collected by the camera, and audio data collected by the microphone; wherein the data acquisition module includes a measurement data acquisition module, an image acquisition module, and a sound acquisition module; the measurement data acquisition module is connected to the probe, the image acquisition module is connected to the camera, the sound acquisition module is connected to the microphone, the measurement data collected by the probe is transmitted to the measurement data acquisition module, the video data collected by the camera is transmitted to the image acquisition module, and the audio data collected by the microphone is transmitted to the sound acquisition module; The data processing module is used to detect the received data and determine whether it conforms to the preset data structure. If it conforms, it is handed over to the corresponding processing module for processing, otherwise the data is discarded; the data processing module includes an instruction data processing module, a raw data processing module and a receiving data processing module; the instruction data processing module is used to process the received instruction data, parse the instruction type according to the instruction format, and distribute the instruction according to the type; the raw data processing module is used to preliminarily process the raw data composed of measurement data, pictures, videos, and audio; the receiving data processing module is used to receive the data collected, processed and sent by the second client, parse it according to the data type, and send it to the data visualization module for display after parsing; wherein, the raw data processing module parses the collected binary raw data into the corresponding decimal measurement value according to the preset rules, uses the least squares method to fit the calibration data, generates a calibration curve, and brings the measurement value into the curve to take the closest value; the raw data preliminarily processed by the raw data processing module is also used to encapsulate and generate JSON data, picture data, video data, and audio data respectively as stand-by data for transmission or display; The data transmission module is used to establish a data transmission channel based on WebRTC real-time communication and IM instant messaging between the communication request method and the target party; the data transmission module is also used to send the data received from the second client to the receiving data processing module in the data processing module for processing; The data visualization module is used to display the received original data and the processed data sent by the data processing module; wherein, the data visualization module is used to display the original data and the data sent by the second client.
2. A method for real-time data transmission for non-destructive testing, characterized in that: The method is performed based on the real-time data transmission device for non-destructive testing according to claim 1, and the method is applied to real-time data transmission between a non-destructive testing device client and other clients. The real-time data transmission method for non-destructive testing includes the following steps: Obtain a connection establishment request initiated by any client to the nondestructive testing device, and the data transmission module of the nondestructive testing device receives the request and forwards it to the nondestructive testing device; After receiving the request, the nondestructive testing device determines whether to accept the request to establish a connection. If the request to establish a connection is accepted, the data transmission module of the nondestructive testing device establishes a data transmission channel based on WebRTC real-time communication and IM instant messaging for both parties; if the request is not accepted, a rejection instruction is sent back and the connection request is disconnected; After the data transmission channel is established, any client or any nondestructive testing device sends a heartbeat signal to the other party at regular intervals. When the heartbeat signal sent by the other client or any nondestructive testing device is not received within the accumulated preset time, it is determined that the other party is offline; if the offline end is the nondestructive testing device, the established data transmission channel is disconnected; if the offline end is not the nondestructive testing device, the data transmission channel is maintained until the measurement is completed; Among them, any client is any one of the non-destructive testing equipment or mobile clients, and the mobile client is a mobile phone or a computer.
