Inspection device and inspection system

Abstract

The present disclosure provides an inspection device and an inspection system. The inspection device comprises a sensor module, a storage box and AR glasses. The sensor module comprises a plurality of sensor assemblies, each of which is used to collect different environmental data of an inspection area. The sensor assembly comprises a connecting piece and a first communication unit. The connecting piece is used to detachably connect the sensor assembly to the AR glasses. The first communication unit is used for wireless communication with the storage box. The storage box comprises a box body, a communication module and a processing module. The box body is provided with a storage compartment for storing the sensor module. The communication module is used for wireless communication with the sensor module and the AR glasses. The processing module is used to process the environmental data to determine abnormal environmental data and transmit abnormal prompt information to the AR glasses for display. The AR glasses comprise a lens and a temple. The lens is used to display the abnormal prompt information transmitted by the storage box. The temple can be detachably connected to the connecting piece.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of inspection, and more particularly to an inspection device and an inspection system. BACKGROUND

[0002] In daily work production, stable operation of equipment or instruments is crucial. At present, inspection mostly relies on artificial periodic on-site viewing, and artificial inspection is low in efficiency and is easily affected by subjective factors of workers. Most of the inspection devices on the market have the problem of single function in order to meet portability, and have limited sensing ability for inspection environment. SUMMARY

[0003] The present disclosure provides an inspection device and an inspection system.

[0004] According to an aspect of the present disclosure, an inspection device is provided, comprising a sensor module, a storage box and AR glasses; the sensor module comprises a plurality of sensor assemblies, and the plurality of sensor assemblies are respectively used to collect different environmental data of an inspection area; the sensor assembly comprises a connecting piece and a first communication unit, the connecting piece is used to detachably connect the sensor assembly to the AR glasses, and the first communication unit is used to wirelessly communicate with the storage box; the storage box comprises a box body and a communication module and a processing module accommodated in the box body; the box body is provided with an accommodation bin used to accommodate the sensor module; the communication module is used to wirelessly communicate with the sensor module and the AR glasses; the processing module is used to process environmental data transmitted by the sensor assembly to determine abnormal environmental data, and transmit abnormal prompt information to the AR glasses for display when the abnormal environmental data is determined; the AR glasses comprise a lens, a lens leg and a second communication unit; the lens is used to display the abnormal prompt information transmitted by the storage box; the lens leg can be detachably connected with the connecting piece; and the second communication unit is used to wirelessly communicate with the storage box.

[0005] According to the inspection device of at least one embodiment of the present disclosure, the communication module is further used to receive inspection instruction information transmitted by an external server, and send the inspection instruction information to the AR glasses for display; wherein the inspection instruction information comprises a type of the sensor assembly required for inspection.

[0006] According to the inspection device of at least one embodiment of the present disclosure, the type of the sensor assembly comprises a ranging sensor, a temperature measuring sensor and an image acquisition sensor.

[0007] According to the inspection device of at least one embodiment of the present disclosure, the type of the sensor assembly comprises a composite sensor, and the composite sensor comprises at least two of a ranging module, a temperature measuring module and an image acquisition module.

[0008] According to at least one embodiment of the inspection device of the present disclosure, the sensor assembly further comprises a connecting structure, the connecting structure is detachably connected with the connecting structure of another sensor assembly to connect two sensor assemblies, and the connecting member of one of the two sensor assemblies is detachably connected with the temple when the two sensor assemblies are connected, so that both of the two sensor assemblies are connected to the AR glasses.

[0009] According to at least one embodiment of the inspection device of the present disclosure, the connecting member comprises two clamping arms, and the temple is clamped between the two clamping arms when the sensor assembly is connected to the AR glasses.

[0010] According to at least one embodiment of the inspection device of the present disclosure, the connecting member comprises a magnetic attraction unit, and the temple comprises a first magnetic attraction part which is magnetically connected with the magnetic attraction unit.

[0011] According to at least one embodiment of the inspection device of the present disclosure, the outer surface of the storage box comprises a second magnetic attraction part which is magnetically connected with the magnetic attraction unit.

[0012] According to at least one embodiment of the inspection device of the present disclosure, the sensor assembly further comprises a charging contact, and the storage box further comprises a power supply module accommodated in the box body, the power supply module comprises a power supply contact which is at least partially exposed to the storage compartment, and when the sensor assembly is stored in the storage compartment, the charging contact is in contact with the power supply contact, so that the power supply module can output current to the sensor assembly.

[0013] According to at least one embodiment of the inspection device of the present disclosure, the storage box further comprises a storage module accommodated in the box body, and the storage module stores abnormal data samples; the processing module processes the environmental data transmitted by the sensor assembly to determine abnormal environmental data, comprising: the processing module compares the environmental data with the abnormal data samples to determine the abnormal environmental data.

[0014] According to at least one embodiment of the inspection device of the present disclosure, the processing module is used to process the environmental data transmitted by the sensor assembly to determine abnormal environmental data, comprising: if the environmental data is image data, the edge computing capability of the processing module is applied for AI recognition to determine whether the environmental data is abnormal environmental data.

[0015] According to at least one embodiment of the present disclosure, the inspection device further comprises a storage module received in the box body, the storage module being configured to store raw environmental data collected by the sensor assembly and abnormal environmental data determined by the processing module; the communication module is further configured to transmit the raw environmental data and the abnormal environmental data to an external server; receive abnormal prompt information transmitted by the external server; and transmit the abnormal prompt information transmitted by the external server to the AR glasses for display.

[0016] According to at least one embodiment of the present disclosure, the inspection device further comprises a wireless earphone, the wireless earphone being connected to the box through wireless communication to realize data interaction; the processing module is further configured to transmit abnormal prompt audio to the wireless earphone for voice broadcast when the abnormal environmental data is determined.

[0017] According to at least one embodiment of the present disclosure, the box body further comprises an earphone compartment for receiving the wireless earphone; the box further comprises a power supply module received in the box body, the power supply module comprising earphone power supply contacts exposed at least partially from the earphone compartment; when the wireless earphone is received in the earphone compartment, the earphone charging contacts of the wireless earphone are in contact with the earphone power supply contacts to enable the box to output current to the wireless earphone.

[0018] According to at least one embodiment of the present disclosure, the wireless earphone comprises a microphone module configured to record voice audio of a user and transmit the voice audio to the box, and the box is further configured to transmit the voice audio to an external server.

[0019] According to an aspect of the present disclosure, an inspection system is provided, comprising the inspection device of any one of the above embodiments, and further comprising a server, the server being connected to the inspection device through wireless communication to realize data interaction; the server comprises a model module configured with an abnormality identification large model, the model module being configured to input environmental data transmitted by the inspection device into the abnormality identification large model to obtain abnormal prompt information output by the abnormality identification large model. BRIEF DESCRIPTION OF DRAWINGS

[0020] The accompanying drawings illustrate exemplary embodiments of the present disclosure and together with the description, explain the principles of the present disclosure, in which the drawings are included to provide further understanding of the present disclosure and constitute a part of the specification.

[0021] Figure 1 is a structural schematic block diagram of an inspection device according to an embodiment of the present disclosure.

[0022] Figure 2is a schematic diagram of an inspection device according to an embodiment of the present disclosure.

[0023] Figure 3 is a schematic diagram of a scene in which a user wears AR glasses. DETAILED DESCRIPTION

[0024] The present disclosure will be further described below in conjunction with the accompanying drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the related content, and not to limit the present disclosure. In addition, it should be noted that only parts related to the present disclosure are shown in the drawings for ease of description.

[0025] It should be noted that the embodiments and features in the embodiments of the present disclosure can be combined with each other without conflict. The technical solutions of the present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.

[0026] Unless otherwise specified, the exemplary embodiments / instances shown will be understood to provide exemplary features of various details that can implement the technical concepts of the present disclosure in practice. Therefore, unless otherwise specified, the features of various embodiments / instances can be additionally combined, separated, interchanged and / or rearranged without departing from the technical concepts of the present disclosure.

[0027] In the inspection scene, the inspection personnel usually need to go to multiple inspection sites to determine whether the equipment, instruments, environment and other elements of the multiple inspection sites are abnormal, so as to timely warn and handle the safety hazards and prevent safety failures or accidents.

[0028] At present, there are some detection devices for inspection on the market. Unlike detection devices placed in fixed positions for detection, detection devices for inspection need to have a certain portability to facilitate the inspection personnel to carry the detection devices for movement and detection.

[0029] However, in order to meet the portability of the inspection device, the detection capability of the inspection device on the market is relatively limited, and there is a problem of single function. If more hardware is installed on the inspection device in order to improve the functionality of the inspection device, the weight of the inspection device will be increased, which will reduce its portability and increase the burden of the inspection personnel.

[0030] Therefore, the present disclosure provides the following technical solutions to provide a portable inspection device that can balance portability and rich functionality.

[0031] Figure 1 shows a structural schematic block diagram of an inspection device according to an embodiment of the present disclosure.

[0032] As Figure 1As shown, the inspection device includes a sensor module, a storage box and AR (Augmented Reality) glasses. The sensor module is used to collect environmental data of the inspection area. The storage box is used to store the sensor module, making the sensor module easy to carry. On the other hand, the storage box can be wirelessly connected to the sensor module and the AR glasses for data transmission. On the other hand, the storage box can receive the environmental data collected by the sensor module and process the environmental data collected by the sensor module to determine whether there is an anomaly in the inspection area, so that when there is an anomaly, the anomaly prompt information can be transmitted to the AR glasses for display, which plays a role of early warning and prompting for the inspection personnel wearing the AR glasses. In addition to being used to display anomaly prompt information, the AR glasses are also used to carry the sensor module, so that the inspection personnel can also be equipped with the sensor module for detection while wearing the AR glasses. In this way, the inspection personnel does not need to hold the sensor module for detection, so that the inspection personnel can operate other equipment while using the sensor module to collect environmental data.

[0033] Please refer to Figure 2 , Figure 2 A schematic diagram of an inspection device 1000 according to an embodiment of the present disclosure is shown.

[0034] The sensor module includes a plurality of sensor components 100. The plurality of sensor components 100 are respectively used to collect different environmental data of the inspection area.

[0035] The environmental data of the inspection area refers to a set of information related to device operation and human activity that can be collected through systematic means within the inspection area, which can be used to assess the potential risks of the inspection area. The plurality of sensor components 100 can be different types of sensor components 100, which can collect different types of environmental data, such as temperature, humidity, distance, image data, etc., which are not limited herein. The more types of sensor components 100, the more types of environmental data that can be collected, making the detection function more diverse.

[0036] The sensor assembly 100 comprises a connecting piece for detachably connecting the sensor assembly 100 to the AR glasses 200. During the inspection, a user (such as an inspector) can select any one of the plurality of sensor assemblies 100 to be connected to the AR glasses 200 according to the inspection requirements to collect environmental data. In this way, when more detection functions are needed, more sensor assemblies 100 can be connected to the AR glasses 200 to collect more types of environmental data. When certain environmental data is not needed to be collected, the corresponding sensor assembly 100 can be detached from the AR glasses 200 to reduce the weight of the AR glasses 200 and the burden of the user wearing the AR glasses 200. Thus, the inspection device 1000 provided by the present disclosure can balance the functionality and portability.

[0037] The detachable connection mode can be achieved by a snap structure, a magnetic attraction structure, a sliding rail and a sliding block guiding structure, and the like, which are convenient and quick to disassemble and assemble, so as to facilitate the user to install and disassemble the sensor assembly 100. In this way, the user can conveniently connect a certain sensor assembly 100 to the AR glasses 200 when it is needed, and disassemble and store it in the storage box when it is not needed.

[0038] The sensor assembly 100 further comprises a first communication unit for wirelessly communicating with the storage box to perform data transmission between the sensor and the storage box. In this way, the sensor assembly 100 can transmit the collected environmental data to the storage box for data processing through the first communication unit.

[0039] In an embodiment, the sensor assembly 100 and the storage box are wirelessly connected based on a Mesh network architecture. The storage box serves as a master node of the Mesh network architecture, and the plurality of sensor assemblies 100 serve as slave nodes of the Mesh network architecture, and the slave nodes can perform data transmission with the master node. The Mesh network architecture supports dynamic addition and deletion of slave nodes. In this way, when a sensor assembly 100 needs to be connected to the AR glasses 200, the newly connected sensor assembly 100 can be dynamically added as a slave node of the Mesh network architecture; when the sensor assembly 100 is detached from the AR glasses 200, the corresponding slave node in the Mesh network architecture can be dynamically deleted. In addition, the data transmission between the master node and the slave nodes of the Mesh network architecture has the advantages of low latency and low power consumption. The low latency performance is beneficial to the instant data uploading of the sensor assembly 100, so that the storage box can timely detect the abnormality or risk problem of the inspection area and improve the timeliness of the abnormality or risk detection. The low power consumption performance is beneficial to the endurance of the sensor assembly 100 to support long-time inspection work.

[0040] In one embodiment, the first communication unit can be a radio frequency chip, for example, a radio frequency chip supporting Mesh networking, to ensure that the first communication unit can support a Mesh network architecture, wherein the Mesh networking can be, for example, a WiFi networking mode.

[0041] Referring to Figure 1 and in combination with Figure 2 The storage box 300 includes a box body 301 and a communication module and a processing module accommodated in the box body 301.

[0042] The box body 301 is provided with a storage compartment 302 for accommodating the sensor assembly 100. Figure 2 In the schematic view, the sensor assembly 100 is accommodated in the storage compartment 302, which causes a certain degree of obstruction to the storage compartment 302.

[0043] In one embodiment, the storage space of the storage compartment 302 corresponds to the number of the plurality of sensor assemblies 100. For example, the number of the storage compartments 302 is equal to the number of the plurality of sensor assemblies 100, and each sensor assembly 100 can be accommodated in the corresponding storage compartment 302 to ensure that each sensor assembly 100 can be simultaneously accommodated in the storage compartment 302. For another example, the storage space of the storage compartment 302 is sufficient to simultaneously accommodate each sensor assembly 100.

[0044] In one embodiment, the storage compartment 302 is a groove structure formed on the outer surface of the box body 301. When the sensor assembly 100 is accommodated in the storage compartment 302, the sensor assembly 100 is at least partially exposed to the box body 301 to facilitate the user to take out the sensor from the storage compartment 302. In one embodiment, the storage box 300 further includes a cover body 303 which can be connected with the box body 301 on the side of the box body 301 provided with the storage compartment 302 to shield the sensor assembly 100 accommodated in the storage compartment 302 and play a certain protective role for the sensor assembly 100.

[0045] The inner part of the box body 301 has a certain storage space, and the communication module and the processing module are located in the storage space in the inner part of the box body 301, so that the box body 301 plays a certain protective role for the communication module and the processing module.

[0046] The communication module is used for wireless communication with the sensor assembly 100 and the AR glasses 200 for data transmission. In one embodiment, the communication module is electrically connected with the processing module, so that the communication module and the processing module can perform data transmission, so that the processing module can receive the data collected by the sensor assembly 100 outside the storage box 300 through the communication module and transmit data to the AR glasses 200 outside the storage box 300 through the communication module.

[0047] The processing module is configured to process the environmental data collected by the sensor assembly 100 to determine whether there is abnormal data in the environmental data. If the processing module determines that there is abnormal data in the environmental data, it indicates that the index corresponding to the environmental data in the inspection area is abnormal, and the user needs to be warned to inform the user of the potential danger in the inspection area. Based on this, when the processing module determines the abnormal environmental data, the abnormal prompt information is transmitted to the AR glasses 200 for display to warn the user.

[0048] In one embodiment, different types of abnormal data correspond to different abnormal prompt information. For example, when the abnormal data is temperature data, the abnormal prompt information is used to warn the abnormal temperature, such as high temperature warning or low temperature warning. The abnormal prompt information can include text, pattern, image, etc. Warning content, which is not limited here.

[0049] In one embodiment, when the abnormal data includes a specific numerical value, the corresponding abnormal prompt information contains the numerical value of the abnormal data, which provides more accurate information, such as the abnormal prompt information is "temperature: 60℃, numerical value is abnormal".

[0050] In one embodiment, the abnormal prompt information is a preset prompt information. For example, when detecting temperature data abnormality, the processing module retrieves the abnormal prompt information corresponding to the abnormal temperature data from the database for storing prompt information and transmits it to the AR glasses 200 for display.

[0051] In yet another embodiment, the abnormal prompt information can be a prompt information generated by the processing module in real time. For example, the processing module is built-in with an AI (Artificial Intelligence) processing model, which is trained to detect whether the environmental data input into the model is abnormal data, and if it is abnormal data, output an abnormal prompt information that can warn this type of abnormality.

[0052] Please refer to Figure 1 and Figure 2 , the AR glasses 200 include a lens 201, a temple 202 and a second communication unit.

[0053] The lens 201 is configured to display the abnormal prompt information transmitted by the storage box 300. The lens 201 of the AR glasses 200 can project virtual information into the human eye, so that the user can see the virtual abnormal prompt information while seeing the real reality scene. In this way, the user can see the abnormal prompt information while seeing the real scene. In one embodiment, the abnormal prompt information also includes steps to eliminate the abnormality. In this way, the user can refer to the instructions of the steps to eliminate the abnormality while observing the environmental information of the equipment, personnel, etc. in the real scene to perform the corresponding steps to eliminate the abnormality.

[0054] The temple 202 is detachably connected with the connecting piece, so that the sensor assembly 100 can be detachably connected with the temple 202 through the connecting piece.

[0055] Please refer to Figure 3 , Figure 3 is a schematic diagram of a scene in which a user wears the AR glasses 200. In an embodiment, when the user wears the AR glasses 200, the sensor assembly 100 can be connected to the temple 202 at a position between the ear of the human body and the lens 201 of the AR glasses 200, so as to avoid the sensor assembly 100 from contacting the human body and causing discomfort to the wearer or affecting the detection effect of the sensor assembly 100.

[0056] When the user performs inspection, part of the sensor assemblies 100 in the plurality of sensor assemblies 100 can be selected according to the needs and connected to the temple 202 for use. For example, when a first area is inspected, two sensor assemblies 100 in the plurality of sensor assemblies 100 are needed, and the two sensor assemblies 100 are connected to the temple 202 for use, so as to ensure that the inspection device 1000 can support the functional requirements of the first area inspection. When a second area is inspected, only one of the two sensor assemblies 100 connected to the temple 202 is needed, and the other sensor assembly 100 that is not needed can be removed, so as to reduce the weight of the AR glasses 200 carrying the sensor assembly 100 and reduce the burden on the user.

[0057] In an embodiment, the AR glasses 200 dynamically display the abnormal prompt information transmitted by the storage box 300. For example, when the temperature data is abnormal, the AR glasses 200 display the abnormal prompt information of the temperature abnormality transmitted by the storage box 300. When the temperature data is abnormal and the humidity data collected by the sensor assembly 100 for collecting humidity data is determined to be abnormal environment data, the storage box 300 transmits the abnormal prompt information of the humidity abnormality to the AR glasses 200, and the AR glasses 200 newly display the abnormal prompt information of the humidity abnormality while displaying the abnormal prompt information of the temperature abnormality. If the humidity data collected by the sensor assembly 100 for collecting humidity data returns to normal while the AR glasses 200 display the abnormal prompt information of the temperature abnormality and the abnormal prompt information of the humidity abnormality, the storage box 300 transmits a control instruction for canceling the abnormal prompt information of the humidity abnormality to the AR glasses 200, so that the AR glasses 200 display the abnormal prompt information of the humidity abnormality is eliminated, and only the abnormal prompt information of the temperature abnormality is displayed. In this way, the abnormal prompt information displayed by the AR glasses 200 has good timeliness.

[0058] The second communication unit is used for wireless communication with the storage box 300 for data transmission, so that the storage box 300 can transmit virtual information to the AR glasses 200 for display.

[0059] In one embodiment, the first communication unit, the second communication unit and the communication module of the storage box 300 are wirelessly connected based on a Mesh network architecture. The communication module acts as a master node of the Mesh network architecture, and the first communication unit and the second communication unit act as slave nodes of the Mesh network architecture.

[0060] In one embodiment, the second communication unit can be a radio frequency chip, such as a radio frequency chip supporting Mesh networking, to ensure that the second communication unit can support the Mesh network architecture.

[0061] In summary, the inspection device 1000 of the embodiment of the present disclosure provides a plurality of sensor assemblies 100 for collecting different environmental data, so that the inspection device 1000 has multiple detection functions and can meet the detection needs of multiple parameters in a complex industrial environment, avoiding the problem of single function of the inspection device 1000. Moreover, the plurality of sensor assemblies 100 of the inspection device 1000 can be stored in the storage box 300, which is convenient to carry and has high portability. During inspection, the sensor assemblies 100 to be used can be connected to the AR glasses 200 to collect environmental data. In one aspect, the user does not need to hold the sensor assemblies 100 to collect environmental data, which can free the user's hands and facilitate the user to perform other work while collecting environmental data during inspection. In another aspect, the user can reduce the sensor assemblies 100 connected to the AR glasses 200 according to the functional requirements of the inspection area, and only connect the necessary sensor assemblies 100 to the AR glasses 200 to collect environmental data, so that the AR glasses 200 carrying the sensor assemblies 100 are lighter and more portable.

[0062] Please refer to Figure 1 and Figure 2 In one embodiment, the communication module of the storage box 300 is wirelessly connected to an external server. The server can issue inspection instruction information to the inspection device 1000, the communication module receives the inspection instruction information transmitted by the server, and sends the inspection instruction information to the AR glasses 200 for display. In this way, the inspection device 1000 can provide visual inspection instructions to the user in real time.

[0063] The communication module is wirelessly connected to the server, so that the inspection device 1000 can interact with the server in real time. In this way, it can be ensured that the information displayed by the AR glasses 200 transmitted by the server has good timeliness. In one embodiment, when the inspection instruction changes, the server can transmit the changed inspection instruction to the inspection device 1000, and the communication module can transmit the changed inspection instruction information to the AR glasses 200 to cover the changed inspection instruction information for display, so that the user can receive high-timeliness inspection instruction information in real time.

[0064] In an embodiment, the inspection instruction information includes a route map of the inspection. For example, the inspection instruction information can include a map containing each inspection area, and display navigation of the inspection route. In this way, the user can view the navigation route displayed by the AR glasses 200 while observing the real scene moving, which facilitates the user to perform the inspection according to the specific route.

[0065] Further, in an embodiment, the communication module of the storage box 300 uploads the real-time location information of the user to the server. In this way, the back-end platform can obtain the real-time inspection path of the user from the server, so as to determine whether the user deviates from the inspection path, or whether the user arrives at the inspection area on time, thereby supervising the inspection task of the user.

[0066] In an embodiment, the inspection instruction information includes inspection steps of each inspection area. By displaying the inspection steps on the AR glasses 200, the user can refer to the virtual inspection steps while observing the real scene to perform the corresponding steps, which is very convenient.

[0067] In an embodiment, the inspection instruction information includes the type of the sensor assembly 100 required for the inspection. For example, the content of the inspection instruction information includes each inspection area, and the type of the sensor assembly 100 required for each inspection area. For example, the inspection instruction information can indicate that two types of sensor assemblies 100 for collecting temperature data and image data are required in the first area, and a sensor assembly 100 for collecting distance data is required in the second area. In this way, when the user arrives at the inspection area, the user can refer to the inspection instruction information to select the sensor assembly 100 corresponding to the inspection area to be connected to the AR glasses 200, so that all sensor assemblies 100 do not need to be connected to the AR glasses 200 every time the inspection is performed, thereby reducing the wearing burden of the user, and making the AR glasses 200 with the sensor assembly 100 more portable.

[0068] In an embodiment, the type of the sensor assembly 100 includes a distance measuring sensor, a temperature measuring sensor, and an image acquisition sensor.

[0069] The distance measuring sensor is used to collect distance data in the environment of the inspection area. For example, the distance between the user and the device, the distance between the devices, the distance between the user and other personnel in the environment, and the like, which are not limited here.

[0070] In one embodiment, the distance measuring sensor can be an ultrasonic radar, which measures the distance between the user and the target object based on the principle of ultrasonic distance measurement. The target object can be a person or an object. Based on this, the distance data measured by the distance measuring sensor can be used to determine whether the distance between the user and the target object is a safe distance. If the distance between the user and the target object is less than a safe distance threshold, the distance data is determined as abnormal distance data when the receiving box 300 receives the data, and the AR glasses 200 displays corresponding abnormal prompt information, which can prompt the user to pay attention to maintaining a safe distance.

[0071] Moreover, based on the principle of ultrasonic distance measurement, if the user moves during the distance measurement, the travel distance when the ultrasonic wave is emitted and the travel distance when the ultrasonic wave returns are different. Based on the difference between the travel distance of the ultrasonic wave and the time consumed, the speed of the user during the movement can be calculated. In this way, when the ultrasonic radar is used as the distance measuring sensor, the distance measuring sensor can simultaneously collect distance data and speed data. In some application scenarios, the user drives a vehicle for inspection. Since the user can see the real environment and virtual information at the same time when wearing the AR glasses 200, the virtual information will block the user's view to a certain extent, and therefore the user's moving speed should not be too fast to avoid causing accidents. In this case, when the receiving box 300 receives speed data collected by the distance measuring sensor that exceeds a safe data threshold, the speed data is determined as abnormal speed data, and the AR glasses 200 displays corresponding abnormal prompt information, which can prompt the user to pay attention to maintaining a safe speed.

[0072] The temperature sensor is used to collect the temperature of the target object in the environment of the inspection area. The target object can be a person or an object.

[0073] In one embodiment, the temperature measuring sensor can be an infrared temperature sensor, which collects the temperature of the target object by using the principle of infrared temperature measurement. In this way, when collecting temperature data by using the temperature measuring sensor, the temperature measuring sensor does not need to be in contact with the target object. On the one hand, this can avoid the user from being injured when approaching a high-temperature object for temperature measurement. On the other hand, this can measure the body temperature of the target person while maintaining a certain distance, thereby avoiding the risk of disease transmission.

[0074] In one embodiment, when the receiving box 300 receives temperature data collected by the temperature measuring sensor that is not within a normal temperature range, the temperature data is determined as abnormal temperature data, and the AR glasses 200 displays corresponding abnormal prompt information, so that the user can take timely measures.

[0075] The image collecting sensor is used to collect image data or video data in the environment of the inspection area.

[0076] In an embodiment, the image acquisition sensor can be a camera for taking a video data composed of multiple frames of image data of the inspection area.

[0077] In an embodiment, the video data is mainly used for identifying whether the worker working in the inspection area complies with the safety specifications, such as correctly wearing a safety helmet, correctly wearing a work uniform and work shoes, and the like. When the storage box 300 identifies that the worker in the video data collected by the image acquisition sensor does not wear a safety helmet, the video data is determined as abnormal video data, and the AR glasses 200 displays corresponding abnormal prompt information so that the user can take timely response measures.

[0078] In an embodiment, the type of the sensor assembly 100 includes a composite sensor including at least two of the distance measurement module, the temperature measurement module, and the image acquisition module. In this way, the composite sensor can simultaneously have the acquisition functions of at least two different types of data, so that when the composite sensor is connected to the AR glasses 200, two or more types of environmental data can be acquired by using a single composite sensor. For example, the composite sensor includes a distance measurement module and a temperature measurement module housed in the same housing, and can simultaneously provide distance measurement and temperature measurement functions.

[0079] In an embodiment, the sensor assembly 100 further includes a connecting structure capable of detachably connecting with the connecting structure of another sensor assembly 100 to connect the two sensor assemblies 100. When the two sensor assemblies 100 are connected, the connecting member of one of the sensor assemblies 100 can be detachably connected with the temple 202, so that both of the sensor assemblies 100 are connected to the AR glasses 200. In this way, any two of the multiple sensor assemblies 100 can be assembled into one, and the two sensor assemblies 100 can be connected to the AR glasses 200 by using only the connecting member of one of the sensor assemblies 100 connected with the temple 202, so that the upper limit of the number of sensor assemblies 100 connectable to the AR glasses 200 can be increased.

[0080] In this way, the detachable connection between the two connecting structures can be achieved by using a snap structure, a magnetic attraction structure, a sliding rail and a sliding block guiding structure, and the like, which are convenient and quick to disassemble and assemble, so as to facilitate the quick disassembly and assembly between the two sensor assemblies 100.

[0081] Please refer to Figure 3In an embodiment, the sensor assembly 100 has a measurement side 101, which is a side of the sensor assembly 100 from which a signal is emitted or received, including an optical signal, an electrical signal, a wave signal, and the like. For example, when the sensor assembly 100 is an image acquisition sensor, the side of the image acquisition sensor on which a lens is located is the measurement side 101. When the sensor assembly 100 is an infrared temperature sensor, the side of the infrared temperature sensor from which infrared light is emitted is the measurement side 101. Based on this, the connector of the sensor assembly 100 can be located on the other side adjacent to the measurement side 101. In this way, when the sensor assembly 100 is connected to the temple 202 of the AR glasses 200, the orientation of the measurement side 101 can be substantially the same as the orientation of the human eye, so that the sensor assembly 100 can acquire data of a target object in the field of view of the human eye. When the user needs to switch the target object of data acquisition, the user only needs to make the target object fall within the field of view of the user, so that the data acquisition method is simple and convenient.

[0082] In an embodiment, the connector of the sensor assembly 100 includes two clamping arms, and when the sensor assembly 100 is connected to the AR glasses 200, the temple 202 is clamped between the two clamping arms. The clamping manner of the clamping arms clamping the temple 202 facilitates the quick installation and disassembly of the sensor assembly 100, and has good convenience.

[0083] In an example, when the AR glasses 200 are worn, there is a relatively large gap between the connection position of the lens 201 and the temple 202 and the face. When the clamping arms clamp the temple 202 at the gap position, the clamping arms can avoid abutting against the face to cause discomfort to the user.

[0084] Further, in an embodiment, the clamping arms of the sensor assembly 100 extend from the housing of the sensor assembly 100, one of the clamping arms is close to the housing of the sensor assembly 100, and the other clamping arm is away from the housing of the sensor assembly 100. The side of the clamping arm away from the housing of the sensor assembly 100 is provided with a protruding structure, and the inner side of the temple 202 is provided with a recess structure. When the clamping arms clamp the temple 202, the protruding structure can be placed in the recess structure, so that the connection between the clamping arms and the temple 202 is more stable, to prevent the sensor assembly 100 from shaking relative to the temple 202. In this way, when the sensor assembly 100 is an image acquisition sensor, the problem of image blurring caused by shaking can be reduced.

[0085] In an embodiment, the clamping arms are made of elastic material, and when the clamping arms clamp the temple 202, the elastic force of the two clamping arms makes the two clamping arms have a tendency to approach each other, so as to tighten the temple 202, and the connection between the clamping arms and the temple 202 is more stable.

[0086] In another embodiment, the connection member comprises a magnetic unit, and the temple 202 comprises a first magnetic part capable of being magnetically connected with the magnetic unit. The magnetic connection facilitates quick installation and dismounting of the sensor assembly 100, and is convenient.

[0087] In one embodiment, the temple 202 is made of a magnetic material. In this way, any position of the temple 202 can be used as the first magnetic part to be magnetically connected with the magnetic unit, and the temple 202 has a large connectable area.

[0088] In another embodiment, the first magnetic part is located at a part of the temple 202, and the temple 202 is only magnetic at the first magnetic part. In this way, the magnetic unit connected with the first magnetic part can only be connected with the temple 202 at the position of the first magnetic part, and the magnetic unit can be prevented from sliding on the temple 202, and the connection stability of the sensor assembly 100 is improved.

[0089] In one embodiment, the outer surface of the storage box 300 comprises a second magnetic part capable of being magnetically connected with the magnetic unit. In this way, the sensor assembly 100 can be connected with the storage box 300 to collect environmental data, and various carrying manners of the sensor assembly 100 are provided. For example, when data collection of a fixed target object is needed, the storage box 300 can be placed at a fixed position, and the sensor assembly 100 can be magnetically connected with the outer surface of the storage box 300, so that the measurement side 101 of the sensor assembly 100 is aligned with the target object. In this way, the user does not need to bear the weight of the sensor assembly 100, and the burden of the user is reduced.

[0090] In one embodiment, the second magnetic part is located on the outer surface of the cover 303 of the storage box 300. In this way, the sensor assembly 100 can be connected with the outer surface of the cover 303 when the cover 303 is closed on the box body 301, and the magnetic connection between the sensor assembly 100 and the storage box 300 does not affect the closing of the cover 303.

[0091] Please refer to Figure 2 In one embodiment, the sensor assembly 100 further comprises a charging contact for connecting electric current to the sensor assembly 100 to charge the sensor assembly 100. For example, the sensor assembly 100 further comprises a rechargeable battery, such as a lithium battery. The charging contact is used to connect electric current to the rechargeable battery.

[0092] Please refer to Figure 1In one embodiment, the receiving box 300 further comprises a power supply module received in the box body 301, the power supply module comprising power supply contacts exposed at least partially from the receiving cavity 302. When the sensor assembly 100 is received in the receiving cavity 302, the charging contacts are in contact with the power supply contacts, so that the power supply module can output current to the sensor assembly 100. In this way, the sensor assembly 100 can be charged when it is received in the receiving cavity 302, so that the sensor assembly 100 has a longer endurance.

[0093] In one embodiment, the receiving box 300 further comprises a storage module received in the box body 301, which can be used to store data received by the communication module, such as data transmitted by the sensor assembly 100 and the server to the communication module.

[0094] In one embodiment, the storage module stores abnormal data samples, which are used to determine whether the environmental data is abnormal. In one embodiment, different types of environmental data correspond to the same type of abnormal data samples, such as temperature data corresponding to abnormal temperature data samples. When the processing module processes the environmental data, the processing module can obtain the environmental data to be processed and the same type of abnormal data samples from the storage module, and compare the environmental data and the abnormal data samples to determine the abnormal environmental data. In this way, the processing module can complete the processing of the environmental data using local abnormal data sample data without networking.

[0095] In some embodiments of the present disclosure, the environmental data can include image data. Preferably, the processing module of the present disclosure processes the environmental data transmitted by the sensor assembly to determine abnormal environmental data, comprising: if the environmental data is image data, applying the edge computing capability of the processing module to determine whether the environmental data is abnormal environmental data through AI recognition.

[0096] When the environmental data is numerical data such as temperature, humidity, distance, etc., the corresponding abnormal data sample can be an abnormal data threshold, an abnormal data interval, a normal data interval, etc. of the same type of data. In this way, whether the environmental data is abnormal environmental data can be determined by comparing whether the environmental data is greater than or less than the abnormal data threshold, whether it is within the abnormal data interval, whether it is within the normal data interval, etc. For example, when the environmental data is a temperature value, the corresponding abnormal temperature sample can be a normal temperature interval. If the collected temperature value is within the normal temperature interval, the temperature value is normal; otherwise, if the collected temperature value is outside the normal temperature interval, the collected temperature value is determined to be abnormal environmental data.

[0097] When the environmental data is image data such as images and videos, the corresponding abnormal data sample can be an image of a specific feature. For example, in a scenario for identifying whether a worker performing an inspection task in an inspection area complies with safety regulations, the key features for judging whether the safety regulations are complied with include a safety helmet, a work uniform, and work shoes. Based on this, images of the safety helmet, the work uniform, and the work shoes can be taken as abnormal data samples. The processing module identifies a face in an image frame collected by the sensor assembly 100 to determine whether the image frame contains a person, and compares the image frame with the abnormal data samples when a person is identified to further identify whether the person in the image frame wears a safety helmet and a work uniform and work shoes. If it is identified through the comparison that the person in the image frame does not wear any of the safety helmet, the work uniform, and the work shoes, the image frame is determined to be abnormal environmental data.

[0098] In one embodiment, the processing module is locally deployed with a neural network model for image processing, which can perform feature recognition on an input image frame in an offline state to determine whether the image frame contains a certain feature, such as whether it contains a face or a human being, and determine whether the image frame does not contain a feature in the abnormal data sample, such as whether it does not contain a safety helmet, a work uniform, and work shoes, in combination with the abnormal data sample, to finally output the recognition result.

[0099] In one embodiment, the communication module is further configured to transmit the original environmental data and the abnormal environmental data to an external server. In this way, a high-performance processor can be deployed on the external server to process the original environmental data to detect the abnormal environmental data, and the abnormal environmental data determined by the processing module can be further analyzed and processed to obtain more refined analysis results and output corresponding abnormal prompt information. The abnormal prompt information output by the server is transmitted to the communication module, which transmits the abnormal prompt information to the AR glasses 200 for display. In this way, based on the fact that the storage box 300 has a certain edge computing capability to process environmental data to obtain abnormal prompt information, the inspection device 1000 can also use the powerful computing power of the server to perform more in-depth data analysis to obtain abnormal prompt information containing more refined analysis results. That is, in the case of relatively poor network environment, at least the abnormal prompt information output by the storage box 300 can be obtained; in the case of good network environment, more refined abnormal prompt information output by the server can be obtained, so that the inspection device 1000 can adapt to various network environments.

[0100] In one embodiment, when a user collects environmental data of an inspection area, at least image data needs to be collected, which is used to determine the type of a target object in the inspection area, for example, to determine whether the target object is a person or a specific device. The purpose of determining the type of the target object is to more accurately analyze other environmental data collected at the same time based on the type of the target object.

[0101] For example, the server is deployed with an anomaly identification large model for processing the environment data transmitted by the inspection device 1000 to identify anomalies therein, including raw environment data collected by sensors and abnormal environment data determined by the processing module, and outputting corresponding abnormal prompt information when identifying abnormal environment data. When the environment data with the same timestamp includes image data and temperature data, if the type of the target object is identified as human based on the image data, the determination of whether the temperature data is abnormal data can be performed by comparing the normal body temperature of the human body with the collected temperature data. If the type of the target object is identified as a certain device based on the image data, the determination of whether the temperature data is abnormal data can be performed by comparing the temperature of the device under normal working conditions with the collected temperature data.

[0102] Further, when the collected temperature data is not the temperature of the device under normal working conditions, the current possible abnormal working condition of the device can also be predicted according to the numerical value of the temperature data to remind the abnormal working condition in the output abnormal prompt information. For example, assuming that the target object is identified as an electric motor device based on the image data, and the temperature data with the same timestamp is 60°C, which exceeds the temperature of such electric motor device under normal working conditions. Assuming that the reason why the temperature of such electric motor device reaches 60°C is due to overload, the overload warning reminder of such electric motor device is included in the abnormal prompt information output by the server.

[0103] Please refer to Figure 1 and Figure 2 In one embodiment, the inspection device 1000 further includes a wireless earphone 400. The wireless earphone 400 and the storage box 300 are connected through wireless communication to realize data interaction. For example, the storage box 300 is the master node of the Mesh network architecture, and the wireless earphone 400 is the slave node of the Mesh network architecture. The master node and the slave node are wirelessly connected to realize data interaction.

[0104] In one embodiment, the processing module is further configured to transmit abnormal prompt audio to the wireless earphone 400 for voice broadcast when determining the abnormal environment data. In this way, the abnormal prompt in the form of audio can be provided, which facilitates the user to receive the abnormal prompt in the scene where it is not convenient to observe the virtual information displayed by the AR glasses 200.

[0105] In one embodiment, the abnormal prompt audio can be audio obtained by converting the abnormal prompt information into audio data, and the content of the abnormal prompt audio is the same as that of the abnormal prompt information. In this way, the content of the abnormal prompt audio does not need to be provided additionally.

[0106] Similarly, the inspection instruction issued by the backend platform can also be transmitted to the communication module of the storage box 300 in the form of inspection instruction audio, and the communication module transmits the inspection instruction audio to the wireless earphone 400 for voice broadcast. In this way, the user can perform the corresponding inspection steps according to the voice broadcast prompt.

[0107] In one embodiment, the box body 301 is also provided with an earphone compartment 304 for accommodating the wireless earphone 400. In this way, the wireless earphone 400 is convenient to carry.

[0108] In one embodiment, the storage box 300 further comprises a power supply module accommodated in the box body 301, and the power supply module comprises earphone power supply contacts exposed at least partially from the earphone compartment 304. When the wireless earphone 400 is accommodated in the earphone compartment 304, the earphone charging contacts of the wireless earphone 400 are in contact with the earphone power supply contacts to enable the storage box 300 to output current to the wireless earphone 400. In this way, the wireless earphone 400 can be charged while being accommodated in the storage box 300, so that the wireless earphone 400 has higher endurance.

[0109] In one embodiment, the wireless earphone 400 comprises a microphone module. The microphone module is used to record the voice audio of the user and transmit it to the storage box 300. The storage box 300 is also used to transmit the voice audio to an external server through the communication module. In this way, on the one hand, the user can input language instructions to the external server through the wireless earphone 400; on the other hand, an external person can transmit voice data to the external server to have a voice conversation with the user using the wireless earphone 400. In this way, the external person can guide the user to perform inspection and abnormality handling through voice.

[0110] Please refer to Figure 1 The embodiments of the present disclosure also provide an inspection system. The inspection system comprises the inspection device 1000 and the server in any one of the above embodiments. The server and the inspection device 1000 are connected through wireless communication to realize data interaction.

[0111] In one embodiment, the server is used to issue inspection instruction information to the inspection device 1000. The inspection instruction information can include information such as inspection task, inspection step, inspection area, and required sensor assembly 100 to help the user to clearly understand the inspection task.

[0112] In one embodiment, the server is used to process the environmental data collected by the inspection device 1000 to identify abnormal environmental data, and send abnormal prompt information to the AR glasses 200 of the inspection device 1000 for display when the abnormal environmental data is obtained. In this way, the server can be used to identify abnormal environmental data with stronger computing power.

[0113] In one embodiment, the server comprises a model module configured with the anomaly identification large model, and the model module is configured to input the environment data transmitted by the inspection device 1000 into the anomaly identification large model to obtain the anomaly prompt information output by the anomaly identification large model. In this way, the inspection device 1000 can interface the anomaly identification large model to process the environment data, and obtain more accurate or more detailed anomaly prompt information.

[0114] In one embodiment, the server comprises a dialogue model configured with professional knowledge of handling device anomalies, and the dialogue model is trained to output audio data containing answers to questions according to the questions in the input audio data. In this way, the user can ask questions to the dialogue model of the server through the wireless earphone 400, and the dialogue model outputs audio data that can answer the questions to the wireless earphone 400 for voice broadcast, to help the user handle the device anomaly.

[0115] In the description of the present specification, the description of the terms "one embodiment / way", "some embodiments / ways", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment / way or example are included in at least one embodiment / way or example of the present application. In the present specification, the illustrative description of the above terms does not necessarily refer to the same embodiment / way or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any appropriate manner in any one or more embodiments / ways or examples. In addition, the person skilled in the art can combine and combine the different embodiments / ways or examples described in the present specification and the features of the different embodiments / ways or examples, without contradiction.

[0116] In addition, the terms "first", "second" are only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "a plurality of" is at least two, for example, two, three, etc., unless otherwise specifically limited.

[0117] Those skilled in the art should understand that the above embodiments are only for the purpose of clearly illustrating the present disclosure, and are not intended to limit the scope of the present disclosure. Other changes or modifications can be made on the basis of the above disclosure, and these changes or modifications are still within the scope of the present disclosure.

Claims

1. An inspection device, characterized in that, The application relates to a sensor module, a storage box and AR glasses. The sensor module comprises a plurality of sensor assemblies, wherein the sensor assemblies are used for collecting different environmental data of an inspection area, the environmental data comprises temperature, humidity, distance and image, the sensor assembly comprises a connecting piece and a first communication unit, the connecting piece is used for detachably connecting the sensor assembly to the AR glasses, and the first communication unit is used for wireless communication with the storage box. The storage box comprises a box body, a communication module and a processing module accommodated in the box body, the box body is provided with a storage compartment for accommodating the sensor module, the communication module is used for wireless communication with the sensor module and the AR glasses, and the processing module is used for processing the environmental data transmitted by the sensor assembly to determine abnormal environmental data and transmitting abnormal prompt information to the AR glasses for display when the abnormal environmental data is determined. The AR glasses comprise a lens, a lens leg and a second communication unit, the lens is used for displaying the abnormal prompt information transmitted by the storage box, the lens leg can be detachably connected with the connecting piece, and the second communication unit is used for wireless communication with the storage box. When a user performs inspection, part of the sensor assemblies is selected according to requirements and connected to the AR glasses for use; when a first area is inspected, two sensor assemblies of the plurality of sensor assemblies are used, the two sensor assemblies are connected to the AR glasses for use, so as to ensure that the inspection equipment supports the functional requirements of the first area inspection; when a second area is inspected, the sensor assemblies that are not needed are detached from the AR glasses, and the detached sensor assemblies are placed in the storage box, so as to reduce the weight of the AR glasses carrying the sensor assemblies.

2. The inspection equipment according to claim 1, wherein the communication module is used for receiving inspection instruction information transmitted by an external server and sending the inspection instruction information to the AR glasses for display. The inspection instruction information comprises the type of the sensor assembly required for inspection. The sensor assembly comprises a connecting structure, the connecting structure can be detachably connected with the connecting structure of another sensor assembly to connect two sensor assemblies, when the two sensor assemblies are connected, the connecting piece of one sensor assembly can be detachably connected with the lens leg, so that the two sensor assemblies are connected to the AR glasses. The connecting piece comprises two clamping arms, when the sensor assembly is connected to the AR glasses, the lens leg is clamped between the two clamping arms.

3. The patrol apparatus according to claim 1, wherein 5. The inspection equipment according to claim 1, wherein the connecting piece comprises a magnetic attraction unit, 4. The patrol apparatus according to claim 1, wherein the lens leg comprises a first magnetic attraction part, the first magnetic attraction part can be magnetically connected with the magnetic attraction unit, and the outer surface of the storage box comprises a second magnetic attraction part, the second magnetic attraction part can be magnetically connected with the magnetic attraction unit.

6. The inspection equipment according to claim 1, wherein ​ ​ ​ The storage box includes a storage module accommodated in the box body, and the storage module stores abnormal data samples; The processing module processes the environmental data transmitted by the sensor assembly to determine abnormal environmental data, including: the processing module compares the environmental data and the abnormal data samples to determine abnormal environmental data.

7. The patrol device according to claim 1, characterized by, The processing module is configured to process the environmental data transmitted by the sensor assembly to determine abnormal environmental data, including: If the environmental data is image data, the edge computing capability of the processing module is applied for AI recognition to determine whether the environmental data is abnormal environmental data.

8. The inspection device of claim 1, wherein The storage box includes a storage module accommodated in the box body, and the storage module is configured to store original environmental data collected by the sensor assembly and abnormal environmental data determined by the processing module; The communication module is configured to transmit the original environmental data and the abnormal environmental data to an external server; Receive the abnormal prompt information transmitted by the external server; And transmit the abnormal prompt information transmitted by the external server to the AR glasses for display.

9. The inspection device of claim 1, wherein The inspection device further includes a wireless earphone, the wireless earphone is connected with the storage box through wireless communication to realize data interaction, and the processing module is configured to transmit abnormal prompt audio to the wireless earphone for voice broadcast when determining the abnormal environmental data, The box body is provided with an earphone compartment for accommodating the wireless earphone, the storage box includes a power supply module accommodated in the box body, and the power supply module includes earphone power supply contacts exposed at least partially from the earphone compartment, when the wireless earphone is accommodated in the earphone compartment, the earphone charging contacts of the wireless earphone are in contact with the earphone power supply contacts to enable the storage box to output current to the wireless earphone.

10. A patrol system characterized by comprising: Including: The inspection device of any one of claims 1 to 9; A server connected with the inspection device through wireless communication to realize data interaction; the server includes a model module configured with an abnormal identification large model, and the model module is configured to input the environmental data transmitted by the inspection device into the abnormal identification large model to obtain abnormal prompt information output by the abnormal identification large model.

Images