Inspection equipment and inspection system

Abstract

The invention provides inspection equipment and an inspection system. The inspection equipment comprises a sensor module, a storage box and AR glasses, the sensor module comprises a plurality of sensor assemblies, the plurality of sensor assemblies are respectively used for collecting different environmental data of an inspection area, each sensor assembly comprises a connecting piece and a first communication unit, the connecting piece is used for enabling the sensor assembly to be detachably connected to the AR glasses, and the first communication unit is used for being in wireless communication with the storage box; the storage box comprises a box body, a communication module and a processing module, the box body is provided with a storage bin, the storage bin is used for storing the sensor module, the communication module is used for wirelessly communicating with the sensor module and the AR glasses, and the processing module is used for processing the environment data to determine abnormal environment data and transmitting abnormal prompt information to the AR glasses for displaying; the AR glasses comprise lenses and glasses legs, the lenses are used for displaying the abnormal prompt information transmitted by the storage box, and the glasses legs can be detachably connected with the connecting pieces.

Description

Technical Field

[0001] The present disclosure relates to the field of patrol inspection technology, and more particularly to a patrol inspection device and a patrol inspection system. Background Art

[0002] In daily production, the stable operation of equipment and instruments is crucial. Currently, inspections mostly rely on regular, manual on-site checks, which are inefficient and susceptible to subjective factors. Most inspection equipment currently available on the market, designed for portability, has limited functionality and limited perception of the inspection environment. Summary of the Invention

[0003] The present disclosure provides a patrol inspection device and a patrol inspection system.

[0004] According to one aspect of the present disclosure, there is provided an inspection device, comprising: a sensor module, a storage box and AR glasses; the sensor module comprises a plurality of sensor components, each of which is used to collect different environmental data of an inspection area, the sensor component comprises a connector and a first communication unit, the connector is used to detachably connect the sensor component to the AR glasses, the first communication unit is used to wirelessly communicate with the storage box; the storage box comprises a box body and a communication module and a processing module accommodated in the box body, the box body is provided with a storage bin, the storage bin is used to accommodate the sensor module, the communication module is used to wirelessly communicate with the sensor module and the AR glasses, the processing module is used to process the environmental data transmitted by the sensor component to determine abnormal environmental data, and when abnormal environmental data is determined, transmit abnormal prompt information to the AR glasses for display; the AR glasses comprise lenses, temples and a second communication unit, the lenses are used to display the abnormal prompt information transmitted by the storage box, the temples can be detachably connected to the connector, and the second communication unit is used to wirelessly communicate with the storage box.

[0005] According to the inspection device of at least one embodiment of the present disclosure, the communication module is also used to receive inspection instruction information transmitted by an external server, and send the inspection instruction information to the AR glasses for display; wherein, the inspection instruction information includes the type of the sensor component required for the inspection.

[0006] According to the inspection equipment of at least one embodiment of the present disclosure, types of the sensor components include distance measurement sensors, temperature measurement sensors, and image acquisition sensors.

[0007] According to the inspection equipment of at least one embodiment of the present disclosure, the sensor component includes a composite sensor, which includes at least two modules of a distance measurement module, a temperature measurement module, and an image acquisition module.

[0008] According to the inspection equipment of at least one embodiment of the present disclosure, the sensor assembly also includes a connecting structure, which can be detachably connected to the connecting structure of other sensor assemblies to connect the two sensor assemblies. When the two sensor assemblies are connected, the connecting piece of one of the sensor assemblies can be detachably connected to the temples to connect the two sensor assemblies to the AR glasses.

[0009] According to the inspection device of at least one embodiment of the present disclosure, the connecting member includes two clamping arms, and when the sensor assembly is connected to the AR glasses, the temples are clamped between the two clamping arms.

[0010] According to the inspection device of at least one embodiment of the present disclosure, the connecting member includes a magnetic unit; the temple includes a first magnetic portion, and the first magnetic portion can be magnetically connected to the magnetic unit.

[0011] According to the inspection device of at least one embodiment of the present disclosure, the outer surface of the storage box includes a second magnetic portion, and the second magnetic portion can be magnetically connected to the magnetic unit.

[0012] According to the inspection equipment of at least one embodiment of the present disclosure, the sensor assembly also includes charging contacts; the storage box also includes a power supply module housed in the box body, and the power supply module includes power supply contacts that are at least partially exposed from the storage compartment; when the sensor assembly is stored in the storage compartment, the charging contacts are in contact with the power supply contacts, so that the power supply module can output current to the sensor assembly.

[0013] According to the inspection device of at least one embodiment of the present disclosure, the storage box also includes a storage module housed in the box body, and the storage module stores abnormal data samples; the processing module processes the environmental data transmitted by the sensor component to determine the abnormal environmental data, including: the processing module performs data comparison on the environmental data and the abnormal data samples to determine the abnormal environmental data.

[0014] According to the inspection equipment of at least one embodiment of the present disclosure, the processing module is used to process the environmental data transmitted by the sensor component to determine abnormal environmental data, including: if the environmental data is image data, applying the edge computing capability of the processing module to perform AI recognition to determine whether the environmental data is abnormal environmental data.

[0015] According to the inspection device of at least one embodiment of the present disclosure, the storage box also includes a storage module housed in the box body, and the storage module is used to store the original environmental data collected by the sensor component and the abnormal environmental data determined by the processing module; the communication module is also used to transmit the original environmental data and the abnormal environmental data to an external server; receive abnormal prompt information transmitted by the external server; and transmit the abnormal prompt information transmitted by the external server to the AR glasses for display.

[0016] According to at least one embodiment of the present disclosure, the inspection equipment further includes a wireless headset, which realizes data interaction with the storage box through a wireless communication connection; the processing module is also used to transmit abnormal prompt audio to the wireless headset for voice broadcast when abnormal environmental data is determined.

[0017] According to the inspection device of at least one embodiment of the present disclosure, the box body is also provided with an earphone compartment, which is used to store the wireless earphones; the storage box also includes a power supply module accommodated in the box body, and the power supply module includes an earphone power supply contact that is at least partially exposed from the earphone compartment; when the wireless earphones are stored in the earphone compartment, the earphone charging contacts of the wireless earphones are in contact with the earphone power supply contacts so that the storage box can output current to the wireless earphones.

[0018] According to the inspection device of at least one embodiment of the present disclosure, the wireless headset includes a microphone module, which is used to record the user's voice audio and transmit it to the storage box, and the storage box is also used to transmit the voice audio to an external server.

[0019] According to one aspect of the present disclosure, a patrol system is provided, comprising a patrol device according to any one of the above-mentioned embodiments, and further comprising a server, wherein the server and the patrol device are connected via wireless communication to realize data interaction; the server comprises a model module configured with an abnormality recognition large model, and the model module is used to input the environmental data transmitted by the patrol device into the abnormality recognition large model to obtain abnormal prompt information output by the abnormality recognition large model. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings illustrate exemplary embodiments of the present disclosure and together with the description serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.

[0021] Figure 1 It is a schematic block diagram of the structure of an inspection device according to one embodiment of the present disclosure.

[0022] Figure 2Schematic diagram of an inspection device according to an embodiment of the present disclosure.

[0023] Figure 3 This is a schematic diagram of the scenario where a user wears AR glasses. DETAILED DESCRIPTION

[0024] The present disclosure will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only intended to explain the relevant content and are not intended to limit the present disclosure. It should also be noted that, for ease of description, only the portions relevant to the present disclosure are shown in the accompanying drawings.

[0025] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in the present disclosure can be combined with each other. The technical solution of the present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0026] Unless otherwise stated, the exemplary embodiments / examples shown are to be understood as providing exemplary features of various details of some ways in which the technical concepts of the present disclosure can be implemented in practice. Therefore, unless otherwise stated, the features of the various embodiments / examples may be further combined, separated, interchanged, and / or rearranged without departing from the technical concepts of the present disclosure.

[0027] In inspection scenarios, inspectors are usually required to visit multiple inspection locations to determine whether there are any abnormalities in the equipment, instruments, environment and other factors at multiple inspection locations, so as to promptly issue early warnings for safety hazards and prevent safety failures or accidents.

[0028] Currently, there are some inspection equipment on the market for patrol inspections. Unlike inspection equipment that is placed in a fixed location for inspection, inspection equipment for patrol inspections needs to be portable so that inspectors can carry the equipment around and conduct inspections.

[0029] However, to meet the portability requirements of patrol inspection equipment, the inspection capabilities of current patrol inspection equipment on the market are relatively limited, and they suffer from a single function. If more hardware is added to improve the functionality of patrol inspection equipment, the weight of the patrol inspection equipment will increase, resulting in reduced portability and increasing the burden on patrol inspection personnel.

[0030] To this end, the present disclosure proposes the following technical solution to provide a portable inspection device that can take into account both portability and rich functionality.

[0031] Figure 1 A schematic structural block diagram of an inspection device according to an embodiment of the present disclosure is shown.

[0032] like Figure 1As shown, the inspection equipment includes a sensor module, a storage box, and AR (augmented reality) glasses. The sensor module is used to collect environmental data in the inspection area. The storage box, on the one hand, houses the sensor module, making it portable; on the other hand, it enables wireless communication between the sensor module and the AR glasses for data transmission. Furthermore, it receives and processes the environmental data collected by the sensor module to determine whether there are any anomalies in the inspection area. If an anomaly is present, an abnormality warning message is transmitted to the AR glasses for display, providing an early warning to the inspector wearing the AR glasses. In addition to displaying abnormality warning messages, the AR glasses also carry the sensor module, allowing inspectors to use the sensor module for inspection while wearing the AR glasses. This eliminates the need for inspectors to hold the sensor module for inspection, allowing them to operate other equipment while using the sensor module to collect environmental data.

[0033] Please combine Figure 2 , Figure 2 FIG. 1 is a schematic diagram of an inspection device 1000 according to an embodiment of the present disclosure.

[0034] The sensor module includes multiple sensor components 100. The multiple sensor components 100 are respectively used to collect different environmental data of the inspection area.

[0035] Environmental data for an inspection area refers to a collection of information related to equipment operation and human activities within the inspection area that can be collected through systematic means and can be used to assess potential risks in the inspection area. The multiple sensor assemblies 100 can be of different types, each capable of collecting different types of environmental data, such as temperature, humidity, distance, and image data, without limitation. The greater the variety of sensor assemblies 100, the greater the types of environmental data that can be collected, enabling a wider range of supported detection functions.

[0036] The sensor assembly 100 includes a connector, which is used to detachably connect the sensor assembly 100 to the AR glasses 200. During the inspection process, the user (such as an inspector) can select any sensor assembly 100 from the multiple sensor assemblies 100 to be connected to the AR glasses 200 according to the inspection requirements for collecting environmental data. In this way, when it is necessary to support more detection functions, the sensor assembly 100 connected to the AR glasses 200 can be increased accordingly to collect more types of environmental data. When it is not necessary to collect certain environmental data, the corresponding sensor assembly 100 can be removed from the AR glasses 200 to reduce the weight of the AR glasses 200 and reduce the burden on the user wearing the AR glasses 200. Thus, the inspection device 1000 provided by the present disclosure can take into account rich functionality and portability.

[0037] The detachable connection can be achieved by a fast and easy-to-assemble connection structure such as a snap-on structure, a magnetic structure, a slide rail and a guide structure, so as to facilitate the user to install and remove the sensor assembly 100. In this way, when a sensor assembly 100 is needed, the user can easily connect it to the AR glasses 200, and when a sensor assembly 100 is no longer needed, the user can easily remove it and put it into the storage box for storage.

[0038] The sensor assembly 100 further includes a first communication unit for wirelessly communicating with the storage box to perform data transmission between the sensor and the storage box. In this way, the sensor assembly 100 can transmit the collected environmental data to the storage box for data processing via the first communication unit.

[0039] In one embodiment, the sensor assembly 100 and the storage box wirelessly communicate based on a mesh (wireless mesh) network architecture. The storage box serves as the master node of the mesh network architecture, and the multiple sensor assemblies 100 serve as child nodes within the mesh network architecture. The child nodes can exchange data with the master node. The mesh network architecture supports dynamic addition and deletion of child nodes. Therefore, when a sensor assembly 100 needs to be connected to the AR glasses 200, the newly connected sensor assembly 100 can be dynamically added as a child node of the mesh network architecture. When a sensor assembly 100 is removed from the AR glasses 200, the corresponding child node can be dynamically deleted from the mesh network architecture. Furthermore, data transmission between the master and child nodes of the mesh network architecture has the advantages of low latency and low power consumption. Low latency facilitates instant data upload from the sensor assembly 100, enabling the storage box to promptly detect anomalies or risks in the inspection area, improving the timeliness of anomaly or risk detection. Low power consumption also enhances the battery life of the sensor assembly 100, supporting extended inspections.

[0040] In one embodiment, the first communication unit may be a radio frequency chip, such as a radio frequency chip that supports Mesh networking, to ensure that the first communication unit can support the Mesh network architecture, wherein the Mesh networking may be, for example, a WiFi networking mode.

[0041] See also Figure 1 Combined with Figure 2 The storage box 300 includes a box body 301 and a communication module and a processing module accommodated in the box body 301.

[0042] The box body 301 is provided with a receiving compartment 302, and the receiving compartment 302 is used to receive the sensor assembly 100. Figure 2 In the schematic view, the sensor assembly 100 is housed in the housing compartment 302 , causing a certain degree of obstruction to the housing compartment 302 .

[0043] In one embodiment, the storage space of the storage bin 302 corresponds to the number of the plurality of sensor assemblies 100. For example, the number of storage bins 302 is equal to the number of the plurality of sensor assemblies 100, and each sensor assembly 100 can be stored in a corresponding storage bin 302 to ensure that each sensor assembly 100 can be simultaneously stored in the storage bin 302. For another example, the storage space of the storage bin 302 is sufficient to accommodate each sensor assembly 100 simultaneously.

[0044] In one embodiment, the storage compartment 302 is a groove structure formed on the outer surface of the box body 301. When the sensor assembly 100 is housed in the storage compartment 302, the sensor assembly 100 is at least partially exposed outside the box body 301, making it easier for the user to remove the sensor from the storage compartment 302. In one embodiment, the storage box 300 also includes a cover 303. The cover 303 can be connected to the box body 301 on the side of the box body 301 where the storage compartment 302 is located, thereby shielding the sensor assembly 100 housed in the storage compartment 302 and providing a certain degree of protection for the sensor assembly 100.

[0045] The inner portion of the box body 301 has a certain accommodation space, and the communication module and the processing module are located in the accommodation space of the inner portion of the box body 301, so that the box body 301 plays a certain protective role for the communication module and the processing module.

[0046] The communication module is used to wirelessly communicate with the sensor assembly 100 and the AR glasses 200 for data transmission. In one embodiment, the communication module is electrically connected to the processing module to enable data transmission between the communication module and the processing module. This allows the processing module to receive data collected by the sensor assembly 100 outside the storage box 300 through the communication module and transmit data to the AR glasses 200 outside the storage box 300 through the communication module.

[0047] The processing module is responsible for processing the environmental data collected by the sensor assembly 100 to determine whether any abnormal data exists within the environmental data. If the processing module determines that there is an abnormality in the environmental data, this indicates that an indicator corresponding to the environmental data in the inspection area is abnormal, and a warning prompt is required to inform the user of potential dangers in the inspection area. Therefore, when the processing module determines that there is abnormal environmental data, the abnormality prompt information is transmitted to the AR glasses 200 for display, providing a warning prompt to the user.

[0048] In one embodiment, different types of abnormal data correspond to different abnormal prompt information. For example, when the abnormal data is temperature data, the abnormal prompt information is used to provide an early warning of abnormal temperatures, such as a high temperature warning or a low temperature warning. The abnormal prompt information can include warning content such as text, graphics, or images, without limitation.

[0049] In one embodiment, when the abnormal data includes a specific numerical value, the corresponding abnormal prompt information includes the numerical value of the abnormal data, which provides more accurate information. For example, the abnormal prompt information is "the temperature is: 60° C., the numerical value is abnormal."

[0050] In one embodiment, the abnormal prompt information is a preset prompt information. For example, when abnormal temperature data is detected, the processing module retrieves the abnormal prompt information corresponding to the abnormal temperature data from a database for storing prompt information and transmits it to the AR glasses 200 for display.

[0051] In another embodiment, the abnormality prompt information can be a prompt information generated in real time by the processing module. For example, the processing module has a built-in AI (Artificial Intelligence) processing model, which is trained to detect whether the environmental data input to the model is abnormal data and, if so, output abnormality prompt information that can provide an early warning of this type of abnormality.

[0052] See also Figure 1 and Figure 2 , the AR glasses 200 include lenses 201, temples 202 and a second communication unit.

[0053] Lens 201 is used to display the abnormality prompt information transmitted by the storage box 300. The lens 201 of the AR glasses 200 can project virtual information into the user's eyes, allowing the user to see the virtual abnormality prompt information while simultaneously viewing the real-world scene. This allows the user to see the abnormality prompt information while simultaneously viewing the real-world scene. In one embodiment, the abnormality prompt information also includes steps to correct the abnormality. This allows the user to refer to the instructions for correcting the abnormality while observing the real-world environment, such as equipment and personnel, and then perform the corresponding steps to correct the abnormality.

[0054] The temple 202 can be detachably connected to the connecting piece, so that the sensor assembly 100 can be detachably connected to the temple 202 through the connecting piece.

[0055] Please combine Figure 3 , Figure 3 Figure 2 is a schematic diagram of a scenario in which a user wears AR glasses 200. In one embodiment, when a user wears AR glasses 200, the sensor assembly 100 can be connected to the temple 202 between the ear and the lens 201 of the AR glasses 200 to prevent the sensor assembly 100 from contacting the human body and causing discomfort to the wearer or affecting the detection effect of the sensor assembly 100.

[0056] When the user conducts an inspection, they can select some of the multiple sensor assemblies 100 to connect to the temples 202 for use as needed. For example, when inspecting the first area, two sensor assemblies 100 are needed. In this case, these two sensor assemblies 100 are connected to the temples 202 to ensure that the inspection device 1000 can support the functional requirements of the inspection of the first area. When inspecting the second area, only one of the two sensor assemblies 100 connected to the temples 202 is needed. In this way, the other sensor assembly 100 can be removed to reduce the weight of the AR glasses 200 equipped with the sensor assemblies 100 and reduce the burden on the user.

[0057] In one embodiment, the AR glasses 200 dynamically display abnormality information transmitted by the storage box 300. For example, when temperature data is abnormal, the AR glasses 200 display abnormal temperature information transmitted by the storage box 300. If the temperature data is abnormal and the humidity data collected by the humidity sensor assembly 100 is determined to be abnormal environmental data, the storage box 300 transmits abnormal humidity information to the AR glasses 200. The AR glasses 200 then display the abnormal humidity information in addition to the abnormal temperature information. If the humidity data collected by the humidity sensor assembly 100 returns to normal while the AR glasses 200 are displaying both abnormal temperature and abnormal humidity information, the storage box 300 transmits a control command to the AR glasses 200 to remove the abnormal humidity information, thereby removing the abnormal humidity information displayed by the AR glasses 200 and displaying only the abnormal temperature information. This ensures that the abnormality information displayed by the AR glasses 200 is more timely.

[0058] The second communication unit is used for wireless communication with the storage box 300 to perform data transmission, so that the storage box 300 can transmit virtual information to the AR glasses 200 for display.

[0059] In one embodiment, the first communication unit, the second communication unit, and the communication module of the storage box 300 are wirelessly connected based on a Mesh network architecture. The communication module serves as the master node of the Mesh network architecture, and the first communication unit and the second communication unit serve as sub-nodes of the Mesh network architecture.

[0060] In one embodiment, the second communication unit may be a radio frequency chip, such as a radio frequency chip that supports Mesh networking, to ensure that the second communication unit can support the Mesh network architecture.

[0061] In summary, the inspection device 1000 of the disclosed embodiments provides multiple sensor assemblies 100 for collecting different environmental data. This allows the inspection device 1000 to have multiple detection functions, meeting the requirements for detecting multiple parameters in complex industrial environments and avoiding the problem of the inspection device 1000 having a single function. Furthermore, the multiple sensor assemblies 100 of the inspection device 1000 can be stored in the storage box 300, making it easy to carry and highly portable. During an inspection, the required sensor assemblies 100 can be connected to the AR glasses 200 to collect environmental data. On the one hand, the user does not need to hold the sensor assemblies 100 to collect environmental data, freeing up their hands and allowing them to perform other tasks while collecting environmental data during the inspection. On the other hand, the user can reduce the number of sensor assemblies 100 connected to the AR glasses 200 based on the functional requirements of the inspection area, connecting only the necessary sensor assemblies 100 to collect environmental data, making the AR glasses 200 equipped with the sensor assemblies 100 lighter and more portable.

[0062] See also Figure 1 and Figure 2 In one embodiment, the communication module of the storage box 300 is wirelessly connected to an external server. The server can send inspection instructions to the inspection device 1000. The communication module receives the inspection instructions from the server and sends them to the AR glasses 200 for display. In this way, the inspection device 1000 can provide users with real-time visual inspection instructions.

[0063] The communication module is wirelessly connected to the server, allowing the inspection device 1000 to exchange data with the server in real time. This ensures that the information transmitted by the server and displayed on the AR glasses 200 is highly timely. In one embodiment, when the inspection instruction changes, the server can transmit the changed inspection instruction to the inspection device 1000. The communication module can then transmit the changed inspection instruction information to the AR glasses 200 to overwrite the pre-changed inspection instruction information for display, allowing the user to instantly receive highly timely inspection instruction information.

[0064] In one embodiment, the inspection instruction information includes an inspection route map. For example, the inspection instruction information may include a map of each inspection area and display navigation of the inspection route. This allows the user to view the navigation route displayed by the AR glasses 200 while observing the real scene and moving around, making it easier for the user to perform inspections along a specific route.

[0065] Furthermore, in one embodiment, the communication module of the storage box 300 uploads the user's real-time location information to the server. In this way, the back-end platform can obtain the user's real-time inspection route from the server to determine whether the user has deviated from the inspection route or arrived at the inspection area on time, thereby supervising the user's inspection tasks.

[0066] In one embodiment, the inspection instruction information includes the inspection steps for each inspection area. By displaying the inspection steps on the AR glasses 200, the user can refer to the virtual inspection steps while observing the real scene and executing the corresponding steps, which is very convenient.

[0067] In one embodiment, the inspection instruction information includes the type of sensor assembly 100 required for the inspection. For example, the content of the inspection instruction information includes each inspection area and the type of sensor assembly 100 required for each inspection area. For example, the inspection instruction information may indicate that two types of sensor assemblies 100 are required to collect temperature data and image data in the first area, and a sensor assembly 100 is required to collect distance data in the second area. In this way, when the user arrives at the inspection area, he or she can refer to the inspection instruction information to select the sensor assembly 100 corresponding to the inspection area and connect it to the AR glasses 200, so that all sensor assemblies 100 do not need to be connected to the AR glasses 200 every time an inspection is carried out, thereby reducing the wearing burden of the user and making the AR glasses 200 equipped with sensor assemblies 100 more portable.

[0068] In one embodiment, the types of the sensor assembly 100 include a distance measurement sensor, a temperature measurement sensor, and an image acquisition sensor.

[0069] Distance sensors are used to collect distance data within the inspection area. Examples include the distance between a user and a device, the distance between devices, and the distance between a user and other people in the environment, among other data points.

[0070] In one embodiment, the ranging sensor may be an ultrasonic radar, which measures the distance between the user and a target object based on the ultrasonic ranging principle. The target object may be a person or an object. Based on this, the distance data measured by the ranging sensor can be used to determine whether the distance between the user and the target object is a safe distance. If the distance between the user and the target object is less than a safe distance threshold, the storage box 300, upon receiving this data, determines the distance data as abnormal, causing the AR glasses 200 to display a corresponding abnormality prompt message, prompting the user to maintain a safe distance.

[0071] Moreover, based on the principle of ultrasonic ranging, if the user moves during the ranging process, the distance traveled when the ultrasonic wave is emitted is different from the distance traveled when it returns. Based on the difference in distance traveled and the time taken for the ultrasonic wave to return, the user's movement speed during the period can be calculated. In this way, when an ultrasonic radar is used as a ranging sensor, the ranging sensor can collect distance data and speed data at the same time. In some application scenarios, users drive vehicles for inspections. Since users can see the real environment and virtual information at the same time when wearing AR glasses 200, the virtual information will block the user's field of view to a certain extent. Therefore, the user's movement speed should not be too fast to avoid causing accidents. In this case, when the storage box 300 receives speed data collected by the ranging sensor that exceeds the safety data threshold, the speed data is determined to be abnormal speed data, so that the AR glasses 200 display the corresponding abnormal prompt information, which can remind the user to maintain a safe speed.

[0072] The temperature sensor is used to collect the temperature of a target object in the environment of the inspection area. The target object can be a person or an object.

[0073] In one embodiment, the temperature sensor can be an infrared temperature sensor, which uses infrared light to measure the temperature of a target object. This eliminates the need for the temperature sensor to come into contact with the target object when collecting temperature data. This prevents injuries to users from approaching hot objects during temperature measurement. Furthermore, the temperature of a target person can be measured while maintaining a certain distance, minimizing the risk of disease transmission.

[0074] In one embodiment, when the storage box 300 receives temperature data collected by the temperature sensor that is not within the normal temperature range, the temperature data is determined to be abnormal temperature data, and the AR glasses 200 display corresponding abnormal prompt information so that the user can take timely countermeasures.

[0075] The image acquisition sensor is used to collect image data or video data in the environment of the inspection area.

[0076] In one embodiment, the image acquisition sensor may be a camera, which is used to capture images of the inspection area to obtain video data composed of multiple frames of image data.

[0077] In one embodiment, video data is primarily used to identify whether workers in the inspection area are complying with safety regulations, such as correctly wearing safety helmets, work clothes, and shoes. When the storage box 300 identifies that a worker in the video data captured by the image acquisition sensor is not wearing a safety helmet, the video data is identified as abnormal, causing the AR glasses 200 to display a corresponding abnormality warning message, allowing the user to take timely countermeasures.

[0078] In one embodiment, the sensor assembly 100 comprises a composite sensor, which includes at least two modules selected from the group consisting of a range measurement module, a temperature measurement module, and an image acquisition module. This allows the composite sensor to simultaneously capture at least two different types of data. Thus, when the composite sensor is connected to the AR glasses 200, a single composite sensor can be used to collect two or more types of environmental data. For example, a composite sensor comprising a range measurement module and a temperature measurement module housed in the same housing can provide both range and temperature measurement functions.

[0079] In one embodiment, the sensor assembly 100 further includes a connecting structure that can be detachably connected to the connecting structure of another sensor assembly 100 to connect two sensor assemblies 100. When the two sensor assemblies 100 are connected, the connecting member of one of the sensor assemblies 100 can be detachably connected to the temple 202, so that both sensor assemblies 100 are connected to the AR glasses 200. In this way, any two sensor assemblies 100 from the multiple sensor assemblies 100 can be assembled into one, and the two sensor assemblies 100 can be connected to the AR glasses 200 while only occupying the connecting member of one sensor assembly 100 and connecting it to the temple 202, thereby increasing the upper limit of the number of sensor assemblies 100 that can be connected to the AR glasses 200.

[0080] Among them, the detachable connection between the two connecting structures can be achieved through a connection structure that is convenient for quick disassembly and assembly, such as a snap structure, a magnetic structure, a slide rail slider guide structure, etc., so as to facilitate quick disassembly and assembly between the two sensor components 100.

[0081] See also Figure 3In one embodiment, the sensor assembly 100 has a measuring side 101. This side is the side of the sensor assembly 100 that transmits or receives signals, including optical, electrical, and wave signals. For example, if the sensor assembly 100 is an image acquisition sensor, the side where the image acquisition sensor's lens is located is the measuring side 101. If the sensor assembly 100 is an infrared temperature sensor, the side where the infrared temperature sensor emits infrared light is the measuring side 101. Therefore, the connector of the sensor assembly 100 can be located on the side adjacent to the measuring side 101. This allows the sensor assembly 100 to be connected to the temple 202 of the AR glasses 200, aligning the measuring side 101 with the orientation of the human eye. This allows the sensor assembly 100 to collect data from objects within the user's field of view. To switch the target object for data collection, the user simply brings the target object into their field of view, making data collection simple and convenient.

[0082] In one embodiment, the connector of the sensor assembly 100 includes two clamping arms. When the sensor assembly 100 is connected to the AR glasses 200, the temples 202 are clamped between the two clamping arms. This clamping arm clamping the temples 202 facilitates quick installation and removal of the sensor assembly 100, providing excellent convenience.

[0083] In one example, when wearing AR glasses 200, there is a relatively large gap between the lens 201 and the temple 202 at the connection point and the user's face. When the clamping arm clamps the temple 202 at this gap, it can prevent the clamping arm from contacting the user's face and causing discomfort to the user.

[0084] Furthermore, in one embodiment, the clamping arms of the sensor assembly 100 extend from the housing of the sensor assembly 100, with one clamping arm proximal to the housing of the sensor assembly 100 and the other clamping arm distal to the housing of the sensor assembly 100. The clamping arm distal to the housing of the sensor assembly 100 has a protrusion on its side facing the other clamping arm, and a groove is provided on the inner side of the temple 202. When the clamping arm is clamped onto the temple 202, the protrusion fits into the groove, further stabilizing the connection between the clamping arm and the temple 202 and preventing the sensor assembly 100 from shaking relative to the temple 202. This can alleviate image blurring caused by shaking when the sensor assembly 100 is used as an image acquisition sensor.

[0085] In one embodiment, the clamping arms are made of elastic material. When the clamping arms clamp the temple 202, the elastic force of the two clamping arms causes the two clamping arms to tend to move closer to each other, thereby tightening the temple 202 and making the connection between the clamping arms and the temple 202 more stable.

[0086] In another embodiment, the sensor assembly 100 is connected to the temple 202, wherein the connecting member includes a magnetic unit, and the temple 202 includes a first magnetic portion that is magnetically connectable to the magnetic unit. This magnetic connection facilitates quick installation and removal of the sensor assembly 100, providing excellent convenience.

[0087] In one embodiment, the temple 202 is made of magnetic material. Thus, any position of the temple 202 can be used as the first magnetic attraction portion to be magnetically connected to the magnetic attraction unit, providing a larger connectable area.

[0088] In another embodiment, the first magnetic portion is located at a portion of the temple 202, and the temple 202 is magnetic only at the first magnetic portion. In this way, the magnetic unit connected to the first magnetic portion can only be connected to the temple 202 at the location where the first magnetic portion is located, which can prevent the magnetic unit from sliding on the temple 202 and improve the connection stability of the sensor assembly 100.

[0089] In one embodiment, the outer surface of the storage box 300 includes a second magnetic portion, and the second magnetic portion can be magnetically connected to the magnetic unit. In this way, the sensor assembly 100 can be connected to the storage box 300 to collect environmental data, providing a variety of ways to carry the sensor assembly 100 for inspection. For example, when it is necessary to collect data from a target object with a fixed position, the storage box 300 can be placed in a fixed position, and the sensor assembly 100 can be adsorbed on the outer surface of the storage box 300, so that the measuring side 101 of the sensor assembly 100 is aligned with the target object. In this way, the user does not need to bear the weight of the sensor assembly 100, which can reduce the burden on the user.

[0090] In one embodiment, the second magnetic portion is located on the outer surface of the cover 303 of the storage box 300. In this way, the sensor assembly 100 can be connected to the outer surface of the cover 303 when the cover 303 is closed on the box body 301, so that the magnetic connection between the sensor assembly 100 and the storage box 300 does not affect the closing of the cover 303.

[0091] See also Figure 2 In one embodiment, the sensor assembly 100 further includes charging contacts, which are used to connect current to the sensor assembly 100 to charge the sensor assembly 100. For example, the sensor assembly 100 further includes a rechargeable battery, such as a lithium battery. The charging contacts are used to connect current to the rechargeable battery.

[0092] Please combine Figure 1In one embodiment, the storage box 300 further includes a power supply module housed within the box body 301. The power supply module includes power supply contacts that are at least partially exposed within the storage compartment 302. When the sensor assembly 100 is stored in the storage compartment 302, the charging contacts come into contact with the power supply contacts, enabling the power supply module to supply current to the sensor assembly 100. This allows the sensor assembly 100 to be charged while housed in the storage compartment 302, extending the battery life of the sensor assembly 100.

[0093] In one embodiment, the storage box 300 further includes a storage module housed in the box body 301 , and the storage module can be used to store data received by the communication module, such as data transmitted from the sensor assembly 100 and the server to the communication module.

[0094] In one embodiment, the storage module stores abnormal data samples, which are used to determine whether the environmental data is abnormal. In one embodiment, different types of environmental data correspond to abnormal data samples of the same type, such as temperature data corresponding to abnormal temperature data samples. When the processing module processes the environmental data, the processing module can obtain the environmental data to be processed and the abnormal data samples of the same type from the storage module, and compare the environmental data and the abnormal data samples to determine the abnormal environmental data. In this way, the processing module can complete the processing of the environmental data using local abnormal data samples without being connected to the Internet.

[0095] In some embodiments of the present disclosure, the environmental data may include image data. Preferably, the processing module of the present disclosure processes the environmental data transmitted by the sensor component to determine abnormal environmental data, including: if the environmental data is image data, applying the edge computing capability of the processing module to perform AI recognition to determine whether the environmental data is abnormal environmental data.

[0096] When the environmental data is numerical data such as temperature, humidity, or distance, the corresponding abnormal data samples can be parameters such as the abnormal data threshold, abnormal data interval, and normal data interval for the same type of data. In this way, whether the environmental data is abnormal can be determined by comparing whether it is greater than or less than the abnormal data threshold, whether it is within the abnormal data interval, or whether it is within the normal data interval. For example, when the environmental data is a temperature value, the corresponding abnormal temperature sample can be the normal temperature interval. If the collected temperature value is within the normal temperature interval, the temperature value is normal; otherwise, if the collected temperature value is outside the normal temperature interval, the collected temperature value is determined to be abnormal environmental data.

[0097] When the environmental data is image-type data such as images and videos, the corresponding abnormal data samples can be images of specific features. For example, in a scenario for identifying whether workers operating in an inspection area comply with safety regulations, the key features used to determine whether safety regulations are complied with include safety helmets, work clothes, and work shoes. Based on this, images of safety helmets, work clothes, and work shoes can be used as abnormal data samples. The processing module identifies the face in the image frame captured by the sensor component 100 to determine whether the image frame contains a person, and when a person is identified, the image frame is compared with the abnormal data sample to further identify whether the person in the image frame is wearing a safety helmet and work clothes and work shoes. If, after comparison, it is identified that the person in the image frame is not wearing any of the safety helmet, work clothes, and work shoes, the image frame is determined to be abnormal environmental data.

[0098] In one embodiment, the processing module is locally deployed with a neural network model for image processing, which can perform feature recognition on the input image frame in an offline state to determine whether the image frame contains certain features, such as whether it contains a face or a human; and determine whether the image frame does not contain features in the abnormal data sample in combination with the abnormal data sample, such as whether it does not contain a safety helmet, work clothes and work shoes, and finally output the recognition result.

[0099] In one embodiment, the communication module is also used to transmit raw environmental data and abnormal environmental data to an external server. This allows a high-computing processor to be deployed on the external server to process the raw environmental data to detect abnormal environmental data. Furthermore, the abnormal environmental data identified by the processing module can be further analyzed to obtain more detailed analysis results and output corresponding abnormality information. The abnormality information output by the server is transmitted to the communication module, which then transmits the abnormality information to the AR glasses 200 for display. Thus, while the storage box 300 has a certain level of edge computing capability to process environmental data and obtain abnormality information, the inspection device 1000 can also leverage the server's more powerful computing power to perform more in-depth data analysis and obtain abnormality information containing more detailed analysis results. In other words, in relatively poor network environments, at least the abnormality information output by the storage box 300 can be obtained; in better network environments, more detailed abnormality information output by the server can be obtained, allowing the inspection device 1000 to operate in a variety of network environments.

[0100] In one embodiment, when a user collects environmental data for an inspection area, they must at least collect image data. This image data is used to determine the type of target object in the inspection area, such as whether the target object is a person or a specific piece of equipment. This determination of the target object type allows for more accurate analysis of other environmental data collected simultaneously based on the target object type.

[0101] For example, the server is deployed with a large anomaly recognition model to process the environmental data transmitted by the inspection device 1000 to identify abnormal data therein, including the original environmental data collected by the sensor and the abnormal environmental data determined by the processing module, and output corresponding abnormal prompt information when abnormal environmental data is identified. When the environmental data with the same timestamp includes image data and temperature data, if the type of the target object is identified as a human based on the image data, then when determining whether the temperature data is abnormal data, the determination can be made by comparing the normal body temperature of the human body with the collected temperature data. If the type of the target object is identified as a certain type of equipment based on the image data, then when determining whether the temperature data is abnormal data, the determination can be made by comparing the temperature of the equipment under normal operating conditions with the collected temperature data.

[0102] Furthermore, when the collected temperature data is not the temperature under the normal operating conditions of the device, the possible abnormal operating conditions of the device can also be predicted based on the value of the temperature data, so as to provide a reminder of the abnormal operating conditions in the output abnormal prompt information. For example, assuming that the target object is identified as a motor device based on the image data, and the temperature data at the same timestamp is 60°C, which exceeds the temperature of this motor device under normal operating conditions. Assuming that the reason why the temperature of this motor device reaches 60°C may be due to overload, the abnormal prompt information output by the server includes an overload warning reminder for this motor device.

[0103] See also Figure 1 and Figure 2 In one embodiment, the inspection device 1000 further includes a wireless headset 400. The wireless headset 400 and the storage box 300 exchange data via wireless communication. For example, the storage box 300 serves as the master node of a mesh network architecture, and the wireless headset 400 serves as a child node of the mesh network architecture. The master node and child nodes communicate wirelessly to exchange data.

[0104] In one embodiment, the processing module is further configured to transmit an abnormality prompt audio to the wireless headset 400 for voice broadcast when abnormal environmental data is determined. In this way, an abnormality prompt in audio form can be provided, making it easier for the user to receive the abnormality prompt in scenarios where it is inconvenient to observe the virtual information displayed by the AR glasses 200.

[0105] In one embodiment, the abnormal prompt audio can be an audio obtained by converting the abnormal prompt information into audio data, and the content of the abnormal prompt audio is the same as the content of the abnormal prompt information. In this way, there is no need to provide the content of the abnormal prompt audio additionally.

[0106] Similarly, the inspection instructions issued by the backend platform can also be transmitted to the communication module of the storage box 300 in the form of inspection instruction audio, and the communication module transmits the inspection instruction audio to the wireless headset 400 for voice broadcast. In this way, the user can perform the corresponding inspection steps according to the prompts of the voice broadcast.

[0107] In one embodiment, the box body 301 is further provided with an earphone compartment 304, and the earphone compartment 304 is used to store the wireless earphone 400. In this way, the wireless earphone 400 is convenient to carry.

[0108] In one embodiment, the storage box 300 further includes a power supply module housed within the box body 301. The power supply module includes headphone power contacts that are at least partially exposed from the headphone compartment 304. When the wireless headphones 400 are stored in the headphone compartment 304, the headphone charging contacts of the wireless headphones 400 come into contact with the headphone power contacts, enabling the storage box 300 to supply current to the wireless headphones 400. This allows the wireless headphones 400 to be charged while being stored in the storage box 300, thereby enhancing the battery life of the wireless headphones 400.

[0109] In one embodiment, the wireless headset 400 includes a microphone module. The microphone module is used to record the user's voice and transmit it to the storage box 300. The storage box 300 is also used to transmit the voice and audio to an external server via a communication module. This allows the user to input verbal instructions to the external server through the wireless headset 400. Furthermore, an external user can transmit voice data through the external server and have a voice conversation with the user using the wireless headset 400. This allows the external user to provide voice guidance to the user during inspections and troubleshooting.

[0110] See also Figure 1 The embodiments of the present disclosure further provide a patrol inspection system. The patrol inspection system includes the patrol inspection device 1000 and a server according to any of the above embodiments. The server and the patrol inspection device 1000 are connected via wireless communication to achieve data exchange.

[0111] In one embodiment, the server is used to send inspection instruction information to the inspection device 1000. The inspection instruction information may include inspection tasks, inspection steps, inspection areas, sensor components 100 required for inspection, and other information to help users clarify inspection tasks.

[0112] In one embodiment, the server processes the environmental data collected by the inspection device 1000 to identify abnormal environmental data, and sends abnormal prompt information to the AR glasses 200 of the inspection device 1000 for display when abnormal environmental data is obtained. In this way, the server's more powerful computing power can be used to identify abnormal environmental data.

[0113] In one embodiment, the server includes a model module configured with a large anomaly recognition model. The model module is configured to input environmental data transmitted by the inspection device 1000 into the large anomaly recognition model to obtain anomaly prompt information output by the large anomaly recognition model. In this way, the inspection device 1000 can interface with the large anomaly recognition model to process environmental data, thereby obtaining more accurate or detailed anomaly prompt information.

[0114] In one embodiment, the server includes a conversation model equipped with specialized knowledge of handling device anomalies. The conversation model is trained to output audio data containing responses to questions in input audio data. Thus, a user can ask the server conversation model questions through a wireless headset 400, and the conversation model outputs audio data that answers the question to the headset 400 for voice playback, helping the user resolve the device anomaly.

[0115] In the description of this specification, the description with reference to the terms "one embodiment / method", "some embodiments / methods", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment / method or example are included in at least one embodiment / method or example of the present application. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment / method or example. Moreover, the specific features, structures, materials or characteristics described may be combined in an appropriate manner in any one or more embodiments / methods or examples. In addition, those skilled in the art may combine and combine different embodiments / methods or examples described in this specification and the features of different embodiments / methods or examples, unless they are contradictory.

[0116] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of such features. Throughout the description of this application, "plurality" means at least two, for example, two, three, etc., unless otherwise specifically defined.

[0117] Those skilled in the art will appreciate that the above embodiments are merely intended to clearly illustrate the present disclosure and are not intended to limit the scope of the present disclosure. Other changes or modifications may be made based on the above disclosure, and such changes or modifications are still within the scope of the present disclosure.

Claims

1. A patrol inspection device, characterized in that: include: Sensor module, storage box and AR glasses; The sensor module includes a plurality of sensor components, each of which is used to collect different environmental data of the inspection area. The sensor component includes a connector and a first communication unit, the connector is used to detachably connect the sensor component to the AR glasses, and the first communication unit is used to wirelessly communicate with the storage box; The storage box includes a box body and a communication module and a processing module accommodated in the box body. The box body is provided with a storage compartment, the storage compartment is used to store the sensor module, the communication module is used to wirelessly communicate with the sensor module and the AR glasses, and the processing module is used to process the environmental data transmitted by the sensor component to determine abnormal environmental data, and when abnormal environmental data is determined, transmit abnormal prompt information to the AR glasses for display; The AR glasses include lenses, temples and a second communication unit. The lenses are used to display abnormal prompt information transmitted by the storage box. The temples can be detachably connected to the connector. The second communication unit is used to wirelessly communicate with the storage box.

2. The inspection device according to claim 1, characterized in that: The communication module is used to receive inspection instruction information transmitted by an external server and send the inspection instruction information to the AR glasses for display; The inspection instruction information includes the type of the sensor component required for the inspection.

3. The inspection device according to claim 1, characterized in that: The sensor assembly includes a connecting structure, which can be detachably connected to the connecting structure of other sensor assemblies to connect the two sensor assemblies. When the two sensor assemblies are connected, the connecting piece of one of the sensor assemblies can be detachably connected to the temples to connect the two sensor assemblies to the AR glasses.

4. The inspection device according to claim 1, characterized in that: The connecting member includes two clamping arms. When the sensor assembly is connected to the AR glasses, the temples are clamped between the two clamping arms.

5. The inspection device according to claim 1, characterized in that: The connecting member includes a magnetic unit, The temple includes a first magnetic portion, which can be magnetically connected to the magnetic unit. The outer surface of the storage box includes a second magnetic portion, which can be magnetically connected to the magnetic unit.

6. The inspection device according to claim 1, characterized in that: The storage box includes a storage module housed in the box body, wherein the storage module stores abnormal data samples; The processing module processes the environmental data transmitted by the sensor component to determine the abnormal environmental data, including: the processing module performs data comparison between the environmental data and the abnormal data sample to determine the abnormal environmental data.

7. The inspection equipment according to claim 1, characterized in that: The processing module is used to process the environmental data transmitted by the sensor assembly to determine abnormal environmental data, including: If the environmental data is image data, the edge computing capability of the application processing module is used to perform AI recognition to determine whether the environmental data is abnormal environmental data.

8. The inspection device according to claim 1, characterized in that: The storage box includes a storage module housed in the box body, the storage module is used to store the original environmental data collected by the sensor assembly and the abnormal environmental data determined by the processing module; The communication module is used to transmit the original environmental data and the abnormal environmental data to an external server; Receive abnormal prompt information transmitted by external servers; And transmit the abnormal prompt information transmitted by the external server to the AR glasses for display.

9. The inspection device according to claim 1, characterized in that: The inspection device also includes a wireless headset, which is connected to the storage box via wireless communication to achieve data exchange, and the processing module is used to transmit abnormal prompt audio to the wireless headset for voice broadcast when abnormal environmental data is determined. The box body is provided with an earphone compartment, which is used to store the wireless earphones. The storage box includes a power supply module housed in the box body, and the power supply module includes an earphone power supply contact that is at least partially exposed from the earphone compartment. When the wireless earphones are stored in the earphone compartment, the earphone charging contacts of the wireless earphones are in contact with the earphone power supply contacts so that the storage box can output current to the wireless earphones.

10. A patrol inspection system, characterized in that: include: The inspection device according to any one of claims 1 to 9; A server, wherein the server and the inspection device realize data interaction through wireless communication connection; the server includes a model module configured with an abnormality recognition large model, and the model module is used to input the environmental data transmitted by the inspection device into the abnormality recognition large model to obtain abnormal prompt information output by the abnormality recognition large model.

Images