Inspection photographing guidance system and method

Abstract

An inspection photographing guidance system, comprising a server, one or more user ends, and a plurality of nodes. The server is in signal connection with the user end and the plurality of nodes, and the plurality of nodes respectively correspond to a plurality of items needing to be inspected in a field domain to be inspected. The server generates a map corresponding to the field domain. The server generates an inspection list on the basis of one or more attributes of each node, and, on the basis of the inspection list, instructs to guide the user end to a photographing range of each node of the map. When the user end enters the photographing range, a camera is turned on and a user is prompted to capture inspection image data within a limited time. The user end automatically returns the inspection image data to the server.

Description

Interrogation and shooting guidance system and method Technical Field

[0001] The present invention relates to an interrogation and guidance system, in particular to an interrogation and shooting guidance system. Background Art

[0002] In mature, developed countries, businesses must comply with numerous regulations and standards, striving to fulfill their social responsibilities and creating a sustainable, safe, fair, and healthy working environment for shareholders, employees, customers, suppliers, and society. To demonstrate that businesses meet certain regulatory requirements (e.g., environmental protection, fire protection, workplace safety, etc.) or standards (e.g., ISO quality systems), regular and periodic audits are essential for modern business operations. However, these audits are often tedious, time-consuming, and resource-intensive. Furthermore, the changing scope of audit targets often complicates the audit process and the recording of results, leading to duplication of audits due to unclear records.

[0003] Furthermore, due to human subjectivity, fatigue, time pressure, and potential dishonesty issues, manual audits carry the risk of inaccurate or falsified audits. For example, manual audits rely on subjective judgment and honesty, which can lead to intentional errors or manipulation. Furthermore, fatigue and time pressure can cause audit personnel to overlook details or adopt less rigorous methods, resulting in incomplete and inaccurate data being recorded. This reduces audit effectiveness, increases enterprise costs, and increases the risks associated with inaccurate audits.

[0004] In view of this, developing an inspection system that reduces inspection costs and improves accuracy and efficiency has become an urgent goal in related fields.

[0005] Summary of the Invention

[0006] To reduce inspection costs and improve accuracy and efficiency, the present invention provides an inspection and photography guidance system comprising a server, one or more user terminals, and multiple nodes. The server is signal-connected to the user terminals and the multiple nodes; each of the multiple nodes corresponds to multiple items to be inspected within a site to be inspected; the server generates a map of the site, creates an inspection list based on one or more attributes of each node, and, based on the inspection list, notifies and guides the user terminal to a capture range within each node on the map; upon entering the capture range, the user terminal activates a camera and is prompted to capture an inspection video within a limited time; and the user terminal automatically transmits the inspection video back to the server.

[0007] The user terminal is continuously connected to the server, and the server obtains location information of the user terminal. The server reads and compares the location information of the user terminal and the distance between the node to be checked to determine whether the user terminal enters a shooting range of the node.

[0008] The node includes a position reporting unit, which confirms whether the user terminal is connected to the node and determines whether the user terminal enters the shooting range of the node based on the signal strength of the connection.

[0009] The position reporting unit is a Bluetooth sensor unit, and the Bluetooth sensor unit uses the received signal strength indicator (RSSI) and the angle of arrival (AoA) in the Bluetooth protocol to determine whether the user terminal has entered the shooting range according to the Bluetooth signal strength and angle.

[0010] The location reporting unit is a near field communication (NFC) sensing unit that uses NFC technology. When the distance between the user terminal and the node is less than 4 centimeters, the user terminal connects with the NFC sensing unit signal and determines that the user has entered the shooting range of the node.

[0011] The user terminal guides the user to shoot the node at a specified position and angle with the camera in an augmented reality (AR) manner.

[0012] The server or the user terminal compares the interrogation image data with the node's previous interrogation image data using an algorithm to determine whether the difference in the shooting results is too large, wherein the algorithm includes a hash algorithm, a structural similarity index (SSIM index), a deep learning algorithm, or a combination of the above three algorithms for feature extraction.

[0013] The server or the user terminal simultaneously checks the Exchangeable Image File Format (Exif) information of the query image data and compares it with the hardware information of the user terminal to confirm that the query image data was indeed taken by the user terminal, and simultaneously adds a timestamp and encrypts the query image data to ensure that it cannot be modified.

[0014] The present invention further provides an interrogation and photographing guidance method, which includes the interrogation and photographing guidance system as described above, and includes the following steps: the user terminal loads the interrogation information; the user terminal or the server determines whether the user terminal enters the photographing range of the node to be interrogated among multiple nodes; when the user terminal enters the photographing range, the user terminal activates the camera, guides and limits the user to photograph the node, and obtains the interrogation image data; and the user terminal or the server compares and confirms the interrogation image data, and guides the user terminal to the next node or completes the interrogation and photographing.

[0015] In the step of comparing and confirming the interrogation image data by the user terminal or the server, when the interrogation image data shows abnormality, the user terminal or the server sends an alarm message to a supervisory unit.

[0016] It can be seen from the above description that the present invention has the following characteristics:

[0017] 1. The interrogation and photography guidance system of the present invention can provide automatic guidance for interrogation and photography, greatly improving interrogation efficiency, increasing interrogation capacity and speeding up interrogation, and reducing the burden on interrogators.

[0018] 2. The interrogation and photography guidance system of the present invention can significantly improve the quality of interrogation data, help reduce errors and inconsistencies in interrogation reports, and avoid human errors, reducing the possibility of negligent or incomplete interrogations.

[0019] 3. The interrogation and photography guidance system of the present invention reduces interrogation errors through multiple anti-fraud mechanisms, ensures that interrogators actually conduct interrogations at designated locations, and helps ensure the integrity and accuracy of data. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] FIG1 is a schematic diagram of a system network according to a preferred embodiment of the present invention;

[0021] FIG2 is a schematic diagram of a system block diagram of a preferred embodiment of the present invention;

[0022] FIG3 is a schematic diagram of an inspection field according to a preferred embodiment of the present invention;

[0023] FIG4 is a schematic diagram showing the distance relationship between a user terminal and a node according to a preferred embodiment of the present invention;

[0024] FIG5 is a schematic diagram of an inspection site inspection according to a preferred embodiment of the present invention;

[0025] FIG6 is a flow chart of a preferred embodiment of the present invention.

[0026] Explanation of symbols: 10: Server 20, 20A, 20B: User terminal 30: Field 32: Node R, RA, RB: Shooting range DETAILED DESCRIPTION

[0027] To more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing each embodiment. Obviously, the drawings described below are merely examples or embodiments of the present invention. Those skilled in the art can apply the present invention to other similar scenarios based on these drawings without inventive effort. Unless otherwise apparent from the context or otherwise noted, the same reference numerals in the figures represent the same structure or operation.

[0028] As used herein and in the claims, unless the context clearly indicates otherwise, the words "a," "an," "an," or "the" are not intended to refer to the singular but may include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements specifically identified, and these steps and elements do not constitute an exclusive list; a method or apparatus may also include additional steps or elements.

[0029] Flowcharts are used in this disclosure to illustrate the operations performed by systems according to embodiments of the present invention. It should be understood that the preceding and following operations do not necessarily need to be performed in exact order. Instead, the steps may be processed in reverse order or simultaneously. Furthermore, other operations may be added to these processes, or one or more operations may be removed from these processes.

[0030] Please refer to Figures 1 to 3, which illustrate a preferred embodiment of an inspection and photo-taking guidance system provided by the present invention. The system comprises a server 10, one or more user terminals 20, and multiple nodes 32. The server 10 may be a cloud server, communicating with the user terminals 20 and multiple nodes 32 via the cloud. This communication may be wired or wireless. The nodes 32 are dispersed throughout a field 30. In the present invention, field 30 refers to the area awaiting inspection. Field 30 may be a factory, a room, an office building, or a factory. Each node 32 represents an item to be inspected in field 30. The types of items corresponding to each node 32 are not limited and may encompass different inspection items depending on the purpose of the inspection. For example, each node 32 may include firefighting facilities, fire hydrants, notification systems, signage, shelters, emergency lighting, emergency power supplies, and the like that comply with fire regulations. Each of the nodes 32 may also be an air conditioner, boiler, automobile, electricity, motor, steam equipment, production equipment, water heater, etc. for the purpose of inventorying an organization's carbon emissions (such as the greenhouse gas inventory principles of ISO14064-1).

[0031] The server 10 generates a map corresponding to each of the sites 30. The map can be a two-dimensional or three-dimensional map, preferably a three-dimensional map in this embodiment. In this embodiment, each node 32 in the site 30 continuously obtains an attribute of each node 32. In the present invention, the so-called attribute refers to information related to each node 32. Different information can be recorded based on the differences in different inspection points. For example, the attributes of each node 32 can include at least an inspection history, an inspection date, target information, and specifications. The attributes of each node 32 can also include information such as the type of fire protection facility, the inspection date of the fire protection facility, the age of the fire protection facility, the location of the fire protection facility, the size of the compartment, the material of the compartment, the distance specifications of the compartment, the functional status of the fire door lock, and the function of the fire extinguishing equipment.

[0032] Furthermore, the server 10 of this embodiment can generate a query list based on the attributes obtained by exchanging messages with the user terminal 20 and each node 32, and store and record all the nodes 32 and their corresponding attributes, as shown in the following table:

[0033] Table 1 Inventory List

[0034] As shown in Table 1 above, the checklist can list all nodes 32 according to different check purposes, and record the attributes and locations of each node 32 in the same checklist. The location corresponding to each node 32 in Table 1 is marked on the map.

[0035] The storage list is stored in the server 10 .

[0036] Furthermore, each node 32 may have a corresponding status reporting module, which includes a location reporting unit, an image information reporting unit, and / or a functional status reporting unit. The location reporting unit may be a positioning unit or a wireless transmission unit, such as an indoor positioning unit. In addition to recording its corresponding position on the map, it may establish a signal connection with the user terminal 20 and report the location of the node 32 and the distance between the user terminal 20 and the node 32 to the server 10. For example, the location reporting unit may be a Bluetooth sensor unit. When the user terminal 20 approaches the node 32, it establishes a pairing connection with the user terminal 20 and immediately reports to the server 10 that the user terminal 20 is close to the node 32. The server 10 then transmits the query list, attributes, and other information corresponding to the node 32 to the user terminal 20. The image information reporting unit captures a real-time streaming image or a photo image of the node 32 and transmits it back to the server 10, which may also update the query list accordingly. The function status reporting unit records and reports a working condition and a status of the node 32, wherein the so-called working condition and status are related to the device type of the node 32 and the inspection focus. For example, the voltage, current, heat output, real-time temperature, carbon dioxide emission results, gas flow rate per second and other data can be output according to different device types; and if the node 32 is to monitor specific dimensions, functions, etc., the working condition and status can be spatial dimensions, interval distance, etc., so the status reporting unit may be a real-time dimension measurement device, such as a microwave or infrared ranging device, a foreign object monitoring device, etc., and the detection results and the attributes are returned to the server 10.

[0037] The user terminal 20 can be a mobile device, computer, or other device. Preferably, the user terminal 20 is a mobile device that is preferably connected to the server 10 wirelessly and receives information such as the map, the checklist, the location of each node 32, and the attributes from the server 10. The user terminal 20 performs a checklist and captures the information, connects to the server 10, and obtains the map and the checklist. The checklist and capture can be implemented using an application, such as the application running on the mobile device of the user terminal 20.

[0038] 3 to 6 , the system for checking shooting instructions of the present invention performs a method for checking shooting instructions, including the following steps:

[0039] Step S1: The user terminal 20 loads the query information. In step S1, the user terminal 20 executes the application and can connect to the server 10 in advance or immediately to obtain the query list. The query list can be a list of all attributes of each node 32, facilitating detailed routine or annual audits, or it can be a list of randomly selected or designated attributes, facilitating rapid spot checks. Preferably, the user terminal 20 can also simultaneously input, annotate, or schedule the query list as needed to further optimize query efficiency.

[0040] Step S2: The interrogation and photographing guidance system determines whether the user terminal 20 is close to the node 32 to be interrogated. In step S2, several methods can be used to determine whether the user terminal 20 is close to the node 32 to be interrogated. In one embodiment, the user terminal 20 is continuously connected to the server 10, and the server 10 can obtain the location information of the user terminal 20 in the map. The server 10 can compare the distance between the location of the user terminal 20 and the location of the node 32 to be interrogated. When the user terminal 20 is sufficiently close to the location of the node 32 to be interrogated within a photographing range R, the user terminal 20 is determined to be close to the node 32 to be interrogated. The user terminal 20 estimates the location of the user terminal 20 in the field using a global navigation satellite system (GNSS), such as the global positioning system (GPS) or the assisted global positioning system (AGPS), or using the gyroscope and / or accelerometer of the user terminal 20.

[0041] Please refer to FIG4 and FIG5 . In another embodiment, whether the user terminal 20 is close to the node 32 to be interrogated is determined by whether the location reporting unit of the node 32 to be interrogated is connected to the user terminal 20. The location reporting unit of the node 32 can determine the mode and method of connection according to the attribute of the node 32. For example, the location reporting unit is a near field communication (NFC) sensing unit using NFC technology. When the distance between the user terminal 20 and the node 32 is less than 4 cm, the user terminal 20 connects with the near field communication sensing unit and exchanges information, which means that the user terminal 20 is determined to be close to the node 32 to be interrogated. In some wider and longer-range applications, the location reporting unit is a Bluetooth sensor unit. The Bluetooth sensor unit uses the Received Signal Strength Indication (RSSI) and Angle of Arrival (AoA) in the Bluetooth protocol to determine whether the user terminal 20 has entered the imaging range R based on the Bluetooth signal strength and angle. In a preferred embodiment, as shown in Figures 4 and 5, the imaging range R is within a 2-meter radius of the node 32. Since the user terminal 20A has not entered the imaging range R, RA of the node 32, the system determines that the user terminal 20A is not close enough to the node 32 to be interrogated. However, since the user terminal 20B has entered the imaging range R, RB of the node 32, the system determines that the user terminal 20A is close enough to the node 32 to be interrogated.

[0042] More preferably, in a preferred embodiment, the user terminal 20 simultaneously connects to the server 10 and transmits information confirming the location of the user terminal 20 in the map, while also attempting to establish a connection with the node 32 to be interrogated. When the location information of the user terminal 20 matches the connection information of the node 32, the system determines that the user terminal 20A is close enough to the node 32 to be interrogated. The dual mechanism confirms that the user terminal 20 has entered the shooting range R.

[0043] Step S3: Activate the camera on the user terminal 20 to capture the node 32 for a limited time, obtaining an inspection image. In step S3, if step S2 determines that the user terminal 20 has entered the imaging range R of the node 32 to be inspected, the camera on the user terminal 20 is automatically activated to allow the user to capture the inspection image of the node 32.

[0044] When the camera on the user terminal 20 is activated, the interrogation and photographing guidance system instructs the user terminal 20 to simultaneously start a timer, requiring the user to complete photographing the node 32 within a specified time limit. In a preferred embodiment, the time limit is 30 seconds. If the photographing is not completed within the time limit, the system returns to step S2 to reconfirm the position of the user terminal 20 and whether the user terminal 20 is still within the photographing range R. If so, step S3 is executed again.

[0045] During the shooting process, the interrogation shooting guidance system of the present invention guides the user to shoot the node 32 correctly and clearly. For example, the interrogation shooting guidance system guides the user to shoot the node 32 at the correct shooting angle and shooting position to obtain the correct interrogation image data, and obtain the key and necessary attribute information of the interrogation from the interrogation image data. Preferably, the interrogation shooting guidance system can guide the user to shoot at the correct position in an augmented reality (AR) manner. In one embodiment, the user terminal 20 simultaneously displays the shooting instant preview screen and an outline of the correct shooting angle and position of the node 32 superimposed thereon, so that the user can correctly shoot the interrogation image data by aligning the preview image of the node 32 in the shooting instant preview screen with the outline. In another embodiment, the interrogation shooting guidance system can display the past interrogation image data of the node 32 for the user to refer to the shooting position and angle.

[0046] Step S4: Compare and confirm the shooting results to complete the interrogation and shooting. In step S4, the interrogation and shooting guidance system checks the interrogation image data and checks whether the interrogation image data is clear and correct. In some preferred embodiments, the interrogation and shooting guidance system compares the interrogation image data with the previous interrogation image data of the node 32 to determine whether the difference in shooting results is too large. Preferably, the interrogation and shooting guidance system uses a hash algorithm (Hash algorithm), a structural similarity index (SSIM index) or a deep learning algorithm (deep learning algorithm) for feature extraction or a combination of the above three algorithms to determine whether the interrogation image data is too different from the previous interrogation image data of the node 32. If it is too large, step S2 is repeated.

[0047] In step S4 , the interrogation and shooting guidance system simultaneously checks the Exchangeable Image File Format (Exif) information of the interrogation image data and compares it with the hardware information of the user terminal 20 to confirm that the interrogation image data is indeed shot by the user terminal 20 .

[0048] Preferably, the interrogation and filming guidance system simultaneously adds a time stamp to the interrogation image data and encrypts the interrogation image data to prevent it from being edited and tampered.

[0049] Preferably, after the user terminal 20 captures and obtains the interrogation image data, the interrogation image data is encrypted and uploaded to the server 10 to perform step S4. The interrogation shooting guidance system guides the user to continue to the next node 32 for interrogation or terminate the interrogation.

[0050] Preferably, when the inspection image data is abnormal, the inspection shooting guidance system can send a warning message to a supervisory unit, which can be a government agency or a third-party inspection agency, so that relevant personnel can immediately deal with possible abnormalities or inspection problems of the node 32.

[0051] It can be seen from the above description that the present invention achieves the following effects:

[0052] 1. The interrogation and photography guidance system of the present invention can provide automatic guidance for interrogation and photography, greatly improving interrogation efficiency, increasing interrogation capacity and speeding up interrogation, and reducing the burden on interrogators.

[0053] 2. The interrogation and photography guidance system of the present invention can significantly improve the quality of interrogation data, help reduce errors and inconsistencies in interrogation reports, and avoid human errors, reducing the possibility of negligent or incomplete interrogations.

[0054] 3. The interrogation and photography guidance system of the present invention reduces interrogation errors through multiple anti-fraud mechanisms, ensures that interrogators actually conduct interrogations at designated locations, and helps ensure the integrity and accuracy of data.

[0055] It should be noted that, based on the explanations and elaborations of the above description, those skilled in the art may also make changes and modifications to the above embodiments. Therefore, the present disclosure is not limited to the specific embodiments disclosed and described above, and equivalent modifications and variations of the present disclosure are also within the scope of protection of the claims of the present disclosure. Furthermore, although certain specific terms are used in this description, these terms are for convenience only and do not constitute any limitation on the invention.

Claims

1. A system for guiding inventory taking and shooting, characterized in that, It includes a server, more than one client, and multiple nodes, where: The server is signal-connected to the client and the multiple nodes; Each of the multiple nodes corresponds to multiple items to be inspected in a field to be inspected; The server generates a map corresponding to the field, and the server generates an inspection list based on one or more attributes of each of the nodes, and notifies and guides the client to a shooting range of each node on the map according to the inspection list; When the client enters the shooting range, it turns on a camera and prompts a user to shoot inspection image data within a limited time; and The client automatically uploads the inspection image data to the server.

2. The inventory shooting guidance system according to claim 1, characterized in that The client continuously connects to the server. The server obtains a location information of the client. The server interprets and compares a distance between the location information of the client and the node to be inspected, and determines whether the client enters a shooting range of the node.

3. The inventory shooting guidance system according to claim 1, characterized in that, The node includes a location reporting unit, and the location reporting unit confirms whether there is a signal connection between the client and the node and determines whether the client enters the shooting range of the node according to the connection signal strength.

4. The inventory shooting guidance system according to claim 3, characterized in that, The location reporting unit is a Bluetooth sensing unit, and determines whether the client has entered the shooting range according to the Bluetooth signal strength and angle through the Bluetooth sensing unit using the Received Signal Strength Indication (RSSI) and Angle of Arrival (AoA) in the Bluetooth protocol.

5. The inventory shooting guidance system according to claim 3, wherein, The location reporting unit is a near field communication sensing unit using Near Field Communication (NFC) technology. When the distance between the client and the node is less than 4 cm, the client is signal-connected to the near field communication sensing unit and determines that the user enters the shooting range of the node.

6. The inventory and shooting guidance system according to claim 1, wherein The client guides the user to shoot the node at a specified position and angle with the camera in the way of Augmented Reality (AR).

7. The inventory and shooting guidance system according to any one of claims 1 to 6, characterized in that, The server or the client compares the inspection image data with the previous inspection image data of the node by an algorithm to determine whether the difference in the shooting results is too large, where the algorithm includes a hash algorithm, a structural similarity index (SSIM index), a deep learning algorithm, or a combination of the above three algorithms for feature extraction.

8. The inventory shooting guidance system according to claim 7, characterized in that, The server or the client simultaneously checks the Exchangeable image file format (Exif) information of the inspection image data, compares it with the hardware information of the client, confirms that the inspection image data was indeed captured by the client, adds a time stamp thereto, and encrypts and secures the inspection image data against modification.

9. A method for guiding inventory taking and shooting, characterized in that, It includes the inspection shooting guidance system as described in claim 1, and includes the following steps: The client loads the inspection information; The client or the server determines whether the client has entered the shooting range of the node to be inspected among multiple nodes; When the client enters the shooting range, the client activates the camera, guides and limits the user to shoot the node, and obtains the inspection image data; And The client or the server compares and confirms the inspection image data, and guides the client to the next node or completes the inspection shooting.

10. The inventory shooting guidance method according to claim 9, characterized in that, In the step where the client or the server compares and confirms the inspection image data, when the inspection image data is abnormal, the client or the server transmits a warning message to a regulatory agency.

Images