Automated on-site supervision data generation method and supervision data management system using same

Abstract

According to an embodiment of the present disclosure, an automated on-site supervision data generation method performed by a user terminal operating in conjunction with a system server, includes the steps of: scanning a scan code provided on-site and obtaining supervision metadata corresponding to the scan code; generating an image in response to a request of a user on-site; generating on-site information data on the basis of a generation location and a generation time of the image; and generating on-site supervision data by visually reflecting the supervision metadata and the on-site information data to the image.

Description

Method for Automatic Generation of On-site Supervision Data and Supervision Data Management System Using the Same

[0001] The present disclosure relates to a method for automatically generating field supervision data and a supervision data management system using the same.

[0002] Supervision is performed at various sites, including construction sites; however, traditional supervision tasks required the preparation of reports based on handwritten records during site inspections. Consequently, there is a growing movement to implement such on-site supervision using digital platforms.

[0003] However, conventional supervision technologies typically involved manually collecting photos taken at the supervision site and writing reports by hand based on metadata; consequently, there was a high possibility of errors occurring during the process of separately manually entering information such as photo source details or shooting locations, and there were limitations due to significant time consumption.

[0004] These conventional technologies have problems such as reduced efficiency due to the necessity of manual work and the inability to ensure the accuracy and integrity of the collected or generated data.

[0005] Meanwhile, a prior art document related to this is Korean Published Patent Application No. 10-2022-0019909 (Date of publication: 2022.02.18).

[0006] One technical objective of the present disclosure is to provide a method for automatically generating field supervision data and a supervision data management system using the same, which can improve the user's work efficiency by easily and automatically generating field supervision data based on a mobile device such as a smartphone used by the field supervision user, and by automatically reflecting supervision metadata and field information in the field data without any separate work during field supervision.

[0007] Another technical objective of the present disclosure is to provide a method for automatically generating field supervision data and a supervision data management system using the same, which can generate more precise field supervision data by preventing mis-registration of field data through verification between supervision metadata and field data.

[0008] Another technical objective of the present disclosure is to provide a method for automatically generating field supervision data and a supervision data management system using the same, which can independently guarantee integrity and prevent tampering with the supervision data itself by generating supervision metadata and field data as hash data and reflecting it in a watermark to display it on the supervision data.

[0009] The technical problems of the present disclosure are not limited to the technical problems described above, and technical problems not mentioned will be clearly understood by those skilled in the art to which the present disclosure belongs from the present specification and the accompanying drawings.

[0010] This summary is provided to introduce the selection of the concept in a simplified form, which is further explained in the detailed description below. This summary is not intended to identify the principal or essential features of the claimed subject matter, nor is it intended to assist in determining the scope of the claimed subject matter.

[0011] A method for automatically generating field supervision data performed at a user terminal operating in conjunction with a system server, according to one embodiment of the present disclosure, may include the steps of: scanning a scan code provided at the site and obtaining supervision metadata corresponding to the scan code; generating an image at the site according to a user's request; generating field information data based on the creation location and creation time of the image; and generating field supervision data by visually reflecting the supervision metadata and the field information data onto the image.

[0012] In one embodiment, the supervision metadata may include one or more of site information, project information, site location information, client information, and supervision information. The supervision information may include one or more of supervision item information, supervision standard information, supervision phase information, and inspection schedule information.

[0013] In one embodiment, the step of generating site supervision data by visually reflecting the supervision metadata and the site information data onto the image may include: generating supervision display text including site information and supervision information from the supervision metadata; and overlaying and displaying the supervision display text at a preset first location on the image.

[0014] In one embodiment, the step of generating field supervision data by visually reflecting the supervision metadata and the field information data onto the image may further include: generating field information text including the shooting location and shooting time of the image from the field information data; and overlaying and displaying the field information text at a preset second location on the image.

[0015] In one embodiment, the step of generating field supervision data by visually reflecting the supervision metadata and the field information data onto the image may further include the step of generating a watermark in relation to the image and overlaying and displaying the watermark at a preset third location on the image.

[0016] A supervision data management system according to one embodiment of the present disclosure may include: a system server that generates and manages supervision data including supervision metadata; and a user terminal that scans a scan code placed at a site, obtains supervision metadata corresponding to the scan code from the system server, generates site information data based on the creation location and creation time of an image generated at the site, and generates site supervision data by visually reflecting the supervision metadata and the site information data onto the image. The system server may update the supervision data by reflecting the site supervision data.

[0017] In one embodiment, when the system server receives the field supervision data, it can perform verification between the field information data and the supervision metadata regarding the field supervision data.

[0018] In one embodiment, the supervision metadata may include one or more of site information, project information, site location information, client information, and supervision information. The supervision information may include one or more of supervision item information, supervision standard information, supervision phase information, and inspection schedule information.

[0019] In one embodiment, the user terminal may generate supervision display text including site information and supervision information in supervision metadata, generate site information text including the shooting location and shooting time of the image in the site information data, display the site information text by overlaying it at a preset second location of the image, and display the supervision display text by overlaying it at a preset first location of the image.

[0020] A computer-readable recording medium according to one embodiment of the present disclosure may store computer-readable instructions. When executed by a computing device, the instructions may cause the computing device to perform the following operations: scanning a scan code provided at the site and obtaining supervision metadata corresponding to the scan code; generating an image at the site according to a user's request; generating site information data based on the creation location and time of the image; and generating site supervision data by visually reflecting the supervision metadata and the site information data onto the image.

[0021] The technical solution of the present disclosure is not limited to the technical solution described above, and technical solutions not mentioned will be clearly understood by those skilled in the art to which the present disclosure belongs from the present specification and the attached drawings.

[0022] According to one embodiment of the present disclosure, there is an effect of easily and automatically generating field supervision data based on a mobile device, such as a smartphone, used by a field supervision user.

[0023] According to one embodiment of the present disclosure, the supervision metadata and site information can be automatically reflected in the site data without any separate work during on-site supervision, thereby improving the user's work efficiency.

[0024] According to one embodiment of the present disclosure, by performing verification between supervision metadata and field data, the mis-registration of field data can be prevented, thereby enabling the generation of more precise field supervision data.

[0025] According to one embodiment of the present disclosure, by generating supervision metadata and field data as hash data and reflecting it in a watermark to display it on the supervision data, the integrity and prevention of falsification can be independently guaranteed solely by the supervision data itself.

[0026] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure pertains from the present specification and the accompanying drawings.

[0027] FIG. 1 is a drawing illustrating a supervision data management system according to one embodiment of the present disclosure.

[0028] FIG. 2 is a flowchart illustrating a supervision data management method performed in a supervision data management system according to one embodiment of the present disclosure.

[0029] FIG. 3 is a block diagram illustrating an example of a user terminal according to an embodiment of the present disclosure.

[0030] FIG. 4 is a flowchart illustrating a method for automatically generating field supervision data performed at a user terminal according to one embodiment of the present disclosure.

[0031] FIG. 5 is a drawing for explaining an automatically generated field supervision image according to one embodiment of the present disclosure.

[0032] FIG. 6 is a flowchart illustrating an embodiment of step S460 of FIG. 4.

[0033] FIG. 7 is a drawing for explaining an automatically generated field supervision image according to one embodiment of the present disclosure.

[0034] FIG. 8 is a block diagram illustrating an embodiment of the watermark generation unit illustrated in FIG. 3.

[0035] FIG. 9 is a flowchart illustrating an example of a method for automatically generating field supervision data performed in a watermark generation unit illustrated in FIG. 8.

[0036] FIG. 10 is a block diagram illustrating an example of a system server according to one embodiment of the present disclosure.

[0037] FIG. 11 is a flowchart illustrating a method for managing audit data in a system server according to one embodiment of the present disclosure.

[0038] FIG. 12 is a block diagram illustrating an embodiment of the watermark verification unit illustrated in FIG. 10.

[0039] FIG. 13 is a drawing illustrating an example of a report automatically generated according to one embodiment of the present disclosure.

[0040] FIG. 14 is a drawing illustrating an example of a work process provided through a user terminal according to an embodiment of the present disclosure.

[0041] FIG. 15 is a drawing illustrating an example of a work process provided through an administrator terminal according to one embodiment of the present disclosure.

[0042] FIG. 16 is a drawing illustrating an exemplary computing operating environment of a system server according to one embodiment of the present disclosure.

[0043] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0044] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another corresponding component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0045] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0046] Various embodiments of this document may be implemented as software (e.g., a program) comprising one or more instructions stored in a storage medium (e.g., memory) readable by a machine or device. For example, the processor of the machine or device may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by a machine may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium.

[0047] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0048] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0049] In this disclosure, the term "processor" may refer to hardware capable of performing functions and operations according to each designation described herein, computer program code capable of performing specific functions and operations, or an electronic recording medium loaded with computer program code capable of performing specific functions and operations. According to the embodiments, the operation of the processor may be defined and / or interpreted as the operation of a digital signage content providing device, but is not limited thereto. The processor may refer to a functional and / or structural combination of hardware for carrying out the technical concept of this disclosure and / or software for driving said hardware.

[0050] FIG. 1 is a drawing illustrating a supervision data management system according to one embodiment of the present disclosure.

[0051] The supervision data management system includes a user terminal (100), an administrator terminal (200), and a system server (300).

[0052] The user terminal (100) is a portable computing device used by a user, that is, a user performing supervision at the site, to receive supervision data management services. The user terminal (100) is a mobile computing device such as a smartphone, PDA (personal digital assistants), tablet PC, laptop computer, navigation, slate PC, ultrabook, PMP (portable multimedia player), or smartwatch, and is a device that includes a function to acquire location information such as a GPS (Global Positioning System).

[0053] The system server (300) generates and manages audit data including audit metadata.

[0054] The system server (300) can generate supervision data based on data input from the administrator terminal (200).

[0055] For example, supervision data may include various information such as project information regarding the project's purpose, scope, and progress; supervision plan information regarding the supervision objectives, schedule, and scope; supervision result information regarding items checked during the supervision, identified problems, and improvements; risk factor information regarding risks and potential problems discovered during the supervision and recommendations for resolving them; and improvement recommendation information regarding measures or improvements necessary for the successful completion of the project.

[0056] The user terminal (100) can be linked with the system server (300) to immediately generate data regarding supervision acquired at the site, i.e., site supervision data, and can provide the generated site supervision data to the system server (300). The system server (300) can update the supervision data by reflecting the provided site supervision data in the supervision data.

[0057] The system server (300) can provide the supervision data being stored and managed to the administrator terminal (200) to perform management tasks such as verifying the supervision data.

[0058] FIG. 2 is a flowchart illustrating a supervision data management method performed in a supervision data management system according to one embodiment of the present disclosure.

[0059] Referring to FIG. 2, when the administrator terminal (200) receives supervision data from the administrator (S201), the system server (300) can generate supervision data including supervision metadata in conjunction with the administrator terminal (200) (S202).

[0060] Here, supervision metadata may include one or more of site information, project information, site location information, client information, and supervision information.

[0061] For example, site information may be the name of the location or project where supervision is being conducted, and project information may be a unique code or ID (identifier) ​​capable of identifying each project. Site location information may be coordinates indicating the site's location (e.g., latitude, longitude), and client information may be information about the organization or company that commissioned the project. Supervision information refers to information related to supervision and may include one or more of supervision item information, supervision standard information, supervision phase information, and inspection schedule information. Supervision item information may be information regarding items to be inspected during supervision (e.g., structural condition, equipment installation status, construction suitability). Supervision standard information may be information regarding standards or specifications applied during supervision (e.g., building codes, safety standards, quality standards). Supervision phase information may be information regarding at which stage of the overall project the supervision is conducted (e.g., foundation work, interim inspection, final acceptance). Inspection schedule information may be information regarding the date and time the supervision was conducted.

[0062] The user terminal (100) is located at the supervision site and can identify each supervision site and generate data generated during the supervision process therein, i.e., on-site supervision data.

[0063] For example, a user terminal (100) can identify a scan code placed at the site and provide scan code identification information therefor to a system server (300) to request supervision metadata (S203).

[0064] The system server (300) can verify the inspection metadata corresponding to the scan code identification information provided by the user terminal (100) and transmit it to the user terminal (100) (S204). The data provided from the system server (300) to the user terminal (100) is inspection metadata. That is, the system server (300) efficiently configures the transmission volume and processing speed by providing only inspection metadata without transmitting separate large-capacity data to the user terminal (100).

[0065] The field information data generated from such supervision metadata and user terminal (100) is reflected in the field supervision data, and through this, information display and verification of the field supervision data can be easily processed with only efficient processing with minimal resources.

[0066] In the following, field data and field supervision data are distinguished. Field data refers to data generated by a user terminal at the supervision site through methods such as photography without separate processing; for example, field images may fall under this category. Field supervision data refers to data generated by processing field data to reflect one or more of supervision metadata and field information data.

[0067] In the following, image data is used as an example of field data and field supervision data, but this is not limited to this, and it is evident that it can be applied to various other types of data (e.g., videos or documents).

[0068] The user terminal (100) can generate a field image, i.e., field data, by performing shooting, etc. at the field site. The user terminal (100) can generate field supervision data by reflecting supervision metadata and field information data in the generated field image (S205).

[0069] For example, a user terminal (100) can generate field supervision data by visually reflecting supervision metadata and field information data onto a field image. Here, visual reflection means that the user can read it with their eyes on at least a part of the area where the image is displayed, and for example, it means displaying text overlaid on the image.

[0070] The user terminal (100) provides the generated field supervision data to the system server (300), and the system server (300) can perform verification between the field supervision data received from the user terminal (100) and the supervision metadata related to the supervision (S206). The system server (300) can perform verification using information visually displayed in the field supervision data.

[0071] Once verification is complete, the system server (300) can update the supervision data by reflecting the field supervision data in the supervision data related to the supervision (S207).

[0072] The administrator terminal (200) can check the updated supervision data, that is, the supervision data for which the field supervision has been completed (S208).

[0073] In one embodiment, the system server (300) can automatically generate a supervision report using field supervision data.

[0074] Hereinafter, with reference to FIGS. 3 to 15, various embodiments of a method for automatically generating field supervision data and a supervision data management system using the same according to the present disclosure will be described.

[0075] FIG. 3 is a block diagram illustrating an example of a user terminal according to an embodiment of the present disclosure, and FIG. 4 is a flowchart illustrating a method for automatically generating field supervision data performed on a user terminal according to an embodiment of the present disclosure.

[0076] Referring to FIG. 3, the user terminal (100) may include a scan code scanner (110), a metadata verification unit (120), an image generation unit (130), a watermark generation unit (140), and a field supervision data management unit (150).

[0077] Referring further to FIG. 4, the scan code scanner (110) identifies the scan code at the site and performs a scan (S410).

[0078] For example, the scan code may be a 2D barcode such as a QR code or a matrix code. The scan code scanner (110) may identify such scan codes in a captured image, read the scan codes, identify information recorded in association with the scan codes (e.g., information for calling a system server for a metadata request), and provide the identified information to the metadata verification unit (120).

[0079] The metadata verification unit (120) can request audit metadata corresponding to the scan code from the system server (300) based on the information identified in the scan code, and receive audit metadata transmitted from the system server (300) in response to the request (S420).

[0080] In one embodiment, the metadata verification unit (120) receives information about the current location from a location verification module (e.g., Global Positioning System (GPS)) of the user terminal (100), and can continuously set the supervision metadata to be the same while the current location is within a certain range of the supervision site (S430). That is, since information about the supervision location exists in the supervision metadata, the metadata verification unit (120) can maintain the supervision metadata to be the same if the current location is within a certain range of the supervision location, and provide a user notification to the user that the current location has left the supervision site if it is outside of this range.

[0081] The metadata verification unit (120) can provide the supervision metadata received from the system server (300) to the field supervision data management unit (150).

[0082] The image generation unit (130) can generate a site image at the supervision site according to the user's request (S440). That is, the image generation unit (130) can control the camera of the user terminal (100) to capture an image of the site and set it as a site image and save it. The image generation unit (130) can provide the generated site image to the site supervision data management unit (150).

[0083] The field supervision data management unit (150) can generate field supervision data based on the field image provided by the image generation unit (130).

[0084] For example, the field supervision data management unit (150) can generate field information data including location information and time information (e.g., date, time) of the user terminal (100) at the time of generating the field image (S450). The location information is information about the location of the supervision site, and the time information is information about the supervision time.

[0085] The field supervision data management department (150) can generate field supervision data (e.g., field supervision image) by visually reflecting supervision metadata and field information data into a field image, and can provide the generated field supervision data to the system server (300) (S460).

[0086] That is, the field supervision data management unit (150) can generate a field supervision image by visually displaying supervision metadata and field information data on a field image, and can provide the generated field supervision image to the system server (300).

[0087] The watermark generation unit (140) can generate a watermark related to a site image and provide it to the site supervision data management unit (150), and the site supervision data management unit (150) can generate a site supervision image by visually displaying this watermark on a part of the site image.

[0088] FIG. 5 is a drawing for explaining an automatically generated field supervision image according to one embodiment of the present disclosure.

[0089] Figure 5(a) is an example of an image taken at the site, i.e., a site image, and Figure 5(b) is an example of a site supervision image generated by the site supervision data management unit (150).

[0090] As shown in FIG. 5(b), the field supervision data management unit (150) can visually display field information data (510) and supervision metadata (520) on a part of the field image, and can generate a field supervision image by additionally displaying a watermark (530) according to the embodiment.

[0091] FIG. 6 is a flowchart illustrating an embodiment of step S460 of FIG. 4.

[0092] Referring to FIG. 6, a method for the field supervision data management unit (150) to visually display supervision metadata and field information data on a field image is described.

[0093] The field supervision data management unit (150) can generate supervision display text containing field information and supervision information about the supervision site from supervision metadata (S461). For example, the field supervision data management unit (150) can generate text about field information and supervision information by selecting a portion from supervision metadata according to a preset rule.

[0094] Additionally, the field supervision data management unit (150) can generate field information text including the shooting location and shooting time of an image from the field information data (S462). For example, the field supervision data management unit (150) can generate text regarding the shooting location and shooting time of an image by selecting a portion of the field information data according to a preset rule.

[0095] The field supervision data management unit (150) can display supervision display text overlayed at a preset first position of the image (S463) and display field information text overlayed at a preset second position of the image (S464).

[0096] The field supervision data management unit (150) can display a watermark by overlaying it on a preset third location of the image (S465).

[0097] FIG. 7 is a drawing for explaining an automatically generated field supervision image according to one embodiment of the present disclosure.

[0098] FIG. 7 illustrates an example in which site information text (710) is overlaid and displayed on the upper left of the site image, supervision display text (720) is overlaid and displayed on the lower left of the site image, and a watermark (730) is overlaid and displayed on the lower right of the site image.

[0099] Since the site supervision image generated in this way displays site information (710) and supervision information (720) on the image, the user can immediately check information about the site supervision using only the image itself.

[0100] In addition, in the embodiments described below, mutual verification is performed based on such field information (710) and supervision information (720) to prevent misregistration of field data and to generate more precise field supervision data.

[0101] FIG. 8 is a block diagram illustrating an embodiment of a watermark generation unit illustrated in FIG. 3, and FIG. 9 is a flowchart illustrating an embodiment of a method for automatically generating field supervision data performed in the watermark generation unit illustrated in FIG. 8.

[0102] Referring to FIG. 8, the watermark generation unit (140) may include a first hash generation module (141), a second hash generation module (142), a shape generation module (143), and a watermark generation module (144).

[0103] Referring further to FIG. 9, the first hash generation module (141) can generate first hash data by applying a first hash algorithm to at least a portion of the supervision indication text (S910).

[0104] The second hash generation module (142) can generate second hash data by applying a second hash algorithm to at least part of the field information text (S920).

[0105] The shape generation module (143) can set a first shape element using first hash data (S930) and can set a second shape element using second hash data (S940).

[0106] The watermark generation module (144) can generate a watermark shape by reflecting the set first shape element and second shape element (S950). The generated watermark shape can be visually displayed on the image (S960).

[0107] For example, the first hash generation module (141) can generate a unique hash value by applying the first hash algorithm to supervision indication text (e.g., site name, supervision date). The second hash generation module (142) can generate a unique hash value by applying the second hash algorithm to site information text (e.g., GPS coordinates, time).

[0108] For example, examples of hash algorithms used include SHA256 and MD5, but are not limited to these.

[0109] The first hash generation module (141) generates first hash data for the supervision indication text, and the second hash generation module (142) generates second hash data for the field information text.

[0110] The shape generation module (143) can generate a shape based on the first hash data and the second hash data.

[0111] In one embodiment, the shape generation module (143) can perform hash value length conversion for each of the first hash data and the second hash data. Specifically, since the hash value is long in hexadecimal, in order to compress or convert the hexadecimal hash value into a processable format, the shape generation module (143) can extract a number at a specific position or extract a specific pattern from the hexadecimal hash value. Furthermore, the shape generation module (143) can use the extracted number or the extracted pattern as a component of the shape.

[0112] In one embodiment, the shape generation module (143) can determine each shape element based on each hash data. For example, the shape generation module (143) may use a number or pattern extracted from the first hash data to set a first shape element (e.g., any one of the size, angle, or color of the shape) and a number or pattern extracted from the second hash data to set a second shape element (e.g., any one of the shape's shape, rotation, or position).

[0113] For example, the shape generation module (143) can select one of various shapes, such as triangles, squares, and circles, depending on a specific number of digits of the hash value.

[0114] For example, the shape generation module (143) can determine the color by setting RGB values ​​based on hash values.

[0115] For example, the shape generation module (143) can adjust the size of the shape by converting the number of hash values ​​into a size.

[0116] For example, the shape generation module (143) can determine the coordinate position and rotation angle of the shape based on the hash value.

[0117] In this way, the first element of a watermark shape is set based on hash data for supervision indication text, and the second element of a watermark shape is set based on hash data for site information text, so that tampering with two different text information can be verified with a single watermark shape.

[0118] In other words, by generating hash data for the supervision metadata and field data respectively, reflecting the generated hash data in a watermark, and displaying this watermark on the supervision data, it is possible to independently guarantee integrity and prevent tampering with the supervision data itself.

[0119] Hereinafter, various embodiments of a system server according to one embodiment of the present disclosure will be described with reference to FIGS. 10 to 16.

[0120] FIG. 10 is a block diagram illustrating an example of a system server according to one embodiment of the present disclosure, and FIG. 11 is a flowchart illustrating a method for managing audit data in a system server according to one embodiment of the present disclosure.

[0121] Referring to FIG. 10, the system server (300) includes a user authentication unit (310), an inspection data management unit (320), a scan code management unit (330), an automatic report generation unit (340), and a watermark verification unit (350).

[0122] Referring further to FIG. 11, the user authentication unit (310) verifies authentication and authority for the field supervision user and manager (S1110). For example, when the field supervision user accesses data via a QR code, the user authentication unit (310) verifies the user's authority and can perform user authentication so that only appropriate tasks can be performed based on the verified authority.

[0123] The supervision data management unit (320) can store, update, and manage supervision data. For example, the supervision data management unit (320) can generate supervision data based on input from an administrator (S1120). Such supervision data may include supervision metadata as described above. The supervision data management unit (320) can update supervision data by reflecting field supervision data generated by field supervision users into the supervision data. If necessary, the supervision data management unit (320) can provide encryption and backup functions so that supervision data can be safely stored.

[0124] In one embodiment, the supervision data management unit (320) can perform verification between the field-generated data and the supervision metadata (S1130). For example, the supervision data management unit (320) can perform a first verification of the creation location and creation time of the field supervision data by comparing the image metadata (e.g., image capture time, GPS location, camera setting value) that is automatically generated for the image when the field image is captured with the location information and time information included in the field supervision data. Subsequently, the supervision data management unit (320) can perform a second verification of the accuracy of the supervision site by comparing the location information included in the field supervision data with the field information included in the supervision metadata.

[0125] The scan code management unit (330) can manage scan codes in association with the supervision metadata included in the supervision data. For example, the scan code management unit (330) can generate scan codes corresponding to the supervision metadata and manage them in association (S1140).

[0126] When the scan code management unit (330) receives information about a scan code from the user terminal (100), it can provide supervision metadata corresponding to the scan code to the user terminal (100). At this time, the scan code management unit (330) can verify the user's authority in conjunction with the user authentication unit (310) and then transmit the supervision metadata corresponding to the scan code.

[0127] When supervision metadata corresponding to a scan code is transmitted to a user terminal (100) by the scan code management unit (330), the user terminal (100) generates field supervision data based on field data as described above and provides it to the supervision data management unit (320), and the supervision data management unit (320) can update the supervision data by reflecting the field-generated data (S1150).

[0128] The automatic report generation unit (340) can automatically generate various reports, such as supervision reports, using supervision data and field supervision data (S1160).

[0129] For example, the automatic report generation unit (340) may have a pre-set report template according to the type of report and generate a report by automatically inserting field supervision data and metadata into the report template according to each supervision item.

[0130] For example, the automatic report generation unit (340) may pre-define a template suitable for an inspection report and configure the report template so that inspection results, photos, metadata, etc. can be automatically inserted. Afterward, the automatic report generation unit (340) may automatically classify the field inspection data captured by each inspection item and place it within the report template along with the metadata to automatically generate a report. FIG. 13 illustrates an example of such an automatically generated report.

[0131] In one embodiment, the report automatic generation unit (340) can add artificial intelligence (AI) analysis comments to the automatically generated report by using a deep learning-based artificial neural network (ANN). For example, the report automatic generation unit (340) can call a conversational large language model (LLM), such as ChatGPT, to generate a summary of the audit results for the automatically generated report, and can add AI analysis comments by automatically placing and inserting the generated summary of the audit results into the report. In addition, based on the audit result data, it can automatically generate an analysis of on-site problems and recommendations for improvement regarding the problems, and add them as AI analysis comments.

[0132] The watermark verification unit (350) verifies the watermark on the field-generated image and can perform forgery verification based on the watermark (S1170). This will be explained in more detail through the embodiment of FIG. 12.

[0133] FIG. 12 is a block diagram illustrating an embodiment of the watermark verification unit illustrated in FIG. 10.

[0134] Referring to FIG. 12, the watermark verification unit (350) may include a shape analysis module (351), a first hash generation module (352), a second hash generation module (353), and a forgery detection module (354).

[0135] The shape analysis module (351) performs an operation that is complementary to the operation of the shape generation module (143) of the user terminal (100).

[0136] That is, the shape analysis module (351) can identify the shapes constituting the watermark within the field supervision data and classify the identified shapes into a first shape element and a second shape element. Here, the first shape element is generated from the aforementioned first hash, and the second shape element is generated from the aforementioned second hash.

[0137] For example, the shape analysis module (351) can identify and separate any one of the size, angle, and color of the shape as a first shape element, and identify and separate any one of the shape's shape, rotation, and position as a second shape element.

[0138] The first hash generation module (352) and the second hash generation module (353) operate similarly to the first hash generation module (141) and the second hash generation module (142) of the user terminal (100).

[0139] First, the first hash generation module (352) identifies the supervision indication text displayed in the corresponding field supervision data. Subsequently, the first hash generation module (352), like the first hash generation module (352) of the user terminal (100), can generate the first hash data by applying the first hash algorithm to at least some of the identified supervision indication text.

[0140] The second hash generation module (353) identifies the site information text displayed in the corresponding site supervision data. Subsequently, the second hash generation module (353) can generate second hash data by applying a second hash algorithm to at least some of the identified site information text.

[0141] This operation of the second hash generation module (353) is configured to directly implement the hash algorithm in response to the user terminal (100), reflecting the characteristics of a hash algorithm that has a unidirectional nature and a data compression characteristic. In other words, it reflects the fact that the same hash value is derived for the same data.

[0142] The forgery determination module (354) can determine whether forgery has occurred by generating a shape element using each generated hash data, and then determining whether the generated shape element corresponds to a shape element analyzed by the shape analysis module (351).

[0143] The forgery detection module (354) can set a first shape element for verification of a shape element using first hash data and set a second shape element for verification of a shape element using second hash data, similar to the shape generation module (143) of the user terminal (100).

[0144] Afterwards, the forgery detection module (354) receives the first shape element and the second shape element from the shape analysis module (351), and then compares the first shape element with the first shape element for verification and compares the second shape element with the second shape element for verification to verify whether forgery has occurred.

[0145] In these embodiments, even with a very simple configuration, it is possible to distinguish which information, between site information and supervision marking information, has been tampered with during verification. In particular, since verification is possible using only the site supervision image itself, very convenient verification is possible.

[0146] FIG. 14 is a drawing illustrating an example of a work process provided through a user terminal according to an embodiment of the present disclosure.

[0147] FIG. 14 illustrates an example of a work process in which a user performs supervision at a site through a user terminal (100). The process starts as a dedicated program or app of the user terminal (100) is loaded, and after logging in, the user can use the "check-in site list" function or the "basic information registration" function.

[0148] The "Check-in Site List" function provides a "Site List" function and an "OR Scan" function. For example, after selecting the "QR Scan" function, the user can scan the QR code as a scan code to use the "Safety Training Check-in" function and the "Daily Site Check-in" function for the site.

[0149] As another example, users can access the "Daily Site" function by selecting the "Site List" function. The "Daily Site" function provides the "Work Photo Gallery," "Take Work Photo", "Safety Training Gallery," and "Safety Training Photo Shooting" functions. Users can take work photos by selecting the "Take Work Photo" function and manage the captured work photos by selecting the "Work Photo Gallery" function. Additionally, users can take safety training or supervision photos using the "Safety Training Photo Shooting" function and manage the captured safety training or supervision photos by selecting the "Safety Training Gallery" function.

[0150] FIG. 15 is a drawing illustrating an example of a work process provided through an administrator terminal according to one embodiment of the present disclosure.

[0151] FIG. 15 illustrates an example of a work process performed by an administrator accessing a system server (100) using an administrator terminal (200). After logging into the system server (100), the administrator can use the "construction site list" function or the "basic information registration" function.

[0152] The "Construction Site List" function provides the "Site List" function and the "Create" function.

[0153] For example, an administrator can use the "Service Creation Modal" function by selecting the "Create" function. Through the "Service Creation Modal" function, the administrator can enter the service name, work location, start date, completion date, construction company, and work manager.

[0154] As another example, the manager can use the "Service Site" function by selecting the "Site List" function.

[0155] The "Service Site" function provides "Site Information," "Download Integrated Report," "Work Log List," and "Create Work Log" functions. For example, an administrator can select the "Download Integrated Report" function to download an integrated report for a construction site. As another example, an administrator can select the "Create Work Log" function to enter a title and date for a work log. As yet another example, an administrator can select the "Work Log List" function to utilize the "Daily Site" function.

[0156] The "Daily Site" function provides "Daily Site Information," "Integrated Report Download," "Safety Training," "Safety Training Report Download," "QR Photos," "Work Photo List," "Work Photo Download," "Work List," and "Worker List Download" functions. Through these examples, administrators can automatically generate and download various reports regarding the construction site (e.g., Overall Report, Safety Training Report, Work Photo Report, Worker List Report) in various report templates. Meanwhile, the "Safety Training" function can provide "Title," "Worker Check-in," "Safety Training Photos," and "Details" functions. Through these examples, administrators can generate and manage various information regarding safety training (e.g., Title, Worker Attendance, Safety Training Photos). In particular, administrators can generate and manage detailed information about safety training by selecting the "Details" function. Specifically, the administrator can create and manage detailed information about safety training by using the "Safety Training Information," "QR Code," "Safety Training Items," "Training Photos," and "Attendance List" functions provided through the "Safety Training Details" function.

[0157] However, it is obvious that the processes disclosed in FIGS. 14 and 15 are exemplary and are not limited thereto, and that various modifications or additions to the processes are possible.

[0158] FIG. 16 is a drawing illustrating an exemplary computing operating environment of a system server according to one embodiment of the present disclosure.

[0159] FIG. 16 is intended to provide a general and simplified description of a suitable computing environment in which embodiments of a system server may be implemented. Referring to FIG. 16, a computing device (1600) is illustrated as an example of a system server (300).

[0160] The computing device (1600) may include at least a processing unit (1630) and a system memory (1610).

[0161] The computing device (1600) may include a plurality of processing units that cooperate when executing a program. Depending on the exact configuration and type of the computing device (1600), the system memory (1610) may be volatile (e.g., RAM), non-volatile (e.g., ROM, flash memory, etc.), or a combination thereof. The system memory (1610) includes a suitable operating system (1620) for controlling the operation of the platform, which may be, for example, the WINDOWS operating system from Microsoft. The system memory (1610) may include one or more software applications, such as program modules, applications, etc.

[0162] The computing device (1600) may include additional data storage devices (1640), such as magnetic disks, optical disks, or tapes. These additional storage devices (1640) may be removable storage and / or fixed storage. Computer-readable storage media may include volatile and non-volatile, removable and fixed media implemented by any method or technique for storage information such as computer-readable instructions, data structures, program modules, or other data.

[0163] System memory (1610) and storage device (1640) are both merely examples of computer-readable storage media. Computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory devices, CD-ROM, DVD or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can store desired information and be accessed by a computing device (300).

[0164] The input device (1650) of the computing device (1600) may include, for example, a keyboard, a mouse, a pen, a voice input device, a touch input device, and a comparable input device. Since the input device (1650) is widely known in the art, a detailed description is omitted.

[0165] The output device (1660) of the computing device (1600) may include, for example, a display, a speaker, a printer, and other types of output devices. Since the output device (1660) is widely known in the art, a detailed description is omitted.

[0166] The computing device (1600) may include a communication device (1670) that allows the device to communicate with other devices through a network in a distributed computing environment, for example, a wired / wireless network, a satellite link, a cellular link, a local area network, and a comparable mechanism. The communication device (1670) is one example of a communication medium, and the communication medium may contain computer-readable instructions, data structures, program modules, or other data. For example, the communication medium includes, but is not limited to, wired media such as a wired network or direct wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media.

[0167] Methods according to various embodiments of the present application may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the embodiments, or may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices may be configured to operate as one or more software modules to perform the operation of the embodiments, and vice versa.

[0168] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results can be achieved even if the described techniques are performed in a different order than described, and / or the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0169] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

[0170] Although specific embodiments have been described in the detailed description of this document, it will be obvious to those skilled in the art that various modifications are possible within the scope of this document.

[0171] As described above, the method for automatically generating on-site supervision data and the supervision data management system using the same can be applied to various construction industry fields.

Claims

1. A method for automatically generating field supervision data performed on a user terminal operating in conjunction with a system server, wherein A step of scanning a scan code provided at the site and obtaining supervision metadata corresponding to the scan code; Step of generating an image on-site according to the user's request; A step of generating field information data based on the creation location and creation time of the above image; and A method comprising the step of generating site supervision data by visually reflecting the supervision metadata and site information data in the image. Method for automatically generating on-site supervision data.

2. In Paragraph 1, The above supervision metadata is, It includes one or more of site information, project information, site location information, client information, and supervision information, and The above supervision information is, Including one or more of supervision item information, supervision standard information, supervision phase information, and inspection schedule information, Method for automatically generating on-site supervision data.

3. In Paragraph 1, The step of generating site supervision data by visually reflecting the supervision metadata and site information data in the image is: A step of generating supervision display text including site information and supervision information from supervision metadata; and A step comprising overlaying and displaying the supervision indication text at a preset first position of the above image, Method for automatically generating on-site supervision data.

4. In Paragraph 3, The step of generating site supervision data by visually reflecting the supervision metadata and site information data in the image is: A step of generating a field information text including the shooting location and shooting time of the image from the field information data; and The method further includes the step of overlaying and displaying the site information text at a preset second location of the above image. Method for automatically generating on-site supervision data.

5. In Paragraph 4, The step of generating site supervision data by visually reflecting the supervision metadata and site information data in the image is: The method further comprises the step of generating a watermark in relation to the above image and overlaying and displaying the watermark at a preset third location of the above image. Method for automatically generating on-site supervision data.

6. A system server that generates and manages audit data including audit metadata; and It includes a user terminal that scans a scan code placed at the site, obtains supervision metadata corresponding to the scan code from the system server, generates site information data based on the creation location and creation time of an image generated at the site, and generates site supervision data by visually reflecting the supervision metadata and the site information data onto the image. The above system server is, Updating the supervision data by reflecting the above-mentioned field supervision data, Supervision Data Management System.

7. In Paragraph 6, The above system server is, Upon receiving the above-mentioned field supervision data, verification is performed between the above-mentioned field information data and the above-mentioned supervision metadata regarding the above-mentioned field supervision data. Supervision Data Management System.

8. In Paragraph 6, The above supervision metadata is, It includes one or more of site information, project information, site location information, client information, and supervision information, and The above supervision information is, Including one or more of supervision item information, supervision standard information, supervision phase information, and inspection schedule information, Supervision Data Management System.

9. In Paragraph 8, The above user terminal is, Generate supervision display text containing site information and supervision information from supervision metadata, and Generate field information text including the shooting location and shooting time of the image from the field information data above, and The site information text is overlaid and displayed at a preset second position of the above image, and Displaying the supervision indication text by overlaying it at a preset first position of the above image, Supervision Data Management System.

10. In a non-transient computer-readable recording medium storing computer-readable instructions, When the above instructions are executed by a computing device, the computing device, An operation of scanning a scan code provided at the site and obtaining supervision metadata corresponding to the scan code; The action of generating an image on-site according to a user's request; An operation to generate field information data based on the creation location and creation time of the above image; and Performing the operation of generating site supervision data by visually reflecting the above supervision metadata and the above site information data into the above image, Non-transient computer-readable recording medium.

Images