Site information generation device, site information generation method, and site information generation program
By integrating GPS coordinates with image-based text recognition, the system accurately generates and manages maintenance site information, addressing inaccuracies in manual entry and enhancing data management efficiency.
Patent Information
- Application Number
- JP2024045732
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-21
- Publication Date
- 2025-10-03
- Estimated Expiration
- 2044-03-21
AI Technical Summary
Existing maintenance and repair information systems suffer from inaccuracies due to manual entry of site attributes, leading to ambiguity and difficulty in searching and updating on-site information, especially when multiple buildings or residences share the same address.
A system that combines longitude and latitude information with text information from captured images to accurately identify maintenance sites, using automatic text recognition to generate provisional registration information, which is then updated through a site information update screen for precise site management.
Reduces notation fluctuations and input errors, enabling accurate and efficient generation and management of on-site information, reducing duplicate registrations and improving data analysis in maintenance services.
Smart Images

Figure 2025145522000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a site information generating device, a site information generating method, and a site information generating program, and more particularly to a site information generating device, a site information generating method, and a site information generating program that generate and update information about a site where a service such as maintenance or repair is performed. [Background technology]
[0002] In the maintenance service industry, data on maintenance and repair history is stored. Information on the maintenance and repair site is largely manual, and there is a problem that the information contains ambiguity as follows: (1) People cannot accurately grasp the attributes of the site (property name, address, etc.). For example, they know how to read it, but they don't know how to write it. Phone calls are unclear and lead to mistakes. (2) The person intended to register later, but time has passed and they cannot remember exactly.
[0003] In this way, variations in notation occur depending on the person, and misrecognition or incorrect input causes the accumulation of "low-accuracy, difficult-to-use on-site information." This on-site information is difficult to search due to duplication and errors in content, making it difficult to immediately check the necessary information when needed, which is one of the factors that reduces work efficiency.
[0004] Patent Document 1 discloses a technology for grouping images of candidate sites based on conditions such as points, areas, and line information to select parking lot candidates, and for quickly sharing information among related parties. Patent Document 1 also discloses that location information is sent along with the images for grouping, and converted into address information. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-019166 Summary of the Invention [Problem to be solved by the invention]
[0006] The prior art acquires address information from location information, which makes it difficult to acquire accurate on-site information in the following cases: - When there are multiple private homes at the same address due to subdivision etc. - When there are multiple buildings on the same site - If you want to identify a private residence within an apartment building
[0007] The present disclosure aims to generate site information accurately by combining longitude and latitude information with text information for identifying the site, thereby reducing fluctuations in notation and input errors. [Means for solving the problem]
[0008] The on-site information generating device according to the present disclosure includes: an image data acquisition unit that acquires image data obtained by capturing a site image including character information used to identify a maintenance site where maintenance service is performed, the image data being provided with longitude and latitude information that is information on the longitude and latitude of the location where the image was captured; a temporary registration generation unit that extracts the character information from the image data, acquires address information of the photography location based on longitude and latitude information of the photography location, and generates information that associates the character information, the longitude and latitude information of the photography location, and the address information of the photography location as temporary registration information; The system is equipped with an update processing unit that displays a site information update screen on a display device to update site information used to manage the maintenance site, the site information including the site name of the maintenance site, longitude and latitude information of the maintenance site, and address information of the maintenance site, using the provisional registration information. [Effects of the Invention]
[0009] The on-site information generating device according to the present disclosure generates on-site information by combining character information for identifying a maintenance site with longitude and latitude information. Therefore, the on-site information generating device according to the present disclosure can reduce inconsistencies in notation and input errors, and generate on-site information accurately. [Brief explanation of the drawings]
[0010] [Figure 1] 1 is a diagram showing an example of the overall configuration of a site information generation system according to a first embodiment. [Figure 2] FIG. 1 is a diagram showing an example of the configuration of a site information generating device according to a first embodiment. [Figure 3] FIG. 2 is a diagram showing a configuration example of a mobile terminal according to the first embodiment. [Figure 4] 4 is a flowchart showing an example of image data acquisition processing and temporary registration generation processing according to the first embodiment. [Figure 5] FIG. 2 is a diagram showing an example of the configuration of address information and image information according to the first embodiment. [Figure 6] FIG. 3 is a diagram showing an example of the configuration of provisional registration information according to the first embodiment. [Figure 7] FIG. 4 is a flowchart showing an example of an update process according to the first embodiment. [Figure 8] FIG. 2 is a diagram showing an example of the configuration of on-site information according to the first embodiment. [Figure 9] FIG. 10 is a diagram showing an example of displaying a list of provisional registration information on a site information update screen according to the first embodiment. [Figure 10] FIG. 10 is a diagram showing an example of displaying target provisional registration information and similar site information on a site information update screen according to the first embodiment. [Figure 11] FIG. 10 is a diagram showing an example of the configuration of a site information generating device according to a modified example of the first embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0011] The present embodiment will be described below with reference to the drawings. In each drawing, identical or corresponding parts are designated by the same reference numerals. In the description of the embodiment, the description of identical or corresponding parts will be omitted or simplified as appropriate. Arrows in the drawings mainly indicate the flow of data or the flow of processing. Furthermore, the sized relationships between components in the following drawings may differ from the actual relationships. Furthermore, in the description of the embodiment, directions or positions such as up, down, left, right, front, rear, front and back may be indicated. These notations are used for convenience of explanation and do not limit the placement, direction or orientation of devices, instruments, parts, etc.
[0012] Embodiment 1 ***Configuration Description*** FIG. 1 is a diagram showing an example of the overall configuration of a site information generating system 500 according to this embodiment. The site information generation system 500 is a system for generating and updating site information, which is information relating to the site of work such as maintenance or repair. The site information generation system 500 includes a site information generation device 100 and a plurality of mobile terminals 200. The site information generation device 100 and the mobile terminals 200 communicate with each other via a network 300. The mobile terminals 200 are, for example, terminals carried by workers at the site. The mobile terminals 200 may also be terminals carried by users at the site. The mobile terminals 200 are, for example, computers with a photographing function and a GPS function, such as a smartphone, tablet, portable computer, or personal computer. GPS is an abbreviation for Global Positioning System.
[0013] FIG. 2 is a diagram showing an example of the configuration of the site information generating device 100 according to this embodiment. FIG. 3 is a diagram showing an example of the configuration of the mobile terminal 200 according to this embodiment.
[0014] The site information generating device 100 is a computer. The site information generation device 100 includes a processor 910, as well as other hardware such as a memory 921, an auxiliary storage device 922, an input / output interface 930, and a communication device 950. The processor 910 is connected to the other hardware via signal lines and controls the other hardware. The site information generation device 100 includes, as functional elements, an image data acquisition unit 110, a temporary registration generation unit 120, an update processing unit 130, and a storage unit 140. The update processing unit 130 includes a processing target reception unit 131 and a candidate display unit 132. The storage unit 140 stores address correspondence information 11, image information 12, temporary registration information 13, and site information 14.
[0015] The mobile terminal 200 is a computer. The mobile terminal 200 includes a processor 910 and other hardware such as a memory 921, an auxiliary storage device 922, an input / output interface 930, a communication device 950, and an image capturing device 960. The processor 910 is connected to the other hardware via signal lines and controls the other hardware. The image capturing device 960 is a camera. The mobile terminal 200 includes, as functional elements, a display unit 210, an image capturing unit 220, a position information acquiring unit 230, and a storage unit 240. In the storage unit 240, image data 31 is stored.
[0016] The same reference numerals are used to describe each piece of hardware, including the processor 910, memory 921, auxiliary storage device 922, input / output interface 930, display device 941, and communication device 950, in both the site information generation device 100 and the mobile terminal 200. This is only to simplify the description, and it is clear that the site information generation device 100 and the mobile terminal 200 each have their own individual hardware.
[0017] The functions of each unit in the site information generation device 100 are realized by software. The functions of each unit in the mobile terminal 200 are realized by software. Each of the storage units 140 and 240 is provided in the memory 921. Note that each of the storage units 140 and 240 may be provided in the auxiliary storage device 922, or may be provided separately in the memory 921 and the auxiliary storage device 922.
[0018] The processor 910 is a device that executes a site information generation program. The site information generation program is a program that realizes the functions of each unit of the site information generation device 100 and the mobile terminal 200. The processor 910 is an IC that performs arithmetic processing. Specific examples of the processor 910 are a CPU, a DSP, and a GPU. IC is an abbreviation for Integrated Circuit. CPU is an abbreviation for Central Processing Unit. DSP is an abbreviation for Digital Signal Processor. GPU is an abbreviation for Graphics Processing Unit.
[0019] The memory 921 is a storage device that temporarily stores data. Specific examples of the memory 921 are SRAM and DRAM. SRAM is an abbreviation for Static Random Access Memory. DRAM is an abbreviation for Dynamic Random Access Memory. The auxiliary storage device 922 is a storage device that stores data. A specific example of the auxiliary storage device 922 is a HDD. The auxiliary storage device 922 may also be a portable storage medium such as an SD (registered trademark) memory card, CF, NAND flash, a flexible disk, an optical disk, a compact disk, a Blu-ray (registered trademark) disk, or a DVD. Note that HDD is an abbreviation for Hard Disk Drive. SD (registered trademark) is an abbreviation for Secure Digital. CF is an abbreviation for CompactFlash (registered trademark). DVD is an abbreviation for Digital Versatile Disk.
[0020] The input / output interface 930 includes an input interface and an output interface. The input interface is a port connected to an input device such as a mouse, keyboard, or touch panel. Specifically, the input interface is a USB terminal. The input interface may also be a port connected to a LAN. USB is an abbreviation for Universal Serial Bus. LAN is an abbreviation for Local Area Network. A display device 941 such as a display is connected to the output interface. The display device 941 may also function as a touch panel. Specifically, the output interface is a USB terminal or an HDMI (registered trademark) terminal. Specifically, the display is an LCD. HDMI (registered trademark) is an abbreviation for High Definition Multimedia Interface. LCD is an abbreviation for Liquid Crystal Display.
[0021] The communication device 950 is connected to a communication network such as a LAN, Wi-Fi (registered trademark), the Internet, or a telephone line.
[0022] The site information generation program is executed in the site information generation device 100. The site information generation program is read into the processor 910 and executed by the processor 910. The memory 921 stores not only the site information generation program but also an OS. OS is an abbreviation for Operating System. The processor 910 executes the site information generation program while running the OS. The site information generation program and the OS may be stored in an auxiliary storage device 922. The site information generation program and the OS stored in the auxiliary storage device 922 are loaded into the memory 921 and executed by the processor 910. Note that part or all of the site information generation program may be incorporated into the OS.
[0023] The "units" of the image data acquisition unit 110, the temporary registration generation unit 120, and the update processing unit 130 in the site information generation device 100 may be read as "circuits," "processes," "procedures," "processing," or "circuitry." The site information generation program causes a computer to execute the image data acquisition process, the temporary registration generation process, and the update process in the site information generation device 100. The "processing" of the image data acquisition process, the temporary registration generation process, and the update process may be read as "program," "program product," or "computer-readable storage medium storing the program." The site information generation program may be provided by being stored in a computer-readable storage medium. The site information generation program may also be provided as a program product.
[0024] ***Explanation of Operation*** Next, the operation of the site information generation device 100 according to this embodiment will be described. The operation procedure of the site information generation device 100 corresponds to a site information generation method. Furthermore, a program that realizes the site information generation process, which is the operation of the site information generation device 100, corresponds to a site information generation program. The site information generation process includes an image data acquisition process, a temporary registration generation process, and an update process.
[0025] FIG. 4 is a flow diagram showing an example of the image data acquisition process and the temporary registration generation process according to the present embodiment.
[0026] <Image Data Acquisition Process: Step S101> In step S101, the image data acquisition unit 110 acquires image data 31 of a captured site image including character information 311 used to identify the maintenance site. The image data 31 is provided with longitude and latitude information 312, which is information on the longitude and latitude of the location where the image was captured. A maintenance site is a site where services such as maintenance or repairs are performed. While this embodiment uses a maintenance service as an example, this embodiment can be applied to any site where services such as construction, sales, or marketing are performed. The term "longitude and latitude" included in the longitude and latitude information 312 can be rephrased as "longitude and latitude" or "latitude and longitude."
[0027] Specifically, a worker at the maintenance site captures a site image including text information 311 at the maintenance site using mobile terminal 200, thereby acquiring image data 31. In this way, the worker at the maintenance site may capture the maintenance site, or a user who provides maintenance services may be asked to capture the maintenance site. The image data 31 is provided with longitude and latitude information 312 acquired by the GPS function of the mobile terminal 200. The text information 311 is information that can identify a property, such as a name plate of a building such as an apartment, condominium, or building, the number of floors in the building, the room number, and the nameplate. The text information 311 may be any information that can identify the site that is the target of maintenance service.
[0028] The image data acquisition unit 110 may acquire a plurality of image data 31 at the maintenance site. The image data acquisition unit 110 may acquire a plurality of image data 31 from one mobile terminal 200 present at the maintenance site. Alternatively, the image data acquisition unit 110 may acquire a plurality of image data 31 from a plurality of mobile terminals 200 present at the maintenance site.
[0029] <Temporary Registration Generation Process: Steps S102 to S107> Next, a provisional registration generation process for generating the provisional registration information 13 will be described. The temporary registration generation unit 120 extracts character information 311 from the image data 31, and acquires address information 313 of the shooting location based on longitude and latitude information 312 of the shooting location. The temporary registration generation unit 120 also generates information that associates the character information 311, the longitude and latitude information 312, and the address information 313 as temporary registration information 13, and stores the information in the storage unit 140. Specifically, it is as follows:
[0030] In step S102, the temporary registration generation unit 120 acquires character information 311 from the image data 31. The temporary registration generation unit 120 acquires the character information 311 from the image data 31 using an automatic text recognition method, such as extracting characters from an image and converting them into text. If there are multiple pieces of image data 31, the character information 311 is extracted from all of the multiple pieces of image data 31. In step S103, the temporary registration generating unit 120 acquires longitude and latitude information 312 from the image data 31. The image data 31 has the longitude and latitude information 312, which is information on the longitude and latitude of the shooting location, added thereto by the GPS function of the mobile terminal 200. In step S104, the temporary registration generating unit 120 refers to the address correspondence information 11 and acquires the address information 313 of the shooting location from the longitude and latitude information 312.
[0031] FIG. 5 is a diagram showing an example of the configuration of the address correspondence information 11 and the image information 12 according to this embodiment. Here, the address correspondence information 11 will be explained. As shown in FIG. 5, the address correspondence information 11 includes range information 111 indicating ranges of longitude and latitude, and addresses 112 corresponding to the range information 111. The range information 111 includes information on the latitude and longitude of the boundary points of the address 112. In FIG. 5, the latitude is shown in the upper row and the longitude in the lower row, with a comma separating the two values. The number of points included in the range information 111 is arbitrary, and the range connecting the specified points is the range corresponding to the address 112. In the case of four points, the range specified by the range information 111 will be an approximate rectangle. In the case of three points, it will be an approximate triangle, and in the case of five points, it will be an approximate pentagon, and by increasing the number of points, it is also possible to specify what is known as irregular land. The address correspondence information 11 can be generated by any method, and can be generated using an external address database or map information. Alternatively, the processing unit of the site information generation device 100 can use the display device 941 to display a map, such as a Geospatial Information Authority of Japan map, of the address to be registered in the address correspondence information 11, and receive designation of points that are the boundary of the range corresponding to the address 112 from an administrator or the like, thereby generating the range information 111. The temporary registration generation unit 120 acquires the address 112 corresponding to the range information 111 that includes the longitude and latitude information 312 acquired from the image data 31, as the address information 313 corresponding to the longitude and latitude information 312. The range information 111 that the longitude and latitude information 312 corresponds to refers to the range identified by the respective range information 111, within which the longitude and latitude information 312 is included. Alternatively, the temporary registration generating unit 120 may convert the longitude and latitude information 312 into address information 313 using an external address conversion database or the like. Furthermore, if the temporary registration generating unit 120 is unable to acquire character information 311 such as the property name due to a defect in the image data 31 in the process of step S102, the temporary registration generating unit 120 may acquire the property name from the address information 313.
[0032] The order of the processes in step S102, step S103, and step S104 does not matter, and the processes in step S102, step S103, and step S104 may be performed in parallel.
[0033] In step S105, the temporary registration generating unit 120 generates property location information 302 in which the text information 311, the longitude and latitude information 312, and the address information 313 are associated with each other. In step S106, the temporary registration generating unit 120 stores information in which the temporary registration number 301 and the registration date and time 303 are associated with the property location information 302 in the storage unit 140 as temporary registration information 13.
[0034] FIG. 6 is a diagram showing an example of the configuration of temporary registration information 13 according to the present embodiment. The temporary registration information 13 includes a temporary registration number 301 , property location information 302 consisting of text information 311 , longitude and latitude information 312 , and address information 313 , and a registration date and time 303 . The provisional registration number 301 is assigned when a new record is registered in the provisional registration information 13. The registration date and time 303 is the date and time when the corresponding record was registered.
[0035] Characters for identifying the maintenance site, which are acquired from the image data 31, are set in the character information 311. When the temporary registration generation unit 120 acquires a plurality of pieces of image data 31 as the image data 31, the temporary registration generation unit 120 generates character information 311 by concatenating the plurality of pieces of character information 311 extracted from the plurality of pieces of image data 31. For example, suppose three pieces of image data 31 are acquired: image data 31 in which an apartment name is captured as character information 311, image data 31 in which a room number is captured as character information 311, and image data 31 in which a nameplate displaying a person's name is captured as character information 311. In this case, the temporary registration generation unit 120 concatenates the three pieces of character information 311 acquired from these pieces of image data 31, i.e., the apartment name, the room number, and the person's name, to generate character information 311 and sets this in the temporary registration information 13. When a worker captures images of the site in the order of the apartment name, the room number, and the nameplate, and the mobile terminal 200 transmits the images based on the order of capturing the images, the image data acquisition unit 110 can easily generate character information 311 that makes the site name easy to understand, based on the order in which the image data 31 are acquired. On the other hand, since the user can edit the site name in the update process described below, if there are multiple characters acquired from image data 31 in step S106, character information 311 can be generated in any order. When there are multiple characters acquired from image data 31, as described above, multiple characters may be acquired from multiple image data 31, but there may also be cases where characters not intended by the worker are acquired from a single image data 31. In this case, too, editing can be performed in the update process, so all acquired characters are included in character information 311. Furthermore, when multiple pieces of longitude and latitude information 312 are acquired from multiple pieces of image data 31, the average value of the multiple pieces of longitude and latitude information 312 or one piece of the multiple pieces of longitude and latitude information 312 is set as the temporary registration information 13. There is no restriction on the method for determining one piece of longitude and latitude information from multiple pieces of longitude and latitude information.
[0036] In step S107, the temporary registration generating unit 120 associates the temporary registration information 13 with the image data 31. 5, the image information 12 is set with an image management number 211, an image file path 212, longitude and latitude information 312, an address (address information 313), a site name (text information 311), a temporary registration number 301, and a site management number 401. As long as the temporary registration information 13 and the image data 31 can be linked, the address (address information 313), the site name (text information 311), etc. may not be necessary. The image management number 211 is assigned when the image data 31 is registered in the image information 12 . In the image file path 212, a file path to the image data 31 is set. As the longitude and latitude information 312, the longitude and latitude information 312 added to the image data 31 is set.
[0037] The temporary registration number 301 is set to the temporary registration number 301 set in the record of the temporary registration information 13 to which the image data 31 corresponds. After information on the image data 31 is registered in the temporary registration information 13, the temporary registration number 301 of the corresponding temporary registration information 13 is set to the temporary registration number 301 of the image information 12. When multiple image data 31 correspond to a record of the temporary registration information 13, the same temporary registration number 301 is set to the multiple image data 31. The site management number 401 is set to the site management number 401 set in the record of the site information 14 to which the image data 31 corresponds. After information related to the image data 31 is registered in the site information 14, the site management number 401 of the corresponding site information 14 is set to the site management number 401 of the image information 12. When multiple image data 31 correspond to a record of the site information 14, the same site management number 401 is set to the multiple image data 31.
[0038] FIG. 7 is a flow diagram showing an example of the update process according to the present embodiment. In the update process, the update processing unit 130 displays a site information update screen 350 on the display device 941 for generating and updating site information 14 used for managing the maintenance site using the provisional registration information 13. A user generates and updates the site information 14 via the site information update screen 350. The user is a staff member who generates and updates the site information 14 via the site information update screen 350. The update process is performed periodically or irregularly.
[0039] FIG. 8 is a diagram showing an example of the configuration of the site information 14 according to this embodiment. The site information 14 is information used for managing the maintenance site, and is required to be information that can accurately identify the maintenance site.
[0040] The site information 14 includes information such as a site management number 401, a site name 402, longitude and latitude information 403, an address 404, and a registration date and time 405. Other information such as a postal code, a telephone number, a floor number (underground), a floor number (above ground), a number of units, a number of maintenance works, and a maintenance work date (most recent) may be set as detailed information 450. The site information 14 includes at least the site name 402 of the maintenance site, longitude and latitude information 403 of the maintenance site, and address (address information) of the maintenance site 404. Other information set in the site information 14 may be determined as appropriate.
[0041] In step S201, the processing target receiving unit 131 of the update processing unit 130 displays a list of temporary registration information 351 on the site information update screen 350. The processing target receiving unit 131 acquires the temporary registration information 13 and the image information 12, and displays the list of temporary registration information 351, which lists the temporary registration information 13, in a selectable manner.
[0042] FIG. 9 is a diagram showing an example of a site information update screen 350 according to this embodiment, in which a list 351 of provisional registration information is displayed. FIG. 10 is a diagram showing an example in which target provisional registration information 61 and similar site information 62 are displayed on a site information update screen 350 according to this embodiment. 9 and 10 are related in that when the target provisional registration information 61 is selected and the read button is pressed in the display of FIG. 9, the display transitions to that of FIG.
[0043] In step S202, the processing target receiving unit 131 determines whether or not there is a record to be processed in the provisional registration information list 351. The processing target receiving unit 131 receives, as target provisional registration information 61, a record of the provisional registration information 13 to be processed, selected by the user from the list 351 of provisional registration information. 9 shows that the record at the top of the list of provisional registration information 351 has been selected by the user as the target provisional registration information 61. When the user selects the target provisional registration information 61 and presses the read button, the processing target receiving unit 131 receives the corresponding record as the target provisional registration information 61.
[0044] If there is target provisional registration information 61, which is a record to be processed according to the user's selection, in step S202, the process proceeds to step S203. If there is no target provisional registration information 61 that is a record to be processed, the process ends. At this stage, the target provisional registration information 61 has been changed to the site information 14, so the user performs the task of registering the maintenance information for each site in the detailed information 450 of the site information 14. Specifically, the candidate display unit 132 displays a screen on which the detailed information 450 can be changed or newly registered, and the user inputs the maintenance information to generate or update the detailed information 450. When there are multiple pieces of target provisional registration information 61, the user registers the maintenance information corresponding to the target provisional registration information 61 in the detailed information 450.
[0045] In step S203, the candidate display unit 132 of the update processing unit 130 extracts site information similar to the target temporary registration information 61 from the site information 14. For example, the candidate display unit 132 extracts, as similar site information 62, information whose longitude and latitude difference with the target temporary registration information 61 is equal to or less than a certain level, or whose site name and address, or the character string of the site name or address, has a similarity equal to or greater than a certain level. The threshold value for the longitude and latitude difference, or the threshold value for the character string similarity, can be set as appropriate.
[0046] In step S204, the candidate display unit 132 displays the target provisional registration information 61 and similar site information 62 on the site information update screen 350 so that the user can select one. The candidate display unit 132 displays each item of the target provisional registration information 61 in an editable manner. For example, the candidate display unit 132 displays items of the target provisional registration information 61, such as the site name, address, or longitude and latitude, in an editable manner. At this time, if there is no similar site information 62, a message such as "No similarity" may be displayed in the similar site information 62. This allows the user to confirm that the target provisional registration information 61 is a new site.
[0047] There may be a plurality of similar site information 62 extracted by the candidate display unit 132. When there is a plurality of similar site information 62, the plurality of similar site information 62 is displayed as shown in FIG. The target provisional registration information 61 and the similar site information 62 are displayed so that one can be selected from them.
[0048] Furthermore, the candidate display unit 132 displays the image data 31 corresponding to the target temporary registration information 61 on the site information update screen 350. If there is a plurality of image data 31 corresponding to the target temporary registration information 61, the plurality of image data 31 are displayed.
[0049] In the example of Figure 10, the target provisional registration information 61 and similar site information 62 are displayed, and image data 31 corresponding to the target provisional registration information 61 is displayed to the left of the target provisional registration information 61 and similar site information 62. 10 shows a configuration in which the target provisional registration information 61 displays the character information 311, address information 313, and longitude and latitude information 312 of the provisional registration information 13 in Fig. 6, and other information is displayed by pressing a detailed display button. Note that the detailed display button does not have to be provided if the necessary information is displayed. In addition, the similar site information 62 in Figure 10 displays the site name 402, address 404, and longitude and latitude information 403 of the site information 14 in Figure 8, and other information is displayed by pressing the detailed display button.
[0050] The layout of the site information update screen 350 may be any layout as long as the necessary displays are displayed. 10, a registration button is displayed to request that the information selected by the user be registered in the site information 14. In the site information update screen 350 shown in FIG.
[0051] Next, a process of updating the site information 14 based on the information selected by the user on the site information update screen 350 in the state shown in FIG. 10 from step S205 to step S209 will be described. When any of the site information 62 similar to the target provisional registration information 61 is selected and the registration button is pressed, the candidate display unit 132 updates the site information 14 based on the selected information. Receiving the pressing of the registration button is equivalent to receiving a registration request to register the selected information in the site information 14.
[0052] In step S205, the candidate display unit 132 determines whether the information selected by the user is provisional registration information. When the information selected by the user is provisional registration information, that is, when the target provisional registration information 61 is selected, the process proceeds to step S206.
[0053] If the information selected by the user is not provisional registration information, that is, if one of the similar site information 62 is selected, the process proceeds to step S209. The fact that one of the similar site information 62 has been selected indicates that the target provisional registration information 61 is a site where a service such as maintenance or repair has been provided in the past, and is data that has already been registered in the site information 14. Therefore, the candidate display unit 132 does not update anything about the site information 14. Then, in step S209, the candidate display unit 132 deletes the record corresponding to the target temporary registration information 61 from the temporary registration information 13.
[0054] In step S206, the candidate display unit 132 determines whether or not the target provisional registration information 61 has been corrected. The fact that the information selected by the user is the target provisional registration information 61 means that the target provisional registration information 61 is a site to which no service such as maintenance or repair has been provided in the past. At this time, the user edits (including corrects) the target provisional registration information 61 as necessary, and presses the registration button after confirming that the content of the target provisional registration information 61 is correct. At this stage, if the user recognizes that the order of the character strings making up the site name obtained from the character information 311 is incorrect or that unnecessary character strings are included, the user can edit the site name.
[0055] If the target provisional registration information 61 has been edited, the process proceeds to step S207. If the target provisional registration information 61 has not been edited, the process proceeds to step S208.
[0056] The candidate display unit 132 has selected and edited the target provisional registration information 61, and upon receiving a registration request, additionally registers the edited target provisional registration information 61 in the site information 14 (step S207). After that, in step S209, the candidate display unit 132 deletes the record corresponding to the target provisional registration information 61 from the provisional registration information 13.
[0057] When the target provisional registration information 61 is selected and a registration request is received, the candidate display unit 132 adds the target provisional registration information 61 to the site information 14 (step S208). If no editing has been performed, the target provisional registration information 61 is added as is to the site information 14. Thereafter, in step S209, the candidate display unit 132 deletes the record corresponding to the target provisional registration information 61 from the provisional registration information 13.
[0058] As described above, when the target provisional registration information 61 is selected and a registration request is received, the candidate display unit 132 adds the target provisional registration information 61 to the site information 14 and deletes the target provisional registration information 61 from the temporary registration information 13. If the target provisional registration information 61 has been edited by the user, the candidate display unit 132 adds the edited target provisional registration information 61 to the site information 14 and deletes the target provisional registration information 61 from the temporary registration information 13.
[0059] The above-described processing from step S202 to step S209 is repeated until there are no more records to be processed in the provisional registration information 13.
[0060] ***Other Configurations*** <Variation 1> In this embodiment, when target provisional registration information is selected on the site information update screen and a registration request for the target provisional registration information is accepted, the candidate display unit 132 may determine whether or not the target provisional registration information is within the range of spelling variation based on past history. If the candidate display unit 132 determines that the target provisional registration information is within the range of spelling variation, the candidate display unit 132 may display a warning message on the site information update screen to warn that the target provisional registration information has already been registered in the site information. At this time, the warning message includes the basis for determining that the notation is within the range of variation. If the user sees the warning message and determines that the basis for determining that the notation is within the range of variation is valid, the user cancels the registration of the target provisional registration information. If the user sees the warning message and determines that the basis for determining that the notation is within the range of variation is not valid, the user continues to register the target provisional registration information. This makes it possible to prevent duplicate registration within the range of spelling variations. Furthermore, if a similar address that is determined to be within the range of spelling variation is found from the past history, it may be displayed together, allowing the past history to be corrected.
[0061] <Variation 2> In this embodiment, the functions of image data acquisition unit 110, temporary registration generation unit 120, and update processing unit 130 are realized by software. As a variation, the functions of image data acquisition unit 110, temporary registration generation unit 120, and update processing unit 130 may be realized by hardware. Specifically, the site information generation device 100 includes an electronic circuit 909 instead of the processor 910 .
[0062] FIG. 11 is a diagram showing an example of the configuration of a site information generating device 100 according to a modified example of this embodiment. The electronic circuit 909 is a dedicated electronic circuit that realizes the functions of the image data acquisition unit 110, the temporary registration generation unit 120, and the update processing unit 130. Specifically, the electronic circuit 909 is a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, a logic IC, a GA, an ASIC, or an FPGA. GA is an abbreviation for Gate Array. ASIC is an abbreviation for Application Specific Integrated Circuit. FPGA is an abbreviation for Field-Programmable Gate Array.
[0063] The functions of the image data acquisition unit 110, the temporary registration generation unit 120, and the update processing unit 130 may be realized by one electronic circuit, or may be realized by distributing them among a plurality of electronic circuits.
[0064] As another variation, some of the functions of image data acquisition unit 110, temporary registration generation unit 120, and update processing unit 130 may be realized by electronic circuits, and the remaining functions may be realized by software. Also, some or all of the functions of image data acquisition unit 110, temporary registration generation unit 120, and update processing unit 130 may be realized by firmware.
[0065] Each of the processor and the electronic circuit is also called processing circuitry. That is, the functions of the image data acquisition unit 110, the temporary registration generation unit 120, and the update processing unit 130 are realized by the processing circuitry. The hardware of the mobile terminal 200 is also the same as that of the site information generation device 100.
[0066] ***Explanation of the effect of this embodiment*** The site information generating device according to this embodiment can identify the property name of a maintenance site, which cannot be identified by longitude and latitude information alone. Furthermore, according to the on-site information generating device of this embodiment, by combining two pieces of information, namely, longitude and latitude information and character information, it is possible to reduce fluctuations in notation and input errors.
[0067] In the on-site information generation device according to this embodiment, the input for registering on-site information is changed from manual input such as interviews to photographs (image data), thereby enabling accurate information to be compiled into a database in a simple manner. Furthermore, the site information generating device according to the present embodiment reduces duplicate registrations due to variations in the notation of addresses and property names, etc. Furthermore, it also eliminates the need to search for registered sites to prevent duplication. Furthermore, the on-site information generating device according to this embodiment enables accurate data analysis using on-site information with improved accuracy, which can create business in the maintenance service industry or reduce management man-hours.
[0068] In the first embodiment described above, each unit of the site information generating device has been described as an independent functional block. However, the configuration of the site information generating device does not have to be the same as that of the above-described embodiment. The functional blocks of the site information generating device may have any configuration as long as they can realize the functions described in the above-described embodiment. Furthermore, the site information generating device may not be a single device, but may be a system made up of multiple devices. Furthermore, it is possible to combine multiple parts of the first embodiment. Alternatively, it is possible to implement only one part of this embodiment. In addition, it is possible to implement this embodiment in any combination, either as a whole or in part. That is, in the first embodiment, it is possible to freely combine parts of the embodiments, or to modify any of the components of the embodiments, or to omit any of the components of the embodiments.
[0069] The above-described embodiments are essentially preferred examples and are not intended to limit the scope of the present disclosure, the scope of application of the present disclosure, or the scope of use of the present disclosure. The above-described embodiments can be modified in various ways as needed. For example, the procedures described using flow charts or sequence diagrams may be modified as appropriate.
[0070] Various aspects of the present disclosure are summarized below as appendices.
[0071] (Appendix 1) an image data acquisition unit that acquires image data obtained by capturing a site image including character information used to identify a maintenance site where maintenance service is performed, the image data being provided with longitude and latitude information that is information on the longitude and latitude of the location where the image was captured; a temporary registration generation unit that extracts the character information from the image data, acquires address information of the photography location based on longitude and latitude information of the photography location, and generates information that associates the character information, the longitude and latitude information of the photography location, and the address information of the photography location as temporary registration information; an update processing unit that displays, on a display device, a site information update screen for updating site information used to manage the maintenance site, the site information including a site name of the maintenance site, longitude and latitude information of the maintenance site, and address information of the maintenance site, by using the provisional registration information; A site information generating device comprising: (Appendix 2) The update processing unit: a processing target receiving unit that displays a list of the provisional registration information on the site information update screen and receives the provisional registration information to be processed selected from the list of the provisional registration information as target provisional registration information; A site information generation device as described in Appendix 1, which is equipped with a candidate display unit that extracts site information similar to the target provisional registration information from the site information and displays the target provisional registration information and the similar site information selectably on the site information update screen. (Appendix 3) The candidate display unit A site information generating device according to appendix 2, which displays the target provisional registration information and the similar site information in a selectable manner, and also displays image data corresponding to the target provisional registration information. (Appendix 4) The candidate display unit 4. A site information generating device according to claim 3, which displays the target provisional registration information in an editable manner. (Appendix 5) The candidate display unit A site information generation device as described in Appendix 3 or Appendix 4, which selects one of the target provisional registration information and the similar site information, and upon receiving a registration request to register the selected information in the site information, updates the site information based on the selected information. (Appendix 6) The candidate display unit A site information generation device as described in Appendix 5, which, when the target provisional registration information is selected and the registration request is received, adds the target provisional registration information to the site information and deletes the target provisional registration information from the provisional registration information. (Appendix 7) The candidate display unit The site information generating device described in Appendix 6, in which the target provisional registration information is selected and edited, and when the registration request is received, the edited target provisional registration information is added to the site information and the target provisional registration information is deleted from the provisional registration information. (Appendix 8) The candidate display unit The site information generating device according to claim 5, wherein, when any of the similar site information is selected and the registration request is received, the target temporary registration information is deleted from the temporary registration information. (Supplementary Note 9) The temporary registration generation unit A site information generating device according to any one of Supplementary Note 1 to Supplementary Note 8, wherein when there are multiple pieces of character information extracted from the image data, information including these multiple pieces of character information is used as the character information. (Appendix 10) The computer acquires image data obtained by capturing an on-site image including character information used to identify a maintenance site where maintenance service is to be performed, the image data being provided with longitude and latitude information that is information on the longitude and latitude of the location where the image was captured; a computer extracts the character information from the image data, acquires address information of the photography location based on the longitude and latitude information of the photography location, and generates information in which the character information, the longitude and latitude information of the photography location, and the address information of the photography location are associated with each other as provisional registration information; A site information generation method in which a computer displays a site information update screen on a display device to update site information used to manage the maintenance site, the site information including the site name of the maintenance site, longitude and latitude information of the maintenance site, and address information of the maintenance site, using the provisional registration information. (Appendix 11) an image data acquisition process for acquiring image data obtained by capturing an on-site image including character information used to identify a maintenance site where maintenance service is performed, the image data being provided with longitude and latitude information that is information on the longitude and latitude of the location where the image was captured; a provisional registration generation process for extracting the character information from the image data, acquiring address information of the photography location based on longitude and latitude information of the photography location, and generating information in which the character information, the longitude and latitude information of the photography location, and the address information of the photography location are associated with each other as provisional registration information; an update process of displaying on a display device a site information update screen for updating site information used for managing the maintenance site, the site information including the site name of the maintenance site, longitude and latitude information of the maintenance site, and address information of the maintenance site, using the provisional registration information; A site information generation program that causes a computer to execute the above. [Explanation of symbols]
[0072] 11 Address correspondence information, 111 Range information, 112 Address, 12 Image information, 211 Image management number, 212 Image file path, 13 Temporary registration information, 301 Temporary registration number, 302 Property location information, 303, 405 Registration date and time, 14 Site information, 401 Site management number, 402 Site name, 404 Address, 450 Detailed information, 31 Image data, 311 Character information, 312, 403 Longitude and latitude information, 313 Address information, 61 Target temporary registration information, 62 Similar site information, 100 Site information generation device, 110 Image data acquisition unit, 120 Temporary registration generation unit, 130 Update processing unit, 131 Processing target reception unit, 132 Candidate display unit, 140, 240 Memory unit, 200 Mobile terminal, 210 Display unit, 220 Photography unit, 230 Location information acquisition unit, 300 network, 350 site information update screen, 351 list of provisional registration information, 500 site information generation system, 909 electronic circuit, 910 processor, 921 memory, 922 auxiliary storage device, 930 input / output interface, 941 display device, 950 communication device, 960 imaging device.
Claims
1. an image data acquisition unit that acquires image data obtained by capturing a site image including character information used to identify a maintenance site where maintenance service is performed, the image data being provided with longitude and latitude information that is information on the longitude and latitude of the location where the image was captured; a temporary registration generation unit that extracts the character information from the image data, acquires address information of the photography location based on longitude and latitude information of the photography location, and generates information that associates the character information, the longitude and latitude information of the photography location, and the address information of the photography location as temporary registration information; an update processing unit that displays, on a display device, a site information update screen for updating site information used to manage the maintenance site, the site information including a site name of the maintenance site, longitude and latitude information of the maintenance site, and address information of the maintenance site, by using the provisional registration information; A site information generating device comprising:
2. The update processing unit: a processing target receiving unit that displays a list of the provisional registration information on the site information update screen and receives the provisional registration information to be processed selected from the list of the provisional registration information as target provisional registration information; The site information generation device of claim 1 is provided with a candidate display unit that extracts site information similar to the target provisional registration information from the site information and displays the target provisional registration information and the similar site information selectably on the site information update screen.
3. The candidate display unit The site information generating device according to claim 2 , wherein the target provisional registration information and the similar site information are displayed in a selectable manner, and image data corresponding to the target provisional registration information is displayed.
4. The candidate display unit The site information generating device according to claim 3 , wherein the target provisional registration information is displayed in an editable manner.
5. The candidate display unit A site information generating device as described in claim 3 or claim 4, wherein when any of the target provisional registration information and the similar site information is selected and a registration request to register the selected information in the site information is received, the site information is updated based on the selected information.
6. The candidate display unit The site information generating device according to claim 5 , wherein when the target provisional registration information is selected and the registration request is accepted, the target provisional registration information is added to the site information and the target provisional registration information is deleted from the provisional registration information.
7. The candidate display unit The site information generating device of claim 6, wherein the target provisional registration information is selected and edited, and when the registration request is received, the edited target provisional registration information is added to the site information and the target provisional registration information is deleted from the provisional registration information.
8. The candidate display unit The site information generating device according to claim 5 , wherein when any one of the similar site information is selected and the registration request is accepted, the target temporary registration information is deleted from the temporary registration information.
9. The temporary registration generation unit 5. The site information generating device according to claim 1, wherein when there are a plurality of pieces of character information extracted from the image data, information including the plurality of pieces of character information is set as the character information.
10. The computer acquires image data obtained by capturing an on-site image including character information used to identify a maintenance site where maintenance service is to be performed, the image data being provided with longitude and latitude information that is information on the longitude and latitude of the location where the image was captured; a computer extracts the character information from the image data, acquires address information of the photography location based on the longitude and latitude information of the photography location, and generates information in which the character information, the longitude and latitude information of the photography location, and the address information of the photography location are associated with each other as provisional registration information; A site information generation method in which a computer displays a site information update screen on a display device to update site information used to manage the maintenance site, the site information including the site name of the maintenance site, longitude and latitude information of the maintenance site, and address information of the maintenance site, using the provisional registration information.
11. an image data acquisition process for acquiring image data obtained by capturing an on-site image including character information used to identify a maintenance site where maintenance service is performed, the image data being provided with longitude and latitude information that is information on the longitude and latitude of the location where the image was captured; a provisional registration generation process for extracting the character information from the image data, acquiring address information of the photography location based on longitude and latitude information of the photography location, and generating information in which the character information, the longitude and latitude information of the photography location, and the address information of the photography location are associated with each other as provisional registration information; an update process of displaying on a display device a site information update screen for updating site information used for managing the maintenance site, the site information including the site name of the maintenance site, longitude and latitude information of the maintenance site, and address information of the maintenance site, using the provisional registration information; A site information generation program that causes a computer to execute the above.
Citation Information
Patent Citations
Image management device and method thereof
JP2016019166A
Product information generation system
JP2018194949A
System-on-chip and operating method thereof
KR1020220122009A