Information processing device, information processing method, and program

By acquiring search queries and meta information in the information processing device, determining the priority order of displayed content and hiding the displayed content, the problem that non-professional personnel find it difficult to judge search results during facility inspections is solved, and information processing efficiency and accuracy are improved.

CN119032352APending Publication Date: 2024-11-26FUJIFILM CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380034446.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-18
Filing Date
2023-03-24
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

When conducting facility inspections, non-professional personnel find it difficult to judge based on search results and grasp the parts they should pay attention to, resulting in low information processing efficiency.

Method used

By acquiring search queries and meta information in the information processing device, determining the priority order of displayed content and hiding the displayed content, and using the processor to output the displayed content, ensuring that the user can easily judge and master key information from the search results.

Benefits of technology

Improves the efficiency of information processing by non-professionals in facility inspections, allowing them to more easily extract critical information from search results, and improves the accuracy of judgment and decision-making.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119032352A_ABST
    Figure CN119032352A_ABST
Patent Text Reader

Abstract

The invention provides an information processing device, an information processing method, and a program, which can sort display content according to search content and search results so as to be easy to judge from the search results, and can grasp concerned parts in the search results. In an information processing device (10) provided with a processor, the processor performs the following processes: acquiring a search query; obtaining a search result of the database according to the search query; obtaining meta-information of the search query; and determining display content according to the meta-information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an information processing device, an information processing method and a program. Background Art

[0002] Conventionally, facility managers have outsourced inspection and other tasks to building consultants, and inspectors with specialized knowledge have conducted inspections of various structures (also called buildings, structures, or infrastructure) such as bridges, roads, tunnels, dams, and buildings.

[0003] In patent document 1, a first inspection result is obtained, a second inspection result is searched from a database based on image features included in the first inspection result, a specific inspection result corresponding to the building condition is searched from the searched second inspection result, and the specific inspection result is preferentially displayed on a display unit.

[0004] Previous technical literature

[0005] Patent Literature

[0006] Patent Document 1: International Publication No. 2017 / 056804 Summary of the invention

[0007] Technical issues to be solved by the invention

[0008] In recent years, due to cost increases and labor shortages, the demand for non-professional inspections is increasing. However, it is not easy for non-professionals to make judgments based on search results displayed by executing search queries, and it is not easy to grasp the parts of the search results that should be paid attention to.

[0009] The present invention is completed in view of this situation, and its purpose is to provide an information processing device, information processing method and program that organize and display content according to search content and search results, so that it is easy to judge from the search results and grasp the parts that should be paid attention to in the search results.

[0010] Means for solving technical problems

[0011] In the information processing device including the processor according to the first aspect, the processor performs the following processing: acquiring a search query; acquiring search results of a database based on the search query; acquiring meta information of the search query; and determining display content based on the meta information.

[0012] In the information processing device according to the second aspect, the processor determines the display content based on the search result.

[0013] In the information processing device according to the third aspect, the processor outputs display content.

[0014] In the information processing device according to the fourth aspect, the processor determines the priority order of display contents.

[0015] In the information processing device according to the fifth aspect, the processor determines whether to adopt the candidate of the display content.

[0016] In the information processing device according to the sixth aspect, the processor determines the display content to be hidden and the other display content to be displayed.

[0017] In the information processing device according to the seventh aspect, the meta-information includes information on the structure.

[0018] In the information processing device of the eighth aspect, the information related to the structure of the meta-information includes at least one selected from the group consisting of a damaged image, specifications, damage information, repair information, peripheral information, weather information and statistical information.

[0019] In the information processing device according to the ninth aspect, the search query includes information related to the structure.

[0020] In the information processing device of the tenth aspect, the information related to the structure to be searched includes at least one selected from the group consisting of damage images, specifications, damage information, repair information, surrounding information, weather information, and statistical information.

[0021] The information processing method of the eleventh mode is an information processing method executed by a processor, comprising the steps of: obtaining a search query; obtaining search results of a database based on the search query; obtaining meta information of the search query; and determining display content based on the meta information.

[0022] The twelfth mode program is a program executed by a processor, wherein the processor performs the following processing: obtaining a search query; obtaining search results from a database based on the search query; obtaining meta information of the search query; and determining display content based on the meta information.

[0023] Effects of the Invention

[0024] According to the present invention, the displayed contents are arranged according to the search contents and the search results, so that it is easy to judge from the search results and to grasp the parts that should be paid attention to in the search results. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 This is a schematic diagram of an information processing device.

[0026] Figure 2 This is a block diagram showing an example of the hardware configuration of the information processing device.

[0027] Figure 3 This is a block diagram showing the processing functions implemented by the CPU.

[0028] Figure 4 It is a diagram showing a database stored in a storage unit.

[0029] Figure 5 It is a flowchart showing the information processing method.

[0030] Figure 6 This is a diagram for explaining an example of a display screen displaying a search query.

[0031] Figure 7 This is a diagram for explaining an example of a display screen displaying search results.

[0032] Figure 8 This is a diagram for explaining an example of a display screen displaying meta-information.

[0033] Fig. 9 This is a diagram for explaining an example of a display screen in which emphasis is displayed.

[0034] Fig.10 This is a diagram for explaining an example of a display screen on which adoption or rejection of a candidate is determined.

[0035] Fig.11 A diagram for explaining an example of an enlarged display of a display screen.

[0036] Fig.12 It is a diagram for explaining an example of a display screen after sorting. DETAILED DESCRIPTION

[0037] Hereinafter, preferred embodiments of the information processing device, information processing method and program according to the present invention will be described with reference to the accompanying drawings. In this specification, "structure" includes buildings, such as civil engineering structures such as bridges, tunnels, and dams, and also includes buildings such as walls, columns, and beams of buildings, houses, and structures.

[0038] Figure 1 1 is a schematic diagram of the information processing device 10. The information processing device 10 is connected to the operation unit 18 and the display device 30. Figure 1 As shown, the user obtains the inspection result of the structure 1 via the camera 3 or the mobile terminal 5 .

[0039] As the mobile terminal 5 , for example, various mobile terminals having a photographing function and an information inputting function, such as a smartphone, a tablet terminal, and a portable personal computer, are preferably used.

[0040] The user inputs a search query based on the inspection result into the information processing device 10 via the operation unit 18. The information processing device 10 acquires the input search query. The information processing device 10 acquires search results from the database 40 based on the search query. The database 40 includes, for example, past inspection results on structures.

[0041] The information processing device 10 acquires meta information of the search query, and determines display content according to the meta information. Then, the information processing device 10 displays the determined display content on the display device 30.

[0042] The information processing device 10 displays the search results in an organized manner according to the search results and their search contents, so that the user can easily judge from the search results and can grasp the parts of the search results that should be paid attention to.

[0043] Hereinafter, this embodiment will be described in detail.

[0044] [Hardware structure of information processing device]

[0045] Figure 2 This is a block diagram showing an example of the hardware configuration of the information processing device according to the present embodiment.

[0046] As Figure 2 The information processing device 10 shown can be a computer or a workstation. The information processing device 10 mainly includes an input / output interface 12, a storage unit 16, an operation unit 18, a CPU (Central Processing Unit) 20, a RAM (Random Access Memory) 22, a ROM (Read Only Memory) 24, and a display control unit 26. A display device 30 constituting a display is connected to the information processing device 10. Under the instruction of the CPU 20, the display device 30 displays various information through the control of the display control unit 26.

[0047] The input / output interface 12 can input various data (information) to the information processing device 10. For example, data stored in the storage unit 16 is input via the input / output interface 12.

[0048] The CPU (processor) 20 reads various programs stored in the storage unit 16 or the ROM 24 , etc., and develops the programs in the RAM 22 to perform calculations, thereby executing various processes of the information processing device 10 .

[0049] Figure 3 It is a block diagram showing the processing functions implemented by the CPU 20 .

[0050] The CPU 20 mainly includes a search query acquisition unit 51, a search result acquisition unit 52, a meta information acquisition unit 53, a display content determination unit 54, and an output unit 55, and executes processing of each unit. The processing function of each unit will be described later.

[0051] Return to Figure 2The storage unit (memory) 16 is composed of a non-temporary storage medium such as a hard disk device, various semiconductor memories, and a control unit thereof. The storage unit 16 stores programs that operate the information processing device 10, such as an operating system and a program for executing an information processing method. In addition, the storage unit 16 stores information used in the embodiments described below.

[0052] The operation unit 18 includes a keyboard and a mouse, and the user can cause the information processing device 10 to perform a desired process via these devices. By using a touch panel type device, the display device 30 and the operation unit 18 can be used as both.

[0053] The display device 30 is a device such as a liquid crystal display, and displays various information from the information processing device 10 .

[0054] Figure 4 1 is a diagram for explaining the database 40 stored in the storage unit 16. In the embodiment, the database 40 includes inspection data 41 which is an inspection result of a structure acquired by a past inspection.

[0055] like Figure 4 As shown, the inspection data 41 includes information of the structure, for example, at least one selected from the group consisting of "specifications", "damage information", "repair information", "surrounding information", "weather information", "statistical information" and "damage image". "Specifications", "damage information", "repair information", "surrounding information", "weather information" and "statistical information" are text data 42, and "damage image" is image data 43. In addition, the inspection data 41 may also include text data such as "inspection date and time", "shooting date and time", and "repair date and time".

[0056] The "specification" includes at least one of the number of years, the structural form, the name of the component or the material.

[0057] The number of years that have passed can be exemplified by the number of years that have passed since the completion date or the start date of use.

[0058] In the case of a bridge, the structural form may be a beam bridge, a rigid frame bridge, a truss bridge, an arch bridge, a cable-stayed bridge, or a suspension bridge.

[0059] In the case of a bridge, the component name may include, for example, a bridge deck, a pier, an abutment, or a beam.

[0060] · Examples of the material include steel, reinforced concrete, and PC (Prestressed Concrete).

[0061] The "damage information" includes at least one of the damage type, damage degree, healthiness, or countermeasure classification.

[0062] The damage types include, for example, cracks (fissures), water leakage, corrosion, breakage, or peeling that occur in the structure.

[0063] The damage degree is information showing the objective state of the damage according to the damage type, and is classified according to size, depth and type, for example, from a to d.

[0064] The health index can be exemplified by an index indicating the diagnosis results of four stages I to IV described in the inspection guidelines prescribed by the Ministry of Land, Infrastructure, Transport and Tourism.

[0065] · Countermeasure classification The countermeasure classification described in the inspection guidelines and the like prescribed by the Ministry of Land, Infrastructure, Transport and Tourism can be exemplified.

[0066] The “repair information” can exemplify, for example, past repair contents.

[0067] The “surrounding information” can include, for example, traffic volume (daily, monthly, annually, cumulatively, etc.) or location (distance from the sea).

[0068] Examples of “weather information” include average temperature, average humidity, rainfall, snowfall, and the like.

[0069] The “statistical information” may include, for example, the type of damage or the ratio of the size of damage.

[0070] exist Figure 4 In the above description, the case where the database 40 is stored in the storage unit 16 is described. However, if the information processing device 10 can access the database 40 via a wired or wireless network, the database 40 may be stored in an external storage device.

[0071] <Information processing method>

[0072] Figure 5 1 is a flowchart showing an information processing method using the information processing device 10. Figure 5 As shown, as an example, the information processing method includes the following steps: obtaining a search query (step S1); obtaining search results (step S2); obtaining meta-information of the search query (step S3); determining display content based on the meta-information (step S4); and outputting display content (step S5).

[0073] <Steps to obtain search query>

[0074] In the step of acquiring a search query (step S1), the search query acquisition unit 51 acquires the search query. The user inputs the search query into the information processing device 10 via the operation unit 18, for example. At this time, the search query is created by the user based on the inspection result of the structure 1. Then, the search query acquisition unit 51 acquires the search query. In addition, as another method, the search query can also be created by the user using the mobile terminal 5. In addition, as another method, the search query can also be automatically created based on the inspection result. Here, the search query includes information for determining the search object and is a processing request to the information processing device 10.

[0075] The search query may include, for example, text data and / or image data. In the case where the structure 1 is the object, the search query includes at least one selected from the group consisting of "specifications", "damage information", "repair information", "surrounding information", "weather information", "statistical information" and "damage image". "Specifications", "damage information", "repair information", "surrounding information", "weather information" and "statistical information" are examples of text data, and "damage image" is an example of image data. The search query is not limited to the above-mentioned text data and / or image data.

[0076] In addition, the image data and text data included in the search query are preferably of the same type as the image data 43 and text data 42 included in the inspection data 41 .

[0077] Figure 6 This is an example of a display screen showing a search query. Figure 6 The display screen 100 shown is displayed on the display device 30 under the control of the display control unit 26. The display screen 100 includes an input display screen 102 and a result display screen 104.

[0078] The input display screen 102 displays the search query Qu acquired by the search query acquisition unit 51, and the characters of "search query" are displayed in the category area 106. In the case where the search query Qu includes image data, the image data ID is displayed on the input display screen 102, and the user can confirm the image data ID. In the case where the search query Qu includes text data, the text data TD is displayed on the input display screen 102, and the user can confirm the text data TD. The user can input the search query Qu (image data ID and / or text data TD) from the input display screen 102, and the input search query Qu is acquired by the search query acquisition unit 51.

[0079] Figure 6 The input display screen 102 shown in FIG. 1 can display or input meta information described later. In the area where meta information is displayed or input, the characters "meta information" are displayed in the category area 107.

[0080] The input display screen 102 includes an execution button 108. If the execution button 108 is operated, the next step is entered. Figure 6 In the process, the process proceeds to step S2 of obtaining search results.

[0081] <Steps to obtain search results>

[0082] In the step of obtaining search results (step S2), the search result obtaining unit 52 obtains the search results of the database 40 according to the search query Qu. Figure 7 As shown, the search result acquisition unit 52 acquires, for example, the inspection data 41 of the database 40 according to the search query Qu. The acquired inspection data 41 is an example of the search result. Figure 7 In FIG. 1 , for convenience of explanation, a search query Qu including only the image data ID is shown. As described above, the search query Qu only needs to include at least one of the text data TD and the image data ID (not shown).

[0083] In the case where the search query Qu includes the image data ID, the search result acquisition unit 52 acquires the image data 43 from the database 40 according to the image data ID. The search result acquisition unit 52 calculates the feature amount of the image data ID and the image data 43 by an image recognition algorithm or a machine learning model, etc. Then, the search result acquisition unit 52 compares the feature amount of the image data ID with the feature amount of the image data 43, and acquires the image data 43 corresponding to the image data ID as the search result according to the search query Qu.

[0084] In the case where the search query Qu includes text data TD, the search result acquisition unit 52 acquires text data 42 from the database 40 according to the text data TD. The search result acquisition unit 52 compares the text data TD with the text data 42 through a text search algorithm or a machine learning model, and acquires the text data 42 corresponding to the text data TD of the search query Qu as the search result according to the search query Qu.

[0085] Furthermore, the term "performed according to a search query" in this specification means that the database 40 is processed in some way using the information of the search query, such as including a search. The search includes concepts such as "consistent", "similar", "dissimilar" and "evaluation" (for example, "from near to far" or "from far to near").

[0086] like Figure 7 As shown, the search result obtained by the search result acquisition unit 52 is displayed on the result display screen 104 under the control of the display control unit 26 .

[0087] In the case where the search query Qu is text data TD, the text data 42 corresponding to the text data TD is displayed on the result display screen 104 .

[0088] Figure 7 Only the image data ID is shown as the search query Qu. And, as the search result based on the search query Qu including only the image data ID, only the image data 43 is displayed. In addition, as described above, the search query Qu only needs to include at least one of the image data ID and the text data TD. And, the search result acquisition unit 52 can also acquire the search result based on the search query formed by combining the image data ID and the text data TD.

[0089] In addition, the acquisition of search results can apply, for example, the technology of International Publication No. 2020 / 071216, International Publication No. 2020 / 255227, Japanese Patent Publication No. 2018-165926, or Japanese Patent Publication No. 2017-167987.

[0090] Next, the processing flow enters step S3 of obtaining meta information of the search query Qu.

[0091] <Steps for obtaining meta information of search query>

[0092] In the step of acquiring meta information of the search query Qu (step S3 ), the meta information acquisition section 53 acquires meta information of the search query Qu. Figure 8 FIG. 1 shows an example of a display screen 100 displaying meta information Me. The acquired meta information Me is displayed on an input display screen 102. Figure 8 In , meta information Me including only text data TD is displayed. Figure 8 In the process, the first search result obtained in step S2 is displayed on the result display screen 104.

[0093] Similar to the search query Qu, the meta-information Me may include text data TD and / or image data ID, for example, at least one selected from the group consisting of "specifications", "damage information", "repair information", "peripheral information", "weather information", "statistical information" and "damaged image". "Specifications", "damage information", "repair information", "peripheral information", "weather information" and "statistical information" are examples of text data TD, and "damaged image" is an example of image data ID. The search query Qu and meta-information Me may include common types of image data ID and text data TD. The information included in the meta-information Me is not limited. Figure 8 , meta information Me including only text data TD (image data ID is not shown) is displayed. Meta information Me only needs to include either text data TD or image data ID.

[0094] Here, the meta information Me is information related to the search query Qu, not the search query Qu itself.

[0095] Next, the combination of the search query Qu and the meta-information Me is shown. Table 1 shows an example of the combination of the search query Qu and the meta-information Me. When the object is a structure, the following combinations can be exemplified. No. 1 shows the case where the search query Qu is image data (damaged image) and the meta-information Me is text data (specifications, damage information, repair information, statistical information, etc.). No. 2 shows the case where the search query Qu is text data (specifications, damage information, repair information, statistical information, etc.) and the meta-information Me is image data (damaged image). No. 3 represents the case where the search query Qu is image data (damaged image) and the meta-information Me is image data (damaged image). In No. 3, when the search query Qu and the meta-information Me respectively include a damaged image as image data, as the damaged image of the meta-information Me, a damaged image different from the search query Qu is applied. As the damaged image of the meta-information Me, an image completely different from the search query Qu, a past image, a slightly processed image, an image shot remotely, etc. can be exemplified.

[0096] Table 1 is an example of a combination of a search query Qu and meta information Me, but the present invention is not limited thereto.

[0097] [Table 1]

[0098]

[0099] The meta-information acquisition unit 53 can automatically acquire the meta-information Me of the search query Qu. For example, when the search query Qu is image data, Exif (Exchangeable Image File Format) is automatically acquired by the meta-information acquisition unit 53 as the meta-information Me. Exif is information attached to the image data when shooting, including information such as the conditions and settings when shooting. Furthermore, when the image data of the search query Qu is shot in a GPS reception environment, the meta-information Me may include location information, latitude and longitude, or altitude, etc.

[0100] Furthermore, when the image data of the search query Qu is a "damaged image", the meta information Me can be acquired using a learning model that has been machine-learned. For example, the "damaged information" can be identified based on the "damaged image" of the search query Qu and through the learning model. The identified "damage information" is acquired as the meta information Me by the meta information acquisition unit 53.

[0101] The meta information Me can be manually input into the information processing device 10 by a user. Figure 8 This is an example of a display screen showing an input example of meta-information Me. Figure 8The display screen 100 can confirm the acquired meta-information Me and input the meta-information Me. That is, the user can manually input the image data ID and / or text data TD as the meta-information Me into the input display screen 102 of the display screen 100. The input meta-information Me is acquired by the meta-information acquisition unit 53. Figure 8 , the meta information Me is text data TD, and the text data TD is displayed as the meta information Me. Not only the text data TD but also the image data ID can be input as the meta information Me. At this time, the image data ID is displayed on the input display screen 102.

[0102] When the user manually inputs meta information Me, the search query Qu is associated with the meta information Me. For example, when inputting meta information Me, the user displays the search query Qu on the input display screen 102 and performs an association process on the meta information Me, thereby establishing a corresponding association between the search query Qu and the meta information Me. The user can arbitrarily establish a corresponding association between the search query Qu and the meta information Me.

[0103] In addition, even when the meta information Me is automatically acquired, the input display screen 102 can display the meta information Me under the control of the display control unit 26 , and the user can confirm the meta information Me.

[0104] When the execution button 108 of the input display screen 102 is operated, the process flow proceeds to step S4 of determining the display content based on the meta information. In addition, the process flow can proceed to step S5 of outputting the display content after step S4.

[0105] <Steps for determining display content>

[0106] In the step of determining the display content (step S4), the display content determination unit 54 determines the display content for the search results based on the meta-information Me. Here, the determination of the display content is a concept that includes the determination of the display object and the determination of the display method. For example, the determination of the display content includes the emphasis or suppression of the display content, the display of statistical information such as the order change, the average, and the dispersion. If the determination of the display content is exemplified, it is possible to cite the display of damage images (thumbnails, enlarged images), meta-information such as the damage location and specifications, statistical information such as proportions (for example, in the top 100, the damage types are 80% cracks, 20% peeling or steel bar exposure, etc.), UI (User Interface: user interface) switching buttons (for example, overview display or enlarged display), additional operation guides (for example, highlight display, gray display), etc.

[0107] Next, the determination of display content by the display content determination unit 54 is described by way of example. The search query includes an image data ID and the search results based on the search query are obtained in step S2. The search results are obtained from the database 40 and can include image data 43 and text data 42.

[0108] This is the case where the meta information Me includes text data TD such as "specifications", "damage information", "repair information" or "statistical information". The display content determination unit 54 can determine the search result having the same text data 42 as the text data TD of the meta information Me as the display content. The determination of the display content is the determination of the object of the display content, and is an example of the determination of whether to adopt or not the display content candidate.

[0109] Next, the meta-information Me includes the degree of damage. The display content determination unit 54 can determine that the statistical information (the proportion of the degree of damage) included in the search results is displayed as information related to the meta-information. That is, in addition to the search results (image data 43), the statistical information included in the text data 42 will become the object of display. In order to add other display content, the display content determination unit 54 can determine that the displayed display content is hidden. The determination of the display content is an example of determining the display content to be hidden and the other display content to be displayed.

[0110] Next, the meta information Me includes the damage type (crack, free lime, etc.) or damage degree (size, depth, etc.). The display content determination unit 54 can determine whether to enlarge, reduce, display in an enlarged manner, or display in a reduced manner the image data 43 in consideration of the damage type and damage degree and the imaging range of the search result image data 43. The determination of the display content is an example of determination of the display content based on the search result.

[0111] Next, the meta information Me includes the image data ID. The display content determination unit 54 can determine the display content of the search result in descending order of relevance based on the relevance between the image data ID and the image data 43. This determination of the display content is an example of determining the priority of the display content.

[0112] <Procedure for outputting display contents>

[0113] In the step of outputting the display content (step S5), the output unit 55 displays the determined display content on the display device 30 via the display control unit 26. In addition, the output unit 55 displays the display content on the display device 30, but the output unit 55 can output the determined display content to a printing device and can output it as electronic data in various data formats.

[0114] Next, regarding an example of display content displayed on the display device 30, in the following Figures 9 to 12 Provide explanation.

[0115] Fig. 9 FIG. 2 shows an example of a display screen 200 displayed by the display device 30. The display screen 200 includes the display content determined in step S4. Figure 8 The basic structure of the display screen 100 shown is the same, but in the display screen 200, the image data 43 including the text data 42 which is the same as the text data TD of the metadata Me is highlighted and displayed.

[0116] In the display screen 200, the text data 42 is displayed below the image data 43, and the corresponding image data 43 is surrounded by a thick frame. The image data 43 is surrounded by a thick frame, so the user can easily recognize the corresponding image data 43. Fig. 9 In the example, a thick frame is used as an emphasis display, but the emphasis display is not limited to this, and the color of the text data 42, the thickness of the characters, or blinking may also be used.

[0117] Fig.10 An example of a display screen 202 displayed by the display device 30 is shown. The structure of the display screen 202 is similar to Figure 8 The basic structure of the display screen 100 shown is the same, but in the display screen 202, only the image data 43 including the text data 42 which is the same as the text data TD of the meta-information Me is displayed. Fig.10 The display screen 202 is an example of determining whether to adopt or not a candidate for display content.

[0118] Fig.11 An example of a display screen 204 displayed by the display device 30 is shown. The structure of the display screen 204 is similar to Figure 8 The basic structure of the display screen 100 shown is the same, but in the display screen 204, the image data 43 is enlarged according to the text data TD of the meta-information Me. For example, in the case where the text data TD includes the type of damage or the degree of damage, the image data 43 is enlarged so that the user can easily visually recognize the type of damage or the degree of damage. The image data 43 can be enlarged as needed. Alternatively, the image data 43 can also be reduced or displayed so that the user can easily visually recognize it. Fig.11 In the search result, text data TD including the damage type and damage degree is displayed below the image data 43. The user can easily grasp the part to be focused on in the search result.

[0119] Fig.12 An example of a display screen 206 displayed by the display device 30 is shown. The structure of the display screen 206 is similar to Figure 8The basic structure of the display screen 100 shown is the same, but in the display screen 206, the image data 43 is sorted in descending order of relevance to the image data ID of the meta information Me. In addition, only the first six image data 43 with the highest relevance to the image data ID are displayed. The determination of the display content is an example of determining the priority of the display content. The structure of the display screen 206 is not particularly limited. For example, the image data 43 may be sorted in descending order of relevance, and only the first six image data 43 may be displayed with emphasis. The user can easily make a judgment from the search results based on the search query.

[0120] <Other>

[0121] In the above-mentioned embodiment, the hardware structure of the processing unit that performs various processes is various processors as shown below. The various processors include general-purpose processors that execute software (programs) and function as various processing units, namely CPU (Central Processing Unit), FPGA (Field Programmable Gate Array) and other processors whose circuit structure can be changed after manufacturing, namely programmable logic devices (PLD), ASIC (Application Specific Integrated Circuit) and other processors with circuit structures specially designed for performing specified processes, namely dedicated circuits, etc.

[0122] One processing unit may be composed of one of these various processors, or may be composed of two or more processors of the same or different types (for example, a plurality of FPGAs or a combination of a CPU and an FPGA). Furthermore, multiple processing units may be composed of one processor. As an example of multiple processing units composed of one processor, first, as represented by computers such as clients and servers, there is a method in which a processor is composed of a combination of one or more CPUs and software, and the processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a method in which a processor is used that implements the functions of the entire system including multiple processing units using one IC (Integrated Circuit) chip. In this way, various processing units are composed of one or more of the above-mentioned various processors as a hardware structure.

[0123] Furthermore, more specifically, the hardware structure of these various processors is a circuit (circuitry) formed by combining circuit elements such as semiconductor elements.

[0124] The above structures and functions can be appropriately implemented by any hardware, software or a combination of the two. For example, the present invention can also be applied to a program that causes a computer to execute the above processing steps (processing sequence), a computer-readable storage medium (non-temporary storage medium) storing such a program, or a computer capable of installing such a program.

[0125] As mentioned above, although the example of this invention was demonstrated, this invention is not limited to the said embodiment, It goes without saying that various deformation|transformation is possible within the range which does not deviate from the summary of this invention.

[0126] Explanation of symbols

[0127] 1-structure, 3-camera, 5-mobile terminal, 10-information processing device, 12-input / output interface, 16-storage unit, 18-operation unit, 20-CPU, 22-RAM, 24-ROM, 26-display control unit, 30-display device, 40-database, 41-inspection data, 42-text data, 43-image data, 51-search query acquisition unit, 52-search result acquisition unit, 53-meta information acquisition unit, 54-display content determination unit, 55-output unit, 100-display screen, 102-input display screen, 104-result display screen, 106-category area, 107-category area, 108-execution button, 200-display screen, 202-display screen, 204-display screen, 206-display screen, ID-image data, TD-text data, Me-meta information, Qu-search query.

Claims

1. An information processing device comprising a processor, The processor performs the following processing: Get the search query; Obtaining search results from a database based on the search query; obtaining meta information of the search query; and Display content is determined according to the meta information.

2. The information processing device according to claim 1, wherein: The processor determines the display content according to the search results.

3. The information processing device according to claim 1 or 2, wherein: The processor outputs the display content.

4. The information processing device according to claim 1 or 2, wherein: The processor determines a priority order for the display content.

5. The information processing device according to claim 1 or 2, wherein: The processor determines whether to adopt the candidate of the display content.

6. The information processing device according to claim 1 or 2, wherein: The processor determines the display content to be hidden and another display content to be displayed.

7. The information processing device according to claim 1 or 2, wherein: The meta information includes information related to the structure.

8. The information processing device according to claim 7, wherein: The information related to the structure of the meta-information includes at least one selected from the group consisting of damage image, specification, damage information, repair information, surrounding information, weather information and statistical information.

9. The information processing device according to claim 1 or 2, wherein: The search query includes information related to a structure.

10. The information processing device according to claim 9, wherein: The information related to the structure of the search query includes at least one selected from the group consisting of damage images, specifications, damage information, repair information, surrounding information, meteorological information and statistical information.

11. An information processing method, which is an information processing method executed by a processor, the information processing method comprising the following steps: Get the search query; Obtaining search results from a database according to the search query; obtaining meta information of the search query; and Display content is determined according to the meta information.

12. A program, which is a program executed by a processor, the processor performing the following processing: Get the search query; Obtaining search results from a database according to the search query; obtaining meta information of the search query; and Display content is determined according to the meta information. 13 . A recording medium which is a non-transitory computer-readable recording medium and has the program according to claim 12 recorded thereon.