Information processing device, information processing method, and program

JPWO2023203965A5Pending Publication Date: 2025-01-06

View PDF 0 Cites 0 Cited by

Patent Information

Application Number: JP2024516146
Authority / Receiving Office: JP · JP
Patent Type: Applications
Filing Date: 2024-10-24
Publication Date: 2025-01-06

AI Technical Summary

Technical Problem

Non-specialist inspectors face difficulties in executing search queries and making judgments based on inspection results for infrastructure structures due to increased costs and labor shortages, making it hard to identify relevant information from search results.

Method used

An information processing device and method that organizes display content based on search queries and results, using meta information to determine and prioritize display content, including damaged images, specifications, damage information, repair information, surrounding information, weather information, and statistical information, to facilitate easier decision-making and focus on key search results.

Benefits of technology

Enables non-experts to easily judge and understand the significance of search results, allowing them to focus on critical information for infrastructure inspections, improving efficiency and effectiveness in resource allocation.

✦ Generated by Eureka AI based on patent content.

Patent Text Reader

Abstract

Provided are an information processing device, an information processing method, and a program which, by organizing display contents in accordance with a search content and a search result, can easily make determination from the search result and can understand a notable point in the search result. In an information processing device (10) equipped with a processor, the processor acquires a search query, acquires a result of search carried out on a database on the basis of the search query, acquires meta information of the search query, and determines contents to be displayed on the basis of the meta information.

Need to check novelty before this filing date? Find Prior Art

Description

Information processing device, information processing method, and program

[0001] The present disclosure relates to an information processing device, an information processing method, and a program.

[0002] Traditionally, facility managers have outsourced inspection work to construction consultants, and inspectors with specialized knowledge inspect various structures (also called architecture, buildings, structures, or infrastructure) such as bridges, roads, tunnels, dams, and buildings.

[0003] In Patent Document 1, first inspection results are obtained, second inspection results are searched for from a database based on image features contained in the first inspection results, specific inspection results corresponding to the building conditions are searched for from the searched second inspection results, and the specific inspection results are displayed preferentially on the display unit.

[0004] International Publication No. 2017 / 056804

[0005] Recently, due to rising costs and labor shortages, there has been an increasing need for inspections by non-experts. However, it is not easy for non-experts to make judgments based on the search results displayed after executing a search query, and it is not easy to understand what should be focused on in the search results.

[0006] The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, information processing method, and program that allows users to easily judge search results and grasp the points of interest in the search results by organizing the display content according to the search content and search results.

[0007] In an information processing device including a processor of the first aspect, the processor acquires a search query, acquires search results from a database based on the search query, acquires meta information of the search query, and determines display content based on the meta information.

[0008] In the information processing device of the second aspect, the processor determines the display content based on the search results.

[0009] In the information processing device of the third aspect, the processor outputs the display content.

[0010] In the information processing device of the fourth aspect, the processor determines the priority of the display contents.

[0011] In the information processing device of the fifth aspect, the processor determines whether to adopt a candidate for the display content.

[0012] In the information processing device of the sixth aspect, the processor determines the display content to be hidden and the other display content to be displayed.

[0013] In the information processing device of the seventh aspect, the meta information includes information relating to the structure.

[0014] In the information processing device of the eighth aspect, the information about the structure in the meta information includes at least one selected from the group consisting of a damage image, specifications, damage information, repair information, surrounding area information, weather information, and statistical information.

[0015] In the information processing device of the ninth aspect, the search query includes information about a structure.

[0016] In the information processing device of the tenth aspect, the information about the structure in the search query includes at least one selected from the group consisting of damage images, specifications, damage information, repair information, surrounding information, weather information, and statistical information.

[0017] An information processing method executed using a processor of an eleventh aspect, comprising: acquiring a search query; acquiring search results based on the search query from a database; acquiring meta information of the search query; and determining display content based on the meta information.

[0018] A program executed by a processor of a twelfth aspect, which acquires a search query, acquires search results based on the search query from a database, acquires meta information of the search query, and determines display content based on the meta information.

[0019] According to the present invention, by arranging the display contents according to the search contents and search results, it is possible to easily judge from the search results and grasp the parts of the search results that should be focused on.

[0020] FIG. 1 is a schematic diagram of an information processing device. FIG. 2 is a block diagram showing an example of the hardware configuration of the information processing device. FIG. 3 is a block diagram showing processing functions implemented by a CPU. FIG. 4 is a diagram showing a database stored in a storage unit. FIG. 5 is a flow diagram showing an information processing method. FIG. 6 is a diagram for explaining an example of a display screen displaying a search query. FIG. 7 is a diagram for explaining an example of a display screen displaying search results. FIG. 8 is a diagram for explaining an example of a display screen displaying meta information. FIG. 9 is a diagram for explaining an example of a display screen in which a highlighted display is performed. FIG. 10 is a diagram for explaining an example of a display screen in which the adoption or rejection of a candidate is determined. FIG. 11 is a diagram for explaining an example of an enlarged display screen. FIG. 12 is a diagram for explaining an example of a sorted display screen.

[0021] Hereinafter, preferred embodiments of an information processing device, an information processing method, and a program according to the present invention will be described with reference to the accompanying drawings. In this specification, the term "structure" includes buildings, such as civil engineering structures, for example, bridges, tunnels, and dams, as well as buildings, houses, and architectural structures such as walls, pillars, and beams of buildings.

[0022] Fig. 1 is a schematic diagram of an information processing device 10. The information processing device 10 is connected to an operation unit 18 and a display device 30. As shown in Fig. 1, a user obtains the inspection results of a structure 1 via a camera 3 or a mobile terminal 5.

[0023] The mobile terminal 5 is preferably any of various mobile terminals having a photographing function and an information input function, such as a smartphone, a tablet terminal, and a portable personal computer.

[0024] The user inputs a search query based on the inspection results to the information processing device 10 via the operation unit 18. The information processing device 10 acquires the input search query. The information processing device 10 acquires the search results based on the search query from the database 40. The database 40 contains, for example, past inspection results for structures.

[0025] The information processing device 10 acquires meta information of the search query, determines display content based on the meta information, and displays the determined display content on the display device 30.

[0026] Since the information processing device 10 organizes the display contents according to the search results and the search contents, the user can easily make a judgment based on the search results and can grasp the parts of the search results that should be focused on.

[0027] This embodiment will be described in detail below.

[0028] [Hardware Configuration of Information Processing Apparatus] FIG. 2 is a block diagram showing an example of a hardware configuration of an information processing apparatus according to the embodiment.

[0029] A computer or a workstation can be used as the information processing device 10 shown in Fig. 2. The information processing device 10 mainly includes an input / output interface 12, a storage unit 16, an operation unit 18, a CPU (Central Processing Unit) 20, a RAM (Random Access Memory) 22, a ROM (Read Only Memory) 24, and a display control unit 26. A display device 30 that constitutes a display is connected to the information processing device 10. Under the command of the CPU 20 and under the control of the display control unit 26, the display device 30 displays various information.

[0030] The input / output interface 12 can input various data (information) to the information processing device 10. For example, data to be stored in the storage unit 16 is input via the input / output interface 12.

[0031] The CPU (processor) 20 reads out various programs stored in the storage unit 16 or the ROM 24, etc., and loads them into the RAM 22 to perform calculations, thereby executing various processes of the information processing device 10.

[0032] FIG. 3 is a block diagram showing the processing functions realized by the CPU 20. As shown in FIG.

[0033] The CPU 20 mainly includes a search query acquisition unit 51, a search result acquisition unit 52, a meta information acquisition unit 53, a display content determination unit 54, and an output unit 55, and executes the processing of each unit. The processing function of each unit will be described later.

[0034] 2, the storage unit (memory) 16 is composed of non-transitory storage media such as a hard disk drive and various semiconductor memories, and its control unit. The storage unit 16 stores programs that operate the information processing device 10, such as an operating system and a program that executes an information processing method. The storage unit 16 also stores information used in the embodiments described below.

[0035] The operation unit 18 includes a keyboard and a mouse, and a user can use these devices to cause the information processing device 10 to perform necessary processing. By using a touch panel type device, the display device 30 can also serve as the operation unit 18.

[0036] The display device 30 is, for example, a device such as a liquid crystal display, and displays various information from the information processing device 10 .

[0037] 4 is a diagram illustrating a database 40 stored in the storage unit 16. In the embodiment, the database 40 includes inspection data 41 that is inspection results of structures acquired through past inspections.

[0038] 4, the inspection data 41 includes information about the structure, for example, at least one selected from the group consisting of "specifications," "damage information," "repair information," "surrounding area information," "weather information," "statistical information," and "damage image." The "specifications," "damage information," "repair information," "surrounding area information," "weather information," and "statistical information" are text data 42, and the "damage image" is image data 43. The inspection data 41 may further include text data such as "inspection date and time," "photograph date and time," and "repair date and time."

[0039] "Specifications" include at least one of the following: age, structural type, component name, or material. ・Examples of age include the number of years since completion or service start date. ・In the case of a bridge, examples of structural type include girder bridge, rigid frame bridge, truss bridge, arch bridge, cable-stayed bridge, or suspension bridge. ・In the case of a bridge, examples of component name include deck, pier, abutment, or girder. ・Examples of material include steel, reinforced concrete, or PC (Prestressed Concrete).

[0040] "Damage information" includes at least one of damage type, damage level, soundness, or countermeasure classification. ・Damage type can be exemplified by the type of damage that occurs in a structure, such as cracks, water leaks, corrosion, fractures, or peeling. ・Damage level is information that indicates the objective state of the damage for each type of damage, and is classified according to size, depth, and type, and displayed, for example, as a to d. ・The soundness index can be exemplified by an index that shows the diagnosis results on a four-level scale, I to IV, as described in the inspection guidelines established by the Ministry of Land, Infrastructure, Transport and Tourism. ・The countermeasure classification can be exemplified by the countermeasure classification as described in the inspection guidelines established by the Ministry of Land, Infrastructure, Transport and Tourism.

[0041] The "repair information" may be, for example, details of past repairs.

[0042] Examples of "surrounding area information" include traffic volume (per day, per month, per year, cumulative, etc.) or location (distance from the sea).

[0043] Examples of "weather information" include average temperature, average humidity, rainfall, and snowfall.

[0044] The "statistical information" may be, for example, a percentage by type of damage or by the size of damage.

[0045] 4 illustrates a case where the database 40 is stored in the storage unit 16. However, the database 40 may be stored in an external storage device as long as the information processing device 10 can access the database 40 via a wired or wireless network.

[0046] <Information Processing Method> Fig. 5 is a flow diagram showing an information processing method using the information processing device 10. As shown in Fig. 5, the information processing method includes, for example, a step of acquiring a search query (step S1), a step of acquiring search results (step S2), a step of acquiring meta information of the search query (step S3), a step of determining display content based on the meta information (step S4), and a step of outputting the display content (step S5).

[0047] <Step of Acquiring a Search Query> In the step of acquiring a search query (step S1), the search query acquisition unit 51 acquires a search query. For example, a user inputs a search query to the information processing device 10 via the operation unit 18. In this case, the search query is created by the user based on the inspection results of the structure 1. Then, the search query acquisition unit 51 acquires the search query. As another method, the user may create the search query using the mobile terminal 5. As a further method, the search query may be automatically created from the inspection results. Here, the search query includes information for identifying a search target and is a type of processing request to the information processing device 10.

[0048] The search query may include, for example, text data and / or image data. When the target is the structure 1, the search query includes at least one selected from the group of "specifications," "damage information," "repair information," "surrounding area information," "weather information," "statistical information," and "damage image." "Specifications," "damage information," "repair information," "surrounding area information," "weather information," and "statistical information" are examples of text data, and "damage image" is an example of image data. The search query is not limited to the above-mentioned text data and / or image data.

[0049] It is preferable that the image data and text data included in the search query are of the same type as the image data 43 and text data 42 included in the inspection data 41 .

[0050] Fig. 6 shows an example of a display screen displaying a search query. The display screen 100 shown in Fig. 6 is displayed on the display device 30 under the control of the display control unit 26. The display screen 100 includes an input display screen 102 and a result display screen 104.

[0051] The input display screen 102 displays the search query Qu acquired by the search query acquisition unit 51, and also displays the words "search query" in the type area 106. If the search query Qu includes image data, the image data ID is displayed on the input display screen 102, allowing the user to confirm the image data ID. If the search query Qu includes text data, the text data TD is displayed on the input display screen 102, allowing the user to confirm the text data TD. The user can input the search query Qu (image data ID and / or text data TD) from the input display screen 102, and the input search query Qu is acquired by the search query acquisition unit 51.

[0052] 6, meta information, which will be described later, can be displayed or input. In the area for displaying or inputting meta information, the word "meta information" is displayed in the type area 107.

[0053] The input display screen 102 includes an execute button 108. When the execute button 108 is operated, the process proceeds to the next step, which is step S2 in Fig. 6, where the search results are acquired.

[0054] <Step of Obtaining Search Results> In the step of obtaining search results (step S2), the search result obtaining unit 52 obtains the results of a search performed on the database 40 based on the search query Qu. As shown in FIG. 7 , the search result obtaining unit 52 obtains, for example, inspection data 41 performed on the database 40 based on the search query Qu. The obtained inspection data 41 is an example of a search result. For ease of explanation, FIG. 7 displays a search query Qu that includes only an image data ID. As described above, the search query Qu may include at least one of text data TD and image data ID (not shown).

[0055] When the search query Qu includes an image data ID, the search result acquisition unit 52 acquires image data 43 from the database 40 based on the image data ID. The search result acquisition unit 52 calculates feature amounts of the image data ID and the image data 43 using an image recognition algorithm, a machine learning model, or the like. Next, the search result acquisition unit 52 compares the feature amounts of the image data ID with the feature amounts of the image data 43, and acquires the image data 43 corresponding to the image data ID as a search result based on the search query Qu.

[0056] When the search query Qu includes text data TD, the search result acquisition unit 52 acquires text data 42 based on the text data TD from the database 40. The search result acquisition unit 52 compares the text data TD with the text data 42 using a text search algorithm, a machine learning model, or the like, and acquires the text data 42 corresponding to the text data TD of the search query Qu as a search result based on the search query Qu.

[0057] Furthermore, in this specification, "based on a search query" means that some processing is performed on the database 40 using information from the search query, and includes, for example, searching. Searching includes concepts such as "match," "similar," "dissimilar," and "rating" (for example, "closest order" or "farthest order").

[0058] As shown in FIG. 7, the search results obtained by the search result obtaining unit 52 are displayed on a result display screen 104 under the control of the display control unit 26 .

[0059] When the search query Qu is text data TD, the text data 42 corresponding to the text data TD is displayed on the result display screen 104 .

[0060] 7 shows only the image data ID as the search query Qu. Furthermore, only the image data 43 is displayed as a search result based on the search query Qu including only the image data ID. As described above, the search query Qu may include at least one of the image data ID and the text data TD. Furthermore, the search result acquisition unit 52 may acquire search results based on a search query that combines the image data ID and the text data TD.

[0061] In addition, the search results may be obtained by applying technologies such as those described in International Publication No. 2020 / 071216, International Publication No. 2020 / 255227, Japanese Patent Application Laid-Open No. 2018-165926, or Japanese Patent Application Laid-Open No. 2017-167987.

[0062] Next, the process flow proceeds to step S3, in which meta information of the search query Qu is acquired.

[0063] <Step of Acquiring Meta Information of Search Query> In the step of acquiring meta information of the search query Qu (step S3), the meta information acquisition unit 53 acquires meta information of the search query Qu. Fig. 8 shows an example of a display screen 100 displaying meta information Me, and the acquired meta information Me is displayed on the input display screen 102. In Fig. 8, meta information Me including only text data TD is displayed. Also in Fig. 8, the first search result acquired in step S2 is displayed on the result display screen 104.

[0064] Like the search query Qu, the meta information Me may include text data TD and / or image data ID, and may include, for example, at least one selected from the group consisting of "specifications," "damage information," "repair information," "peripheral information," "weather information," "statistical information," and "damage image." The "specifications," "damage information," "repair information," "peripheral information," "weather information," and "statistical information" are examples of text data TD, and the "damage image" is an example of an image data ID. The search query Qu and the meta information Me may include common types of image data ID and text data TD. However, the information included in the meta information Me is not limited. In FIG. 8 , meta information Me including only text data TD (image data ID is not shown) is displayed. The meta information Me may include either text data TD or image data ID.

[0065] Here, the meta information Me is not the search query Qu itself but information that is said to be related to the search query Qu.

[0066] Next, combinations of search queries Qu and meta information Me are shown. Table 1 shows examples of combinations of search queries Qu and meta information Me. When the target is a structure, the following combinations can be exemplified. No. 1 indicates that the search query Qu is image data (damage image), and the meta information Me is text data (specifications, damage information, repair information, statistical information, etc.). No. 2 indicates that the search query Qu is text data (specifications, damage information, repair information, statistical information, etc.), and the meta information Me is image data (damage image). No. 3 indicates that the search query Qu is image data (damage image), and the meta information Me is image data (damage image). In No. 3, when the search query Qu and the meta information Me each contain a damage image as image data, a damage image different from the search query Qu is applied as the damage image of the meta information Me. Examples of the damage image of the meta information Me include an image that is completely different from the search query Qu, a past image, a slightly edited image, an image taken remotely, etc.

[0067] Table 1 shows an example of a combination of a search query Qu and meta information Me, but is not limited to this.

[0068]

[0069] The meta information acquisition unit 53 can automatically acquire meta information Me of the search query Qu. For example, if the search query Qu is image data, the meta information acquisition unit 53 automatically acquires Exif (Exchangeable Image File Format) as the meta information Me. Exif is information attached to image data when it is captured, and includes information such as the circumstances and settings at the time of capture. Furthermore, if the image data of the search query Qu is captured in a GPS reception environment, the meta information Me may include location information, latitude and longitude, altitude, etc.

[0070] Furthermore, when the image data of the search query Qu is a "damage image," the meta information Me can be acquired using a machine-learned learning model. For example, based on the "damage image" of the search query Qu, the learning model can identify "damage information." The identified "damage information" is acquired as the meta information Me by the meta information acquisition unit 53.

[0071] The meta information Me can be manually input into the information processing device 10 by the user. FIG. 8 is an example of a display screen showing an example of input of meta information Me. The display screen 100 of FIG. 8 allows the user to check the acquired meta information Me and input the meta information Me. That is, the user can manually input image data ID and / or text data TD as the meta information Me into the input display screen 102 of the display screen 100. The input meta information Me is acquired by the meta information acquisition unit 53. FIG. 8 shows a case where the meta information Me is text data TD, and the text data TD is displayed as the meta information Me. In addition to text data TD, image data ID can also be input as the meta information Me. In this case, the image data ID is displayed on the input display screen 102.

[0072] When manually inputting meta information Me, the user associates the search query Qu with the meta information Me. For example, when inputting the meta information Me, the user displays the search query Qu on the input display screen 102 and performs a process of linking the meta information Me, thereby associating the search query Qu with the meta information Me. The user can associate the search query Qu with the meta information Me in any way.

[0073] Even when the meta information Me is acquired automatically, the input display screen 102 can display the meta information Me under the control of the display control unit 26, allowing the user to check the meta information Me.

[0074] When the execute button 108 on the input display screen 102 is operated, the process flow proceeds to step S4, where the display content is determined based on the meta information. After step S4, the process flow can proceed to step S5, where the display content is output.

[0075] <Step of Determining Display Content> In the step of determining display content (step S4), the display content determination unit 54 determines display content for the search results based on the meta information Me. Here, determining display content is a concept that includes determining what to display and how to display it. For example, determining display content includes highlighting or suppressing display content, rearranging the display content, and displaying statistical information such as averages and variances. Examples of display content include displaying damage images (thumbnails, enlarged images), meta information such as damaged locations and specifications, statistical information such as percentages (e.g., of the top 100 damage types, 80% are cracks and 20% are peeling or exposed rebar), UI (User Interface) switching buttons (e.g., list display or enlarged display), and additional operation guidance (e.g., highlight display, grayed-out display).

[0076] Next, an example of the determination of display content by the display content determination unit 54 will be described. A case will be described in which a search query includes an image data ID, and search results based on the search query are obtained in step S2. The search results are obtained from the database 40, and may include image data 43 and text data 42.

[0077] This is the case when the meta information Me includes text data TD such as "specifications," "damage information," "repair information," or "statistical information." The display content determination unit 54 can determine, as the display content, the search results that have the same text data 42 as the text data TD of the meta information Me. This determination of the display content is a determination of the target of the display content, and is an example of a determination of whether to accept or reject a candidate for the display content.

[0078] Next, consider a case where the meta information Me includes the degree of damage. The display content determination unit 54 can determine to display statistical information (the percentage of the degree of damage) included in the search results as information related to the meta information. That is, the statistical information included in the text data 42 is to be displayed in addition to the search results (image data 43). To add another display content, the display content determination unit 54 can determine to hide the display content that is already displayed. This determination of display content is an example of determining the display content to be hidden and the other display content to be displayed.

[0079] Next, there is a case where the meta information Me includes the type of damage (cracks, free lime, etc.) or the degree of damage (size, depth, etc.). The display content determination unit 54 can determine whether to enlarge, reduce, zoom in, or zoom out the image data 43, taking into account the type and degree of damage and the imaging range of the search result image data 43. This determination of the display content is an example of determining the display content based on the search result.

[0080] Next, consider a case where the meta information Me includes an image data ID. The display content determination unit 54 can determine the display content of the search results in descending order of relevance based on the relevance between the image data ID and the image data 43. This determination of the display content is an example of determining the priority of the display content.

[0081] <Step of Outputting Display Content> In the step of outputting display content (step S5), the output unit 55 displays the determined display content on the display device 30 via the display control unit 26. Although the example has been given in which the output unit 55 displays the display content on the display device 30, the output unit 55 can output the determined display content to a printing device, and can also output it as electronic data in various data formats.

[0082] Next, examples of the display contents displayed on the display device 30 will be described below with reference to FIGS.

[0083] 9 shows an example of a display screen 200 displayed by the display device 30. The display screen 200 includes the display content determined in step S4. The configuration of the display screen 200 is basically the same as that of the display screen 100 shown in FIG. 8, but the display screen 200 highlights image data 43 including text data 42 that is the same as the text data TD of the meta information Me.

[0084] On the display screen 200, the text data 42 is displayed below the image data 43, and the corresponding image data 43 is surrounded by a thick frame. Because the image data 43 is surrounded by a thick frame, the user can easily recognize the corresponding image data 43. Although a thick frame is used as a highlighting display in Fig. 9, the highlighting display is not limited to this, and the color of the text data 42, the thickness of the characters, or flashing may also be used.

[0085] Fig. 10 shows an example of a display screen 202 displayed by the display device 30. The configuration of the display screen 202 is basically the same as that of the display screen 100 shown in Fig. 8, but only image data 43 including text data 42 that is the same as the text data TD of the meta information Me is displayed on the display screen 202. In other words, the display screen 202 in Fig. 10 is an example of a decision on whether to accept or reject candidates for display content.

[0086] FIG. 11 shows an example of a display screen 204 displayed by the display device 30. The configuration of the display screen 204 is basically the same as that of the display screen 100 shown in FIG. 8 , but the image data 43 is enlarged on the display screen 204 based on the text data TD of the meta information Me. For example, if the text data TD includes the type of damage or the degree of damage, the image data 43 is enlarged so that the user can easily visually recognize the type of damage or the degree of damage. The image data 43 may be zoomed in as needed. Alternatively, the image data 43 may be reduced or zoomed out so that the user can easily visually recognize it. In FIG. 11 , the text data TD including the type of damage or the degree of damage is displayed below the image data 43. The user can easily identify the areas of interest in the search results.

[0087] FIG. 12 shows an example of a display screen 206 displayed by the display device 30. The configuration of the display screen 206 is basically the same as that of the display screen 100 shown in FIG. 8 , but on the display screen 206, the image data 43 are sorted in descending order of relevance to the image data ID of the meta information Me. Furthermore, only the top six image data 43 with the highest relevance to the image data ID are displayed. This determination of the display content is an example of determining the priority of the display content. The configuration of the display screen 206 is not particularly limited. For example, the image data 43 may be sorted in descending order of relevance, and only the top six image data 43 may be highlighted. The user can easily make a judgment from the search results performed based on the search query.

[0088] <Others> In the above embodiment, the hardware structure of the processing unit that executes various processes is the following various processors: The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), such as an FPGA (Field Programmable Gate Array), whose circuit configuration can be changed after manufacture, and a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing specific processes.

[0089] A single processing unit may be configured with one of these various processors, or may be configured with two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). Furthermore, multiple processing units can be configured with a single processor. Examples of multiple processing units configured with a single processor include: a first configuration, as typified by client or server computers, in which a single processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units; a second configuration, as typified by system-on-chip (SoC), in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip; and a hardware configuration, in which the various processing units are configured with one or more of the above-mentioned various processors.

[0090] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit made up of a combination of circuit elements such as semiconductor elements.

[0091] The above-described configurations and functions can be realized by any hardware, software, or a combination of both. For example, the present invention can be applied to a program that causes a computer to execute the above-described processing steps (processing procedures), a computer-readable storage medium (non-transitory storage medium) that stores such a program, or a computer on which such a program can be installed.

[0092] Although examples of the present invention have been described above, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the present invention.

[0093] REFERENCE SIGNS LIST 1 Structure 3 Camera 5 Portable terminal 10 Information processing device 12 Input / output interface 16 Storage unit 18 Operation unit 20 CPU 22 RAM 24 ROM 26 Display control unit 30 Display device 40 Database 41 Inspection data 42 Text data 43 Image data 51 Search query acquisition unit 52 Search result acquisition unit 53 Meta information acquisition unit 54 Display content determination unit 55 Output unit 100 Display screen 102 Input display screen 104 Result display screen 106 Type area 107 Type area 108 Execute button 200 Display screen 202 Display screen 204 Display screen 206 Display screen ID Image data TD Text data Me Meta information Qu Search query

Claims

1. An information processing device including a processor, The processor, Get the search query, obtaining a search result based on the search query from a database; obtaining meta information of the search query; determining display content based on the meta information; outputting the display content, the search query, and the meta information; Information processing device.

2. The information processing device according to claim 1 , wherein the processor determines the display content based on the search results.

3. The processor outputs the display content.