Search device, search method, and information processing system

Abstract

To provide a highly user-friendly retrieval device, a retrieval method, and an information processing system that can retrieve image data based on three-dimensional information of a retrieval target.SOLUTION: A retrieval device 1 outputs retrieval results in response to retrieval requests, and comprises: an image data registration unit 12 which vectorizes features based on characteristics of image data for registering the same in a retrieval database 13; and an image retrieval unit 16 which vectorizes features based on characteristics extracted from three-dimensional information of a retrieval target 2 for generating a retrieval request, and retrieves image data in the retrieval database using the generated retrieval request.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a search device, a search method, and an information processing system. [Background technology]

[0002] For example, a company that owns manufacturing equipment such as machine tools may search for drawings similar to those requested by a customer among the drawings it possesses, and create an estimate based on the found drawing. For this reason, a device that searches for drawings similar to those requested by a customer has been proposed (Patent Document 1). Furthermore, a device has also been proposed that iconizes component drawing areas corresponding to keywords specified by the user and places them in a virtual space to provide the user with search clues (Patent Document 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-55219 [Patent Document 2] Japanese Patent Application Laid-Open No. 2004-30122 Summary of the Invention [Problem to be solved by the invention]

[0004] The technology described in Patent Document 1 allows a search for similar company drawings from a 3D or plan view provided by a customer, but is inconvenient to use because it does not support data other than drawings.The technology described in Patent Document 2 requires the user to specify an appropriate key image, which is inconvenient to use.

[0005] The present invention has been made in consideration of the above problems, and its purpose is to provide a highly user-friendly search device, search method, and information processing system that can search image data based on three-dimensional information of the search target. [Means for solving the problem]

[0006] In order to solve the above problem, a search device according to one aspect of the present invention is a search device that outputs search results in response to a search request, and includes an image data registration unit that vectorizes feature quantities based on the characteristics of image data and registers them in a search database, and an image search unit that vectorizes feature quantities based on characteristics extracted from three-dimensional information of the object to be searched to generate a search request, and searches the search database using the generated search request. [Effects of the Invention]

[0007] According to the present invention, it is possible to search for image data registered in a search database based on three-dimensional information of a search target object. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is an overall configuration diagram of a search system. [Figure 2] FIG. 2 is a hardware configuration diagram of the search system. [Figure 3] This is a conceptual diagram showing how various search requests are input into the search system to search for similar product drawings. [Figure 4] FIG. 10 is an explanatory diagram showing how features of a search object are extracted from three-dimensional data of the search object. [Figure 5] FIG. 10 is an explanatory diagram showing how features appear differently depending on the viewpoint. [Figure 6] This is an explanatory diagram showing how the same search object is imaged from multiple viewpoints, the difference in feature amount between each image and image data in a database is calculated as a distance based on the features of each image, and the search results are output in order of shortest distance. [Figure 7] FIG. 10 is a sequence diagram showing the flow of processing in the search system. [Figure 8] FIG. 10 is an explanatory diagram of an information processing system according to a second embodiment. [Figure 9] FIG. 10 is an explanatory diagram of a search system according to a third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] An embodiment of the present invention will be described below with reference to the accompanying drawings. In this embodiment, drawing data such as plan views or three-dimensional views is used as an example of "image data." Feature quantities based on the characteristics of the drawing data are calculated, vectorized, and registered in a search database. A search target is an object for which drawing data similar to its shape is sought. Examples of the object include various products or product models. Products may be prototypes, custom products, or mass-produced products. Product models may include exterior models, miniatures, and samples. Products include finished products and parts. Three-dimensional information about the search target is acquired using a three-dimensional information acquisition device, such as SfM (Structure from Motion), MVS (Multi-View Stereo), or LiDAR (Light Detection and Ranging). Features are extracted from the acquired three-dimensional information, feature quantities are calculated, and the calculated feature quantities are vectorized. Drawing data similar to the search target is retrieved by searching the search database using a search request based on the three-dimensional information of the search target.

[0010] The device for acquiring three-dimensional information of an object (search target) may be a portable device, or may be a device that is difficult to carry and is installed in a facility such as a factory or laboratory.

[0011] According to the search device of this embodiment, feature quantities based on the characteristics of drawing data (image data) are vectorized and registered in a search database in advance. When searching for drawing data related to a search target, three-dimensional information is acquired about the search target itself or a model of the search target. Then, the search database is searched using a search request based on the acquired three-dimensional information. Therefore, even if drawing data for the search target does not exist or only a model of the search target is available, drawing data similar to the search target can be searched. Furthermore, by linking the drawing data with a manufacturing device capable of manufacturing an object represented by the drawing data, it is possible to easily identify the manufacturing device capable of manufacturing the search target, and to calculate an estimate for manufacturing the object (product) related to the search target using the identified manufacturing device. [Example]

[0012] A first embodiment will be described with reference to FIGS. 1 to 7. FIG. 1 is an overall configuration diagram of a search system 1 as an example of a "search device." In this embodiment, a case where drawing data previously registered in a search database is searched for by a search request based on three-dimensional information about the search target is described. In the following, a user terminal U1 used by a user who registers drawing data in the search system 1 and a user terminal U2 used by a user who searches for drawing data similar to the search target are described as separate terminals, but the user terminal U1 and the user terminal U2 may be the same. In other words, the user who registers drawing data and the user who searches for drawing data similar to the search target may belong to the same organization. Hereinafter, the user terminal U1 that registers drawing data in the search system 1 may be referred to as the registration user terminal U1, and the user terminal U2 used to search for registered drawing data may be referred to as the search user terminal U2.

[0013] The search system 1 includes, for example, an image data collection unit 11, an image data registration unit 12, an index database 13, a project information database 14, a three-dimensional information reception unit 15, and an image search unit 16. The image data collection unit 11 and the image data registration unit 12 are responsible for indexing the drawing data. The three-dimensional information reception unit 15 and the image search unit 16 are responsible for searching the indexed drawing data.

[0014] The image data collection unit 11 collects drawing data as "image data." The image data collection unit 11 collects drawing data as image data from a web server 111 or a file server 112. A person who registers drawing data can use a registration user terminal U1 to send the drawing data to the image data collection unit 11 via the web server 111. For example, the person who registers the drawing data may input image data obtained by photographing the drawing data from the web server 111 to the image data collection unit 11. The drawing data may also be input to the image data collection unit 11 via a file server 112 connected to a CAD (Computer Aided Design) system (not shown), for example.

[0015] The image data registration unit 12 extracts feature quantities from the image data collected by the image data collection unit 11 using a feature point extraction unit 121, vectorizes the extracted feature quantities using a vectorization processing unit 122, and registers the vectorized quantities in an index database 13. The image data registration unit 12 registers project information including drawing data, information on manufacturing equipment capable of manufacturing an object shown in the drawing data, a parts list, a cost list, etc., in a project information database 14.

[0016] The index database 13 is an example of a "search database." As described above, the index database 13 stores drawing data DW (see FIG. 3) of products (search objects, objects) that can be manufactured by the manufacturing equipment 3 (see FIG. 3) indexed based on feature quantities. The project information database 14 stores information related to the manufacture and sale of products indicated by the drawing data. The information related to the manufacture and sale of products includes, for example, a parts list, a materials list, a cost list, a sales price, and a delivery date.

[0017] The three-dimensional information receiving unit 15 receives three-dimensional information of the search object 2 as an image that serves as the basis for the search. The three-dimensional information of the search object 2 can be generated using a device that acquires three-dimensional information of an object. Known technologies used in such devices include, for example, SfM (Structure From Motion), MVS (Multi-View Stereo), and LiDAR (Light Detection And Ranging).

[0018] The device for acquiring three-dimensional information of an object may be built into the searching user terminal U2 or may be connected to the searching user terminal U2. The three-dimensional information of the search object 2 can be input from the user terminal U2 to the three-dimensional information accepting unit 15. Alternatively, if the creator of the search object 2 (e.g., the end user) is provided with a device for creating three-dimensional information of an object, the creator of the search object 2 can acquire the three-dimensional information of the search object 2, fix the acquired three-dimensional information on a storage medium, bring it into the search system 1, and input it to the three-dimensional information accepting unit 15. As in an embodiment described later, the three-dimensional information of the search object 2 can also be input to the three-dimensional information accepting unit 15 via the Internet.

[0019] The image search unit 16 generates a search request based on the three-dimensional information of the search object 2, and searches the index database 13 to extract drawing data similar to the search object 2. The image search unit 16 includes, for example, a 3D preprocessing unit 161, an image preprocessing unit 162, and a search unit 163.

[0020] The 3D preprocessing unit 161 performs preprocessing of three-dimensional information. The 3D preprocessing unit 161 includes, for example, an opacity processing unit 1611 and a multi-viewpoint processing unit 1612. Hereinafter, the opacity processing unit 1611 may be abbreviated as opacity 1611, and the multi-viewpoint processing unit 1612 may be abbreviated as multi-viewpoint 1612.

[0021] The opacity processing unit 1611 performs opacity processing so that only the surface seen from the viewpoint is displayed among the three-dimensional information of the search object 2. In other words, the three-dimensional information that has been subjected to the opacity processing cannot show the point cloud inside or behind it.

[0022] The multi-viewpoint processor 1612 generates an image when the opaque-processed three-dimensional information is viewed from a plurality of viewpoints. Examples of processing by the opaque processor 1611 and the multi-viewpoint processor 1612 will be described later.

[0023] The image preprocessing unit 162 preprocesses the image data processed by the 3D preprocessing unit 161 in order to generate a search request. The image preprocessing includes, for example, a process of extracting feature points and a process of vectorizing the extracted feature points. By extracting feature points from the three-dimensional information of the search object 2 and vectorizing the feature points, it is possible to search for vectorized drawing data in the index database 13.

[0024] The search unit 163 generates a search request based on the vectorized data and searches the index database 13. The search results for the drawing data are sent to the searching user terminal U2 together with related information read from the project information database 14.

[0025] 2 is a diagram showing the hardware configuration of the search system 1. The search system 1 can be generated using a single computer 1000. Alternatively, the search system 1 can be generated by linking a plurality of computers.

[0026] The computer 1000 includes, for example, a processor 1100, a memory 1200, an auxiliary storage device 1300, a communication unit 1400, and a user interface unit 1500. In the figure, the user interface is abbreviated as UI.

[0027] The processor 1100 executes a computer program stored in the auxiliary storage device 1300 to realize each function of the search system 1. The processor 1100 is not limited to a CPU (Central Processing Unit) and may include a GPU (Graphics Processing Unit) or an ASIC (Application Specific Integrated Circuit), etc.

[0028] The memory 1200 includes a random access memory (RAM) and a read only memory (ROM).

[0029] The communication unit 1400 is a device for communicating with user terminals U1 and U2 and other systems not shown in the figure via a communication network CN. Examples of other systems not shown in the figure include a design support system, a production management system, a sales management system, an estimate creation system, and a document management system. The type of communication network CN does not matter. The communication network CN may be a public line or a dedicated line.

[0030] The user interface unit 1500 is a device for exchanging information between users of the search system 1 (registerers of drawing data, searchers of drawing data) and the search system 1. The user interface unit 1500 can be equipped with an information input device and an information output device (neither of which are shown). Examples of information input devices include keyboards, voice input devices, pointing devices, and touch panels. Examples of information output devices include monitor displays, printers, and synthesized voice output devices. Technologies such as virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR) may be used to exchange information between the user and the search system 1.

[0031] The auxiliary storage device 1300 is a relatively large-capacity storage device such as a semiconductor memory device, a hard disk device, an optical disk device, or a magnetic tape device. The auxiliary storage device 1300 stores predetermined computer programs for implementing the functions of the image data collection unit 11, the image data registration unit 12, the three-dimensional information reception unit 15, and the image search unit 16. The auxiliary storage device 1300 can also store an index database 13 and a project information database 14. These databases 13 and 14 may be located in a computer not shown.

[0032] The search system 1 can be connected to a storage medium MM. The storage medium MM is configured as, for example, a memory device, a hard disk device, an optical disk device, a magneto-optical disk device, a magnetic tape device, or the like, and non-temporarily stores computer programs and data. The storage medium MM can transfer and store computer programs and data to the auxiliary storage device 1300 of the search system 1. Computer programs and data can also be transferred and stored from the auxiliary storage device 1300 to the storage medium MM. A computer program that realizes the functions of the search system 1 can be stored in the storage medium MM, and by connecting the storage medium MM to another computer and installing the computer program stored in the storage medium MM on the other computer, the other computer can function as the search system 1.

[0033] FIG. 3 is a conceptual diagram showing how various search requests are input to the search system 1 to search for drawing data similar to a search object 2.

[0034] As described above, the index database 13 has the drawing data DW of the products that can be manufactured by the manufacturing equipment 3 registered in advance.

[0035] The manufacturing equipment 3 is, for example, a processing or production equipment such as an injection molding machine, an NC processing machine, or an electric discharge machine. The manufacturing equipment 3 is used to manufacture finished products or parts thereof such as automobiles, trains, aircraft, ships, robots, home appliances, and transportation equipment. The manufacturing equipment 3 can be used in any industry. The multiple manufacturing equipment 3(1) to 3(n) shown in the drawing will be referred to as manufacturing equipment 3 unless otherwise specified.

[0036] The three-dimensional information receiving unit 15 receives three-dimensional information of the search object 2, such as paper drawings, digitalized drawings, samples such as specimens and models, photographs, point cloud data, etc. The image search unit 16 extracts features from the three-dimensional information received by the three-dimensional information receiving unit 15 and generates vectorized data from them. The searched product drawing data is then transmitted to the user terminal U2, which is the source of the search, along with information obtained from the project information database 14. The project information database 14 is not shown in FIG. 3.

[0037] FIG. 4 is an explanatory diagram showing how features of the search object 2 are extracted from three-dimensional information 21 of the search object 2. In the upper part of FIG. 4, point cloud data of the search object 2 is shown as three-dimensional information 21. The three-dimensional information 21 of the search object 2 has, for example, a chair-like shape, with a protrusion 211 formed on the underside of the backrest. The three-dimensional information 21 includes many features, such as intersections. The protrusion 211 is shown as one of these features.

[0038] An opaque 3D image 22 is displayed at the bottom of Fig. 4. In the 3D image 22 as well, a protrusion 221 is formed on the underside of the backrest.

[0039] FIG. 5 is an explanatory diagram showing how features appear differently depending on the viewpoint. The lower left side of FIG. 5 shows a 3D image 22(3) of the search object 2 viewed from the back. The lower right side of FIG. 5 shows a 3D image 22(1) of the search object 2 viewed from the right side. As shown in the rear image 22(3), protrusions 221L and 221R protrude from the left and right sides of the underside of the backrest. However, in the image 22(1) viewed from the right side, the protrusion 221R blends into the background and is difficult to distinguish. Thus, even for the same 3D information 21 of the search object 2, the appearance of the features varies depending on the viewing angle. Therefore, in this embodiment, the features of the search object 2 are captured from multiple viewpoints and vectorized, enabling the search for similar drawing data from registered drawing data.

[0040] 6 is an explanatory diagram showing how the same search object 2 is imaged from multiple viewpoints, the distance between each image 22 and the image data (drawing data) in the index database 13 is calculated based on the characteristics of each image 22, and the search results are output in order of shortest distance. Here, 3D images viewed from a total of four viewpoints are shown: right side image 22(1), left side image 22(2), back image 22(3), and front image 22(4). In addition, top and bottom images (neither of which are shown) can also be added.

[0041] In addition to the images 22 from predetermined viewpoints such as front, back, up, down, left and right, or in place of all or some of the images 22 from predetermined viewpoints, images 22 from any viewpoint may be used. A searcher operating the search user terminal U2 can also generate the image 22 from an angle that best shows the characteristics of the search object 2.

[0042] 6 shows the relationship between an image 22 of the search object 2 and image data (drawing data) that resembles the image 22 among the image data registered in the index database 13. In the center of FIG.

[0043] For example, when focusing on the right side image 22(1) of the search object 2, image data (drawing data) DW11, DW12, and DW13 similar to the right side image 22(1) are extracted. The distances indicating the similarity between the right side image 22(1) and the similar image data DW11, DW12, and DW13 are d11, d12, and d13.

[0044] Similarly, image data DW21, DW22, and DW23 similar to the left side image 22(2) are extracted for the left side image 22(2) of the search object 2. Distances indicating the similarity between the left side image 22(2) and the similar image data DW21, DW22, and DW23 are d21, d22, and d23.

[0045] Similarly, when attention is focused on the rear image 22(3) of the search object 2, image data DW31, DW32, and DW33 similar to the rear image 22(3) are extracted. The distances indicating the similarity between the rear image 22(3) and the similar image data DW31, DW32, and DW33 are d31, d32, and d33.

[0046] Focusing on the left side image 22(2) of the search object 2, image data DW41, DW42, and DW43 similar to the front image 22(4) are extracted. The distances indicating the similarity between the front image 22(4) and the similar image data DW41, DW42, and DW43 are d41, d42, and d43.

[0047] A search request is generated for each of the images 22(1) to 22(4) obtained from the multiple viewpoints, and the index database 13 is searched. Then, for each of the multiple viewpoints, an image DW similar to the search object 2 is extracted. The image search unit 16 extracts similar images that are close in distance (similar images with high similarity) from the results of the similar images simultaneously searched from the multiple viewpoints, and provides them to the searching user terminal U2.

[0048] 7 is a sequence diagram showing the processing of the search system 1. First, image data registration processing S1 to S7 is performed to register image data (drawing data) in the index database 13. Next, image search processing S11 to S17 is performed to search the index database 13 based on three-dimensional information of the search target object 2.

[0049] In the image data registration process, the registration user terminal U1 instructs the image data registration unit 12 to register image data (drawing data) via the image data collection unit 11 (S1). The feature point extraction unit 121 of the image data registration unit 12 extracts feature points contained in the image data and calculates feature quantities (S2). The vectorization processing unit 122 converts the calculated feature quantities into n-dimensional vector data (S3) and generates an index (S4).

[0050] The image data registration unit 12 registers the generated index in the index database 13 (S5). The image data registration unit 12 links the image data registered in the index database 13 with information in the project information database 14 related to this image data (S6), and stores the information in the project information database 14 (S7).

[0051] In the image search process, a search instruction is input from the searching user terminal U2 to the image search unit 16 via the three-dimensional information receiving unit 15 (S11). This search instruction includes three-dimensional information of the object 2 to be searched.

[0052] The searching user terminal U2 can also indicate to the image search unit 16 important features of the search object 2. For example, the searching user terminal U2 can mark the most distinctive part of the three-dimensional information of the search object 2, thereby notifying the image search unit 16 that the feature is important.

[0053] The image search unit 16 can set the priority of search results for a search request from a viewpoint including a feature with high importance among multiple viewpoints higher than the priority of search results for other viewpoints, and output the search results according to the similarity and priority. The searching user terminal U2 may instruct the image search unit 16 to search without specifying the important features.

[0054] The 3D preprocessing unit 161 of the image search unit 16 performs 3D preprocessing, such as opacity processing and multi-viewpoint extraction processing, on the three-dimensional information of the search target object 2 (S12). The image preprocessing unit 162 of the image search unit 16 extracts feature points from the 3D preprocessed image, calculates feature amounts of the extracted feature points (S13), and generates n-dimensional vector data from the calculated feature amounts (S14). Note that when generating the vector data, the image preprocessing unit 162 may set a high priority to feature amounts with high importance (feature amounts of feature points with high importance).

[0055] The search unit 163 generates a search request based on the vectorized data and searches for image data registered in the index database 13 (S15).

[0056] When the image search unit 16 obtains the search results from the index database 13, it obtains information related to the search results from the project information database 14 (S16). The image search unit 16 associates the search results from the index database 13 with the related information obtained from the project information database 14, transmits them to the searching user terminal U2, and presents them to the user (S17).

[0057] According to the search system 1 of this embodiment configured as described above, when searching for drawing data related to the search object 2, three-dimensional information is acquired about the search object itself or a model of the search object, and a search request based on the acquired three-dimensional information is used to search the index database 13. Therefore, even if there is no drawing data of the search object 2 or if there is only a model of the search object 2, it is possible to search for image data (drawing data) similar to the search object 2.

[0058] In the search system 1 of this embodiment, a search request is generated for each image of the search object 2 viewed from multiple viewpoints, and the multiple search requests are used simultaneously to search the index database 13. Therefore, the search system 1 can search the index database 13 by capturing the characteristics (feature points) of the search object 2, and can find image data similar to the search object 2.

[0059] The search system 1 of this embodiment can easily identify a manufacturing device 3 capable of manufacturing the search object 2 by linking the manufacturing device capable of manufacturing the object indicated by the drawing data with the drawing data. Therefore, the search system 1 can also calculate an estimate for manufacturing the object (product) related to the search object using the identified manufacturing device 3.

[0060] The search system 1 of this embodiment can clearly indicate important feature points when three-dimensional information of a search target object 2 is input into the search system 1. Therefore, the search system 1 can search for image data (drawing data) that are similar based on important feature points. This makes it possible to search the index database 13 with an emphasis on key manufacturing aspects (such as how to handle cutting tools, how easy it is to remove a mold, and how easy it is to inject molten resin), further improving usability for users looking for drawing data. [Example]

[0061] Second Embodiment A second embodiment will be described with reference to Fig. 8. In the following embodiments including this embodiment, the differences from the first embodiment will be mainly described. Fig. 8 is an explanatory diagram of an information processing system according to the second embodiment.

[0062] The search system 1A of this embodiment is connected to an embedded system 4. In other words, the search system 1A is used as one of the functions of the embedded system 4. The embedded system 4 is, for example, a sales support system, an estimate creation support system, a production management system, a design support system, etc.

[0063] This embodiment configured in this manner also achieves the same effects as those of embodiment 1. Since the search system 1A of this embodiment is incorporated as one of the functions of the embedded system 4, the convenience of the embedded system 4 can be improved. [Example]

[0064] 9 is an explanatory diagram of a search system 1B according to Example 3. The search system 1B of this example further includes an external publication unit 17 in addition to the configuration of the search system 1 described in Example 1.

[0065] The external publishing unit 17 has a function for publishing the search system 1B on the communication network CN. For example, the registration user terminal U1 and the search user terminal U2 can access the search system 1B via the communication network CN and register image data (drawing data) in the search system 1B or retrieve image data similar to the search target 2 from the search system 1B. The search system 1B may be made public 24 hours a day, 365 days a year via the external publishing unit 17. This improves user convenience.

[0066] Furthermore, in the search system 1B of this embodiment, the material providing unit 181 and the estimating unit 182 are connected to the project information database 14. The material providing unit 181 provides materials such as catalogs, explanatory videos, and specifications of the manufacturing equipment 3 to the project information database 14. The estimating unit 182 creates or assists in the creation of an estimate when the manufacturing equipment 3 manufactures an object shown in the drawing data.

[0067] This embodiment configured as described above also achieves the same effects as those of the embodiment 1. The search system 1B of this embodiment is made public on the communication network CN through the external publication unit 17, improving usability for users. Furthermore, in this embodiment, document data and estimates for the manufacturing equipment 3 related to the drawing data can be provided to the search user terminal U2, improving convenience for the user who is the searcher.

[0068] The present invention is not limited to the above-described embodiments and includes various modifications. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and are not necessarily limited to those including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of each embodiment with the configuration of another embodiment. Furthermore, each embodiment can be combined as appropriate unless there is an obvious contradiction.

[0069] In this embodiment, the apparatus or method described below is clearly described in an operable manner.

[0070] (Representation 1) A search device that outputs search results in response to a search request, comprising: an image data registration unit that vectorizes feature quantities based on the characteristics of image data and registers them in a search database; and an image search unit that vectorizes feature quantities based on characteristics extracted from three-dimensional information of a search target object to generate a search request, and searches the search database using the generated search request.

[0071] (Representation 2) The image search unit creates search requests corresponding to images of three-dimensional information of the search object viewed from multiple viewpoints, and searches the search database using the search requests for each of the multiple viewpoints. This is the search device described in Representation 1.

[0072] (Representation 3) The image search unit performs opacity processing on the three-dimensional information of the search object, creates search requests corresponding to images of the opacified three-dimensional information of the search object viewed from the multiple viewpoints, and searches the search database using the search requests for each of the multiple viewpoints.

[0073] (Representation 4) A search device according to any one of Representations 1-3, wherein the image search unit outputs the search results for each of the plurality of search requests according to the similarity between the search results and the three-dimensional information of the search target.

[0074] (Representation 5) A search device described in any one of Representations 1-4, wherein the image search unit sets the priority of search results for search requests from a viewpoint including a feature of high importance among the multiple viewpoints higher than the priority of search results for other viewpoints, and outputs the search results according to the similarity and the priority.

[0075] (Representation 6) A search device according to any one of Representations 1-5, wherein the three-dimensional information of the object to be searched is generated using a three-dimensional information acquisition method for acquiring three-dimensional information.

[0076] (Representation 7) A search device according to any one of Representations 1 to 6, wherein the search object is a physical sample of an object.

[0077] (Representation 8) A search device according to any one of Representations 1 to 7, wherein the image data registered in the search database is two-dimensional image data.

[0078] (Representation 9) A search device according to any one of Representations 1-8, wherein the image data registered in the search database is associated with a manufacturing device capable of manufacturing an object related to the image data.

[0079] (Representation 10) A search method for outputting search results in response to a search request from a search device, the search method comprising: an image data registration step for vectorizing features based on the characteristics of image data and registering the vectorized features in a search database; and an image search step for vectorizing features based on characteristics extracted from three-dimensional information of a search target object to generate a search request, and searching the search database using the generated search request.

[0080] (Representation 11) An information processing system comprising a search device according to any one of Representations 1-9, which outputs information regarding the production or sales of the search object based on the search results output by the search device. [Explanation of symbols]

[0081] 1, 1A, 1B: Search system, 2: Search object, 3: Manufacturing equipment, 4: Embedded system, 11: Image data collection unit, 12: Image data registration unit, 13: Index database, 14: Project information database, 15: Three-dimensional information reception unit, 16: Image search unit, U1: User terminal for registration, U2: User terminal for search

Claims

1. A search device that outputs search results in response to a search request, an image data registration unit that vectorizes feature quantities based on the features of the image data and registers the vectorized feature quantities in a search database; an image search unit that generates a search request by vectorizing a feature quantity based on features extracted from three-dimensional information of a search target object, and searches the search database using the generated search request; the image search unit creates the search requests corresponding to images of three-dimensional information of the search object viewed from a plurality of viewpoints, and searches the search database using the search requests for each of the plurality of viewpoints; a degree of similarity between the search results for the search requests for each of the plurality of viewpoints and the three-dimensional information of the search object; a priority set so that a search result for a search request from a viewpoint including a feature quantity with high importance among the plurality of viewpoints is higher than a search result for other viewpoints; and outputting the search results according to the Search device.

2. The search device described in claim 1, wherein the image search unit performs opacity processing on the three-dimensional information of the search object, creates search requests corresponding to images of the opacified three-dimensional information of the search object viewed from the multiple viewpoints, and searches the search database using the search requests for each of the multiple viewpoints.

3. The three-dimensional information of the search object is generated using a three-dimensional information acquisition method for acquiring three-dimensional information. The search device according to claim 1 .

4. The search object is a physical specimen of an object. The search device according to claim 3 .

5. The image data registered in the search database is two-dimensional image data. The search device according to claim 4.

6. The image data registered in the search database is associated with a manufacturing device capable of manufacturing an object related to the image data. The search device according to claim 5 .

7. A search method for outputting search results in response to a search request from a search device, comprising: The search device includes: an image data registration step of vectorizing feature quantities based on the features of the image data and registering the vectorized feature quantities in a search database; an image search step of vectorizing feature quantities based on features extracted from the three-dimensional information of the object to be searched to generate a search request, and searching the search database using the generated search request; the image search step generates the search requests corresponding to images of three-dimensional information of the search object viewed from a plurality of viewpoints, and searches the search database using the search requests for each of the plurality of viewpoints; a degree of similarity between the search results for the search requests for each of the plurality of viewpoints and the three-dimensional information of the search object; a priority set so that a search result for a search request from a viewpoint including a feature quantity with high importance among the plurality of viewpoints is higher than a search result for other viewpoints; The search results are output in accordance with the How to search.

8. An information processing system comprising the search device according to any one of claims 1 to 6, Based on the search results output by the search device, information relating to the production or sales of the search object is output. Information processing system.

Images