Support device, support system, terminal device, support program, and method

Abstract

To improve convenience in exchanging products installed in an architectural structure.SOLUTION: A support device 10 includes a specific information acquisition unit 22 for acquiring specific information to specify use feelings of products installed in an architectural structure, a specification unit 24 for specifying the use feelings of the products on the basis of the specific information, and an extraction unit 25 for extracting candidates for exchange products to be recommended for exchange of all or a part of the products from a storage device storing the candidates for the plurality of products on the basis of the specification results.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to a technology for assisting in the replacement of some or all of the goods installed in a building.

Background Art

[0002] Various technologies for assisting in the renovation of houses have been proposed. For example, Non-Patent Document 1 discloses a house renovation support system in which a user selects goods and replacement contents, transmits a photograph of the goods installed in the house, and requests an estimate of the cost required for the replacement of the goods.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When selecting goods, the user may not know which goods to select. Therefore, there is a need for a technology that provides appropriate information to users considering the replacement of goods and assists in the replacement of goods.

[0005] In view of the above, an object of the present disclosure is to provide a technology that improves the convenience when replacing goods installed in a building.

Means for Solving the Problems

[0006] To solve the above problems, a support device according to an aspect of the present disclosure includes a specific information acquisition unit that acquires specific information for specifying the usability of a product installed in a building, a specific unit that specifies the usability of the product based on the specific information, and an extraction unit that extracts, based on the specific result, candidates for replacement products recommended for replacement of all or part of the product from a storage device storing candidates for a plurality of products.

[0007] A support system according to another aspect of the present disclosure includes a support device that supports replacement of part or all of a product installed in a building, and a terminal device that communicates with the support device. The support device includes a specific information acquisition unit that acquires specific information for specifying the usability of a product installed in a building, a specific unit that specifies the usability of the product based on the specific information, and an extraction unit that extracts, based on the specific result, candidates for replacement products recommended for replacement of all or part of the product from a storage device storing candidates for a plurality of products. The terminal device includes a specific information transmission unit that transmits the specific information, and a presentation unit that presents the candidates extracted by the extraction unit.

[0008] A terminal device according to still another aspect of the present disclosure is a terminal device that communicates with a support device, and includes a specific information acquisition unit that acquires specific information for specifying the usability of a product installed in a building, a specific unit that specifies the usability of the product based on the specific information, and an extraction unit that extracts, based on the specific result, candidates for replacement products recommended for replacement of all or part of the product from a storage device storing candidates for a plurality of products. The terminal device includes a specific information transmission unit that transmits the specific information to the support device, and a presentation unit that presents the candidates extracted by the extraction unit of the support device.

[0009] A support program according to still another aspect of the present disclosure causes a computer to execute acquiring specific information for specifying the usability of a product installed in a building, specifying the usability of the product based on the specific information, and extracting, based on the specific result, candidates for replacement products recommended for replacement of all or part of the product from a storage device storing candidates for a plurality of products.

[0010] Another aspect of the present disclosure is a method including obtaining specific information for specifying the usability of a product installed in a building, specifying the usability of the product based on the specific information, and extracting, based on the specific result, candidates for replacement products recommended for all or part of the product from a storage device storing candidates for a plurality of products.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Embodiments for Carrying Out the Invention

[0012] Hereinafter, preferred embodiments will be described with reference to the drawings. The same or equivalent components, members, and processes shown in each drawing are denoted by the same reference numerals, and redundant explanations will be omitted as appropriate. The embodiments are examples, and all features and combinations thereof described in the embodiments are not necessarily essential to the present disclosure.

[0013] (First Embodiment) In the first embodiment, a technique for assisting in replacing a product (hereinafter also referred to as an "existing product") installed in a building such as a house with another product (hereinafter also referred to as a "replacement product") will be described. Hereinafter, mainly, an example of replacing a faucet device as a product will be described.

[0014] FIG. 1 shows the configuration of the support system 1 according to the first embodiment. The support system 1 includes a support device 10 for supporting the replacement of products installed in a building, a terminal device 50 that communicates with the support device 10, and the Internet 3 which is an example of a communication network connecting them. The terminal device 50 includes an imaging device 60 (see FIG. 3) for imaging an image of a faucet device 4 which is an example of a product installed in the building. The imaging device 60 images an image of the existing faucet device 4 that the user is considering replacing. The imaging device 60 may be provided in the terminal device 50 or may be provided separately from the terminal device 50. In the latter case, the terminal device 50 acquires the captured image from the imaging device 60 by wireless or wired communication or the like.

[0015] The support device 10 identifies the product number of the existing product from a captured image of the existing product (hereinafter sometimes referred to as a product image), and acquires information on the product with that product number from the information providing server 2.

[0016] The information providing server 2 provides information on products such as faucet devices, toilet devices, kitchens, bathtubs, washbasins, etc. that can be installed in buildings such as houses. The support device 10 and the information providing server 2 are connected via the communication network 3. The support device 10 and the information providing server 2 may transmit and receive data using a communication protocol such as HTTP (Hypertext Transfer Protocol). The information providing server 2 may be implemented as a web server. Note that the support device 10 may also be implemented as a web server. In this case, the terminal device 50 may connect to the support device 10 using a browser and have the functions provided by the support device 10.

[0017] FIG. 2 shows the hardware configuration of the support device 10 according to the first embodiment. The support device 10 includes a control device 11, an input interface 12, a display 13, a memory 14, a communication interface 15, and a bus 16 connecting them. The support device 10 may be a device such as a server and a personal computer. The support device 10 may be a portable terminal such as a mobile phone terminal, a smartphone, or a tablet terminal.

[0018] The control device 11 executes the support program of the first embodiment. The input interface 12 transmits the instruction input by the user of the support device 10 to the control device 11. The input interface 12 may be a mouse, a keyboard, a touch pad, or the like. The display 13 displays the screen generated by the control device 11. The display 13 may be a liquid crystal display device, an organic EL display device, or the like. The input interface 12 and the display 13 may be implemented as a touch panel.

[0019] The memory 14 stores programs, data, etc. used by the control device 11. The memory 14 may be a semiconductor memory, a hard disk, or the like. The communication interface 15 controls communication with other devices. The communication interface 15 may communicate by any wired or wireless communication method. The communication interface 15 communicates with the terminal device 50. The communication interface 15 communicates with the information providing server 2 and receives the information provided by the information providing server 2.

[0020] The control device 11 includes a condition acquisition unit 21, a specific information acquisition unit 22, a facility image acquisition unit 23, a specific unit 24, an extraction unit 25, an estimate creation unit 26, an augmented reality (AR) image generation unit 27, a necessity determination unit 28, and an order placement unit 29. These configurations are realized hardware-wise by the CPU, memory, and other LSIs of an arbitrary computer, and software-wise by programs loaded into the memory, etc., but here, functional blocks realized by their cooperation are depicted. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms, such as by hardware alone or a combination of hardware and software.

[0021] The condition acquisition unit 21 acquires, from the terminal device 50, the conditions of the products to be presented as candidates for replacement products. The conditions of the products will be described later.

[0022] The specific information acquisition unit 22 acquires data of the product image from the terminal device 50 and stores it in the memory 14 as specific information. The specific information acquisition unit 22 acquires data of the product number of the existing product from the terminal device 50 and stores it in the memory 14 as specific information. At least one of the data of the product image and the product number constitutes specific information for specifying the usability of the existing product. The usability of the existing product includes at least one of the shape, function, and grade of the product. The usability of the existing product is specified by, for example, but not limited to, at least one of the existing product itself, the shape, function, and grade of the existing product.

[0023] The facility image acquisition unit 23 acquires data of a captured image of the facility used by the existing product (hereinafter referred to as the facility image).

[0024] The specifying unit 24 specifies the usability of the existing product based on the specific information of the existing product. In the present embodiment, the specifying unit 24 indirectly specifies the usability of the existing product by specifying the existing product based on the specific information of the existing product.

[0025] The extraction unit 25 extracts candidates for replacement products recommended for replacement with the existing product. The extraction unit 25 of the present embodiment extracts candidates for replacement products from the information providing server 2 that stores a plurality of candidates for replacement products.

[0026] The estimate creation unit 26 creates an estimate of the cost when replacing the existing product with a replacement product.

[0027] The AR image generation unit 27 generates an AR image when replacing the existing product with a candidate for replacement product.

[0028] The necessity determination unit 28 acquires a determination result as to whether additional work other than the work for installing the candidate is required when replacing the existing product with a candidate for replacement product. In the first embodiment, this determination result is created, for example, by the worker in charge of the additional work and supplied to the necessity determination unit 28 via the input interface 12 of the support device 10.

[0029] The ordering unit 29 performs an ordering process for exchanging an existing product with a replacement product.

[0030] Figure 3 shows the hardware configuration of the terminal device 50 according to the first embodiment. The terminal device 50 includes a control device 51, an input interface 52, a display 53, a memory 54, a communication interface 55, an imaging device 60, and a bus 56 that connects them. The terminal device 50 may be a device such as a personal computer. The terminal device 50 may be a portable terminal such as a mobile phone terminal, a smartphone, or a tablet terminal.

[0031] The control device 51 executes the support program according to the first embodiment. The input interface 52 transmits an instruction input by the user of the terminal device 50 to the control device 51. The input interface 52 may be a mouse, a keyboard, a touch pad, or the like. The display 53 displays a screen generated by the control device 51. The display 53 may be a liquid crystal display device, an organic EL display device, or the like. The input interface 52 and the display 53 may be implemented as a touch panel.

[0032] The memory 54 stores programs, data, etc. used by the control device 51. The memory 54 may be a semiconductor memory, a hard disk, or the like. The communication interface 55 controls communication with other devices. The communication interface 55 may communicate by any wired or wireless communication method. The communication interface 55 communicates with the support device 10 and transmits data of an image captured by the imaging device 60.

[0033] The control device 51 includes a condition transmission unit 61, a facility image transmission unit 62, a specific information transmission unit 63, a presentation unit 64, a replacement product selection unit 65, an estimate request unit 66, an order request unit 67, and a display control unit 68. These configurations can also be realized in various forms, such as only hardware or a combination of hardware and software.

[0034] The condition transmission unit 61 acquires the conditions of the products to be presented as candidates for replacement products from the user via the input interface 52, and transmits them to the support device 10.

[0035] The facility image transmission unit 62 acquires the facility images of the existing products from the imaging device 60, and transmits them to the support device 10.

[0036] The specific information transmission unit 63 acquires the product images from the imaging device 60, and transmits them to the support device 10 as specific information. The specific information transmission unit 63 acquires the product numbers of the existing products from the user via the input interface 52, and transmits them to the support device 10 as specific information.

[0037] The presentation unit 64 presents various information. For example, the presentation unit 64 acquires the information of the products extracted as candidates for replacement products from the support device 10, and displays it on the display 53. For example, the presentation unit 64 acquires the AR images generated by the support device 10 from the support device 10, and displays them on the display 53. For example, the presentation unit 64 acquires the estimates created by the support device 10, and displays them on the display 53.

[0038] The replacement product selection unit 65 receives a selection instruction from the user for a candidate for generating an AR image from among the candidates acquired from the support device 10, and transmits it to the support device 10.

[0039] The estimate request unit 66 receives a selection of a candidate for requesting the creation of an estimate from the user, and transmits a request for creating an estimate to the support device 10.

[0040] The order request unit 67 receives a selection instruction for a replacement product for which an order is requested from the user, and transmits a request for order processing to the support device 10.

[0041] The display control unit 68 controls the display on the display 53 by each function of the terminal device 50.

[0042] FIG. 4 and FIG. 5 are sequence diagrams showing the procedure S100 of the support method executed in the support system 1 according to the first embodiment. For example, the procedure S100 is started by activating a predetermined product replacement support application pre-installed in the terminal device 50.

[0043] In step S10, the presentation unit 64 of the terminal device 50 displays a condition input screen D1 for inputting product conditions. FIG. 6 illustrates the condition input screen D1. The condition input screen D1 is provided with first to sixth selection items 101 to 106 and an item 107 of "Next". The first selection item 101 indicates a condition of "want to pull out the faucet and wash the sink". The second selection item 102 indicates a condition of "want to be touchless". The third selection item 103 indicates a condition of "want a water purification function". The fourth selection item 104 indicates a condition of "want to replace at an affordable price". The fifth selection item 105 indicates a condition of "want to install a dishwasher". The sixth selection item 106 indicates a condition of "want to be equivalent to the existing faucet". The product conditions are not limited to the examples listed on the condition input screen D1 and can be set as appropriate.

[0044] In step S12, the condition transmission unit 61 of the terminal device 50 receives the product conditions input by the user via the condition input screen D1 of FIG. 6. By selecting the first to sixth selection items 101 to 106, the conditions indicated by the selected items can be received and the conditions can be transmitted to the support device 10. By selecting the item 107 of "Next", the process proceeds to a first facility imaging screen D2 described later in FIG. 7.

[0045] In step S14, the presentation unit 64 of the terminal device 50 displays an equipment imaging screen for imaging the equipment used by the existing product. FIG. 7 illustrates a first equipment imaging screen D2 for imaging the space under the sink through which the pipes of the faucet device 4 pass. On the first equipment imaging screen D2, there are an imaging range 108 of the imaging device 60, an item 109 of "imaging" for causing the imaging device 60 to perform imaging, an item 110 of "re-imaging" for causing the imaging device 60 to perform re-imaging, a "photographing example" 111 of the space under the sink, a "photographing location example" 112 illustrating the location of the space under the sink which is the photographing location, and an item 113 of "next". After the space under the sink is imaged on the first equipment imaging screen D2, when the item 113 of "next" is selected, the presentation unit 64 switches the display from the first equipment imaging screen D2 to the second equipment imaging screen D3.

[0046] FIG. 8 illustrates a second equipment imaging screen D3 for imaging the root portion of the faucet device 4. On the second equipment imaging screen D3, there are an imaging range 108 of the imaging device 60, an item 109 of "imaging", an item 110 of "re-imaging", a "photographing example" 114 of the root portion of the faucet device 4, a "photographing location example" 115 illustrating the location of the root portion of the faucet device 4, and an item 113 of "next". After the root portion of the faucet device 4 is imaged on the second equipment imaging screen D3, when the item 113 of "next" is selected, the procedure S100 proceeds to step S16.

[0047] In step S16, the equipment image transmission unit 62 of the terminal device 50 acquires the equipment image obtained by the user imaging the equipment of the existing product using the imaging device 60.

[0048] In step S18, the presentation unit 64 of the terminal device 50 displays a product imaging screen D4 for imaging an existing product. FIG. 9 illustrates the product imaging screen D4 for imaging the faucet device 4. The second facility imaging screen D3 is provided with an imaging range 108 of the imaging device 60, an item 109 of "imaging", an item 110 of "re - imaging", a "shooting example" 116 of the faucet device 4, and an item 113 of "next". After the faucet device 4 is imaged on the product imaging screen D4, when the item 113 of "next" is selected, the procedure S100 proceeds to step S20.

[0049] In step S20, the specific information transmission unit 63 of the terminal device 50 acquires, as specific information, a product image obtained by the user imaging an existing product using the imaging device 60. However, it is not limited to the product image, and the product number input by the user may be acquired as specific information.

[0050] In step S22, the condition transmission unit 61, the facility image transmission unit 62, and the specific information transmission unit 63 of the terminal device 50 each transmit the received product condition, facility image, and specific information to the support device 10.

[0051] In step S24, the specifying unit 24 of the support device 10 specifies the product number of the existing product based on the specifying information. By specifying the product number, the existing product is specified. When the specifying information is a product image, the user can simply image the existing product with the imaging device 60 to specify the product number of the existing product and obtain the information necessary for product replacement. Therefore, it is possible to save the trouble of searching for a photo of the existing product from a huge number of product photos and specifying the product number. For example, the specifying unit 24 may read identification information such as the product number, product name, and manufacturing number displayed on the existing product from the product image using character recognition technology. For example, the specifying unit 24 may detect the feature amount of the existing product from the captured image and specify the product number of the existing product by searching the product information database held in the information providing server 2 based on the detected feature amount. For example, the specifying unit 24 may extract the area where the product is imaged using contour detection technology or the like, and detect the type, color, size, shape, function, grade, etc. of the product from the extracted product image. The specifying unit 24 may specify the product using an algorithm learned by machine learning. For example, a neural network having the image data as the input layer and the product number as the output layer may be constructed, and the weights of the intermediate layer may be learned using the pair of the product image data and the product number as learning data. Thereby, since a huge amount of product information can be comprehensively learned, the product number can be specified with higher accuracy. The specifying unit 24 specified the product from the product number specified based on the specifying information, but is not limited thereto, and the product may be directly specified based on the specifying information.

[0052] In step S26, the specifying unit 24 of the support device 10 transmits the specifying result of the product number of the existing product to the terminal device 50.

[0053] In step S28, the presentation unit 64 of the terminal device 50 displays a specific result presentation screen D5 showing the specific result of the product number of the existing product. FIG. 10 illustrates the specific result presentation screen D5. On the specific result presentation screen D5, there are provided a product number identification result 117, a product imaging result 118, a product number input item 119, an example 120 of the label location, an item 121 of "no product number label", and an item 122 of "confirm". Generally, the position where the product number is displayed is determined according to the type of the product or product group, the manufacturer or seller of the product, etc. Therefore, the user can confirm whether the product number of the existing product is correctly identified by checking whether the product number shown at the location of the faucet device 4 presented in the example 120 of the label location matches the product number identification result 117. Also, the user can confirm whether the existing product is correctly recognized by checking the product imaging result 118.

[0054] If the product number of the existing product is not correctly identified, the user can input the correct product number in the product number input item 119. In this case, the user may input the product number shown at the location of the faucet device 4 presented in the example 120 of the label location into the product number input item 119. If the product number of the existing product is correctly identified, when the item 122 of "confirm" is selected, the procedure S100 proceeds to step S30.

[0055] In addition, if there is no display of the product number in the faucet device 4, when the item 121 of "no product number label" is selected, the procedure S100 proceeds to step S30. In this case, for example, using the specific result of the product number of the existing product in step S24, candidates for replacement products for the existing product may be extracted in step S32 described later.

[0056] In step S30, the specific information transmission unit 63 of the terminal device 50 transmits a user confirmation regarding the specific result to the support device 10.

[0057] In step S32, the extraction unit 25 of the support device 10 extracts candidates for replacement products from the product information database DB. FIG. 11 illustrates the product information database DB. In the product information database DB of FIG. 11, for each combination of the product number of the existing product and the conditions of the product selected by the user, the product number of the proposed product based on the conditions of the product corresponding to the user's request, the product number of a product equivalent to the existing product, and the product number of a recommended product with higher functionality than the proposed product are set. 1), 2), and 3) in the condition column in FIG. 11 correspond to the first selection item 101 to the third selection item 103 of the condition input screen D1 in FIG. 6. The extraction unit 25 extracts candidates that match the product number and product conditions of the existing product acquired from the terminal device 50 from among a plurality of replacement product candidates held in the product information database DB. The product information database DB may be held in the support device 10 or may be held in the information providing server 2. The information providing server 2 and the support device 10 are each examples of a storage device that stores a plurality of product candidates.

[0058] The proposed products, equivalent products, and recommended products here are, for example, products that can be exchanged from existing products and have a similar feel in use to the existing products. Products with a similar feel in use to the existing products are, for example, products in which at least one of the shape, function, and grade of the product is similar to at least one of the shape, function, and grade of the existing product. Examples of the shape of the product include the position and range of movement of each member of the existing product. For example, when the lever handle or discharge port of the existing product is at a position higher than the standard, proposed products, equivalent products, and recommended products with the lever handle or discharge port at a position higher than the standard are set. For example, when the range of movement of the lever handle or discharge port of the existing product is larger than the standard, proposed products, equivalent products, and recommended products with the range of movement of the lever handle or discharge port larger than the standard are set. By extracting products with a shape similar to the existing product, for example, the user can use the product at an operation position they are accustomed to. Examples of the function of the product are, when the existing product has a touchless function or a water purification function, proposed products, equivalent products, and recommended products with a touchless function or a water purification function are set. By extracting products with a function similar to the existing product, for example, the user can use the product with a function they are accustomed to. Examples of the grade of the product are, when the existing product belongs to a high-class grade, proposed products, equivalent products, and recommended products belonging to a high-class grade are set. By extracting products with a grade similar to the existing product, for example, the user can use a product of a grade they are accustomed to. For example, it becomes possible to provide high-class products to high-class-oriented users who are accustomed to using products with high-class specifications (such as operation feel and texture). By specifying the product number of the existing product, the shape, function, and grade of the existing product can be specified, so it becomes possible to use products with a similar feel in use to the existing product as candidates for replacement products.

[0059] In step S34, the estimate creation unit 26 of the support device 10 creates a rough estimate of the cost when replacing each candidate by extracting part or all of the existing products. The "rough estimate" here refers to the purchase cost of the candidate replacement product and the cost of the work for installing the candidate replacement product (hereinafter sometimes referred to as the installation work cost), and does not include the cost required for additional work such as adding stop valves or sockets. The purchase cost of the candidate and the installation work cost may be obtained from the information providing server 2 or may be held in advance in the support device 10 for each product.

[0060] In step S36, the estimate creation unit 26 of the support device 10 transmits estimate information indicating the rough estimate created for the extracted product candidates to the terminal device 50.

[0061] In step S38, the presentation unit 64 of the terminal device 50 acquires the estimate information and displays an estimate screen D6 showing the estimate information. FIG. 12 illustrates the estimate screen D6. On the estimate screen D6, there are provided a proposed product presentation part 123, an equivalent product presentation part 124, a recommended product presentation part 125, AR image request items 126 and 127, and a final estimate request item 128. In the proposed product presentation part 123 and the recommended product presentation part 125, there are respectively shown the product number 129 of the product candidate, the rough estimate 130 of the product candidate, and the appearance 131 of the product candidate. In the example of FIG. 12, in the equivalent product presentation part 124, it is shown that there is no product that meets the conditions for the equivalent product. By referring to the estimate screen D6, the user can quickly confirm the rough estimate amount and determine the replacement product. Therefore, the convenience of the user can be improved. When the AR image request item 126 or 127 is selected, the procedure S100 proceeds to step S40, and an AR image of the proposed product or the recommended product is presented. When the final estimate request item 128 is selected, the procedure S100 proceeds to step S50, and a final estimate of the proposed product or the recommended product is presented. Hereinafter, the case where the AR image request item 127 for the recommended product is selected and then the final estimate request item 128 for the proposed product is selected will be described as an example.

[0062] In step S40, the replacement product selection unit 65 of the terminal device 50 receives from the user a selection instruction for a candidate for generating an AR image from among the candidates for replacement products presented to the user. As described above, in this example, since the AR image request item 127 for the recommended product is selected, the replacement product selection unit 65 receives a selection instruction for the recommended product.

[0063] In step S42, the replacement product selection unit 65 of the terminal device 50 transmits the received selection instruction for the replacement product to the support device 10.

[0064] In step S44, the AR image generation unit 27 of the support device 10 generates an AR image in the space where the existing product is installed when part or all of the existing product is replaced with a candidate for the replacement product. The AR image generation unit 27 acquires from the terminal device 50 a selection instruction for a candidate for generating an AR image, and generates an AR image in which the image of the selected candidate is superimposed on the position of the existing product in the product image. For example, the AR image generation unit 27 acquires from the information providing server 2 the three-dimensional shape data of the candidate and the position data indicating the installation position of the candidate in the space. The AR image generation unit 27 adjusts the scale of the three-dimensional shape data of the candidate according to the product image. The AR image generation unit 27 arranges the three-dimensional shape data of the candidate at the installation position indicated by the position data. The AR image generation unit 27 sets the viewpoint position and the line-of-sight direction estimated from the product image and superimposes the rendered image on the product image. Thereby, an AR image when the candidate is installed at the installation position is generated.

[0065] In step S46, the AR image generation unit 27 of the support device 10 transmits the generated AR image to the terminal device 50.

[0066] In step S48, the presentation unit 64 of the terminal device 50 acquires the AR image generated by the support device 10 and displays the AR image presentation screen D7. FIG. 13 illustrates the AR image presentation screen D7. The AR image presentation screen D7 is provided with a product image 132 and an AR image 133. Thereby, an AR image in which an exchange product is superimposed on an existing product can be displayed. Therefore, the user can clearly recall the image when actually exchanging. The user can easily confirm the interference with the shape of the space, installed objects, fittings, etc. when the exchange product is installed.

[0067] In step S50, the estimate request unit 66 of the terminal device 50 receives from the user an estimate request for creating a main estimate. The "main estimate" here includes, in addition to the candidate purchase cost and the candidate installation work cost, the cost required for additional work different from the work for installing the candidate when exchanging the existing product with the candidate acquired from the terminal device 50. As described above, in this example, since the main estimate request item 128 is selected for the proposed product, the estimate request unit 66 receives the main estimate request for the proposed product.

[0068] In step S52, the estimate request unit 66 of the terminal device 50 transmits the main estimate request to the support device 10.

[0069] In step S54, the necessity determination unit 28 of the support device 10 obtains, for example, from the person in charge of the additional work, the determination result as to whether additional work different from the work of installing the candidate is required when replacing the candidate obtained from the terminal device 50 with the existing product. Based on the existing product image, the facility image, etc., the person in charge of the work determines the state of the facility used by the product, and based on the determination result, determines whether additional work is required. The facilities used by the product are, for example, facilities for supplying water to the product, facilities for draining water from the product, or facilities for supplying power to the product. For example, based on the facility image under the sink of the faucet device 4, the worker determines the presence or absence of a stop valve, a socket, and a branch faucet, the distance from the center of the counter to the stop valve if there is a branch faucet, whether there is an empty space or an insertion if there is a socket, whether the socket has one port or two or more ports, and the necessity of replacing the wood due to corrosion of the base wood. Also, for example, based on the facility image of the root part of the faucet device 4, the worker determines the necessity of replacing the back plate of the faucet device 4, the diameter of the holes through which the water supply pipe and the drain pipe pass, etc.

[0070] In step S56, based on the determination result of the necessity of the additional work, the estimate creation unit 26 of the support device 10 creates a detailed estimate of the cost when replacing each product candidate obtained by extracting part or all of the existing product. Thereby, a more accurate estimate reflecting the cost of the necessary work can be created, improving the convenience for the user. The user can select a replacement product considering the necessity of the additional work.

[0071] In step S58, the estimate creation unit 26 of the support device 10 transmits the detailed estimate information indicating the created detailed estimate to the terminal device 50.

[0072] In step S60, the presentation unit 64 of the terminal device 50 acquires the estimate information and displays an estimate screen D8 showing the estimate information. FIG. 14 illustrates the estimate screen D8. The estimate screen D8 is provided with a selected product presentation section 134 and an order request item 135. The selected product presentation section 134 shows the product number 129 of the selected product, the estimate 136 of the selected product, the appearance 131 of the selected product, and the estimate details 137. In the estimate details 137, an estimate with additional construction costs added to the product and installation construction costs is shown. When the order request item 135 is selected, the procedure S100 proceeds to step S62.

[0073] In step S62, the order request unit 67 of the terminal device 50 accepts from the user the selection of the replacement product for which an order is to be requested.

[0074] In step S64, the order request unit 67 of the terminal device 50 transmits the order request for the accepted replacement product to the support device 10.

[0075] In step S66, the order placement unit 29 of the support device 10 performs the order placement process for the replacement product requested from the terminal device 50. The order placement unit 29, for example, places an order for the replacement product with the seller who sells the replacement product and places an order for the installation work with the contractor who installs the replacement product. If it is determined that additional work is required, the order placement unit 29 places an order for the additional work as well. This can save the trouble of re-entering the product number of the replacement product at the estimate and order placement stages, thus improving the convenience for the user. Also, since the product number of the replacement product is passed on to the replacement contractor and various services, a faster product replacement process can be realized.

[0076] In the first embodiment, the existing product is identified based on specific information, but the present invention is not limited thereto, and at least one of the shape, function, and grade of the existing product may be identified. For example, at least one of the shape, function, and grade of the existing product may be identified based on a product image using a known or future-implementable image recognition technology. In this case, for example, when at least one identification result of the shape, function, and grade of the existing product is input, candidate replacement products may be extracted using a learned model that outputs candidate replacement products. This learned model may be generated using a known or future-implementable method. By identifying at least one of the shape, function, and grade of the existing product, the feeling of use of the existing product is directly identified.

[0077] In the first embodiment, candidate replacement products are presented in the approximate estimate and the final estimate, but the present invention is not limited thereto. For example, candidate replacement products may be simply presented without these estimates.

[0078] In the first embodiment, the case of replacing a faucet device has been mainly described, but the technology of the first embodiment is also applicable to the case of replacing any product installed in a building. It is applicable not only to the case of replacing all of the product but also to the case of replacing only a part of the product. For example, when replacing the water purification cartridge of the faucet device 4, if the user images the faucet device 4 and transmits it to the support device 10, the support device 10 may identify the product number of the faucet device 4 and extract candidates for water purification cartridges that can be attached to the faucet device 4 and are recommended for replacement.

[0079] In the first embodiment, candidate products are extracted based on the conditions of the product, but the conditions of the product may not be used in the extraction of candidate products. In this case, for example, candidates may be set for each product number.

[0080] The operation and effects of the first embodiment will be described.

[0081] Products such as various facilities and equipment installed in a house, such as toilets, kitchens, bathrooms, washbasins, etc., have different structures. Taking a faucet device as an example, the water discharge position and the movable range of the water discharge port are different for each faucet device. Therefore, the feeling of use is different between the existing product and the replacement product, and the user may feel uncomfortable with the replacement product used after the replacement. On the other hand, since it is difficult for the owner of the existing product or the user himself / herself to judge the feeling of use of the replacement product in advance, the user may not be able to determine which product is suitable for that user. In contrast, in the first embodiment, the support device 10 includes a specific information acquisition unit 22 that acquires specific information for specifying the feeling of use of the product installed in the building, a specific unit 24 that specifies the feeling of use of the product based on the specific information, and an extraction unit 25 that extracts, based on the specific result, candidates for replacement products recommended for all or part of the product from a storage device that stores candidates for a plurality of products. With this configuration, the user can grasp the replacement products suitable for that user by supplying the specific information to the support device. Thereby, the convenience of the user can be improved. Since the user can more easily consider replacing the product, it is expected that the opportunity to replace the product will increase. Therefore, it can also give benefits to the manufacturers and sellers of the products.

[0082] In the first embodiment, the support device 10 includes a condition acquisition unit 21 that acquires the conditions of the product to be presented as the replacement product, and the extraction unit 25 extracts candidates based on the conditions of the product. According to this configuration, since candidates for replacement products based on the conditions required by the user are presented, the convenience of the user who is considering replacing the product can be further improved.

[0083] In the first embodiment, the specific information acquisition unit 22 acquires a product image obtained by imaging the product as the specific information, and the specific unit 24 specifies the product by specifying the product number of the product based on the product image. According to this configuration, since the existing product can be accurately specified only by imaging the product, it is possible to simply and appropriately extract candidates for replacement products. As a result, the convenience of the user can be further improved.

[0084] In the first embodiment, the support device 10 includes an estimate creation unit 26 that creates an estimate including at least the purchase cost of a candidate and the cost of the work for installing the candidate when all or part of a product is to be replaced with a candidate. According to this configuration, since it is possible to present an estimate together with the candidate for the replacement product, the convenience for the user can be further improved.

[0085] In the first embodiment, the specific information acquisition unit 22 acquires a product image obtained by imaging a product as specific information, and the support device 10 includes an augmented reality image generation unit 27 that generates an augmented reality image in which an image of a candidate for a replacement product is superimposed on the position of the product in the product image. According to this configuration, it is possible to clearly recall the image after replacement.

[0086] In the first embodiment, the usability includes at least one of the shape, function, and grade of the product. According to this configuration, since it is possible to extract a product whose shape, function, and grade are at least one of those of the existing product, for example, the user can use the product in at least one of the shape, function, and grade that they are used to.

[0087] (Second Embodiment) The second embodiment will be described. The second embodiment is mainly different from the first embodiment in that the necessity determination unit 28 instead of the worker determines the necessity of additional work, and only this estimate is created without creating a rough estimate. Hereinafter, the second embodiment will be described mainly focusing on the differences from the first embodiment, and the common descriptions will be omitted as appropriate.

[0088] FIGS. 15 and 16 are sequence diagrams showing the procedure S 200 of the support method executed in the support system 1 according to the second embodiment. Since steps S 110 to S 132, S 142 to S 150, and S 152 to S 156 in FIGS. 15 and 16 are the same as steps S 10 to S 32, S 40 to S 48, and S 62 to S 66 in FIGS. 4 and 5, the description thereof will be omitted.

[0089] In step S134, the necessity determination unit 28 of the support device 10 determines whether additional construction work is necessary based on the facility image. For example, the necessity determination unit 28 uses a known or future-implementable image recognition technology to determine the state of each facility in the facility image, and determines whether additional construction work is necessary based on the determination result. For example, based on the facility image under the sink of the faucet device 4, the necessity determination unit 28 determines the presence or absence of a stop valve, a socket, and a branch faucet, the distance from the center of the counter to the stop valve when there is a branch faucet, whether there is an empty space or an insertion when there is a socket, whether the socket has one port or two or more ports, and the necessity of replacing the wood due to corrosion of the base wood. Further, for example, based on the facility image of the root portion of the faucet device 4, the necessity determination unit 28 determines the necessity of replacing the back plate of the faucet device 4, the diameter of the holes through which the water supply pipe and the drain pipe pass, and the like.

[0090] In step S136, the estimate creation unit 26 of the support device 10 creates a final estimate for each extracted candidate. FIG. 17 illustrates the final estimate screen D9 of the second embodiment. The final estimate screen D9 is provided with a proposed product presentation portion 123, an equivalent product presentation portion 124, a recommended product presentation portion 125, AR image request items 126 and 127, and an order request item 135. The proposed product presentation portion 123 and the recommended product presentation portion 125 show the product number 129 of the product, the final estimate 136 of the product, the appearance 131 of the product, and the details 137 of the final estimate.

[0091] Here, when a worker determines the necessity of additional construction as in the first embodiment, in addition to taking time for the determination, there are cases where the worker is engaged in other work or absent. Therefore, it may take several days until the determination result of the necessity of additional construction is provided. Therefore, first, an approximate estimate is created and an instruction to select a candidate for the replacement product is received from the user. Then, in order to obtain a final confirmation as to whether the selected replacement product is acceptable, it is necessary to provide the user with a detailed estimate for the selected replacement product after the determination of the necessity of additional construction is completed. On the other hand, the support device 10 of the second embodiment includes a facility image acquisition unit 23 that acquires a facility image of at least one of a facility for supplying water to the product, a facility for draining water from the product, and a facility for supplying power to the product, and a necessity determination unit 28 that determines, based on the facility image, whether additional construction different from the construction for installing the candidate is necessary when replacing the product with a candidate for the replacement product. The estimate creation unit 26 creates a detailed estimate including the purchase cost of the candidate, the cost of the construction for installing the candidate, and the cost required for the additional construction as an estimate based on the determination result of the necessity of additional construction. According to this configuration, since the necessity determination unit 28 determines the necessity of additional construction, the time required until the determination result is provided can be reduced compared to the case where a worker determines the necessity of additional construction. Since the determination result of the necessity of additional construction can be obtained immediately, there is no need to create an approximate estimate, so it is possible to reduce the burden on the user for confirmation and realize a faster product replacement process. Therefore, it is possible to improve the convenience of the user.

[0092] (Third Embodiment) The third embodiment will be described. The third embodiment is mainly different from the first embodiment in that a candidate for the replacement product is extracted using a prediction model obtained by machine learning with specific information as the captured image of the product and the feature amount of the product and the product number as teacher data. Hereinafter, the third embodiment will be described mainly focusing on the differences from the first embodiment, and the common descriptions will be omitted as appropriate.

[0093] FIG. 18 shows the hardware configuration of the support device 10 according to the third embodiment. The memory 14 according to the third embodiment stores a prediction model 17 that has been machine-learned in advance using, as teacher data, the feature amounts extracted from the images of the products and the product numbers. The specifying unit 24 according to the third embodiment specifies the shape of the product as the feel of use of the product by extracting the feature amounts of the product from the captured image of the existing product as the specifying information. For example, the specifying unit 24 extracts, from the image of the product, feature amounts of, for example, n dimensions (for example, 2048 dimensions), and determines n (for example, 2048) numerical values representing the extracted feature amounts. The extraction unit 25 according to the third embodiment extracts candidates for replacement products by specifying the product numbers of the products having feature amounts approximating the feature amounts extracted by the specifying unit 24, using the prediction model 17 that has been machine-learned using the feature amounts of the products and the product numbers as teacher data.

[0094] The support device 10 according to the third embodiment further includes a learning processing unit 30. The learning processing unit 30 executes machine learning processing for generating the prediction model 17, and stores the generated prediction model 17 in the memory 14.

[0095] Here, the learning process in the prediction model 17 will be described. First, to construct the prediction model 17, the specific information acquisition unit 22 acquires the captured image by photographing in advance the product to be learned, and the specifying unit 24 extracts the feature amounts of the product in the captured image. The products to be learned here are currently sold products and do not include products that were sold in the past but are not currently sold. The operator inputs the product number of the product to be learned via an input device (not shown), and the learning processing unit 30 performs machine learning using the feature amounts and product numbers of the products as teacher data, and stores data indicating the correspondence relationship between the feature amounts and product numbers of the products as the learning result in the memory 14. The operator inputs the conditions of the products corresponding to each product number in the data indicating this correspondence relationship. As a result, a prediction model 17 having a data table showing the correspondence relationship between the product conditions, the feature amounts of the products as the learning result, and the product numbers is created and stored in the memory 14. In the prediction model 17, when the received product conditions and the feature amounts specified by the specifying unit 24 are input, a product number having feature amounts that match the received product conditions and approximate the feature amounts specified by the specifying unit 24 is output.

[0096] FIGS. 19 and 20 are sequence diagrams showing the procedure S100 of the support method executed in the support system 1 according to the third embodiment. Since steps S210 to S216, S220 to S222, and S228 to S260 in FIGS. 19 and 20 are the same as steps S10 to S16, S20 to S22, and S34 to S66 in FIGS. 4 and 5, their descriptions are omitted.

[0097] In step S218, the presentation unit 64 of the terminal device 50 displays a product imaging screen D4 for imaging an existing product. FIG. 21 illustrates the product imaging screen D4 of the third embodiment. As shown in FIG. 21, within the imaging range 108, a product guide frame 140 indicating a reference position when imaging a product is displayed. By photographing the faucet, an existing product, aligning the approximate positions of the base and the water outlet of the faucet with the guide frame 140, it becomes possible to photograph the faucet, an existing product, in an appropriate orientation and scale. As a result, in step S224 described later, it becomes possible to effectively extract the feature amounts of the existing product, so that it becomes possible to present more appropriate candidates for replacement products. In addition, when there are a plurality of different shape patterns for each product, corresponding guide frames 140 may be prepared for each shape pattern of the product so that the user can select the shape of the guide frame 140.

[0098] In step S224, the specifying unit 24 of the support device 10 specifies the feature amounts of the existing product based on the captured image of the existing product as the specifying information. The specifying unit 24 extracts the feature amounts using a known feature amount extraction technique such as, for example, SIFT (Scale-Invariant Feature Transform), SURF (Speed-Upped Robust Feature), or AKAZE (Accelerated-KAZE). Alternatively, the specifying unit 24 may extract the feature amounts by means of a convolutional neural network.

[0099] In step S226, the extraction unit 25 of the support device 10 extracts candidates for replacement products for existing products using a prediction model 17 that has been machine-learned in advance with the feature quantities extracted from the image of the product and the product number as teacher data. FIG. 22 illustrates a data table DT showing the correspondence between the conditions of the product in the prediction model 17, the feature quantities of the product as the learning result, and the product number. In the data table DT of FIG. 22, for each product number, the numerical values of a number of feature quantities corresponding to the product in the prediction model 17 and whether or not they match various conditions of the product are set. The feature quantities in the data table DT of the third embodiment are feature quantities that are extracted from the image of the product to be learned, and are machine-learned in advance as teacher data together with the corresponding product numbers and stored as a prediction model. For example, in the data table DT of FIG. 22, n numerical values from "feature quantity 001" to "feature quantity n" are defined as feature quantities. The feature quantities are represented by numerical values indicating individual feature quantities such as "1.0335" and "-0.0313". Also, in the data table DT of FIG. 22, as to whether or not it matches various conditions of the product, numerical values such as "1" when it matches the conditions of the product and "0" when it does not match the conditions of the product are represented.

[0100] The extraction unit 25 identifies the product number of the product that matches the conditions of the product received in step S212 and is associated with a feature quantity that approximates the feature quantity extracted by the specifying unit 24. For example, the feature quantity that approximates the feature quantity extracted by the specifying unit 24 can be specified using, for example, the method of approximate nearest neighbor search. That is, the extraction unit 25 uses the data table DT to calculate the vector distance between the feature quantity of the product that matches the conditions of the received product and the feature quantity extracted by the specifying unit 24 by the method of approximate nearest neighbor search, and identifies the product number associated with the feature quantity whose vector distance is smaller than a predetermined standard, thereby extracting candidates for replacement products.

[0101] In the third embodiment, the storage device stores a prediction model 17 that has been pre-trained by machine learning using, as teacher data, the feature amounts extracted from the images of products and the product numbers of the products. The specific information acquisition unit 22 acquires a captured image of a product as specific information. The specific unit 24 specifies the feature amounts of the product from the captured image as the usability. The extraction unit 25 uses the prediction model 17 to specify the product number of the captured product from the specified feature amounts, thereby extracting candidates for replacement products. According to this configuration, since products having feature amounts approximated to the feature amounts of the products in the captured image are extracted as candidates for replacement products, it is possible to present appropriate candidates for replacement products.

[0102] In the third embodiment, the products to be learned by the prediction model 17 are currently sold products. According to this configuration, by learning the feature amounts with currently sold products as the learning targets, it is not necessary to learn a huge amount of images and product numbers of old products. As a result, while reducing the amount of arithmetic processing in the machine learning of the prediction model 17, it is possible to appropriately present products having feature amounts approximated to the feature amounts of existing products.

[0103] In the third embodiment, the specific information acquisition unit 22 acquires a captured image from a terminal device 50 that communicates with the support device 10. A product imaging screen D4 including a guide frame 140 indicating a reference position at the time of imaging a product is displayed on the terminal device 50. According to this configuration, since it is possible to effectively extract the feature amounts of existing products, it is possible to present more appropriate candidates for replacement products.

[0104] The product information database DB of the third embodiment shows the correspondence relationships among various conditions of products, a large number of feature quantities, and product numbers, but is not limited thereto. For example, the product information database DB may show the correspondence relationships among various conditions of products and product numbers. In this case, by inputting the feature quantities extracted by the specifying unit 24 into the prediction model 17, the product numbers of products associated with feature quantities approximated to the feature quantities extracted by the specifying unit 24 are specified, and based on the product information database DB, it is determined whether the products corresponding to these product numbers match the conditions of the received products, whereby candidates for replacement products that match the conditions of the products may be extracted.

[0105] In the third embodiment, the learning processing unit 30 is provided in the control device 11 of the support device 10, but is not limited thereto, and the learning processing unit 30 may be provided outside the support device 10.

[0106] In the third embodiment, candidates for products are extracted based on the conditions of the products, but the conditions of the products may not be used in the extraction of candidates for products. In this case, for example, the prediction model 17 created by performing machine learning using the feature quantities and product numbers of the products as teacher data may be used.

[0107] As described above, the present disclosure has been described based on the embodiments, but the embodiments merely show the principles and applications of the present disclosure. Many modifications and arrangement changes are possible in the embodiments without departing from the idea of the present disclosure defined in the claims.

[0108] The following technologies are disclosed in the present disclosure.

[0109] (Item 1) A support device including a specific information acquisition unit that acquires specific information for specifying the usability of a product installed in a building, a specific unit that specifies the usability of the product based on the specific information, and an extraction unit that extracts candidates for replacement products recommended for all or part of the product from a storage device storing candidates for a plurality of products based on the specific result.

[0110] (Item 2) The support device according to item 1, comprising a condition acquisition unit that acquires conditions of a product to be presented as an exchange product, wherein the extraction unit extracts the candidates based on the conditions of the product.

[0111] (Item 3) The support device according to any one of items 1 and 2, wherein the specific information acquisition unit acquires a captured image of the product as the specific information, and the specific unit identifies the product by identifying the product number of the product based on the captured image.

[0112] (Item 4) The support device according to any one of items 1, 2, and 3, comprising an estimate creation unit that creates an estimate including at least the purchase cost of the candidate and the cost of the work for installing the candidate when all or part of the product is exchanged for the candidate.

[0113] (Item 5) An equipment image acquisition unit that acquires an equipment image of at least one of the equipment for supplying water to the product, the equipment for draining water from the product, and the equipment for supplying power to the product, and a necessity determination unit that determines whether additional work different from the work for installing the candidate is required when the product is exchanged for the candidate based on the equipment image, wherein the estimate creation unit creates the estimate including the purchase cost of the candidate, the cost of the work for installing the candidate, and the cost required for the additional work as the estimate based on the necessity determination result of the additional work. The support device according to item 4.

[0114] (Item 6) The support device according to any one of items 1, 2, 3, 4, and 5, wherein the specific information acquisition unit acquires a captured image of the product as the specific information, and the support device comprises an augmented reality image generation unit that generates an augmented reality image in which an image of the candidate is superimposed on the position of the product in the product image.

[0115] (Item 7) The support device according to any one of items 1, 2, 3, 4, 5, and 6, wherein the usability includes at least one of the shape, function, and grade of the product.

[0116] (Item 8) The memory device stores a prediction model that has been pre-trained using, as teacher data, the feature amounts extracted from the image of the product and the product number of the product. The specific information acquisition unit acquires, as the specific information, a captured image of the product. The specific unit specifies the feature amounts of the product from the captured image as the usability. The extraction unit uses the prediction model to specify the product number of the product from the feature amounts specified for the imaged product, thereby extracting candidates for replacement products. The support device according to Item 1 or 2.

[0117] (Item 9) The product to be learned by the prediction model is a product currently on sale. The support device according to Item 8.

[0118] (Item 10) The specific information acquisition unit acquires the captured image from a terminal device that communicates with the support device. A product capture screen including a guide frame indicating a reference position when imaging the product is displayed on the terminal device. The support device according to any one of Items 8 and 9.

[0119] (Item 11) A support system comprising: a support device that supports replacement of part or all of a product installed in a building; and a terminal device that communicates with the support device. The support device includes: a specific information acquisition unit that acquires specific information for specifying the usability of the product installed in the building; a specific unit that specifies the usability of the product based on the specific information; and an extraction unit that extracts, based on the specific result, candidates for replacement products recommended for replacement of all or part of the product from a memory device that stores candidates for a plurality of products. The terminal device includes: a specific information transmission unit that transmits the specific information; and a presentation unit that presents the candidates extracted by the extraction unit.

[0120] A terminal device that communicates with a support device, comprising: a specific information acquisition unit that acquires specific information for identifying the usability of a product installed in a building; a specific unit that identifies the usability of the product based on the specific information; and an extraction unit that extracts candidates for replacement products recommended for all or part of the product from a storage device storing candidates for a plurality of products based on the specific result, and a specific information transmission unit that transmits the specific information to the support device, and a presentation unit that presents the candidates extracted by the extraction unit of the support device.

[0121] (Item 13) A support program that causes a computer to acquire specific information for identifying the usability of a product installed in a building, identify the usability of the product based on the specific information, and extract candidates for replacement products recommended for all or part of the product from a storage device storing candidates for a plurality of products based on the specific result.

[0122] (Item 14) A method including acquiring specific information for identifying the usability of a product installed in a building, identifying the usability of the product based on the specific information, and extracting candidates for replacement products recommended for all or part of the product from a storage device storing candidates for a plurality of products based on the specific result.

Explanation of Reference Numerals

[0123] 1 Support system, 2 Information providing server, 3 Internet, 4 Faucet device, 10 Support device, 11 Control device, 21 Condition acquisition unit, 22 Specific information acquisition unit, 23 Facility image acquisition unit, 24 Specific unit, 25 Extraction unit, 26 Estimate creation unit, 27 AR image generation unit, 28 Necessity determination unit, 29 Ordering unit, 50 Terminal device, 51 Control device, 60 Imaging device, 61 Condition transmission unit, 62 Facility image transmission unit, 63 Specific information transmission unit, 64 Presentation unit, 65 Replacement product selection unit, 66 Estimate request unit, 67 Order request unit, 68 Display control unit.

Claims

1. A specific information acquisition unit that acquires specific information for specifying the usability of a product installed in a building; A specific unit that specifies the usability of the product based on the specific information; An extraction unit that extracts, based on the specific result, candidates for replacement products recommended for replacement of all or part of the product from a storage device that stores candidates for a plurality of products; A support device comprising the above.

2. Comprising a condition acquisition unit that acquires conditions for a product to be presented as a replacement product, The extraction unit extracts the candidates further based on the conditions of the product. The support device according to claim 1.

3. The specific information acquisition unit acquires a captured image of the product as the specific information, The specific unit specifies the product by specifying the product number of the product based on the captured image. The support device according to claim 1.

4. The support device according to claim 1, comprising an estimate creation unit that creates an estimate including at least the purchase cost of the candidate and the cost of the work for installing the candidate when all or part of the product is replaced with the candidate.

5. An equipment image acquisition unit that acquires an equipment image obtained by imaging at least one of the equipment for supplying water to the product, the equipment for draining water from the product, and the equipment for supplying power to the product; A necessity determination unit that determines, based on the equipment image, whether additional work different from the work for installing the candidate is required when the product is replaced with the candidate; Comprising, The estimate creation unit creates, as the estimate, a main estimate including the purchase cost of the candidate, the cost of the work for installing the candidate, and the cost required for the additional work based on the necessity determination result of the additional work. The support device according to claim 4.

6. The specific information acquisition unit acquires a captured image of the product as the specific information, The support device comprises an augmented reality image generation unit that generates an augmented reality image in which an image of the candidate is superimposed on the position of the product in the captured image. The support device according to claim 1.

7. The usability includes at least one of the shape, function, and grade of the product. The support device according to claim 1.

8. The storage device stores a prediction model that has been pre-trained by machine learning using, as teacher data, a feature amount extracted from an image of the product and the product number of the product. ​ ​ ​ ​ The specific information acquisition unit acquires a captured image obtained by capturing the product as the specific information. The specific unit specifies the feature amount of the product from the captured image as the usability. The extraction unit extracts candidates for replacement products by specifying the product number of the captured product from the feature amount specified for the captured product using the prediction model. The support device according to claim 1 or 2.

9. The support device according to claim 8, wherein the product to be learned by the prediction model is a product currently on sale.

10. The specific information acquisition unit acquires the captured image from a terminal device that communicates with the support device. The support device according to claim 8, wherein a product capture screen including a guide frame indicating a reference position when capturing the product is displayed on the terminal device.

11. A support device for supporting replacement of part or all of a product installed in a building, A terminal device that communicates with the support device, Comprising: The support device includes: A specific information acquisition unit that acquires specific information for specifying the usability of a product installed in a building; A specific unit that specifies the usability of the product based on the specific information; An extraction unit that extracts candidates for replacement products recommended for replacement of all or part of the product from a storage device storing candidates for a plurality of products based on the specific result; Including: The terminal device includes: A specific information transmission unit that transmits the specific information; A presentation unit that presents the candidates extracted by the extraction unit; A support system.

12. A terminal device that communicates with a support device, A specific information acquisition unit that acquires specific information for specifying the usability of a product installed in a building; A specific unit that specifies the usability of the product based on the specific information; An extraction unit that extracts candidates for replacement products recommended for replacement of all or part of the product from a storage device storing candidates for a plurality of products based on the specific result; Comprising a specific information transmission unit that transmits the specific information to the support device; A presentation unit that presents the candidates extracted by the extraction unit of the support device; A terminal device.

13. Causing a computer to acquire specific information for specifying the usability of a product installed in a building; specify the usability of the product based on the specific information; Based on the specific result, extracting candidates for replacement products recommended for replacement of all or part of the product from a storage device that stores candidates for a plurality of products; A support program for causing execution. **Claim 14** Obtaining specific information for specifying the usability of a product installed in a building; Based on the specific information, specifying the usability of the product; Based on the specific result, extracting candidates for replacement products recommended for replacement of all or part of the product from a storage device that stores candidates for a plurality of products; A method comprising:

Images