Programs and Systems

Abstract

This invention provides an information processing device and program that can output appropriate answers to user questions regarding rooms. [Solution] The information processing device 1 includes a display unit 24 which displays a portion of an image of a room in a building in which an object is placed as a display range; a first acquisition unit 11 which acquires a question about the room within the display range displayed by the display control unit; a second acquisition unit 11 which acquires a question image, which is an image of the display range displayed on the display unit 24 at the time the question is acquired by the first acquisition unit; and an answer generation unit 11 which generates an answer to the question based on the question acquired by the first acquisition unit and the question image acquired by the second acquisition unit. The image of the room is an omnidirectional image taken at a predetermined shooting position in the room, and the display control unit changes the display range according to user operation.

Description

Technical Field

[0006] , , system , ,

[0005] , , , , , program

[0001] The present invention relates to program and system .

Background Art

[0002] Conventionally, a technique for recognizing an object included in an image has been known (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, there is a virtual housing exhibition system that allows customers who wish to purchase a building such as a house to view the interior of the building via the Internet or the like. In such a system, it is conceivable to generate answers to user questions regarding equipment, furnishings, etc. provided in the rooms of the building, and materials, structures, etc. of the rooms, using a language model. In this case, it is required that the system generate an appropriate answer to the user's above question. Questions regarding equipment, furnishings, etc. provided in the rooms of the building, and materials, structures, etc. of the rooms are questions regarding the rooms.

[0005] The present invention has been made in view of the above circumstances, and its object is to output an appropriate answer to a user's question regarding a room program and system .

Means for Solving the Problems

[0006] <00000​​​​ The computer (control unit 11) The display control unit causes the display unit 24 to display a portion of the image of a room in a building where an object is installed, as the display range. 、 The room within the display range displayed by the display control unit Materials in an object or room First acquisition unit to obtain questions related to this matter 、 The second acquisition unit acquires the question image, which is the image of the display range displayed on the display unit 24, at the time the question is acquired by the first acquisition unit. 、 A response generation unit generates an answer to the question based on the question acquired by the first acquisition unit and the question image acquired by the second acquisition unit. 、 To function as , The image relating to the aforementioned room is an omnidirectional image taken at a predetermined shooting position within the room. The display control unit changes the display range in response to user operation.

[0007] According to the invention described in claim 1, it is possible to appropriately generate answers to questions about a room based on a portion of an image of the room. Therefore, it can output appropriate answers to user questions about rooms.

[0008] The invention described in claim 2 is, for example, as shown in Figures 2 and 5, as described in claim 1. program In, The display control unit (control unit 11) changes the display range based on the rotation angle specified by the user.

[0009] According to the invention described in claim 2, the user can include a desired portion of the room within the display range. Therefore, users can easily ask questions about the desired part of the room.

[0010] The invention according to claim 3, for example, as shown in FIGS. 2 and 5, in the program wherein the display control unit (control unit 11) changes the display range based on the magnification specified by the user.

[0011] According to the invention described in claim 3, the user can include a desired part of the room in the display range. Therefore, the user can easily ask questions about a desired part of the room.

[0012] The invention according to claim 4, for example, as shown in FIGS. 6 and 7, in the program wherein the display control unit (control unit 11) displays the question and the answer to the question on the display range.

[0013] According to the invention described in claim 4, the user can simultaneously view the display range, which is a partial area of the image related to the room, the question about the room, and the answer to the question. Therefore, it can contribute to the promotion of the sale of the building as a product by considering the purchase of the building with reference to a partial area of the image related to the room and the answer, in order to consider the purchase of the building.

[0014] The invention according to claim 5, for example, as shown in FIGS. 4 and 8, in the program wherein The aforementioned computer (control unit 11) a reception unit that receives a selection of a room for which an image is to be displayed by the display control unit (control unit 11) To function as 、 the display control unit causes the display unit 24 to display a partial area of the image related to the room selected by the reception unit.

[0015] According to the invention described in claim 5, the user can easily display an indoor image of a desired room on the display unit 24 by selecting the room for which the indoor image is to be displayed. Therefore, the user can contribute to the promotion of the sale of the building as a product by considering purchasing the building as a product by referring to the indoor image of the room.

[0016] The invention according to claim 6, for example, as shown in FIGS. 5 and 8, in the program wherein The computer (control unit 11) is configured to function as a reception unit that accepts the selection of a room to display an image in, The display control unit (control unit 11) causes the display unit 24 to display the floor plan 241f of the building, and in the floor plan 241f, indicates the shooting position of the image related to the room death, The reception unit accepts the selection of the room by accepting the selection of the shooting position for the image relating to the room.

[0017] According to the invention of claim 6, the user can easily grasp the shooting position of the indoor image in the building. Therefore, the user can contribute to the promotion of the sale of the building as a product by considering purchasing the building as a product by referring to the indoor image of the room. Furthermore, users can easily select the room on which they want to display interior images. Therefore, the display unit 24 can easily display an interior image of the room desired by the user.

[0020] Claim 7 The invention described in is, for example, as shown in FIGS. 5 and 8, in the program wherein The aforementioned computer (control unit 11) A reception unit that receives a selection of a room for displaying an image by the display control unit (control unit 11) To function as , The reception unit receives the selection of the room by receiving a pressing operation on a button (room type selection button 241c) for selecting the room displayed on the display unit 24.

[0021] According to the invention of claim 8, the user can easily select a room for which an indoor image is to be displayed. Therefore, the user can easily display the indoor image of the desired room on the display unit 24.

[0022] The invention described in claim 8 is, for example, as shown in Figure 2, in the program described in claim 1, The response generation unit (control unit 11) outputs an answer to the question by inputting the question and the question image into a machine learning model that has been trained using information about objects or materials in the room as training data. The invention described in claim 9 is, system For example, as shown in Figures 2, 4, 5, 6, and 7, table The display control unit causes the display unit 24 to display a portion of the image of a room in a building where an object is installed, as the display range. (Control unit 11) and , The room within the display range displayed by the display control unit Materials in an object or room First acquisition unit to obtain questions related to this matter (Control unit 11) and , The second acquisition unit acquires the question image, which is the image of the display range displayed on the display unit 24, at the time the question is acquired by the first acquisition unit. (Control unit 11) and , A response generation unit generates an answer to the question based on the question acquired by the first acquisition unit and the question image acquired by the second acquisition unit. (Control unit 11) and , Equipped with , The image relating to the aforementioned room is an omnidirectional image taken at a predetermined shooting position within the room. The display control unit changes the display range in response to user operation.

[0023] According to the invention described in claim 8, an appropriate answer to a question can be generated based on information about objects or materials in a room. Therefore, it can output appropriate answers to user questions regarding objects or materials in a room. According to the invention described in claim 9, it is possible to appropriately generate answers to questions about a room based on a portion of an image of the room. Therefore, it can output appropriate answers to user questions about rooms. [Effects of the Invention]

[0024] According to the present invention, it is possible to output appropriate answers to user questions regarding rooms. [Brief explanation of the drawing]

[0025] [Figure 1]This is a diagram showing the configuration of an information processing system. [Figure 2] This is a block diagram showing the configuration of an information processing device. [Figure 3] This is a block diagram showing the configuration of a terminal device. [Figure 4] This is a flowchart showing the flow of the display control process. [Figure 5] This figure shows an example of a display screen shown by a terminal device. [Figure 6] This figure shows an example of a display screen where the chat screen is shown. [Figure 7] This figure shows an example of a display screen where the chat screen is shown. [Figure 8] This figure shows an example of a display screen shown by a terminal device. [Modes for carrying out the invention]

[0026] Embodiments of the present invention will be described below with reference to the drawings. However, the embodiments described below are subject to various technically preferred limitations for carrying out the present invention, but the technical scope of the present invention is not limited to the following embodiments and illustrated examples.

[0027] [1. Explanation of the structure] [1-1. System Configuration Description] Figure 1 shows an information processing system 100. The information processing system 100 comprises an information processing device 1 and a terminal device 2 as a user terminal. In this embodiment, the user is, for example, a prospective buyer in a housing sale. The information processing device 1 and the terminal device 2 can communicate with each other, for example, via a communication network N. The communication network N may include various communication network types such as telephone lines, ISDN lines, optical fibers, mobile communication networks, satellite communication lines, CATV lines, and other dedicated lines, as well as internet service providers (i.e., the Internet) connecting them. It may also be a collective communication network where various communication networks such as LAN (Local Area Network), WAN (Wide Area Network), WiFi (Wireless Fidelity), Bluetooth®, and NFC (Near Field Communication) are interconnected in a way that allows them to communicate with each other. Furthermore, the connection method may be wired, wireless, or a combination of wired and wireless connections.

[0028] [1-2. Description of Information Processing Devices] Next, the configuration of the information processing device 1 will be described. Information processing device 1 consists of a PC, dedicated devices / terminals, etc. As shown in Figure 2, the information processing device 1 comprises a control unit 11, a storage unit 12, and a communication unit 13. Each part of the information processing device 1 is electrically connected by a bus or the like. The information processing device 1 may also include at least one of a display unit and an operation unit.

[0029] The control unit 11 includes a CPU, RAM (Random Access Memory), ROM (Read Only Memory), etc. The ROM stores various programs executed by the CPU. The CPU of the control unit 11 reads various programs stored in the memory unit 12, expands them into RAM, executes various processes according to the expanded programs, and centrally controls the operation of the information processing device 1.

[0030] The storage unit 12 includes non-volatile memory, a hard disk, and the like. The memory unit 12 stores various programs executed by the control unit 11, as well as various data necessary for program execution. The various programs include, for example, programs that perform the display control processing described later. Other programs necessary for the operation of this system are also included as appropriate. Furthermore, the various data include the data and parameters necessary for the operation of this system.

[0031] Furthermore, the memory unit 12 stores the image DB (database) 121. Image DB121 is image data for realizing a virtual housing exhibition, and stores interior image data of rooms in a specified building such as a house, associating it with the type of room in the building. The interior images stored in image DB121 are 360-degree panoramic images (omnidirectional images) taken from a predetermined shooting position in each room of the building using an omnidirectional camera. An omnidirectional camera is a 360-degree camera capable of capturing images in all directions: up, down, left, right, front, and back.

[0032] Furthermore, the memory unit 12 stores the text generation model 122 used in the display control processing. The text generation model 122 is a model that has been trained using machine learning data that includes information about equipment, fixtures, and other objects installed in rooms of buildings such as houses, as well as information about the materials and structure of the rooms. The text generation model 122 is an artificial intelligence (AI) that generates text that is an answer to a question by taking a predetermined image and a question about the room contained in the image as input.

[0033] The communication unit 13 includes a communication module and the like. The communication unit 13 transmits and receives various signals and data to and from other devices (such as terminal devices 2) connected via wired or wireless connections through the communication network N.

[0034] [1-3. Description of terminal equipment] Next, we will describe the configuration of terminal device 2. Terminal device 2 does not require a dedicated device; general-purpose terminals such as PCs, smartphones, and tablet devices can be used. As shown in Figure 3, terminal device 2 comprises a control unit 21, a storage unit 22, a communication unit 23, a display unit 24, and an operation unit 25. Each part of terminal device 2 is electrically connected by a bus or the like.

[0035] The control unit 21 is the part that controls the operation of the terminal device 2, and for example, it includes a CPU, ROM, RAM, etc., and in cooperation with the CPU and program data stored in the storage unit 22, it comprehensively controls each part of the terminal device 2.

[0036] The memory unit 22 is the part that stores various information necessary for the operation of the terminal device 2. For example, it is equipped with non-volatile memory or a hard disk, and stores data necessary for the operation of the terminal device 2, such as program data, in a read / write format from the control unit 21.

[0037] Furthermore, the memory unit 22 stores an image display application program (hereinafter referred to as the image display app) 221. Image display application 221 is an application that realizes a virtual housing exhibition where users can view buildings such as houses in a virtual reality space such as the internet.

[0038] The control unit 21 generates and displays a display screen in the image display application 221 based on the information received from the information processing device 1. If terminal device 2 has a browser, the control unit 21 may display various web pages generated by the information processing device 1 on the display unit 24 according to operations performed by the user on the operation unit 25.

[0039] The communication unit 23 includes a communication module and the like. The communication unit 23 transmits and receives various signals and data to and from other devices (such as the information processing device 1) connected via wired or wireless means through the communication network N.

[0040] The display unit 24 includes a display such as an LCD (Liquid Crystal Display), and displays an image on the display based on a display control signal output from the control unit 21.

[0041] The operation unit 25 includes, for example, a keyboard having character input keys, numeric input keys, and keys corresponding to various other functions, a touch panel integrally formed with the display unit 24, and receives operation input from the user and outputs an operation signal corresponding to the operation input to the control unit 21.

[0042] [2. Explanation of the operation of the information processing system] Next, the operation of the information processing system 100 according to this embodiment will be described. Figure 4 shows a flowchart of the display control process performed by the information processing system 100. The control unit 11 of the information processing device 1 performs display control processing to provide a virtual housing exhibition system to a user using the terminal device 2, allowing them to view buildings such as houses in a virtual reality space.

[0043] (Display control processing) First, when the user instructs the launch of the image display application 221 via the operation unit 25 of the terminal device 2, the control unit 11 of the information processing device 1 acquires an indoor image from the image DB 121 that corresponds to the room type set as the initial display. Next, the control unit 11 displays a predetermined range of the acquired indoor image in the image display area 241a on the display screen 241 (see Figure 5) displayed on the display unit 24 (step S1). In the example shown in Figure 5, the room type set as the initial display is assumed to be the living room. In this embodiment, the living room is equipped with objects such as lighting 310 (see Figure 6) and potted plants 320 (see Figure 7), which will be described later. In other words, the control unit 11 causes the display unit 24 to display a portion of the image of a room in a building where an object is placed, as the display range. The control unit 11 functions as a display control unit.

[0044] When the control unit 11 receives a drag operation or the like from the user via the operation unit 25 in the image display area 241a, it displays a portion of the room image rotated in the direction based on the operation in the image display area 241a. Furthermore, when the control unit 11 receives a predetermined zoom-in or zoom-out operation from the user via the operation unit 25 in the image display area 241a, it performs an enlargement process on the room image based on the operation and displays a portion of the room image in the image display area 241a while enlarging it at a predetermined magnification ratio. The predetermined magnification ratio is the magnification ratio set by the predetermined zoom-in or zoom-out operation from the user via the operation unit 25. In other words, the control unit 11 changes the display range of the indoor image based on user operations on the indoor image displayed in the image display area 241a.

[0045] As shown in Figure 5, the control unit 11 displays menu 241b at the bottom of the display screen 241. Menu 241b includes a room type selection button 241c for selecting the room type to display an interior image on the display screen 241, a floor plan display button 241d, and the like. Furthermore, the control unit 11 displays a close button 241e at the top of the menu 241b on the display screen 241. When the control unit 11 receives a press operation of the close button 241e via the operation unit 25, it hides the menu 241b.

[0046] Furthermore, when the control unit 11 receives a press operation from the user via the operation unit 25 to display the floor plan, it displays the floor plan 241f of the building on the display screen 241. The control unit 11 displays viewpoint marks 241g in each room of the floor plan 241f, indicating the shooting position of the interior image of each room stored in the image DB 121. The control unit 11 displays the viewpoint mark 241g, which indicates the shooting position of the indoor image currently displayed in the image display area 241a, in a different display manner (different color, etc.) from the other viewpoint marks 241g.

[0047] Furthermore, the control unit 11 displays a fan-shaped angle mark 241h, which indicates the shooting angle of the indoor image currently displayed in the image display area 241a, adjacent to the viewpoint mark 241g. When the control unit 11 receives a drag operation or the like from the user via the operation unit 25 on the angle mark 241h, it displays a portion of the room image that has been rotated horizontally based on the operation.

[0048] Next, the control unit 11 determines whether the user has pressed the AI ​​chat button 241i, which is used to instruct the user to activate the AI ​​chat function provided on the display screen 241, via the operation unit 25 (step S2). When the AI ​​chat button 241i is pressed (step S2; YES), that is, when the user instructs the activation of the AI ​​chat function, the control unit 11 displays the chat screen 242 on the image display area 241a, as shown in Figure 6, and accepts the user's input of a question (step S3). Specifically, the control unit 11 displays an input field 242a on the chat screen 242 for the user to enter a question, and accepts input operations on the input field 242a from the user via the operation unit 25. The user enters a question in input field 242a regarding the room included in the interior image currently displayed in image display area 241a. When the control unit 11 receives a question input operation from the user via the operation unit 25, it displays the received question 242b in the input field 242a on the chat screen 242. In the example shown in Figure 6, the question entered by the user is a question about the lighting 310 included in the indoor image displayed in the image display area 241a, and is "What is this lighting?". In other words, the control unit 11 acquires information about rooms within a certain area (display range) of the images of rooms in a building. The control unit 11 functions as a first acquisition unit.

[0049] Next, in step S3, the control unit 11 determines whether or not a question has been entered by the user in the input field 242a of the chat screen 242 (step S4). If a question is entered by the user (step S4; YES), the control unit 11 acquires a question image, which is an image obtained, for example, by taking a screenshot, of the room image that was displayed in the image display area 241a at the time the question was entered by the user (step S5). In other words, the control unit 11 acquires a question image, which is an image of a portion of the area (display range) of the image of the rooms of the building displayed on the display unit 24 at the time the question is acquired. The control unit 11 functions as a second acquisition unit.

[0050] Next, the control unit 11 inputs the question text received in step S3 and the question image acquired in step S5 into the text generation model 122. The control unit 11 uses the text generation model 122 to perform image analysis on the question image and generates text for the answer to the question based on the image analysis results and the question text (step S6). The control unit 11 functions as an answer generation unit.

[0051] Next, the control unit 11 displays the text 242c of the answer to the question generated in step S6 on the chat screen 242 (step S7). In the example shown in Figure 6, the answer text is "This is LED lighting. It is designed to be energy-saving and environmentally friendly."

[0052] Figure 7 shows another example of the question text 242b and the answer text 242c displayed on the chat screen 242. In the example shown in Figure 7, the question entered by the user is about the houseplant 320 included in the indoor image displayed in the image display area 241a, and is "What kind of houseplant is this?". The answer text to the question is: "This houseplant is a Monstera. It will brighten up the atmosphere of your room."

[0053] Furthermore, if the AI ​​chat button 241i is not pressed (step S2; NO), or if the user does not enter a question (step S4; NO), the control unit 11 proceeds to step S8 for display control processing.

[0054] Next, the control unit 11 determines whether the user has pressed any of the room type selection buttons 241c or any of the viewpoint marks 241g displayed on the display screen 241 via the operation unit 25, that is, whether a room type for which an indoor image is to be displayed has been selected on the display screen 241 (step S8). In other words, the control unit 11 accepts the selection of a room for which to display an indoor image on the display screen 241. The control unit 11 functions as a reception unit.

[0055] If the user selects a room type (step S8; YES), the control unit 11 retrieves an interior image associated with the room type selected by the user from the image database 121. Next, as shown in Figure 8, the control unit 11 displays a predetermined range of the retrieved interior image in the image display area 241a on the display screen 241 (step S9), and then proceeds to step S2 for display control processing. If the floor plan 241f is displayed on the display screen 241, the control unit 11 displays a viewpoint mark 241g on the floor plan 241f that indicates the shooting position of the interior image currently displayed in the image display area 241a, in a different display manner from the other viewpoint marks 241g. Furthermore, the control unit 11 displays a fan-shaped angle mark 241h, which indicates the shooting angle of the indoor image currently displayed in the image display area 241a, adjacent to the viewpoint mark 241g.

[0056] On the other hand, if the user does not select a room type (step S8; NO), the control unit 11 returns the display control process to step S8.

[0057] Furthermore, when the user instructs the image display application 221 to be terminated via the operation unit 25, the control unit 11 terminates the display control process.

[0058] [3. Effects] As described above, the information processing device 1 of this embodiment includes a display control unit (control unit 11) that displays a portion of an image relating to a room in a building, in which an object is installed, as a display range on the display unit 24; a first acquisition unit (control unit 11) that acquires a question relating to the room within the display range displayed by the display control unit; a second acquisition unit (control unit 11) that acquires a question image, which is an image of the display range displayed on the display unit 24 at the time the question is acquired by the first acquisition unit; and an answer generation unit (control unit 11) that generates an answer to the question based on the question acquired by the first acquisition unit and the question image acquired by the second acquisition unit. The image relating to the room is an omnidirectional image taken at a predetermined shooting position in the room, and the display control unit changes the display range according to user operation. According to this, it is possible to appropriately generate answers to questions about a room based on a portion of an image of that room. Therefore, it can output appropriate answers to user questions about rooms.

[0059] Furthermore, in the information processing device 1 of this embodiment, the display control unit (control unit 11) changes the display range based on the rotation angle specified by the user. According to this, the user can include a desired portion of the room within the display area. Therefore, users can easily ask questions about the desired part of the room.

[0060] Furthermore, in the information processing device 1 of this embodiment, the display control unit (control unit 11) changes the display range based on the magnification ratio specified by the user. According to this, the user can include a desired portion of the room within the display area. Therefore, users can easily ask questions about the desired part of the room.

[0061] Furthermore, in the information processing device 1 of this embodiment, the display control unit (control unit 11) displays the question and the answer to the question within the display range. According to this, the user can simultaneously view a display area, which is a portion of the image of the room, a question about that room, and the answer to that question. Therefore, by considering the purchase of a building based on certain areas of images related to the room and the answers provided, it can contribute to the promotion of sales of the building as a product.

[0062] Furthermore, the information processing device 1 of this embodiment includes a reception unit (control unit 11) that receives a selection of a room to display an image from a display control unit (control unit 11), and the display control unit causes the display unit 24 to display a portion of the image related to the room selected by the reception unit. According to this, the user can easily display the interior image of the desired room on the display unit 24 by selecting the room in which they want to display the interior image. Therefore, since users refer to the interior images of the room in question when considering purchasing the building, this can contribute to the promotion of sales of the building.

[0063] Furthermore, in the information processing device 1 of this embodiment, the display control unit (control unit 11) displays a floor plan 241f of the building on the display unit 24, and indicates the shooting position of the images related to the rooms in the floor plan 241f.

[0064] According to this, users can easily determine the location where interior images were taken within a building. Therefore, since users refer to the interior images of the room in question when considering purchasing the building, this can contribute to the promotion of sales of the building.

[0065] Furthermore, the information processing device 1 of this embodiment includes a reception unit (control unit 11) that receives the selection of a room to display an image from a display control unit (control unit 11), and the reception unit receives the selection of the image shooting position for the room, thereby receiving the selection of a room. According to this, users can easily select the room in which they want to display interior images. Therefore, the display unit 24 can easily display an interior image of the room desired by the user.

[0066] Furthermore, the information processing device 1 of this embodiment includes a reception unit (control unit 11) that receives a selection of a room to display an image from a display control unit (control unit 11). The reception unit receives a press operation on a button (room type selection button 241c) for selecting a room displayed on the display unit 24, thereby receiving the selection of a room. According to this, users can easily select the room in which they want to display interior images. Therefore, the display unit 24 can easily display an interior image of the room desired by the user.

[0067] Furthermore, in recent years, there has been a growing demand for the realization of a decarbonized society through the promotion of carbon neutrality, which aims to achieve virtually zero carbon dioxide emissions, and for the achievement of the Sustainable Development Goals (SDGs). Various initiatives are being undertaken in the construction industry as well. In this embodiment, prospective homebuyers can be provided with appropriate answers to questions about the rooms in a house. As a result, homebuyers can consider purchasing a house based on the answers provided, enabling them to buy a house that closely matches their ideal, which leads to continued residence in the house. Therefore, this can contribute to the realization of a decarbonized society through the promotion of carbon neutrality and the achievement of the SDGs (Goals 11, 12, 13, and 15). Furthermore, the buildings that users can view in the virtual housing exhibition system of the above embodiment may be newly built properties or existing properties.

[0068] It should be noted that the embodiments to which the present invention can be applied are not limited to those described above, and can be modified as appropriate without departing from the spirit of the invention. For example, in the above embodiment, the information processing device 1 is provided with an image DB 121 and a text generation model 122, but is not limited to this. The information processing system 100 may be connected to the information processing device 1 in a communicative manner and may include an external device that provides an image DB 121 and a text generation model 122. [Explanation of Symbols]

[0069] 100 Information Processing Systems 1. Information Processing Device 11 Control Unit (Display Control Unit, First Acquisition Unit, Second Acquisition Unit, Response Generation Unit, Reception Unit) 12 Storage section 121 Image Database 122 Text Generation Models 13 Communications Department 2 Terminal devices 21 Control Unit 22 Memory section 221 Image Viewing Apps 23 Communications Department 24 Display section 25 Control section

Claims

1. A computer, A display control unit that displays a portion of an image of a room in a building where an object is installed, as the display range. A first acquisition unit acquires questions regarding objects or materials in a room located within the display range displayed by the display control unit. A second acquisition unit acquires a question image, which is an image of the display range displayed on the display unit, at the time the question is acquired by the first acquisition unit. An answer generation unit generates an answer to the question based on the question acquired by the first acquisition unit and the question image acquired by the second acquisition unit. To make it function as, The image relating to the aforementioned room is an omnidirectional image taken at a predetermined shooting position within the room. The display control unit is a program that changes the display range in response to user operation.

2. The program according to claim 1, wherein the display control unit changes the display range based on a rotation angle specified by the user.

3. The program according to claim 1, wherein the display control unit changes the display range based on a magnification ratio specified by the user.

4. The program according to claim 1, wherein the display control unit causes the question and the answer to the question to be displayed on the display range.

5. The computer functions as a reception unit that receives the selection of a room to display an image by the display control unit, The program according to claim 1, wherein the display control unit causes the display unit to display a portion of the image relating to the room selected by the reception unit.

6. The computer functions as a reception unit that receives the selection of a room to display an image by the display control unit, The display control unit causes the display unit to display the floor plan of the building, and in the floor plan, it indicates the shooting position of the image relating to the room. The program according to claim 1, wherein the reception unit accepts the selection of the image shooting position for the room, thereby accepting the selection of the room.

7. The computer is configured to function as a reception unit that receives the selection of a room to display an image by the display control unit, The program according to claim 1, wherein the reception unit accepts the selection of a room by receiving a press operation on a button for selecting a room displayed on the display unit.

8. The program according to claim 1, wherein the answer generation unit outputs an answer to the question by inputting the question and the question image into a machine learning model that has been trained using information about objects provided in the room or materials in the room as training data.

9. A display control unit that causes a display unit to display a portion of an image relating to a room in a building in which an object is installed as a display range, A first acquisition unit acquires questions regarding objects or materials in a room located within the display range displayed by the display control unit, A second acquisition unit acquires a question image, which is an image of the display range displayed on the display unit, at the time the question is acquired by the first acquisition unit. An answer generation unit generates an answer to the question based on the question acquired by the first acquisition unit and the question image acquired by the second acquisition unit, Equipped with, The image relating to the aforementioned room is an omnidirectional image taken at a predetermined shooting position within the room. The display control unit is a system that changes the display range in response to user operation.

Images