Information processing method, program, and information processing device

Abstract

To provide an information processing method or the like capable of presenting a curtain that matches a window frame with high accuracy to a user.SOLUTION: An information processing method acquires a window frame identification number for identifying a precut window frame from a user terminal owned by the user, reads size information corresponding to the window frame identification number with reference to a window frame database recording the size information of the precut window frame in association with the window frame identification number, specifies a curtain or a blind that can correspond to the size information with reference to a curtain database recording the range of a size of the precut window frame that can correspond to the curtain or the blind, and transmits information of the specified curtain or blind to the user terminal.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present technology relates to an information processing method, a program, and an information processing device. [Background technology]

[0002] Conventionally, systems for selling custom-made curtains have been proposed. For example, the custom-made curtain sales system described in Patent Document 1 calculates the dimensions of the curtain based on image information captured around the opening where the curtain will be installed, and transmits product information including the dimensions of the curtain and information about the customer who will order the product as order information to a store terminal via a communication network. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-047946 A Summary of the Invention [Problem to be solved by the invention]

[0004] The custom curtain sales system described in Patent Document 1 calculates the dimensions of the curtains based on image information taken near the opening (window frame, etc.) where the curtains will be installed, so the dimensions of the curtains may not match the size of the window frame, and the accuracy of presenting curtains that fit the window frame to the user is low.

[0005] The present disclosure has been made in consideration of the above circumstances, and aims to provide an information processing method and the like that can present to a user curtains that fit a window frame with high accuracy. [Means for solving the problem]

[0006] An information processing method according to one embodiment of the present disclosure obtains a window frame identification number that identifies a pre-cut window frame from a user terminal owned by a user, refers to a window frame database in which size information of the pre-cut window frame is recorded corresponding to the window frame identification number, reads out the size information that corresponds to the obtained window frame identification number, refers to a curtain database in which a range of sizes of the pre-cut window frame that are compatible with curtains or blinds is recorded, identifies curtains or blinds that are compatible with the size information, and transmits information about the identified curtains or blinds to the user terminal.

[0007] An information processing method according to one embodiment of the present disclosure identifies the window frame identification number based on a window frame code attached to the precut window frame and read by the user terminal.

[0008] An information processing method according to one embodiment of the present disclosure obtains the window frame identification number read from a communication tag attached to the precut window frame and capable of communicating with the user terminal.

[0009] An information processing method according to one embodiment of the present disclosure obtains a captured image of the precut window frame from the user terminal, displays an identified curtain or blind in AR on the captured image, and accepts input for changing the color or size of the curtain or blind displayed in AR on the captured image.

[0010] An information processing method according to one embodiment of the present disclosure obtains ordering information for a specified curtain or blind, calculates a commission to a manufacturer producing the ordered curtain or blind, and outputs the size information of the precut window frame, the ordering information for the specified curtain or blind, and information regarding the commission to a manufacturer terminal owned by the manufacturer.

[0011] In an information processing method according to one embodiment of the present disclosure, the curtain database records the number of times a curtain or blind has been ordered, and when the window frame identification number is obtained, information regarding the curtain or blind that has been ordered the most number of times and is compatible with the size information of the precut window frame is output to the user terminal.

[0012] An information processing method according to one embodiment of the present disclosure identifies recommended curtains or blinds based on information of a user who purchased the precut window frame, information of the building in which the precut window frame will be installed, or information of the room in which the precut window frame will be installed, including floor material, floor color, or use.

[0013] An information processing method according to one embodiment of the present disclosure includes obtaining from the user terminal a room image of the room in which the precut window frame is to be installed, recognizing objects around the precut window frame in the room image, calculating the distance between the precut window frame and the objects, and identifying curtains or blinds that can be installed in the precut window frame based on the distance.

[0014] A program according to one embodiment of the present disclosure causes a computer to execute the following process: obtain a window frame identification number that identifies a pre-cut window frame from a user terminal owned by a user; refer to a window frame database in which size information of the pre-cut window frame is recorded corresponding to the window frame identification number, read the size information corresponding to the obtained window frame identification number; refer to a curtain database in which a range of sizes of the pre-cut window frame that are compatible with curtains or blinds is recorded, identify curtains or blinds that are compatible with the size information, and send information about the identified curtains or blinds to the user terminal.

[0015] An information processing device according to one embodiment of the present disclosure includes a processing unit that acquires a window frame identification number that identifies a pre-cut window frame from a user terminal owned by a user, refers to a window frame database in which size information of the pre-cut window frame is recorded corresponding to the window frame identification number, reads the size information corresponding to the acquired window frame identification number, refers to a curtain database in which a range of sizes of the pre-cut window frame that are compatible with curtains or blinds is recorded, identifies curtains or blinds that are compatible with the size information, and transmits information about the identified curtains or blinds to the user terminal. Effect of the Invention

[0016] In the information processing method according to an embodiment of the present disclosure, it is possible to present to the user curtains that match the window frame with high accuracy. [Brief description of the drawings]

[0017] [Figure 1] 1 is a block diagram showing a configuration example of a curtain ordering system. [Diagram 2] FIG. 1 is a block diagram showing an example of the configuration of an information processing device. [Diagram 3] FIG. 2 is a block diagram showing an example of the configuration of a user terminal. [Figure 4] FIG. 10 is an explanatory diagram showing an example of a precut window frame database. [Diagram 5] FIG. 2 is an explanatory diagram illustrating an example of a curtain database. [Figure 6] FIG. 2 is an explanatory diagram showing an example of a precut window frame. [Figure 7] FIG. 13 is an explanatory diagram showing an example of an information transmission screen. [Figure 8] FIG. 13 is an explanatory diagram showing an example of a curtain ordering screen. [Figure 9] FIG. 13 is an explanatory diagram illustrating an example of an AR display screen for curtains. [Figure 10] 11 is a flowchart illustrating an example of processing by an information processing device and a user terminal. [Figure 11]FIG. 11 is an explanatory diagram showing an example of a precut window frame database according to the second embodiment. [Figure 12] FIG. 11 is an explanatory diagram showing an example of a curtain ordering screen according to the second embodiment. [Figure 13] 11 is a flowchart showing an example of processing by an information processing device and a user terminal according to the second embodiment. [Figure 14] FIG. 11 is a block diagram showing an example of the configuration of an information processing device according to a third embodiment. [Figure 15] FIG. 13 is an explanatory diagram showing an example of an information transmission screen according to the third embodiment. [Figure 16] FIG. 11 is an explanatory diagram illustrating an example of a recommended curtain output model. [Figure 17] FIG. 13 is an explanatory diagram showing an example of a curtain ordering screen according to the third embodiment. [Figure 18] 11 is a flowchart showing an example of processing by an information processing device and a user terminal according to embodiment 3. [Figure 19] FIG. 11 is a block diagram showing an example of the configuration of an information processing device according to a fourth embodiment. [Figure 20] FIG. 13 is an explanatory diagram showing an example of a curtain database according to the fourth embodiment. [Figure 21] FIG. 13 is an explanatory diagram showing an example of an information transmission screen according to the fourth embodiment. [Figure 22] FIG. 2 is an explanatory diagram illustrating an example of an object detection model. [Figure 23] FIG. 4 is an explanatory diagram illustrating an example of a distance calculation module. [Figure 24] 13 is a flowchart showing an example of processing by an information processing device and a user terminal according to embodiment 4. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] (Embodiment 1) Fig. 1 is a block diagram showing an example of the configuration of a curtain ordering system S. The curtain ordering system S includes an information processing device 1, a user terminal 2, and a manufacturer terminal 3. The information processing device 1 is capable of communicating with the user terminal 2 via a network N using wide area wireless communication. The user terminal 2 is a terminal carried by a user who has purchased a precut window frame and is considering purchasing curtains or blinds (hereinafter referred to as curtains).

[0019] The user terminal 2 transmits the window frame identification number read from the two-dimensional barcode B attached to the pre-cut window frame purchased by the user to the information processing device 1. The information processing device 1 identifies curtains that can be used with the size information corresponding to the window frame identification number, and transmits the curtains to the user terminal 2.

[0020] Furthermore, the user terminal 2 accepts input of curtains that the user has decided to order from the manufacturer from among the identified curtains acquired from the information processing device 1. The user terminal 2 transmits the curtains that the user has decided to order (order information) to the information processing device 1. The information processing device 1 transmits information on the ordered curtains and information on the fee calculated based on the order information to the manufacturer terminal 3.

[0021] FIG. 2 is a block diagram showing a configuration example of the information processing device 1. The information processing device 1 is, for example, a server computer, and includes a control unit 11, a storage unit 12, and a communication unit 13. The control unit 11 is configured with a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphical Processing Unit), a quantum processor, or the like, and performs various control processing, arithmetic processing, and the like by reading and executing a program P (program product) and a database stored in advance in the storage unit 12. Note that a database server or the like may be provided outside the information processing device 1, and the database may be read from the database server or the like. In addition, the information processing device 1 may be one whose functions are realized by a plurality of server devices or computers. In addition, the information processing device 1 may correspond to a node on a blockchain.

[0022] The storage unit 12 of the information processing device 1 is, for example, a volatile memory and a non-volatile memory. The storage unit 12 stores a program P, a precut window frame database 121, and a curtain database 122. The program P may be provided to the information processing device 1 using a storage medium 12a in which the program P is stored in a computer-readable manner. The storage medium 12a is, for example, a portable memory. Examples of the portable memory include a CD-ROM, a USB (Universal Serial Bus) memory, an SD card, a micro SD card, and a compact flash memory (registered trademark). When the storage medium 12a is a portable memory, the processing element of the control unit 11 may read the program P from the storage medium 12a using a reading device (not shown). The read program P is written to the storage unit 12. Furthermore, the program P may be provided to the information processing device 1 by the communication unit 13 communicating with an external device. Details of the precut window frame database 121 and the curtain database 122 will be described later.

[0023] The communication unit 13 is a communication module or a communication interface for communicating with the user terminal 2 by wire or wirelessly, and is, for example, a wide-area wireless communication module such as LTE (registered trademark), 4G, or 5G. The control unit 11 communicates with the user terminal 2 via the communication unit 13 through an external network N such as the Internet.

[0024] FIG. 3 is a block diagram showing a configuration example of the user terminal 2. The user terminal 2 is, for example, a smartphone, a tablet terminal, wearable glasses, a wearable computer, a personal computer, or an HMD (Head Mounted Display). In this embodiment, an example in which the user terminal 2 is a smartphone will be described. The user terminal 2 includes a terminal control unit 21, a storage unit 22, a communication unit 23, an input unit 24, a display unit 25, and a photographing unit 26. The terminal control unit 21 is configured with a CPU or an MPU, and performs various control processes, arithmetic processes, and the like. The functions of the user terminal 2 may be realized by a plurality of devices. For example, the arithmetic processes may be performed by a smartphone, and the input reception or the display of the screen may be performed by the wearable glasses. In addition, the user terminal 2 may perform a part or all of the processes performed by the information processing device 1 according to this embodiment.

[0025] The storage unit 22 stores an application program Pa that reads a two-dimensional barcode B attached to a window frame and accepts an input of a decision on which curtains to order from the curtains received (acquired) from the information processing device 1. The application program Pa is provided to the user terminal 2 using, for example, a storage medium 22a. Note that the terminal control unit 21 of the user terminal 2 may obtain the application program Pa using the Internet and store it in the storage unit 22.

[0026] The communication unit 23 is a communication module or a communication interface for wirelessly communicating with the information processing device 1. The terminal control unit 21 communicates with the information processing device 1 through the communication unit 23 and an external network N.

[0027] The input unit 24 accepts input from the user. The user can use the input unit 24 to input changes to the products displayed in the product perspective image, selection of products to be ordered from manufacturers, and the like.

[0028] The display unit 25 displays product perspective images and a product list received (acquired) from the information processing device 1. In this embodiment, the user terminal 2 is a smartphone, and the input unit 24 and the display unit 25 are integrally configured by a touch panel.

[0029] The photographing unit 26 photographs the precut window frame. In this embodiment, the user terminal 2 is a smartphone, and the photographing unit 26 is, for example, a camera built into the smartphone. The user may view the image photographed by the photographing unit 26 as a video. The display unit 25 of the user terminal 2 is capable of displaying the image photographed by the photographing unit 26 in real time.

[0030] FIG. 4 is an explanatory diagram showing an example of the precut window frame database 121. The precut window frame database 121 stores information about precut window frames purchased by users. The management items (fields) of the precut window frame database include, for example, a user ID field, a window frame identification number field, a window frame height field, and a window frame width field. The user ID field stores the user ID of the user who purchased the precut window frame, and the window frame identification number field stores the window frame identification number assigned to the precut window frame for identifying the precut window frame. The window frame height field stores the height of the precut window frame. The window frame width field stores the width of the precut window frame. In this embodiment, the values ​​stored in the window frame height field and the window frame width field are the inner dimensions of the precut window frame, but the outer dimensions of the precut window frame or dimensions specified by the manufacturer may also be stored.

[0031] FIG. 5 is an explanatory diagram showing an example of the curtain database 122. The curtain database 122 stores sizes (height and width) of curtains that can be ordered by a manufacturer. The management items (fields) of the curtain database 122 include, for example, a curtain number field, a type field, a corresponding height field, a corresponding width field, a unit price field, a color field, and an AR image field. The curtain number field stores a curtain number for identifying each curtain. The type field stores the type of curtain. The corresponding height field stores a range of heights of pre-cut window frames that the curtain can support, and the corresponding width field stores a range of widths of pre-cut window frames that the curtain can support. The unit price field stores the price of the curtain per unit area (for example, 1 square meter). The color field stores color variations (multiple colors) of the curtain. The AR image field stores an AR image showing the appearance of the curtain, for example, in a file format.

[0032] FIG. 6 is an explanatory diagram showing an example of a precut window frame. FIG. 6A shows a precut window frame with a two-dimensional barcode B attached. A precut window frame is a window frame in which a horizontal frame and a building frame are manufactured, for example, in a factory, and assembled at a construction site and embedded in a wall or the like. A two-dimensional barcode B indicating a window frame identification number is attached to the precut window frame, for example, when it is manufactured in a factory. The user terminal 2 can obtain the window frame identification number of the precut window frame by photographing and reading the two-dimensional barcode B. In this embodiment, the two-dimensional barcode is attached to the lower right corner of the precut window frame, but the location where the two-dimensional barcode is attached is not limited to this. In addition, the two-dimensional barcode B may be attached to a delivery note or instruction manual that comes with the precut window frame. In addition, the two-dimensional barcode B may indicate the height and width of the precut window frame.

[0033] FIG. 6B shows a precut window frame with an RFID (Radio Frequency Identification) tag attached according to a modified example. An RFID tag T (communication tag) T is attached to the precut window frame according to the modified example. The RFID tag T records the window frame identification number of the precut window frame. The user terminal 2 can obtain the window frame identification number recorded in the RFID tag T by performing short-range wireless communication with the RFID tag T. The RFID may be attached to a delivery note or instruction manual that accompanies the precut window frame, and the height and width of the precut window frame may be recorded in the RFID tag T.

[0034] 7 is an explanatory diagram showing an example of an information transmission screen. When the photographing unit 26 photographs a two-dimensional barcode B, the terminal control unit 21 of the user terminal 2 reads the two-dimensional barcode B and causes the display unit 25 to display the window frame identification number specified based on the read two-dimensional barcode B on the information transmission screen. In addition, a transmission command (function button) is displayed on the information transmission screen. When the transmission command is selected, the terminal control unit 21 of the user terminal 2 transmits the window frame identification number to the information processing device 1.

[0035] FIG. 8 is an explanatory diagram showing an example of a curtain ordering screen. FIG. 9 is an explanatory diagram showing an example of a curtain AR display screen. The information processing device 1 specifies curtains compatible with the size of the precut window frame based on the window frame identification number of the precut window frame acquired from the user terminal 2, the size stored in the precut window frame database 121, and the compatible size of the curtains stored in the curtain database 122. The information processing device 1 transmits information on the specified curtains (information stored in the curtain database 122) to the user terminal 2. The terminal control unit 21 of the user terminal 2 causes the display unit 25 to display information on the curtains on the curtain ordering screen. In addition, on the curtain ordering screen, a curtain color selection field, a height input field and a width input field of the curtains to be ordered, a price field, a command to instruct AR display of the curtains, and a command to instruct ordering the curtains are displayed for each curtain.

[0036] In the curtain color selection field, a plurality of colors stored in the color field of the curtain database 122 are displayed, and it is possible to accept input of a selection of any one of the colors. In addition, the color selected on the curtain AR display screen described later is reflected in the color selection field on the curtain ordering screen.

[0037] In the curtain height input field, the same value as the height of the precut window frame is displayed as an initial value. Note that the input unit 24 can accept input of changes to the value entered in the input field within the range stored in the corresponding height field of the curtain database 122. Also, the size entered in the AR display screen for curtains, which will be described later, is reflected in the height input field of the curtain ordering screen.

[0038] In the curtain width input field, the same value as the width of the precut window frame is displayed as an initial value. Note that the input unit 24 can accept input of changes to the value entered in the width input field within the range stored in the corresponding width field of the curtain database 122. Also, the size entered in the AR display screen for curtains, which will be described later, is reflected in the width input field of the curtain ordering screen.

[0039] The price column displays the price required to order curtains, calculated based on the values ​​entered in the height and width input columns and the unit price of curtains. In other words, if the value entered in the height or width input column is changed, the price displayed in the price column will also change.

[0040] When the AR display command is selected, the terminal control unit 21 of the user terminal 2 causes the photographing unit 26 to photograph the precut window frame and causes the display unit 25 to display the AR display screen shown in FIG. 9. The AR display screen displays an AR display image, a color selection field, a height input field, a width input field, and a confirmation command. The AR display image is an image in which an AR image of curtains acquired from the information processing device 1 is superimposed on a photographed image photographed by the photographing unit 26. The user can input a change in color or the height or width (size) of curtains while checking the AR display image of curtains on the AR display screen. Specifically, when the color selected in the color selection field on the AR display screen is changed, the color of the curtains displayed in the AR display image is changed. Also, when the height or width is input in the height input field or width input field, the size of the curtains displayed in the AR display image is changed.

[0041] When a confirmation command is selected on the AR display screen, the terminal control unit 21 of the user terminal 2 causes the display unit 25 to display the curtain ordering screen again. At this time, the color selected on the AR display screen is displayed in the color selection field of the curtain ordering screen, the height input field displays the height input on the AR display screen, and the width input field displays the width input on the AR display screen. When an order command is selected on the curtain ordering screen, the terminal control unit 21 of the user terminal 2 transmits to the information processing device 1 the size of the precut window frame, the color and size of the ordered curtains, and the price of the ordered curtains.

[0042] 10 is a flowchart showing an example of processing by the information processing device 1 and the user terminal 2. The terminal control unit 21 of the user terminal 2 causes the photographing unit 26 to photograph the two-dimensional barcode B (S1). The terminal control unit 21 reads the two-dimensional barcode B from the photographed image (S2). The terminal control unit 21 acquires a window frame identification number based on the read two-dimensional barcode B (S3). The terminal control unit 21 causes the display unit 25 to display the window frame identification number (S4), and transmits (outputs) the window frame identification number to the information processing device 1 (S5).

[0043] The control unit 11 of the information processing device 1 receives (acquires) a window frame identification number from the user terminal 2 (S6). The control unit 11 refers to the precut window frame database 121 and reads out size information (height and width) of the user's precut window frame based on the received (acquired) window frame identification number (S7). The control unit 11 refers to the curtain database 122 and identifies curtains that can correspond to the size information based on the read out size information of the precut window frame (S8). The control unit 11 reads out information on the identified curtains from the curtain database 122 (S9) and transmits (outputs) the read out information on the curtains to the user terminal 2 (S10).

[0044] The terminal control unit 21 of the user terminal 2 receives (acquires) the specified information on curtains from the information processing device 1 (S11). The terminal control unit 21 causes the display unit 25 to display a curtain ordering screen including the received (acquired) information on curtains (S12). The terminal control unit 21 causes the photographing unit 26 to photograph the precut window frame (S13) and causes the display unit 25 to display an AR display screen (S14). The terminal control unit 21 causes the input unit 24 to accept an input for changing the color or size of the curtains (S15). The terminal control unit 21 causes the display unit 25 to display the curtain ordering screen again (S16), and transmits (outputs) curtain ordering information including the color, size, and price of the curtains to be ordered to the information processing device 1 (S17), and ends the process.

[0045] The control unit 11 of the information processing device 1 receives (acquires) order information for curtains from the user terminal 2 (S18). The control unit 11 calculates a fee for the manufacturer of the curtains based on the price of the curtains included in the order information (S19). In S19, the control unit 11 calculates a fee of, for example, 5% of the price of the ordered curtains. The control unit 11 transmits (outputs) size information of the precut window frames, order information for the curtains, and information related to the fee to the manufacturer terminal 3 (S20), and ends the process.

[0046] According to the above configuration and processing, information on compatible curtains is presented to the user based on size information of a pre-cut window frame measured in advance, so that it is possible to present the user with curtains that match the window frame with high accuracy. In addition, since it is possible to obtain order information for curtains whose color or size has been changed according to the user's preference, it is possible to increase the user's purchasing motivation. Note that the value stored in the height field or width field of the pre-cut window frame database 121 may be updated to a value measured after embedding the pre-cut window frame. According to this embodiment, even if the size of the pre-cut window frame after embedding is distorted, the information processing device 1 can identify curtains that correspond to the size information with high accuracy.

[0047] (Embodiment 2) The information processing device 1 according to the second embodiment stores the number of times each curtain has been ordered. The information processing device 1 transmits information about the curtain that has been ordered the most among the curtains that are compatible with the size information of the precut window frame to the user terminal 2. The following describes the differences between the second embodiment and the first embodiment. The other configurations, except for the configurations described below, are common to the first embodiment. For this reason, the components common to the first embodiment are given the same reference symbols as the first embodiment, and the description of those components will be omitted.

[0048] 11 is an explanatory diagram showing an example of the curtain database 122 according to the second embodiment. The curtain database 122 according to the second embodiment includes an order count field. The order count field stores the number of times curtains have been ordered. When the control unit 11 of the information processing device 1 receives (acquires) order information for curtains from the user terminal 2, the value stored in the order count field for the corresponding curtains is updated to a value incremented by 1.

[0049] FIG. 12 is an explanatory diagram showing an example of a curtain ordering screen according to the second embodiment. After identifying curtains compatible with the size information of the precut window frame, the control unit 11 of the information processing device 1 assigns a recommendation level based on the number of orders received, and transmits the identified curtains to the user terminal 2. The terminal control unit 21 of the user terminal 2 causes the display unit 25 to display information on the identified curtains and the recommendation level of each curtain on the curtain ordering screen. In this embodiment, the recommendation level is assigned to the curtain with the third most number of orders, and the curtain with the most number of orders is assigned a recommendation level of 3 (three stars). That is, the terminal control unit 21 of the user terminal 2 causes the display unit 25 to display the curtain with the most number of orders output from the information processing device as the curtain with the highest recommendation level.

[0050] Fig. 13 is a flowchart showing an example of the processing of the information processing device 1 and the user terminal 2 according to the second embodiment. Steps S31 to S39 are similar to steps S1 to S9 in Fig. 10. The control unit 11 of the information processing device 1 assigns a recommendation level to the identified curtains based on the number of orders included in the read information on the curtains (S40). The control unit 11 transmits (outputs) the read information on the curtains and the assigned recommendation level to the user terminal 2 (S41).

[0051] The terminal control unit 21 of the user terminal 2 receives (acquires) the information and recommendation level of the specified curtains from the information processing device 1 (S42). The terminal control unit 21 causes the display unit 25 to display a curtain ordering screen including the received (acquired) information and recommendation level of the curtains (S43). S44 to S51 are the same processes as S13 to S20 shown in FIG.

[0052] The control unit 11 of the information processing device 1 increments the value stored in the order count field of the curtain database 122 for the curtains about which order information has been sent to the manufacturer terminal 3 by 1 (S52), and ends the process.

[0053] According to the above configuration and process, by presenting the user with curtains that have been ordered many times as curtains with a high degree of recommendation, it is possible to provide an index for the user to decide which curtains to order, and to increase the user's willingness to purchase. Note that the degree of recommendation is not limited to one that is given based on the number of orders, but may be one that is given based on the unit price or the ratio of commission to the price, etc.

[0054] (Embodiment 3) The information processing device 1 according to the third embodiment acquires information of the user who purchased the precut window frame, information of the building in which the precut window frame is to be installed, and information of the room in which the precut window frame is to be installed, which are inputted to the user terminal 2. The information processing device 1 inputs the information and size information acquired from the user terminal into a model that has been trained to output recommended curtains (recommended curtains) based on the inputted information and size information of the precut window frame, and outputs and identifies the recommended curtains. The other configurations, except for the configuration described below, are common to the first embodiment. For this reason, the same reference symbols as those in the first embodiment are used for the components common to the first embodiment, and the description of those components will be omitted.

[0055] 14 is a block diagram showing an example of the configuration of an information processing device 1 according to embodiment 3. The storage unit 12 of the information processing device 1 according to embodiment 3 stores a recommended curtains output model M1. Details of the recommended curtains output model will be described later.

[0056] FIG. 15 is an explanatory diagram showing an example of an information transmission screen according to the third embodiment. The information transmission screen according to the third embodiment displays a user information input field, a building information input field, and a room information input field. The user information input field is a field for accepting input of information of a user who has purchased a precut window frame, and includes a gender field, an age field, and a family structure field. The input unit 24 of the user terminal 2 accepts input of a selection of user information in each field. The building information input field is a field for accepting input of information of a building in which a precut window frame is to be installed, and includes a type field, a location field, and a neighboring building field. The input unit 24 of the user terminal 2 accepts input of a selection of building information in each field. In the neighboring building field, a selection of the distance (5 m or more or less than 5 m) to a neighboring building is input. The room information input field is a field for accepting input of information of a room in which a precut window frame is to be installed, and includes a floor material field, a floor color field, and a purpose field. The input unit 24 of the user terminal 2 accepts input of a selection of room information in each field. In addition, the information transmission screen may display input fields other than those described above, such as the direction in which the precut window frame will be installed or the floor number of the room.

[0057] FIG. 16 is an explanatory diagram showing an example of the recommended curtains output model M1. The recommended curtains output model M1 is, for example, a trained model configured by a neural network and generated by machine learning. The input layer included in the recommended curtains output model M1 has a plurality of neurons that accept input of user information, building information, and room information (input information) received (acquired) from the user terminal 2, as well as size information of a pre-cut window frame specified based on a window frame identification number, and passes the input user information to the intermediate layer. The intermediate layer has a plurality of neurons that extract information features of the user information, and passes the extracted information features to the output layer. The output layer outputs the curtain number of the recommended curtains based on the information features output from the intermediate layer. The recommended curtains output model M1 may be CNN, R-CNN, Fast R-CNN, Faster R-CNN, SSD, YOLO, or the like. The recommended curtains output model M1 may also be based on a method other than a neural network, such as a decision tree, a k-nearest neighbor method, or an SVM.

[0058] The recommended curtains output model M1 learns using training data that associates the input information entered by the user on the information transmission screen and size information of pre-cut window frames with the curtain numbers of curtains actually ordered by the user. The control unit 11 creates training data that associates the input information acquired from the user terminal 2 as input values ​​and the curtain numbers included in the information related to the order acquired from the user terminal 2 as correct output values. The recommended curtains output model M1 learns or re-learns by learning weights in the intermediate layer so that the difference between the curtain number output when input information is input and the training data becomes small. The control unit 11 creates training data every time it acquires order information from the user terminal 2, for example, and re-learns the recommended curtains output model M1.

[0059] Fig. 17 is an explanatory diagram showing an example of a curtain order receiving screen according to the third embodiment. The control unit 11 of the information processing device 1 refers to the curtain database 122 to identify recommended curtains based on the curtain number output by the recommended curtains output model M1. The control unit 11 of the information processing device 1 reads information on the recommended curtains from the curtain database 122 and transmits it to the user terminal 2. The terminal control unit 21 of the user terminal 2 causes the display unit 25 to display the information on the recommended curtains received (acquired) from the information processing device 1 on the curtain order receiving screen. In the example shown in Fig. 17, information on curtains that are compatible with the size information identified based on the size information of precut window frames as in the first embodiment is also displayed.

[0060] Fig. 18 is a flowchart showing an example of the processing of the information processing device 1 and the user terminal 2 according to embodiment 3. Steps S61 to S64 are similar to steps S1 to S4 shown in Fig. 10. The terminal control unit 21 of the user terminal 2 causes the input unit 24 to accept input of input information including user information, building information, and room information (S65). The terminal control unit 21 transmits (outputs) the window frame identification number and the input information to the information processing device 1 (S66).

[0061] The control unit 11 of the information processing device 1 receives (acquires) the window frame identification number and input information from the user terminal 2 (S67). The control unit 11 refers to the precut window frame database 121 and reads out size information (height and width) of the user's precut window frame based on the received (acquired) window frame identification number (S68). The control unit 11 inputs the input information and size information to the recommended curtains output model M1 (S69) and outputs the curtain number of the recommended curtains (S70). The control unit 11 also refers to the curtain database 122 and identifies curtains that can correspond to the size information based on the read out size information of the precut window frame (S71). The control unit 11 reads out information on the recommended curtains and the identified curtains from the curtain database 122 (S72) and transmits (outputs) the read out curtain information to the user terminal 2 (S73).

[0062] The terminal control unit 21 of the user terminal 2 receives (acquires) information on the recommended curtains and the specified curtains from the information processing device 1 (S74). The terminal control unit 21 causes the display unit 25 to display a curtain ordering screen including the received (acquired) curtain information (S75). Steps S76 to S83 are the same processes as steps S13 to S20 shown in FIG.

[0063] According to the above configuration and processing, it is possible to present the user with information on appropriate curtains depending on the user who purchased the precut window frame or the building or room in which the precut window frame is to be installed.

[0064] (Embodiment 4) A room image in which a precut window frame is to be installed, photographed by a user terminal 2 according to the fourth embodiment, is acquired, objects around the precut window frame in the room image are recognized, and curtains that can be installed in the precut window frame are identified based on the distance between the precut window frame and the objects. The configuration other than the configuration described below is the same as that of the first embodiment. Therefore, the components common to the first embodiment are given the same reference symbols as those of the first embodiment, and the description of those components is omitted.

[0065] 19 is a block diagram showing an example of the configuration of an information processing device 1 according to embodiment 4. The storage unit 12 of the information processing device 1 according to embodiment 4 stores an object detection model M2 and a distance calculation module M3. Details of the object detection model M2 and the distance calculation module M3 will be described later.

[0066] 20 is an explanatory diagram showing an example of the curtain database 122 according to the fourth embodiment. The curtain database 122 according to the fourth embodiment includes a required space height field and a required space width field. The required space height field stores the height of a range from the top frame of a precut window frame where no objects are present, which is necessary when installing curtains, etc. The required space width field stores the width of a range from the side frame of a precut window frame where no objects are present, which is necessary when installing curtains, etc.

[0067] 21 is an explanatory diagram showing an example of an information transmission screen according to the fourth embodiment. After reading the two-dimensional barcode B, the terminal control unit 21 of the user terminal 2 according to the fourth embodiment causes the photographing unit 26 to photograph a room image of the room in which the pre-cut window frame is to be installed. The information transmission screen according to the fourth embodiment displays the window frame identification number, the photographed room image, and a transmission command. When the transmission command is selected, the terminal control unit 21 of the user terminal 2 transmits the window frame identification number and the room image to the information processing device 1.

[0068] FIG. 22 is an explanatory diagram showing an example of the object detection model M2. The object detection model M2 is a learning model that detects an object included in a room image, such as RCNN (Regions with Convolutional Neural Network), Fast RCNN, Faster RCNN, SSD (Single Shot Multibook Detector), or YOLO (You Only Look Once). When the object detection model M2 is configured with a neural network including a CNN (Convolutional Neural Network) that extracts image features such as RCNN, the object detection model M2 has a plurality of neurons that accept input of pixel values ​​of the room image, and passes the input pixel values ​​to an intermediate layer. The intermediate layer has a plurality of neurons that extract image features of the room image, and passes the extracted image features to an output layer. The output layer outputs the type and position of objects including a wall surface, a ceiling surface, or an outlet in the room image based on the image features. The control unit 11 may output the type and position of each object by a method such as pattern matching.

[0069] FIG. 23 is an explanatory diagram showing an example of the distance calculation module M3. The distance calculation module M3 is based on a markerless AR technique including, for example, PTAM or SmartAR. The control unit 11 of the information processing device 1 inputs a room image (object detection image) in which the type and position of the object output by the object detection model M2 are indicated, to the distance calculation module M3. The distance calculation module M3 outputs the height or width distance between each object in the object detection image and the precut window frame, and indicates it in the object detection image. Note that the control unit 11 of the information processing device 1 may measure the distance between the precut window frame and the object by a function such as Lidar (Light Detection And Ranging) or an infrared sensor provided in the user terminal 2, or may measure based on mapping by SLAM (Simultaneous Localization and Mapping) technology. Also, a marker may be installed in the room and the distance may be measured by a marker-type AR technique, or the distance may be estimated based on the size information of the precut window frame in the room image and the precut window frame identified based on the window frame identification number.

[0070] Fig. 24 is a flowchart showing an example of the processing of the information processing device 1 and the user terminal 2 according to the fourth embodiment. Steps S91 to S93 are similar to steps S1 to S3 shown in Fig. 10. The terminal control unit 21 of the user terminal 2 causes the photographing unit 26 to photograph a room image of the room in which the precut window frame is to be installed (S94). The terminal control unit 21 causes the display unit 25 to display the window frame identification number and the room image (S95), and transmits (outputs) the window frame identification number and the room image to the information processing device 1 (S96).

[0071] The control unit 11 of the information processing device 1 receives (acquires) the window frame identification number and the room image from the user terminal 2 (S97). The control unit 11 refers to the precut window frame database 121 and reads out the size information (height and width) of the user's precut window frame based on the received window frame identification number (S98). The control unit 11 inputs the room image to the object detection model M2 (S99) and outputs the type and position of the object in the room image (S100). The control unit 11 inputs the room image (object detection image) in which the type and position of the object are indicated to the distance calculation module M3 (S101) and outputs the distance between each object and the precut window frame (S102). The control unit 11 refers to the curtain database 122 and identifies curtains that can be installed in the precut window frame based on the size information of the precut window frame and the distance between each object and the precut window frame (S103). Specifically, the control unit 11 specifies, among the curtains that can correspond to the size information specified based on the size information, those curtains whose value in the space required height field is smaller than the distance from the precut window frame to the object closest in the height direction and whose value in the space required width field is smaller than the distance from the precut window frame to the object closest in the width direction. The control unit 11 reads out information on the specified curtains from the curtain database 122 (S104), and transmits the read information on the curtains to the user terminal 2 (S105). Steps S106 to S115 are the same processes as steps S11 to S20 shown in FIG. 10.

[0072] According to the above configuration and processing, the information processing device 1 identifies curtains that can be installed based on objects around a precut window frame, making it possible to prevent ordering curtains that cannot be installed in a precut window frame.

[0073] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The technical features described in each embodiment can be combined with each other, and the scope of the present invention is intended to include all modifications within the scope of the claims and equivalents to the scope of the claims. In addition, the independent claims and dependent claims described in the claims can be combined with each other in all combinations regardless of the reference format. Furthermore, the claims use a format in which a claim references two or more other claims (multiple claim format), but this is not limited to this. A format in which a multiple claim (multi-multi claim) that references at least one multiple claim may be used. [Explanation of symbols]

[0074] 1. Information processing device 11 Control section 12 Storage section 121 Precut Window Frame Database 122 Curtain Database M1 Recommended Curtain Output Model M2 Object Detection Model M3 Distance Calculation Module 12a Storage medium 13. Communications Department 2. User terminal 21 Terminal control unit 22 Memory section 22a Storage medium 23 Communications Department 24 Input section 25 Display section 26 Photography Department 3 Manufacturer terminal B 2D barcode N Network P Program Pa App Program S Curtain ordering system T RFID tag (communication tag)

Claims

1. Obtaining a window frame identification number that identifies a pre-cut window frame from a user terminal owned by the user; Refer to a window frame database in which size information of the precut window frame is recorded in correspondence with the window frame identification number, and read out the size information corresponding to the acquired window frame identification number; Identifying a curtain or blind that corresponds to the size information by referring to a curtain database in which a range of sizes of the pre-cut window frames that can be used with the curtain or blind is recorded; Transmitting information about the identified curtain or blind to the user terminal. Information processing methods.

2. Identifying the window frame identification number based on a window frame code attached to the pre-cut window frame and read by the user terminal. The information processing method according to claim 1 .

3. The window frame identification number is obtained by reading a communication tag attached to the precut window frame and capable of communicating with the user terminal. The information processing method according to claim 1 .

4. Acquire a captured image of the precut window frame from the user terminal; The identified curtain or blind is displayed on the captured image in an AR manner; Accepting an input for changing the color or size of the curtain or blind to be displayed on the captured image in AR 3. The information processing method according to claim 1.

5. Obtain ordering information for the identified curtains or blinds; Calculate the commission to the manufacturer of the ordered curtains or blinds; The size information of the precut window frame, the order information of the specified curtain or blind, and the information regarding the fee are output to a manufacturer terminal owned by the manufacturer.

3. The information processing method according to claim 1.

6. The curtain database records the number of times that a curtain or blind has been ordered in association with the curtain or blind, When the window frame identification number is acquired, information regarding the curtain or blind that has been ordered the most among the curtains or blinds that are compatible with the size information of the precut window frame is output to the user terminal.

3. The information processing method according to claim 1.

7. Identifying recommended curtains or blinds based on information of a user who purchased the precut window frame, information of a building in which the precut window frame is to be installed, or information of a room in which the precut window frame is to be installed, including flooring, floor color, or use.

3. The information processing method according to claim 1.

8. Acquire from the user terminal a room image of a room in which the precut window frame is to be installed; Recognizing objects around the pre-cut window frame in the room image; Calculating a distance between the pre-cut window frame and the object; Identifying curtains or blinds that can be installed in the pre-cut window frame based on the distance.

3. The information processing method according to claim 1.

9. Obtaining a window frame identification number that identifies a pre-cut window frame from a user terminal owned by the user; Refer to a window frame database in which size information of the precut window frame is recorded in correspondence with the window frame identification number, and read out the size information corresponding to the acquired window frame identification number; Identifying a curtain or blind that corresponds to the size information by referring to a curtain database in which a range of sizes of the pre-cut window frames that can be used with the curtain or blind is recorded; Transmitting information about the identified curtain or blind to the user terminal. A program that causes a computer to carry out processing.

10. Obtaining a window frame identification number that identifies a pre-cut window frame from a user terminal owned by the user; Refer to a window frame database in which size information of the precut window frame is recorded in correspondence with the window frame identification number, and read out the size information corresponding to the acquired window frame identification number; Identifying a curtain or blind that corresponds to the size information by referring to a curtain database in which a range of sizes of the pre-cut window frames that can be used with the curtain or blind is recorded; Transmitting information about the identified curtain or blind to the user terminal. Processing section An information processing device comprising:

Images