Information processing apparatus, view screen presentation method, and program

Abstract

To provide a technique to create a coordination plan for a room by using a creation model.SOLUTION: An aspect of the present disclosure relates to an information processing apparatus having: an acquisition unit that acquires room information to be coordinated and a coordination condition; a coordination plan presentation unit that acquires a coordination plan from the room information to be coordinated and the coordination condition by using a creation model trained to create a coordination plan on the basis of the room information and the coordination condition, and presents the coordination plan; and a view screen presentation unit that presents a view screen of the coordination plan designated from the coordination plan.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a view screen presentation method, and a program. [Background technology]

[0002] With the spread of information and communication technology, the provision of services using information processing devices such as personal computers, smartphones, and tablets is expanding to various industries and business areas. These services may be provided from cloud servers or by apps installed on the information processing devices.

[0003] For example, when purchasing furniture or interior items, it is desirable to be able to confirm in advance how the furniture or interior items to be purchased can be arranged in a room. A user can refer to a virtual layout view screen displayed on an information processing terminal before making a purchase. For example, techniques for three-dimensionally displaying a furnished room have been proposed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2023-031310 Summary of the Invention [Problem to be solved by the invention]

[0005] With the recent advancement of artificial intelligence (AI), AI technology is being used in a variety of technical and industrial fields. In particular, the emergence of generative AI models is having a major impact on society as a whole. For example, efforts to utilize data generated by generative AI models in business are expected to increase and expand in the future.

[0006] In view of the above problems, an object of the present disclosure is to provide a technology for generating a room coordination plan using a generative model. [Means for solving the problem]

[0007] One aspect of the present disclosure relates to an information processing device having an acquisition unit that acquires room information and coordination conditions of a coordination target, a coordination plan presentation unit that acquires a coordination plan from the room information and coordination conditions of the coordination target using a generation model trained to generate a coordination plan based on the room information and the coordination conditions and presents the coordination plan, and a view screen presentation unit that presents a view screen of a coordination plan specified from the coordination plan. [Effects of the Invention]

[0008] According to the present disclosure, a technology for generating a room coordination plan using a generative model can be provided. [Brief explanation of the drawings]

[0009] [Figure 1] 1A to 1C are schematic diagrams illustrating a coordination plan generation process according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a block diagram illustrating a hardware configuration of an information processing device according to an embodiment of the present disclosure. [Figure 3] FIG. 3 is a block diagram illustrating a functional configuration of an information processing device according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a schematic diagram illustrating a coordination plan generation model according to one embodiment of the present disclosure. [Figure 5] 5A and 5B are diagrams illustrating a view screen according to one embodiment of the present disclosure. [Figure 6] 6A and 6B are diagrams illustrating a view screen according to one embodiment of the present disclosure. [Figure 7]FIG. 7 is a flowchart illustrating a coordination plan generation process according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0011] In the following embodiment, an information processing device that generates a room coordination plan using a generative model is disclosed.

[0012] [overview] First, a description will be given of a coordination plan generation process according to an embodiment of the present disclosure. Figures 1A to 1C are schematic diagrams illustrating a coordination plan generation process according to an embodiment of the present disclosure.

[0013] The information processing device 100 accepts room information and coordination conditions from the user on an input screen for room information and coordination conditions as shown in Fig. 1A. In the example shown in Fig. 1A, the room information to be coordinated includes a living / dining / kitchen (LDK), a bedroom, and a children's room, and the LDK is selected by the user. The user also inputs the registered floor plan, total budget, purchased furniture, and style as coordination conditions.

[0014] When room information and coordination conditions to be coordinated are specified on the input screen shown in the figure, the information processing device 100 inputs the specified room information and coordination conditions into the coordination plan generation model 20 and acquires a coordination plan from the coordination plan generation model 20. For example, the coordination plan generation model 20 generates four coordination plans for the room information and coordination conditions specified by the user shown in FIG. 1A, and the information processing device 100 presents the user with a list of coordination plans as shown in FIG. 1B. In the example shown in FIG. 1B, for each coordination plan, a layout thumbnail image in which furniture is arranged on a floor plan of the room, product information such as the product names of the furniture to be arranged, and a budget required for the coordination are presented.

[0015] When the user specifies a desired coordination plan from the coordination plans acquired from the coordination plan generation model 20, the information processing device 100 generates a view screen of the specified coordination plan and presents the generated view screen to the user. For example, the information processing device 100 may present a three-dimensional view screen as shown in FIG. 1C to the user. The presented three-dimensional view screen allows the user to check the coordination plan in more detail.

[0016] According to the coordination plan generation process of the following embodiment, a coordination plan is generated by the coordination plan generation model 20 based on the room information and coordination conditions of the coordination target specified by the user, and the generated coordination plan is presented to the user.

[0017] The information processing device 100 that executes such a coordination plan generation process may be realized by a cloud server communicatively connected to a user terminal, or may be realized by an app installed on the user terminal. For example, when the information processing device 100 is realized by a cloud server, the coordinate plan generation model 20 may be stored and executed on the cloud server, or may be stored and executed on another cloud server. Furthermore, when the information processing device 100 is realized by an app on a user terminal, the coordinate plan generation model 20 may be stored and executed on the user terminal, or may be stored and executed on a cloud server.

[0018] Here, the information processing device 100 may have, for example, a hardware configuration as shown in Fig. 2. That is, the information processing device 100 has a storage device 101, a memory device 102, a processor 103, and a communication device 104, which are interconnected via a bus B.

[0019] Programs and / or data that realize various functions and processes in the information processing device 100 are downloaded to the storage device 101 or memory device 102 via the communication device 104 from an external device and / or a network.

[0020] The storage device 101 is realized by a nonvolatile memory or the like, and stores installed or downloaded programs or data (for example, files, etc.).

[0021] The memory device 102 is realized by a random access memory, a static memory, or the like, and when a program or instruction is activated, reads and stores the program, instruction, data, or the like from the storage device 101. The storage device 101, the memory device 102, and the removable storage medium may be collectively referred to as a non-transitory storage medium.

[0022] The processor 103 may be realized by one or more CPUs (Central Processing Units), GPUs (Graphics Processing Units), processing circuitry, etc., which may be composed of one or more processor cores, and performs various functions and processes of the information processing device 100 in accordance with programs, instructions, data such as parameters required to execute the programs or instructions, etc. stored in the memory device 102.

[0023] The communication device 104 is realized by various communication circuits that execute wired and / or wireless communication processing with external devices, the Internet, a LAN (Local Area Network), a cellular network, or other communication networks.

[0024] However, the above-described hardware configuration is merely an example, and the information processing device 100 according to the present disclosure may be realized by any other appropriate hardware configuration.

[0025] [Information processing device] Next, an information processing device 100 according to an embodiment of the present disclosure will be described. Fig. 3 is a block diagram showing a functional configuration of the information processing device 100 according to an embodiment of the present disclosure. As shown in Fig. 3, the information processing device 100 has an acquisition unit 110, a coordination plan presentation unit 120, and a view screen presentation unit 130. Each of the functional units of the acquisition unit 110, the coordination plan presentation unit 120, and the view screen presentation unit 130 can be realized by the processor 103 of the information processing device 100 executing a program stored in the memory device 102.

[0026] The acquisition unit 110 acquires room information and coordination conditions to be coordinated. Specifically, the acquisition unit 110 prompts the user to select the type of room to be coordinated, such as a living / dining / kitchen (LDK), bedroom, or children's room, via an input screen such as that shown in FIG. 1A. For example, on the input screen shown in FIG. 1A, "LDK" is selected as the room information to be coordinated. However, the room information is not necessarily limited to these and may include, for example, information on one or more of the room's three-dimensional shape, home appliances, lighting, wiring devices, air conditioner, color, and room type. That is, the room information may be described by space definition (e.g., floor, walls, ceiling, etc.), room functions (e.g., home appliances such as doors, windows, kitchen, and storage, lighting, outlets, media panels, switches, wiring devices such as fire alarms, air conditioners, etc.), etc. Furthermore, the room information may include three-dimensional position and size, functions, and attributes. Examples of functions include opening / closing and illumination angle, and examples of attributes include color and room type.

[0027] The acquisition unit 110 also prompts the user to input coordination conditions for the selected room via an input screen such as that shown in FIG. 1A. For example, the coordination conditions may include information on one or more of the floor plan, furniture type, brand, size, color, design, quantity, theme, taste, number of people living in the room, and budget. Here, the theme may indicate lifestyle, minimalism, priority on household flow, easy tidying, openness, etc. The taste may indicate natural, modern, hotel-like, cafe, vintage, etc. The number of people living in the room may indicate single living, couple, nuclear family, two-generation family, etc. In the input screen shown in FIG. 1A, the budget of "400,000 yen," the furniture to be purchased ("bed, sofa, TV stand"), and the style ("Scandinavian style") are input. The floor plan is applied from a registered source.

[0028] The acquisition unit 110 passes the acquired room information and coordination conditions of the coordination target to the coordination plan presentation unit 120.

[0029] The coordination plan presenting unit 120 acquires a coordination plan from the room information and coordination conditions of the coordination target using a generation model trained to generate a coordination plan based on the room information and coordination conditions, and presents the coordination plan. Specifically, as shown in Fig. 4, the coordination plan presenting unit 120 uses a trained coordination plan generation model 20 to generate one or more coordination plans from the room information and coordination conditions acquired from the acquiring unit 110. Typically, the coordination plan presenting unit 120 may acquire multiple coordination plans from the coordination plan generation model 20 and present a list of the acquired coordination plans to the user, as shown in Fig. 1B.

[0030] Such a coordination plan generation model 20 can be realized as a machine learning model trained to receive room information and coordination conditions as input and generate a coordination plan corresponding to the received room information and coordination conditions. For example, a training data set is prepared in advance, in which various combinations of room information and coordination conditions are used as input training data and coordination plans corresponding to the input training data are used as output training data, and the coordination plan generation model 20 is trained using this training data set. Furthermore, the coordination plan generation model 20 may be stored in the information processing device 100, or may be stored on an external cloud server or the like of the information processing device 100.

[0031] Here, the coordination plan may be composed of furniture information about the furniture to be provided in the room (e.g., type, brand, size, color, design, number, etc.) and layout information about the furniture in the room (e.g., position, orientation, etc.). In other words, the output indicates which furniture should be placed in which position in the room and in what orientation.

[0032] For example, when the coordination plan generation model 20 is realized by a deep learning model such as a Transformer, training data for input of a training dataset is input to the coordination plan generation model 20 to be trained, and the parameters of the coordination plan generation model 20 to be trained are adjusted according to the backpropagation method based on the error between the processing result from the coordination plan generation model 20 to be trained and the corresponding training data for output.

[0033] The view screen presenting unit 130 presents a view screen of a coordination plan specified from the coordination plans. For example, as shown in Fig. 1B, a list of multiple coordination plans is presented to the user, and when the user selects one of the presented coordination plans, the view screen presenting unit 130 generates a view screen of the selected coordination plan and presents the generated view screen to the user, as shown in Fig. 1C. In the example shown in Fig. 1C, a 3D view and an orthocolor image of the selected coordination plan are presented to the user.

[0034] Here, the 3D view and / or orthocolor image may be generated by the coordinate plan generation model 20, or may be generated by applying any known rendering process to the coordinate plan generated from the coordinate plan generation model 20.

[0035] In one embodiment, the view screen presentation unit 130 may present furniture objects arranged in the three-dimensional view of the coordination plan in a manner that allows the user to move them. Also, in one embodiment, the view screen presentation unit 130 may present furniture objects arranged in the three-dimensional view of the coordination plan in a manner that allows the user to change them. For example, as shown in FIG. 5A , the view screen presentation unit 130 may move a sofa object along a guideline on the view screen. This allows the user to change the arrangement of furniture or change the furniture based on the generated coordination plan.

[0036] In one embodiment, the view screen presentation unit 130 may present alternative furniture information for furniture objects arranged in the three-dimensional view of the coordination plan. For example, as shown in FIG. 5B, the view screen presentation unit 130 may display a list of furniture items that match the attributes of the arranged general-purpose furniture. Then, when the user selects any piece of furniture from the displayed list of furniture items, the view screen presentation unit 130 may present product information for the selected furniture item, as shown in FIG. 6A.

[0037] In one embodiment, the view screen presentation unit 130 may present a website related to alternative furniture information. For example, when a user selects a link to product information shown in Fig. 6A, the view screen presentation unit 130 may direct the user to a website for purchasing the furniture, as shown in Fig. 6B. This allows the user to easily purchase the furniture presented in the coordination plan.

[0038] [Coordination plan generation process] Next, a coordination plan generation process according to an embodiment of the present disclosure will be described. The coordination plan generation process can be realized by information processing device 100, more specifically, by processor 103 of information processing device 100 executing a program stored in memory device 102. Figure 7 is a flowchart showing the coordination plan generation process according to an embodiment of the present disclosure.

[0039] 7, in step S101, the information processing device 100 acquires room information and coordination conditions for a room to be coordinated. For example, the room information may include information on one or more of the three-dimensional shape of the room, household equipment, lighting, wiring devices, air conditioner, color, and room type. The coordination conditions may include information on one or more of the type, brand, size, color, design, number, theme, taste, number of people living in the room, and budget.

[0040] In step S102, the information processing device 100 inputs the room information and coordination conditions to be coordinated into the coordination plan generation model 20. For example, a training data set is prepared in advance, in which various combinations of room information and coordination conditions are used as input training data, and one or more coordination plans corresponding to each combination are used as output training data, and the coordination plan generation model 20 can be trained using the training data set.

[0041] In step S103, the information processing device 100 acquires a coordination plan from the coordination plan generation model 20. For example, the information processing device 100 may cause the coordination plan generation model 20 to generate multiple coordination plans based on the room information and coordination conditions acquired in step S101. Each coordination plan may indicate the furniture to be placed in the room and the position and / or orientation of each piece of furniture in the room.

[0042] In step S104, the information processing device 100 presents a coordination plan. Specifically, the information processing device 100 may display a list of multiple coordination plans generated by the coordination plan generation model 20 on the user terminal. At this time, the list of coordination plans is displayed in a format that allows the user to select a desired coordination plan.

[0043] In step S105, the information processing device 100 presents a view screen of the specified coordination plan. That is, when the user specifies a coordination plan from the list of coordination plans, the information processing device 100 may present a 3D view screen of the specified coordination plan. At this time, the 3D view screen may be displayed so that the user can move and / or change furniture objects and the like displayed on the screen. Furthermore, when the user specifies a furniture object on the 3D view screen, the information processing device 100 may present product information corresponding to the specified furniture object and / or may guide the user to a site for purchasing the product.

[0044] According to the information processing device 100 described above, it is possible to present to the user a coordination plan that corresponds to the room information and coordination conditions specified by the user.

[0045] Although the examples of the present disclosure have been described in detail above, the present disclosure is not limited to the specific embodiments described above, and various modifications and variations are possible within the scope of the gist of the present disclosure as set forth in the claims. [Explanation of symbols]

[0046] 20 Coordination Plan Generation Model 100 Information processing device 110 Acquisition Department 120 Coordination Plan Presentation Section 130 View screen presentation section

Claims

1. an acquisition unit that acquires room information and coordination conditions to be coordinated; a coordinate plan presentation unit that acquires a coordinate plan from the room information and the coordination conditions of the coordination target using a generative model trained to generate a coordinate plan based on the room information and the coordination conditions, and presents the coordinate plan; a view screen presenting unit that presents a view screen of a coordinate plan designated from the coordinate plan; An information processing device having the above.

2. The information processing device according to claim 1 , wherein the view screen presenting unit presents furniture objects arranged in the three-dimensional view of the coordinate plan in a manner that allows the user to move them.

3. The information processing device according to claim 1 , wherein the view screen presenting unit presents furniture objects arranged in the three-dimensional view of the coordinate plan in a manner that allows the user to change them.

4. The information processing device according to claim 1 , wherein the view screen presenting unit presents alternative furniture information for furniture objects arranged in the three-dimensional view of the coordination plan.

5. The information processing device according to claim 4 , wherein the view screen presenting unit presents a site related to the substitute furniture information.

6. The information processing device according to claim 1 , wherein the room information includes information on one or more of a three-dimensional shape of the room, household equipment, lighting, wiring devices, air conditioners, colors, and room types.

7. The information processing device according to claim 1 , wherein the coordination conditions include information on one or more of furniture type, brand, size, color, design, number of pieces, theme, taste, number of people living in the home, and budget.

8. Acquiring room information and coordination conditions to be coordinated; acquiring a coordination plan from the room information and the coordination conditions of the coordination target using a generative model trained to generate a coordination plan based on room information and coordination conditions, and presenting the coordination plan; presenting a view screen of a coordinate plan designated from the coordinate plan; When the computer executes the view, the screen presents the method.

9. Acquiring room information and coordination conditions to be coordinated; acquiring a coordination plan from the room information and the coordination conditions of the coordination target using a generative model trained to generate a coordination plan based on room information and coordination conditions, and presenting the coordination plan; presenting a view screen of a coordinate plan designated from the coordinate plan; A program that causes a computer to execute the following.

Images