Information processor, method for processing information, and program

Abstract

To provide an information processor capable of outputting a layout drawing and other predetermined information on the basis of video taken of an office, an information processing method, and a program.SOLUTION: An information processor includes: an imaging unit for capturing a space in an office; a recognition unit for recognizing, from the image of the office captured by the imaging unit, the shape and the size of the space in the office and an object as a piece of furniture provided in the office; a determination unit for determining the type of at least a part of or all of objects recognized by the recognition unit; and an output unit for outputting predetermined information on the basis of the objects recognized by the recognition unit and the types of the objects determined by the determination unit.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program, and more particularly to an information processing device, an information processing method, and a program that can output a layout drawing and other predetermined information based on an image of an office. Regarding. [Background technology]

[0002] Conventionally, an information processing system that supports the design of offices and other spaces has been known, for example, the office layout presentation device disclosed in Patent Document 1. The office layout presentation device disclosed in Patent Document 1 acquires or sets a floor plan that indicates the shape and size of the office to be designed, and presents an office layout that matches the floor plan. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2021-105939 Summary of the Invention [Problem to be solved by the invention]

[0004] When designing an office space using conventional technology, it is first necessary to acquire or set a floor plan showing the shape and size of the office, as in Patent Document 1. However, some offices may not have a floor plan, or the existing floor plan may differ from the actual shape and size of the office due to expansions, renovations, etc. Furthermore, when changing the layout of an existing office, it is necessary to replace some of the existing fixtures and fittings with other fixtures and fittings or to change their placement. However, if the acquired floor plan is a paper drawing or a bitmap image drawing, it is necessary to create a drawing converted into a CAD (Computer Aided Design) format or the like so that the existing fixtures and fittings can be handled by an information processing system.

[0005] In view of the above problems, an object of the present invention is to provide an information processing device, an information processing method, and a program that can output layout drawings and other specified information based on video footage of an office.

[0006] The information processing device of the present invention, which has been made to solve the above-mentioned problems, is characterized by comprising: a photographing unit that photographs the space within an office; a recognition unit that recognizes the shape and size of the space and objects that are fixtures installed in the office from the photographed image; a determination unit that determines the type of object for some or all of the object; and an output unit that outputs specified information based on the object and the type of the object.

[0007] In the information processing device according to the present invention, the predetermined information may be a layout drawing that represents the arrangement of the objects in the office as a two-dimensional and / or three-dimensional drawing.

[0008] The information processing device of the present invention may further include a spatial taste designation unit that receives designation of a spatial taste indicating at least one of color, material, texture, or function, and the output unit may output the predetermined information based on the designated spatial taste.

[0009] The information processing device according to the present invention may further include a spatial concept designation unit that receives a designation of a spatial concept that indicates how workers work in the office, and the output unit may output the specified information based on the designated spatial concept.

[0010] In the information processing device according to the present invention, the predetermined information may be a list of the determined objects.

[0011] The information processing device of the present invention may be configured such that the output unit outputs a layout screen that displays the layout drawing, and the position and / or orientation of the object included in the layout drawing can be changed on the layout screen.

[0012] In the information processing device according to the present invention, the layout screen may further enable the object included in the layout drawing to be changed to another object recorded in advance.

[0013] In the information processing device according to the present invention, the predetermined information may be information relating to a cost for exchanging the object for the other object.

[0014] The information processing device of the present invention may be configured such that the output unit outputs a layout screen that displays the layout drawing, and that at least one of the position, shape, and size of the space and / or fixtures included in the layout drawing can be modified on the layout screen.

[0015] The information processing device according to the present invention may further include an object type estimation model generated by machine learning, in which the recognized object is used as input data and the type of the object is used as output data, and the determination unit may make the determination using the object type estimation model.

[0016] The information processing method of the present invention, which has been made to solve the above-mentioned problems, is an information processing method executed by a computer, and is characterized by comprising the steps of: photographing a space within an office; recognizing the shape and size of the space and objects that are fixtures installed in the office from the photographed image; determining the type of the object for some or all of the object; and outputting specified information based on the object and the type of the object. [Effects of the Invention]

[0017] In the information processing device according to the present invention, the recognition unit recognizes the image of the office space captured by the imaging unit, and the output unit outputs the image as predetermined information. With this configuration, the present invention can output a layout drawing and other predetermined information based on the image of the office. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a diagram illustrating a configuration of an information processing device according to an example embodiment of the present invention. [Figure 2] FIG. 10 is a flow diagram showing the flow of output of predetermined information in one example of the embodiment. [Figure 3] FIG. 10 is a diagram showing the configuration of a 3D layout screen in an example of the embodiment. [Figure 4] FIG. 10 is a diagram showing a state in which a list of spatial tastes is superimposed on a 3D layout screen in an example of the same embodiment. [Figure 5] FIG. 10 is a diagram showing the configuration of a 2D layout screen in an example of the embodiment. [Figure 6] FIG. 10 is a diagram showing a state in which an office space is being modified on a 2D layout screen in the example of the same embodiment. [Figure 7] FIG. 10 is a diagram showing a state in which a list of other objects is superimposed on the 2D layout screen in the example of the embodiment. [Figure 8] FIG. 10 is a diagram showing a configuration of an object list screen in an example of the same embodiment. [Figure 9] FIG. 10 is a diagram showing the configuration of a quote screen in an example of the same embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of the present invention will be described below with reference to the drawings. An information processing device 1 in this example of the present embodiment is a device that captures images of a space in an office and outputs a layout drawing of the office and other predetermined information based on the captured images, and as shown in Fig. 1, includes a capture unit 11, a recognition unit 12, a determination unit 13, an output unit 14, a space taste designation unit 15, a space concept designation unit 16, an object type estimation model 17, and a database 18.

[0020] The photographing unit 11 photographs the space within the office. Specifically, the photographing unit 11 in this embodiment is a camera provided in the information processing device 1, and the space within the office photographed by the photographing unit 11 is recorded in the information processing device 1 as a still image or a video image, and is treated as input data for the recognition unit 12, which will be described later.

[0021] In one example of this embodiment, the office may be, for example, one floor of a building, or a work space enclosed by partitions, etc., as long as the shape and size can be recognized from the image by the recognition unit 12 described below.

[0022] The recognition unit 12 recognizes the shape and size of the office space and the objects, such as fixtures and fittings, installed in the office from the video captured by the imaging unit 11. In one example of this embodiment, the recognition unit 12 generates 3D models of the office space and the objects installed in the office, each having the recognized shape and size, and records them in the information processing device 1.

[0023] The objects recognized by the recognition unit 12 may be desks, chairs, whiteboards, computers and other electronic devices, other furniture, windows, doors and other fixtures provided on the walls of the office, or both furniture and fixtures may be recognized as objects. Also, the objects recognized by the recognition unit 12 may be furniture only.

[0024] The determination unit 13 determines the type of object for some or all of the objects recognized by the recognition unit 12. The specific configuration of the object type may be selected arbitrarily, but in one example of this embodiment, the object type is information including category information indicating a general category of fixtures and fittings, such as chairs, desks, windows, doors, etc., and product information indicating a specific product of the fixture or fitting that belongs to that category. As will be described later, in one example of this embodiment, the information processing device 1 is provided with a product database 18a, and the product information is information indicating any of the products recorded in the product database 18a, or information indicating that the product is not any of the products recorded in the product database 18a.

[0025] The output unit 14 outputs predetermined information based on the object recognized by the recognition unit 12 and the type of object determined by the determination unit 13. In one example of this embodiment, the predetermined information is a 3D layout drawing, a 2D layout drawing, a list of objects, and an estimate. The output unit 14 outputs one or more of the above predetermined information collectively or selectively.

[0026] In one example of this embodiment, the 3D layout drawing is a drawing showing in three dimensions the arrangement of objects in the office space, the 2D layout drawing is a drawing showing in two dimensions the arrangement of objects in the office space, the object list is a list of objects arranged in the office space and the object type has been determined by the determination unit 13, and the estimate is an estimate of the cost of changing some or all of the objects recognized by the recognition unit 12 to other objects.

[0027] In one example of this embodiment, the output unit 14 selectively outputs one or more of the above-mentioned specified information to a display device (not shown) provided in the information processing device 1, but the output destination may be selected arbitrarily, and for example, instead of a display device, the information may be output as a file to the storage device of the information processing device 1 or another computer.

[0028] The space taste designation unit 15 receives a designation of a space taste indicating at least one of color, material, texture, and function. In one example of this embodiment, as will be described later, one or more space tastes and products corresponding to the space tastes are pre-recorded, and when a space taste is designated by an operation of the user of the information processing device 1, the output 14 outputs predetermined information based on the designated space taste.

[0029] The spatial concept designation unit 16 receives designation of a spatial concept that indicates the way workers work in the office. In one example of this embodiment, as will be described later, one or more spatial concepts and object arrangement patterns corresponding to the spatial concepts are recorded in advance, and when a spatial concept is designated by an operation of the user of the information processing device 1, the output unit 14 outputs predetermined information based on the designated spatial concept.

[0030] The object type estimation model 17 is a trained model generated by machine learning, in which an object recognized by the recognition unit 12 is used as input data and the type of the object is used as output data. Note that the specific configurations of the input data and output data may be selected arbitrarily. For example, the 3D model generated by the recognition unit 12 may be used as input data, or the feature amounts of the 3D model may be calculated and used as input data.

[0031] The database 18 is a database that manages information handled by the information processing device 1. The specific configuration of the database 18 may be selected arbitrarily, and for example, an RDBMS (Relational Database Management System) may be constructed in the information processing device 1 and used as the database 18, or a partial area of ​​an HDD (Hard Disk Drive), SSD (Solid State Drive), or other storage device provided in the information processing device 1 may be used as the database 18, or the database 18 may be configured using both an RDBMS and a partial area of ​​a storage device.

[0032] In one example of this embodiment, database 18 includes product database 18a, which contains 3D models of a predetermined product group of fixtures or fittings. The predetermined product group may be, for example, a product group manufactured and sold by a predetermined manufacturer, a product group of a predetermined series within the product group manufactured and sold by a predetermined manufacturer, or a product group regardless of manufacturer or series. Product database 18a pre-records, for each product belonging to the predetermined product group, the type of object corresponding to the product, a 3D model, and information related to the product, such as the product name, sales price, the product series to which it belongs, the date and time of release, and other product-related information, all of which are linked together.

[0033] The above is the configuration of the information processing device 1 according to an example of this embodiment. The specific hardware configuration of the information processing device 1 may be selected arbitrarily. The information processing device 1 may be configured from a single computer or other device, or from two or more computers or other devices. For example, a program that causes a computer to function as the information processing device 1 may be pre-recorded on a smartphone, tablet computer, or other computer with sufficient performance to function the recognition unit 12 and the determination unit 13. The recorded program may be loaded into the computer's memory and executed by a CPU (Central Processing Unit), causing the computer to function as the information processing device 1. Alternatively, the information processing device 1 may be configured by connecting a smartphone or tablet computer to a server computer or other computer via a network so that they can communicate with each other. Alternatively, the information processing device 1 may be configured using a stationary personal computer and a camera that can communicate with the computer. The specific execution method of the program may also be changed arbitrarily. For example, part or all of the program may be executed by a GPU (Graphics Processing Unit) instead of or in addition to the CPU.

[0034] Next, the flow of outputting layout drawings and other predetermined information in one example of this embodiment will be described. Fig. 2 is a flow diagram showing the flow of outputting layout drawings and other predetermined information in one example of this embodiment. As shown in Fig. 2, in outputting predetermined information using the information processing device 1 in one example of this embodiment, first, an image of the space in the office is taken using the photographing unit 11 of the information processing device 1 (step S1).

[0035] After the image of the office space is captured in step S1, the information processing device 1 then causes the recognition unit 12 to recognize the shape and size of the office space and objects installed in the office (step S2). Specifically, in step S2, the space is recognized (step S21) and objects are recognized (step S22).

[0036] In step S21, the shape and size of the office space are recognized. In one example of this embodiment, a 3D model of the shape and size of the space constituted by the walls and floor of the office included in the video captured by the imaging unit 11 is generated and recorded.

[0037] In one example of this embodiment, the 3D model is generated as a file in a predetermined CAD format. The specific configuration of the 3D model may be selected arbitrarily. For example, instead of a predetermined CAD format file, a group of 3D coordinates of the faces and vertices that make up each of the floor and wall surfaces may be generated. In one example of this embodiment, the generated 3D model is recorded in database 18, but the method for recording the generated information may also be selected arbitrarily. For example, the generated information may be recorded as a file in a predetermined area of ​​a storage device of information processing device 1.

[0038] Additionally, in step S21, office information, which is information about the office, is generated together with the 3D model and recorded in database 18. As described above, in this example of the present embodiment, the 3D model is generated as a file in a predetermined CAD format, but information that cannot be recorded in a file in the predetermined CAD format or information that is managed separately from the CAD format file is recorded as office information in database 18. The office information in this example of the present embodiment is configured to include the name and address of the office, comments from the photographer, and other information.

[0039] Step S22 recognizes objects in the office. As described above, step S21 recognizes the shape and size of the office space and generates a 3D model, and step S22 also recognizes objects in the office and generates and records each of the objects as a 3D model.

[0040] As described above, the objects in this example embodiment are desks, chairs, whiteboards, and other furniture, or windows, doors, and other fixtures. In step S22, a 3D model representing the shape and size of each object included in the captured video of the office is generated and recorded. The generated 3D model may be recorded so as to be included in the 3D model of the office space generated in step S21 described above, or a 3D model for each object may be generated and recorded as a file in a predetermined CAD format, separate from the 3D model of the office space.

[0041] Furthermore, in step S22, a 3D model of the object is generated, and object information, which is information relating to the object, is also generated and recorded in database 18. As in step S21, in step S22, the 3D model of the object is generated as a file in a predetermined CAD format, but the type of object and other information that cannot be recorded in a file in the predetermined CAD format, and information that is managed separately from the CAD format file, are recorded as object information in database 18. Also, as described above, the 3D model of the office space and the 3D models of the objects may be generated as separate CAD format files, but in this case, information indicating where in the office each object is placed and in what orientation is also recorded as object information in database 18. The type of object is also recorded in database 18 as information constituting the object information in step S3, which will be described later.

[0042] After the office space and objects are recognized in step S2, the determination unit 13 of the information processing device 1 then determines the types of some or all of the recognized objects (step S3).

[0043] In one example of the present embodiment, as described above, the information processing device 1 is equipped with the object type estimation model 17 generated by machine learning. The object type estimation model 17 is an estimation model that uses the object recognized in step S22 as input data and the object type as output data, and in step S3, the object type estimation model 17 is used to determine the object type for all or part of the objects recognized in step S22. Note that the specific configuration of the input and output data may be selected arbitrarily, but in this example of the present embodiment, the input data is generated based on the 3D model generated in step S22.

[0044] Furthermore, when generating the object type estimation model 17 by machine learning, the way in which the training data is generated may be selected arbitrarily. As described above, in one example of this embodiment, the product database 18a records a 3D model of a specific object product and the type of object to which the product corresponds. For example, some or all of the training data may be created based on the 3D model and the type of object to which the product corresponds, recorded in the product database 18a.

[0045] Furthermore, in this example of the present embodiment, the object type is determined using the object determination estimation model 17 as described above, but the method for determining the object type may be selected arbitrarily, and a determination process using a predetermined algorithm may be performed instead of or in addition to an estimation model generated by machine learning. For example, the information processing device 1 in this example of the present embodiment includes a product database 18a in which 3D models and corresponding object types for a predetermined product group are pre-recorded. Using this, for an object recognized and a 3D model generated in step S22, in step S3, the feature amounts of the generated 3D model may be calculated, and the type of object corresponding to the product represented by the 3D model with the most similar feature amounts may be obtained from the product database 18a to perform determination.

[0046] Once the type of object is determined in step S3, predetermined information is then output by the output unit 14. In one example of this embodiment, as described above, the predetermined information is output collectively or selectively in part, including the 3D layout drawing, the 2D layout drawing, the object list, and the quotation. Note that in one example of this embodiment, as will be described later, the predetermined information is output to a display device provided in the information processing device 1 as a predetermined screen; however, instead of outputting to a display device, for example, a file in a predetermined format may be output to a predetermined storage device or the like.

[0047] 3 is a diagram showing the configuration of a 3D layout screen W1 in one example of this embodiment. The 3D layout screen W1 is a screen that displays a 3D layout drawing output as predetermined information in the above-mentioned step S4. As shown in FIG. 3, the 3D layout screen W1 in one example of this embodiment is a screen that displays a 3D layout drawing W14 that shows, as a three-dimensional drawing, the arrangement of objects in an office space W13 that is made up of a wall surface W11 made up of walls and pillars and a floor surface W12.

[0048] In this example of the present embodiment, the office space and objects installed in the office are recognized and 3D models are generated in step S2, but how the 3D layout drawing W14 is generated from the 3D models may be selected arbitrarily. For example, in this example of the present embodiment, the office information related to the office is generated together with a 3D model of the office space in step S21, and object information related to each object is generated together with a 3D model of the object in step S22. However, if the office information and object information are not directly necessary for outputting the 3D layout drawing W14, the output unit 14 may be configured to render the 3D models and output them as the 3D layout drawing W14.

[0049] In addition, in this example of the present embodiment, a space taste specification button W15 and a space concept specification button W16 are displayed on the 3D layout screen W1.

[0050] The space taste specification button W15 is a button for specifying a space taste indicating one or more of color, material, texture, or function. As described above, the information processing device 1 in one example of this embodiment is equipped with a space taste specification unit 15 that receives a space taste specification, and when a user presses the space taste specification button W15, a list of specifiable space tastes is superimposed on the 3D layout screen W1. In one example of this embodiment, one or more space tastes are pre-recorded in the database 18, linked to products corresponding to the space tastes. The space taste specification unit 15 acquires one or more space tastes from the database 18 and superimposes them on the 3D layout screen W1.

[0051] 4 is a diagram showing a state in which a list of space tastes W17 is superimposed on a 3D layout screen W1 in an example of this embodiment. As shown in FIG. 4, the list of space tastes W17 superimposed on the 3D layout screen W1 includes, for each of the space tastes that can be specified, an image W17a of a corresponding product, a color W17b of the product, and a name W17c of the space taste.

[0052] When the user of the information processing device 1 selects an arbitrary space taste from the displayed space taste list, the space taste designation unit 15 assumes that the selected space taste has been designated and changes the objects installed in the office to products corresponding to the designated space taste. When the space taste designation unit 15 has completed the change of the objects, the information processing device 1 re-outputs the 3D layout drawing W14 from the output unit 15 and displays it on the 3D layout drawing W1.

[0053] The spatial concept designation button W16 is a button for designating a spatial concept that indicates how workers work in an office. As described above, the information processing device 1 in one example of this embodiment is equipped with a spatial concept designation unit 16 that receives the designation of a spatial concept, and when a user presses the spatial concept designation button W16, a list of designable spatial concepts is superimposed on the 3D layout screen W1. In one example of this embodiment, one or more spatial concepts and information indicating the arrangement pattern of objects for each spatial concept are linked and pre-recorded in the database 18. The spatial concept designation unit 16 acquires one or more spatial concepts from the database 18 and superimposes them on the 3D layout screen W1.

[0054] The specific configuration of the spatial concept may be selected arbitrarily, but in one example of this embodiment, one or more spatial concepts are set in advance based on whether workers will work together in an office or in a satellite office or at each worker's home, and whether each worker will work alone or multiple workers will work together, and these are recorded in the database 18. In addition, each spatial concept is linked to the number or ratio of desks, chairs, private rooms, meeting spaces, etc., when the office is laid out according to that spatial concept, and this is recorded in the database 18 as an arrangement pattern.

[0055] When a user of the information processing device 1 selects a spatial concept from the list of spatial concepts superimposed on the 3D layout screen W1, the spatial concept designation unit 16 assumes the selected spatial concept and rearranges objects within the office based on the object arrangement pattern associated with the selected spatial concept. For example, if the designated spatial concept is a work style in which workers gather in an office to work collaboratively, the spatial concept designation unit 16 rearranges objects within the office based on the arrangement pattern associated with the work style to increase the number or proportion of meeting spaces, desks, chairs, and other objects that can be used by two or more people. Alternatively, if the designated spatial concept is a work style in which workers perform their assigned tasks independently or work in a satellite office, the worker's home, or other location other than the office, the spatial concept designation unit 16 rearranges objects within the office to increase the number or proportion of individual rooms, desks, chairs, and other objects for single use. After the spatial concept designation unit 16 completes the rearrangement of objects, the information processing device 1 re-outputs the 3D layout drawing W14 via the output unit 15 and displays it on the 3D layout drawing W1.

[0056] FIG. 5 is a diagram showing the configuration of the 2D layout screen W2 in one example of this embodiment. The 2D layout drawing W2 is a screen displaying the 2D layout drawing output as predetermined information in step S4 described above. As shown in FIG. 5, the 2D layout screen W2 in one example of this embodiment is a screen displaying a 2D layout drawing W24 showing, as a two-dimensional drawing, the arrangement of objects in an office space W23 composed of wall surfaces W21 consisting of walls and pillars and a floor surface W22. As described above, in this example of this embodiment, the office space and objects installed in the office are generated as 3D models in step S2, and the output unit 14 outputs the 3D model as a two-dimensional drawing in a plan view as the 2D layout drawing W24 and displays it on the 2D layout screen W2.

[0057] In one example of this embodiment, the shape and / or size of the office space or fixtures recognized in step S21 can be modified in the aforementioned 3D layout screen W1 and / or 2D layout screen W2. FIG. 6 is a diagram illustrating a state in which the office space W23 is being modified in the 2D layout screen W2 in one example of this embodiment. The state shown in FIG. 6 illustrates a state in which a portion of the 2D layout drawing W24 is enlarged and displayed in the 2D layout screen W2, and the position of some of the walls W21a constituting the enlarged office space W24 is being modified. Note that the specific method of the modification operation may be selected arbitrarily. For example, if the display device of the information processing device 1 is a touch panel display, the position of some of the walls W21a constituting the office space W23 may be changed by a drag-and-drop operation, and the size of the walls W21a may be increased or decreased by a pinch-in operation and a pinch-out operation. Furthermore, although the position of the wall W21a is modified in the state shown in FIG. 6, the positions or sizes of doors, windows, and other fixtures may also be similarly changed or increased or decreased. When a user of the information processing device 1 modifies the position and / or size of the wall surface W21a by operating the touch panel, mouse, keyboard, or other input device of the information processing device 1, the information processing device 1 redisplays the 2D layout screen W2 reflecting the modification. Note that the specific configuration for reflecting the modification may be selected arbitrarily; for example, the corresponding wall surface W21a of the 3D model generated in step S21 may be modified, or the content of the modification may be recorded in the database 18 as office space information. Also, although the office space W21 is modified on the 2D layout screen W2 in FIG. 6, the office space W1 may also be configured to be modifiable on the 3D layout screen W1.

[0058] In addition, in one example of this embodiment, the position and / or orientation of any object W25 can be changed in the aforementioned 3D layout screen W1 and / or 2D layout screen W2. In one example of this embodiment, the user of the information processing device 1 can change the position or orientation of the object displayed in the 3D layout screen W1 and the object displayed in the 2D layout screen W2 on the 3D layout drawing W14 or the 2D layout drawing W24 by operating the touch panel, mouse, keyboard, or other input device of the information processing device 1. In one example of this embodiment, when the position and / or orientation of the object W25 is changed, the change is reflected in the 3D model or object information and recorded in the database 18, and the 3D layout screen W1 and / or the 2D layout screen W2 are redrawn.

[0059] In addition, in one example of this embodiment, an arbitrary object W25 can be changed to another object on the 3D layout screen W1 and / or the 2D layout screen W2. FIG. 7 is a diagram showing a state in which a list of other objects W26 is superimposed on the 2D layout screen W2 in one example of this embodiment. When a user of the information processing device 1 selects an arbitrary object W25 from among the objects arranged in the office space W23 on the 2D layout screen W2, a list of other objects W26 that can be changed to the object W25 is superimposed on the 2D layout screen W2. When the user selects an arbitrary other object W26a from the other object list W26, the information processing device 1 changes the object W25 arranged in the office space W21 to the selected other object W26a, re-outputs the 2D layout drawing W23 via the output unit 14, and re-displays the 2D layout screen W2. Note that in one example of this embodiment, the list of other objects W24 is acquired from the product database 18a based on the selected object W25. The specific method of acquisition may be selected arbitrarily, and for example, a list of products corresponding to the object type determined for the selected object W25 in step S3 may be acquired from the product database 18a. The object type in one example of this embodiment includes general classifications of fixtures and fittings, such as chairs, desks, windows, doors, etc., and product information indicating specific fixtures or fittings belonging to those classifications, but products that have the same general classification as the selected object W25 may also be displayed as a list of other changeable objects.

[0060] FIG. 8 is a diagram showing the configuration of the object list screen W3 in one example of this embodiment. The object list screen W3 is a screen that displays a list of objects output as predetermined information in step S4 described above. As shown in FIG. 8, the object list screen W3 in one example of this embodiment displays a list of objects installed in the office in a table format with columns for each object type: a general classification W31 of the object, a product name W32 of the object, and the number W33 of objects installed in the office. Note that in this example of this embodiment, the objects displayed on the object list screen W3 are objects whose object types have been determined by the determination unit 13, but objects whose types have not been determined by the determination unit 13 may also be displayed in a list.

[0061] 9 is a diagram showing the configuration of the estimate screen W4 in one example of this embodiment. As described above, in one example of this embodiment, any object W12, W22 can be changed to another object on the 3D layout screen W1 and / or the 2D layout screen W2. The estimate screen W4 is a screen that displays a cost estimate when the above changes are made, and as shown in FIG. 9, for each product of the changed object, it includes a list of product name W41, price W42, quantity W43, and subtotal for each product W44, as well as total cost W45.

[0062] This completes the description of one example of this embodiment. However, the present invention is not limited to the above. For example, the object type in this example of this embodiment is information including category information indicating a general category of fixtures and fittings, such as chairs, desks, windows, doors, etc., and product information indicating specific fixtures or fittings belonging to that category. However, instead of or in addition to this information, other information may be treated as the object type. For example, the number of people who can use the fixture, or the manufacturer or series of the product may be treated as the object type.

[0063] In one example of this embodiment, the space taste designation unit 15 changes the objects installed in the office to products corresponding to a space taste indicating one or more of the designated color, material, texture, or function, but the objects to be changed by designating a space taste may be selected arbitrarily, for example, only the fixtures among the objects installed in the office may be changed. In this case, in addition to the space taste indicating one or more of the color, material, texture, or function of the fixtures, a fixture taste indicating one or more of the color, material, texture, or function of the fixtures may be configured to be separately designated, and the fixtures may be changed to products corresponding to the designated fixture taste.

[0064] Furthermore, in one example of this embodiment, the information processing device 1 uses an object type estimation model 17 to determine the type of object, but in order to generate the object type estimation model 17 by machine learning, training data may be generated based on the 3D layout drawing W14 or 2D layout drawing W24 output in step S4, or the 3D model included in the drawings W14 and W24.

[0065] In one example of this embodiment, the 3D layout screen W1 includes a spatial concept specification button W16, and the user of the information processing device 1 presses the button W16 to specify a spatial concept. However, the specific manner in which the spatial concept is specified may be selected arbitrarily. For example, a prompt for specifying the spatial concept by word or sentence may be displayed on the 3D layout screen W1, allowing the user to specify a working style or an image of the working style by word or sentence. In this case, the spatial concept specification unit 16 may estimate the corresponding spatial concept using a spatial concept estimation unit generated by machine learning that estimates a spatial concept from the words or sentences, and arrange products corresponding to the estimated spatial concept in the office. Alternatively, the spatial concept specification unit 16 may arrange products in the office using a layout estimation model generated by machine learning that estimates the layout of the office from the words or sentences and the office space.

[0066] Other specific configurations are not limited to those of the present embodiment, and various modifications are possible within the scope of the present invention. [Explanation of symbols]

[0067] 1. Information processing equipment 11 Filming Department 12 Recognition part 13 Judgment section 14 Output section 15 Space taste specification section 16. Spatial Concept Designation Section 17 Object type estimation model 18 Databases

Claims

1. A photography department that takes photos of the office space, a recognition unit that recognizes the shape and size of the space and objects that are fixtures installed in the office from the captured image; a determination unit that determines the type of the object for a part or all of the object; an output unit that outputs predetermined information based on the object and the type of the object; An information processing device comprising:

2. the predetermined information is a layout drawing that represents the arrangement of the objects in the office as a two-dimensional and / or three-dimensional drawing; 2. The information processing device according to claim 1.

3. The information processing device further comprises a space taste designation unit that receives designation of space taste indicating at least one of color, material, texture, and function, The output unit outputs the predetermined information based on the specified spatial taste.

2. The information processing device according to claim 1.

4. the information processing device further comprises a space concept designation unit that receives designation of a space concept that indicates a working style of a worker in the office, the output unit outputs the predetermined information based on the specified spatial concept.

2. The information processing device according to claim 1.

5. the predetermined information is a list of the determined objects; 2. The information processing device according to claim 1.

6. the output unit outputs a layout screen that displays the layout drawing; The layout screen allows the position and / or orientation of the object included in the layout drawing to be changed.

3. The information processing device according to claim 2.

7. The layout screen further allows the object included in the layout drawing to be changed to another object recorded in advance.

7. The information processing device according to claim 6.

8. The predetermined information is information regarding a cost for exchanging the object for the other object.

8. The layout creating device according to claim 7.

9. the output unit outputs a layout screen that displays the layout drawing; On the layout screen, at least one of the position, shape, and size of the space and / or fittings included in the layout drawing can be modified.

3. The information processing device according to claim 2.

10. the information processing device further includes an object type estimation model generated by machine learning, the object type estimation model using the recognized object as input data and the type of the object as output data; the determination unit makes the determination using the object type estimation model.

2. The information processing device according to claim 1.

11. 1. A computer-implemented information processing method, comprising: Taking a photo of the office space; A step of recognizing the shape and size of the space and objects that are furniture and fixtures installed in the office from the captured image; determining the type of the object for some or all of the objects; outputting predetermined information based on the object and the type of the object; An information processing method comprising:

12. A program that causes a computer to function as the information processing device according to any one of claims 1 to 10.

Images