Information processing device and information processing method

Abstract

In the present invention, a first generation unit generates a three-dimensional model of a building on the basis of the floor plan of the building. A reception unit receives article designation information that designates an article to be arranged in the building and arrangement designation information that designates the arrangement location of the article in the building. A determination unit determines whether the article can be conveyed to the arrangement location in the building on the basis of a three-dimensional model of the article and the generated three-dimensional model of the building.

Description

Information Processing Apparatus and Information Processing Method

[0001] The present disclosure relates to an information processing apparatus and an information processing method.

[0002] Conventionally, when moving to a new residence or workplace, etc., there is a need to confirm whether the furniture and home appliances at hand (or newly purchased) can be moved into the new residence. Although it is possible for the user or an agent to visit the new residence for measurement, in reality, it is often difficult.

[0003] For example, in the real estate information providing system described in Patent Document 1 below, the information search means searches for real estate information based on the desired conditions from the user terminal device. The building virtual tour means displays, from 360-degree viewpoints, or enlarges or reduces and displays, a specified part of the three-dimensional structure image of the selected property. The pre-installation inspection means sets the three-dimensional image of the user's furniture and equipment at the position of the specified three-dimensional structure image to investigate whether installation is possible. The interior and exterior decoration virtual change means changes and displays the color selected for the specified part of the three-dimensional structure image. The pre-move-in inspection means compares the external dimensions of the entrance of the three-dimensional structure image with the external dimensions of the user's furniture and equipment to investigate whether move-in is possible.

[0004] Japanese Patent Application Laid-Open No. 2003-186969

[0005] In the conventional technology described above, whether move-in is possible is investigated by comparing the external dimensions of the entrance of the three-dimensional structure with the external dimensions of the user's furniture and equipment. However, when actually moving in an article, there is a problem that the dimensions of locations other than the entrance also need to be considered. For example, when there is a bent portion close to a right angle in a corridor or staircase of a building, an article with a certain length such as a sofa may not be able to pass through, which may hinder the moving operation.

[0006] An object of the present disclosure is to accurately determine whether an article can be moved to a specific location within a building.

[0007] The information processing device according to this disclosure comprises: a first generation unit that generates a three-dimensional model of a building based on a floor plan of the building; a reception unit that receives item designation information specifying items to be placed in the building and placement designation information specifying the location of the items in the building; and a determination unit that determines whether or not the items can be brought into the building to the placement location based on the three-dimensional model of the items and the generated three-dimensional model of the building.

[0008] The information processing method relating to this disclosure involves a computer generating a three-dimensional model of a building based on a floor plan of the building, receiving a specification of an item to be placed in the building and the location of the item in the building, and determining whether the item can be brought into the building to the location based on the three-dimensional model of the item and the three-dimensional model of the building.

[0009] According to this disclosure, it is possible to accurately determine whether or not goods can be brought into a specific location within a building.

[0010] This is a block diagram showing the configuration of the information processing device 10. This is a schematic diagram showing an example of a floor plan 30. This is a schematic diagram showing an example of a wall arrangement image 32. This is a schematic diagram showing an example of a building model 40. This is a schematic diagram showing an example of a first mark M1. This is a schematic diagram showing an example of the display of a second mark M2. This is a schematic diagram showing another example of the display of the first mark M1. This is a flowchart showing the operation of the processing device 107.

[0011] [Embodiment] Figure 1 is a block diagram showing the configuration of the information processing device 10. The information processing device 10 is, for example, a smartphone, a personal computer, a tablet terminal, or smart glasses. In this embodiment, the information processing device 10 is assumed to be a smartphone. In this embodiment, the information processing device 10 is held by the user. The information processing device 10 may also be referred to as a user terminal.

[0012] The information processing device 10 includes a display device 101, an input device 102, a communication device 103, a camera 104, a LiDER (Light Detection and Ranging) scanner 105, a storage device 106, a processing device 107, and a bus 120 that connects these devices to each other.

[0013] The display device 101 is a display device that displays information to the outside (for example, various display panels such as a liquid crystal display panel or an organic EL display panel). The input device 102 is an input device that accepts input from the outside (for example, a keyboard, mouse, microphone, switch, button, or sensor). The display device 101 and the input device 102 may be configured as an integrated unit (for example, a touch panel).

[0014] The communication device 103 has an interface that can connect to a network (not shown) and communicates with other devices connected to the network using wireless or wired communication.

[0015] Camera 104 captures an image of a subject and outputs image data corresponding to the captured image. Camera 104 has, for example, an imaging optical system and an image sensor. The imaging optical system is an optical system that includes at least one imaging lens. The image sensor is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary MOS) image sensor. The image captured by camera 104 may be a still image or a video.

[0016] The LiDER scanner 105 measures the distance from the LiDER scanner 105 to multiple points on the object's surface by irradiating the object with laser light at multiple points and measuring the time it takes to receive the reflected light from the object. By measuring the distance from the LiDER scanner 105 to multiple points on the object, the surface shape of the object can be estimated.

[0017] The storage device 106 is a recording medium that can be read by the processing device 107. The storage device 106 includes, for example, non-volatile memory and volatile memory. Non-volatile memory includes, for example, ROM (Read Only Memory), EPROM (Erasable Programmable Read Only Memory), and EEPROM (Electrically Erasable Programmable Read Only Memory). Volatile memory includes, for example, RAM (Random Access Memory). The storage device 106 stores program PG1. Program PG1 is a program for operating the information processing device 10.

[0018] Furthermore, the storage device 106 stores floor plan data DM. Floor plan data DM is data showing the floor plan 30, which will be described later. Floor plan data DM is, for example, in JPEG or PNG format.

[0019] The information processing device 10 acquires floor plan data DM, for example, via a network. Specifically, the information processing device 10 stores (stores in the storage device 106) floor plan data DM sent by, for example, a real estate agent via email. The information processing device 10 may also download floor plan data DM of floor plans 30 posted on an internet site, or take a screenshot of a floor plan 30 posted on an internet site and save it as floor plan data DM. Furthermore, the floor plan data may also be image data obtained by taking a picture of a paper floor plan 30 with a camera 104.

[0020] The processing unit 107 includes one or more CPUs (Central Processing Units). One or more CPUs are examples of one or more processors. Each processor and CPU is an example of a computer.

[0021] The processing unit 107 reads the program PG1 from the storage device 106. By executing the program PG1, the processing unit 107 functions as a first generation unit 111, a reception unit 112, a second generation unit 113, a determination unit 114, and a display control unit 115. At least one of these functions may be implemented by circuits such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array).

[0022] The first generation unit 111 generates a three-dimensional model of the building (hereinafter referred to as "building model 40") based on the building floor plan 30. In this embodiment, the building floor plan 30 may be a diagram showing the layout of the entire building, or it may be a diagram showing the layout of a part of the building (for example, a room in an apartment building, or a floor in a multi-story building).

[0023] First, the first generation unit 111 generates a wall arrangement image 32 showing the arrangement of multiple walls W that make up the building, based on the floor plan 30. Next, the first generation unit 111 generates a vector image by vectorizing the wall arrangement image 32. Subsequently, the first generation unit 111 acquires a first measured value indicating the dimensions of at least one of the multiple walls W. Then, the first generation unit 111 generates a building model 40 based on the vector image and the first measured value.

[0024] Figure 2 is a schematic diagram showing an example of a floor plan 30. In Figure 2, the floor plan 30 is shown in a single color, but the floor plan 30 may also be shown in multiple colors (for example, each room may be colored in a different color).

[0025] In the floor plan 30 shown in Figure 2, "S" represents the service room, "MB" represents the meter box, "E" represents the entrance, "W" represents the washroom, "UB" represents the unit bath, "C" represents the hallway, "T" represents the toilet, "ST" represents the storage room, "CL" represents the closet, "K" represents the kitchen, and "LD" represents the living and dining room.

[0026] If the floor plan 30 is a color drawing, the first generation unit 111 converts the floor plan 30 into a grayscale drawing. If the floor plan 30 is a black and white drawing, the conversion to a grayscale drawing may be omitted.

[0027] Next, the first generation unit 111 performs a morphological transformation on the floor plan 30. Morphological transformation is used to remove noise from a binary image and extract contours. When creating a three-dimensional model of a building, it is necessary to first place walls W and construct the building's structure. Generally, in the floor plan 30, walls W, excluding windows and doors, are represented as thick lines. Therefore, by utilizing morphological transformation, only the parts of the walls W (indicated by thick lines) can be extracted.

[0028] Figure 3 is a schematic diagram showing an example of a wall arrangement image 32. When morphological transformation is performed on the floor plan 30 shown in Figure 2, a wall arrangement image 32 is generated in which only the walls W of the floor plan 30 are extracted. The wall arrangement image data (not shown) that shows the wall arrangement image 32 is in JPEG or PNG format, similar to the floor plan data DM.

[0029] Next, the first generation unit 111 vectorizes the wall arrangement image 32 and converts it into a vector image. The vector image data (not shown) is in a format that can be represented by vectors, such as SVG format or EPS format. By converting the wall arrangement image 32 into a vector image, it becomes possible to enlarge and reduce the wall arrangement image 32.

[0030] Next, the first generation unit 111 prompts the user to input the dimensions of at least one of the walls W that make up the building. The dimensions of the wall W are the width and height values ​​of the wall W. The user measures the dimensions of at least one of the walls W that make up the building and inputs them into the information processing device 10. One of the walls W whose dimensions the user has measured is called the "first wall W1". The dimensions of the first wall W1 input by the first user are called the "first measured value". Based on the width value of the first wall W1, the ratio of the floor plan 30 to the actual size of the building (the scale of the floor plan 30) can be determined. Also, based on the height value of the first wall W1, the height of the building (length from floor to ceiling), which does not appear in the floor plan 30, can be obtained.

[0031] In this embodiment, the first wall W1 is provided with a first entrance / exit D1. The user also measures the dimensions (width and height) of the first entrance / exit D1 and inputs them into the information processing device 10. That is, the first wall W1 is provided with a first entrance / exit D1, and the first measured value includes the dimensions of the first entrance / exit D1. The first wall W1 is an example of at least one wall W whose dimensions the user measures. Just as there may be multiple walls W whose dimensions the user measures, there may also be multiple entrance / exit D whose dimensions the user measures. The more walls W and entrance / exit D that are measured, the more accurate the building model 40 described later can be.

[0032] Furthermore, in this embodiment, the user is supposed to measure the dimensions of the first wall W1 and the dimensions of the first entrance D1, but the user may also input only the dimensions of the first entrance D1 as the first measured value. In this case, the height of the building will not be accurately determined, but a height higher than the height of the first entrance D1 and that is specified by standards or laws can be estimated as the height of the building.

[0033] Furthermore, doors within the same building are often selected with the same design to maintain interior uniformity, and in this case, the dimensions of the doors, i.e., the dimensions of the entrances, are often the same. Therefore, in this embodiment, the building is provided with multiple entrances D, including the first entrance D1, and the dimensions of the entrances D other than the first entrance D1 are presumed to be the same as the first entrance D1. However, doors such as the front door, bathroom door, or closet door often have special shapes compared to other doors. Therefore, the dimensions of these doors do not necessarily have to be presumed to be the same as the first entrance D1. If the ratio of the sizes between multiple doors within the building can be estimated from the floor plan 30, the dimensions of the other doors may be estimated based on the dimensions of the first entrance D1.

[0034] The first generation unit 111 then creates a building model 40 based on the input measured values ​​and vector images. The data of the building model 40 is converted into a format that can be handled by common game engines or 3D model editing software, such as FBX or OBJ format.

[0035] Figure 4 is a schematic diagram showing an example of a building model 40. Figure 4 shows a part of the building model 40 displayed on the display device 101. In Figure 4, the building model 40 includes a wall model 41 representing the walls W of the building, a door model 42 representing a door, a floor model 43 representing the floor, and a ceiling model 44 representing the ceiling, etc., to reproduce the structure of the building. The user can change the viewpoint within the building model 40 (move within the building model 40) by operating the input device 102.

[0036] After this, the user completes the building model 40 by specifying the textures of the wall model 41, door model 42, floor model 43, and ceiling model 44 as needed, and by specifying the type of door panel and how it opens (for example, whether it is a hinged door or a sliding door).

[0037] The reception unit 112 receives item specification information, which specifies the items to be placed in the building, and placement specification information, which specifies the location of the items within the building. In this embodiment, items are, for example, furniture such as sofas, chests of drawers, or bookshelves, and home appliances such as refrigerators, washing machines, or air conditioners. These items are relatively large, and the question arises as to whether or not they can be brought into the building. Whether or not they can be brought into the building does not simply mean whether or not they can enter the building, but rather whether or not they can be brought to the placement location intended by the user and whether or not they can be installed at that location.

[0038] First, let's explain the item designation information. The reception unit 112 requests the user to capture an image of an item (hereinafter referred to as "item image") with the camera 104. The reception unit 112 identifies the type of item based on the item image. Identifying the type of item based on the item image is done, for example, using a machine learning model for image recognition. This machine learning model is trained using a set of training data consisting of a training image of an arbitrary item and text indicating the name (type) of that arbitrary item. The machine learning model may be stored in the storage device 106, or one stored in another information processing device (image recognition engine) connected to the network may be used.

[0039] Information indicating the type of item is not necessarily required for subsequent processing. Therefore, if an image of the item is obtained, the type of item does not need to be identified. However, identifying the type of item improves convenience, for example, when there are restrictions on the orientation in which the item is transported (specifically, transporting a refrigerator on its side is undesirable as it may cause malfunction). This allows for determination of whether the item can be transported within the limits of those restrictions.

[0040] Next, the placement specification information will be explained. The reception unit 112 displays the building model 40 or floor plan 30 generated by the first generation unit 111 and prompts the user to specify the location where they want to place the items specified by the item specification information. The user specifies the location where they want to place the items by tapping a location on the building model 40 or floor plan 30. Note that the order in which the items are specified and the location where the items are specified does not matter.

[0041] The second generation unit 113 generates a three-dimensional model of an article (hereinafter referred to as the "article model") based on scan data obtained by three-dimensionally scanning the article and second measured values ​​obtained by actually measuring the dimensions of at least one location on the article. The second generation unit 113 requests the user to three-dimensionally scan the article using, for example, a LiDER scanner 105. The second generation unit 113 also requests the user to actually measure and input the dimensions of at least one location on the article. The location on the article where the length is measured can be arbitrary, but it is thought that measuring a location with a shape close to a straight line will result in less error. The actual size of the article is determined by inputting the dimensions of at least one location on the article. The shape of the article is determined by the scan data obtained by the LiDER scanner 105, and the actual size of the article can be determined by the measured values ​​of one or more locations. This makes it possible to place the article model within the building model at the same scale as when the article is placed inside the building.

[0042] Note that the 3D scanning by the LiDAR scanner 105 and the imaging of the image by the camera 104 may be performed simultaneously. For example, when the reception unit 112 receives the designation of an article in the processing device 107, the camera 104 and the LiDAR scanner 105 are activated simultaneously, and a message such as "Please photograph the article from various directions" is displayed. In this case, the user can perform the 3D scanning and the designation of the article for the reception unit 112 simultaneously.

[0043] The determination unit 114 determines whether it is possible to carry the article to the placement location in the building based on the article model and the building model 40 generated by the first generation unit 111. Further, when the determination unit 114 determines that the article cannot be carried to the placement location, the first location in the building where the movement of the article is obstructed is specified.

[0044] The determination unit 114, for example, moves the article model from the entrance of the building model 40 to the position of the building model 40 corresponding to the placement location (hereinafter referred to as "model placement location"), and determines whether there is a location where interference occurs with the wall or the like of the building model 40. At this time, for example, after maintaining an appropriate margin between the building model 40 and the article model, it is determined whether the article can be carried to the model placement location. The appropriate margin is, for example, the position where the body of the carrier is placed.

[0045] Further, the determination unit 114 specifies the third location in the building where the movement of the article may be obstructed. The third location is a location where the article can move on the model (it may also be said in terms of dimensions), but depending on the actual situation of the building, the article may not be able to be moved. Specifically, for example, depending on the shape of the door of the entrance and exit, the width of the entrance and exit (the range where the article can actually pass) may be reduced by the door panel. Also, for example, when a handrail is installed on the stairs, the width of the stairs (the range where the article can actually pass) may be reduced by the handrail. The determination unit 114 determines that the article may not be able to move when, for example, at the above-mentioned locations, the margin between the dimensions of the building and the dimensions of the article is not sufficient.

[0046] The display control unit 115 displays the building model 40 on the display device 101. The display control unit 115 displays a first mark at a second location of the building model 40 corresponding to the first location. Further, the display control unit 115 displays a second mark at a fourth location of the building model corresponding to the third location, and displays a message requesting an input of a third measured value indicating the dimension of the third location.

[0047] FIG. 5 is a schematic diagram showing an example of the display of the first mark M1. In FIG. 5, it is assumed that the movement of articles is obstructed at the entrance / exit where the door model 42 is arranged among the building models 40 shown in FIG. 4. That is, in FIG. 5, the entrance / exit where the door model 42 is arranged is the location (second location) of the building model 40 corresponding to the first location (the door in the actual building) where the movement of articles in the building is obstructed.

[0048] In the example of FIG. 5, the first mark M1 has an exclamation mark for attracting the user's attention in the balloon, and the text "Cannot move" is displayed. By looking at the first mark M1, the user can grasp that the movement of articles is obstructed at the location of the door model 42.

[0049] FIG. 6 is a schematic diagram showing an example of the display of the second mark M2. In FIG. 6, it is assumed that the movement of articles may be obstructed at the entrance / exit where the door model 42 is arranged among the building models 40 shown in FIG. 4. That is, in FIG. 6, the entrance / exit where the door model 42 is arranged is the location (fourth location) of the building model 40 corresponding to the third location (the door in the actual building) where the movement of articles in the building may be obstructed.

[0050] In the example of FIG. 6, the second mark M2 has an exclamation mark for attracting the user's attention in the balloon, the text "May not be able to move", the text "Please measure the actual width and enter it", and an input field for entering the measured dimension (measured value). By looking at the second mark M2, the user can grasp that the movement of articles may be obstructed at the location of the door model 42. Further, the user can enter the measured value and confirm whether the movement of articles is obstructed at the entrance / exit where the door model 42 is arranged.

[0051] When the measured width of an entrance is input to the second mark M2, the determination unit 114 determines, based on the measured value, whether or not an item can pass through that location. If the determination results in the item's movement being obstructed, the first mark M1 shown in Figure 5 is displayed near the door model 42. If the determination results in the item's movement not being obstructed, a message such as "You can pass through" is displayed near the door model 42.

[0052] Note that the first mark M1 and the second mark M2 may be displayed on the floor plan 30 instead of the building model 40. Figure 7 is a schematic diagram showing another example of the display of the first mark M1. In Figure 7, the first mark M1 is displayed on the floor plan 30. By displaying the first mark M1 on the floor plan 30, the user can easily understand at what location within the building the movement of items will be obstructed.

[0053] Furthermore, if the determination unit 114 determines that it is possible to bring the items into the building and to the designated location, the display control unit 115 displays a message on the display device 101 indicating that it is possible to bring the items in. The message indicating that it is possible to bring the items in may be a symbol with a positive meaning, such as a circle or a checkmark, or it may be a message such as "Pick-up is possible."

[0054] [Flowchart] Figure 8 is a flowchart showing the operation of the processing unit 107. The processing unit 107 functions as a first generation unit 111 and generates a building model 40 based on the building floor plan 30 and the measured dimensions of at least one wall W (step S100). The processing unit 107 functions as a reception unit 112 and receives item specification information specifying the items to be placed in the building and placement specification information specifying the placement locations of the items in the building (step S102).

[0055] The processing unit 107 functions as a second generation unit 113 and generates an article model based on the scan data of the article and the measured dimensions of at least one part of the article (step S104). The processing unit 107 functions as a determination unit 114 and determines, based on the article model and the building model 40, whether or not the article can be brought into the building to its placement location (step S106).

[0056] If the determination unit 114 determines that the item can be brought in (step S106: YES), the processing unit 107 functions as a display control unit 115 and displays a message indicating that the item can be brought in on the display device 101 (step S108), and terminates the processing of this flowchart. If the determination unit 114 does not determine that the item can be brought in (step S106: NO), the processing unit 107 functions as a display control unit 115 and displays a mark at a location in the building model 40 where the movement of the item is obstructed (or where the movement of the item may be obstructed) (step S110), and terminates the processing of this flowchart. If a mark (second mark M2) is displayed at a location where the movement of the item may be obstructed, the feasibility of bringing in the item is re-determined based on the measured value entered by the user.

[0057] [Summary of Embodiments] As described above, the information processing device 10 according to the embodiment determines whether or not an item can be brought into the building to its placement location based on the item model and the building model 40. Therefore, the user can check in advance whether or not an item can be placed in the desired location, for example, when moving, thus improving convenience.

[0058] Furthermore, in this embodiment, the building model 40 is a three-dimensional model of a building, and the item model is a three-dimensional model of an item. Therefore, it is possible to accurately determine whether or not an item can be brought into a specific location within the building. For example, the information processing device 10 can consider not only the lateral movement of an item (parallel to the floor) but also its vertical movement. The floor plan 30 shown in Figure 2 is a one-story house, but in a house with two or more stories, for example, it is necessary to move items in the vertical direction via stairs, etc. The information processing device 10 can determine whether or not it is actually possible to pass through a location even when there is vertical movement.

[0059] Furthermore, the information processing device 10 automatically generates a building model 40 based on the floor plan 30 and at least one measured value. Therefore, even if, for example, the user cannot actually go to the building and perform a 3D scan of the building, the building model 40 can be generated, improving convenience.

[0060] Furthermore, the information processing device 10 acquires the dimensions of at least one entrance / exit as measured values. Therefore, the information processing device 10 can generate a building model 40 that accurately reproduces the dimensions of entrances / exits, which tend to be bottlenecks when goods are brought in.

[0061] Furthermore, the information processing device 10 generates an item model based on scan data obtained by 3D scanning the item and actual measurements obtained by measuring the dimensions of at least one part of the item. Therefore, it is possible to determine whether or not any item can be brought in, improving convenience.

[0062] Furthermore, the information processing device 10 displays a first mark M1 or a second mark M2, etc., if there are locations within the building where items cannot be brought to their designated location or where the movement of items may be obstructed. As a result, users can easily identify bottlenecks in the delivery of items, improving convenience.

[0063] [Regarding Modifications] The following are examples of modifications in the above-described embodiment. Two or more modifications can be arbitrarily selected from the following examples and combined as appropriate, provided they do not contradict each other.

[0064] [First Modified Example] In the embodiment described above, when a building has multiple entrances, the dimensions of one of the multiple entrances (first entrance D1) are measured, and the dimensions of the other entrances are estimated to be the same as those of the first entrance D1. However, this is not limited to this, and for example, the dimensions of multiple entrances within a building may be estimated to be those specified in the standard. That is, in the first modified example, the building has multiple entrances, and the dimensions of the multiple entrances are estimated to be those specified in the standard.

[0065] According to the first modified example, by estimating the dimensions of the entrance / exit to values ​​specified in the standard, even when actual measured values ​​of the entrance / exit dimensions cannot be obtained, the determination unit 114 can be provided with information to determine whether or not it is possible to bring in goods, and it is expected that the accuracy of the determination of whether or not it is possible to bring in goods will be improved.

[0066] [Second Modification] In the embodiment described above, the second generation unit 113 generated the item model. However, the system is not limited to this, and for example, an item model generated by a manufacturer that produces an item or a retail store that sells an item may be acquired via the network. In this case, for example, the reception unit 112 prompts the user to input item identification information, such as the manufacturer name and model number of the item (or displays a list for the user to select). Subsequently, an acquisition unit (not shown) acquires the item model provided by the manufacturer or retail store via the network.

[0067] According to the second modification, the user can avoid the effort of 3D scanning the item. Also, since the information processing device 10 does not generate an item model, the processing load on the information processing device 10 can be reduced. Furthermore, since an item model can be obtained even for items that the user does not own, the user can, for example, check in advance whether the item will fit inside the building or whether the item will blend in with the building when purchasing a new item, thereby improving convenience.

[0068] [Third Modification] Generally, during a move, a large number of items are brought into a building. Therefore, the information processing device 10 may be configured to determine whether or not multiple items can be brought in. Specifically, for example, suppose a user is considering placing a bed and a chest of drawers in the same room (hereinafter referred to as "the first room"). The reception unit 112 accepts the specification of the placement location of the bed in the first room (for example, near the center of the first room) and the placement location of the chest of drawers in the first room (for example, along the wall of the first room). At this time, the reception unit 112 may also accept the order in which the bed and chest of drawers are brought in. The second generation unit 113 generates a three-dimensional model of the bed (bed model) and a three-dimensional model of the chest of drawers (chest of drawers model) based on three-dimensional scan data of the bed and chest of drawers and actual measured values ​​of one or more dimensions.

[0069] The determination unit 114 moves the bed model within the building model 40 and determines whether the bed can be brought into the first room. If the bed can be brought into the first room, the unit moves the chest of drawers model within the building model 40 with the bed model in place and determines whether the chest of drawers can be brought into the first room. If the chest of drawers can also be brought into the first room, the display control unit 115, for example, displays a message to the display device 101 stating that "both the bed and the chest of drawers can be brought in."

[0070] On the other hand, if it is determined that the chest of drawers cannot be brought into the first room due to interference between the bed model placed in the first room and the chest of drawers model being brought in, the determination unit 114 deletes the bed model from the building model 40, moves the chest of drawers model within the building model 40, and determines whether or not the chest of drawers can be brought into the first room. If the chest of drawers can be brought into the first room, the bed model is moved within the building model 40 with the chest of drawers model in place, and determines whether or not the bed can be brought into the first room.

[0071] If the bed and chest of drawers can be brought into the first room using this delivery order, the display control unit 115 will display a message on the display device 101, for example, stating that "the chest of drawers and bed can be brought in by bringing in the chest of drawers first and then the bed." If the bed and chest of drawers cannot be brought into the first room using this delivery order, the display control unit 115 will display a message on the display device 101, for example, stating that "it is not possible to bring both the chest of drawers and the bed into the first room."

[0072] Furthermore, if there are any points where the movement of the bed model or chest of drawers model is hindered by factors other than the items already delivered, the first mark M1 or the second mark M2 will be displayed, as in the embodiment described above.

[0073] Thus, in the third modified example, the reception unit 112 receives first item designation information specifying a first item (a bed in the above example), first placement designation information specifying a first placement location for the first item, second item designation information specifying a second item different from the first item (a chest of drawers in the above example), and second placement designation information specifying a second placement location for the second item. The determination unit 114 determines, based on the three-dimensional model of the first item, the three-dimensional model of the second item, and the building model 40, whether or not the second item can be brought to the second placement location while the first item is placed in the first placement location in the building.

[0074] According to the third modification, the user can know whether multiple items can be brought in, improving convenience. In addition, the user can consider the order in which multiple items will be brought in based on whether or not there is interference between the items, allowing the delivery work to proceed more efficiently.

[0075] [Fourth Modification] Regardless of the determination result by the determination unit 114, the display control unit 115 may place the user-specified item model at a location specified by the user within the building model 40 and display it on the display device 101. In other words, the information processing device 10 may be used to simulate how items would be placed in the building. This allows the user to visualize how items would be placed inside the building and to efficiently decide, for example, which room to place their items in, or how to arrange their items.

[0076] [Fifth Modification] In the embodiments described above, the information processing device 10 was described as a terminal held by the user. However, the information processing device 10 may be a server connected to the user's terminal via a network. In this case, the server functioning as the information processing device 10 receives a request for a floor plan 30 from the user terminal. The floor plan 30 may be transmitted from the user terminal or stored in another information processing device connected to the network.

[0077] According to the fifth modified example, since a server is used as the information processing device 10, it is possible to determine whether or not goods can be brought in, regardless of the performance of the terminal held by the user.

[0078] [Other] (1) In the embodiments described above, ROM and RAM were given as examples of the storage device 106, but the storage device 106 may be a flexible disk, magneto-optical disk (e.g., compact disk, digital multipurpose disk, Blu-ray® disk), smart card, flash memory device (e.g., card, stick, key drive), CD-ROM (Compact Disc-ROM), register, removable disk, hard disk, floppy® disk, magnetic strip, database, server, or other suitable storage medium.

[0079] (2) In the embodiments described above, the information, signals, etc. may be represented using any of the various different techniques. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0080] (3) In the embodiments described above, the input and output information may be stored in a specific location (e.g., memory) or managed using a management table. The input and output information may be overwritten, updated, or appended to. The output information may be deleted. The input information may be transmitted to other devices.

[0081] (4) In the embodiments described above, the determination may be made by a value represented by one bit (0 or 1), by a Boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).

[0082] (5) The processing procedures, sequences, flowcharts, etc., exemplified in the embodiments described above may be rearranged in order, as long as there is no inconsistency. For example, in the methods described herein, various step elements are presented using an exemplary order and are not limited to the specific order presented.

[0083] (6) Each function illustrated in Figure 1 is implemented by any combination of at least one of hardware and software. Furthermore, the method of implementing each functional block is not particularly limited. That is, each functional block may be implemented using one device that is physically or logically coupled, or it may be implemented using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired, wireless, etc.). A functional block may also be implemented by combining the above one device or the above multiple devices with software.

[0084] (7) The programs illustrated in the embodiments described above should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., whether they are called software, firmware, middleware, microcode, hardware description languages ​​or by any other name.

[0085] Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technology (such as coaxial cable, fiber optic cable, twisted pair, or digital subscriber line (DSL)) and wireless technology (such as infrared or microwave), then at least one of these wired and wireless technologies is included in the definition of a transmission medium.

[0086] (8) In each of the above-mentioned forms, the terms “system” and “network” shall be used interchangeably.

[0087] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a given value, or other corresponding information.

[0088] (10) In the embodiments described above, the portable device may be a Mobile Station (MS). A Mobile Station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or several other appropriate terms. In this disclosure, terms such as “mobile station,” “user terminal,” “user equipment (UE),” and “terminal” may be used interchangeably.

[0089] (11) In the embodiments described above, the terms “connected,” “coupled,” or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, “connection” may be read as “access.” As used in this disclosure, two elements may be considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables, and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain, and optical (both visible and invisible) domain.

[0090] (12) In the embodiments described above, the phrase "based on" does not mean "based solely on" unless otherwise specified. In other words, the phrase "based on" means both "based solely on" and "based at least on".

[0091] (13) The terms “determinating” and “deciding” as used in this disclosure may encompass a wide variety of actions. “Determinating” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, inquiry (for example, searching in a table, database or another data structure), and confirming. Furthermore, "judgment" and "decision" may include considering something as a "judgment" or "decision" based on actions such as receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, and access (e.g., accessing data in memory). Additionally, "judgment" and "decision" may include considering something as a "judgment" or "decision" based on actions such as resolving, selecting, choosing, establishing, and comparing. In short, "judgment" and "decision" may include considering something as a "judgment" or "decision" based on some action. Furthermore, "judgment (decision)" may be reinterpreted as "assuming," "expecting," or "considering."

[0092] (14) Where the terms “include,” “including,” and variations thereof are used in the embodiments described above, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in this disclosure is not intended to be exclusive OR.

[0093] (15) Where articles are added in translation, for example, a, an, and the in English, the disclosure may include the fact that the noun following these articles is plural.

[0094] (16) In this disclosure, the term “A and B are different” may mean “A and B are different from each other.” The term may also mean “A and B are each different from C.” Terms such as “separate” and “combine” may be interpreted in the same way as “different.”

[0095] (17) Each aspect / embodiment described herein may be used individually, in combination, or switched between as needed during implementation. Furthermore, notification of certain information (e.g., notification that "it is X") is not limited to explicit notification, but may also be implicit (e.g., by not providing such notification).

[0096] 10... Information processing device, 101... Display device, 102... Input device, 103... Communication device, 104... Camera, 105... LiDER scanner, 106... Storage device, 107... Processing device, 111... First generation unit, 112... Reception unit, 113... Second generation unit, 114... Determination unit, 115... Display control unit.

Claims

1. An information processing device comprising: a first generation unit that generates a three-dimensional model of a building based on a floor plan of the building; a reception unit that receives item specification information specifying items to be placed in the building and placement specification information specifying the placement locations of the items in the building; and a determination unit that determines whether or not the items can be brought into the building to the placement locations based on the three-dimensional models of the items and the generated three-dimensional model of the building.

2. The information processing apparatus according to claim 1, wherein the first generation unit generates a wall arrangement image showing the arrangement of a plurality of walls constituting the building based on the floor plan, generates a vector image by vectorizing the wall arrangement image, obtains a first measured value showing the dimensions of at least one of the plurality of walls, and generates the three-dimensional model based on the vector image and the first measured value.

3. The information processing apparatus according to claim 2, wherein at least one wall is provided with a first entrance / exit, and the first measured value includes the dimensions of the first entrance / exit.

4. The building is provided with a plurality of entrances, including the first entrance, and the dimensions of the entrances other than the first entrance are presumed to be the same as those of the first entrance, as described in claim 3.

5. The information processing device according to claim 1, wherein the building is provided with a plurality of entrances and exits, and the dimensions of the plurality of entrances and exits are presumed to be values ​​defined by standards.

6. The information processing apparatus according to claim 1, further comprising a second generation unit that generates a three-dimensional model of the article based on scan data obtained by three-dimensionally scanning the article and a second measured value obtained by actually measuring the dimensions of at least one location of the article.

7. The information processing apparatus according to claim 1, further comprising a display control unit that displays a three-dimensional model of the building on a display device, wherein the determination unit determines that the article cannot be brought to the placement location, it identifies a first location in the building where the movement of the article is obstructed, and the display control unit displays a mark at a second location in the three-dimensional model of the building corresponding to the first location.

8. The information processing apparatus according to claim 7, wherein the determination unit identifies a third location in the building where the movement of the article may be obstructed, and the display control unit displays a mark at a fourth location on the three-dimensional model of the building corresponding to the third location, and displays a message requesting the input of a third measured value indicating the dimensions of the third location.

9. The information processing apparatus according to claim 1, wherein the article is a first article, the receiving unit receives first article designation information specifying the first article, first placement designation information specifying a first placement location for the first article, second article designation information specifying a second article different from the first article, and second placement designation information specifying a second placement location for the second article, and the determination unit determines, based on a three-dimensional model of the first article, a three-dimensional model of the second article, and the generated three-dimensional model of the building, whether or not the second article can be transported to the second placement location while the first article is placed in the first placement location in the building.

10. An information processing method comprising: generating a three-dimensional model of a building based on a floor plan of the building using a computer; receiving a specification of items to be placed in the building and the location of those items in the building; and determining whether or not it is possible to transport the items to the location in the building based on the three-dimensional model of the items and the three-dimensional model of the building.

Images