Control system

Abstract

To reproduce the brightness and view in a room in accordance with an environment.SOLUTION: A control system includes: an acquisition unit which acquires imaging position information including horizontal position information of an imaging position and height information from the ground, imaging direction information indicating an imaging direction, and light amount information detected based on the imaging position information and the imaging direction information; and an illumination control unit which controls illumination processing on the basis of the detected light amount information. The Control system may include a display control unit which controls display processing of a video image captured based on the imaging position information and the imaging direction information.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a control system.

Background Art

[0002] In recent years, before purchasing an apartment, it has become possible to experience in advance the layout of the rooms to be purchased in a virtual space or a real showroom using virtual reality (VR). Non-Patent Document 1 discloses displaying a landscape image extending outside the apartment on a window frame. When considering purchasing a high-rise apartment as a residence, the view from the window has great value for the purchaser.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] On the other hand, in the case of Non-Patent Document 1, the brightness inside a room may be uniformly represented by the lighting. In particular, in the case of high-rise buildings such as condominiums, the amount of natural light may differ from floor to floor. Also, in virtual spaces or showrooms, the best possible scenery image or a composite image may be displayed, which is not an actual image of the room. This can lead to a gap in the impression of the room before and after purchase. As a result, there has been a problem in that satisfaction with the purchased room does not improve. Furthermore, information such as reflected light from surrounding buildings and shadows also has an impact, making it difficult to imagine the impression of the room before purchase. This problem occurs even when the effective daylighting area, which is mandated by the Building Standards Act, is calculated and designed, for the same reasons mentioned above.

[0005] Therefore, in view of the above problems, one of the objectives of the present invention is to reproduce the brightness or scenery of a room according to the environment. [Means for solving the problem]

[0006] According to one embodiment of the present invention, a control system is provided which includes an acquisition unit that acquires imaging position information including horizontal position information of the imaging position and height information from the ground and the floor of the building, imaging direction information indicating the direction of imaging, and light intensity information detected based on the imaging position information and the imaging direction information, and an illumination control unit that controls the illumination process based on the detected light intensity information.

[0007] The control system described above may include a display control unit that controls the display processing of moving images (including still images) captured based on the imaging position information and the imaging direction information.

[0008] The control system described above includes an imaging device for capturing the moving image and an attachment mounted on the front side of the imaging device, wherein the attachment has a box-shaped form with space inside and may have a first sensor disposed inside the attachment for detecting the light intensity information of light incident from the outside of the attachment.

[0009] In the control system described above, the attachment may have a window portion positioned in front of it so as to correspond to the image sensor of the imaging device, the window portion may include a glass material, and the first sensor may detect light intensity information that has entered the interior of the attachment through the window portion.

[0010] In the control system described above, the attachment may include a floor portion provided on the lower interior surface and containing a first type of material, a wall portion provided on the side of the interior and containing a second type of material, and a ceiling portion provided on the upper interior surface and containing a third type of material.

[0011] In the control system described above, the first sensor is composed of a plurality of first sensors, and each of the plurality of first sensors may be located in at least one of the floor, the wall, and the ceiling.

[0012] In the control system described above, the acquisition unit may acquire reflectance information for at least one of the floor, wall, and ceiling, perform calculations using the at least one reflectance information and the light intensity information to generate brightness information, and control the lighting process using the brightness information.

[0013] In the control system described above, the attachment may include at least one of the following: an eaves portion provided on the upper outer side of the window portion, and a veranda portion positioned on the lower outer side of the window portion and overlapping with a part of the window portion in the height direction.

[0014] In the control system described above, the imaging device to which the attachment is mounted is attached to an aircraft, and the aircraft may include a second sensor for detecting the imaging direction information and a third sensor for detecting the imaging position information.

[0015] In the control system described above, the aircraft further includes a fourth sensor for detecting the tilt information of the aircraft, and the imaging device may capture images based on the tilt information.

[0016] The moving image may be displayed in a VR (Virtual Reality) space using the brightness information.

Advantages of the Invention

[0017] By using one embodiment of the present invention, it is possible to reproduce the indoor brightness and scenery according to the environment.

Brief Description of the Drawings

[0018] [Figure 1] It is a schematic diagram of a control system according to one embodiment of the present invention. [Figure 2] It is a hardware configuration diagram of an imaging device and an attachment according to one embodiment of the present invention. [Figure 3] It is a schematic diagram of a room according to one embodiment of the present invention. [Figure 4] It is a functional block diagram of a control system according to one embodiment of the present invention. [Figure 5] It is a processing flow diagram of the control system. [Figure 6] It is a data structure of imaging conditions. [Figure 7] It is a schematic diagram at the time of imaging according to one embodiment of the present invention. [Figure 8] It is a data structure of the brightness of the room under imaging conditions. [Figure 9] It is a processing flow diagram of the control system. [Figure 10] It is a schematic diagram of a showroom. [Figure 11] It is a hardware configuration diagram of an imaging device and an attachment according to one embodiment of the present invention. [Figure 12] It is a functional block diagram of a control system according to one embodiment of the present invention. [Figure 13] It is a schematic diagram at the time of imaging according to one embodiment of the present invention.

Modes for Carrying Out the Invention

[0019] The embodiments of the present invention will be described below with reference to the drawings. It should be noted that these embodiments are merely examples, and any modifications that a person skilled in the art could easily conceive while maintaining the spirit of the invention are naturally included within the scope of the present invention. Furthermore, in order to clarify the explanation, the drawings may schematically represent the width, thickness, shape, etc., of each part compared to the actual embodiment. However, the illustrated shapes are merely examples and do not limit the interpretation of the present invention.

[0020] In this specification, for the sake of explanation, terms such as "upper," "above," or "upper part," or "down," "below," or "lower part" will be used, but these only describe the hierarchical relationships of each component.

[0021] In this specification, the terms "1st," "2nd," etc., attached to each component are merely convenient markers used to distinguish each component, and unless otherwise specified, they have no further meaning.

[0022] In this specification and drawings, the same reference numeral is used to refer to multiple identical or similar components collectively, and uppercase or lowercase letters may be used to distinguish each of these components. Furthermore, natural numbers may be used to distinguish multiple parts of a single component.

[0023] Furthermore, the following embodiments can be combined with each other, provided that no technical inconsistencies arise.

[0024] <First Embodiment> A control system according to the first embodiment of the present invention will be described in detail with reference to the drawings.

[0025] (1-1. Control System Configuration) Figure 1 shows a block diagram illustrating the configuration of the control system 10. As shown in Figure 1, the control system 10 includes a control terminal 100, an imaging device 200, an aircraft 400, and a database (DB) 500.

[0026] In the control system 10, the control terminal 100 can acquire motion image data captured by the imaging device 200 and light intensity data detected by an attachment 300, which will be described later and is attached to the imaging device 200. The control terminal 100 generates brightness information based on the acquired light intensity data. The control terminal 100 can display the motion image data on the second display device 600 and control the brightness of the lighting system 700 based on the light intensity data. The aircraft 400 can move to a predetermined position based on imaging conditions such as horizontal position information, height information, and direction information. The imaging device 200 can capture motion images at the predetermined position in response to a request from the control terminal 100. The functions of the control terminal 100 may be incorporated into the imaging device 200.

[0027] (1-1-1. Control terminal 100) The control terminal 100 includes computing devices such as a CPU (Central Processing Unit) 110 and a GPU (Graphic Processing Unit) 120, main memory 130 such as RAM (Random Access Memory) and ROM (Read Only Memory), storage devices 140 such as an HDD (Hard Disk Drive) and SSD (Solid State Drive), an input / output interface (IF) 150, and a communication interface (IF) 160. The CPU 110, GPU 120, main memory 130, storage devices 140, input / output interface 150, and communication interface 160 are connected to each other by a wiring bus 105.

[0028] The CPU 110 and GPU 120 perform various arithmetic operations based on control programs and data stored in the main memory 130 and storage device 140. The GPU 120 is suitable for image processing and spatial arithmetic operations. The input / output IF 150 connects to peripheral devices such as the display device 170, keyboard 180, touch panel 190, second display device 600, and lighting system 700. The communication IF 160 transmits and receives information from external devices (imaging device 200, aircraft 400, DB500) via a network. The second display device 600 consists of a projector or display panel and displays moving images based on signals sent from the input / output IF 150. The lighting system 700 illuminates the room based on signals sent from the input / output IF 150.

[0029] (1-1-2. Imaging device 200 and attachment 300) Figure 2 is a schematic diagram showing an example of the hardware configuration of the imaging device 200 and the attachment 300 mounted on the imaging device 200. As shown in Figure 2, the imaging device 200, like the control terminal 100, includes a CPU 210, GPU 220, main memory 230, storage device 240, input / output IF 250, and communication IF 260, in addition to an image sensor 270 and an optical element 280.

[0030] The image sensor 270 forms a moving image of the landscape (captures an image) by receiving light from the outside through an optical element 280 (e.g., a lens). The image sensor 270 can be a CCD image sensor (Charge-Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

[0031] The attachment 300 is mounted on the front side 200a of the imaging device 200. The attachment 300 has a box-like shape with an internal space.

[0032] The attachment 300 has a light receiving sensor 310 (also called the first sensor) and a window portion 320.

[0033] The light receiving sensor 310 includes multiple light receiving sensors (light receiving sensors 310-1, 310-2, 310-3, 310-4, 310-5, 310-6, 310-7), but the number of light receiving sensors 310 can be changed as appropriate. The light receiving sensor 310 is located inside (in the inner space) of the attachment 300. Note that unless it is necessary to explain each separately, they will be described as light receiving sensor 310. The light receiving sensor 310 is provided in the floor portion 301. In this example, the light receiving sensor 310 is embedded in the floor portion 301, but it may also be provided on top of the floor portion 301. The light receiving sensor 310 detects the light intensity information and irradiation range of light incident from the window portion 320 of the attachment 300, which will be described later.

[0034] The window portion 320 is provided in front of (facing) the attachment 300 so as to correspond to the image sensor 270 and optical element 280 of the imaging device 200. In this example, the window portion 320 is provided in front of the image sensor 270 and optical element 280.

[0035] Here, Figure 3 shows a schematic diagram of a room 90 provided in an apartment building. The attachment 300 in Figure 2 preferably has the same structure as the room shown in Figure 3, although on a different scale. Specifically, the inside of the attachment 300 is provided with a floor section 301 corresponding to the floor surface 91 of the room 90 provided in the apartment building as described in Figure 3, a wall section 303 corresponding to the wall surface 93 is provided on the interior side, and a ceiling section 305 corresponding to the ceiling surface 95 is provided. In this case, it is preferable that the floor section 301 is made of the same material as the floor surface 91 of the room 90 (also called the first type of material). Specifically, examples of floor materials used for the floor section 301 include wood, resin flooring, carpet, sheet, and tatami. It is preferable that the wall section 303 is made of the same material as the wall surface 93 of the room 90 (also called the second type of material). Specifically, examples of wall materials used for the wall section 303 include wallpaper, concrete, wood, plaster, and mortar. Preferably, the ceiling section 305 is made of the same material (also called the third type of material) as the ceiling surface 95 of the room 90. Specifically, examples of ceiling materials used for the ceiling section 305 include wallpaper, concrete, and wood. In other words, the floor section 301, wall section 303, and ceiling section 305 are each made of different materials. This makes it possible to achieve the same reflectivity as the light incident on the room. If the reflectivity is approximately the same, the materials used for the floor section 301, wall section 303, and ceiling section 305 in the attachment 300 can be different from those used for the floor surface 91, wall surface 93, and ceiling surface 95.

[0036] Furthermore, the window section 320 corresponds to the window 97 of room 90. It is preferable that the same material as the window 97 of room 90 be used for the window section 320. Therefore, the transmittance of the window section 320 will be the same as that of the window 97 of room 90. Light from the outside enters the interior of the attachment 300 through the window section 320. It is preferable to adjust the thickness of the window section 320 according to the scale ratio between room 90 and the attachment 300.

[0037] Furthermore, it is preferable that the height H300 within the attachment 300, the length L300 from the window section 320 to the imaging device, the depth, and the ratio of the size of the window section 320 be set to match the dimensions of the room. In this case, since the attachment 300 has a configuration similar to that of an actual room, it can be considered a miniature version of the room space. As a result, the light incident on the interior of the attachment 300 from the external environment at a predetermined position, height, and direction (orientation) has information similar to the light entering the room through the window. By detecting (receiving) this light, the brightness of the actual room can be reproduced.

[0038] Furthermore, the provision of the window section 320 creates a closed space within the attachment 300. This prevents rain and foreign objects from entering the attachment from the outside.

[0039] (1-1-3. Flying object 400) Let's return to Figure 1 for explanation. The aircraft 400 may be, for example, a drone or an unmanned aerial vehicle (UAV). In addition to having a CPU, GPU, main memory, storage device, input / output interface, and communication interface, the aircraft 400 includes a position sensor 410 such as a GNSS (Global Navigation Satellite System) or GPS (Global Positioning System), an angle sensor 420, a pressure sensor 430 (barometric pressure sensor), a tilt sensor 440, and so on. In this embodiment, the imaging device 200 and attachment 300 are attached to the aircraft 400. The aircraft 400 may also be equipped with multiple other sensors, such as a temperature sensor and a magnetic sensor.

[0040] The position sensor 410 detects the position information (horizontal position information (more specifically, latitude and longitude)) of the aircraft 400. Multiple position sensors 410 may be provided. The angle sensor 420 detects the direction (azimuth) information of the imaging device 200. The pressure sensor 430 detects the height information from the ground by detecting the pressure (atmospheric pressure) at the location where the drone is located. The tilt sensor 440 detects the tilt of the imaging device 200 and the aircraft 400. It is preferable that the aircraft 400 is horizontal. Furthermore, the aircraft 400 may also detect the position information of the sun.

[0041] (1-1-4.DB500) DB500 stores information generated by each hardware resource of the control system. In this example, DB500 may be either the storage device 140 of the control terminal 100 or a cloud-based database server connected to the network.

[0042] (1-2. Functional block diagram of the control system) Figure 4 is a block diagram showing an example of the functional configuration of the control system 10. Each of the functions described below is implemented by hardware, software, or a combination of hardware and software.

[0043] In Figure 4, the control terminal 100 includes a data acquisition unit 1101, a calculation processing unit 1103, an illumination control unit 1105, a display control unit 1107, and an imaging instruction unit 1109.

[0044] The data acquisition unit 1101 acquires various types of data. The acquired information is stored in the storage device 140 or DB500 of the control terminal 100. In this example, the DB500 stores various types of data, including location data, height data, seasonal data, time data, direction data, weather data, moving image data, and attachment information (light intensity data, reflectance (floor, ceiling, wall), incident range, glass transmittance). Each piece of data may be displayed on the display device 170 when the user inputs imaging conditions at the control terminal 100. Based on the input data, the calculation processing unit 1103 generates the imaging condition data shown in Figure 6, which will be described later. The data acquisition unit 1101 also acquires light intensity data detected by the light receiving sensor 310 and moving images captured by the imaging device 200. It is also preferable that the data acquisition unit 1101 acquires location information (latitude and longitude) of the construction site of the apartment building.

[0045] The arithmetic processing unit 1103 generates brightness data (brightness information) based on the detected light intensity information. The lighting control unit 1105 controls the lighting processing by the lighting system 700 using the generated brightness data. The display control unit 1107 controls the display processing of the acquired moving image data by the second display device 600.

[0046] The aircraft 400 includes a flight control unit 4101, a sensor control unit 4105, and a communication processing unit 4107. The flight control unit 4101 controls the flight to a predetermined position based on flight instruction information (flight plan 4103). At the same time, the sensor control unit 4105 controls each sensor provided on the aircraft 400. The communication processing unit 4107 communicates with the control terminal 100, the imaging device 200, and the DB 500.

[0047] The imaging device 200 includes an imaging control unit 2101, an image processing unit 2103, a storage unit 2105, and a sensor control unit 2107. The imaging control unit 2101 controls the imaging process by the image sensor 270 based on imaging instruction information. The image processing unit 2103 processes the moving images captured by the image sensor 270. The storage unit 2105 stores various data acquired by the imaging device 200. The sensor control unit 2107 controls each sensor provided in the imaging device 200.

[0048] The second display device 600 has a display processing unit 6101. The display processing unit 6101 performs display processing on the received moving image (specifically, the scenery outside the window).

[0049] The lighting system 700 has a lighting processing unit 7101. The lighting processing unit 7101 performs lighting processing using a plurality of lighting units 7103 (lighting unit 7103-1, ..., lighting unit 7103-n) provided in the lighting system 700 based on lighting instruction information.

[0050] (1-3. Control Processing) Next, the control processing based on instructions from the control program in this embodiment will be explained using Figures 5 to 10.

[0051] (1-3-1. First control process S100) Figure 5 is a flowchart of the first control process S100. In Figure 5, the user inputs imaging request information, including the imaging conditions to be captured, via the screen (user interface) of the control program (application software) displayed on the display device 170 of the control terminal 100 (S101). At this time, the user can refer to and select imaging request information stored in DB500. For example, the imaging conditions may include the horizontal position information (latitude and longitude) of the apartment building (construction site or planned construction site), the number of floors in the apartment building, the direction to be captured, the season to be captured, the weather to be captured, the time to be captured, the reflectance of the floor material, the reflective area of ​​the floor, the reflectance of the wall material, the reflective area of ​​the wall, the reflectance of the ceiling material, the reflective area of ​​the ceiling, and the transmittance of the window material.

[0052] The data acquisition unit 1101 of the control terminal 100 acquires the input imaging request information. Figure 6 shows imaging condition data P1 to P5 as an example of the imaging condition data structure included in the imaging request information. The imaging condition data structure 800 includes the horizontal position information of the apartment building (latitude and longitude) 805, the number of floors in the apartment building 810, the direction 820, the season 830, the weather 840, the time 850, the reflectance of the floor material 860, the reflective area of ​​the floor 865, the reflectance of the wall material 870, the reflective area of ​​the wall 875, the reflectance of the ceiling material 880, the reflective area of ​​the ceiling 885, and the transmittance of the window material 890. Note that the imaging condition data structure 800 may include only some of the data (for example, the number of floors in the apartment building and the direction). The imaging condition data in Figure 6 is linked to the moving image captured by the imaging device 200 and stored in DB 500. Note that the imaging condition data may be saved in the control terminal 100 after imaging.

[0053] The control terminal 100 generates imaging instruction information based on the imaging request information (S103). The imaging instruction information is transmitted to the imaging device 200 via the aircraft 400 (S105).

[0054] When the aircraft 400 receives imaging instruction information (S107), the aircraft 400 moves (flies) based on a flight plan that includes imaging position information (horizontal position information and height information) and imaging direction information set in the imaging instruction information, as shown in Figure 7 (S109). In this example, the aircraft 400 moves through the space of an apartment building 50 that is under construction. If the apartment building has not yet been constructed, it may be the construction site.

[0055] A position sensor 410 mounted on the aircraft 400 detects the position of the aircraft 400. Angle sensor 420 detects the direction (imaging direction). A magnetic sensor can be used to detect the direction. A pressure sensor 430 calculates the height by detecting the pressure at the position where the aircraft 400 is flying. A tilt sensor 440 detects the tilt (horizontalness) of the aircraft 400 and the imaging device 200 (S111). At this time, the position, direction, and tilt (horizontalness) may be finely adjusted. A horizontal imaging angle is preferable to acquire the view from a window in a room of a building. When a predetermined position is reached, information that the predetermined position has been reached is transmitted from the aircraft 400 to the imaging device 200 (S113).

[0056] When the imaging device 200 reaches a predetermined position, the imaging device 200 starts the imaging process (S115). The imaging device 200 also stores the light intensity information detected by the light receiving sensor 310 located inside the attachment 300 (S115).

[0057] The imaging device 200 transmits the captured moving images (including still images) and light intensity data to the control terminal 100 or DB500 (S117). At this time, the imaging condition data shown in Figure 6 may also be transmitted.

[0058] After receiving motion image data and light intensity data, the control terminal 100 stores this data in the storage device 140 or DB500 (S119). The control terminal 100 generates room brightness data based on the acquired light intensity data. The room brightness data Q is calculated using the following formula 1.

number

[0059] As described above, the attachment 300 in Figure 2 is a space that is a scaled-down version of the room space. The area M on the floor surface 91 of the actual room 90 in Figure 3 where light is reflected is similar to the light-receiving area m on the floor part 301 of the attachment 300 in Figure 2. In other words, by multiplying the light intensity data detected by the light-receiving sensor 310 by a predetermined coefficient S, the amount of light reflected by the floor in the actual room space can be calculated. Therefore, by performing calculations using Equation 1, the same brightness as the room can be obtained.

[0060] Figure 8 shows an example of the brightness data structure 900 for each imaging condition calculated based on Equation 1. As shown in Figure 8, the brightness data structure 900 includes the imaging conditions, which are the horizontal position information (latitude and longitude) of the apartment building (latitude and longitude) 805, the number of floors of the apartment building 810, the direction 820, the season 830, the weather 840, the time 850, the reflectance of the floor material 860, the reflective area of ​​the floor 865, the reflectance of the wall material 870, the reflective area of ​​the wall 875, the reflectance of the ceiling material 880, the reflective area of ​​the ceiling 885, and the transmittance of the window material 890, as well as the amount of light received 910 and the brightness of the room 920. The calculated room brightness data 920 is stored in the storage device 140 or DB500. With this, the first control process S100 is completed.

[0061] (1-3-2. Second control process S200) Figure 9 is a flowchart of the second control process S200. In Figure 9, the second control process S200 uses the second display device 600 and the lighting system 700 to reproduce the moving image and the brightness of the room acquired using the aircraft 400 within the room. First, the process starts when the user selects display request information to the control terminal 100 (S201). For example, the user inputs the display request information by selecting the desired conditions from the brightness data structure 900 in Figure 8 displayed on the control terminal 100. The control terminal 100 generates a display of the moving image of the landscape under the selected imaging conditions, and a lighting instruction to reproduce the brightness data under the same imaging conditions as the moving image of the landscape in the lighting system 700 (S203). Next, the moving image data is transmitted to the second display device 600 based on the display instruction information (S205). The lighting instruction information is transmitted to the lighting system 700 (S207).

[0062] Figure 10 is a schematic diagram of a showroom. When the second display device 600 receives moving image data, it displays the transmitted moving image (S209). In this case, the second display device 600 is positioned in the window frame area of ​​the showroom. As a result, the landscape moving image is displayed from the window frame. The lighting system 700 also receives lighting instruction information and brightness data, and illuminates the room based on the brightness data (S211). Although Figure 10 only shows an example where the lighting is installed near the window frame, the installation location of the lighting is not limited and may be installed on the wall, ceiling, or outside the window. With this, the second control process S200 is completed.

[0063] Conventionally, the brightness inside a room was represented uniformly, and the image of the most beautiful scenery was displayed. In contrast, in this embodiment, imaging is performed in the actual space, and information including light reflected from surrounding buildings and other elements can be acquired. As a result, it is possible to check a video image of the brightness and scenery outside that is very close to what it would be like to actually live in the purchased room. In other words, the gap between the imagined scenery and the actual scenery is reduced, leading to greater satisfaction at the time of purchase.

[0064] <Second Embodiment> In this embodiment, attachments different from those in the first embodiment will be described. Specifically, an example in which parts corresponding to the eaves and veranda of a room are arranged will be described.

[0065] Figure 11 is a schematic diagram of attachment 300A. As shown in Figure 11, attachment 300A has a floor section 301, a wall section 303, a ceiling section 305, a light receiving sensor 310, and a window section 320, in addition to an eaves section 330 and a veranda section 340.

[0066] The eaves 330 is provided on the upper outside of the window section 320. The eaves 330 corresponds to the eaves of the apartment room. The balcony section 340 is provided on the lower outside of the window section 320. The balcony section 340 corresponds to the balcony of the room. The balcony section 340 includes a fence section 341 corresponding to the room's fence (handrail) or parapet and an exterior floor section 343 corresponding to the exterior floor. The fence section 341 overlaps with a part of the window section 320 in the height direction. The length L330 of the eaves 330, the length L343 of the exterior floor section 343 of the balcony section 340, and the height H341 of the fence section 341 of the balcony section 340 are preferably set in accordance with the scale of the room.

[0067] Attachment 300A, by having an eaves portion 330 and a veranda portion 340, can block some of the external light. This reduces the impact of unexpected light (for example, reflected light from another building). Therefore, the space inside attachment 300A can be made closer to the space of an actual room.

[0068] Therefore, by using this embodiment, the brightness of the room can be reproduced more accurately.

[0069] (modified version) The embodiments described above as embodiments of the present invention can be combined and implemented as appropriate, insofar as they do not contradict each other. Furthermore, any additions, deletions, or design changes to components, or additions, omissions, or changes to processes based on these embodiments, made by those skilled in the art, are also included within the scope of the present invention, as long as they retain the essence of the present invention.

[0070] Any effects or benefits other than those brought about by the embodiments described above, if they are clear from the description herein or easily predictable to a person skilled in the art, are naturally considered to be brought about by the present invention.

[0071] In the first embodiment of the present invention, the imaging device 200 is shown to be movable to a predetermined position on the aircraft 400, but the present invention is not limited thereto. Alternatively, instead of the aircraft 400, the imaging device 200B equipped with attachment 300 may be mounted on a mobile body such as a robot. Figure 12 is a block diagram showing an example of the functional configuration of the control system 10B. In the control system 10B of Figure 12, the aircraft 400 is not required. In this case, the imaging device 200B may have position sensors, angle sensors, tilt sensors and other sensors that were equipped on the aircraft 400. The imaging device 200B may also have a communication processing unit 2109. The communication processing unit 2109 communicates with the control terminal 100 and DB 500.

[0072] Figure 13 is a schematic diagram showing an example in which the imaging device 200B equipped with attachment 300 is fixed in place. As shown in Figure 13, the imaging device 200B may be fixed in place. In this case, power can be supplied to the imaging device 200B on a steady basis. By fixing the imaging device 200B, images can be captured over a long period of time. This allows for a more detailed understanding of changes in the brightness of the landscape at the imaging location, thereby increasing customer satisfaction before purchase.

[0073] In the first embodiment of the present invention, an example was shown in which the second display device 600 and the lighting system 700 are provided separately, but the present invention is not limited thereto. The second display device 600 and the lighting system 700 may be reproduced in a VR space. In this case, a head-mounted display may be used. In the VR space, the actual view from the window and the brightness of the room can be reproduced.

[0074] Furthermore, although the first embodiment of the present invention shows an example in which the displayed moving image and brightness are controlled separately, the moving image and brightness may be controlled together. For example, the brightness may be adjusted in conjunction with the displayed image on the second display device 600.

[0075] In the first embodiment of the present invention, an example was shown in which the floor portion 301, wall portion 303, and ceiling portion 305 are each made of different materials, but the present invention is not limited thereto. If the attachment 300 has a configuration such as a darkroom, the floor portion 301, wall portion 303, and ceiling portion 305 may be made of the same material. For example, the interior of the attachment 300 may be a darkroom.

[0076] In the first embodiment of the present invention, an example was shown in which the light receiving sensor 310 is placed on the floor, but the present invention is not limited thereto. The light receiving sensor 310 may also be placed on the ceiling or on the wall. By placing the light receiving sensor 310 at multiple locations within the attachment 300, more detailed light intensity information, such as the distribution of received light and the amount of reflected light, can be obtained within the attachment 300. Therefore, the brightness of the room can be reproduced more accurately.

[0077] In the first embodiment of the present invention, an example of capturing a moving image was shown, but a still image may also be used. [Explanation of symbols]

[0078] 10: Control system, 50: Apartment building, 90: Room, 91: Floor surface, 93: Wall surface, 95: Ceiling surface, 100: Control terminal, 105: Wiring bus, 110: CPU, 120: GPU, 130: Main memory, 140: Storage device, 150: Input / Output IF, 160: Communication IF, 170: Display device, 180: Keyboard, 190: Touch panel, 200: Imaging device, 200B: Imaging device, 210: CPU, 220: GPU, 230: Main memory, 240: Storage device, 250: Input / Output IF, 260: Communication IF, 270: Image sensor, 280: Optical element, 300: Attachment, 301: Floor part, 303: Wall part, 305: Ceiling part, 310: Light receiving sensor, 320: Window part, 330: Eaves part, 340: Balcony part, 341: Fence part, 343: Exterior floor part, 400: Aircraft, 410: Position sensor, 420: Angle sensor, 430: Pressure sensor, 440: Tilt sensor, 500: Database (DB), 600: Second display device, 700: Lighting system, 800: Imaging condition data structure, 805: Horizontal position information, 810: Apartment floor 820: Direction, 830: Season, 840: Weather, 850: Time, 860: Reflectance of floor material, 865: Reflective area of ​​floor, 870: Reflectance of wall material, 875: Reflective area of ​​wall, 880: Reflectance of ceiling material, 885: Reflective area of ​​ceiling, 890: Transmittance, 900: Brightness data structure, 910: Amount of light received, 920: Brightness of room, 1101: Data acquisition unit, 1103: Calculation processing Unit, 1105: Lighting Control Unit, 1107: Display Control Unit, 1109: Image Imaging Instruction Unit, 2101: Image Imaging Control Unit, 2103: Image Processing Unit, 2105: Memory Unit, 2107: Sensor Control Unit, 2109: Communication Processing Unit, 4101: Flight Control Unit, 4103: Flight Plan, 4105: Sensor Control Unit, 4107: Communication Processing Unit, 6101: Display Processing Unit, 7101: Lighting Processing Unit, 7103: Lighting Unit

Claims

1. an acquisition unit that acquires imaging position information including horizontal position information of an imaging position and height information from the ground, imaging direction information indicating an imaging direction, and light intensity information detected based on the imaging position information and the imaging direction information; an illumination control unit that controls illumination processing based on the detected light amount information; Control system.

2. a display control unit that controls display processing of the captured image based on the imaging position information and the imaging direction information. The control system of claim 1 .

3. an imaging device that captures the image; an attachment attached to the front side of the imaging device, The attachment has a box-like shape with an internal space, a first sensor disposed inside the attachment and configured to detect the light amount information of light incident from outside the attachment; The control system of claim 2 .

4. The attachment is a window portion disposed in front of the imaging device so as to correspond to the imaging element of the imaging device; the window portion includes a glass material; the first sensor detects information about the amount of light incident on the inside of the attachment through the window portion; The control system of claim 3 .

5. The attachment is a floor portion provided on a lower surface of the interior and including a first type of material, a wall portion provided on a side surface of the interior and including a second type of material, and a ceiling portion provided on an upper surface of the interior and including a third type of material; The control system of claim 4.

6. the first sensor is composed of a plurality of first sensors, Each of the plurality of first sensors is disposed on at least one of the floor, the wall, and the ceiling. The control system of claim 5 .

7. the acquisition unit acquires reflectance information of at least one of the floor portion, the wall portion, and the ceiling portion; generating brightness information by performing an arithmetic process using the at least one piece of reflectance information and the light quantity information, and controlling the lighting process using the brightness information; The control system of claim 6.

8. The attachment includes an eave portion provided on the upper outer side of the window portion, and At least one of a balcony portion arranged at a lower outer side of the window portion and overlapping a part of the window portion in the height direction, A control system according to any one of claims 4 to 7.

9. the imaging device with the attachment attached is attached to an aircraft; The flying vehicle is a second sensor for detecting the imaging direction information; a third sensor that detects the imaging position information, A control system according to any one of claims 3 to 8.

10. The flying object further includes a fourth sensor that detects tilt information of the flying object; the imaging device captures an image based on the tilt information. The control system of claim 9.

11. The image is displayed in a virtual reality (VR) space using the brightness information. The control system of claim 7.

Images