Installation assistance device, installation assistance system, installation assistance method, and program

Abstract

To provide an installation assistance device, an installation assistance system, an installation assistance method, and a program for assisting decision about an appropriate position in which a watching device is installed.SOLUTION: An installation assistance device 10 provides assistance for installing a watching device that watches over a resident by imaging the inside of a living room. The installation assistance device 10 comprises: an image acquisition unit 111a that acquires, as a living room image, an image of the inside of the living room captured by an imaging unit 114; and an installation position determination unit 111b that estimates a shape and a size of the living room on the basis of the living room image, and determines a recommended installation position of the watching device on the basis of the estimated shape and size. The installation assistance device further comprises a proposal processing unit 111e that performs processing for proposing the recommended installation position determined by the installation position determination unit 111b.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an installation support device, an installation support system, an installation support method, and a program that support the installation of a monitoring device that monitors an occupant by capturing an image of the inside of a room. [Background technology]

[0002] Conventionally, there is known a monitoring device that is installed in a room in a facility such as a nursing home and monitors the occupants by capturing images of the interior of the room. The monitoring device is installed in the upper part of the room, mainly on the ceiling, by a worker dispatched to the site. At this time, the worker determines an appropriate installation position (installation location) according to the shape and size (internal dimensions) of the room, and attaches the monitoring device to the determined installation position.

[0003] The worker cannot check the imaging range of the monitoring device until the monitoring device is installed. Therefore, the location where the monitoring device is installed is not necessarily appropriate depending on the shape of the room and the arrangement of furniture, lighting, and other equipment in the room. Therefore, if the installation location is inappropriate, the installation must be redone, which may increase the amount of work or leave installation marks on the ceiling surface, degrading the aesthetic appearance.

[0004] For these reasons, workers would like to be able to easily determine an appropriate installation location for the monitoring device, and would also like to be able to check the imaging range and imaging status of the monitoring device installed in the determined location before actually installing it.

[0005] The following Patent Document 1 describes a curtain attachment simulation system. In this system, curtain attachment position information in a background image is received, and a curtain image is generated based on the curtain attachment position information. Then, the curtain image and the background image are combined to generate a simulation image in which a curtain is attached at the curtain attachment position in the background image, and the simulation image is displayed on a display unit.

[0006] As described above, a system that provides assistance in installing curtains in a room is already known. However, it is believed that a device or system that provides assistance in installing a monitoring device is not yet known. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2010-39908 A Summary of the Invention [Problem to be solved by the invention]

[0008] When installing a monitoring device in a room, if assistance could be provided to a worker in determining an appropriate installation position, it would be possible to reduce the burden on the worker.

[0009] In view of the above problem, the present invention aims to provide an installation support device, an installation support system, an installation support method, and a program that can provide support in determining an appropriate installation location for a monitoring device. [Means for solving the problem]

[0010] A first aspect of the present invention relates to an installation support device that supports the installation of a monitoring device that monitors a resident by capturing an image of the interior of a room. The installation support device according to this aspect includes an image acquisition unit that acquires an image of the interior of the room captured by an imaging unit as a room image, and an installation position determination unit that estimates a shape and size of the room based on the room image and determines a recommended installation position of the monitoring device based on the estimated shape and size.

[0011] According to the installation support device of this aspect, a worker can easily determine the actual installation position of the monitoring device by obtaining the recommended installation position of the monitoring device from the installation support device.

[0012] The installation assistance device according to this aspect may be configured to further include a proposal processing unit that performs processing for proposing the recommended installation position determined by the installation position determination unit.

[0013] According to the above configuration, the worker can easily obtain the recommended installation position through a suggestion from the installation support device, such as a display on the display unit.

[0014] In the installation support device of this embodiment, the device may be configured to further include an image generation unit that generates a pseudo-image of an image that would be captured when the monitoring device is installed at the recommended installation position determined by the installation position determination unit, and a display processing unit that performs processing to display the pseudo-image.

[0015] For example, the image generation unit may be configured to generate a three-dimensional layout model of the room based on the room image, and to generate the pseudo image based on the layout model, the recommended installation position determined by the installation position determination unit, and the imaging range of the monitoring device.

[0016] According to the above configuration, before actually installing the monitoring device in the recommended installation position, the worker can check the imaging range and imaging state of the monitoring device when installed in the recommended installation position and can determine whether the recommended installation position is appropriate. This prevents the need to redo the installation, which would increase the amount of work, and prevents installation marks from remaining on the installation surface, such as the ceiling, which would detract from the aesthetic appearance.

[0017] The installation support device according to this aspect may be further configured to include an operation unit for performing an operation to change the recommended installation position to a position different from the position determined by the installation position determination unit. In this case, the image generation unit may be configured to generate the pseudo image of the monitoring device when the recommended installation position is changed.

[0018] According to the above configuration, if an operator such as a worker checks the pseudo image and finds that the determined recommended installation position is not appropriate, the operator can change the recommended installation position to another position and check the pseudo image at the changed recommended installation position. This makes it possible to install the monitoring device in a more appropriate installation position.

[0019] In the installation assistance device according to this aspect, the image generation section may be configured to combine an image of a person with the pseudo image.

[0020] According to the above configuration, an operator such as a worker can check a pseudo image that includes the person to be watched and is similar to an actual surveillance image.

[0021] In the installation assistance device according to this aspect, the imaging unit may be configured to capture a visible image having luminance information for each pixel, and the image acquisition unit may be configured to acquire the visible image as the room image.

[0022] In the above configuration, the room image may include an image of a measurement reference body. In this case, the acquisition unit may be configured to acquire the size of the measurement reference body as a reference size together with the room image. Furthermore, the installation position determination unit may be configured to estimate the size of the room based on the reference size.

[0023] According to the above configuration, it is possible to accurately estimate the size of a room from a room image, which is a visible image.

[0024] In the installation assistance device according to this aspect, the imaging unit may be configured to capture a distance image having distance information for each pixel by a ToF method, and the image acquisition unit may be configured to acquire the distance image as the room image.

[0025] With the above configuration, there is no need to perform a series of tasks, such as capturing an image of a room so that it includes a measurement reference object and then inputting the size of the measurement reference object in order to use it to estimate the shape and size of the room, making it easier to operate the installation support device.

[0026] In the installation support device of this embodiment, the installation position determination unit may be configured to estimate the position of equipment placed in the room based on the room image, and to determine the recommended installation position based on the estimated shape and size of the room and the positions of the equipment.

[0027] According to the above configuration, the placement of equipment is taken into consideration when determining the recommended installation location, making it possible to install the monitoring device in a more appropriate location where blind spots caused by equipment are reduced and where the monitoring device can avoid equipment present on the installation surface.

[0028] In the installation support device according to this aspect, the monitoring device may be configured to include a movable camera unit, and the imaging range may be adjusted by adjusting the movable range of the camera unit. In this case, the installation support device may be configured to further include a movable range notification processing unit that performs processing to notify the movable range required for the imaging range to cover a predetermined monitoring range according to the size of the room when the monitoring device is installed at the recommended installation position.

[0029] According to the above configuration, a worker or the like can check the movable range of the camera unit notified by the installation support device, and set the movable range to an appropriate range when actually installing the monitoring device in a room.

[0030] A second aspect of the present invention relates to an installation support system including an installation support device that supports the installation of a monitoring device that monitors a resident by capturing an image of the interior of a room, and an imaging device that captures an image of the interior of the room as a room image and transmits the image to the installation support device. In the installation support system according to this aspect, the installation support device includes an image acquisition unit that acquires the room image captured by the imaging device, and an installation position determination unit that estimates a shape and size of the room based on the room image and determines a recommended installation position of the monitoring device based on the estimated shape and size.

[0031] According to the installation support system of this aspect, the same effects as those of the first aspect can be achieved.

[0032] A third aspect of the present invention relates to an installation support method executed by an installation support device that supports the installation of a monitoring device that monitors a resident by capturing an image of the interior of a living room, the installation support method according to this aspect comprising the steps of: acquiring an image of the interior of the living room captured by an imaging unit as a living room image; and estimating a shape and size of the living room based on the living room image, and determining a recommended installation position of the monitoring device based on the estimated shape and size.

[0033] According to the installation support method of this aspect, the same effects as those of the first aspect can be achieved.

[0034] A fourth aspect of the present invention is a program that causes a control unit of an installation support device, which supports the installation of a monitoring device that monitors residents by capturing images of the interior of a room, to execute a function of acquiring an image of the interior of the room captured by an imaging unit as a room image, and a function of inferring the shape and size of the room based on the room image, and determining a recommended installation location for the monitoring device based on the inferred shape and size.

[0035] According to the program of this aspect, the same effects as those of the first aspect can be achieved. Effect of the Invention

[0036] As described above, according to the present invention, it is possible to provide an installation support device, an installation support system, an installation support method, and a program that are capable of supporting the determination of an appropriate installation position for a monitoring device.

[0037] The effects and significance of the present invention will become clearer from the following description of the embodiment. However, the embodiment described below is merely an example of how the present invention can be put into practice, and the present invention is not limited to the embodiment described below. [Brief description of the drawings]

[0038] [Figure 1] FIG. 1 is a diagram for explaining an overview of an installation support device and a monitoring device according to the first embodiment. [Diagram 2] 2(a) to 2(c) are diagrams showing an example of a monitoring device for which the installation support device provides installation support according to the first embodiment. [Diagram 3] FIG. 3 is a block diagram illustrating a configuration of the installation support device according to the first embodiment. [Figure 4] FIG. 4 is a flowchart showing a process performed in the control unit of the installation support device according to the first embodiment. [Diagram 5] 5(a) and (b) are diagrams for explaining the process for acquiring a room image according to the first embodiment. [Figure 6] 6(a) to (d) are diagrams for explaining the process for acquiring a room image according to the first embodiment. [Figure 7] FIG. 7(a) is a diagram for explaining the process for estimating the shape and size of a room according to embodiment 1, and FIGS. 7(b) and (c) are diagrams for explaining the process for determining a recommended installation position for a monitoring device according to embodiment 1. [Figure 8] 8(a) to (d) are diagrams illustrating the process for generating a pseudo image according to the first embodiment. [Figure 9]FIG. 9(a) is a diagram for explaining a process for displaying a pseudo image according to embodiment 1, and FIG. 9(b) is a diagram for explaining a process for proposing a recommended installation position for a monitoring device according to embodiment 1. [Figure 10] FIG. 10 is a block diagram showing a configuration of an installation support system according to the second embodiment. [Figure 11] FIG. 11 is a flowchart showing a process performed in the control unit of the installation support device according to the first modified example. [Figure 12] FIG. 12(a) is a diagram showing an example of a pseudo image display screen according to the first modification, and FIG. 12(b) is a diagram showing an example of an installation position change screen according to the first modification. [Figure 13] Fig. 13(a) is a flowchart showing a process performed in a control unit of the installation support device according to Modification Example 2. Fig. 13(b) is a diagram showing an example of a pseudo image display screen in which a human image is combined with a pseudo image according to Modification Example 2. [Figure 14] FIG. 14 is a block diagram showing a configuration of an installation support device capable of communicating with a projector according to the third modified example. [Figure 15] Fig. 15(a) is a flowchart showing a process performed in a control unit of an installation support device according to Modification Example 3. Fig. 15(b) is a diagram showing an example of an installation position image according to Modification Example 3. Fig. 15(c) is a diagram showing a state in which the installation position image is projected onto a ceiling surface of a room by a projector according to Modification Example 3. [Figure 16] 16(a) to 16(c) are diagrams for explaining an installation support device according to the fourth modified example. [Figure 17] 17(a) and (b) are diagrams showing the configuration of a watching device according to Modification Example 5. FIG. 17(c) is a diagram showing the configuration of an installation support device according to Modification Example 5. [Figure 18] Fig. 18(a) is a flowchart showing processing performed in a control unit of the installation support device according to Modification 5. Fig. 18(b) to (d) are diagrams for explaining processing for notifying the movable range of the camera unit according to Modification 5. [Figure 19] FIG. 19 is a block diagram showing a configuration of an installation support device according to the sixth modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0039] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0040] <Embodiment 1> An installation support device 10 according to a first embodiment will be described.

[0041] The installation support device 10 is a device that provides support for installing the monitoring device 20 in a room. In this embodiment, a portable installation support device 10 is realized by installing an application program for executing the functions of the installation support device 10 in a portable terminal device such as a smartphone or tablet terminal equipped with a camera.

[0042] FIG. 1 is a diagram for explaining an overview of an installation support device 10 and a watching device 20. As shown in FIG.

[0043] As shown in the upper left diagram of FIG. 1, the monitoring device 20 is installed in the upper part of a room in a facility such as a nursing home, mainly on the ceiling. The monitoring device 20 monitors the resident by capturing images of the inside of the room. For example, the monitoring device 20 sends the captured images (video) to a management terminal provided in a management company. The monitoring device 20 also has an image recognition function and recognizes the resident included in the captured images. When the resident performs an abnormal movement such as a fall, the movement is detected by the monitoring device 20 and a report is sent from the monitoring device 20 to the management terminal. For example, the monitoring device 20 recognizes the resident's chest, and if the chest is on the floor, it considers that the resident has fallen and sends a report.

[0044] The monitoring device 20 is installed in the room by a worker dispatched to the site. When installing, the worker needs to determine an appropriate installation position (installation location) according to the shape and size (internal dimensions) of the room. When determining an appropriate installation position for the monitoring device 20, the installation support device 10 is used.

[0045] As shown in the lower right diagram of FIG. 1, a photographer such as a worker captures an image of the interior of the room before the monitoring device 20 is installed as a room image using the installation support device 10, the image being used to identify the shape, etc., of the room. The installation support device 10 determines a recommended installation position P of the monitoring device 20 suitable for the room by inferring the shape, etc. of the room based on the captured room image. The installation support device 10 then displays a pseudo image generated by pseudo-generating an image captured by the monitoring device 20 installed at the determined recommended installation position P. Furthermore, the installation support device 10 proposes the determined recommended installation position P.

[0046] The worker checks the pseudo image displayed by the installation support device 10 and confirms the recommended installation position P proposed by the installation support device 10 as the actual installation position. After that, the worker installs the monitoring device 20 in the confirmed installation position in the living room.

[0047] 2(a) to (c) are diagrams showing an example of a monitoring device 20 for which installation support is provided by the installation support device 10. Fig. 2(a) is a front view of the monitoring device 20, and Figs. 2(b) and (c) are side views of the monitoring device 20.

[0048] The monitoring device 20 includes a movable camera unit 21 that captures an image. The camera unit 21 is, for example, a ToF camera or an infrared camera. The camera unit 21 is rotated in the front-rear direction by a drive motor 22. The camera unit 21 can rotate by a predetermined first angle (for example, about 50 degrees) from a rear position (see FIG. 2(b)) where the imaging lens 21a faces directly downward to a front position (see FIG. 2(c)) where the imaging lens 21a faces diagonally downward and forward. That is, the movable range (rotatable range) α of the camera unit 21 is the first angle. The camera unit 21 does not move in the left-right direction.

[0049] The left-right angle A1 of the camera unit 21 is fixed and is 0 degrees with respect to the vertical. The front-rear angle A2 of the camera unit 21 changes and is 0 degrees with respect to the vertical when the camera unit 21 is in the rear position, and is at a first angle with respect to the vertical when the camera unit 21 is in the front position.

[0050] The angle of view R1 in the left-right direction of the camera unit 21 is a predetermined second angle (for example, about 90 degrees), and the angle of view R2 in the front-rear direction of the camera unit 21 is a predetermined third angle (for example, about 60 degrees).

[0051] The angle expressed three-dimensionally by combining left-right angle A1 and front-to-back angle A2 is simply referred to as angle A, and the angle expressed three-dimensionally by combining left-right angle of view R1 and front-to-back angle of view R2 is simply referred to as angle of view R.

[0052] The angle of view R and movable range α of the camera unit 21 determine the imaging range of the camera unit 21, i.e., the monitoring device 20. Since the camera unit 21 of the monitoring device 20 rotates in the front-to-rear direction, the imaging range of the device is wider in the front-to-rear direction than in the left-to-right direction of the device.

[0053] The monitoring device 20 may be configured so that the camera unit 21 does not move at all, or may be configured so that the camera unit 21 is rotatable in both the front-back and left-right directions.

[0054] FIG. 3 is a block diagram showing the configuration of the installation support device 10. As shown in FIG.

[0055] The installation support device 10 includes a control unit 111 , a storage unit 112 , an operation display unit 113 , an imaging unit 114 , and a wireless communication unit 115 .

[0056] The control unit 111 includes an arithmetic processing circuit such as a CPU (Central Processing Unit), and controls each unit according to a program stored in the storage unit 112. The storage unit 112 includes storage media such as a ROM (Read Only Memory) and a RAM (Random Access Memory), and stores the programs executed by the control unit 111 and various data. The storage unit 112 is also used as a work area when the control unit 111 performs control.

[0057] In this embodiment, the application program 112a of the installation support device 10 is installed in the storage unit 112. The storage unit 112 also stores the angle of view R (R1, R2) of the monitoring device 20 and angles A (A1, A2) at the front and rear positions.

[0058] The operation display unit 113 includes a touch panel and a processing circuit for the same. The operation display unit 113 displays a predetermined screen in response to control from the control unit 111, and also outputs to the control unit 111 a signal in response to an operation performed on the screen by an operator.

[0059] The imaging unit 114 includes an imaging element such as a CMOS sensor and a processing circuit for the imaging element. The imaging unit 114 captures a visible image having luminance information and color information for each pixel under the control of the control unit 111, and outputs the visible image (visible image data) to the control unit 111.

[0060] The wireless communication unit 115 is a wireless communication module for performing wireless communication with a router, a base station, etc. The router and the base station are connected to an external communication network such as the Internet. Under the control of the control unit 111, the wireless communication unit 115 communicates with an external device such as a server or a personal computer via the external communication network.

[0061] In this embodiment, the control unit 111 is provided with the functions of an image acquisition unit 111a, an installation position determination unit 111b, an image generation unit 111c, a display processing unit 111d, and a proposal processing unit 111e by an application program 112a stored in the storage unit 112.

[0062] The image acquisition unit 111a acquires, as a room image, an image (visible image) of the interior of the room captured by the imaging unit 114. The installation position determination unit 111b estimates the shape and size (length, width, height, etc.) of the room based on the room image, and determines a recommended installation position P of the monitoring device 20 based on the estimated shape and size.

[0063] The image generating unit 111c generates, as a pseudo image, an image that is captured when the watching device 20 is installed at the recommended installation position P determined by the installation position determining unit 111b. The display processing unit 111d executes processing for displaying the pseudo image on the operation display unit 113, which is a display unit.

[0064] The proposal processing unit 111e performs a process for proposing the recommended installation position P determined by the installation position determining unit 111b.

[0065] FIG. 4 is a flow chart showing the processing performed by the control unit 111 of the installation support device 10. FIGS. 5(a) and (b) and FIGS. 6(a) to (d) are diagrams for explaining the processing for acquiring a room image M1. FIG. 7(a) is a diagram for explaining the processing for estimating the shape and size of a room, and FIGS. 7(b) and (c) are diagrams for explaining the processing for determining a recommended installation position P of the monitoring device 20. FIGS. 8(a) to (d) are diagrams for explaining the processing for generating a pseudo image M2. FIG. 9(a) is a diagram for explaining the processing for displaying the pseudo image M2, and FIG. 9(b) is a diagram for explaining the processing for proposing a recommended installation position P of the monitoring device 20.

[0066] The control unit 111 is provided with the functions of the image recognition engine and the three-dimensional image generation engine by installing application programs for these engines in the storage unit 112.

[0067] 4, first, the control unit 111 (image acquisition unit 111a) executes a process for acquiring a room image M1 including information required for estimating the shape and size of a room (S101).

[0068] That is, the control unit 111 causes the operation display unit 113 to display a shooting operation screen 500. As shown in Fig. 5(a), the shooting operation screen 500 includes a preview image 501 output from the imaging unit 114, a shutter button 502, and an end button 503. When the shutter button 502 is pressed, the imaging unit 114 captures an image in response to a shooting command from the control unit 111.

[0069] The photographer captures visible images that capture the entire front, back, left, and right walls and parts of the ceiling and floor from four directions, as room image M1. At this time, the photographer has a person who serves as a measurement reference stand near the wall so that an image of the person is included in room image M1. Room images M1 from four directions as shown in Figs. 6(a) to (d) are output from imaging unit 114 and acquired by control unit 111.

[0070] When the photographer presses the end button 503, the control unit 111 displays a reference size input screen 510 on the operation display unit 113. As shown in FIG. 5(b), the reference size input screen 510 includes a numeric keypad 511, an input box 512, and a confirmation button 513.

[0071] The photographer inputs the height of a person included in the room image M1 as a measurement reference body using numeric keypad 511. The input height is displayed in input box 512. Control unit 111 acquires the input height as reference size D and stores it in memory unit 112. Reference size D is used when estimating the size of the room based on the room image M1.

[0072] Alternatively, a video including images M1 of the room in four directions may be captured by the imaging unit 114, and the control unit 111 (image acquisition unit 111a) may extract the images M1 of the room in four directions from the video.

[0073] Furthermore, the room images M1 in four directions may be captured in advance and stored in the storage unit 112, and the control unit 111 (image acquisition unit 111a) may acquire the room images M1 stored in the storage unit 112.

[0074] Furthermore, an object other than a person, for example, a specific object, may be used as the measurement reference object. The specific object may be an object already present in the room as long as it can be used as the measurement reference object.

[0075] Next, the control unit 111 (installation position determination unit 111b) executes a process for estimating the shape and size (inner dimensions) of the room based on the acquired room image M1 (S102).

[0076] That is, the control unit 111 recognizes each wall surface and a person as a measurement reference body included in the four living room images M1 by using the function of the image recognition engine, and extracts the four wall surfaces on the front, back, left, and right and the measurement reference body (person) from the four living room images M1. Then, the control unit 111 infers the shape of the living room formed by combining these walls based on the shapes of the four walls. For example, as shown in Fig. 7(a), if all four walls have a square planar shape, the control unit 111 infers that the living room is a rectangular parallelepiped shape.

[0077] Furthermore, the control unit 111 estimates the size of the room from the ratio of each side of the room to the measurement reference body and the reference size D of the measurement reference body (person's height). For example, as shown in Fig. 7(a), in the case of a rectangular parallelepiped shape, the control unit 111 estimates the vertical width W1, horizontal width W2, and height H of the room.

[0078] Next, the control unit 111 (installation position determining unit 111b) executes a process for determining a recommended installation position P of the watching device 20 based on the estimated shape and size of the room (S103).

[0079] Installation rules are determined in advance to determine the recommended installation position P. In this embodiment, the installation rules are, for example, as follows.

[0080] (1) When the length of a room in the vertical direction and the length of the room in the horizontal direction are different, the longitudinal direction of the room is set as the front-to-rear direction of the monitoring device 20, which has a wide imaging range.

[0081] (2) In the direction of the room, which corresponds to the left and right sides of the monitoring device 20 (in the direction of the short side if the lengths are different), the monitoring device 20 is installed in the center position.

[0082] (3) In the direction of the room, which is the front-to-back direction of the monitoring device 20 (the longitudinal direction if the length is different), the monitoring device 20 is installed in a position where the specified height range X is imaged from the floor surface on the wall behind the monitoring device 20 when the front-to-back angle A2 of the monitoring device 20 is at its smallest (0 degrees).

[0083] (4) If there is a door (entrance / exit) on a wall in the direction of the living room, which is the front and rear of the monitoring device 20, the wall surface having the door should be located in front of the monitoring device 20.

[0084] The installation rules are not limited to those described above, and any rules may be used as long as the recommended installation position P is determined using the shape and size of the room.

[0085] The control unit 111 determines a recommended installation position P of the monitoring device 20 on the ceiling surface based on the estimated shape and size of the room in accordance with the above installation rules. At this time, the angle of view R2 in the front-to-rear direction stored in the storage unit 112 is also used. For example, as shown in FIG. 7(a), in a room in which the vertical width W1 is greater than the horizontal width W2, the vertical direction is longer than the horizontal direction, and there is a door on the vertical wall, the recommended installation position P of the monitoring device 20 is determined as shown in FIG. 7(b) and (c). The control unit 111 recognizes the door on the wall surface by using the function of an image recognition engine.

[0086] 7(b) and (c), the recommended installation position P can be represented by a distance L1 from either a wall surface on the left or right side of the watching device 20, and a distance L2 from a wall surface on the rear side of the watching device 20. The control unit 111 stores these distances L1 and L2 in the storage unit 112 as position information of the recommended installation position P.

[0087] The monitoring device 20 is attached to the ceiling surface via a mounting bracket or the like so that the position of the imaging lens 21a of the camera unit 21 approximately coincides with the recommended installation position P in a plan view.

[0088] Next, the control unit 111 (image generating unit 111c) executes a process for generating a pseudo image M2 based on an image that would be captured if the monitoring device 20 were installed at the recommended installation position P determined in step S103 (S104).

[0089] In this embodiment, the angle A changes as the camera unit 21 of the monitoring device 20 rotates. Thus, a pseudo image M2 at angle A (front-to-back angle A2 is 0 degrees) when the camera unit 21 is in a rear position, and a pseudo image M2 at angle A (front-to-back angle A2 is a first angle) when the camera unit 21 is in a front position are generated.

[0090] First, the control unit 111 generates a three-dimensional layout model LM of the room based on the room image M1 acquired in step S101. That is, the control unit 111 recognizes fittings such as windows and doors installed on the walls and furnishings such as a bed and a wardrobe case arranged in the room from each of the four room images M1, and estimates the shapes, sizes, and positions of these fittings and furnishings in the room. At this time, the reference size D of the measurement reference body is used to estimate the size. Then, the control unit 111 uses the function of the three-dimensional image generation engine to generate a layout model LM in which fittings are arranged on the walls of the room and furnishings are arranged in the room, as shown in Figures 8(a) and (c).

[0091] As shown in Fig. 8(a) and (c), when the monitoring device 20 is installed at the recommended installation position P in the living room of the layout model LM, the angle A and the angle of view R of the camera unit 21 determine the imaging range in the living room at the angle A. Therefore, the control unit 111 generates 3D computer graphics images of the two imaging ranges shown in Fig. 8(a) and (c) based on the layout model LM, the recommended installation position P, and the angle A and the angle of view R, i.e., the imaging range, by using the function of the 3D image generation engine. As a result, a pseudo image M2 at the angle A when the camera unit 21 is in the rear position as shown in Fig. 8(b), and a pseudo image M2 at the angle A when the camera unit 21 is in the forward position as shown in Fig. 8(d) are generated.

[0092] In addition to the above two pseudo images M2, one or more pseudo images M2 may be generated when the camera unit 21 of the monitoring device 20 is in one or more positions between the rear position and the front position. For example, if the monitoring device 20 is configured so that the camera unit 21 moves between the rear position, the front position, and an intermediate position therebetween in response to the movement of the resident in the room, the pseudo images M2 in these three positions can be generated.

[0093] Next, the control unit 111 (display processing unit 111d) executes a process for displaying the pseudo image M2 (S105).

[0094] That is, the control unit 111 generates a pseudo image display screen 520 including two pseudo images M2, and causes the pseudo image display screen 520 to be displayed on the operation display unit 113. As shown in Fig. 9(a), the pseudo image display screen 520 includes, in addition to the two pseudo images M2, a confirm button 521. When the confirm button 521 is pressed, the pseudo image display screen 520 is closed.

[0095] By looking at the pseudo image M2 displayed on the operation display unit 113, an operator can check the imaging range and imaging state of the monitoring device 20 when installed at the recommended installation position P before actually installing the monitoring device 20 at the recommended installation position P, and can determine whether the recommended installation position P is appropriate.

[0096] It should be noted that one pseudo image display screen 520 may be generated for each pseudo image M2.

[0097] Furthermore, the entire pseudo image display screen 520 may be configured with two pseudo images M2 or one pseudo image M2. In this case, for example, the pseudo image display screen 520, i.e., the pseudo image M2, may be configured to be closed by a tap operation.

[0098] Furthermore, as a display process, the control unit 111 (display processing unit 111d) may transmit the pseudo image M2 to an external device such as a personal computer via the wireless communication unit 115, etc., so that the pseudo image M2 can be displayed on a display unit of the external device.

[0099] Next, the control unit 111 (proposal processing unit 111e) executes processing for proposing a recommended installation position P of the monitoring device 20 determined in step S103 (S106). That is, the control unit 111 generates an installation position display screen 530 showing the recommended installation position P, and causes the operation display unit 113 to display the installation position display screen 530. As shown in FIG. 9(b), the installation position display screen 530 includes, for example, an installation diagram 531 showing the monitoring device 20 located at the recommended installation position P on a plan layout of the room, and distances L1 and L2 from each wall surface to the recommended installation position P. The installation position display screen 530 also includes a confirm button 532. When the confirm button 532 is pressed, the installation position display screen 530 is closed.

[0100] The recommended installation position P of the watching device 20 is suggested by the display on the operation display unit 113, so that the worker can easily determine an appropriate installation position for the watching device 20.

[0101] Note that, as the proposal process, the control unit 111 (proposal processing unit 111e) may transmit an image showing the recommended installation position P such as the installation drawing 531 to an external device such as a personal computer via the wireless communication unit 115, etc., so as to display it on a display unit of the external device. Furthermore, the control unit 111 may output the image showing the recommended installation position P to an external printer via the wireless communication unit 115, etc., and cause the printer to print it.

[0102] <Effects of the First Embodiment> According to the first embodiment, the following effects can be achieved.

[0103] 4, the functions of the image acquisition unit 111a and the installation position determination unit 111b provided to the control unit 111 by the application program 112a acquire a room image M1 captured by the imaging unit 114, estimate the shape and size of the room based on the acquired room image M1, and determine a recommended installation position P of the monitoring device 20 based on the shape and size. Thus, by obtaining the recommended installation position P from the installation support device 10, the worker can easily determine the actual installation position of the monitoring device 20.

[0104] 4, a process for proposing the determined recommended installation position P is performed by the function of the proposal processing unit 111e provided to the control unit 111 by the application program 112a. Therefore, the worker can easily obtain the recommended installation position P by the proposal from the installation support device 10 by displaying it on the operation display unit 113, etc.

[0105] Furthermore, as shown in FIG. 4, by the functions of the image generation unit 111c and the display processing unit 111d provided to the control unit 111 by the application program 112a, an image that would be captured if the monitoring device 20 were installed at the determined recommended installation position P is pseudo-generated as a pseudo image M2 and displayed on the operation display unit 113.

[0106] More specifically, by the function of the image generation unit 111c, a three-dimensional layout model LM of the room is generated based on the room image M1, and a pseudo image M2 is generated based on the layout model LM, the determined recommended installation position P, and the imaging range of the monitoring device 20.

[0107] Therefore, before actually installing the monitoring device 20 at the recommended installation position P, the worker can check the imaging range and imaging state of the monitoring device 20 when installed at the recommended installation position P, and can determine whether the recommended installation position P is appropriate. This prevents the need to redo the installation, which would increase the amount of work, and prevents installation marks from remaining on the ceiling surface or the like, which would detract from the aesthetic appearance.

[0108] Furthermore, the imaging unit 114 captures a visible image having brightness information for each pixel, and acquires the visible image as the room image M1. At this time, the size of the measurement reference body is acquired as the reference size D along with the room image M1 by the functions of the image acquisition unit 111a and the installation position determination unit 111b, and the size of the room is estimated based on the reference size D. This makes it possible to accurately estimate the size of the room from the room image M1, which is a visible image.

[0109] <Embodiment 2> An installation support system 1 according to a second embodiment will be described.

[0110] FIG. 10 is a block diagram showing the configuration of the installation support system 1. As shown in FIG.

[0111] The installation support system 1 includes an installation support device 30 and an imaging device 40. In this embodiment, the installation support device 30 is realized by installing an application program for executing the functions of the installation support device 30 in a terminal device such as a personal computer. The installation support device 30 provides support for installing the monitoring device 20 in a room. The installation support device 30 is installed, for example, in the facility of a manufacturer that sells the monitoring device 20.

[0112] The imaging device 40 is, for example, a mobile terminal device such as a smartphone or tablet terminal equipped with a camera, and can be communicatively connected to the installation support device 30 via an external communication network 60 or the like. The imaging device 40 has an imaging section 41 including an imaging element and the like, which has a configuration similar to that of the imaging section 114 in the above-mentioned first embodiment, and captures an image (visible image) of the interior of the room as a room image M1 using the imaging section 41, and transmits the image to the installation support device 30. Furthermore, the imaging device 40 has a display section 42 on which a preview image and the like are displayed during imaging.

[0113] The installation support device 30 includes a control unit 311 , a storage unit 312 , a display unit 313 , an operation unit 314 , and a wireless communication unit 315 .

[0114] The control unit 311 includes an arithmetic processing circuit such as a CPU (Central Processing Unit), and controls each unit according to a program stored in the storage unit 312. The storage unit 312 includes a storage medium such as a ROM (Read Only Memory) and a RAM (Random Access Memory), and stores the programs executed by the control unit 311 and various data. The storage unit 312 is also used as a work area when the control unit 311 performs control.

[0115] In this embodiment, the application program 312a of the installation support device 30 is installed in the storage unit 312. The storage unit 312 also stores the angle of view R (R1, R2) of the monitoring device 20 and angles A (A1, A2) at the front and rear positions.

[0116] The display unit 313 includes a display such as a liquid crystal panel and a processing circuit for the same. The display unit 313 displays a predetermined screen in response to control from the control unit 311. The operation unit 314 includes a keyboard and a mouse and a processing circuit for the same. The operation unit 314 outputs a signal to the control unit 311 in response to an operation performed by an operator.

[0117] The wireless communication unit 315 is a wireless communication module for performing wireless communication with the router 50. The router 50 is connected to an external communication network 60 such as the Internet. Under control of the control unit 311, the wireless communication unit 315 communicates with the imaging device 40 via the router 50, the external communication network 60, and a router 70 (or a base station).

[0118] In this embodiment, similar to the control unit 111 of the installation support device 10 in the above-mentioned embodiment 1, the control unit 311 is provided with the functions of an image acquisition unit 311a, an installation position determination unit 311b, an image generation unit 311c, a display processing unit 311d and a proposal processing unit 311e by an application program 312a stored in a memory unit 312.

[0119] In the installation support system 1 of this embodiment, the control unit 311 of the installation support device 30, like the control unit 111 of the installation support device 10 of the above-mentioned embodiment 1, executes the processing shown in FIG. 4 using the functions of the image acquisition unit 311a, the installation position determination unit 311b, the image generation unit 311c, the display processing unit 311d, and the proposal processing unit 311e.

[0120] At this time, in the process for acquiring the livable room image M1 in step S101, the imaging device 40 captures livable room images M1 in four directions as shown in Figs. 6(a) to (d) and transmits them to the installation support device 30. The control unit 311 (image acquisition unit 311a) acquires the livable room image M1 immediately after it is received by the wireless communication unit 315 from the imaging device 40, or the livable room image M1 previously received by the wireless communication unit 315 and stored in the storage unit 312. Upon acquiring the livable room image M1, the control unit 311 (image acquisition unit 311a) causes the display unit 313 to display the reference size input screen 510 of Fig. 5(b). Note that in the imaging device 40, the reference size input screen 510 may be displayed on the display unit 42, and the reference size D input on the reference size input screen 510 may be transmitted to the installation support device 30 together with the livable room image M1.

[0121] Furthermore, in the process for displaying the pseudo image M2 in step S105, the control unit 311 (display processing unit 311d) causes the display unit 313 to display the pseudo image display screen 520 including the pseudo image M2, and transmits the pseudo image M2 to the imaging device 40. In the imaging device 40, the received pseudo image M2 is displayed on the display unit 42.

[0122] Furthermore, in the process of proposing a recommended installation position P of the monitoring device 20 in step S106, the control unit 311 (proposal processing unit 311e) causes the display unit 313 to display an installation position display screen 530 including an installation diagram 531 showing the recommended installation position P, and transmits the installation diagram 531 to the imaging device 40. In the imaging device 40, the received installation diagram 531 is displayed on the display unit 42.

[0123] The confirmation buttons 521 and 532 on the screen are operated by the operation unit 314.

[0124] The worker can check the pseudo image M2 and the recommended installation position P of the monitoring device 20 on the display unit 313 of the installation support device 30 or the display unit 42 of the imaging device 40.

[0125] In addition, the pseudo image M2 and the installation diagram 531 may be configured not to be transmitted to the imaging device 40.

[0126] In the installation support system 1, the installation support device 30 may be configured by a server. In this case, the installation support device 30 is not provided with the display unit 313 and the operation unit 314. Therefore, the pseudo image M2 and the installation diagram 531 are displayed only on the display unit 42 of the imaging device 40.

[0127] As described above, according to the second embodiment, the same effects as those of the first embodiment can be achieved.

[0128] Furthermore, a person who is not a worker, such as a facility manager, can capture the room image M1 with the imaging device 40 and transmit it to the installation support device 30, and within the facility where the installation support device 30 is installed, a worker can check the pseudo image M2 and installation diagram 531 displayed on the display unit 313 of the installation support device 30. This makes it possible for a worker to determine the installation position of the monitoring device 20 before installing the monitoring device 20, without going to the site, which is the room.

[0129] <Change Example 1> Fig. 11 is a flowchart showing processing performed in the control unit 111 of the installation support device 10 according to the modified example 1. Fig. 12(a) is a diagram showing an example of a pseudo image display screen 520 according to the modified example 1, and Fig. 12(b) is a diagram showing an example of an installation position change screen 540 according to the modified example 1.

[0130] In this modified example, the control unit 111 of the installation assistance device 10 performs the process shown in Fig. 11, thereby making it possible to change the recommended installation position P of the monitoring device 20 that was determined based on the shape and size of the room. The operation display unit 113 functions as an operation unit that performs operations (operation of the change button 522, operation of the move button 542) for changing the recommended installation position P of the monitoring device 20 to a position different from the determined position.

[0131] In this modification, as shown in FIG. 12(a), a pseudo image display screen 520 displayed on the operation display unit 113 in step S105 includes a change button 522 for changing the recommended installation position P in addition to a confirm button 521.

[0132] 11, after causing the pseudo image display screen 520 to be displayed on the operation display unit 113 in step S105, the control unit 111 monitors whether a confirmation operation has been performed using the confirmation button 521 or a change operation has been performed using the change button 522 (S111). Then, when a confirmation operation has been performed (S111: Confirmed), the control unit 111 proceeds to a process for proposing a recommended installation position P in step S106.

[0133] On the other hand, when a change operation is performed (S111: Change), the control unit 111 executes a process for moving the recommended installation position P (S112).

[0134] That is, the control unit 111 displays an installation position change screen 540 on the operation display unit 113. As shown in Fig. 12(b), the installation position change screen 540 includes, for example, an installation diagram 541 displaying the monitoring device 20 located at the recommended installation position P on the plan layout of the room, a movement button 542 for moving the monitoring device 20 on the installation diagram 541, and a confirmation button 543. The movement button 542 is made up of four buttons for moving the monitoring device 20 forward, backward, left and right.

[0135] When any of the movement buttons 542 is pressed, the control unit 111 moves the monitoring device 20 on the installation diagram 541 in a direction corresponding to the pressed button, and by a distance corresponding to the time and number of times the button was pressed (see the dashed line in FIG. 12(b)). This changes the recommended installation position P of the monitoring device 20. When the confirm button 543 is pressed, the control unit 111 confirms the changed recommended installation position P, closes the installation position change screen 540, and proceeds to processing for generating the pseudo image M2 in step S104.

[0136] In step S104, the control unit 111 (image generation unit 111c) generates a pseudo image M2 when the watching device 20 is installed in the changed recommended installation position P. Then, in step S105, the control unit 111 (display processing unit 111d) causes the operation display unit 113 to display the pseudo image M2 of the watching device 20 in the changed recommended installation position P.

[0137] According to Modification Example 1, if the operator such as a worker checks the pseudo image M2 in step S104 and finds that the determined recommended installation position P is not appropriate, the operator can change the recommended installation position P to another position and check the pseudo image M2 at the changed recommended installation position P. This makes it possible to install the monitoring device 20 in a more appropriate installation position.

[0138] Similarly, in the installation support system 1 according to the second embodiment, the control unit 311 of the installation support device 30 can be modified to perform the process shown in Fig. 11. In this case, the operation unit 314 operates buttons such as the change button 522 and the move button 542 on the screen.

[0139] <Change Example 2> Fig. 13(a) is a flowchart showing a process performed by the control unit 111 of the installation support device 10 according to the modified example 2. Fig. 13(b) is a diagram showing an example of a pseudo image display screen 520 in which a human image is combined with a pseudo image M2 according to the modified example 2.

[0140] In this modification, the control unit 111 of the installation support device 10 performs the process shown in FIG. 13(a), whereby a pseudo image M2 with a human image combined therewith can be displayed on the operation and display unit 113.

[0141] Image data of a person image to be combined with pseudo image M2 is stored in storage unit 112. The person image has a predetermined posture, such as a reclining posture.

[0142] 13(a), after generating pseudo image M2 in step S104, control unit 111 (image generating unit 111c) reads out a person image from storage unit 112 and synthesizes it with generated pseudo image M2 (S121). For example, control unit 111 synthesizes an image of a person lying down (assuming a fall, etc.) with the floor surface portion included in pseudo image M2.

[0143] Then, the control unit 111 (display processing unit 111d) causes the operation display unit 113 to display a pseudo image display screen 520 including a pseudo image M2 with a human image combined therewith, as shown in FIG. 13(b) (S105).

[0144] According to the second modification, an operator such as a worker can check a pseudo image M2 that includes the person to be watched and is similar to an actual surveillance image.

[0145] Similarly, the installation support system 1 according to the second embodiment can also be modified so that the control unit 311 of the installation support device 30 performs the process shown in FIG. 13(a).

[0146] <Change Example 3> FIG. 14 is a block diagram showing a configuration of an installation support device 10 capable of communicating with a projector 80 according to the third modified example.

[0147] In this modified example, the installation support device 10 is communicably connected to a projector 80 that projects an image. For this reason, the installation support device 10 includes a short-distance wireless communication unit 116. The short-distance wireless communication unit 116 is a wireless communication module for performing short-distance wireless communication such as Bluetooth (registered trademark) with the projector 80 or the like. The short-distance wireless communication unit 116 performs short-distance wireless communication with a short-distance wireless communication unit (not shown) of the projector 80 in response to control from the control unit 111.

[0148] Fig. 15(a) is a flowchart showing the processing performed by the control unit 111 of the installation support device 10 according to Modification Example 3. Fig. 15(b) is a diagram showing an example of an installation position image M3 according to Modification Example 3. Fig. 15(c) is a diagram showing a state in which the installation position image M3 is projected onto the ceiling surface of a room by the projector 80 according to Modification Example 3.

[0149] When the installation support device 10 is connected to the projector 80 so as to be able to communicate with it, the control unit 111 executes a process for proposing a recommended installation position P of the monitoring device 20 (S106), and then generates an installation position image M3 using the function of the image generation unit 111c, and transmits the generated installation position image M3 to the projector 80 via the short-range wireless communication unit 116 (S131).

[0150] As shown in Fig. 15(b), the installation position image M3 is an image including a ceiling surface and the monitoring device 20 installed at a recommended installation position P on the ceiling surface. As shown in Fig. 15(b), the projector 80 projects the received installation position image M3 onto the ceiling surface of the room. At this time, the projector 80 adjusts the size of the projected installation position image M3 so that the ceiling surface of the installation position image M3 has approximately the same size as the actual ceiling surface.

[0151] According to the third modification, the worker can confirm the recommended installation position P of the monitoring device 20 on the actual ceiling surface from the projected installation position image M3. Therefore, it becomes possible to actually install the monitoring device 20 at the projected recommended installation position P, making the installation work easier.

[0152] The control unit 111 of the installation support device 10 may transmit the installation position image M3 from the wireless communication unit 115 to the projector 80 via an external communication network or the like. In this case, the projector 80 includes a wireless communication unit for communicating with the wireless communication unit 115 via the external communication network or the like.

[0153] Similarly, the installation support system 1 according to the second embodiment can be modified so that the control unit 311 of the installation support device 30 performs the process shown in Fig. 13(a). In this case, the control unit 311 of the installation support device 30 transmits the installation position image M3 from the wireless communication unit 315 to the projector 80 via the external communication network 60 or the like.

[0154] <Change Example 4> 16(a) to 16(c) are diagrams for explaining an installation support device 10 according to a fourth modified example.

[0155] In the installation assistance device 10 according to this modified example, the installation position determination unit 111b estimates the positions of the equipment arranged in the room based on the room image M1, and determines a recommended installation position P based on the estimated shape and size of the room and the arrangement of the equipment. More specifically, the installation position determination unit 111b determines the recommended installation position P based on the positions of the equipment arranged on the surface (ceiling surface) on which the monitoring device 20 is installed and blind spots caused by the arrangement of the equipment in the room.

[0156] That is, in the process for estimating the shape and size of the room in step S102 of the process shown in Fig. 4, the control unit 111 (installation position determination unit 111b) uses the function of the image recognition engine to recognize not only each wall surface and the person serving as the measurement reference body included in the four room images M1, but also the equipment (furniture, lighting, etc.) arranged in the room. Then, after estimating the shape and size of the room, the control unit 111 estimates the shape, size, and position of the equipment in the room. At this time, the reference size D of the measurement reference body is used to estimate the size.

[0157] In the process for determining the recommended installation position P in step S103 of the process shown in Fig. 4, the control unit 111 (installation position determination unit 111b) determines a temporary installation position P1 of the monitoring device 20 on the ceiling surface based on the estimated shape and size of the room in accordance with the installation rules described in the above embodiment 1. The temporary installation position P1 corresponds to the recommended installation position P in the above embodiment 1. However, in this modified example, the recommended installation position P is finally determined taking into account the positions of the equipment in the room, so at this stage, the temporary installation position P1, which is the temporary recommended installation position P, is determined.

[0158] Thereafter, as shown in Fig. 16(a), the control unit 111 sets an installation area having a predetermined width in all directions from the temporary installation position P1 around the temporary installation position P1, and sets a plurality of candidate installation positions P2 at predetermined intervals on the installation area. The installation area is set to a width such that the monitoring device 20 can capture an image of the required monitoring range, i.e., a range including the entire floor surface and the portions of the four walls from the floor surface to a predetermined height position, when the monitoring device 20 is installed in the installation area. The predetermined height can be set to a height that allows an image of the chest of a resident standing near a wall surface to be captured, for example.

[0159] As shown in FIG. 16(a), there may be cases where equipment such as sprinklers are arranged on the ceiling surface on which the monitoring device 20 is installed. Furthermore, within the imaging range of the monitoring device 20, blind areas that cannot be imaged due to being hidden by equipment such as lighting and furniture arranged in the room may occur. The control unit 111 calculates the volume of all blind areas caused by the equipment when the monitoring device 20 is installed at the temporary installation position P1 and each candidate installation position P2 based on the shape, size and position of the equipment and the imaging range of the monitoring device 20. Then, the control unit 111 determines the temporary installation position P1 or the candidate installation position P2 with the smallest total volume of blind areas, i.e., the smallest blind area, as the recommended installation position P. Note that, before examining the blind areas, the control unit 111 removes from the candidates for the recommended installation position P any positions among the temporary installation position P1 and all the candidate installation positions P2 that will interfere with the equipment arranged on the ceiling surface when the monitoring device 20 is installed.

[0160] The control unit 111 may determine the temporary installation position P1 or the candidate installation position P2 with the smallest number of blind spots as the recommended installation position P, instead of the amount of blind spots, or may determine the temporary installation position P1 or the candidate installation position P2 with the smallest maximum blind spot area as the recommended installation position P.

[0161] Furthermore, among the installation rules described in the above embodiment 1, the rule that the wall surface having a door should be in front of the monitoring device 20 is not applied, and as shown in Fig. 16(c), the installation area may be set on both sides of two walls in the direction of the room, which are the front and rear directions of the monitoring device 20. In this case, the recommended installation position P may be determined based on the positions of the equipment from the temporary installation positions P1 or candidate installation positions P2 of the two installation areas.

[0162] Thus, according to this modified example, the arrangement of equipment is taken into consideration when determining the recommended installation position P, making it possible to install the monitoring device 20 in a more appropriate location, such as by reducing blind spots caused by equipment or by avoiding equipment that is present on the surface on which the monitoring device 20 is installed.

[0163] This modification is also applicable to the installation support system 1 according to the second embodiment.

[0164] <Change Example 5> 17(a) and (b) are diagrams showing the configuration of a watching device 20 according to a fifth modified example.

[0165] In this modified example, the monitoring device 20 has a configuration that allows the imaging range to be adjusted by adjusting the movable range α of the camera unit 21. For example, the monitoring device 20 can switch between a first mode (see FIG. 17(a)) in which the movable range α of the camera unit 21 is a first angle θ1 (e.g., about 50 degrees) and a second mode (see FIG. 17(b)) in which the movable range α of the camera unit 21 is a second angle θ2 (e.g., about 25 degrees) smaller than the first angle θ1. When the movable range α of the camera unit 21 changes, the imaging range changes in front of the monitoring device 20. That is, the larger the movable range α, the longer the imaging range becomes in the forward direction.

[0166] When the first mode is set, if the resident is about to move forward out of the angle of view R while the image of the resident is being captured with the angle A2 in the front-to-rear direction at 0 degrees, the camera unit 21 rotates to a position where the angle A2 is at the second angle. Furthermore, if the resident is about to move forward out of the angle of view R while the image of the resident is being captured with the angle A2 at the second angle, the camera unit 21 rotates to a position where the angle A2 is at the first angle. That is, the camera unit 21 moves between the positions where the angle A2 is at 0 degrees, the second angle, and the first angle so as to follow the movement of the resident.

[0167] On the other hand, when the second mode is set, the camera unit 21 moves between the positions where the angle A2 is 0 degree and the second angle so as to follow the movement of the resident.

[0168] Fig. 17(c) is a diagram showing a configuration of the installation support device 10 according to Modification Example 5. In Fig. 17(c), only a control unit 111 is shown.

[0169] In this modified example, in accordance with the monitoring device 20 in which the movable range α of the camera unit 21 can be set, the installation support device 10 has a function of notifying the user of the movable range α of the camera unit 21 required depending on the size of the room in which the monitoring device 20 is installed.

[0170] In the installation assistance device 10, the control unit 111 is provided with the function of a movable range notification processing unit 111f in addition to the functions of an image acquisition unit 111a, an installation position determination unit 111b, an image generation unit 111c, a display processing unit 111d, and a proposal processing unit 111e by an application program 112a stored in the storage unit 112. The movable range notification processing unit 111f performs processing for notifying the movable range α required for the imaging range to cover a predetermined monitoring range according to the size of the room when the monitoring device 20 is installed at the recommended installation position P.

[0171] Fig. 18(a) is a flowchart showing the processing performed by the control unit 111 of the installation support device 10 according to the modified example 5. Fig. 18(b) to (d) are diagrams for explaining the processing for notifying the movable range α of the camera unit 21 according to the modified example 5.

[0172] As shown in FIG. 18(a), after a process for proposing a recommended installation position P of the monitoring device 20 has been executed, the control unit 111 executes a process for notifying the movable range α of the camera unit 21 by using the function of the movable range notification processing unit 111f (S141).

[0173] That is, the control unit 111 checks whether the movable range α at that time can cover the monitoring range while varying the movable range α of the camera unit 21 for the monitoring device 20 installed at the recommended installation position P, and determines the movable range α that does not over or undercover the monitoring range based on the check result. The monitoring range can be, for example, an area that includes the entire floor surface of the room and the portions of the four walls from the floor surface to a predetermined height position.

[0174] Specifically, in order to determine the movable range α, the control unit 111 checks whether the imaging range in the movable range α in the second mode, which is smaller than the first mode, can cover the monitoring range. For example, if the imaging range includes a portion of the wall surface in front of the monitoring device 20 at a predetermined height position Y from the floor surface, the control unit 111 determines that the imaging range can cover the monitoring range.

[0175] As shown in FIG. 18(b), when the imaging range defined by the movable range α of the second mode can cover the monitoring range because the front-to-rear dimension of the monitoring device 20 in the room is relatively small, the control unit 111 determines the movable range α of the second mode to be the required movable range α.

[0176] On the other hand, as shown in FIG. 18(c), if the imaging range defined by the movable range α of the second mode cannot cover the monitoring range because the front-to-rear dimension of the monitoring device 20 in the room is relatively large, but the imaging range defined by the movable range α of the first mode can cover the monitoring range, the control unit 111 determines the movable range α of the first mode to be the required movable range α.

[0177] Next, the control unit 111 causes a movable range notification screen 550 for notifying the determined movable range α of the camera unit 21 to be displayed on the operation display unit 113, which is a notification unit. As shown in Fig. 18(d), the movable range notification screen 550 includes, for example, a message 551 for notifying the movable range α and a confirmation button 552. When the confirmation button 552 is pressed, the movable range notification screen 550 is closed.

[0178] According to this modified example, a worker or the like can check the movable range α of the camera unit 21 notified by the installation support device 10, and set the movable range α to an appropriate range when actually installing the monitoring device 20 in the room.

[0179] This modification is also applicable to the installation support system 1 according to the above-described embodiment 2. In this case, the movable range α of the camera unit 21 is notified by the display unit 313 of the installation support device 30 or the display unit 42 of the imaging device 40.

[0180] <Change Example 6> FIG. 19 is a block diagram showing a configuration of the installation support device 10 according to the sixth modified example.

[0181] The installation support device 10 according to this modified example can be realized, for example, by installing an application program for executing the functions of the installation support device 10 on a mobile terminal device such as a smartphone or tablet terminal equipped with a ToF camera.

[0182] The installation support device 10 includes a ToF camera module 117 as an imaging unit, in addition to the control unit 111, the storage unit 112, the operation display unit 113, and the wireless communication unit 115. The installation support device 10 may include the imaging unit 114 in addition to the ToF camera module 117.

[0183] The ToF camera module 117 includes a light-emitting element that emits light such as laser light and a light-receiving element that receives light reflected by a subject, captures a distance image having distance information for each pixel by a ToF (Time of Flight) method, and outputs the distance image (distance image data) to the control unit 111. The distance information indicates the distance from the ToF camera module 117 to the subject (such as a wall surface).

[0184] In this modified example, in the process for acquiring the living room image M1 in step S101 in the process shown in Fig. 4, the ToF camera module 117 captures distance images in four directions corresponding to the living room images M1 in the four directions of Fig. 6(a) to (d) as the living room image M1. However, in this modified example, the living room image M1 does not include a person, i.e., a measurement reference object. The image acquisition unit 111a acquires the distance images captured by the ToF camera module 117 as the living room image M1.

[0185] Furthermore, in this modified example, in the process of estimating the shape and size of the room in step S102 in the process shown in Fig. 4, the control unit 111 generates a three-dimensional point cloud representing the room by calculating the three-dimensional coordinate values ​​of each pixel based on the distance information of each pixel for the four-direction distance image that is the room image M1. The control unit 111 then uses the three-dimensional point cloud to estimate the shape and size of the room. The three-dimensional point cloud also includes the fixtures arranged in the room, and becomes a three-dimensional layout model LM of the room. Therefore, this layout model LM is used in the process of generating the pseudo image M2 in step S104.

[0186] In this modification, similarly to the first embodiment, a moving image may be captured by the ToF camera module 117, and four-direction images M1 of the room, which are distance images, may be extracted from the moving image.

[0187] According to this modified example, there is no need to perform a series of tasks, such as capturing an image of a measurement reference body so that it is included in the room image M1 and then inputting the reference size D of the measurement reference body in order to use it to estimate the shape and size of the room, thereby making it easier to operate the installation support device 10.

[0188] This modification is also applicable to the installation support system 1 according to the above-described embodiment 2. In this case, the imaging device 40 is equipped with a ToF camera module.

[0189] Although the first to sixth modified examples have been described above, the configurations of these modified examples can be combined as appropriate.

[0190] <Other changes> The present invention is not limited in any way by the above-described embodiment, and various modifications of the embodiment of the present invention are possible.

[0191] In the above-mentioned first and second embodiments, the monitoring device 20, the installation of which is assisted by the installation assistance device 10, 30, is configured so that the camera unit 21 rotates. For this reason, in the installation assistance device 10, 30, the control unit 111, 311 (image generation unit 111c, 311c) generates pseudo images M2 at multiple (two) angles A, and displays them on the operation display unit 113. However, the monitoring device 20, the installation of which is assisted by the installation assistance device 10, 30, may be configured so that the camera unit 21 does not rotate and the angle A is fixed. In this case, one pseudo image M2 is generated by the control unit 111, 311 (image generation unit 111c, 311c), and displayed on the operation display unit 113 or the display unit 313.

[0192] Furthermore, in the process of generating pseudo image M2, the control units 111, 311 (image generation units 111c, 311c) may generate a single pseudo image M2 by stitching together pseudo images M2 at multiple angles A, i.e., a pseudo image M2 of the entire imaging range when the camera unit 21 is moved.

[0193] Furthermore, in the above-mentioned first and second embodiments, the control unit 111 acquires room images M1 in four directions captured by the imaging unit 114, estimates the shape and size of the room based on the room images M1 in the four directions, and generates a layout model LM of the room. However, if it is possible to estimate the shape and size of the room and generate a layout model LM of the room, the control unit 111 may acquire room images M1 in three or two directions instead of four directions. In other words, it is sufficient that the control unit 111 acquires room images M1 in at least two orthogonal directions.

[0194] Furthermore, in the above-mentioned first and second embodiments, a three-dimensional image of the equipment that is not actually installed in the room may be stored in the storage unit 112, 312, and the equipment may be added to the layout model LM based on an operation of an operator. In this way, an operator such as a worker can check the pseudo image M2 including the equipment that is to be installed.

[0195] Furthermore, in the above-mentioned first and second embodiments, the room image M1, which is a visible image, includes a measurement reference object (a person, equipment, etc.), and the control unit 111 (installation position determination unit 111b) is configured to estimate the size of the room based on the input reference size D of the measurement reference object. However, it is also possible not to include the measurement reference object in the room image M1. In this case, for example, the size of part of the room (the size of one side), such as the height of the room, may be input, and the control unit 111 (installation position determination unit 111b) may estimate the remaining size from the size of the part.

[0196] Furthermore, in the above-mentioned first and second embodiments, the recommended installation position P of the monitoring device 20 is provided on the ceiling surface of the room. However, for example, if the monitoring device 20 is configured such that its imaging range does not extend to the rear of the device, the recommended installation position P may be provided on a wall surface near the ceiling (at the top of the wall surface).

[0197] Furthermore, the image acquisition units 111a, 311a, installation position determination units 111b, 311b, image generation units 111c, 311c, display processing units 111d, 311d, proposal processing units 111e, 311e and movable range notification processing unit 111f do not necessarily have to be realized by program functions, and may be realized using hardware such as a logic circuit.

[0198] Furthermore, the pseudo image M2 is not limited to a computer graphics image, but may be an augmented reality image, a virtual reality image, or a mixed reality image.

[0199] In addition, the embodiments of the present invention can be modified as appropriate within the scope of the claims. [Explanation of symbols]

[0200] 1 Installation support system 10, 30 Installation support equipment 20 Monitoring Device 21 Camera Division 40 Imaging device 111a, 311a Image acquisition section 111b, 311b Installation position determination section 111c, 311c image generation section 111d, 311d Display processing unit 111e, 311e Proposal Processing Unit 111f Movable range notification processing unit 112a, 312a Application Program 113 Operation display section (operation section) 114 Imaging unit 117 ToF camera module (imaging section) 314 Operation section P Recommended installation position M1 Room Image M2 pseudo image LM Layout Model A angle R Angle of View D Reference Size α Movable range

Claims

1. An installation support device that supports installation of a monitoring device that monitors a resident by capturing an image of the inside of a room, an image acquisition unit that acquires an image of the interior of the living room captured by an imaging unit as a living room image; and an installation position determination unit that estimates a shape and a size of the room based on the room image and determines a recommended installation position of the monitoring device based on the estimated shape and size. An installation support device comprising:

2. A proposal processing unit that performs processing to propose the recommended installation position determined by the installation position determination unit, 2. The installation support device according to claim 1 .

3. an image generating unit that generates, as a pseudo image, an image that is captured when the monitoring device is installed at the recommended installation position determined by the installation position determining unit; A display processing unit that performs processing to display the pseudo image.

3. The installation support device according to claim 1 or 2.

4. The image generating unit includes: generating a three-dimensional layout model of the room based on the room image; generating the pseudo image based on the layout model, the recommended installation position determined by the installation position determination unit, and an imaging range of the monitoring device; 4. The installation support device according to claim 3.

5. An operation unit for performing an operation to change the recommended installation position to a position different from the position determined by the installation position determination unit, when the recommended installation position is changed, the image generating unit generates the pseudo image when the monitoring device is installed in the changed recommended installation position.

4. The installation support device according to claim 3.

6. The image generation unit combines an image of a person with the pseudo image.

4. The installation support device according to claim 3.

7. The imaging unit captures a visible image having luminance information for each pixel, The image acquisition unit acquires the visible image as the room image.

2. The installation support device according to claim 1 .

8. the room image includes an image of a measurement reference body; The acquisition unit acquires a size of the measurement reference body as a reference size together with the room image, The installation position determination unit estimates the size of the living room based on the reference size.

8. The installation support device according to claim 7.

9. The imaging unit captures a distance image having distance information for each pixel by a ToF method, The image acquisition unit acquires the distance image as the room image.

2. The installation support device according to claim 1 .

10. The installation position determination unit is Predicting the positions of equipment arranged in the living room based on the living room image; determining the recommended installation location based on the estimated shape and size of the room and the location of the equipment; 2. The installation support device according to claim 1 .

11. The monitoring device includes: Includes a movable camera unit, The imaging range can be adjusted by adjusting the movable range of the camera unit, The installation support device includes: and a movable range notification processing unit that performs processing to notify the movable range required for the imaging range to cover a predetermined monitoring range according to the size of the living room when the monitoring device is installed in the recommended installation position.

2. The installation support device according to claim 1 .

12. An installation support system including: an installation support device that supports installation of a monitoring device that monitors a resident by capturing an image of the interior of a room; and an imaging device that captures an image of the interior of the room as a room image and transmits the image to the installation support device; The installation support device includes: an image acquisition unit that acquires the image of the living room captured by the imaging device; and an installation position determination unit that estimates a shape and a size of the room based on the room image and determines a recommended installation position of the monitoring device based on the estimated shape and size. An installation support system comprising:

13. An installation support method executed by an installation support device that supports installation of a monitoring device that monitors a resident by capturing an image of the inside of a living room, comprising: acquiring an image of the interior of the living room captured by an imaging unit as a living room image; A step of estimating a shape and size of the room based on the room image, and determining a recommended installation position of the monitoring device based on the estimated shape and size.

13. An installation support method comprising:

14. A control unit of an installation support device that supports installation of a monitoring device that monitors a resident by capturing an image of the inside of a living room, A function of acquiring an image of the interior of the living room captured by an imaging unit as a living room image; A program that executes a function of estimating the shape and size of the room based on the room image, and determining a recommended installation position of the monitoring device based on the estimated shape and size.

Images