Mirror-type monitor device for elevator

Abstract

This mirror-type monitor device comprises: an in-car camera that captures images of a user inside the car of an elevator; a mirror-type monitor that is provided to a side surface in the car and can be switched between a mirror state, in which the mirror-type monitor functions as a mirror, and a monitor state, in which the mirror-type monitor functions as a display device that displays an image; and a control device that controls operation of the in-car camera and the mirror-type monitor. The control device includes: an imaging unit that, when imaging conditions are met, captures an image of a user, who has boarded the car, by using the in-car camera; and a user image display unit that, when display conditions are met, switches the state of the mirror-type monitor from the mirror state to the monitor state, and that displays the user image captured by the imaging unit on the mirror-type monitor.

Description

Elevator mirror monitor

[0001] The present disclosure relates to a mirror-type monitoring device for an elevator.

[0002] Patent Document 1 discloses a technology related to an elevator car display device equipped with a camera and a monitor inside the elevator car. With this technology, an image captured by the camera is displayed on the monitor in a horizontally inverted form only while the elevator car doors are open to allow passengers to board and disembark.

[0003] Japanese Patent Application Publication No. 2008-74535

[0004] Elevator cars are equipped with mirrors that allow wheelchair users to check behind them when getting off. The mirror inside the car can also be used by users riding alone to see their own reflection. If a mirror-type monitor that can switch between a mirror state functioning as a mirror and a monitor state functioning as a display device for displaying images is used as the mirror inside the car, there is room for providing additional services to users who use the mirror as a reflection.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide additional services to users who use a mirror-type monitor installed inside an elevator car to see their full-length image.

[0006] The elevator mirror monitor device of the present disclosure includes an in-car camera that captures images of users inside the elevator car, a mirror monitor that is provided on a side surface inside the car and is switchable between a mirror state where it functions as a mirror and a monitor state where it functions as a display device that displays images, and a control device that controls the operation of the in-car camera and the mirror monitor. The control device includes an imaging unit that captures images of users inside the car using the in-car camera when an imaging condition is met, and a user image display unit that switches the state of the mirror monitor from the mirror state to the monitor state when a display condition is met and displays the user image captured by the imaging unit on the mirror monitor.

[0007] The elevator mirror monitor device of the present disclosure includes an in-car camera that captures images of a user in the elevator car, a mirror monitor that is provided on a side surface inside the car and is switchable between a mirror state where it functions as a mirror and a monitor state where it functions as a display device that displays images, and a control device that controls the operation of the in-car camera and the mirror monitor. The control device includes: an imaging unit that captures an image of the user in the car using the in-car camera when an imaging condition is met; an information acquisition unit that acquires product information including image images of clothing products; an image generation unit that generates a dress-up image in which the user wears the clothing products using the user image captured by the imaging unit and the image image; and a dress-up image display unit that switches the state of the mirror monitor from the mirror state to the monitor state when a display condition is met and displays the dress-up image on the mirror monitor.

[0008] According to the elevator mirror monitor device of the present disclosure, an image of a user captured by an in-car camera can be displayed on the mirror monitor for the user inside the car, allowing the user to objectively check their own appearance from the displayed image.

[0009] FIG. 1 is a diagram showing an overview of an elevator to which a mirror-type monitor device according to embodiment 1 is applied. FIG. 2 is a diagram for explaining an overview of the mirror-type monitor device according to embodiment 1. FIG. 3 is a block diagram showing an example of the configuration of a mirror-type monitor device. FIG. 4 is a functional block diagram showing functions realized by a processor of a control device executing a program. FIG. 5 is a flowchart of a routine executed in the mirror-type monitor device. FIG. 6 is a diagram for explaining an overview of a modified example of the mirror-type monitor device according to embodiment 1. FIG. 7 is a diagram showing a modified example of hardware resources of a control device. FIG. 8 is a block diagram showing the configuration of a mirror-type monitor device according to embodiment 2. FIG. 9 is a functional block diagram showing functions realized by a processor of a control device executing a program. FIG. 10 is a diagram for explaining an overview of the mirror-type monitor device according to embodiment 2. FIG. 11 is a flowchart of a routine executed in the mirror-type monitor device according to embodiment 2.

[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Elements common to the various drawings will be designated by the same reference numerals, and redundant explanations will be omitted.

[0011] 1. Embodiment 1. 1-1. Overview of Mirror-Type Monitoring Device FIG. 1 is a diagram showing an overview of an elevator to which a mirror-type monitoring device according to embodiment 1 is applied. FIG. 2 is a diagram for explaining the overview of the mirror-type monitoring device according to embodiment 1. The mirror-type monitoring device 10 according to embodiment 1 is installed in an elevator 100. The elevator 100 is installed in a facility consisting of a building or the like having multiple floors.

[0012] A hoistway 3 for an elevator 100 is provided in a facility. The hoistway 3 is a vertically long space spanning multiple floors. A landing 4 for the elevator 100 is provided on each floor of the facility. The landing 4 is a location adjacent to the hoistway 3.

[0013] Elevator 100 includes car 1 and a control panel 6. Car 1 is a device that transports passengers and others inside it between multiple floors by traveling up and down a hoistway 3. Car 1 includes car doors 2. When car 1 stops at a floor, car doors 2 open and close in conjunction with the hall doors of the hall 4 at that floor so that passengers can board and disembark at the hall 4 and car 1 at that floor. An in-car operation panel 8 is installed next to car door 2 inside car 1 for operating the car doors 2 and registering destination floors. Operation information from the in-car operation panel 8 is sent to the control panel 6.

[0014] The control panel 6 is a device that controls the operation of the elevator 100. The operation of the elevator 100 controlled by the control panel 6 includes, for example, opening and closing of doors, management of registered calls, and running of the car 1 in response to calls.

[0015] The mirror-type monitor device 10 according to the first embodiment includes an in-car camera 12, a mirror-type monitor 14, and a control device 20. The mirror-type monitor 14 is switchable between a mirror state in which it functions as a mirror and a monitor state in which it functions as a display device that displays an image. The mirror-type monitor 14 is disposed on the side surface 1a facing the car door 2.

[0016] The in-car camera 12 is a camera for capturing images of users inside the car. The in-car camera 12 is capable of capturing images of users operating the in-car operation panel 8 inside the car 1 from the rear side, and is also arranged, for example, above the mirror-type monitor 14 on the side surface 1a so as to be able to capture images of users facing the mirror-type monitor 14 from the front side. The images of users captured by the in-car camera 12 will be referred to as "user images" hereinafter.

[0017] The control device 20 is a computer for controlling the operation of the in-car camera 12 and the mirror monitor 14. The control panel 6 constantly transmits operational information and sensor information of the elevator 100 to the control device 20. Examples of operational information include operation information of the in-car operation panel 8, the opening and closing of the elevator 100 doors, registered calls, and information on the car 1 responding to calls. Examples of sensor information include measurement information from a scale measuring the weight inside the car 1 and detection information from a door sensor detecting passengers getting on and off the car 1. The control device 20 captures a user image using the in-car camera 12 when predetermined imaging conditions are met. This process is hereinafter referred to as "imaging processing." The imaging conditions include, for example, that the in-car operation panel 8 has been operated by a user and that there is only one passenger in the car 1. According to these imaging conditions, the in-car camera 12 captures a rear image of the user alone as a user image. The captured user image is sent from the in-car camera 12 to the control device 20.

[0018] The control device 20 normally controls the state of the mirror-type monitor 14 to be in the mirror state. When a predetermined display condition is met, the control device 20 switches the state of the mirror-type monitor 14 from the mirror state to the monitor state, and displays the user image on the mirror-type monitor 14. This process is hereinafter referred to as "user image display process." The display condition includes, for example, that the user in the car 1 is facing the direction of the mirror-type monitor 14. According to such a display condition, it is possible to provide a rear view image of the user only to users who wish to use the full-length mirror.

[0019] In the example shown in Fig. 2, a user facing the mirror-type monitor 14 is provided with a user image PIC1 of the user's back through the mirror-type monitor 14. By controlling the mirror-type monitor device 10 in this way, an additional service can be provided to a user who uses the mirror in the car 1 to look at himself / herself, by providing an image of the user's back.

[0020] 1-2. Configuration of the mirror-type monitoring device 10 FIG. 3 is a block diagram showing an example of the configuration of the mirror-type monitoring device 10. As described above, the mirror-type monitoring device 10 includes the in-car camera 12, the mirror-type monitor 14, and the control device 20. The control device 20 has the functionality of a processing device as a computer. Typically, the control device 20 includes at least one processor 200 and at least one memory 210 coupled to the processor 200. The memory 210 stores at least one program 220 executable by the processor 200 and various data 230 associated therewith.

[0021] The processor 200 executes the program 220 to realize various processes by the processor 200. Fig. 4 is a functional block diagram showing functions realized by the processor 200 of the control device 20 executing the program 220. As shown in Fig. 4, the processor 200 includes an imaging unit 201, an imaging condition determination unit 202, a user image display unit 203, and a display condition determination unit 204.

[0022] The imaging unit 201 is a functional block for performing imaging processing. The imaging condition determination unit 202 is a functional block for determining whether the conditions for executing imaging processing by the imaging unit 201 are met. The user image display unit 203 is a functional block for performing user image display processing. The display condition determination unit 204 is a functional block for determining whether the conditions for executing user image display processing by the user image display unit 203 are met. Below, the processing executed in each functional block of the processor 200 will be described in detail with reference to flowcharts.

[0023] 1-3. Specific Processing Executed in the Mirror-Type Monitoring Device 10 Fig. 5 is a flowchart of a routine executed in the mirror-type monitoring device 10. The routine shown in Fig. 5 is repeatedly executed by the processor 200 of the control device 20 at a predetermined control period while the elevator 100 is in operation.

[0024] The processing of steps S100 and S102 corresponds to processing executed in the image capturing condition determination unit 202. In step S100, it is determined whether or not there is only one user riding in car 1. Here, the control device 20 determines whether or not there is only one user riding in car 1 based on scale measurement information included in the sensor information received from the control panel 6. Alternatively, the control device 20 determines whether or not there is only one user riding in car 1 based on detection information from a door sensor. Alternatively, the control device 20 determines whether or not there is only one user riding in car 1 by analyzing an image captured by the in-car camera 12 using a known image analysis method.

[0025] If the result of step S100 is that the determination is not successful, the processing of this routine is terminated, and if the determination is successful, the processing proceeds to step S102. In step S102, it is determined based on the received operation information whether the user has operated the in-car operation panel 8. If the result is that the determination is successful, the processing proceeds to step S104, and if the determination is not successful, the processing of this routine is terminated.

[0026] The processing of step S104 corresponds to the imaging processing executed by the imaging unit 201. In step S104, the rear view of the user operating the in-car operation panel 8 is imaged by the in-car camera 12, and the image is temporarily stored as user image PIC1 in the data 230 area of ​​the memory 210. When the processing of step S104 is completed, the processing proceeds to step S106.

[0027] The processing of step S106 corresponds to processing executed by the display condition determination unit 204. In step S106, it is determined whether or not the user in car 1 is facing the direction of the mirror-type monitor 14. Here, the control device 20 determines whether or not the user in car 1 is facing the direction of the mirror-type monitor 14, for example, by performing image analysis of an image inside the car captured by the in-car camera 12. As a result, if the determination is not established, the processing proceeds to step S110, and if the determination is established, the processing proceeds to step S108.

[0028] The processing of step S108 corresponds to a user image display processing executed by the user image display unit 203. In step S108, the mirror-type monitor 14 is switched from the mirror state to the monitor state, and the user image PIC1 stored in the memory 210 is read out and displayed on the mirror-type monitor 14. When the processing of step S108 is completed, the process proceeds to step S110.

[0029] In step S110, it is determined whether the elevator 100 has arrived at the destination floor registered by the user's call, or whether it has stopped at an intermediate floor before arriving at the destination floor due to a call registered by another user, based on the operation information received from the control panel 6. If the determination is not affirmative, the process returns to step S106, and if the determination is affirmative, the process proceeds to step S112.

[0030] In step S112, the display of the user image PIC1 on the mirror-type monitor 14 is terminated, and the mirror-type monitor 14 is switched from the monitor state to the mirror state.

[0031] The mirror-type monitor device 10 described above can provide a rear view image of a user who uses the mirror in the car 1 as a full-length mirror. This allows the user to check the appearance of the rear view of the user.

[0032] In addition, when there is only one user in car 1, the user's image is displayed, allowing the user to check their appearance without worrying about being seen by others. Furthermore, when elevator 100 stops at the destination floor or an intermediate floor, the display of the user's image is terminated, preventing the display of the user's image from being shown to other users.

[0033] 1-4. Modifications The mirror-type monitor device 10 of the first embodiment may be modified as follows.

[0034] 5, the processing of step S106 is not essential. That is, the user image may be displayed regardless of the orientation of the user in the car 1. In this case, the user may be notified by a notification means such as a voice that the user image will be displayed.

[0035] The mirror-type monitor device 10 may display on the mirror-type monitor 14 a user image captured from the front of the user in addition to a user image captured from the back of the user. FIG. 6 is a diagram for explaining an overview of a modified example of the mirror-type monitor device according to the first embodiment. In the example shown in this figure, a user image PIC2 of the front of the user is displayed next to a user image PIC1 of the back of the user displayed on the mirror-type monitor 14. For example, in the routine of the flowchart of FIG. 5 , when the determination in step S106 is confirmed, an image of the user facing the mirror-type monitor 14 is captured by the in-car camera 12 and temporarily stored as user image PIC2 in the data 230 area of ​​the memory 210. Then, in the user image display process of the next step S108, the user images PIC1 and PIC2 stored in the memory 210 are read and displayed side by side on the mirror-type monitor 14. This control allows the user in the car 1 to check their appearance not only from the back but also from the front. In the user image display process, only the user image PIC2 in front of the user may be displayed.

[0036] It is also assumed that a user who has been provided with a display of his or her own user image may wish to terminate the display. Therefore, the mirror-type monitor device 10 may be provided with a cancel button that allows the user to cancel the display by the user image display process. Such a cancel button may be provided, for example, on the car operation panel 8, or the mirror-type monitor 14 may be provided with an input function such as a touch panel, and the cancel button may be displayed on the mirror-type monitor 14.

[0037] Fig. 7 is a diagram showing a modified example of the hardware resources of the control device 20. In the example shown in Fig. 7, the control device 20 includes a processing circuit 250 including, for example, a processor 200, a memory 210, and dedicated hardware 240. Fig. 7 shows an example in which some of the functions of the control device 20 are realized by the dedicated hardware 240. All of the functions of the control device 20 may be realized by the dedicated hardware 240. The dedicated hardware 240 may be a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

[0038] The mirror-type monitor device 10 may have a function for displaying past images of the user. For example, when storing a user image in the memory 210, such a function assigns an identification ID to the user image using known face recognition technology and then stores the user image in the memory 210. Then, in the user image display process, the mirror-type monitor device 10 reads out a user image with an identification ID that is the same as the identification ID of the current user image, and displays the read user image together with the current user image as a past image. This process allows the user to visually compare their past and current appearances.

[0039] 2. Embodiment 2. 2-1. Configuration of a Mirror-Type Monitor Device According to Embodiment 2 FIG. 8 is a block diagram showing the configuration of a mirror-type monitor device according to embodiment 2. FIG. 9 is a functional block diagram showing functions realized by a processor of a control device according to embodiment 2 executing a program. FIG. 10 is a diagram for explaining an overview of a mirror-type monitor device according to embodiment 2. As shown in FIG. 9, a mirror-type monitor device 10 according to embodiment 2 of a control device 20 according to embodiment 2 is connected to a communication network such as the Internet or a telephone network so as to be able to receive clothing information from an external service 30. The external service 30 is, for example, an external service that provides product information related to fashion. The mirror-type monitor device 10 according to embodiment 2 has a common configuration with the mirror-type monitor device 10 according to embodiment 1, except for being connected to the external service 30. Description of the common configuration with the mirror-type monitor device 10 according to embodiment 1 will be omitted.

[0040] As shown in FIG. 9, the processor 200 further includes an information acquisition unit 205 and a dress-up image generation unit 206 in addition to the functional blocks included in the processor 200 of the first embodiment.

[0041] The information acquisition unit 205 is a part that acquires product information related to clothing products from the external service 30. This process will be referred to as the "product information acquisition process" hereinafter. The product information here includes, for example, an image of the clothing product and product description information that can identify the clothing product. The product description information includes information such as a description of the clothing product, its price, and retailers. The product information acquired by the information acquisition unit 205 is temporarily stored in the data 230 area of ​​the memory 210.

[0042] The dress-up image generation unit 206 is a part that generates a dress-up image of the user image using the product information acquired by the information acquisition unit 205. The dress-up image generation unit 206 generates a dress-up image by combining an image of the product information with the user image using known image processing technology. This process is hereinafter referred to as the "dress-up image generation process." The dress-up image generated by the dress-up image generation process is displayed on the mirror-type monitor device 10 by a user image display process. Furthermore, in the user image display process, product information is displayed in addition to the dress-up image. In the example shown in FIG. 10 , the displayed image includes a dress-up image PIC3 in which an image is combined with a frontal user image, and product information INF. The product information INF includes detailed product information and retailer information.

[0043] In this way, the processing by the mirror-type monitor device 10 according to the second embodiment allows the user to refer to the dress-up image of the user, so that the user can get an idea of ​​how the product will look on them without actually trying them on. In addition, the product information is displayed together with the composite image, so that the user can obtain the information necessary for purchase.

[0044] 2-2. Specific Processing Executed in the Mirror-Type Monitoring Device 10 According to Embodiment 2 Fig. 11 is a flowchart of a routine executed in the mirror-type monitoring device 10 according to Embodiment 2. The routine shown in Fig. 11 is repeatedly executed by the processor 200 of the control device 20 at a predetermined control period while the elevator 100 is in operation.

[0045] The processing of steps S200 and S202 corresponds to the processing executed in the image capturing condition determination unit 202. In step S200, it is determined whether or not there is only one user in the car 1. Here, the same processing as the processing of step S100 in the routine shown in FIG.

[0046] As a result of step S200, if the determination is not established, the processing of this routine is terminated, and if the determination is established, the processing proceeds to step S202. In step S202, it is determined whether the user in car 1 is facing the direction of the mirror-type monitor 14. Here, the control device 20 determines whether the user in car 1 is facing the direction of the mirror-type monitor 14, for example, by performing image analysis of an image inside the car captured by the in-car camera 12. As a result, if the determination is not established, the processing of this routine is terminated, and if the determination is established, the processing proceeds to step S204.

[0047] The processing of step S204 corresponds to the imaging processing executed by the imaging unit 201. In step S204, the front of the user facing the mirror-type monitor 14 is imaged by the in-car camera 12, and the image is temporarily stored as a user image PIC2 in the data 230 area of ​​the memory 210. When the processing of step S204 is completed, the processing proceeds to step S206.

[0048] The processing of step S206 corresponds to product information acquisition processing executed by the information acquisition unit 205. In step S206, product information related to fashion is acquired from the external service 30. The information acquisition unit 205 estimates the gender, age, etc. of the user in the cart 1 by image analysis of the user image PIC2 captured in the processing of step S204, and acquires product information related to fashion that matches the estimated gender, age, etc. When the processing of step S206 is completed, the processing proceeds to step S208.

[0049] The processing of step S208 corresponds to the dress-up image generation executed by the dress-up image generation unit 206. In step S208, a dress-up image PIC3 of the user image is generated using the product information acquired by the information acquisition unit 205. The generated dress-up image PIC3 is temporarily stored in the data 230 area of ​​the memory 210. When the processing of step S208 is completed, the process proceeds to step S210.

[0050] Step S210 corresponds to a user image display process executed by the user image display unit 203. In step S210, the mirror-type monitor 14 is switched from the mirror state to the monitor state, and the dress-up image PIC3 stored in the memory 210 is read out and displayed on the mirror-type monitor 14. When the process of step S210 is completed, the process proceeds to step S212.

[0051] In step S212, it is determined based on the operation information received from the control panel 6 whether the elevator 100 has arrived at the destination floor registered by the user, or whether it has stopped at an intermediate floor before arriving at the destination floor due to a call registered by another user. If the determination is not affirmative, the process of step S212 is repeatedly executed until the determination is affirmative. If the determination of step S212 is affirmative, the process proceeds to step S214.

[0052] In step S214, the display of the dress-up image PIC3 on the mirror-type monitor 14 is terminated, and the mirror-type monitor 14 is switched from the monitor state to the mirror state.

[0053] 2-3. Modifications The mirror-type monitor device 10 of the second embodiment may be modified as follows.

[0054] 10, there are no limitations on the content of the product information INF displayed on the mirror-type monitor 14. That is, the product information may be, for example, a readable two-dimensional barcode in which the product information is encrypted, or a URL related to the product.

[0055] The dress-up image generated in the dress-up image generation process in step S208 of the flowchart in Fig. 10 is not limited to an image of the front of the user, but may also be an image of the back. In the case of generating a dress-up image of the back, if the determination in step S200 is affirmative, an image of the back of the user may be captured by executing the processes in steps S102 and S104 shown in Fig. 5, and the captured back image may be used in the dress-up image generation process.

[0056] DESCRIPTION OF SYMBOLS 1 Cage, 1a Side, 2 Cage door, 3 Hoistway, 4 Landing, 6 Control panel, 8 In-cab operation panel, 10 Mirror-type monitor device, 12 In-cab camera, 14 Mirror-type monitor, 20 Control device, 30 External service, 100 Elevator, 200 Processor, 201 Imaging unit, 202 Imaging condition determination unit, 203 User image display unit, 204 Display condition determination unit, 205 Information acquisition unit, 206 Image generation unit, 210 Memory, 220 Program, 230 Data, 240 Dedicated hardware, 250 Processing circuit

Claims

1. An in-cab camera that captures images of users inside the elevator car; a mirror-type monitor provided on a side surface inside the car and switchable between a mirror state in which the mirror functions as a mirror and a monitor state in which the monitor functions as a display device that displays an image; A control device that controls the operation of the car interior camera and the mirror-type monitor; Equipped with The control device includes: an imaging unit that images a user who is in the elevator car using an in-elevation camera when an imaging condition is satisfied; a user image display unit that switches a state of the mirror-type monitor from the mirror state to the monitor state when a display condition is satisfied, and causes the user image captured by the imaging unit to be displayed on the mirror-type monitor; An elevator mirror-type monitor device including:

2. The car interior camera is installed at a position where it can capture an image of a user operating an in-car operation panel from the rear side, 2. The mirror-type monitor device according to claim 1, wherein the image capturing condition includes that the in-car operation panel has been operated.

3. 3. The mirror-type monitor device according to claim 1, wherein the image capturing conditions include a condition that the number of passengers in the elevator car is one.

4. 3. The mirror-type monitor device according to claim 1, wherein the display condition includes that the user faces the direction of the mirror-type monitor.

5. When the elevator arrives at the destination floor or when the elevator arrives at the intermediate floor for which a call has been registered, the user image display unit ends the display of the user image.

2. The mirror type monitor device according to claim 1, which is configured as follows.

6. An in-cab camera that captures images of users inside the elevator car; a mirror-type monitor provided on a side surface inside the car and switchable between a mirror state in which the mirror functions as a mirror and a monitor state in which the monitor functions as a display device that displays an image; A control device that controls the operation of the car interior camera and the mirror-type monitor; Equipped with The control device includes: an imaging unit that images a user who is in the elevator car using an in-elevation camera when an imaging condition is satisfied; an information acquisition unit that acquires product information including image images of clothing products; an image generating unit that generates a dress-up image in which the user wears the clothing product by using the user image captured by the imaging unit and the image image; a dress-up image display unit that switches a state of the mirror-type monitor from the mirror state to the monitor state when a display condition is satisfied, and displays the dress-up image on the mirror-type monitor; Including, The car interior camera is installed at a position where it can capture an image of a user facing the mirror-type monitor from the front side, The mirror-type monitor device in an elevator, wherein the imaging conditions include the user facing toward the mirror-type monitor.

7. The product information includes product description information for identifying the clothing product, The dress-up image display unit displays the product description information together with the dress-up image. It is configured as follows:

7. A mirror type monitor device according to claim 6.

8. 8. The mirror type monitor device according to claim 6, wherein the image capturing conditions include a condition that the number of passengers in the elevator car is one.