Image transmission system, learning device, estimation device, image transmission method, and image transmission program for elevator

Abstract

An image transmission system, a learning device, an inference device, an image transmission method, and an image transmission program for an elevator can make an image output to an external information device become an image captured in an environment more suitable for person photographing. An image transmission system is provided with an environment control unit (24) and a transmission unit (26). The environment control unit (24) controls the environment in the elevator car by means of an environment device on the basis of the normal environment setting during normal time. The environment control unit (24) controls the environment in the car by means of the environment device on the basis of the photographing environment setting while the user takes the car and the car door of the car is closed. The photographing environment setting is an environment setting for photographing a person of a user and is an environment setting different from the normal environment setting. The transmission unit (26) transmits, to an information device outside the elevator, an image captured by a photographing device in the car when the environment control unit (24) controls the environment in the car according to the photographing environment setting.

Description

Technical Field

[0001] The present invention relates to an image transmission system, a learning device, an inference device, an image transmission method and an image transmission program for an elevator. Background Art

[0002] Patent Document 1 discloses an example of an image transmission system for an elevator. An image pickup device for capturing images inside a car is provided in an elevator. The image transmission system transmits images captured by the image pickup device inside the car to a portable device held by a user who has boarded the car.

[0003] Prior art literature

[0004] Patent Document 1: Japanese Patent Application Publication No. 2009-190847 Summary of the invention

[0005] However, in elevators, the environment inside the car, such as lighting, is sometimes set from the perspective of exterior design. For example, in the system of Patent Document 1, the photographic environment of the captured image may not always be suitable for photographing people such as users.

[0006] The present invention is made to solve such a problem and provides an elevator image transmission system, a learning device, an inference device, an image transmission method and an image transmission program that can make images output to external information equipment be images taken in an environment more suitable for photographing people.

[0007] The image sending system of the elevator of the present invention comprises: an environment control unit, which under normal circumstances controls the environment in the car using an environment device of the car according to a pre-set normal environment setting, and controls the environment in the car using the environment device according to a photographic environment setting different from the normal environment setting while a user is riding in the car and the car door of the car is closed, wherein the photographic environment setting is an environment setting for photographing the person of the user; and a sending unit, which sends to an information device outside the elevator an image taken by a photographic device installed in the car when the environment control unit controls the environment in the car according to the photographic environment setting.

[0008] The learning device of the present invention is a learning device that generates a completed learning model, wherein the completed learning model estimates the setting value of the personal-use photography environment setting used in the following image sending system of an elevator, wherein the image sending system is the image sending system of the above-mentioned elevator, and the photography environment setting includes a personal-use photography environment setting that is set to be suitable for personal-use photography of the user, and the sending unit sends to the information device accessible to the user the image taken by the photography device when the environment control unit controls the environment in the car according to the personal-use photography environment setting, wherein the learning device comprises: a learning data acquisition unit that acquires learning data, wherein the learning data includes a combination of a post-evaluation value for the image taken by the photography device and the setting value of the personal-use photography environment setting when the image was taken; and a model generation unit that uses the learning data acquired by the learning data acquisition unit to generate a completed learning model that estimates the setting value of the personal-use photography environment setting that makes the post-evaluation value of the image taken by the photography device higher.

[0009] The inference device of the present invention is an inference device using a learned model, wherein the learned model is generated based on learning data in a manner that estimates the setting value of the personal-use photography environment setting used in the following image sending system, wherein the learning data includes a combination of a post-evaluation value for an image captured by the photographic device and the setting value of the personal-use photography environment setting when the image is captured, wherein the image sending system is the image sending system of the above-mentioned elevator, and the photography environment setting includes a personal-use photography environment setting that is set to be suitable for personal-use photography of the user, wherein the sending unit sends to the information device accessible to the user the image captured by the photographic device when the environment control unit controls the environment in the car according to the personal-use photography environment setting, and the inference device includes an inference unit that uses the learned model to estimate the setting value of the personal-use photography environment setting that makes the post-evaluation value of the image captured by the photographic device higher.

[0010] The image sending method of the elevator of the present invention is the following method, wherein a computer performs the following processing: under normal circumstances, the environment inside the car is controlled by using the environment device of the car according to a pre-set normal environment setting; while a user is riding in the car and the car door of the car is closed, the environment inside the car is controlled by using the environment device according to a photographic environment setting different from the normal environment setting, the photographic environment setting being an environment setting for photographing the person of the user; and an image taken by the photographic device installed in the car when the environment inside the car is controlled according to the photographic environment setting is sent to an information device outside the elevator.

[0011] The image sending program of the elevator of the present invention causes the computer to perform the following processing: under normal circumstances, the environment inside the car is controlled by the environment device of the car according to a pre-set normal environment setting; while a user is riding in the car and the car door of the car is closed, the environment inside the car is controlled by the environment device according to a photographic environment setting different from the normal environment setting, the photographic environment setting being an environment setting for photographing the user's person; and images taken by the photographic device installed in the car when the environment inside the car is controlled according to the photographic environment setting are sent to an information device outside the elevator.

[0012] Effects of the Invention

[0013] According to the elevator image transmission system, learning device, inference device, image transmission method or image transmission program of the present invention, images output to external information equipment can be images taken in an environment more suitable for photographing people. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is a block diagram of an elevator according to Embodiment 1.

[0015] Figure 2 This is a diagram showing an example of the interior of the elevator car according to Embodiment 1.

[0016] Figure 3 This is a diagram showing an example of a screen display of a portable device for setting the imaging environment of the elevator according to the first embodiment.

[0017] Figure 4 This is a flowchart showing an example of operation of the image transmission system according to the first embodiment.

[0018] Figure 5 This is a hardware configuration diagram of the main parts of the image transmission system according to the first embodiment.

[0019] Figure 6This is a flowchart showing an example of the operation of the image transmission system according to the second embodiment.

[0020] Figure 7 This is a structural diagram of a learning device according to the third embodiment.

[0021] Figure 8 This is a diagram showing an example of a neural network used by the learning device of the third embodiment.

[0022] Fig. 9 This is a flowchart showing an example of the operation of the learning device according to the third embodiment.

[0023] Fig.10 This is a structural diagram of the inference device of embodiment 3.

[0024] Fig.11 This is a flowchart showing an example of the operation of an image transmission system including an estimation device according to the third embodiment.

[0025] Description of symbols

[0026] 1: elevator; 2: car; 3: control panel; 4: first communication device; 5: car door; 6: lighting device; 7: air conditioning device; 8: image display device; 9: position detection unit; 10: photographing device; 11: operation control unit; 12: door opening and closing control unit; 13: public communication line; 14: management server; 15: second communication device; 16: storage unit; 17: data management unit; 18: portable device; 19: image transmission system; 20: image processing unit; 21: personal recognition unit; 22: feature determination unit; 23: elevator detection unit; 24: environmental control unit; 25: status determination unit; 26: transmission unit; 27: learning device; 28: inference device; 29: learning data acquisition unit; 30: model generation unit; 31: model storage unit; 32: inference data acquisition unit; 33: inference unit; 100a: processor; 100b: memory; 100c: signal input and output unit. DETAILED DESCRIPTION

[0027] The embodiments of the present invention are described with reference to the accompanying drawings. In each figure, the same reference numerals are used to mark the same or corresponding parts, and repeated descriptions are appropriately simplified or omitted. In addition, the object of the present invention is not limited to the following embodiments, and any constituent element of the embodiment can be deformed or omitted without departing from the scope of the purpose of the present invention.

[0028] Implementation method 1.

[0029] Figure 1 This is a block diagram of the elevator 1 according to the first embodiment.

[0030] The elevator 1 is used in a building having multiple floors. Although not shown, a shaft of the elevator 1 is provided in the building. The shaft is a vertically long space spanning multiple floors. The elevator 1 includes a car 2, a control panel 3, and a first communication device 4.

[0031] The car 2 is a device for transporting users of the elevator 1 between multiple floors by running in the up-down direction in the hoistway. The load of the car 2 is supported by, for example, a main rope not shown in the hoistway. The car 2 runs in the up-down direction in the hoistway in conjunction with the movement of the main rope, for example, by a traction machine not shown pulling the main rope.

[0032] The car 2 includes a car door 5, a lighting device 6, an air conditioning device 7, an image display device 8, a position detection unit 9, and a camera 10. The car door 5 is a door that separates the inside and outside of the car 2. The lighting device 6 is, for example, a device that emits visible light to the inside of the car 2. The lighting device 6 adjusts the optical environment inside the car 2. The air conditioning device 7 is, for example, a device that adjusts the room temperature and humidity inside the car 2. The air conditioning device 7 may be, for example, a ventilation device that replaces the air inside the car 2, or a circulation device that circulates the air inside the car 2. The air conditioning device 7 adjusts the environment formed by the air inside the car 2. The image display device 8 is, for example, a device that displays an image to a user riding in the car 2. The image display device 8 adjusts the visual environment for the user riding in the car 2. The lighting device 6, the air conditioning device 7, and the image display device 8 are examples of environmental devices. The position detection unit 9 is a part equipped with a function of detecting the position of the user riding in the car 2 in the car 2. The camera 10 is a device that captures the inside of the car 2. The image captured by the imaging device 10 may be a still image or a moving image.

[0033] The control panel 3 is a device for controlling the operation of the elevator 1. The control panel 3 is arranged, for example, at the upper part or the lower part of the hoistway. For example, when a machine room of the elevator 1 is provided above the hoistway, the control panel 3 may be arranged in the machine room. The control panel 3 outputs control signals in a manner capable of controlling the devices and equipment such as the car 2 and the traction machine of the elevator 1. The control panel 3 collects information from the devices and equipment such as the car 2 and the traction machine so as to grasp the state of the elevator 1. The control panel 3 includes an operation control unit 11 and a door opening and closing control unit 12. The operation control unit 11 controls the operation of the car 2. The operation of the car 2 includes making the car 2 travel between multiple floors in response to the registered user's call. The door opening and closing control unit 12 controls the opening and closing of the car door 5. The door opening and closing control unit 12 opens and closes the car door 5 when the car 2 stops at any floor so that users can get on and off.

[0034] The first communication device 4 is a device for performing information communication between the elevator 1 and external devices, etc. The first communication device 4 is connected to the public communication line 13 through wireless communication or wired communication. The public communication line 13 may include, for example, the Internet or a telephone line network. The first communication device 4 may be, for example, a remote monitoring device for monitoring the status of the elevator 1 from a distance. The first communication device 4, for example, sends the status information of the elevator 1 to the management server 14 through the public communication line 13. The status information of the elevator 1 includes, for example, a control signal in the elevator 1 and an image taken by the camera 10 installed in the car 2. The first communication device 4 sends the information to the management server 14, for example, at a predetermined timing, such as regularly or irregularly.

[0035] The management server 14 is a device that collects and manages information of the elevator 1. The management server 14 is an example of an information device external to the elevator 1. The management server 14 is, for example, one or more server computers. The management server 14 is, for example, installed at a remote location of a building to which the elevator 1 is applied. The management server 14 includes a second communication device 15, a storage unit 16, and a data management unit 17. The second communication device 15 is a device that performs information communication between the management server 14 and an external device. The second communication device 15 is connected to the public communication line 13 by wireless communication or wired communication. The second communication device 15 collects status information of the elevator 1 from the first communication device 4, for example, through the public communication line 13. The storage unit 16 is a part that stores the collected information. The data management unit 17 is a part that manages the addition, modification, and deletion of the information stored in the storage unit 16, as well as the reading and writing.

[0036] The user of the elevator 1 has a portable device 18. The portable device 18 is a portable information device equipped with a wireless communication function, such as a smartphone or a smart watch. The portable device 18 held by the user is an example of an information device that the user can access. The portable device 18 is connected to the public communication line 13 through wireless communication.

[0037] In the elevator 1, an image transmission system 19 is applied. The image transmission system 19 may be an internal system included in the elevator 1, or an external system applied to the elevator 1 from the outside. A part or all of the image transmission system 19 may also be included in the elevator 1. The image transmission system 19 is a system equipped with a function of transmitting an image captured by the imaging device 10 in the car 2 to an information device outside the elevator 1. The image transmission system 19 includes an image processing unit 20, a personal identification unit 21, a feature determination unit 22, an elevator detection unit 23, an environment control unit 24, a status determination unit 25, and a transmission unit 26.

[0038] The image processing unit 20 is a part that performs image data analysis and other processing on the image in the car 2 captured by the imaging device 10. The image processing unit 20, for example, extracts feature quantities from the image. For example, when a person is reflected in the image, the image processing unit 20 extracts the person's feature points and the like.

[0039] The personal identification unit 21 is a part that performs processing such as recognition of a person in the image based on the feature quantity extracted from the image by the image processing unit 20. The personal identification unit 21 uses, for example, a model learned in advance based on teacher data to recognize a person in the image. For example, when a user registers a call for the elevator 1 using a portable device 18 or an IC tag (IC: Integrated Circuit) or an ID card (ID: IDentifier), the personal identification unit 21 can also recognize the user riding in the car 2 based on the call information. In this case, the personal identification unit 21 obtains the call information from the operation control unit 11, for example. In addition, the personal identification unit 21 can also recognize the user riding in the car 2 by receiving a wireless signal transmitted by the portable device 18 or IC tag held by the user. The wireless signal is received by a receiver (not shown) installed in the car 2, for example. In this case, the personal identification unit 21 obtains the reception information of the wireless signal from the receiver, for example. In addition, the personal identification unit 21 can also identify the user riding in the car 2 by, for example, receiving a wireless signal from a wireless beacon installed in the car 2 through the portable device 18 or IC tag held by the user. In this case, the personal identification unit 21 obtains the reception information of the wireless signal from the portable device 18 or IC tag of the user.

[0040] The feature determination unit 22 is a part that performs processing such as feature determination of a person such as a user riding in the car 2. For example, the feature determination unit 22 determines the feature of the user shown in the image subjected to feature extraction and other processing by the image processing unit 20 based on the extracted feature quantity and the like. In addition, the feature determination unit 22 determines the feature of the user based on, for example, the position of the user in the car 2 detected by the position detection unit 9 and the like. The feature determination unit 22 determines the feature of the user, for example, identified by the personal identification unit 21. The feature determination unit 22 determines the feature of the user, for example, based on the action pattern such as the posture or movement path of the user in the car 2 and the like.

[0041] The boarding detection unit 23 is a part that performs processing such as detecting the boarding of the user to the car 2. The boarding detection unit 23 may directly detect the state of the user boarding the car 2, or may detect the state of the user boarding the car 2 based on the user boarding the car 2 and getting off the car 2. The boarding detection unit 23 may detect boarding based on, for example, the feature quantity extracted by the image processing unit 20, the information of the user identified by the personal identification unit 21, or the feature determined by the feature determination unit 22. The boarding detection unit 23 may detect boarding based on, for example, the position of the user detected by the position detection unit 9. The boarding detection unit 23 may detect boarding based on, for example, a device that measures the load inside the car 2, such as a weighing device (not shown) installed in the car 2. The boarding detection unit 23 may detect the boarding of the user to the car 2 based on the call information, for example, when the user registers the call for the elevator 1 using the portable device 18 or an IC tag or ID card (not shown). For example, the riding detection unit 23 may also process the elevator as if the user is riding in the elevator car 2 while the elevator car 2 responding to the user's call is traveling from the user's departure floor to the destination floor. In this case, the riding detection unit 23 obtains the call information from the operation control unit 11 or the like.

[0042] The environment control unit 24 is a part that performs processing such as controlling the environment in the car 2. The environment control unit 24 controls the environment devices such as the lighting device 6, the air conditioning device 7, and the image display device 8 according to the preset environment settings, thereby controlling the environment in the car 2. The control of the environment devices by the environment control unit 24 includes, for example, startup control and adjustment of various operating parameters. The environment settings include normal environment settings and photography environment settings.

[0043] The normal environment setting is an environment setting that specifies the environment in the car 2 at normal times. The normal environment setting is set, for example, by emphasizing design so that the user riding in the car 2 feels comfortable. In the normal environment setting, for example, the color temperature of the lighting device 6 is set to a low value so that a soft atmosphere can be created in the car 2. In the normal environment setting, for example, the air supply volume of the air conditioner 7 is set so that a comfortable wind can be felt in the car 2.

[0044] The photographic environment setting is an environment setting different from the normal environment setting. In addition, when multiple setting values ​​are set in the environment setting, it is sufficient as long as at least any one setting value between the photographic environment setting and the normal environment setting is different, or some setting values ​​between the photographic environment setting and the normal environment setting may be consistent. The photographic environment setting is an environment setting that is set to be applicable to the situation of photographing people and is suitable for portrait photography. The photographic environment setting may also include, for example, multiple environment settings that are different from each other. The photographic environment setting includes, for example, a personal-purpose photography environment setting. The personal-purpose photography environment setting is an environment setting that is set to be suitable for the user's personal-purpose photography. Personal-purpose photography includes, for example, commemorative photography or photography for confirming appearance. Personal-purpose photography is, for example, photography for purposes that emphasizes the appearance of the captured image.

[0045] The situation determination unit 25 is a part that performs processing such as determination of the situation related to whether photography in the car 2 is appropriate or not. The situation determination unit 25 determines the situation based on, for example, the feature quantity extracted by the image processing unit 20, the information of the user recognized by the personal recognition unit 21, or the feature determined by the feature determination unit 22. The situation determination unit 25 may also determine the situation based on, for example, the position of the user detected by the position detection unit 9. The determination made by the situation determination unit 25 includes, for example, determination of whether the situation is in a situation where photography for personal use is to be performed. In addition, the determination made by the situation determination unit 25 includes, for example, determination of whether the situation is inappropriate for photography for personal use. Here, the situation inappropriate for photography for personal use includes, for example, a situation inappropriate for photography for personal use because the crowded situation or operating situation of the elevator 1 has a great impact on other users and is therefore inappropriate for photography for personal use.

[0046] The sending unit 26 is a part that performs processing such as sending the image captured by the imaging device 10 to the outside of the elevator 1 through the first communication device 4 or the like. The sending unit 26 performs transmission control such as processing to determine whether to send the image captured by the imaging device 10 to information equipment such as the management server 14. The sending unit 26 may send the image captured by the imaging device 10 after adding the imaging condition information such as the imaging location, the imaging time, the setting value of the imaging environment setting, and the information on the result of the identification of the user reflected in the image by the personal identification unit 21.

[0047] Figure 2 This is a diagram showing an example of the interior of the car 2 of the elevator 1 according to the first embodiment.

[0048] The lighting device 6 is disposed, for example, on the ceiling or wall of the car 2. The lighting device 6 is, for example, an LED lighting (LED: Light Emitting Diode) or the like.

[0049] Inside the car 2 , for example, an air outlet of an air conditioner 7 that sends air into the car 2 is provided on a ceiling or a wall inside the car 2 .

[0050] The image display device 8 is, for example, installed on a wall inside the car 2. The image display device 8 may be, for example, a device that displays image content, such as a liquid crystal display device, an organic EL display device (EL: Electro-Luminescence), an LED display device, or a MEMS shutter display device (MEMS: Micro Electro Mechanical Systems). The image display device 8 may be, for example, a device that projects image content onto the ceiling, wall, floor, or car door 5 inside the car 2, such as a projector. The image display device 8 may also display an image captured by the camera 10 in real time.

[0051] The imaging device 10 is installed, for example, on a wall or ceiling inside the car 2. The imaging device 10 may be a security camera device or the like.

[0052] The position detection unit 9 may be, for example, a device that detects the position of the user based on the load applied to the floor of the car 2. The position detection unit 9 may be, for example, a device that detects the position of the user based on positioning using an ultrasonic sensor or an infrared sensor, or the signal strength of a wireless signal sent from a portable device 18 or an IC tag held by the user. The position detection unit 9 may be, for example, a device that detects the position of the user based on the reception strength of a wireless signal sent from a wireless beacon installed in the car 2, etc., in the portable device 18 held by the user. In this case, the function of the position detection unit 9 may also be mounted on the portable device 18. The position detection unit 9 may also detect the position of the user based on an image captured by the photographic device 10. In this case, the position detection unit 9 may not be installed in the car 2, and the function of the position detection unit 9 may also be mounted on the control panel 3 or other equipment of the elevator 1 or the management server 14, etc.

[0053] In the personal-use photography environment setting, for example, the setting values ​​of the lighting device 6 are set so that the illumination, color temperature, lighting direction, and lighting state in the car 2 become an environment suitable for photography. For example, there is usually a tendency in portrait photography that when the illumination is too low, a darker impression is formed, and the lower the color temperature, the more red the captured image is. Therefore, in the personal-use photography environment setting, for example, the lighting intensity of the lighting device 6 is set to be stronger than the intensity in the normal environment setting so that the illumination in the car 2 becomes higher. In addition, in the personal-use photography environment setting, for example, the color temperature of the lighting device 6 is set to be higher than the color temperature in the normal environment setting so as to suppress the redness of the image. In addition, in the personal-use photography environment setting, for example, the lighting direction of the lighting device 6 is set in a manner that can suppress the shadow of the user.

[0054] In the personal use photography environment setting, for example, the setting values ​​of the air conditioner 7 are set so that the air volume, wind direction, air conditioner setting temperature, and operating state become an environment suitable for photography. In the personal use photography environment setting, for example, the air volume is set to be weaker than the intensity in the normal environment setting. In the personal use photography environment setting, for example, the wind direction is set so that the wind does not blow directly toward the user. In the personal use photography environment setting, for example, the temperature or humidity in the car 2 is set. In the personal use photography environment setting, for example, the operation of the air conditioner 7 is set to stop.

[0055] In the personal use photography environment setting, for example, the setting values ​​of the image display device 8 are set so that the projection direction, projection brightness, contrast, focus setting, and operation state become an environment suitable for photography. In the personal use photography environment setting, for example, the projection brightness of the image projected by the image display device 8 is set to be weaker than the projection brightness in the normal environment setting. In the personal use photography environment setting, for example, the setting values ​​are set so that the focus of the image projected by the image display device 8 is blurred. In the personal use photography environment setting, for example, the operation of the image display device 8 is stopped.

[0056] Various setting values ​​of the photography environment setting such as the personal photography environment setting may be preset as a setting value set different from the normal photography environment setting. In addition, various setting values ​​of the personal photography environment setting may be preset by the user through the portable device 18 or the like.

[0057] Figure 3 This is a diagram showing an example of a screen display of the portable device 18 for setting the imaging environment of the elevator 1 according to the first embodiment.

[0058] The user selects whether to take a personal photography of the interior of the car 2 from two values ​​of the photography function, for example, "ON" or "OFF". At this time, the user may also set the conditions in which the personal photography is desired. In addition, the user may also specify fellow passengers who may be the same image subjects in the personal photography such as commemorative photography.

[0059] In the setting of the personal photography environment, the user selects a setting value of whether to operate the air conditioner 7 from two values, for example, "on" or "off". The user selects a setting value of the illumination in the car 2 from two values, for example, "bright" or "dark". The user may also select a setting value of the illumination in the car 2 from a plurality of discrete values ​​or from a continuous value, for example, by numerical input or a slider.

[0060] By setting the setting value according to the user's preference, the form of the captured image becomes the form preferred by the user, and the user as the subject in the image is more easily recognized. When the user sets the setting value according to the user's preference, the setting value is pre-stored in the storage unit 16 of the management server 14 together with the information identifying the user. The setting value is pre-transmitted to the management server 14 from the portable device 18 via the public communication line 13, for example.

[0061] Next, an operation example of the image transmission system 19 will be described.

[0062] Figure 4 This is a flowchart showing an example of operation of the image transmission system 19 according to the first embodiment.

[0063] In normal times, the environment control unit 24 controls the environment in the car 2 using environment devices such as the lighting device 6, the air conditioning device 7, or the image display device 8 according to normal environment settings.

[0064] In step S101, the image transmission system 19 determines whether the boarding detection unit 23 has detected that a user has boarded the car 2. If the boarding of a user has been detected, the processing of the image transmission system 19 proceeds to step S102. On the other hand, if the boarding of a user has not been detected, the processing of the image transmission system 19 ends.

[0065] In step S102, the personal identification unit 21 identifies the user who has boarded the car 2. In this example, the personal identification unit 21 identifies the user through wireless communication between the portable device 18 held by the user and a receiver or a wireless beacon installed in the car 2. The wireless communication at this time is, for example, short-range wireless communication. Then, the processing of the image transmission system 19 enters step S103.

[0066] In step S103, the image transmission system 19 determines whether the identified user in the car 2 is a user who wishes to take a personal photograph in the car 2. For example, the image transmission system 19 uses the information of the user identified by the personal identification unit 21 to obtain information from the storage unit 16 of the management server 14 on whether the user has been set to wish to take a personal photograph. When the user wishes to take a personal photograph and other users are not riding in the car 2, the image transmission system 19 determines that the user in the car 2 is a user who wishes to take a personal photograph. In addition, the identified user in the car 2 may specify a fellow passenger who can also be a subject of the same image. In this case, when other users other than the user and the specified fellow passenger are not riding in the car 2, the image transmission system 19 may determine that the user in the car 2 is a user who wishes to take a personal photograph. When it is determined that the user in the car 2 is a user who wishes to take a personal photograph, the processing of the image transmission system 19 proceeds to step S104. On the other hand, when it is not determined that the user in the car 2 is a user who desires personal photography, the processing of the image transmission system 19 ends.

[0067] In step S104, the situation determination unit 25 determines whether the situation is not suitable for personal photography. In this example, the situation determination unit 25 determines whether the situation is not suitable for personal photography due to the operating status of the elevator 1, etc., not due to the user's own situation who wants personal photography. For example, when the operation control unit 11 is operating the elevator 1 according to a specific operation mode such as a dispatch mode to improve the operation efficiency during a time period when the elevator 1 is used frequently, the situation determination unit 25 determines that the situation is not suitable for personal photography. For example, when the operation control unit 11 is operating the elevator 1 according to a specific operation mode such as a control operation mode in an emergency, the situation determination unit 25 determines that the situation is not suitable for personal photography. For example, when an autonomous mobile body such as a robot or a drone is riding in the car 2 in addition to the user, the situation determination unit 25 determines that the situation is not suitable for personal photography. For example, when the car 2 is just after departure and just before arrival, that is, when the car 2 is accelerating or decelerating, the situation determination unit 25 determines that the situation is not suitable for personal photography. At this time, for example, when the car 2 reaches the highest speed and travels at a constant speed, the situation determination unit 25 determines that the situation is not unsuitable for personal photography. When the situation determination unit 25 determines that the situation is not unsuitable for personal photography, the processing of the image transmission system 19 proceeds to step S105. On the other hand, when the situation determination unit 25 determines that the situation is unsuitable for personal photography, the processing of the image transmission system 19 ends. At this time, the control of the environment device based on the photography environment setting by the environment control unit 24 and the transmission of the photographic image of the photography device 10 by the transmission unit 26 are not performed.

[0068] In step S105, the situation determination unit 25 determines whether the situation is to be photographed for personal use. In this example, the situation determination unit 25 determines whether the situation is to be photographed for personal use based on the situation of the user himself who wishes to photograph the elevator 1 for personal use or the timing desired by the user himself. For example, when the user leaves or returns to the building where the elevator 1 is installed, the situation determination unit 25 determines that the situation is to be photographed for personal use such as to confirm the appearance. In this case, the building where the elevator 1 is installed is, for example, an apartment building where the user lives or an office building where the user works. In the case where the building is an office building, the user's going out or returning includes the user's going to and from get off work. For example, when the user's use history of the use time, movement direction, departure floor, and destination floor of the elevator 1 is stored in the storage unit 16 of the management server 14 or the portable device 18, the situation determination unit 25 determines the user's going out or returning based on the use history. Furthermore, for example, when it is estimated that the appearance of the user in the elevator 1 installed in a commercial facility such as a department store has changed, the situation determination unit 25 determines that it is in a situation of performing personal photography such as confirming the appearance. The situation determination unit 25 obtains the product purchase history of the user from, for example, an external server (not shown) that manages the purchase information of the user. For example, when the user uses the elevator 1 in the commercial facility after purchasing clothes or the like in the commercial facility, or when the user receives a beauty service in the commercial facility, the situation determination unit 25 estimates that the appearance of the user has changed. Alternatively, for example, when the user uses the elevator 1 in the commercial facility to move from a floor where a clothing store or a tenant providing beauty services is staying, the situation determination unit 25 estimates that the appearance of the user has changed. In addition, for example, when it is expected that the user wants to take personal photography such as commemorative photography in the elevator 1 installed in a tourist facility, the situation determination unit 25 may determine that it is in a situation of performing personal photography in principle. When the situation determination unit 25 determines that it is in a situation of performing personal photography, the processing of the image transmission system 19 proceeds to step S106. On the other hand, when the situation determination unit 25 determines that the situation is not for personal photography, the processing of the image transmission system 19 ends. In this case, the control of the environment device based on the photography environment setting by the environment control unit 24 and the transmission of the photographic image by the photography device 10 by the transmission unit 26 are not performed.

[0069] In step S106, the image transmission system 19 determines whether the door opening and closing control unit 12 has closed the car door 5. When the car door 5 is not closed, the image transmission system 19 proceeds to step S107. On the other hand, when the car door 5 is closed, the image transmission system 19 proceeds to step S108.

[0070] In step S107, the image transmission system 19 determines whether the user identified by the personal identification unit 21 is still riding in the car 2 based on the detection result of the riding detection unit 23, etc. When the user is riding in the car 2, the processing of the image transmission system 19 enters step S104. On the other hand, when the user is not riding in the car 2, the processing of the image transmission system 19 ends.

[0071] In step S108, the image transmission system 19 determines whether the user identified by the personal identification unit 21 is standing at the photography position in the car 2 by detecting the position detection unit 9 while the car door 5 is closed. The photography position is a pre-set position in the car 2 suitable for photographing a person by the photographing device 10. For example, when the user is standing at a position other than the photography position in the car 2, the image transmission system 19 determines that the user is not standing at the photography position in the car 2. In addition, the image transmission system 19 may determine whether the user is standing at the photography position and performing a pre-set posture. When the user is standing at the photography position in the car 2, the processing of the image transmission system 19 proceeds to step S109. On the other hand, when the user is not standing at the photography position in the car 2, the processing of the image transmission system 19 ends.

[0072] In step S109, the environment control unit 24 switches the environment setting from the normal environment setting to the personal use photography environment setting. The setting value of the personal use photography setting may be, for example, a preset value or a value pre-stored by the storage unit 16 of the management server 14 for the user identified by the personal identification unit 21. The environment control unit 24 controls the environment in the car 2 using the environment devices such as the lighting device 6, the air conditioning device 7 or the image display device 8 according to the personal use photography environment setting. Then, the processing of the image transmission system 19 proceeds to step S110.

[0073] In step S110, the photographing device 10 photographs the user in the car 2 under the photographing environment controlled by the environment control unit 24 according to the personal use photographing environment setting. The sending unit 26 sends the image of the user photographed by the photographing device 10 to the management server 14. The sending unit 26, for example, adds information such as the recognition result of the personal recognition unit 21 to the image and sends it to the management server 14. The data management unit 17 of the management server 14 stores the data of the image sent from the sending unit 26 in the storage unit 16. In addition, the sending unit 26 may send the data of the image of the user photographed by the photographing device 10 to the portable device 18 held by the user. The photographing of the image by the photographing device 10 and the sending of the image by the sending unit 26 are performed, for example, from the time when the car door 5 is closed, through the time when the car 2 starts from the departure floor and stops at the next stop floor, until the car door 5 is opened next. The timing of the image captured by the image capturing device 10 and the transmission of the image by the transmission unit 26 may be a predetermined regular or irregular timing during the period from the closing of the car door 5 to the next opening of the car door 5, or may be a timing designated by the user. After the transmission unit 26 transmits the image, the processing of the image transmission system 19 proceeds to step S111.

[0074] Here, the data management unit 17 of the management server 14 may transmit the image data to the portable device 18, for example, in response to a request from a portable device 18 held by a user who is the subject of the image captured by the photographing device 10. In this case, the management server 14 is an example of an information device that can be accessed by the user through the portable device 18 held by the user. In addition, the data management unit 17 may transmit the image data to the portable device 18 independently of the request from the portable device 18 held by the user who is the subject of the image. In this case, the timing of transmitting the image data to the portable device 18 may be a regular or irregular timing pre-set in the image transmission system 19, or may be a timing designated by the user.

[0075] In step S111, the image transmission system 19 determines whether the car 2 has stopped at the next stop floor. The image transmission system 19 determines the stop of the car 2, etc., based on information obtained from the operation control unit 11, etc. If the car 2 has not stopped at the next stop floor, the processing of the image transmission system 19 proceeds to step S110. On the other hand, if the car 2 has stopped at the next stop floor, the processing of the image transmission system 19 proceeds to step S112.

[0076] In step S112, the environment control unit 24 switches the environment setting from the personal use environment setting to the normal environment setting. The environment control unit 24 controls the environment in the car 2 using environment devices such as the lighting device 6, the air conditioning device 7 or the image display device 8 according to the normal environment setting. Then, the processing of the image transmission system 19 ends.

[0077] As described above, the image transmission system 19 of the first embodiment includes the environment control unit 24 and the transmission unit 26. Under normal circumstances, the environment control unit 24 controls the environment in the car 2 using the environment device according to the normal environment setting. While the user is riding in the car 2 and the car door 5 of the car 2 is closed, the environment control unit 24 controls the environment in the car 2 using the environment device according to the photography environment setting. The photography environment setting is an environment setting for photographing the user's person, and is an environment setting different from the normal environment setting. The transmission unit 26 transmits the image captured by the photography device 10 in the car 2 when the environment control unit 24 controls the environment in the car 2 according to the photography environment setting to the information equipment outside the elevator 1. The environment device includes, for example, the lighting device 6, the air conditioning device 7, and the image display device 8 provided in the car 2.

[0078] For example, when the color temperature of the lighting device 6 is set to a relatively low value under normal circumstances, the color of an image captured under such a photographic environment may be different from the actual color. In response to this, in the image transmission system 19, the environment control unit 24 outputs an image captured based on the photographic environment in the car 2 being controlled to be suitable for photographing people to an information device outside the elevator 1 such as the management server 14. Therefore, the image output to the information device outside the elevator 1 becomes an image captured under an environment more suitable for photographing people. In addition, in the case where the photographic environment setting is a photographic environment setting pre-set in the image transmission system 19, the user does not need to independently set various setting values ​​of the photographic environment setting. Therefore, the user does not need to spend the effort of specifically setting various setting values ​​of the environment setting, and can obtain, for example, an image captured in an environment suitable for photographing people that is generally highly rated.

[0079] In addition, the photography environment setting includes a personal photography environment setting that is set to be suitable for the user's personal photography. The sending unit 26 sends the image captured by the photography device 10 when the environment control unit 24 controls the environment in the car 2 according to the personal photography environment setting to the information device that the user can access. According to such a structure, the user of the elevator 1 can obtain an image captured in an environment suitable for personal photography such as checking appearance or commemorative photography. For example, when the user wants to take commemorative photography with friends in the car 2 of the elevator 1 in a commercial facility, the image captured in an environment suitable for commemorative photography can be provided. In addition, the user can check his appearance for the day in the car 2 of the elevator 1, for example, when going out from a residence such as an apartment. For example, when there is no mirror facing the wheelchair user in the car 2, the user can also easily check his appearance.

[0080] In addition, the image transmission system 19 includes a position detection unit 9. The position detection unit 9 detects the position of the user in the car 2. The transmission unit 26 transmits the image captured by the photographing device 10 when the position detection unit 9 detects that the user is standing at a preset photographing position in the car 2 to an external information device. According to such a structure, since the user is photographed at a position suitable for the photographing device 10 to perform human photography, a higher quality image can be obtained. In addition, the user can prepare for photography before standing at the photography position, so that the situation of being accidentally photographed can be suppressed, and a more satisfactory image can be obtained.

[0081] In addition, the image transmission system 19 includes a status determination unit 25. The status determination unit 25 determines whether the personal-use photography is being performed based on the user's usage status of the elevator 1. The transmission unit 26 transmits the image captured by the imaging device 10 to the external information device only when the status determination unit 25 determines that the personal-use photography is being performed. In addition, the environment control unit 24 performs control based on the personal-use photography environment setting only when the status determination unit 25 determines that the personal-use photography is being performed. According to such a structure, personal-use photography is performed when it should be performed based on the user's own situation such as the usage status of the elevator 1 or the user's wishes. As a result, the convenience of the user can be further improved.

[0082] In addition, the image transmission system 19 includes a status determination unit 25. The status determination unit 25 determines whether the elevator 1 is in a state not suitable for personal photography based on the operating status of the elevator 1. When the status determination unit 25 determines that the elevator 1 is in a state not suitable for personal photography, the transmission unit 26 does not transmit the image captured by the photography device 10 to the external information device. In addition, when the status determination unit 25 determines that the elevator 1 is in a state not suitable for personal photography, the environment control unit 24 does not perform control based on the personal photography environment setting. According to such a structure, personal photography can be avoided when it should be avoided based on the operating status of the elevator 1, etc., not due to the user's own situation who wants personal photography. As a result, the overall convenience of the users of the elevator 1 can be further improved.

[0083] In addition, the image transmission system 19 includes a personal identification unit 21. The personal identification unit 21 identifies the user who is riding in the car 2. The environment control unit 24 controls the environment in the car 2 according to the personal use photography environment setting preset for the user identified by the personal identification unit 21. According to such a configuration, the user can set various setting values ​​of the personal use photography environment setting according to his or her own preferences. Therefore, the user can obtain an image taken in an environment suitable for photographing people according to his or her personal preferences.

[0084] In addition, part or all of the functions of the image transmission system 19 may be mounted on, for example, a device or apparatus of the elevator 1 such as the control panel 3, or may be mounted on an information device such as the management server 14 or the portable device 18. Part or all of the functions of the image transmission system 19 may also be implemented, for example, by processing or storage resources on a cloud service.

[0085] Next, use Figure 5 An example of the hardware configuration of the image transmission system 19 will be described.

[0086] Figure 5 This is a hardware configuration diagram of the main parts of the image transmission system 19 according to the first embodiment.

[0087] Each function of the image transmission system 19 can be realized by a processing circuit. The processing circuit includes at least one processor 100a and at least one memory 100b. The processing circuit includes the processor 100a, the memory 100b, and at least one dedicated hardware, or the processing circuit may include at least one dedicated hardware instead of the processor 100a and the memory 100b. The processing circuit includes a signal input and output unit 100c. The signal input and output unit 100c is, for example, a module that performs signal input and output processing with a device or equipment outside the processing circuit.

[0088] When the processing circuit includes a processor 100a and a memory 100b, each function of the image transmission system 19 is implemented by software, firmware, or a combination of software and firmware. At least one of the software and firmware is described as a program. The program is stored in the memory 100b. The processor 100a implements each function of the image transmission system 19 by reading and executing the program stored in the memory 100b.

[0089] The processor 100a is also called a CPU (Central Processing Unit), a processing device, an arithmetic device, a microprocessor, a microcomputer, or a DSP. The memory 100b is composed of a nonvolatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Read Only Memory).

[0090] When the processing circuit has dedicated hardware, the processing circuit is implemented by, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof.

[0091] Each function of the image transmission system 19 can be realized by a processing circuit. Alternatively, each function of the image transmission system 19 can be realized by a processing circuit. Regarding each function of the image transmission system 19, a part can be realized by dedicated hardware, and the other part can be realized by software or firmware. In this way, the processing circuit realizes each function of the image transmission system 19 by dedicated hardware, software, firmware, or a combination thereof.

[0092] Implementation method 2.

[0093] In Embodiment 2, the differences from the example disclosed in Embodiment 1 are described in particular detail. With regard to features not described in Embodiment 2, any features of the example disclosed in Embodiment 1 can be adopted.

[0094] The photography environment setting includes, for example, a safety photography environment setting. The safety photography environment setting is an environment setting that is set to be suitable for identifying a suspicious user riding in the elevator car 2 of the elevator 1. In addition, the user may be a user who is not identified by the personal identification unit 21. The user may also be a user who does not particularly want to be photographed by the photography device 10. In the safety photography environment setting, for example, the setting value of the lighting device 6 is set so that the illumination, color temperature, lighting direction, and lighting state in the elevator car 2 become an environment suitable for identifying the user's face and the color of the clothes he wears.

[0095] In the safety photography environment setting, for example, the lighting intensity of the lighting device 6 is set to be stronger than the intensity in the normal environment setting so that the illumination in the car 2 becomes higher. The lighting intensity is set so that the illumination in the car 2 is, for example, 50 lx or more. The lighting intensity can also be set according to the number of light-emitting parts lit in the lighting device 6. In addition, in the safety photography environment setting, the color temperature of the lighting device 6 is set in a manner that makes it easy to distinguish the color of the user's clothing. The color temperature is set to about 4200K in the case of white, about 5000K in the case of daylight white, and about 6500K in the case of daylight color.

[0096] Next, an operation example of the image transmission system 19 will be described.

[0097] Figure 6 This is a flowchart showing an example of operation of the image transmission system 19 according to the second embodiment.

[0098] In step S201, the image transmission system 19 determines whether the boarding detection unit 23 has detected the boarding of the user into the car 2. When the boarding of the user is detected, the processing of the image transmission system 19 proceeds to step S202. On the other hand, when the boarding of the user is not detected, the processing of the image transmission system 19 ends.

[0099] In step S202, the image transmission system 19 determines whether the door opening and closing control unit 12 has closed the car door 5. When the car door 5 is not closed, the image transmission system 19 proceeds to step S203. On the other hand, when the car door 5 is closed, the image transmission system 19 proceeds to step S204.

[0100] In step S203, the image transmission system 19 determines whether the user is still riding in the car 2 based on the detection result of the riding detection unit 23. When the user is riding in the car 2, the processing of the image transmission system 19 enters step S202. On the other hand, when the user is not riding in the car 2, the processing of the image transmission system 19 ends.

[0101] In step S204, the feature determination unit 22 determines whether the user riding in the car 2 has suspicious features while the car door 5 is closed. The feature determination unit 22 determines whether the user has suspicious features based on, for example, the user's behavior pattern, clothing, and belongings. If the user has suspicious features, the processing of the image transmission system 19 proceeds to step S205. On the other hand, if the user does not have suspicious features, the processing of the image transmission system 19 ends.

[0102] In step S205, the environment control unit 24 switches the environment setting to the safety photography environment setting. The environment control unit 24 controls the environment in the car 2 using environment devices such as the lighting device 6, the air conditioning device 7 or the image display device 8 according to the safety photography environment setting. Then, the processing of the image transmission system 19 proceeds to step S206.

[0103] In step S206, the photographing device 10 photographs the user in the car 2 under the photographing environment controlled by the environment control unit 24 according to the safety photographing environment setting. The sending unit 26 sends the image of the user photographed by the photographing device 10 to the management server 14. The sending unit 26 attaches information such as a data tag indicating that the image is an image of a suspicious user to the image and then sends it to the management server 14. The data management unit 17 of the management server 14 stores the image data sent from the sending unit 26 in the storage unit 16. After the sending unit 26 sends the image, the processing of the image sending system 19 enters step S207.

[0104] Here, the data management unit 17 of the management server 14 may automatically forward the image data captured by the imaging device 10 to a PC (Personal Computer) in a management room accessible to the management personnel of the building or elevator 1 or a system of a pre-set security company, etc. In this case, the timing of forwarding the image data may be a regular or irregular timing pre-set in the image transmission system 19, or may be a timing specified by the management personnel or the like.

[0105] In step S207, the image transmission system 19 determines whether the car 2 has stopped at the next stop floor. When the car 2 has not stopped at the next stop floor, the image transmission system 19 proceeds to step S206. On the other hand, when the car 2 has stopped at the next stop floor, the image transmission system 19 proceeds to step S208.

[0106] In step S208, the environment control unit 24 switches the environment setting from the safety environment setting to the normal environment setting. The environment control unit 24 controls the environment in the car 2 using environment devices such as the lighting device 6, the air conditioning device 7 or the image display device 8 according to the normal environment setting. Then, the processing of the image transmission system 19 ends.

[0107] As described above, in the image transmission system 19 of the second embodiment, the photographic environment setting includes a safe photographic environment setting that is set to be suitable for identifying the user. In addition, the image transmission system 19 includes a feature determination unit 22. The feature determination unit 22 determines the features of the user in the car 2 based on the image captured by the photographic device 10. When the feature determination unit 22 determines that the user has suspicious features, the environment control unit 24 controls the environment in the car 2 based on the safe photographic environment setting. According to such a structure, the image of the user with suspicious features is captured under a photographic environment suitable for identifying the user. As a result, more effective data can be provided for searches when a situation occurs, thereby further improving the safety of the building to which the elevator 1 is applied.

[0108] Implementation method 3.

[0109] In Embodiment 3, the differences from the example disclosed in Embodiment 1 or Embodiment 2 are described in particular detail. For features not described in Embodiment 3, any features of the example disclosed in Embodiment 1 or Embodiment 2 may be adopted.

[0110] When there are various setting values ​​for the personal use photography environment setting used in the image transmission system 19, it is sometimes difficult to set the setting value to the preferred setting value that meets the user's wishes only through manual setting by the user. Therefore, in the following, an example of a method for setting the preferred setting value of the personal use photography environment setting is described. Here, a method using a learning device 27 that generates a learned model for setting the setting value of the personal use photography environment setting and an estimation device 28 that estimates the preferred setting value of the personal use photography environment setting using the learned model is described. In addition, the determination conditions in the determination of whether the situation is not suitable for personal use photography and the determination of whether the situation is suitable for personal use photography can also be set by the same method.

[0111] Figure 7 This is a configuration diagram of the learning device 27 according to the third embodiment.

[0112] In this example, the learning device 27 is a device included in the image transmission system 19. In addition, part or all of the learning device 27 may be a device outside the image transmission system 19. Part or all of the functions of the learning device 27 may be mounted on a device or apparatus of the elevator 1 such as the control panel 3, or may be mounted on an information device such as the management server 14 or the portable device 18. Part or all of the functions of the learning device 27 may be installed by, for example, processing or storage resources on a cloud service. The learning device 27 includes a learning data acquisition unit 29 and a model generation unit 30.

[0113] The learning data acquisition unit 29 is a part that performs processing such as acquisition of learning data for learning the completed model. The learning data is, for example, data including a combination of a plurality of sets of post-evaluation values ​​for an image captured by the imaging device 10 and setting values ​​of the personal use photography environment setting when the image was captured. The learning data acquisition unit 29 provides the acquired learning data to the model generation unit 30.

[0114] The post-evaluation value of the user image captured by the photographing device 10 is, for example, the satisfaction of the user's own evaluation of the image. When the user obtains image data from the management server 14 through the portable device 18, for example, the user inputs the satisfaction of the image through the portable device 18 and sends it to the management server 14. The satisfaction of the image input at this time is stored in the storage unit 16 of the management server 14 in correspondence with the setting value of the personal use photography environment setting when the image was captured. The learning data acquisition unit 29 acquires the learning data by reading information from the storage unit 16 of the management server 14, for example.

[0115] The post-evaluation value of the user image captured by the photographic device 10 is, for example, an evaluation value of the image evaluated by a third person other than the user. The user, for example, allows a friend who is a third person other than the user to view the image on the management server 14. The third person who is allowed to view the image, for example, inputs the evaluation value of the image to the management server 14 when viewing the image. The evaluation value of the image input at this time is stored in the storage unit 16 of the management server 14 in correspondence with the setting value of the personal photography environment setting when the image was captured. The learning data acquisition unit 29 acquires learning data by, for example, reading information from the storage unit 16 of the management server 14. Alternatively, the evaluation value of the third person can also be acquired by the learning data acquisition unit 29 from an external system such as SNS (Social Networking Service) when the image is uploaded to the external system.

[0116] Here, the post-evaluation value may be a single value or may include multiple item values. For example, multiple item values ​​include more high evaluations, fewer low evaluations, the number of views or citations, etc. In the case where the post-evaluation value includes multiple item values, for example, the comprehensive level of the post-evaluation value may be evaluated based on the value obtained by weighted average of each item value, or the level of the post-evaluation value may be evaluated based on the value of the item value selected from the multiple item values. At this time, the weight setting of the item value or the selection of the item value may be pre-set in the learning device 27, or may be set by the user.

[0117] In addition, the learning data acquisition unit 29 may not simultaneously acquire the post-evaluation value of the image captured by the imaging device 10 and the setting value of the personal-use photography environment setting when the image was captured. As long as the post-evaluation value of the image and the setting value of the personal-use photography environment setting when the image was captured are associated, the learning data acquisition unit 29 may acquire these data at different times.

[0118] The model generation unit 30 is a part that performs processes such as the generation of a learned model using learning data. In this example, the model generation unit 30 generates a learned model by supervised learning using a neural network. Here, supervised learning refers to a method in which learning data, which is a group of input data and result data, is provided to a learning device so that the learning device learns the characteristics of the learning data and generates a learned model of the result inferred from the input. In addition, the neural network is composed of, for example, an input layer composed of multiple neurons, an intermediate layer or hidden layer composed of multiple neurons, and an output layer composed of multiple neurons. The intermediate layer can be one layer or two or more layers.

[0119] Figure 8 This is a diagram showing an example of a neural network used by the learning device 27 according to the third embodiment.

[0120] exist Figure 8 In the illustrated three-layer neural network, when multiple inputs are input to the input layer (X1-X3), the input value of (X1-X3) is multiplied by the weight W1 (w11-w16) and then input to the intermediate layer (Y1-Y2). Furthermore, the input value of (Y1-Y2) is multiplied by the weight W2 (w21-w26) and then output from the output layer (Z1-Z3). The output result at this time changes according to the values ​​of weights W1 and W2. The learned model generated by the model generation unit 30 is represented by, for example, the values ​​of such weights W1 and W2.

[0121] The model generation unit 30 uses learning data including a combination of a post-evaluation value for an image and a setting value of a personal-use photography environment setting when the image was taken, to generate a learned model that outputs the setting value of the personal-use photography environment setting so that the post-evaluation value becomes higher. In this example, after the post-evaluation value for the image is input to the input layer, the setting value of the personal-use photography environment setting when the image was taken is output from the output layer, and the weights W1 and W2 of the neural network are adjusted according to the learning data. The model generation unit 30 generates a learned model by, for example, performing the learning as described above. The model generation unit 30 outputs the generated learned model to, for example, a model storage unit 31. Here, the model storage unit 31 is a part that stores information on the learned model. The model storage unit 31 may be, for example, a part of the storage unit 16 of the management server 14, or may be another storage device.

[0122] The model generation unit 30 may also generate a learned model by other methods. For example, the model generation unit 30 may also adjust the weights W1 and W2 of the neural network by supervised learning according to the learning data in a manner such that the setting values ​​of the personal photography environment settings when the image captured by the photographic device 10 is photographed are input into the input layer and the post-evaluation value for the image is output from the output layer. At this time, the neural network of the learned model outputs estimated values ​​of the post-evaluation values ​​expected for various setting values. The learned model may also be a model that uses such a neural network to search for setting values ​​of the personal photography environment settings that make the estimated value of the post-evaluation value higher. In addition to supervised learning, the model generation unit 30 may also use known algorithms such as unsupervised learning, semi-supervised learning, or reinforcement learning to generate a learned model.

[0123] Next, an operation example of the learning device 27 will be described.

[0124] Fig. 9 This is a flowchart showing an example of the operation of the learning device 27 according to the third embodiment.

[0125] In step S301, the learning data acquisition unit 29 acquires, as learning data, the post-evaluation value of the image captured by the image capturing device 10 and the setting value of the personal use image capturing environment when the image was captured. Then, the processing of the learning device 27 proceeds to step S302.

[0126] In step S302, the model generation unit 30 generates a learned model by, for example, supervised learning, based on the learning data acquired by the learning data acquisition unit 29. In this example, the generated learned model is a model that estimates the setting values ​​of the personal photography environment setting so that the post-evaluation value of the image captured by the photography device 10 becomes higher. Then, the processing of the learning device 27 proceeds to step S303.

[0127] In step S303, the model generation unit 30 outputs the generated learned model to the model storage unit 31. The model storage unit 31 stores the learned model generated by the model generation unit 30. Then, the processing of the learning device 27 ends.

[0128] Fig.10 This is a configuration diagram of the estimation device 28 according to the third embodiment.

[0129] In this example, the inference device 28 is a device included in the image transmission system 19. In addition, part or all of the inference device 28 may be a device outside the image transmission system 19. Part or all of the functions of the inference device 28 may be mounted on a device or apparatus of the elevator 1 such as the control panel 3, or may be mounted on an information device such as the management server 14 or the portable device 18. Part or all of the functions of the inference device 28 may be implemented by, for example, processing or storage resources on a cloud service. The inference device 28 includes an inference data acquisition unit 32 and an inference unit 33.

[0130] The inference data acquisition unit 32 is a part that performs processing such as acquiring inference data for inference based on the learned model. The inference data is, for example, an expected post-evaluation value for the image captured by the photographic device 10. The expected post-evaluation value for the image captured by the photographic device 10 can be pre-set in the inference device 28 or can be set by the user. The inference data acquisition unit 32 acquires the inference data from, for example, the storage unit 16 of the management server 14 or the portable device 18 of the user. The inference data acquisition unit 32 provides the acquired inference data to the inference unit 33.

[0131] The estimation unit 33 is a part that performs processing such as estimating the setting value of the personal use photography environment setting so that the ex post evaluation value of the image captured by the photography device 10 becomes higher. The estimation unit 33 reads the learned model from the model storage unit 31, for example. The learned model read in this case may be a model generated by the learning device 27 of the image transmission system 19, or a model generated in advance in another external system. The estimation unit 33 estimates the setting value of the personal use photography environment setting so that the ex post evaluation value of the image captured by the photography device 10 becomes higher by applying the estimation data to the learned model, etc. The estimation unit 33 estimates the setting value of the personal use photography environment setting so that the ex post evaluation value expected for the image captured by the photography device 10 or a higher ex post evaluation value can be obtained. The estimation unit 33 outputs the estimated setting value of the personal use photography environment setting to, for example, the control panel 3 of the elevator 1 or the environment control unit 24 of the image transmission system 19. The environment control unit 24 controls the environment in the car 2 according to the estimated setting value of the personal use photography environment setting.

[0132] Next, an operation example of the image transmission system 19 including the estimation device 28 will be described.

[0133] Fig.11 This is a flowchart showing an example of the operation of the image transmission system 19 including the estimation device 28 according to the third embodiment.

[0134] In step S351, the estimation data acquisition unit 32 acquires, as estimation data, the post-evaluation value expected for the image captured by the imaging device 10. Then, the processing of the image transmission system 19 including the estimation device 28 proceeds to step S352.

[0135] In step S352, the inference unit 33 estimates the setting value of the personal use photography environment setting so that the expected post-evaluation value for the image captured by the photography device 10 can be obtained by applying the inference data to the learned model read from the model storage unit 31. Then, the processing of the image transmission system 19 including the inference device 28 proceeds to step S353.

[0136] In step S353, the estimation unit 33 outputs the estimated setting value of the personal use photography environment setting to, for example, the environment control unit 24 of the image transmission system 19. Then, the processing of the image transmission system 19 including the estimation device 28 proceeds to step S354.

[0137] In step S354, the environment control unit 24 controls the environment in the car 2 using environment devices such as the lighting device 6, the air conditioning device 7 or the image display device 8 based on the personal use environment setting of the estimated setting value. Then, the processing of the image transmission system 19 including the estimation device 28 ends.

[0138] As described above, the learning device 27 of the third embodiment generates a learned model for estimating the setting value of the personal-use photography environment setting used in the image transmission system 19. The learning device 27 includes a learning data acquisition unit 29 and a model generation unit 30. The learning data acquisition unit 29 acquires learning data including a combination of a post-evaluation value for an image captured by the imaging device 10 and a setting value of the personal-use photography environment setting when the image was captured. The model generation unit 30 generates a learned model for estimating the setting value of the personal-use photography environment setting that makes the post-evaluation value for the image captured by the imaging device 10 higher, using the learning data acquired by the learning data acquisition unit 29. In addition, the inference device 28 of the third embodiment estimates the setting value of the personal-use photography environment setting used in the image transmission system 19 using the learned model generated based on the learning data. The inference device 28 includes an inference unit 33. The inference unit 33 estimates the setting value of the personal-use photography environment setting that makes the post-evaluation value for the image captured by the imaging device 10 higher, using the learned model. Here, the post-evaluation value of the user image captured by the imaging device 10 includes the satisfaction of the user himself / herself in evaluating the image or the evaluation value evaluated by a third party other than the user.

[0139] According to such a configuration, even when there are various setting values ​​for the personal photography environment setting, the setting value that makes the post-evaluation value of the image captured by the photography device 10 higher is set according to the learned model. Therefore, the user can obtain an image captured in a photography environment that matches the user's preference or in a photography environment that is generally highly evaluated, without the user having to manually adjust each setting value.

[0140] The learning device 27 may generate a learned model using learning data based on images captured by a single image transmission system 19 or the like, or may generate a learned model using learning data based on images captured by a plurality of image transmission systems 19 or the like. The image transmission system 19 for which the learning data is collected may be an image transmission system applied to a plurality of elevators 1 installed in the same area or the like. The plurality of image transmission systems 19 for which the learning data is collected may be applied to a plurality of elevators 1 installed in different areas, respectively, and operate independently of each other. The learning device 27 may newly add an image transmission system 19 for which the learning data is collected, or may exclude any of the plurality of image transmission systems 19 for which the learning data is collected from the collection object. Furthermore, the learned model generated by the learning device 27 based on the learning data collected from a certain image transmission system 19 may be used in the inference device 28 applied to another image transmission system 19. The learning device 27 may update the learned model by re-learning based on the learning data collected from the other image transmission system 19.

[0141] The learning device 27 and the inference device 28 may be constituted by separate hardware or may be installed on the same hardware. The learning device 27 and the inference device 28 each have a processing circuit including a processor and a memory as hardware. The processor is, for example, a CPU (Central Processing Unit), an arithmetic device, a microprocessor or a microcomputer. The memory is, for example, a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), a flash memory, EPROM (Erasable Programmable Read Only Memory) and EEPROM (Electrically Erasable Programmable Read Only Memory), or a magnetic disk, a floppy disk, an optical disk, a CD (compactdisk), a minidisk and a DVD (Digital Versatile Disk). The memory stores, for example, a program as software or firmware. Furthermore, the learning device 27 and the inference device 28 implement pre-set processing by executing a program stored in a memory through a processor, and realize each function as a result of the cooperation between hardware and software. The functions of the learning device 27 and the inference device 28 can also be realized by processing circuits respectively. Alternatively, part or all of the functions of the learning device 27 and the inference device 28 can also be realized uniformly by a processing circuit. In addition, the processing circuit can also be realized by, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array), or a combination thereof.

[0142] To summarize the above description, the technology of the present invention can adopt configurations including the configurations shown below as supplementary notes.

[0143] (Note 1)

[0144] An elevator image transmission system, wherein the elevator image transmission system comprises:

[0145] an environment control unit that, under normal circumstances, controls the environment in the car using an environment device of the car according to a pre-set normal environment setting, and, while a user is riding in the car and the car door of the car is closed, controls the environment in the car using the environment device according to a photographic environment setting different from the normal environment setting, the photographic environment setting being an environment setting for photographing the person of the user; and

[0146] A transmitting unit transmits, to an information device outside the elevator, an image captured by a photographing device installed in the car when the environment control unit controls the environment in the car according to the photographing environment setting.

[0147] (Note 2)

[0148] The image transmission system for an elevator according to Supplement 1, wherein:

[0149] The environmental control unit controls a lighting device provided in the car as the environmental device.

[0150] (Note 3)

[0151] The image transmission system for an elevator according to Supplement 1, wherein:

[0152] The environmental control unit controls an air-conditioning device installed in the car as the environmental device.

[0153] (Note 4)

[0154] The image transmission system for an elevator according to Supplement 1, wherein:

[0155] The environmental control unit controls a video display device provided in the car as the environmental device.

[0156] (Note 5)

[0157] An elevator image transmission system according to any one of Supplementary Notes 1 to 4, wherein:

[0158] The photography environment setting includes a personal photography environment setting, wherein the personal photography environment setting is set to be suitable for the user's personal photography.

[0159] The transmitting unit transmits, to the information device accessible to the user, the image captured by the photographing device when the environment control unit controls the environment in the car according to the personal-use photographing environment setting.

[0160] (Note 6)

[0161] The image transmission system for an elevator according to Supplement 5, wherein:

[0162] The image transmission system of the elevator includes a position detection unit, the position detection unit detecting the position of the user in the car,

[0163] The transmitting unit transmits, to the information device, the image captured by the imaging device when the position detecting unit detects that the user is standing at a preset imaging position in the car.

[0164] (Note 7)

[0165] The image transmission system for an elevator according to Supplement 5, wherein:

[0166] The elevator image transmission system includes a situation determination unit for determining whether the user is in a situation where personal photography is to be performed based on the situation of the user using the elevator.

[0167] The transmission unit transmits the image captured by the imaging device to the information device only when the situation determination unit determines that the situation is a situation where personal-use photography is to be performed.

[0168] (Note 8)

[0169] The image transmission system for an elevator according to Supplement 7, wherein:

[0170] The environment control unit performs control based on the personal-purpose photography environment setting only when the situation determination unit determines that the situation is a situation where personal-purpose photography is to be performed.

[0171] (Note 9)

[0172] The image transmission system for an elevator according to Supplement 5, wherein:

[0173] The elevator image transmission system includes a status determination unit, which determines whether the elevator is in a state that is not suitable for personal photography based on the operation state of the elevator.

[0174] When the situation determination unit determines that the situation is not suitable for photography for personal use, the transmission unit does not transmit the image photographed by the photography device to the information equipment.

[0175] (Note 10)

[0176] The image transmission system for an elevator according to Supplementary Note 9, wherein:

[0177] When the situation determination unit determines that the situation is not suitable for personal-purpose photography, the environment control unit does not perform control based on the personal-purpose photography environment setting.

[0178] (Note 11)

[0179] An image transmission system for an elevator according to any one of Supplementary Notes 5 to 10, wherein:

[0180] The image transmission system of the elevator includes a personal identification unit for identifying the user.

[0181] The environment control unit controls the environment in the car according to the personal use photography environment setting preset for the user identified by the personal identification unit.

[0182] (Note 12)

[0183] The elevator image transmission system according to any one of Supplementary Notes 5 to 11, wherein the elevator image transmission system comprises:

[0184] a learning data acquisition unit that acquires learning data, the learning data including a combination of a post-evaluation value for an image captured by the imaging device and a setting value of the personal-use photography environment setting when the image was captured; and

[0185] A model generating unit generates a learned model using the learning data acquired by the learning data acquiring unit, wherein the learned model estimates a setting value of the personal-use photography environment setting that makes a post-evaluation value of an image captured by the photography device higher.

[0186] (Note 13)

[0187] An image transmission system for an elevator according to Supplement 12, wherein:

[0188] The post-evaluation value of the image captured by the imaging device includes the satisfaction of the user himself / herself in evaluating the image or the evaluation value evaluated by a third party other than the user.

[0189] (Note 14)

[0190] An image transmission system for an elevator according to any one of Supplementary Notes 5 to 11, wherein:

[0191] The image transmission system of the elevator includes an inference unit that estimates a setting value of the personal-use photography environment setting that makes the ex post evaluation value of the image captured by the photography device higher using a learned model generated based on learning data, wherein the learning data includes a combination of the ex post evaluation value of the image captured by the photography device and the setting value of the personal-use photography environment setting when the image was captured.

[0192] The environment control section controls the environment in the car using the environment device according to the personal use photography environment setting whose setting value is estimated by the estimation section.

[0193] (Note 15)

[0194] An elevator image transmission system according to any one of Supplementary Notes 1 to 4, wherein:

[0195] The photography environment setting includes a safety photography environment setting, and the safety photography environment setting is set to be suitable for identifying the user.

[0196] (Note 16)

[0197] An image transmission system for an elevator according to Supplement 15, wherein:

[0198] The image transmission system of the elevator includes a feature determination unit for determining a feature of the user in the car based on the image captured by the imaging device.

[0199] When the feature determination unit determines that the user has suspicious features, the environment control unit controls the environment in the car according to the safety photography environment setting.

[0200] (Note 17)

[0201] A learning device that generates a learned model for estimating a setting value of the personal use photography environment setting used in the elevator image transmission system described in any one of Supplementary Notes 5 to 11, wherein:

[0202] The learning device comprises:

[0203] a learning data acquisition unit that acquires learning data, the learning data including a combination of a post-evaluation value for an image captured by the imaging device and a setting value of the personal-use photography environment setting when the image was captured; and

[0204] A model generating unit generates a learned model using the learning data acquired by the learning data acquiring unit, wherein the learned model estimates a setting value of the personal-use photography environment setting that makes a post-evaluation value of an image captured by the photography device higher.

[0205] (Note 18)

[0206] An inference device using a learned model, the learned model being generated based on learning data in a manner of estimating a setting value of the personal-use photography environment setting used in the image transmission system of an elevator as described in any one of Appendixes 5 to 11, the learning data including a combination of a post-evaluation value for an image captured by the photography device and a setting value of the personal-use photography environment setting when the image was captured,

[0207] The estimation device includes an estimation unit that estimates, using the learned model, a setting value of the personal-use photography environment setting that makes a post-evaluation value of an image captured by the photography device higher.

[0208] (Note 19)

[0209] An elevator image transmission method, wherein a computer performs the following processing:

[0210] Under normal circumstances, according to the preset normal environment settings, the environment in the car is controlled by using the environment device of the car;

[0211] While a user is riding in the car and the car door of the car is closed, the environment in the car is controlled by the environment device according to a photography environment setting different from the normal environment setting, the photography environment setting being an environment setting for photographing the person of the user; and

[0212] An image captured by a photographing device installed in the car when the environment in the car is controlled according to the photographing environment setting is transmitted to information equipment outside the elevator.

[0213] (Note 20)

[0214] An elevator image transmission program, the elevator image transmission program causing a computer to execute the following processing:

[0215] Under normal circumstances, according to the preset normal environment settings, the environment in the car is controlled by using the environment device of the car;

[0216] While a user is riding in the car and the car door of the car is closed, the environment in the car is controlled by the environment device according to a photography environment setting different from the normal environment setting, the photography environment setting being an environment setting for photographing the person of the user; and

[0217] An image captured by a photographing device installed in the car when the environment in the car is controlled according to the photographing environment setting is transmitted to information equipment outside the elevator.

Claims

1. An elevator image transmission system, wherein: The image transmission system of the elevator comprises: an environment control unit that, under normal circumstances, controls the environment in the car using an environment device of the car according to a pre-set normal environment setting, and, while a user is riding in the car and the car door of the car is closed, controls the environment in the car using the environment device according to a photographic environment setting different from the normal environment setting, the photographic environment setting being an environment setting for photographing the person of the user; and A transmitting unit transmits, to an information device outside the elevator, an image captured by a photographing device installed in the car when the environment control unit controls the environment in the car according to the photographing environment setting.

2. The elevator image transmission system according to claim 1, wherein: The environmental control unit controls a lighting device provided in the car as the environmental device.

3. The image transmission system for an elevator according to claim 1, wherein: The environmental control unit controls an air-conditioning device installed in the car as the environmental device.

4. The image transmission system for an elevator according to claim 1, wherein: The environmental control unit controls a video display device provided in the car as the environmental device.

5. The image transmission system for an elevator according to any one of claims 1 to 4, wherein: The photography environment setting includes a personal photography environment setting, wherein the personal photography environment setting is set to be suitable for the user's personal photography. The transmitting unit transmits, to the information device accessible to the user, the image captured by the photographing device when the environment control unit controls the environment in the car according to the personal-use photographing environment setting.

6. The image transmission system for an elevator according to claim 5, wherein: The image transmission system of the elevator includes a position detection unit, the position detection unit detecting the position of the user in the car, The transmitting unit transmits, to the information device, the image captured by the imaging device when the position detecting unit detects that the user is standing at a preset imaging position in the car.

7. The image transmission system for an elevator according to claim 5, wherein: The elevator image transmission system includes a situation determination unit for determining whether the user is in a situation where personal photography is to be performed based on the situation of the user using the elevator. The transmission unit transmits the image captured by the imaging device to the information device only when the situation determination unit determines that the situation is a situation where personal-use photography is to be performed.

8. The image transmission system for an elevator according to claim 7, wherein: The environment control unit performs control based on the personal-purpose photography environment setting only when the situation determination unit determines that the situation is a situation where personal-purpose photography is to be performed.

9. The image transmission system for an elevator according to claim 5, wherein: The elevator image transmission system includes a status determination unit, which determines whether the elevator is in a state that is not suitable for personal photography based on the operation state of the elevator. When the situation determination unit determines that the situation is not suitable for photography for personal use, the transmission unit does not transmit the image photographed by the photography device to the information equipment.

10. The image transmission system for an elevator according to claim 9, wherein: When the situation determination unit determines that the situation is not suitable for personal-purpose photography, the environment control unit does not perform control based on the personal-purpose photography environment setting.

11. The image transmission system for an elevator according to claim 5, wherein: The image transmission system of the elevator includes a personal identification unit for identifying the user. The environment control unit controls the environment in the car according to the personal use photography environment setting preset for the user identified by the personal identification unit.

12. The image transmission system for an elevator according to claim 5, wherein: The image transmission system of the elevator comprises: a learning data acquisition unit that acquires learning data, the learning data including a combination of a post-evaluation value for an image captured by the imaging device and a setting value of the personal-use photography environment setting when the image was captured; as well as A model generating unit generates a learned model using the learning data acquired by the learning data acquiring unit, wherein the learned model estimates a setting value of the personal-use photography environment setting that makes a post-evaluation value of an image captured by the photography device higher.

13. The image transmission system for an elevator according to claim 12, wherein: The post-evaluation value of the image captured by the imaging device includes the satisfaction of the user himself / herself in evaluating the image or the evaluation value evaluated by a third party other than the user.

14. The image transmission system for an elevator according to claim 5, wherein: The image transmission system of the elevator includes an inference unit that estimates a setting value of the personal-use photography environment setting that makes the ex post evaluation value of the image captured by the photography device higher using a learned model generated based on learning data, wherein the learning data includes a combination of the ex post evaluation value of the image captured by the photography device and the setting value of the personal-use photography environment setting when the image was captured. The environment control section controls the environment in the car using the environment device according to the personal use photography environment setting whose setting value is estimated by the estimation section.

15. The image transmission system for an elevator according to any one of claims 1 to 4, wherein: The photography environment setting includes a safety photography environment setting, and the safety photography environment setting is set to be suitable for identifying the user.

16. The image transmission system for an elevator according to claim 15, wherein: The image transmission system of the elevator includes a feature determination unit for determining a feature of the user in the car based on the image captured by the imaging device. When the feature determination unit determines that the user has suspicious features, the environment control unit controls the environment in the car according to the safety photography environment setting.

17. A learning device for generating a learned model for estimating the setting value of the personal use photography environment setting used in the elevator image transmission system according to claim 5, wherein: The learning device comprises: a learning data acquisition unit that acquires learning data, the learning data including a combination of a post-evaluation value for an image captured by the imaging device and a setting value of the personal-use photography environment setting when the image was captured; as well as A model generating unit generates a learned model using the learning data acquired by the learning data acquiring unit, wherein the learned model estimates a setting value of the personal-use photography environment setting that makes a post-evaluation value of an image captured by the photography device higher.

18. An inference device using a learned model, the learned model being generated based on learning data in a manner of estimating a setting value of the personal-use photography environment setting used in the image transmission system of the elevator according to claim 5, the learning data including a combination of a post-evaluation value for an image captured by the photography device and a setting value of the personal-use photography environment setting when the image was captured, The estimation device includes an estimation unit that estimates, using the learned model, a setting value of the personal-use photography environment setting that makes a post-evaluation value of an image captured by the photography device higher.

19. A method for sending an image of an elevator, wherein: The computer performs the following processing: Under normal circumstances, according to the preset normal environment settings, the environment in the car is controlled by using the environment device of the car; While a user is riding in the car and the car door of the car is closed, the environment in the car is controlled by the environment device according to a photography environment setting different from the normal environment setting, the photography environment setting being an environment setting for photographing the person of the user; and An image captured by a photographing device installed in the car when the environment in the car is controlled according to the photographing environment setting is transmitted to information equipment outside the elevator.

20. An elevator image transmission program, the elevator image transmission program causing a computer to execute the following processing: Under normal circumstances, according to the preset normal environment settings, the environment in the car is controlled by using the environment device of the car; While a user is riding in the car and the car door of the car is closed, the environment in the car is controlled by the environment device according to a photography environment setting different from the normal environment setting, the photography environment setting being an environment setting for photographing the person of the user; and An image captured by a photographing device installed in the car when the environment in the car is controlled according to the photographing environment setting is transmitted to information equipment outside the elevator.

Images