Elevator control system and control method

Abstract

The image processing device (6) calculates the congestion information of passengers in the elevator car (1) based on the image captured by the camera device (4). When the calculated congestion information is below a threshold, the image processing device (6) sends a command to the control device (2) to set the operation mode of the elevator to the first operation mode, and when the calculated congestion information exceeds the threshold, the image processing device (6) sends a command to the control device (2) to set the operation mode to the second operation mode. The display unit (20) displays the congestion information and the operation mode together with the image.

Description

Technical Field

[0001] The invention relates to an elevator control system and a control method. Background Art

[0002] In the conventional elevator control system, a camera is installed in the elevator car, and the congestion information of passengers in the car is calculated based on the images taken by the camera. In such a system, the operation of the elevator is optimized by changing the elevator settings such as changing the operation mode of the elevator according to the calculated congestion information.

[0003] For example, Japanese Patent Publication No. 2019-85253 (Patent Document 1) describes an elevator control system that calculates the occupied area of ​​a passenger in a car based on an image captured by a camera installed in the car. In this elevator control system, when the remaining area obtained by subtracting the occupied area from the floor area of ​​the car is less than a threshold, the movement of the car is controlled so that it does not respond to elevator calls from the landing station.

[0004] In such a system, when calculating congestion information by analyzing images captured by a camera, congestion information may not be correctly calculated due to misrecognition or misjudgment depending on the shooting state. In addition, different elevator users and building owners have different preferences and requirements on how to change the operation of the elevator under different congestion conditions.

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Publication No. 2019-85253 Summary of the invention

[0008] Problems to be solved by the invention

[0009] In order to solve the above-mentioned problems, it is necessary to change the settings of the elevators according to the use of the elevators on site and the preferences and requirements of the building owners, etc. In addition, in the case where it is expected that misidentification or misjudgment is likely to occur, it is necessary to temporarily stop the elevator system and change the settings of the elevators after confirming the situation.

[0010] When changing the elevator settings in these scenarios, it is necessary to make a comprehensive judgment after confirming the time lapse of various information such as the elevator's operating status, the image captured by the camera, and the congestion information. To do this, it is necessary to find out the various data generated at the time of capturing the image, interpret these data, and conduct comparative studies. However, such operations require professional knowledge, and even maintenance personnel with professional knowledge still need time and labor.

[0011] The present invention has been made to solve such a problem, and an object of the present invention is to provide an elevator control system and a control method capable of easily grasping the congestion condition of passengers in a car required for adjusting the setting of the elevator.

[0012] Means for solving problems

[0013] The control system of the elevator of the present invention comprises a control device, a camera device, an image processing device and a display unit. The control device controls the elevator. The camera device is arranged in the elevator car. The image processing device communicates with the control device and the camera device. The image processing device calculates the congestion information of the passengers in the car based on the image captured by the camera device. When the calculated congestion information is below a threshold value, the image processing device sends a command to the control device to set the operation mode of the elevator to the first operation mode, and when the calculated congestion information exceeds the threshold value, the image processing device sends a command to the control device to set the operation mode to the second operation mode. The display unit displays the congestion information and the operation mode together with the image.

[0014] The control method of the present invention is a method for controlling an elevator control system. The elevator control system comprises: a control device that controls the elevator; a camera device that is disposed in the elevator car; an image processing device that communicates with the control device and the camera device; and a display unit that performs display. The control method comprises the following steps: calculating the congestion information of passengers in the car based on the image captured by the camera device; when the calculated congestion information is below a threshold, sending an instruction to the control device to set the operation mode of the elevator to the first operation mode; when the calculated congestion information exceeds the threshold, sending an instruction to the control device to set the operation mode to the second operation mode; and causing the display unit to display the congestion information and the operation mode together with the image.

[0015] Effects of the Invention

[0016] According to the present invention, it is possible to easily grasp the congestion condition of passengers in the car which is necessary for adjusting the setting of the elevator. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 This is a diagram showing an example of a functional block diagram of an elevator control system.

[0018] Figure 2 It is a diagram showing a display example of a synthesized image.

[0019] Figure 3 This is a flowchart of the main process executed by the image processing device.

[0020] Figure 4 This is a diagram for explaining the relationship between the cage room size and the congestion degree.

[0021] Figure 5 This is a diagram for explaining the relationship between the cage room size and the congestion degree.

[0022] Figure 6 This is a diagram for explaining an example in which the congestion degree shows an abnormal value.

[0023] Figure 7 is a diagram used to illustrate user permissions.

[0024] Figure 8 This is a flowchart of the display processing executed by the terminal device.

[0025] Fig. 9 This is a flowchart of the change processing executed by the terminal device. DETAILED DESCRIPTION

[0026] Hereinafter, the implementation mode will be described with reference to the accompanying drawings. In the following description, the same reference numerals are used for the same components. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated.

[0027] First, the elevator control system 100 according to the present embodiment will be described. Figure 1 This is a diagram showing an example of a functional block diagram of the elevator control system 100 .

[0028] The elevator control system 100 includes a car 1, a control device 2, a car display unit 3, a camera device 4, a landing display unit 5, an image processing device 6, a terminal device 8, and a server device 9. The terminal device 8 has a display unit 20. The car display unit 3, the landing display unit 5, and the display unit 20 are, for example, displays.

[0029] The control device 2 controls the elevator. The control device 2 is installed in a machine room of a building, for example. The control device 2 communicates with a car display unit 3 installed in the car 1, a landing display unit 5 installed in the landing of the car 1, and an image processing device 6. The image processing device 6 communicates with a camera 4 installed in the car 1 of the elevator. The image processing device 6 is installed on the car 1, for example.

[0030] The server device 9 communicates with the image processing device 6. The terminal device 8 communicates with the server device 9. The server device 9, the image processing device 6, and the terminal device 8 can communicate using an Internet line or a telephone line. The terminal device 8 can be a personal computer, a smart phone, or a tablet terminal. The server device 9 and the terminal device 8 can be installed in a building where an elevator is installed, or in a building outside the building.

[0031] The video processing device 6 includes an external communication unit 6a, a storage unit 6b, an operation mode change instruction unit 6c, a video output unit 6d, a memory 6e, an image analysis unit 6f, a synthesis processing unit 6g, and a display control unit 6h.

[0032] The image processing device 6 includes a CPU (Central Processing Unit) for controlling the entire image processing device 6. The CPU executes a program stored in the storage unit 6b to realize the processing performed by the image analysis unit 6f, the synthesis processing unit 6g, and the like.

[0033] The memory 6e is a work area when executing a program, temporarily storing the program and data when executing the program, etc. The storage unit 6b is a non-volatile storage device. For example, a ROM (Read Only Memory) and a HDD (Hard Disk Drive) may be provided as the storage unit 6b.

[0034] The following is an overview of the processing performed by the elevator control system 100. Figure 3 The external communication unit 6a obtains the image captured by the camera 4. The image analysis unit 6f analyzes the obtained image and calculates the degree of congestion of passengers in the car 1. The operation mode change instruction unit 6c instructs the control device 2 to change the operation mode of the elevator according to the calculated degree of congestion. The synthesis processing unit 6g synthesizes various information such as the degree of congestion into the image to generate a synthesized image.

[0035] The image output unit 6d outputs the composite image to the car display unit 3 and the landing display unit 5. The display control unit 6h controls the display of the car display unit 3 and the landing display unit 5. In addition, in order to protect privacy, when generating the composite image, the parts and faces of the people reflected can also be mosaiced. Figure 2 The details of various information such as the composite image and congestion degree are described.

[0036] The external communication unit 6a sends the composite image to the server device 9. The server device 9 stores the received composite image. The terminal device 8 can obtain the composite image by making a request to the server device 9 and display the composite image on the display unit 20. In addition, the terminal device 8 can make a request to the server device 9 to change the elevator settings. Figure 7 to Figure 9 The following describes in detail the communication between the server device 9 and the terminal device 8 and the change of the elevator settings.

[0037] Figure 2 FIG. 4 is a diagram showing an example of displaying a composite image. Figure 2As shown, the screen 10a shows an image of the interior of the car 1 captured by the camera 4. The screen 10a is a screen displayed on the car display unit 3, the landing display unit 5 or the display unit 20 of the terminal device 8. Three passengers 61 are riding in the car 1. In addition, the entrance 51 of the car is in a closed state (closed door state).

[0038] In the screen 10a, various information is displayed together with the image in the car 1. On the left side of the screen 10a, the degree of congestion, the congestion index, and the ventilation status are displayed from top to bottom. In addition, on the right side of the screen 10a, the operation mode and the analysis sensitivity are displayed from top to bottom. The image obtained by synthesizing the above information with the image in the car 1 is called a "synthesized image".

[0039] The screen 10a shows that the congestion degree is "30%", the congestion index is "Level 2" of three levels, the ventilation state is "Excellent", the operation mode is "Normal Operation", and the analysis sensitivity is "High". Each information is described below.

[0040] The "crowding degree" indicates the degree of crowding of passengers in the car 1 and is represented by a numerical value of 0 to 100%. The crowding degree of this embodiment is the ratio of the number of passengers in the car 1 to the rated number of passengers in the car 1. For example, when the car 1 has 15 passengers (rated number of passengers is 15) and the number of passengers is 4, the crowding degree is 27% (= 4 / 15) (refer to Figures 4 to 6 ).

[0041] For example, the number of passengers is calculated based on the image in the car 1 captured by the camera 4 and the reference image (refer to Figure 6 ). The reference image is an image of a state in which there are no passengers in the car 1. When there are passengers in the car 1, the area where people exist can be extracted by taking the difference with the reference image. The number of passengers can be calculated based on the area where people exist.

[0042] In addition, the "exclusive area ratio" (0 to 100%) may be displayed instead of the "congestion degree". The exclusive area ratio of the present embodiment is the ratio of the area of ​​objects present in the car 1 to the floor area of ​​the car 1. Objects present in the car 1 also include objects other than passengers (cargo, trolleys, wheelchairs, etc.). The area of ​​the object can be calculated by taking the difference with the reference image. Such congestion degree or exclusive area ratio can be calculated using known techniques.

[0043] The "congestion index" is expressed using a scale of 0 to 3. Each level is expressed by the number of black squares. If it is level 2, two black squares are displayed. For example, level 0 = congestion 0%, level 3 = congestion 100%, and level 1 and level 2 are set to the range between them for display. In addition, the congestion index can also be expressed using indicators other than congestion (such as exclusive area ratio).

[0044] "Ventilation" indicates the ventilation status in the car 1 in three levels. For example, a sensor is used to detect the degree of air circulation in the car 1, and the status is indicated in the order of "good (excellent)", "average", and "bad (poor)" from good to bad. Based on this display, maintenance personnel can determine whether to operate the fan installed in the car 1 to improve the ventilation status.

[0045] "Operation mode" means the operation mode of the elevator. In the present embodiment, the operation mode includes "normal operation (also referred to as "normal operation mode")", "full-pass operation (also referred to as "full-pass operation mode")" and "forced stop operation on each floor (also referred to as "forced stop operation mode on each floor")".

[0046] The control device 2 can receive a landing call from each of the multiple floors where the car 1 can stop, and make the car 1 respond to the landing call. Normal operation is a mode in which the car 1 can respond to the landing call from any of the multiple floors. Full-pass operation is a mode in which the car 1 does not respond to the landing call from any of the multiple floors.

[0047] For example, suppose that a car call for the 5th floor (destination floor) is registered in car 1, and car 1 is traveling in the upward direction (also called "upward direction") from the 2nd floor. At this time, a landing call for the upward direction is registered at the landing on the 4th floor. If the operation mode is normal operation, car 1 can stop at the 4th floor in response to the landing call. On the other hand, if the operation mode is full-pass operation, car 1 recognizes that car 1 is full and does not respond to the landing call and stops at the 4th floor.

[0048] In this embodiment, the control device 2 switches the operation mode to either normal operation or full-pass operation according to the degree of congestion in the car 1. Specifically, when the degree of congestion in the car 1 is greater than the full-pass threshold (also referred to as "threshold"), the control device 2 switches the operation mode to the full-pass operation (see Figure 3 to Figure 5 ). In addition, the above switching can be performed when the exclusive area ratio exceeds a predetermined threshold value, or when the weight detected by a weighing device installed in the car 1 exceeds a predetermined threshold value.

[0049] The forced stop operation at each floor is a mode in which the car 1 stops at all floors regardless of whether there is a car call. The car 1 performs the forced stop operation at each floor according to a command from the control device 2. A maintenance person or the like can instruct the control device 2 to perform the forced stop operation at each floor.

[0050] "Analysis sensitivity" indicates the analysis sensitivity related to the difference between the acquired image and the reference image in the calculation (model used for calculation) for calculating the above-mentioned congestion degree and exclusive area ratio. Analysis sensitivity indicates the sensitivity set in descending order of "high", "medium", and "low". When the analysis sensitivity is set to high, the difference of the image is detected with high sensitivity. Details will be used later. Figure 6 It is described that in this case, for example, a protective sheet or the like pasted on the wall surface may be mistakenly detected as a passenger. In such a case, maintenance personnel or the like need to take measures such as reducing the analysis sensitivity (setting change).

[0051] Although not displayed on the screen, the elevator has a "full-passing function" as a function of the elevator. Maintenance personnel and the like can use the terminal device 8 to set the full-passing function to the control device 2. When the full-passing function is set to ON, as described above, when the congestion exceeds the threshold, the normal operation is switched to the full-passing operation. On the other hand, when the full-passing function is set to OFF, normal operation is always performed even when the congestion exceeds the threshold. Therefore, in the case of a false detection as described above, in addition to reducing the analysis sensitivity, a countermeasure of turning off the full-passing function can also be taken.

[0052] In addition, multiple elevators may be provided in a building. In this case, a camera device is provided for each elevator, and it is determined for each elevator whether to change the operation mode. In addition, a composite image corresponding to the elevator is displayed on the display unit in the elevator car provided for each elevator car. The composite image of all elevator cars can be displayed on the display unit 20 of the floor display unit 5 and the terminal device 8. In the event of a floor call, any one of the multiple elevators is assigned, and the assigned elevator responds to the floor call. One of the multiple elevators in normal operation is selected and assigned a floor call. A floor call is not assigned to an elevator car that is in full-load operation.

[0053] Figure 3 This is a flowchart of the main process executed by the image processing device 6. The main process is a series of processes executed by the external communication unit 6a, the image analysis unit 6f, the operation mode change instruction unit 6c, and the synthesis processing unit 6g of the image processing device 6 described above.

[0054] The main process executed by the image processing device 6 can be started, for example, when the image processing device 6 is powered on. Hereinafter, a "step" is also simply referred to as "S".

[0055] like Figure 4 As shown in FIG. 1 , when the main process starts, the external communication unit 6a obtains the image of the camera device 4, and in S1, the image analysis unit 6f determines whether the image analysis condition is satisfied. When the image analysis unit 6f determines that the image analysis condition is satisfied (“Yes” in S1), the process proceeds to S2. On the other hand, when the image analysis unit 6f does not determine that the image analysis condition is satisfied (“No” in S1), the process proceeds to S1. That is, the process proceeds to S2 after waiting for the image analysis condition to be satisfied.

[0056] The image analysis condition is satisfied, for example, when the car 1 changes from an open door state to a closed door state. Whether the car door is open or closed is determined by receiving a signal indicating the open or closed state of the car door from the control device 2 and based on the signal.

[0057] After S2, the image processing device 6 calculates the degree of congestion of passengers in the car 1 based on the image captured by the camera device 4, and switches the operation mode of the elevator based on the calculated degree of congestion. The number of passengers in the car 1 is determined at the stage when the door of the car 1 is closed (the moment when the door is closed). Therefore, in this embodiment, the image processing device 6 calculates the degree of congestion at this moment and makes a judgment on the switching of the operation mode. In addition, the image analysis condition may also be established at the moment when the door starts to close.

[0058] In S2, the image analysis unit 6f calculates the congestion information of the passengers in the car 1 based on the image captured by the camera 4, and the process proceeds to S3. Here, in this embodiment, the "congestion information" is the above-mentioned "congestion degree". In addition, the "congestion information" may also be the above-mentioned "exclusive area ratio".

[0059] In S3, the operation mode change instruction unit 6c determines whether the calculated congestion degree exceeds the threshold value. When the operation mode change instruction unit 6c determines that the calculated congestion degree exceeds the threshold value ("Yes" in S3), the process proceeds to S4. On the other hand, when the operation mode change instruction unit 6c determines that the calculated congestion degree is less than the threshold value ("No" in S3), the process proceeds to S5.

[0060] In S4, the operation mode change instruction unit 6c sends a command to the control device 2 to set the elevator operation mode to normal operation, and the process proceeds to S6. In S5, the operation mode change instruction unit 6c sends a command to the control device 2 to set the elevator operation mode to full-load operation, and the process proceeds to S6.

[0061] That is, when the calculated congestion information is below the threshold, the operation mode change instruction unit 6c of the image processing device 6 sends a command to the control device 2 to set the operation mode of the elevator to normal operation, and when the calculated congestion information exceeds the threshold, the operation mode change instruction unit 6c sends a command to the control device 2 to set the operation mode to full-load operation. In addition, the operation mode change instruction unit 6c may send a command to change the operation mode to the control device 2 only when the operation mode changes.

[0062] In S7, the synthesis processing unit 6g determines whether it is the collection mode. When the synthesis processing unit 6g determines that it is the collection mode ("Yes" in S7), the processing proceeds to S8. On the other hand, when the synthesis processing unit 6g does not determine that it is the collection mode ("No" in S7), the processing returns to S1.

[0063] Here, the collection mode is set in response to a request from the terminal device 8. A maintenance worker or a building owner (building manager) sets the collection mode by operating the terminal device 8. By setting the collection mode, a synthetic image can be generated and sent to the server device 9 (S9).

[0064] In S8, the synthesis processing unit 6g determines whether there is a change in the operation mode (from normal operation to full-load operation, or from full-load operation to normal operation). When the synthesis processing unit 6g determines that there is a change in the operation mode ("Yes" in S8), the processing proceeds to S9. On the other hand, when the synthesis processing unit 6g does not determine that there is a change in the operation mode ("No" in S8), the processing returns to S1.

[0065] In the present embodiment, when there is a change in the operation mode, it is possible to generate a synthetic image and send it to the server device 9 (S9). Thus, it is possible to confirm the synthetic image when there is a change in the operation mode. In addition, it is also possible to configure that when the congestion level is greater than a specified value, it is possible to generate a synthetic image and send it to the server device 9 (S9).

[0066] In S9, the synthesis processing unit 6g generates synthesis data. Then, the external communication unit 6a transmits the generated synthesis data to the server device 9, and the process returns to S1.

[0067] Specifically, the synthesis processing unit 6g superimposes information including the degree of congestion and the operation mode as congestion information on the image of the imaging device 4 to generate a synthesized image (see Figure 2 ). The operation mode is the mode set in S4 and S5. The external communication unit 6a transmits the generated composite image to the server device 9. Alternatively, instead of generating a composite image, the image, the degree of congestion, and the operation mode information may be transmitted separately.

[0068] Thus, when there is a request from the user and the operation mode is switched, the synthesis processing unit 6g of the image processing device 6 generates a synthesized image including the congestion information and the operation mode in the image. Then, the external communication unit 6a sends the synthesized image as display information including the image, congestion information and the operation mode to the server device 9.

[0069] In addition, without limitation to the above, the synthesized image may be generated unconditionally, may be generated only when there is a request from the server device 9 or the terminal device 8, or may be generated when the congestion level becomes greater than a predetermined value. In addition, the generated synthesized image may be sent unconditionally, may be sent only when there is a request from the server device 9 or the terminal device 8, or may be sent when the congestion level becomes greater than a predetermined value.

[0070] Figure 4 , Figure 5 This is a diagram for explaining the relationship between the size of the elevator car and the degree of congestion. In this embodiment, it is assumed that the elevator car 1 can accommodate 15 people (the rated capacity is 15 people). Figure 4 , the relationship between the number of passengers and the degree of congestion is shown together with the image inside the car 1.

[0071] like Figure 4 As shown, when there is one person in the elevator, the congestion level is 7%. In the image in the car 1, there is one passenger 62, and the entrance 52 is in the state of door opening (open door state). In this embodiment, the congestion level is calculated based on the number of passengers in the car 1. Congestion level = number of passengers / rated number of passengers = 1 / 15 = 7%.

[0072] When there are 4 passengers, the congestion is 27% (= 4 / 15). In the image inside the car 1, there are 4 passengers 62, and the door 52 is open. When there are 7 passengers, the congestion is 47% (= 7 / 15). In the image inside the car 1, there are 7 passengers 62, and the door 52 is open. When there are 12 passengers, the congestion is 80% (= 12 / 15). In the image inside the car 1, there are 12 passengers 62, and the door 52 is open.

[0073] In this embodiment, the full-pass threshold is set to 30%. In this example, when the crowding degree is 7% (the number of passengers is one person) and when the crowding degree is 27% (the number of passengers is 4 people), the car 1 does not pass the full-pass (performs normal operation). On the other hand, when the crowding degree is 47% (the number of passengers is 7 people) and when the crowding degree is 80% (the number of passengers is 12 people), the car 1 passes the full-pass (performs the full-pass operation).

[0074] The full occupancy threshold can be set and changed arbitrarily. For example, in recent years, in order to prevent the spread of coronavirus infection, it is expected that passengers will keep a certain distance as much as possible when riding the elevator so that passengers are not crowded together. Figure 4 As shown in the figure, when four people are on board, the passengers are not crowded, but if the user or the building owner feels that the number of people is crowded when the number of people exceeds five, it is appropriate to set the full-occupancy threshold to 30%. Alternatively, depending on the purpose of the building or apartment, there may be a case where passengers are not allowed to ride together as much as possible, so the full-occupancy threshold can be changed while viewing the screen in a form that meets the needs of the building owner, etc.

[0075] on the other hand, Figure 5 An example is shown in which 9 people are seated in the car 1 (the rated capacity is 9 people). Figure 5 In FIG. 1 , the relationship between the number of passengers and the degree of congestion is shown together with the image inside the elevator car 1. Figure 5 As shown, when there is one person in the elevator, the congestion is 11% (= 1 / 9). In the image inside the car 1, there is one passenger 62 on board, and the door 52 is open. When there are three people in the elevator, the congestion is 33% (= 3 / 9). In the image inside the car 1, there are three passengers 62 on board, and the door 52 is open.

[0076] When the number of passengers is 5, the congestion is 56% (= 5 / 9). In the image inside the car 1, there are 5 passengers 62, and the door 52 is open. When the number of passengers is 8, the congestion is 89% (= 8 / 9). In the image inside the car 1, there are 8 passengers 62, and the door 52 is open.

[0077] In this example, the threshold value for full-pass is set to 95%. In any of the cases where the congestion level is 11% (one person on the elevator), 33% (three people on the elevator), 56% (five people on the elevator), and 89% (eight people on the elevator), full-pass is not performed. When the number of people on the elevator becomes 9, the congestion level becomes 100% (=9 / 9), and full-pass is performed.

[0078] and Figure 4 Compared with the example in Figure 5 In the example, the quota is smaller. Figure 4 In the case where the full-pass threshold is lowered and the frequency of full-pass is increased as in the example of , the waiting time at the landing station increases (transportation efficiency decreases). In the case where the number of cars is small or the waiting time is long due to a small number of rated passengers, by Figure 5By setting the full-pass threshold to a higher value as in the example of , the transportation efficiency can be improved. In this way, the full-pass threshold can be set according to various needs such as the installation status of the elevator and the intention of the building owner. When the composite image is displayed, the status and congestion level in the car 1 can be compared, and the full-pass threshold as the setting value of the elevator can be appropriately changed.

[0079] Figure 6 : is a diagram for explaining an example in which the congestion degree shows an abnormal value. Figure 6 As shown, in the reference image, the number of passengers is 0 and the doorway 52 is open. In this case, the congestion level is 0%. As described above, the congestion level is calculated based on the difference between the image captured by the camera 4 and the reference image.

[0080] When there are passengers in the car 1, the area where the passengers are located is detected as the difference between the reference image and the reference image. Figure 4 , Figure 5 As described in , the congestion degree increases. Then, when the congestion degree exceeds the full-pass threshold value, the car 1 passes the full-pass.

[0081] On the other hand, Figure 6 In the example, the protective sheet 71 is pasted in the car 1. For example, it is assumed that when a moving company transports moving goods, the protective sheet 71 is pasted so as not to damage the inside of the car 1.

[0082] In abnormal case 1 (ground change), a maintenance sheet 71 is attached to the floor of the car 1. In this case, the portion of the maintenance sheet 71 attached to the floor may become a difference with the reference image. Due to this difference, there is a case where it is mistakenly detected that there are passengers. In this example, although there are no passengers, an abnormal value such as a congestion degree of 50% is detected.

[0083] In abnormal case 2 (floor / wall change), a protective sheet 71 is attached to the floor and wall of the car 1. In this case, the portion of the protective sheet 71 attached to the floor and wall may become a difference from the reference image. In this example, an abnormal value such as a congestion degree of 100% is detected even though there are no passengers.

[0084] For example, in Figure 4 When the full-pass threshold is set to 30% as in the example, full-pass occurs even if the protective sheet 71 is only attached to the floor of the car 1. In this case, even if there is no one riding in the car 1, the car 1 does not respond at all even if a landing call occurs at the landing.

[0085] On the other hand, there are cases where the maintenance sheet 71 is not mistakenly detected as a passenger, such as when the color of the maintenance sheet 71 is close to the color of the floor or wall of the car. In addition, due to natural changes in external lighting, minor image changes such as posters being pasted or dirt on the lens of the camera 4, there are cases where false detection occurs and cases where false detection does not occur.

[0086] In addition, in the case where the lens of the camera 4 or the dirt on the wall gradually changes over time, abnormal detection can be prevented by regularly updating the reference image. However, for sudden changes such as sticking a maintenance sheet when moving, the possibility of false detection increases. In addition, as a sudden change, it is also conceivable that an object collides with the camera 4 and causes the shooting direction to shift, resulting in abnormal detection of congestion.

[0087] As described above, in the model for calculating the congestion degree, the analysis sensitivity indicates the sensitivity related to the difference between the acquired image and the reference image. For example, when the analysis sensitivity is set to "high", the difference with the reference image may react too sensitively and cause false detection.

[0088] On the other hand, if the analysis sensitivity is changed to "medium" or "low", the above-mentioned erroneous detection can be prevented. When the synthetic image is displayed, the actual situation and congestion level in the car 1 can be compared, and the analysis sensitivity can be appropriately changed according to the actual situation.

[0089] In addition, in this embodiment, "analysis sensitivity" is exemplified as a parameter that can be changed in the model for calculating the congestion degree. However, this is not limited to this. The parameters that can be changed in this model can be, for example, parameters that can be adjusted to improve the detection sensitivity of people, or parameters that can be adjusted to improve the detection sensitivity of objects other than people. These parameters can be adjusted according to the user's preferences. In addition, the system can also be configured in a way that allows the system to learn these parameters according to the actual detection conditions on site.

[0090] Next, the user authority set in the server device 9 will be described. Figure 7 is a diagram used to illustrate user permissions. In this example, Figure 7 As shown in FIG. 1 , three terminal devices 8 are connected to the server device 9 . Each terminal device 8 can access the server device 9 .

[0091] In this embodiment, in order to access the server device 9, a user with user authority needs to log in to the server device 9. A user ID and a password are stored in the server device 9. The user ID is associated with the user authority. The requests that can be made to the server device 9 are different depending on the user authority.

[0092] User rights include user rights A, user rights B, and user rights C. User rights A are rights that elevator maintenance personnel can have. User rights B are rights that building owners (or building managers) can have. User rights C are rights that ordinary users can have. Ordinary users refer to users other than maintenance personnel, building owners, and managers, such as building residents.

[0093] A person with user authority A or user authority B can request a setting change of the elevator to the server device 9. Specifically, a person with user authority A or user authority B can request a switch of the operation mode to the server device 9. On the other hand, a person with user authority C can request a setting change of the elevator to the server device 9.

[0094] In addition, as a setting of the elevator, a person having user authority A or user authority B can request a change in analysis sensitivity to the server device 9. Alternatively, a person having user authority A can request a change in analysis sensitivity, but a person having user authority B cannot request a change in analysis sensitivity. In this way, the requests that can be made to the server device 9 differ depending on the user authority.

[0095] When a change in the setting of the elevator is requested to the server device 9, the request can be notified to the control device 2 via the image processing device 6. For example, when a change in the setting of the full-pass function is requested, the control device 2 changes the setting of the full-pass function according to the request. When a change in the analysis sensitivity is requested, the image processing device 6 changes the setting of the analysis sensitivity according to the request.

[0096] The above-mentioned "elevator settings" are not limited to settings for directly controlling the elevator, but also include settings for indirectly controlling the elevator. For example, sometimes the operation mode of the elevator is changed from "full-load passing operation" to "normal operation" by adjusting the "analysis sensitivity". Therefore, it can be said that "analysis sensitivity" is a setting for indirectly controlling the elevator.

[0097] In addition, the “elevator settings” include “full-pass threshold value”, “full-pass function”, etc. In addition, the operation settings of the fan installed in the car 1 in order to change the ventilation state in the car 1 are also included.

[0098] When a person having user authority A to C requests the server device 9 to transmit an image, the server device 9 transmits display information including the image, congestion information, and operation mode to the terminal device 8 .

[0099] In this embodiment, the server device 9 transmits the above-mentioned composite image as display information to the terminal device 8. However, the present invention is not limited thereto, and various information including images, congestion information, and operation modes may be transmitted to the terminal device 8. The terminal device 8 may generate a composite image based on various information.

[0100] Furthermore, the terminal device 8 can request a composite image by specifying an arbitrary period and time or an arbitrary condition, such as requesting a composite image of the most recent predetermined period or requesting only composite images when the congestion degree is equal to or greater than a predetermined value.

[0101] If used Figure 2 As described above, the terminal device 8 displays a composite image (displays congestion information and operation mode, etc. together with the image) on the display unit 20. At this time, the display unit 20 of the terminal device 8 of the maintenance personnel having user authority A displays the screen 10b. On the screen 10b, a message 81 indicating that the operation mode can be changed is displayed together with the composite image.

[0102] On the screen, “The elevator settings can be changed. Please check the congestion situation and degree of congestion in the camera image” is displayed as a message 81. In addition, the display unit 20 of the terminal device 8 of the owner having the user authority B also displays the screen 10b.

[0103] On the other hand, the screen 10 c is displayed on the display unit 20 of the terminal device 8 of the general user having the user authority C. Although the synthesized image is displayed on the screen 10 c , the message 81 is not displayed.

[0104] In addition, even a general user with user authority C may be able to change some of the elevator settings. In this case, the message 81 is also displayed on the display unit 20 of the terminal device 8. In addition, the terminal device 8 used by the general user with user authority C may be a smartphone. In this case, even without viewing the in-car display unit 3 and the landing display unit 5, the synthesized image can be confirmed using the smartphone.

[0105] The following is an explanation based on the flow chart. Figure 8 2 is a flowchart of a display process executed by the terminal device 8. The display process may be started when the terminal device 8 logs in to the server device 9, for example.

[0106] When the display process starts, in S11, the terminal device 8 sends a request for a synthesized image (display information) to the server device 9, and the process proceeds to S12. The server device 9 sends the synthesized image to the terminal device 8 in response to the request from the terminal device 8. In S12, the terminal device 8 obtains the synthesized image from the server device 9, and the process proceeds to S13.

[0107] In S13, the terminal device 8 determines whether the server device 9 is accessed by the authority A or the authority B. If the terminal device 8 determines that the server device 9 is accessed by the authority A or the authority B ("Yes" in S13), the process proceeds to S14. On the other hand, if the terminal device 8 does not determine that the server device 9 is accessed by the authority A or the authority B ("No" in S13), the process proceeds to S15.

[0108] In S14, the display unit 20 of the terminal device 8 displays a message 81 indicating that the setting of the elevator can be changed together with the synthesized image (display information). In S15, the display unit 20 of the terminal device 8 displays the synthesized image instead of the message 81.

[0109] Fig. 9 This is a flowchart of the change process executed by the terminal device 8. For example, the change process may be activated when there is an input from an input device connected to the terminal device 8.

[0110] When the change process starts, in S21, the terminal device 8 determines whether the server device 9 is accessed by the authority A or the authority B. If the terminal device 8 determines that the server device 9 is accessed by the authority A or the authority B ("Yes" in S21), the process proceeds to S22. On the other hand, if the terminal device 8 does not determine that the server device 9 is accessed by the authority A or the authority B ("No" in S21), the change process ends.

[0111] In S22, the terminal device 8 determines whether there is an analysis sensitivity change request. When the terminal device 8 determines that there is an analysis sensitivity change request ("Yes" in S22), the process proceeds to S23. On the other hand, when the terminal device 8 does not determine that there is an analysis sensitivity change request ("No" in S22), the process proceeds to S24.

[0112] A user with authority A or authority B can make a change setting of the analysis sensitivity (a request to change the analysis sensitivity) from an input device connected to the terminal device 8. Figure 6 When the congestion degree as shown in becomes an abnormal value, the analysis sensitivity is lowered so that the protection sheet 71 is not determined as a passenger.

[0113] In S23, the terminal device 8 instructs the server device 9 to change to the set analysis sensitivity. As a result, the server device 9 instructs the image processing device 6 to change the analysis sensitivity. The image processing device 6 changes the analysis sensitivity to the instructed analysis sensitivity.

[0114] In S24, the terminal device 8 determines whether there is a setting change request for the full-pass function. If the terminal device 8 determines that there is a setting change request for the full-pass function ("Yes" in S24), the process proceeds to S25. On the other hand, if the terminal device 8 does not determine that there is a setting change request for the full-pass function ("No" in S24), the change process ends.

[0115] A user with authority A or authority B can set whether to turn on or off the full-pass function (setting change request for the full-pass function) from an input device connected to the terminal device 8. Figure 6 When the congestion degree as shown in becomes an abnormal value, the full-pass function is turned off to prevent the abnormal occurrence of a full-pass inconvenience.

[0116] In S25, the terminal device 8 instructs the server device 9 to change the setting of the full-pass function. The server device 9 instructs the control device 2 to change the setting of the full-pass function. The control device 2 changes the setting of the full-pass function to the instructed setting. That is, the control device 2 sets the full-pass function to on or off according to the user's instruction.

[0117] In this way, the image processing device 6 or the control device 2 changes the setting of the elevator according to the request from the terminal device 8. The image processing device 6 or the control device 2 can change the setting of the elevator according to the request from the user with the authority A, B, but on the other hand, it does not change the setting of the elevator according to the request from the user with the authority C.

[0118] As described above, in this embodiment, the display unit 20 displays the congestion information and the operation mode as a composite image together with the image captured by the camera 4, so that the congestion condition of the passengers in the car 4 required for adjusting the setting of the elevator can be easily grasped. Thus, the user such as the maintenance personnel operating the terminal device 8 can study how to change the setting of the elevator while observing the composite screen.

[0119] For example, if you use Figure 4 , Figure 5 As described above, the full-pass threshold can be adjusted to a lower level while observing the composite image to avoid crowding of passengers in the car 1, or the full-pass threshold can be adjusted to a higher level in consideration of the elevator's rated capacity. Figure 6 As shown, when a sudden change occurs in the car 1, such as the maintenance sheet 71 being attached to the wall during moving, measures such as reducing the analysis sensitivity while observing the composite image or setting the full-pass function to off can be taken.

[0120] Conventionally, when studying the setting change of the elevator, it is necessary to check the image captured by the camera device 4 separately. Then, it is necessary to obtain various data stored in the control device 2 and the image processing device 6, find various data generated when the image is captured, interpret these data and conduct comparative studies. Such operations require professional knowledge, and even maintenance personnel with professional knowledge need time and labor.

[0121] In contrast, by configuring as in this embodiment, it is possible to examine the setting changes of the elevator while observing the synthesized screen obtained by synthesizing the required information into the image used for analysis. This can reduce the possibility of missed detection and can shorten the operation time, so that the needs of users can be met immediately. In this way, the monitoring efficiency of the elevator can be improved, and the service quality for customers can be improved.

[0122] In addition, building owners and ordinary users (passengers) who do not have professional knowledge can also confirm the operating status of the system in real time and can set the elevator according to their preferences. In addition, by displaying a composite image on the in-car display unit 3 and the landing display unit 5, passengers can confirm the operating status of the system without going through the terminal device 8.

[0123] [Main structure and effects]

[0124] Hereinafter, the main structure and effects of the above-mentioned embodiment will be described.

[0125] (1) An elevator control system 100 includes a control device 2, a camera device 4, an image processing device 6, and a display unit 20. The control device 2 controls the elevator. The camera device 4 is provided in the elevator car 1. The image processing device 6 communicates with the control device 2 and the camera device 4. The image processing device 6 calculates the congestion information of the passengers in the car 1 based on the image captured by the camera device 4. When the calculated congestion information is below a threshold value, the image processing device 6 sends a command to the control device 2 to set the operation mode of the elevator to the first operation mode (normal operation), and when the calculated congestion information exceeds the threshold value, the image processing device 6 sends a command to the control device 2 to set the operation mode to the second operation mode (full-pass operation). The display unit 20 displays the congestion information and the operation mode together with the image. Thus, it is possible to easily grasp the congestion condition of the passengers in the car 4 required to adjust the settings of the elevator.

[0126] (2) The control device 2 is capable of accepting a landing call from each of the multiple floors where the car 1 can stop, and causing the car 1 to respond to the landing call. The first operation mode (normal operation) is a mode in which the car 1 can respond to a landing call from any of the multiple floors. The second operation mode (full-pass operation) is a mode in which the car 1 does not respond to a landing call from any of the multiple floors. In this way, the congestion of passengers in the car 4 can be easily grasped, and when congested, it can be changed to a full-pass operation in which the car 1 does not respond to any landing call.

[0127] (3) The elevator control system 100 further includes a server device 9 and a terminal device 8. The server device 9 communicates with the image processing device 6. The terminal device 8 communicates with the server device 9. The terminal device 8 has a display unit 20. The image processing device 6 transmits display information including an image, congestion information, and an operation mode to the server device 9. The server device 9 transmits the display information to the terminal device 8 in response to a request from the terminal device 8. Thus, the congestion condition of passengers in the car 4 required for adjusting the setting of the elevator can be easily grasped in the terminal device 8.

[0128] (4) When there is a request from the user and the operation mode is switched, the image processing device 6 generates a composite image including the congestion information and the operation mode. The image processing device 6 sends the composite image as display information to the server device 9. In this way, since the composite image is generated when necessary, the processing load and storage capacity of the image processing device 6 can be reduced.

[0129] (5) The control device 2 changes the settings of the elevator in response to a request from the terminal device 8. This makes it possible to easily grasp the congestion status of passengers in the car 4 and adjust the settings of the elevator accordingly.

[0130] (6) The display unit 20 displays the fact that the elevator settings can be changed together with the display information. This can prompt the elevator settings to be changed.

[0131] (7) The control device 2 can change the elevator settings in response to a request from a user with the first authority, but does not change the elevator settings in response to a request from a user with the second authority. Thus, in a case where professional knowledge is required to change the settings, the elevator settings can be changed only by the authorized users.

[0132] (8) The control method is a method for controlling an elevator control system 100. The elevator control system 100 includes: a control device 2 for controlling an elevator; a camera device 4 provided in a car 1 of the elevator; an image processing device 6 for communicating with the control device 2 and the camera device 4; and a display unit 20 for displaying. The control method includes the following steps: calculating the congestion information of passengers in the car 1 based on an image captured by the camera device 4; sending a command to set the operation mode of the elevator to the first operation mode to the control device 2 when the calculated congestion information is below a threshold; sending a command to set the operation mode to the second operation mode to the control device 2 when the calculated congestion information exceeds the threshold; and causing the display unit 20 to display the congestion information and the operation mode together with the image. As a result, it is possible to easily grasp the congestion status of passengers in the car 4 required for adjusting the settings of the elevator.

[0133] The embodiments disclosed this time should be considered in all respects as illustrative rather than restrictive. The scope of the present invention is indicated by the claims rather than the above description, and is intended to include all modifications within the meaning and scope equivalent to the claims.

[0134] Description of symbols

[0135] 1: Car; 2: Control device; 3: Display unit in the car; 4: Camera device; 5: Floor display unit; 6: Image processing device; 6a: External communication unit; 6b: Storage unit; 6c: Operation mode change indication unit; 6d: Image output unit; 6e: Memory; 6f: Image analysis unit; 6g: Synthesis processing unit; 6h: Display control unit; 8: Terminal device; 9: Server device; 10a~10c: Screen; 20: Display unit; 51, 52: Entrance and exit; 61, 62: Passengers; 71: Maintenance sheet; 81: Message; 100: Elevator control system.

Claims

1. An elevator control system, wherein: The elevator control system comprises: A control device, which controls the elevator; A camera device, which is arranged in the elevator car; an image processing device, which communicates with the control device and the camera device; A server device that communicates with the image processing device; and a terminal device that communicates with the server device, The terminal device includes a display unit for displaying, The image processing device calculates the congestion information of the passengers in the car based on the image captured by the camera device, and when the calculated congestion information is below a threshold value, sends a command to the control device to set the operation mode of the elevator to a first operation mode, and when the calculated congestion information exceeds the threshold value, sends a command to the control device to set the operation mode to a second operation mode, and when there is a request from a user and the operation mode is switched, generates a composite image in which the congestion information and the operation mode are included in the image, and sends the composite image to the server device, The server device sends the synthesized image to the terminal device in response to a request from the terminal device. The display unit displays the synthesized image.

2. The elevator control system according to claim 1, wherein: The control device is capable of receiving a landing call from each of the plurality of floors at which the car can stop, and causing the car to respond to the landing call. The first operation mode is a mode in which the car can respond to a landing call from any of the plurality of floors. The second operation mode is a mode in which the car does not respond to a landing call from any of the plurality of floors.

3. The elevator control system according to claim 1, wherein: The control device changes the setting of the elevator in response to a request from the terminal device.

4. The elevator control system according to claim 3, wherein: The display unit displays, together with the synthesized image, that the setting of the elevator can be changed.

5. The elevator control system according to claim 3 or 4, wherein: The control device can change the setting of the elevator in response to a request from a user having a first authority, but does not change the setting of the elevator in response to a request from a user having a second authority.

6. A control method, which is a control method for controlling an elevator control system, wherein: The elevator control system comprises: A control device, which controls the elevator; A camera device, which is arranged in the elevator car; an image processing device, which communicates with the control device and the camera device; A server device that communicates with the image processing device; and a terminal device that communicates with the server device, The terminal device includes a display unit for displaying, The control method comprises the following steps: Calculating the congestion information of the passengers in the car according to the image captured by the camera device; When the calculated congestion information is below a threshold value, sending a command to the control device to set the operation mode of the elevator to a first operation mode; When the calculated congestion information exceeds the threshold, sending a command to the control device to set the operation mode to a second operation mode; generating a composite image synthesized by including the congestion information and the operation mode in the image when there is a request from the user and the operation mode is switched; sending the composite image to the server device; The server device sends the synthesized image to the terminal device according to a request from the terminal device; as well as The display unit is caused to display the synthesized image.

Images