A solution for indicating elevator occupancy information

Abstract

The invention relates to a method for indicating elevator occupancy information (502, 504). The method comprising: obtaining sensor data from inside an elevator car and sensor data from a landing area (240); and performing (320) the following steps for each obtained sensor data: identifying (410) one or more objects (270a-270d) and classifying the identified one or more objects (270a-270d) into predefined object groups, counting (420) the number of objects (270a-270d) in each object group, and generating (430) occupancy information (502, 504) respective to the elevator entity (102, 240) from which the sensor data is obtained. The method further comprises: controlling (330) at least one display (250) arranged inside the elevator car (102) to indicate the occupancy information (504) respective to the landing area (240); and / or controlling (340) at least one display (260) arranged to the landing area (240) to indicate the occupancy information (502) respective to the elevator car (102). The invention relates also to an elevator control unit (210), an elevator occupancy indication system (200), a computer program, and a computer- readable storage medium for indicating elevator occupancy information (502, 504).

Description

[0001] A solution for indicating elevator occupancy information

[0002] TECHNICAL FIELD

[0003] The invention concerns in general the technical field of elevator systems. Especially the invention concerns indication of elevator occupancy information in elevator systems.

[0004] BACKGROUND

[0005] In elevator systems, elevator cars are controlled to transport passengers and load between floors. However, the passengers inside the elevator car do not typically the situation on the landings (e.g. what kind of objects are waiting the elevator car on the landings), and the passengers waiting the elevator car on the landings do not typically know the situation inside the elevator (e.g. the occupancy level or what kind of objects are inside the elevator car). For example, it may be an unpleasant surprise for the passengers waiting the elevator car on the landings, if the elevator car is full and the passengers or their belongings cannot fit in the elevator car. On the other hand, the passengers may be negatively surprised by something inside the elevator car, when intending to enter the elevator car, or on the landing outside the elevator car, when intending exit the elevator car.

[0006] For indicating the occupancy level of the elevator car on the landings (e.g. “elevator full” indication), solutions based on elevator scale data may be used. However, these solutions are relying on the mass of the objects inside the elevator car, not the volumetric occupancy. Thus, the solutions based on the elevator scale data may be inaccurate. There exist also camera-based solutions, where a camera is arranged inside the elevator car and the image from the camera is displayed on the landings. However, these solutions violate user privacy.

[0007] SUMMARY

[0008] The following presents a simplified summary in order to provide basic understanding of some aspects of various invention embodiments. The summary is not an extensive overview of the invention. It is neither intended to identify key or critical elements of the invention nor to delineate the scope of the invention. The following summary merely presents some concepts of the invention in a simplified form as a prelude to a more detailed description of exemplifying embodiments of the invention.

[0009] An objective of the invention is to present a method, an elevator control unit, an elevator occupancy indication system, a computer program, and a computer-readable storage medium for indicating elevator occupancy information. Another objective of the invention is that the method, the elevator control unit, the elevator occupancy indication system, the computer program, and the computer-readable storage medium for indicating elevator occupancy information enables providing to a landing area information about an occupancy situation inside an elevator car and / or providing to inside an elevator car information about an occupancy situation on a landing area without violating user privacy.

[0010] The objectives of the invention are reached by a method, an elevator control unit, an elevator occupancy indication system, a computer program, and a computer-readable storage medium as defined by the respective independent claims.

[0011] According to a first aspect, a method for indicating elevator occupancy information is provided, wherein the method comprises: obtaining sensor data from inside an elevator car and sensor data from a landing area; and performing the following steps for each obtained sensor data: identifying one or more objects from the sensor data and classifying the identified one or more objects into predefined object groups, counting the number of objects in each object group, and generating occupancy information respective to the elevator entity from which the sensor data is obtained, wherein the occupancy information comprises information about each identified object group and the number of objects in each object group; wherein the method further comprises: controlling at least one display arranged inside the elevator car to indicate the occupancy information respective to the landing area; and / or controlling at least one display arranged to the landing area to indicate the occupancy information respective to the elevator car.

[0012] Identifying the one or more objects, classifying the one or more objects into the predetermined object groups, and counting the number of objects in each object group may be performed by using a machine learning module. The indicated occupancy information may be a symbol-based indication comprising a specific symbol for each object group.

[0013] The landing area may comprise a plurality of sub landing areas so that each sub landing area resides on a different landing, wherein the sensor data obtained from the landing area may comprise sensor data obtained from each sub landing area, and wherein the occupancy information indicated on the at least one display arranged inside the elevator car may comprise occupancy information respective to one or more sub landing areas.

[0014] The method may further comprise controlling at least one operation of the elevator system based on the generated occupancy information.

[0015] The at least one operation of the elevator system may be at least one of the following: adjusting an elevator door closing time, the elevator car passing one or more landings without stopping.

[0016] The display arranged to the elevator car may be one of the following: a display of an elevator car operating panel, an image projector device.

[0017] The display arranged to the landing area may be one of the following: a display of a hall indicator device, an image projector device.

[0018] The method may further comprise controlling at least one other display inside the building, in which the elevator system resides, to indicate the occupancy information respective to the elevator car and / or the occupancy information respective to the landing area.

[0019] The predefined object groups may comprise one or more of the following groups: persons, persons with a mobility aid, vehicles, pets, means of transport.

[0020] According to a second aspect, an elevator control unit for indicating elevator occupancy information is provided, wherein the elevator control unit comprises: a processing unit comprising at least one processor; and a memory unit comprising at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the elevator control unit to perform the method as described above. According to a third aspect, an elevator occupancy indication system for indicating elevator occupancy information is provided, wherein the elevator occupancy indication system comprises: at least one sensor device configured to provide sensor data from an elevator car; at least one sensor device configured to provide sensor data from a landing area; at least one display arranged inside the elevator car; at least one display arranged to the landing area; and an elevator control unit as described above.

[0021] The at least one sensor device may be one of the following: a camera, a time- of-flight camera, a microwave radar, a lidar.

[0022] According to a fourth aspect, a computer program is provided, wherein the computer program comprises instructions which, when the program is executed by an elevator control unit, cause the elevator control unit to carry out the method as described above.

[0023] According to a fifth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium comprises instructions which, when executed by an elevator control unit, cause the elevator control unit to carry out the method as described above.

[0024] Various exemplifying and non-limiting embodiments of the invention both as to constructions and to methods of operation, together with additional objects and advantages thereof, will be best understood from the following description of specific exemplifying and non-limiting embodiments when read in connection with the accompanying drawings.

[0025] The verbs “to comprise” and “to include” are used in this document as open limitations that neither exclude nor require the existence of unrecited features. The features recited in dependent claims are mutually freely combinable unless otherwise explicitly stated. Furthermore, it is to be understood that the use of “a” or “an”, i.e. a singular form, throughout this document does not exclude a plurality.

[0026] BRIEF DESCRIPTION OF FIGURES

[0027] The embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings.

[0028] Figure 1 illustrates schematically an example of an elevator system. Figure 2A illustrates schematically an example of an elevator occupancy indication system.

[0029] Figure 2B illustrates schematically an example of a plurality sub landing areas forming a landing area.

[0030] Figure 3 illustrates schematically an example of a method for indicating elevator occupancy information.

[0031] Figure 4 illustrates schematically another example of the method.

[0032] Figures 5A and 5B schematically illustrate examples of indication of occupancy information.

[0033] Figures 6A and 6B schematically illustrate other examples of the indication of the occupancy information.

[0034] Figure 6C illustrates schematically an example of indication of assistance information.

[0035] Figure 7 illustrates schematically an example of components of an elevator control unit.

[0036] DESCRIPTION OF THE EXEMPLIFYING EMBODIMENTS

[0037] Figure 1 illustrates schematically an example of an elevator system 100. The elevator system 100 comprises an elevator car 102 configured to travel along an elevator shaft 104 between a plurality of landings (i.e. floors) 106a-106n, a counterweight 108, an elevator hoisting machine, and an elevator control system 110. The elevator system 100 may also form an elevator group, i.e. group of two or more elevator cars 102 each travelling along a separate elevator shaft 104 configured to operate as a unit serving the same landings 106a-106n. The elevator system 100 may further comprise one or more known elevator related entities, e.g. elevator doors, and / or safety circuit and devices, etc., which are not shown in Figure 1 for sake of clarity.

[0038] The elevator hoisting machine is configured to drive the elevator car 102 along the elevator shaft 104 between the landings 106a-106n. The elevator hoisting machine comprises a hoisting motor and a traction sheave 112 for lifting the elevator car 102. The elevator hoisting machine further comprise a hoisting machine brake arrangement comprising one or more hoisting machine brakes. For illustrative purposes, only the traction sheave 112 of the elevator hoisting machine is shown in Figure 1 .

[0039] The elevator control system 110 is configured to at least control the operations of the elevator system 100. The elevator control system 110 may locate inside a machine room 114 (as illustrated in the example of Figure 1 ) or at one of the landings 106a-106n, e.g. in a machine roomless elevator system. The elevator control system 110 is communicatively coupled to the other entities of the elevator system 100. The communication between the elevator control system 110 and the other entities of the elevator system 100 may be based on one or more known communication technologies, either wired or wireless. The implementation of the elevator control system 110 may be done as a standalone control entity or as a distributed control environment between a plurality of stand-alone control entities, such as a plurality of servers, providing distributed control resource.

[0040] The elevator system 100 further comprises an elevator car call device 116 arranged inside the elevator car 102. If the elevator system 100 forms the elevator group, an elevator call device 116 is arranged inside each elevator car 102. The elevator car call device 116 may for example be an elevator car operating panel (COP). The elevator car call device 116 comprises a user interface for generating car calls to control at least one operation of the elevator system 100, e.g. to drive the elevator car 102 to a desired destination landing, open or close elevator doors (landing door(s) and / or elevator car door(s)), generating an elevator alarm, making an emergency call, etc. The elevator car call device 116 further comprises a display for displaying information to passengers inside the elevator car 102. The displayed information may for example comprise occupancy information and possibly also elevator movement information as will be described later in this disclosure.

[0041] The elevator system 100 further comprises a hall indicator device 118a-118n respective to the elevator car 102 arranged to each landing 106a-106c. If the elevator system 100 forms the elevator group, a hall indicator device 118a- 118n respective to each elevator car 102 is arranged to each landing 106a- 106n. The hall indicator device 118a-118n comprises a display for displaying information to passengers waiting the elevator car 102 on the landings 106a- 106n. The displayed information may for example comprise the occupancy information and possibly also elevator movement information as will be described later in this disclosure.

[0042] The elevator system 100 may further comprise a landing call device 120a- 120n respective to the elevator car 102 arranged to each landing 106a-106n. The landing call device 120a-120n may for example be a landing call station (LCS). The landing call device 120a-120n may comprise a user interface for generating landing calls to control at least one operation of the elevator system 100, e.g. to drive the elevator car 102 to a desired departure landing 106a- 106n, i.e. said landing 106a-106n, where said landing call device 120a-120n resides.

[0043] Alternatively or in addition, the elevator system 100 may comprise at least one destination call device 122 arranged to at least one landing 106a-106n. The at least one destination call device 122 may for example be a destination operation panel (DOP). The destination call device 122 may comprise a user interface e.g. for generating destination calls to control at least one operation of the elevator system 100, e.g. to drive the elevator car 102 first to a desired departure landing 106a-106n, i.e. said landing 106a-106n, where said destination call device 122 resides, and then to a desired destination landing 106a-106n. In the example of Figure 1 the destination call device 122 is arranged to a separate support element, e.g. a stand, but the destination call device 122 may also be arranged e.g. to a wall at the landing 106a-106n, e.g. within a landing area or an elevator lobby area.

[0044] The elevator system 100 further comprises an elevator occupancy indication system 200 for indicating elevator occupancy information. The elevator occupancy indication system 200 comprises an elevator control unit 210, at least one sensor device (e.g. at least one car sensor device) 220 configured to provide sensor data (e.g. car sensor data) from the elevator car 102, at least one sensor device (e.g. at least one landing sensor device) 230 configured to provide sensor data (e.g. landing sensor data) from a landing area 240, at least one display (e.g. at least one car display) 250 arranged inside the elevator car 102 (i.e. residing inside the elevator car 102), at least one display (e.g. at least one landing display) 260 arranged to the landing area 240. Figure 2A illustrates schematically an example of the elevator occupancy indication system 200. In the example of Figure 2A, one car sensor device 220 is arranged inside the elevator car 102 for providing the sensor data from the elevator car 102 and one landing sensor device 230 is arranged to each landing 106a-106n for providing sensor data from the landing area 240. For sake of clarity only two landings 106a (i.e. floor 1 ) and 106n (i.e. floor 8) are shown in Figure 2A. The landing area 240 is respective to the elevator car 102. In case the elevator system 100 forms the elevator group, there are a landing area 240 respective to each elevator car 102. The landing area 240 comprises a plurality of sub landing areas 240a-240n so that each sub landing area 240a- 240n resides on a different landing 106a-106n. In other words, the landing area 240 is formed by the plurality of sub landing areas 240a-240n each residing on a different landing 106a-106n. Preferably, the landing area 240 comprises the sub landing area 240a-240n of each landing 106a-106n as illustrated in Figure 2B, which illustrates schematically an example of the plurality sub landing areas 240a-240n forming the landing area 240. With the term “sub landing area” is meant throughout this disclosure an area in a close vicinity of the doorway of the elevator car 102 (e.g. an area in front of the doorway of the elevator car 102) on the landing 106a-106n in question. With the term “landing area” is meant throughout this disclosure an area formed by the areas in a close vicinity of the doorways of the elevator car 102 (e.g. the areas in front of the doorways of the elevator car 102) on different landings 106a-106n, i.e. an area formed by the sub landing areas 240a-240n.

[0045] The at least one car sensor device 220 is arranged inside the elevator car 102 so that it is capable of providing sensor data covering the whole floor of the elevator car 102. In the example of Figure 2A, the car sensor device 220 is arranged inside the elevator car 102 and configured to provide sensor data from the elevator car 102, i.e. from inside the elevator car 102. In Figure 2A only one non-limiting example placement for the car sensor device 220 inside the elevator car 102 is illustrated. The at least one car sensor device 220 may preferably be placed in a vicinity of a ceiling of the elevator car 102, i.e. as high as possible, as also illustrated in the example of Figure 2A. The at least one landing sensor device 230 may be arranged to the landing area 240 on each landing 106a-106n so that sensor data covering the whole area in the close vicinity of the doorway of the elevator car 102 on each landing 106a-106n may be provided. In the example of Figure 2A, the landing sensor device 230 is arranged on a wall next to the elevator door and configured to provide sensor data from the landing area 240. In Figure 2A only one non-limiting example placement for the landing sensor device 230 to the landing area 240 is illustrated. The landing sensor device 230 may preferably be placed in a vicinity of the ceiling of the landing area 240, i.e. as high as possible, as also illustrated in the example of Figure 2A. The at least one sensor device 220, 230 may be one of the following: a camera, a time-of-flight (ToF) camera, a microwave radar, a lidar.

[0046] Furthermore, in the example of Figure 2A one car display 250 is arranged to the elevator car 102 and a plurality of landing displays 260 is arranged to the landing area 240 so that one landing display 260 is arranged to each sub landing area 240a-240n. The car display 250 arranged to the elevator car 102 may for example be one of the following: a display of an elevator car operating panel 116, an image projector device. However, the car display 250 may also be also any other display arranged to the elevator car 102 (i.e. residing inside the elevator car 102). In the example of Figure 2A, the car display 250 is implemented as the display of the elevator car operating panel 116. The landing display 260 arranged to the landing area 240 may for example be one of the following: a display 260 of a hall indicator device 118a-118n, an image projector device. However, the landing display 260 may also be also any other display arranged to the landing area 240 (i.e. residing within the landing area 240). In the example of Figure 2A, the landing displays 260 are implemented as displays of the hall indicator devices 118a-118n .

[0047] The elevator control unit 210 may be implemented as a part of the elevator control system 110 or as a separate unit communicatively coupled to the elevator control system 110. The communication between the elevator control unit 210 and the elevator control system 110 may be based on one or more known communication technologies, either wired or wireless. The elevator control unit 210 is communicatively coupled to the other entities of the elevator occupancy indication system 200. The communication between the elevator control unit 210 and the other entities of the elevator occupancy indication system 200 may be based on one or more known communication technologies, either wired or wireless. For sake of clarity, in the example of Figure 2A the arrows indicating the communication between the elevator control unit 210 and the other entities of the elevator occupancy indication system 200 are presented only between the elevator control unit 210 and the entities inside the elevator car 102 and the entities on the landing 106n, however also the entities on the other landings (e.g. the landing 106a) are communicatively coupled to the elevator control unit 210. The implementation of the elevator control unit 210 may be done as a stand-alone control entity or as a distributed control environment between a plurality of stand-alone control entities providing distributed control resource.

[0048] Next an example of a method for indicating the elevator occupancy information is described by referring to Figure 3. Figure 3 schematically illustrates the method as a flow chart. The method may be a computer-implemented method performed by the elevator occupancy indication system 200 described above.

[0049] At step 310, the elevator control unit 210 obtains sensor data (i.e. the car sensor data) from inside a first elevator entity being the elevator car 102 and sensor data (i.e. the landing sensor data) from a second elevator entity being the landing area 240. The elevator car 102 may be considered as a first area of interest and the landing area 240 may be considered as a second area of interest. The car sensor data obtained from inside the elevator car 102 is obtained from the at least one car sensor device 220. The landing sensor data obtained from the landing area 240 is obtained from the at least one landing sensor device 230. As discussed above, the landing area 240 comprises the plurality of sub landing areas 240a-240n so that each sub landing area 240a- 240n resides on a different landing 106a-106n. This means that the sensor data obtained from the landing area 240 comprises sensor data obtained from each sub landing area 240a-240n. The type of the obtained sensor data depends on the sensor device 220, 230 used to provide the sensor data. For example, when the sensor device is a camera, the sensor data may for example be image data comprising one or more images and / or video images comprising a plurality of consecutive images, i.e. frames. According to another example, when the sensor device is a time-of-flight camera, the sensor data may for example be depth data. According to yet another example, when the sensor device is a microwave radar, the sensor data may for example be radar data. According to yet another example, when the sensor device is lidar the sensor data may for example be point cloud data.

[0050] At step 320, the elevator control unit 210 generates based on the sensor data obtained from each elevator entity 102, 240 occupancy information 502, 504 respective to the elevator entity 102, 240 from which the sensor data is obtained. In other words, the elevator control unit 210 generates occupancy information 502 respective to the elevator car 102 based on the sensor data obtained from the elevator car 102 and occupancy information 504 respective to the landing area 240 based on the sensor data obtained from the landing area 240. The occupancy information 504 respective to the landing area 240 may comprise occupancy information respective to each sub landing area 240a-240n generated based on the sensor data obtained from the respective sub landing area 240a-240n. The occupancy information 502, 504 generated based on the sensor data increases the accuracy of the generated occupancy data, for example in comparison to the mass -based solutions discussed in the background section.

[0051] At steps 330 and 340, the elevator control unit 210 controls the at least one display 250, 260 arranged to the elevator entity 102, 240 to indicate the occupancy information 502, 504 respective to the other elevator entity 102, 240. In other words, the elevator control unit 210 controls the at least one car display 250 to indicate the occupancy information 504 respective to the landing area 240 at step 330 and / or the elevator control unit 210 controls the at least one landing display 260 to indicate the occupancy information 502 respective to the elevator car 102 at step 340. The occupancy information 504 indicated on the at least one car display 250 may comprise occupancy information 504 respective to one or more sub landing areas 240a-240n, e.g. the sub landing areas 240a-240n of the landings 106a-106n, where the elevator car 102 is going to stop. Preferably, the elevator control unit 210 controls both the at least one car display 250 to indicate the occupancy information 504 respective to the landing area 240 and the at least one landing display 260 to indicate the occupancy information 502 respective to the elevator car 102. This enables indicating simultaneously information about the occupancy situation inside the elevator car 102 on the landings 106a-106n and information about the occupancy situation on the landings 106a-106n inside the elevator car 102. The indicated occupancy information 502, 504 does not comprise the sensor data itself (i.e. the sensor data itself is not displayed for the passengers), but instead the indicated occupancy information 502, 504 is generated from the obtained sensor data. The indication of the occupancy information 502, 504 is a schematic indication. The indicated occupancy information 502, 504 may for example be a symbol-based indication comprising a specific symbol for each object group. This enables respecting user privacy, which is a great benefit for example in comparison to using a direct camera feed that violates the user privacy as discussed in the background section.

[0052] The indication of the occupancy information 502 respective to the elevator car 102 on the at least one landing display 260 enables providing information about the occupancy situation inside the elevator car 102 (e.g. what kind of objects are inside the elevator car 102 and the number of the objects) for the passengers waiting to enter the elevator car 102 on the landings 106a-106n. The indicated occupancy information 502 may for example help guiding the behaviour of the passengers and enables preparing by the passengers on the landing 106a-106n before the elevator car 102 arrives at the landing 106a- 106n. For example, by knowing that the elevator car 102 is not empty, the passengers on the landings 106a-106n know to prepare to potentially give way for the passengers exiting the elevator car 102 and not standing close in front of the elevator doors. Knowing what is inside the elevator car 102 has other benefits too. For example, if a passenger afraid of dogs or if a passenger with a reactive dog knows that there is already a dog in the elevator car 102, they can wait for the next elevator car 102, if they choose so. Alternatively or in addition, if a passenger with a wheelchair knows that there is already a stroller inside the elevator car 102, they can evaluate if it would be more convenient to take the next elevator car 102.

[0053] On the other hand, the indication of the occupancy information 504 respective to the landing area 240 on the at least one car display 250 enables providing information about the occupancy situation on the landings 106a-106n (e.g. what kind of objects are waiting the elevator car 102 on the landings and the number of the objects) for the passengers inside the elevator car 102. The indicated occupancy information 504 may help guiding the behaviour of the passengers inside the elevator car 102 and enables preparing by the passengers inside the elevator car 102 before the elevator car 102 reaches the landing 106a-106n. For example, by knowing what kind of objects are going to enter the elevator car 102 and the number of each kind of objects, the passengers inside the elevator car 102 can already start making room for the passengers wating on the landing 106a-106n before the elevator car 102 reaches the landing 106a-106n. This may have a positive impact on the user experience and people flow. According to an example, the elevator control unit 210 may further control at least one other display inside the building, in which the elevator system 100 resides, to indicate the occupancy information 502 respective to the elevator car 102 and / or the occupancy information 504 respective to the landing area 240. For example, the at least one other display inside the building may be, but is not limited to, at least one of the following: a display of a building management system, a display of a destination operation panel 122, an elevator lobby display, any other suitable display inside the building.

[0054] Figure 4 schematically illustrates the flow chart of Figure 3 in more detailed manner. Especially the step 320 becomes clear from Figure 4. As said the elevator control unit 210 obtains 310 the sensor data from inside the elevator car 102 and the sensor data from the landing area 240. The generation of the occupancy information 502, 504 at the step 320 comprises performing steps 410 - 430 for each obtained sensor data. In other words, the elevator control unit 210 performs the steps 410 - 430 for the car sensor data to generate the occupancy information 502 respective to the elevator car 102 and for the landing sensor data to generate the occupancy information 504 respective to the landing area 240.

[0055] At step 410, the elevator control unit 210 identifies (i.e. detects) one or more objects 270a-270d from the sensor data and classifies the identified one or more objects 270a-270d into predefined object groups (i.e. one or more predetermined object groups). The predefined object groups may comprise one or more of the following groups: persons, persons with a mobility aid (e.g. wheelchair, walker, walking stick, crutch, etc.) vehicles (e.g. bicycles, electric scooters, etc.), pets, means of transport (e.g. strollers, shopping carts, boxes, freight pallets, etc.). For example, in a situation according to the example of Figure 2A, the elevator control unit 210 identifies from the sensor data obtained from the elevator car 102 three objects 270a, 270b, 270c and classifies the identified three objects 270a, 270b, 270c into the predetermined object groups, namely one identified object 270a is classified into the group of persons, one identified object 270c is classified into the group of persons with a mobility aid, and one identified object 270b is classified into the group of pets. Furthermore, in the situation according to the example of Figure 2A, the elevator control unit 210 identifies from the sensor data obtained from the sub landing area 240n of the landing 106n three objects 270a, 270c, 270d and classifies the identified three objects 270a, 270c, 270d into the predetermined object groups, namely one identified object 270a is classified into the group of persons, one identified object 270c is classified into the group of persons with a mobility aid, and one identified object 270d is classified into the group of means of transport, and from the sensor data obtained from the sub landing area 240a of the landing 106a four objects 270a, 270b and classifies the identified four objects 270a, 270b into the predetermined object groups, namely three identified objects 270a are classified into the group of persons and one identified object 270b is classified into the group of pets.

[0056] At step 420, the elevator control unit 210 counts the number of objects 270a- 270d in each object group. For example, in the situation according to the example of Figure 2A, inside the elevator car 102 the number of objects in the group of persons is one, the number of objects in the group of persons with a mobility aid is one, and the number of objects in the group of pets is one. Furthermore, in the situation according to the example of Figure 2A, on the landing 106n the number of objects in the group of persons is one, the number of objects in the group of persons with a mobility aid is one, and the number of objects in the group of means of transport is one, while on the landing 106a the number of objects in the group of persons is three and the number of objects in the group of pets is one.

[0057] According to an example, the elevator control unit 210 may comprise a machine learning module 726. The elevator control unit 210 may use (e.g. apply) the machine learning module 726 to identify the one or more objects 270a-270d from the sensor data and to classify the one or more objects 270a- 270d into the predetermined object groups discussed above referring to the step 410. Furthermore, the elevator control unit 210 may use the machine learning module 726 to count the number of objects 270a-270d in each object group discussed above referring to the step 420. In other words, the identification of the one or more objects 270a-270d, the classification of the one or more objects 270a-270d into the predetermined object groups, and the counting of the number of objects 270a-270d in each object group may be performed by using the machine learning module 726. Yet in other words, the elevator control unit 210 may process the obtained sensor data with the machine learning module 726 to identify the one or more objects 270a-270d from the sensor data, to classify the one or more objects 270a-270d into the predetermined object groups, and to count the number of objects 270a-270d in each object group. The machine learning module 726 may be a pre-trained machine learning model. The machine learning module 726 may for example be pre-trained by using sensor data obtained from the elevator car 102 and from the landing area 240 in a plurality of different situations, where different number of objects 270a-270d belonging to different objects groups reside inside the elevator car 102 and within the landing area 240. The machine learning module 726 may be based on one or more known machine learning techniques.

[0058] At step 430, the elevator control unit 210 generates the occupancy information 502, 504 respective to the elevator entity 102, 240 from which the sensor data is obtained. The generated occupancy information 502 comprises information about each identified object group and the number of objects 270a-270d in each object group. In other words, the generated occupancy information 502 comprises information about in which objects groups the objects 270a-270d are identified and the number of the identified objects in each object group.

[0059] Figure 5A schematically illustrates an example of the occupancy information 504 respective to the landing area 240 displayed on the car display 250 arranged inside the elevator car 102 in the example of Figure 2A. In the example of Figure 5A, the displayed occupancy information 504 indicates that on the first landing 106a three persons 270a and one pet 270b are waiting to enter the elevator car 102 and on the eight landing 106n one person 270a, one person with a mobility aid 270c, and one means of transport (i.e. a stroller) 270d are waiting to enter the elevator car 102. Furthermore, in the example of Figure 5A, the displayed occupancy information 504 indicates that no objects 270a-270d are identified on the second and fourth floor landings. In addition to the occupancy information 504 also other information 506, 508 may be displayed on the display 250 arranged to the elevator car 102. For example, the elevator movement information may be displayed on the display 250 arranged inside the elevator car 102. In the example of Figure 5A the elevator movement information comprises movement direction 506 of the elevator car 102 and the current floor 508 of the elevator car 102. As discussed above, the occupancy information 504 indicated on the at least one car display 250 may comprise occupancy information 504 respective to one or more sub landing areas 240a-240n. In the example of Figure 5A, the occupancy information 504 indicated on the at least one car display 250 comprises occupancy information 504 respective to the sub landing areas 240a-240n of the landings 106a-106n, where the elevator car 102 is going to stop (i.e. landings: 1 , 2, 4, and 8). Figure 5B schematically illustrates an example of the occupancy information 502 respective to the elevator car 102 displayed on the landing displays 260 arranged to the landing area 240. In the example of Figure 5B, the displayed occupancy information 502 indicates that one person 270a, one person with a mobility aid 270c, and one pet 270b are inside the elevator car 102. In addition to the occupancy information 502 also other information 506, 508 may be displayed on the landing displays 260. For example, elevator movement information may be displayed on the landing display 260. In the example of Figure 5B the elevator movement information comprises movement direction 506 of the elevator car 102 (e.g. current movement direction, future movement direction, or indented movement direction) and the current floor 508 of the elevator car 102.

[0060] According to an example, the elevator control unit 210 may further control the at least one display 250, 260 arranged to the elevator entity 102, 240 to indicate the occupancy information 502, 504 respective to said elevator entity 102, 240 itself. In other words, the elevator control unit 210 may further control the at least one display 250 arranged inside the elevator car 102 to indicate the occupancy information 502 respective to the elevator car 102 at the step 330 and / or the elevator control unit 210 may further control the at least one display 260 arranged to the landing area 240 to indicate the occupancy information 504 respective to the landing area 240 at the step 340. This enables providing further elevator occupancy related information for the elevator passengers. Figure 6A illustrates schematically an example of the indication of the occupancy information 502, 504 inside the elevator car 102. In the example of Figure 6A, the car display 250 arranged to the elevator car 102 is controlled to display the occupancy information 504 respective to the landing area 240 and the occupancy information 502 respective to the elevator car 102 itself. Figure 6B illustrates schematically an example the indication of the occupancy information 502, 504 on the landing area 240. In the example of Figure 6B, the landing display 260 arranged to the landing area 240 on the first landing 106a is controlled to display the occupancy information 502 respective to the elevator car 102 and the occupancy information 504 respective to the landing area 240 itself.

[0061] According to another example, the elevator control unit 210 may further control at least one operation of the elevator system 100 based on the generated occupancy information 502, 504. The at least one operation of the elevator system 100 may for example be, but is not limited to, at least one of the following: adjusting (e.g. increasing) an elevator door closing time, the elevator car 102 passing one or more landings 106a-106n without stopping. For example, if the generated occupancy information 502 indicates that there are inside the elevator car 102 and / or on the landing area 240 objects 270b, 270c, 270d that may benefit from longer door closing time (e.g. person(s) with a mobility aid 270c, means of transportation 270d, pets 270b, etc.), the elevator control unit 210 may increase the elevator door closing time in order to allow more time for these objects 270b, 270c, 270d to enter or exit the elevator car 102. In case the elevator control unit 210 adjusts the elevator door closing time, the elevator control unit 210 may further control the at least one display 250, 260 to indicate assistance information 602. Similarly, as the indicated occupancy information 502, 504, the indicated assistance information 602 may for example be a symbol-based indication, but in this case the symbol-based indication may comprise a specific symbol for the assistance mode (e.g. an assistance symbol). Figure 6C illustrates schematically an example of the indication of the assistance information 602 on the landing area 240. In the example of Figure 6C, the landing display 260 is controlled to display the occupancy information 502 respective to the elevator car 102 and the assistance information 602. The landing display 260 may further be controlled to display the occupancy information 504 respective to the landing area 240 itself as illustrated in the example of Figure 6B. Similarly, the display 250 arranged to the elevator car 102 may be controlled to display the occupancy information 504 respective to the landing area 240 and the assistance information 602 and possibly also the occupancy information 502 respective to the elevator car 102 itself. Alternatively, if the generated occupancy information 502 indicates that the elevator car 102 is full, the elevator control unit 210 may control the movement of the elevator car 102 so that the elevator car 102 passes one or more landings 106a-106n without stopping. Alternatively or in addition, if the generated occupancy information 502 indicates that a number of objects 270a-270d in specific object group(s) meets a predetermined limit, the elevator control unit 210 may control the movement of the elevator car 102 so that the elevator car 102 passes one or more landings 106a-106n without stopping. For example, if the generated occupancy information 502 indicates that there is already one large object (e.g. a wheelchair, a stroller, a shopping cart, etc.) inside the elevator car 102, the elevator control unit 210 may control the movement of the elevator car 102 so that the elevator car 102 passes one or more landings 106a-106n, where objects belonging to the object groups comprising large objects (e.g. persons with a mobility aid, means of transport, etc.) are waiting to enter the elevator car 102. Similarly, if the generated occupancy information 502 indicates that there are already one or more pets inside the elevator car 102, the elevator control unit 210 may control the movement of the elevator car 102 so that the elevator car 102 passes one or more landings 106a-106n, where one or more pets are waiting to enter the elevator car 102. The controlling of the movement of the elevator car 102 by the elevator control unit 210 may be direct or indirect (e.g. via the elevator control system 110) depending on the implementation of the elevator control unit 210.

[0062] In the examples of Figures 5A-5B and 6A-6C, the occupancy information 502, 504 is symbol -based indication comprising a specific symbol for each object group. Similarly, in the example of Figure 6C the assistance information 602 is symbol-based indication comprising a specific symbol for the assistance mode. The symbols used in the examples of Figures 5A-5B and 6A-6C are only nonlimiting examples and also any other symbols may be used.

[0063] Figure 7 illustrates schematically an example of components of the elevator control unit 210. The elevator control unit 210 may comprise a processing unit 710 comprising one or more processors, a memory unit 720 comprising one or more memories, a communication unit 730 comprising one or more communication devices, and possibly a user interface (III) unit 740. The mentioned elements may be communicatively coupled to each other with e.g. a communication bus. The memory unit 720 may store and maintain portions of a computer program (code) 725, the machine learning module 726, and any data. The computer program 725 may comprise instructions which, when the computer program 725 is executed by the processing unit 710 of the elevator control unit 210 may cause the processing unit 710, and thus the elevator control unit 210 to carry out desired tasks, e.g. one or more of the method steps described above. The processing unit 710 may thus be arranged to access the memory unit 720 and retrieve and store any information therefrom and thereto. For sake of clarity, the processor herein refers to any unit suitable for processing information and control the operation of the elevator control unit 210, among other tasks. The operations may also be implemented with a microcontroller solution with embedded software. Similarly, the memory unit 720 is not limited to a certain type of memory only, but any memory type suitable for storing the described pieces of information may be applied in the context of the present invention. The communication unit 730 provides one or more communication interfaces for communication with any other unit, e.g. elevator control system 110, the sensor devices 220, 230, the displays 250, 260, one or more databases, and / or with any other unit. The user interface unit

[0064] 740 may comprise one or more input / output (I / O) devices, such as buttons, keyboard, touch screen, microphone, loudspeaker, display and so on, for receiving user input and outputting information. The computer program 725 may be a computer program product that may be comprised in a tangible nonvolatile (non-transitory) computer-readable medium bearing the computer program code 725 embodied therein for use with a computer, i.e. the elevator control unit 210.

[0065] The specific examples provided in the description given above should not be construed as limiting the applicability and / or the interpretation of the appended claims. Lists and groups of examples provided in the description given above are not exhaustive unless otherwise explicitly stated.

Claims

CLAIMS1. A method for indicating elevator occupancy information (502, 504), the method comprising: obtaining (310) sensor data from inside an elevator car (102) and sensor data from a landing area (240); and performing (320) the following steps for each obtained sensor data: identifying (410) one or more objects (270a-270d) from the sensor data and classifying the identified one or more objects (270a-270d) into predefined object groups, counting (420) the number of objects (270a-270d) in each object group, and generating (430) occupancy information (502, 504) respective to the elevator entity (102, 240) from which the sensor data is obtained, wherein the occupancy information (502, 504) comprises information about each identified object group and the number of objects (270a-270d) in each object group; wherein the method further comprises: controlling (330) at least one display (250) arranged inside the elevator car (102) to indicate the occupancy information (504) respective to the landing area (240); and / or controlling (340) at least one display (260) arranged to the landing area (240) to indicate the occupancy information (502) respective to the elevator car (102).

2. The method according to claim 1 , wherein identifying the one or more objects (270a-270d), classifying the one or more objects (270a-270d) into the predetermined object groups, and counting the number of objects (270a-270d) in each object group is performed by using a machine learning module (726).

3. The method according to any of the preceding claims, wherein the indicated occupancy information is a symbol-based indication comprising a specific symbol for each object group.

4. The method according to any of the preceding claims, wherein the landing area (240) comprises a plurality of sub landing areas (240a-240n) so that each sub landing area (240a-240n) resides on a different landing (106a- 106n), wherein the sensor data obtained from the landing area (240) comprises sensor data obtained from each sub landing area (240a-240n), and wherein the occupancy information (504) indicated on the at least one display (250) arranged inside the elevator car (102) comprises occupancy information (504) respective to one or more sub landing areas (240a-240n).

5. The method according to any of the preceding claims further comprising controlling at least one operation of the elevator system (100) based on the generated occupancy information (502, 504).

6. The method according to claim 5, wherein the at least one operation of the elevator system (100) is at least one of the following: adjusting an elevator door closing time, the elevator car (102) passing one or more landings (106a- 106n) without stopping.

7. The method according to any of the preceding claims, wherein the display (250) arranged to the elevator car (102) is one of the following: a display of an elevator car operating panel (116), an image projector device.

8. The method according to any of the preceding claims, wherein the display (260) arranged to the landing area (240) is one of the following: a display of a hall indicator device (118a-118n), an image projector device.

9. The method according to any of the preceding claims further comprising controlling at least one other display inside the building, in which the elevator system (100) resides, to indicate the occupancy information (502) respective to the elevator car (102) and / or the occupancy information (504) respective to the landing area (240).

10. The method according to any of the preceding claims, wherein the predefined object groups comprise one or more of the following groups: persons, persons with a mobility aid, vehicles, pets, means of transport.

11. An elevator control unit (210) for indicating elevator occupancy information (502, 504), the elevator control unit (210) comprising: a processing unit (710) comprising at least one processor; anda memory unit (720) comprising at least one memory including computer program code (725); wherein the at least one memory and the computer program code (725) are configured to, with the at least one processor, cause the elevator control unit (210) to perform the method according to any of the preceding claims.

12. An elevator occupancy indication system (200) for indicating elevator occupancy information (502, 504), the elevator occupancy indication system (200) comprises: at least one sensor device (220) configured to provide sensor data from an elevator car (102); at least one sensor device (230) configured to provide sensor data from a landing area (240); at least one display (250) arranged inside the elevator car (102); at least one display (260) arranged to the landing area (240); and an elevator control unit (210) according to claim 11 .

13. The elevator occupancy indication system (200) according to claim 12, wherein the at least one sensor device (220, 230) is one of the following: a camera, a time-of-flight camera, a microwave radar, a lidar.

14. A computer program (725) comprising instructions which, when the program (725) is executed by an elevator control unit (210), cause the elevator control unit (210) to carry out the method according to any of claims 1 to 10.

15. A computer-readable storage medium comprising instructions which, when executed by an elevator control unit (210), cause the elevator control unit (210) to carry out the method according to any of claims 1 to 10.

Images