Generative artificial intelligence system for passengers

Abstract

An elevator system is provided. An elevator system includes an elevator car including a camera, a viewing screen, and a communication device. In the event that a deaf-mute passenger is trapped in an elevator car, communication via a communication device is initiated, sign language movements expressed by the passenger are observed by a camera, whereupon the sign language movements are translated into messages for an operator, and sign languages associated with the sign language movements are identified, and a response from the operator is displayed to the passenger on the viewing screen.

Description

Background Technology

[0001] This disclosure relates to elevator systems, and more particularly to an intelligent generative artificial intelligence (AI) system for trapped passengers.

[0002] In an elevator system, an elevator car travels up and down along an elevator shaft to reach landing doors on different floors of a building. The elevator's movement is driven by a motor, which is controlled by a drive unit based on instructions received from users of the elevator system. The elevator system can be managed by the owner and / or a third party. This management is particularly important during service interruptions, when passengers may be trapped in the elevator car.

[0003] When passengers are trapped in an elevator car, they typically press the emergency button to notify the operator or use the emergency phone installed in the elevator car. However, when a passenger is disabled, these options may not be sufficient to meet the immediate needs of the trapped disabled passenger. Summary of the Invention

[0004] According to one aspect of this disclosure, an elevator system is provided. The elevator system includes an elevator car, which includes a camera, a viewing screen, and a communication device. In the event that a deaf or mute passenger is trapped in the elevator car, communication is initiated via the communication device. Sign language movements expressed by the passenger are observed by the camera, and the sign language movements are translated into messages for the operator. The sign language associated with the sign language movements is recognized, and the response from the operator is displayed to the passenger on the viewing screen.

[0005] According to another or alternative embodiment, in the event that a deaf or mute passenger is trapped in an elevator car, the response from the operator is displayed to the passenger as a text message on the viewing screen.

[0006] According to another or alternative embodiment, in the event that a deaf or mute passenger is trapped in an elevator car, the response from the operator is translated into sign language movements and expressed to the passenger by a virtual avatar displayed on a viewing screen.

[0007] According to other or alternative embodiments, the camera, observation screen, and communication device are installed inside the elevator car.

[0008] According to other or alternative embodiments, the camera is provided as one or more elevator car cameras.

[0009] According to another or alternative embodiment, the sign language movements expressed by the passenger are forwarded to a cloud-based artificial intelligence (AI) model, and the cloud-based AI model uses all known sign language forms to translate the sign language movements expressed by the passenger.

[0010] According to other or alternative embodiments, sign language movements expressed by passengers are translated into messages for rescuers, and text or verbal responses from rescuers are displayed to passengers as text messages on the viewing screen, and / or sign language movements translated into sign language are expressed to passengers by virtual avatars displayed on the viewing screen.

[0011] According to one aspect of this disclosure, a method is provided for operating an elevator system when a deaf or mute passenger is trapped in an elevator car. The method includes: initiating communication between the passenger and an operator; observing sign language movements expressed by the passenger; forwarding the sign language movements to a cloud-based artificial intelligence (AI) model, whereby the sign language movements are translated into a message for the operator, and the sign language associated with the sign language movements is identified; and one or more of the following: displaying a response from the operator as a text message to the passenger; and translating the response from the operator into sign language movements, and having a displayed virtual avatar convey the operator's response, now translated into sign language, to the passenger.

[0012] According to other or alternative embodiments, cloud-based AI models use all known forms of sign language to translate sign language movements expressed by passengers.

[0013] According to another or alternative embodiment, sign language movements expressed by passengers are translated into messages for rescuers; and one or more of the following: displaying text or verbal responses from rescuers as text to passengers; and translating text or verbal responses from rescuers into sign language movements, and having the text or verbal responses from rescuers translated into sign language movements expressed to passengers by a displayed virtual avatar.

[0014] According to one aspect of this disclosure, an elevator system is provided, comprising an elevator car including a camera, an observation screen, a tactile interface, and a communication device. In the event that a disabled passenger is trapped in the elevator car, communication is initiated via the communication device. The passenger's movement is observed by the camera, and the movement is analyzed. Based on the analysis of the passenger's movement, the passenger's disability is identified. A communication pattern between the operator and the passenger is determined and initiated based on the disability. The communication pattern is executed between the operator and the passenger via at least a subset of the camera, the observation screen, the tactile interface, and the communication device, and vice versa.

[0015] According to other or alternative embodiments, the camera, viewing screen, tactile interface, and communication device are installed inside the elevator car.

[0016] According to other or alternative embodiments, the camera is provided as one or more elevator car cameras.

[0017] According to other or alternative embodiments, the viewing screen includes one or more of a video display and a speaker.

[0018] According to other or alternative embodiments, the tactile interface includes a Braille generator.

[0019] According to another or alternative embodiment, in the event that a passenger is deaf and mute and trapped in an elevator car, communication via a communication device is initiated, and sign language movements expressed by the passenger are observed by a camera. The sign language movements are then translated into a message for the operator, and the sign language associated with the sign language movements is identified. One or more of the following occur: the response from the operator is displayed as text to the passenger on the observation screen; and the response from the operator is translated into sign language movements and expressed to the passenger by a virtual image displayed on the observation screen.

[0020] According to other or alternative embodiments, sign language movements expressed by passengers are forwarded to a cloud-based artificial intelligence (AI) model.

[0021] According to other or alternative embodiments, the AI ​​model uses all known forms of sign language to translate the sign language movements expressed by the passenger.

[0022] According to other or alternative embodiments, the messages for the operator and the responses from the operator are text.

[0023] According to another or alternative embodiment, sign language movements expressed by the passenger are translated into text for the rescuers, and one or more of the following: the text or verbal response from the rescuers is displayed as text to the passenger on the viewing screen; and the text or verbal response from the rescuers is translated into sign language movements and expressed to the passenger by a virtual image displayed on the viewing screen.

[0024] Additional features and advantages are achieved through the technology disclosed herein. Other embodiments and aspects of this disclosure are described in detail herein and are considered part of the claimed technical concept. For a better understanding of this disclosure having these advantages and features, reference is made to the description and the accompanying drawings. Attached Figure Description

[0025] To gain a more complete understanding of this disclosure, reference is now made to the following brief description taken in conjunction with the accompanying drawings and specific embodiments, wherein similar reference numerals denote similar parts:

[0026] Figure 1 This is a perspective view of an elevator system according to an embodiment;

[0027] Figure 2A This is a schematic diagram of an elevator system according to an embodiment;

[0028] Figure 2B According to the embodiments Figure 2A A schematic diagram of an elevator system with video displays and virtual avatar viewing screens;

[0029] Figure 2C According to the embodiments Figure 2A A schematic diagram of a tactile interface with a Braille generator in an elevator system;

[0030] Figure 3 This is a flowchart illustrating a method for operating an elevator system in the event of a deaf or mute passenger being trapped, according to an embodiment; and

[0031] Figure 4 This is a flowchart illustrating a method for operating an elevator system in the event of a passenger with an initially uncertain disability being trapped, according to an embodiment. Detailed Implementation

[0032] When a person is trapped inside an elevator car, a line call can be activated. In some situations (such as when a passenger is deaf and / or unable to speak), the passenger may be unable to express their situation and may not be able to follow the response from the operator on the other end of the call. Simultaneously, the operator may be unable to communicate using sign language. This situation may prevent helpful information from being transmitted to the passenger.

[0033] Therefore, as will be described below, once the connection is established and the passenger is unable to respond to the operator due to deafness and / or muteness, the operator can initiate a sign language-based communication scenario. In this scenario, the elevator car camera captures the passenger's sign language and streams the gestures to a cloud-based AI model. The cloud-based AI model then attempts to convert the gestures into text using all known sign languages ​​by recognizing the sign language used by the passenger and subsequently performing the appropriate gesture-to-text conversion. The text is then displayed to the operator, who can now send a response by typing in text. The response is then displayed in text form and / or translated into "recognized sign language" and streamed via a virtual image on a viewing screen in the elevator car. Communication continues in this manner until rescue personnel are dispatched. Rescuers are also notified of the situation and are shared with the rescuers the basic hand gestures used during the rescue.

[0034] Reference Figure 1 , Figure 1This is a perspective view of an elevator system 101, which includes an elevator car 103, a counterweight 105, a tension member 107, guide rails 109, a motor 111, a position reference system 113, and a controller 115. The elevator car 103 and the counterweight 105 are connected to each other via the tension member 107. The tension member 107 may include or be configured as, for example, ropes, cables, and / or coated steel strips. The counterweight 105 is configured to balance the load of the elevator car 103 and is configured to facilitate simultaneous and opposite movement of the elevator car 103 relative to the counterweight 105 within the elevator shaft 117 and along the guide rails 109.

[0035] Tension member 107 engages motor 111, which is part of the overhead structure of elevator system 101. Motor 111 is configured to control movement between elevator car 103 and counterweight 105. Position reference system 113 may be mounted on a fixed portion at the top of elevator shaft 117, such as on supports or guide rails, and may be configured to provide a position signal relating to the position of elevator car 103 within elevator shaft 117. In other embodiments, position reference system 113 may be mounted directly to the moving part of motor 111, or may be located in other locations and / or configured as known in the art. Position reference system 113 can be any device or mechanism for monitoring the position of elevator car and / or counterweight, as known in the art. For example, without limitation, position reference system 113 can be an encoder, sensor, or other system, and can include rate sensing, absolute position sensing, etc., as will be understood by those skilled in the art.

[0036] As shown in the figure, controller 115 may be located in controller room 121 of elevator shaft 117 and is configured to control the operation of elevator system 101 (and specifically, elevator car 103). It should be understood that controller 115 does not need to be located in controller room 121, but may be located in the elevator shaft or other locations within the elevator system. For example, controller 115 may provide drive signals to motor 111 to control the acceleration, deceleration, leveling, stopping, etc., of elevator car 103. Controller 115 may also be configured to receive position signals from position reference system 113 or any other intended position reference device. When moving up or down along guide rail 109 within elevator shaft 117, elevator car 103 may stop at one or more floors 125 under the control of controller 115. Although shown in controller room 121, those skilled in the art will understand that controller 115 can be located and / or configured in other locations or positions within elevator system 101. In one embodiment, controller 115 may be located remotely or in a distributed computing network (e.g., a cloud computing architecture). The controller 115 can be implemented using a processor-based machine (such as a personal computer, server, distributed computing network, etc.).

[0037] Motor 111 may include an electric motor or a similar drive mechanism. According to embodiments of this disclosure, motor 111 is configured to include an electrically driven motor. The power source for the motor is a variable speed drive, which may generally be referred to as a drive. Motor 111 may include a traction sheave that applies force to tension member 107 to move elevator car 103 within elevator shaft 117.

[0038] Elevator system 101 also includes one or more elevator doors 104. Elevator doors 104 may be integrally attached to elevator car 103, or elevator doors 104 may be located on a landing 125 of elevator system 101, or both. The embodiments disclosed herein are applicable to elevator doors 104 integrally attached to elevator car 103, elevator doors 104 located on a landing 125 of elevator system 101, or both. Elevator doors 104 open to allow passengers to enter and exit elevator car 103.

[0039] Although shown and described as a rope system including a tension member 107, embodiments of this disclosure may be used in elevator systems employing other methods and mechanisms for moving the elevator car within the elevator shaft. For example, embodiments may be used in ropeless elevator systems using linear motors to apply motion to the elevator car. Embodiments may also be used in ropeless elevator systems using hydraulic lifts to apply motion to the elevator car. Embodiments may also be used in ropeless elevator systems using self-propelled elevator cars (e.g., elevator cars equipped with friction wheels, clamping wheels, or traction wheels). Figure 1 These are non-restrictive examples presented for illustrative and explanatory purposes only.

[0040] Continue to refer to Figure 1 And refer to other Figure 2A , 2B And 2C, elevator system 201 is provided to, for example Figure 1 The elevator system 101 is used together. The elevator system 201 includes an elevator car 202, such as... Figure 1 Elevator car 103. Elevator car 202 includes a main body defining the interior 203, camera 204, observation screen 205, and communication device 206. Elevator car 202 may also include: device 207, such as one or more buttons, for initiating communication with operator 208 via communication device 206 and network 209. Network 209 may be a dedicated network for elevator system emergencies. Elevator car 202 may also include: tactile interface 210, such as Braille generator 211 (see...). Figure 2C It is located near observation screen 205.

[0041] Camera 204 can be provided as one or more cameras 204 deployed at multiple locations to establish a combined field of view (FOV) that covers substantially the entire interior 203 of the elevator car 202. Viewing screen 205 can include a video display 2051 and a speaker 2052 (see [link to video display]). Figure 2B One or more of the following: Camera 204, Viewing screen 205, Communication device 206 and Touch interface 210 (where applicable) are all housed inside the elevator car 202 203 and are accessible to passengers.

[0042] In the event that a deaf and / or mute passenger is trapped in elevator car 202, the following actions shall be taken. Initially, the trapped passenger event is determined to be active either by the passenger actuating device 207 or by the elevator system 202 from contextual clues (i.e., through...). Figure 1 Once the controller 115 determines that the elevator car 202 is stuck between floors or has not opened its doors for an unusually long period of time (and determines that the elevator car 202 is occupied based on, for example, the weight reading of the elevator car 102), communication via the communication device 206 is initiated. Next, sign language movements expressed by the passenger are observed by the camera 204. A processor coupled to the camera 204 or provided in the controller 115, or the controller 115 itself, can analyze the passenger's movements to determine that they are indeed sign language movements. This can be achieved by the processor being programmed to identify certain patterns in the passenger's movements as sign language movements or to identify certain passenger movements as common sign language movements, and the processor being able to distinguish common sign language movements from other types of passenger movements. If the processor determines that the passenger's movements are sign language movements, the sign language movements are forwarded to a cloud-based artificial intelligence (AI) model 220 via the communication device 206 and via the network 209. The cloud-based AI model 220 may have access to or may learn all known sign language forms through deep learning algorithms. The sign language movement is then translated into messages (such as text or typed / text messages) by a cloud-based AI model 220 for use by operator 208, and the sign language associated with the sign language movement is recognized by the cloud-based AI model 220. Responses from operator 208 (such as text or typed / text messages) are then translated into sign language movements in the recognized sign language. The response to the sign language movement, now translated into recognized sign language, can be displayed by a virtual avatar 2053 on a viewing screen 205 (see [link to relevant documentation]). Figure 2B This is to be expressed to the passengers.

[0043] According to another embodiment, sign language movements expressed by passengers can also be translated into messages for rescuers 230, and typed / text or verbal responses from rescuers 230 can be translated into sign language movements and expressed to passengers by a virtual avatar 2053 displayed on the viewing screen 205.

[0044] Reference Figure 3 Operating elevator systems (such as...) Figure 2A , 2B Elevator system 201 and / or 2C Figure 1 Method 300 is provided for elevator systems 101). This method is applicable when deaf and / or mute passengers are trapped in an elevator car (such as...). Figure 2A , 2B and elevator car 202 and / or 2C Figure 1 In the case of an elevator car (103), method 300 includes: initiating communication between the passenger and the operator (box 301), observing sign language movements expressed by the passenger (box 302), and forwarding the sign language movements to a cloud-based artificial intelligence (AI) model (box 303). The sign language movements are translated into a message for the operator (i.e., a text or audio message) (box 3031), and the sign language associated with the sign language movements is recognized by the cloud-based AI model (box 3032), which has access to or has learned all known sign language forms via deep learning algorithms (i.e., algorithms for sign language detection and gesture-to-text / text-to-gesture). Method 300 also includes: expressing responses from the operator to the passenger by displaying the responses in text form (box 304). Alternatively, the method may include: translating the response from the operator into sign language movement (box 305), and having a displayed virtual avatar convey the operator's response, which has been translated into sign language, to the passenger (box 306).

[0045] According to another embodiment, method 300 may further include: translating sign language movements expressed by the passenger into messages for rescuers (box 307), and expressing those responses to the passenger by displaying responses from the rescuers in text form (box 308), and / or translating text or verbal responses from the rescuers into sign language movements (box 309), and expressing the text or verbal responses from the rescuers that have been translated into sign language to the passenger by a displayed virtual avatar (box 310).

[0046] Return to reference Figure 2A , 2BRegarding 2C, it should be understood that elevator system 201 can be used in cases where the passenger has a disability that is at least initially uncertain. In such an instance, in the case of a passenger with an uncertain disability trapped in the elevator car, the following actions are taken. Initially, communication via communication device 206 is initiated. The passenger's movement is observed by camera 204 and forwarded to cloud-based AI model 220, whereby the movement is analyzed, and based on the analysis, the passenger's disability is identified. Cloud-based AI model 220 analyzes the passenger's movement and disability by being trained, for example, to identify certain movements of the passenger as potentially indicating certain sign language. That is, if multiple sign languages ​​have similar but not necessarily identical movements for "help" or "I'm trapped!", then cloud-based AI model 220 can be trained to identify all of those movements as either help gestures or trapped gestures. Cloud-based AI model 220 can be further trained to identify the sign language used by the passenger based on the identified gestures. For example, if the sign language gesture for “help” differs from that for “help” in another sign language, the cloud-based AI model 220 can identify the passenger’s preferred sign language based on the gesture used for “help”.

[0047] The communication pattern between operator 208 and passenger is then determined and initiated based on disability. For example, in the case of a deaf and / or mute passenger, the communication pattern is sign language expressed by the passenger and observed by camera 204, with responses from the operator displayed to the passenger as text messages and / or translated into sign language movements, which are then expressed to the passenger by a virtual avatar 2051 displayed on observation screen 205 (i.e., as described above). Figure 2A , 2B and 2C and Figure 3 As an alternative example, in the case of a blind passenger, the communication mode is vocalization expressed by the passenger and received via communication device 206, with responses from the operator expressed to the passenger via speaker 2052 and / or translated into Braille, which is then expressed to the passenger via tactile interface 210. This communication mode is subsequently executed between operator 208 and passenger, and vice versa, via at least a subset of camera 204, viewing screen 205, tactile interface 210, and communication device 206.

[0048] Reference Figure 4 Passengers with initially uncertain disabilities are trapped in elevator cars (such as...) Figure 2A , 2B and elevator car 202 and / or 2C Figure 1 In the case of elevator car 103), operating the elevator system (such as...) Figure 2A , 2B Elevator system 201 and / or 2C Figure 1Method 400 for elevator system 101 is provided. Figure 4 As shown, method 400 includes: initiating communication via a communication device (box 401), observing the passenger's movements by a camera (box 402), identifying those movements as sign language movements as described above, and then forwarding the movements to a cloud-based AI model (box 403). The movements are then analyzed by the cloud-based AI model, which has access to or has learned through deep learning algorithms all known movement types of people with disabilities (box 404), and the passenger's disability is identified based on the analysis of the passenger's movements (box 405). As described above, a passenger's disability can be determined in a similar manner. For example, a passenger using sign language would indicate that the passenger is deaf. Furthermore, a passenger's reluctance to communicate by telephone would indicate that the passenger is mute. Therefore, a passenger using sign language but not using a telephone can be considered deaf or mute. The communication mode between the operator and the passenger is then determined and activated based on the disability (box 406), and is performed between the operator and the passenger and vice versa via at least a subset of cameras, viewing screens, tactile interfaces and communication devices (box 407).

[0049] In the exemplary case where the trapped passenger was identified as deaf and mute... Figure 4 Method 400 can be with Figure 3 The method has 300 combinations. That is, in Figure 4 The communication mode in box 406 can be determined as gesture detection and / or gesture-to-text / text-to-gesture, and according to Figure 4 The communication mode of box 407 is executed. Figure 3 The initiation of communication between passengers and operators in box 301 and Figure 3 The observation of the sign language movement expressed by the passenger in box 302 can be performed.

[0050] The technical effect and benefit of this disclosure is to provide an elevator system capable of enabling intelligent generative AI for communication with trapped passengers. This will improve passenger safety, enhance the experience of trapped passengers, and adapt to the latest technological trends.

[0051] All components or steps in the following claims, along with their corresponding structures, materials, actions, and equivalents of functional elements, are intended to include any structure, material, or action used to perform the function in conjunction with other claimed elements as specifically claimed. The description in this disclosure has been presented for illustrative and descriptive purposes but is not intended to be exhaustive or limiting to the technical concepts presented in the form of the disclosure. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of this disclosure. Embodiments have been chosen and described to best explain the principles and practical application of this disclosure and to enable others skilled in the art to understand the various embodiments of this disclosure with various modifications, suitable for the particular intended use.

[0052] While preferred embodiments of this disclosure have been described, it will be understood that various modifications and enhancements falling within the scope of the following claims will be made by those skilled in the art, both now and in the future. These claims should be construed as providing appropriate protection for this disclosure as first described.

Claims

1. An elevator system, comprising: An elevator car, comprising a camera, a viewing screen, and a communication device. In the case where a deaf or mute passenger is trapped inside the elevator car: Communication via the aforementioned communication device is initiated. The sign language movements expressed by the passenger are observed by the camera, and these movements are then translated into messages for the operator. The associated sign language is then identified. The operator's response is displayed to the passenger on the observation screen.

2. The elevator system according to claim 1, wherein, In the event that a deaf or mute passenger is trapped in the elevator car, the response from the operator is displayed as a text message to the passenger on the viewing screen.

3. The elevator system according to claim 1, wherein, In the event that a deaf or mute passenger is trapped in the elevator car, the response from the operator is translated into sign language movements and expressed to the passenger by a virtual image displayed on the observation screen.

4. The elevator system according to claim 1, wherein, The camera, the viewing screen, and the communication device are installed inside the elevator car.

5. The elevator system according to claim 1, wherein, The camera is provided as one or more elevator car cameras.

6. The elevator system according to claim 1, wherein: The sign language movements expressed by the passenger are forwarded to a cloud-based artificial intelligence (AI) model, and The cloud-based AI model uses all known forms of sign language to translate the sign language movements expressed by the passenger.

7. The elevator system according to claim 1, wherein: The sign language movements expressed by the passenger were translated into messages for rescue personnel, and Text or verbal responses from the rescue personnel are displayed as text messages to the passenger on the observation screen, and / or sign language movements translated into sign language are expressed to the passenger by the virtual avatar displayed on the observation screen.

8. A method for operating an elevator system when a deaf or mute passenger is trapped in an elevator car, the method comprising: Initiate communication between the passengers and the operator; Observe the sign language movements expressed by the passengers; The sign language movement is forwarded to a cloud-based artificial intelligence (AI) model, whereby the sign language movement is translated into a message for the operator, and the sign language associated with the sign language movement is identified; and one or more of the following: The response from the operator is displayed to the passenger as a text message; as well as The operator's response is translated into sign language movement, and the sign language movement, which has been translated into sign language, is expressed to the passenger by a displayed virtual avatar.

9. The method according to claim 8, wherein, The cloud-based AI model uses all known forms of sign language to translate the sign language movements expressed by the passenger.

10. The method of claim 8, further comprising: The sign language movement expressed by the passenger will be translated into a message for rescue personnel; and one or more of the following: The text or verbal response from the rescue personnel will be displayed as text to the passenger; and The sign language movement translates the text or verbal response from the rescuers into the sign language, and the virtual avatar displays the translated sign language movement to convey the text or verbal response from the rescuers to the passenger.

11. An elevator system, comprising: An elevator car, comprising a camera, a viewing screen, a tactile interface, and a communication device. In the case where a disabled passenger is trapped inside the elevator car: Communication via the aforementioned communication device is initiated. The movement of the passengers is observed by the camera, and then the movement is analyzed. Based on the analysis of the passenger's movement, the passenger's disability was identified. The communication pattern between the operator and the passenger is determined and initiated based on the disability, and The communication mode is performed between the operator and the passenger, and vice versa, via at least a subset of the camera, the viewing screen, the tactile interface, and the communication device.

12. The elevator system according to claim 11, wherein, The camera, the viewing screen, the tactile interface, and the communication device are installed inside the elevator car.

13. The elevator system according to claim 11, wherein, The camera is provided as one or more elevator car cameras.

14. The elevator system according to claim 11, wherein, The viewing screen includes one or more of a video display and speakers.

15. The elevator system according to claim 11, wherein, The tactile interface includes a Braille generator.

16. The elevator system according to claim 11, wherein, In the case where the passenger is deaf and mute and trapped in the elevator car: Communication via the aforementioned communication device is initiated. The sign language movements expressed by the passenger are observed by the camera, and these movements are translated into a message for the operator. The sign language associated with the movements is identified, and one or more of the following are also observed: The operator's response is displayed as text to the passenger on the observation screen; and The operator's response is translated into sign language movements and expressed to the passenger by a virtual avatar displayed on the observation screen.

17. The elevator system according to claim 16, wherein, The sign language movements expressed by the passenger are forwarded to a cloud-based artificial intelligence (AI) model.

18. The elevator system according to claim 17, wherein, The AI ​​model uses all known forms of sign language to translate the sign language movements expressed by the passenger.

19. The elevator system according to claim 16, wherein, The messages used by the operator and the responses received by the operator are text.

20. The elevator system according to claim 16, wherein: The sign language movements expressed by the passenger are translated into text for rescue personnel, and one or more of the following: Text or verbal responses from the rescue personnel are displayed as text to the passenger on the observation screen; and The textual or verbal responses from the rescue personnel are translated into sign language movements and expressed to the passenger by the virtual avatar displayed on the observation screen.

Images