Path finding application interface for passenger assistance

Abstract

A system is provided and includes: an electromechanical system; a controller configured to control an operation of the electromechanical system according to a command; and a multi-modal navigation system. The multi-modal navigation system is in communication with the controller to receive information related to the operations of the electromechanical system and is configured to control at least a subset of the operations of the electromechanical system in accordance with the information and at least a subset of the commands.

Description

Technical Field

[0001] This disclosure relates to personnel mobility systems, and in particular to elevator systems, escalator systems, and moving walkway systems, which have passenger-oriented assistance in the form of an auxiliary interface from a wayfinding application, a guiding robot, and elevator functionality. Background Technology

[0002] Specifically, in an elevator system, an elevator shaft is constructed into the building, and the elevator car travels up and down along the shaft to reach different floor doors. The movement of the elevator is driven by a machine, controlled by a controller based on instructions received from the users of the elevator system. During operation, passengers typically arrive at an elevator floor in the building, press the call button, and wait for the elevator to arrive. Once the elevator arrives and its doors open, passengers enter and select their destination floor. The doors close, and the elevator travels up or down to the selected floor, where passengers disembark.

[0003] Using elevators, escalators, and moving walkways can often present challenges for passengers with special needs. Blind or visually impaired passengers may not be able to see elevators, escalators, and moving walkways, their corresponding floors, or their corresponding buttons. Passengers with mobility issues may not be able to enter and exit elevators in a timely manner when doors open or close. Even for passengers without special needs, locating elevators, escalators, and moving walkways within a given building can be difficult, especially when only certain elevators, escalators, and moving walkways serve certain floors or other designated areas. Summary of the Invention

[0004] According to an aspect of this disclosure, a system is provided, comprising: an electromechanical system; a controller configured to control the operation of the electromechanical system according to commands; and a multimodal navigation system. The multimodal navigation system communicates with the controller to receive information related to the operation of the electromechanical system, and is configured to control at least a subset of the operation of the electromechanical system based on at least a subset of the information and the commands.

[0005] According to additional or alternative embodiments, the electromechanical system includes a personnel mobility system deployed in a building.

[0006] According to an additional or alternative embodiment, the route-finding application is a client of the multimodal navigation system, and within the passenger interface, navigation information is displayed and an interface is generated, wherein a first subset of the operations of the electromechanical system is controlled from the interface via a second subset of the commands.

[0007] According to an additional or alternative embodiment, the passenger interface includes graphic markers that appear on the navigation map of the wayfinding application and represent one or more of elevator groups, escalators, and moving walkways and their locations.

[0008] According to an additional or alternative embodiment, when the graphic marker is activated, the passenger interface provides elevator-specific details, including a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, car speed, and one or more additional elevator car characteristics.

[0009] According to an additional or alternative embodiment, when the graphic marker is activated, the passenger interface can be used to call the elevator.

[0010] According to an additional or alternative embodiment, the passenger interface includes a two-button interface.

[0011] According to an additional or alternative embodiment, the passenger interface includes a destination entry interface.

[0012] According to an additional or alternative embodiment, when the graphic marker is activated and is a waypoint, the passenger interface includes at least one of a floor selection menu with automatic elevator calls and notifications.

[0013] According to additional or alternative embodiments, the electromechanical system includes at least one of a bank counter, a shopping checkout counter, and a food ordering counter.

[0014] According to an aspect of this disclosure, a wayfinding application for interacting with a people mobility system is provided. The wayfinding application is executable on a portable computing device and includes a navigation map and a passenger interface generated within the navigation map, the operation of which is controllable via passenger commands through the passenger interface. The passenger interface includes graphic markers appearing on the navigation map and representing one or more of the elevator groups, escalators, and moving walkways of the people mobility system and their locations.

[0015] According to an additional or alternative embodiment, when the graphic marker is actuated or clicked, the passenger interface provides elevator-specific details, including a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, car speed, and one or more additional elevator car characteristics.

[0016] According to an additional or alternative embodiment, the passenger interface can be used to call an elevator when the graphic marker is actuated or clicked.

[0017] According to an additional or alternative embodiment, the passenger interface includes a two-button interface.

[0018] According to an additional or alternative embodiment, the passenger interface includes a destination entry interface.

[0019] According to an additional or alternative embodiment, when the graphic marker is actuated or clicked and is a waypoint, the passenger interface includes at least one of a floor selection menu with automatic elevator calls and notifications.

[0020] According to an aspect of this disclosure, an integrated system is provided, executable on a portable computing device, and includes: a passenger interface; and a plurality of applications networked together for data sharing, the plurality of applications including at least: a multimodal navigation system, wherein a wayfinding application of the multimodal navigation system is a client; and a mobile system application for controlling a personnel mobility system. The passenger interface is configured to present at least the wayfinding application and the mobile system application to a passenger via the portable computing device, such that the wayfinding application and the mobile application interact with the passenger for navigating and controlling the personnel mobility system using sensory feedback transferable to the passenger, the sensory feedback being associated with the passenger's interaction with the wayfinding application and the mobile application.

[0021] According to additional or alternative embodiments, the sensory feedback includes at least one of audio feedback, visual feedback, and tactile feedback.

[0022] According to an additional or alternative embodiment, the wayfinding application is configured for passengers with disabilities.

[0023] According to an additional or alternative embodiment, the passenger interface presents graphic markers in the navigation map of the wayfinding application, the graphic markers representing one or more of the elevator groups, escalators, and moving walkways of the personnel mobility system and their corresponding locations.

[0024] According to an additional or alternative embodiment, at least one of the following: when the graphic marker is actuated or clicked, the passenger interface provides elevator-specific details, including one or more of the following: a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, car speed, and additional elevator car characteristics; and when the graphic marker is actuated or clicked, the passenger interface can be used to call an elevator.

[0025] According to an aspect of this disclosure, a computing system for wayfinding and personnel movement system control is provided. The computing system includes: a personnel movement system deployed in a building and controllable by a control application; a first device configured to execute a first side of the control application; a second device configured to execute a multimodal navigation application and generate navigation information for display within the wayfinding application; and a third device configured to execute a wayfinding application in which a passenger interface is displayed, the passenger interface displaying the navigation information, thereby allowing the passenger to interact with a second side of the control application.

[0026] According to an additional or alternative embodiment, the passenger interface includes graphic markers that appear on the navigation map and represent one or more of the elevator groups, escalators, and moving walkways of the personnel mobility system and their locations.

[0027] According to an additional or alternative embodiment, when the graphic marker is activated, the passenger interface provides elevator-specific details, including a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, car speed, and one or more additional elevator car characteristics.

[0028] According to an additional or alternative embodiment, when the graphic marker is activated, the passenger interface can be used to call the elevator.

[0029] According to an additional or alternative embodiment, the passenger interface includes a two-button interface.

[0030] According to an additional or alternative embodiment, the passenger interface includes a destination entry interface.

[0031] According to an additional or alternative embodiment, when the graphic marker is activated and is a waypoint, the passenger interface includes at least one of a floor selection menu with automatic elevator calls and notifications.

[0032] Additional features and advantages are achieved through the technology disclosed herein. Other embodiments and aspects of this disclosure are described in detail herein and are considered part of the claimed technical concept. For a better understanding of the advantages and features of this disclosure, reference is made to the description and the accompanying drawings. Attached Figure Description

[0033] To gain a more complete understanding of this disclosure, reference is now made to the following brief description in conjunction with the accompanying drawings and detailed description, wherein like reference numerals denote like parts:

[0034] Figure 1 This is a perspective view of an elevator system according to an embodiment;

[0035] Figure 2A This is a schematic diagram illustrating the architecture of an elevator system control application according to an embodiment;

[0036] Figure 2B The illustration shows how the parties, according to the embodiment, interact... Figure 2A A flowchart of the elevator system control application interaction;

[0037] Figure 3 According to the embodiments Figure 2A and Figure 2B A graphical depiction of an example of elevator control application;

[0038] Figure 4 This is a schematic diagram of an elevator control system according to an embodiment;

[0039] Figure 5 The illustration is for use according to an embodiment. Figure 4 A flowchart of the operation method of the elevator control system;

[0040] Figure 6 This is a schematic diagram of the system according to an embodiment;

[0041] Figure 7 It is a graphical display of a pathfinding application having a user interface generated therein, according to an embodiment;

[0042] Figure 8 This is a schematic diagram of a computing system for pathfinding and elevator system control according to an embodiment;

[0043] Figure 9 It is a graphical illustration of an automated pathfinding system with robot guidance;

[0044] Figure 10 This is a graphical illustration of a robot guide virtually attached to a passenger according to an embodiment;

[0045] Figure 11 This is a graphical illustration of a robot guide coupled to a passenger's wheelchair according to an embodiment;

[0046] Figure 12 This is a graphic illustration of a robot guide provided as a passenger's wheelchair according to an embodiment;

[0047] Figure 13 This is a flowchart illustrating the operation method of an automatic pathfinding system according to an embodiment; and

[0048] Figure 14 This is a schematic diagram illustrating an interactive system executable on a portable computing device according to an embodiment. Detailed Implementation

[0049] There is a persistent need for the use of elevator systems, escalators, and moving walkways, and more generally, a persistent need for building transportation systems to be more inclusive and easier to use so that buildings can be more easily navigated. This is especially true for passengers with special needs, such as blind or visually impaired passengers and passengers with mobility problems.

[0050] Therefore, as described below, the personnel mobility system is provided in the form of an elevator system, escalator system, and / or moving walkway system, with dual-sided applications including both the passenger side and the building side. Several users of different types can be included based on their respective roles (i.e., passengers, mechanics, etc.), with each user optionally having a detailed profile for each user type. Based on passenger data, certain modules are activated to assist passengers when they wish to use the personnel mobility system (i.e., visual assistance for those with visual challenges, voice assistance for deaf passengers, and slow operation for passengers with mobility difficulties). Similar profiles can be created by building owners interested in using the application platform to improve inclusivity, usability, and building navigation. Furthermore, an elevator system is provided where a navigation application (e.g., a navigation application installed on a smartphone) allows passengers to navigate the personnel mobility system independently without requiring a separate personnel mobility system application. Additionally, an automated wayfinding system is provided that uses robotics to mimic the behavior of a hotel concierge or porter. The automated wayfinding system can be invoked by the aforementioned applications, particularly where (one or more) passengers can register their desired destination, whereby the system can respond by assigning a robotic guide assistant. Based on passenger profiles and needs, the robotic guide assistant can range from simple navigational robotic guides to robotic assistive devices coupled to wheelchairs, stand-alone robotic wheelchairs, and luggage carriers. The system's robotic guide dispatcher will send the appropriate guide device to the passenger and will use building layout data to provide a navigation path to their elevator. The robotic assistive device will move along this path and will be virtually tethered to the passenger using human detection technologies such as LiDAR, RADAR, millimeter-wave sensing, and optical sensing to ensure it stays close to the passenger and moves at their pace. The robotic assistive device can provide coordinated movement when needed and can accompany them in the elevator if required. Once at the elevator, the robotic assistive device can signal its presence and readiness to board. The robotic assistive device can also be programmed to converse with passengers using greetings and helpful information (similar to what doormen and porters would offer). When needed, the robotic assistive device can also provide storage for passengers' bags and other belongings.

[0051] The following description will relate to personnel movement systems, particularly elevator systems. This is done for clarity and brevity and should not be construed as limiting the specification or the appended claims in any way. It should also be understood that other personnel movement systems may include, but are not limited to, escalator systems and moving walkway systems, all of which will be readily apparent to a person skilled in the art without any excessive experimentation. Therefore, any references in the following description should be construed as relating to elevator systems, escalator systems, moving walkway systems, other similar systems, and / or personnel movement systems in general.

[0052] refer to Figure 1 This is a perspective view of an elevator system 101, which includes an elevator car 103, a counterweight 105, a tension member 107, guide rails 109, a machine 111, a position reference system 113, and a controller 115. The elevator car 103 and the counterweight 105 are connected to each other via the tension member 107. The tension member 107 may include or be configured as, for example, ropes, cables, and / or coated steel strips. The counterweight 105 is configured to balance the load of the elevator car 103 and to facilitate simultaneous and opposite movement of the elevator car 103 relative to the counterweight 105 within the elevator shaft 117 and along the guide rails 109.

[0053] Tension member 107 engages machine 111, which is part of the overhead structure of elevator system 101. Machine 111 is configured to control movement between elevator car 103 and counterweight 105. Position reference system 113 may be mounted on a fixed portion at the top of elevator shaft 117, such as on a bearing or guide rail, and may be configured to provide a position signal relating to the position of elevator car 103 within elevator shaft 117. In other embodiments, position reference system 113 may be directly mounted to a moving component of machine 111, or may be positioned in other locations and / or configurations as known in the art. As known in the art, position reference system 113 can be any device or mechanism for monitoring the position of elevator car and / or counterweight. For example, and not limitingly, as those skilled in the art will appreciate, position reference system 113 can be an encoder, sensor, or other system, and can include speed sensing, absolute position sensing, etc.

[0054] As shown, controller 115 can be located in controller room 121 of elevator shaft 117 and configured to control the operation of elevator system 101 and, in particular, the operation of elevator car 103. It should be understood that controller 115 does not need to be in controller room 121, but can be in the elevator shaft or other locations within the elevator system. For example, controller 115 can provide drive signals to machine 111 to control the acceleration, deceleration, leveling, stopping, etc., of elevator car 103. Controller 115 can also be configured to receive position signals from position reference system 113 or any other desired position reference device. As the elevator car 103 moves up or down along guide rail 109 within elevator shaft 117, it can stop at one or more landings 125 as controlled by controller 115. Although shown in controller room 121, those skilled in the art will appreciate that controller 115 can be located and / or configured in other locations or positions within elevator system 101. In one embodiment, controller 115 may be remotely located or located within a distributed computing network (e.g., a cloud computing architecture). Controller 115 may be implemented using a processor-based machine (e.g., a personal computer, server, distributed computing network, etc.).

[0055] Machine 111 may include a motor or similar drive mechanism. According to embodiments of this disclosure, machine 111 is configured to include an electrically driven motor. The motor is powered by a variable speed drive, which is generally referred to as a drive. As will be understood by those skilled in the art, the drive includes several circuits, such as an inverter, rectifier stage, filter, and control circuitry, to control the motor. Machine 111 may include traction pulleys that transmit force to tension member 107 to move elevator car 103 within elevator shaft 117.

[0056] Elevator system 101 also includes one or more elevator doors 104. Elevator doors 104 may be integrally attached to elevator car 103 or may be positioned on a landing 125 of elevator system 101, or both. The embodiments disclosed herein may be applied to elevator doors 104 integrally attached to elevator car 103 or elevator doors 104 positioned on a landing 125 of elevator system 101, or both. Elevator doors 104 open to allow passengers to enter and exit elevator car 103.

[0057] Although illustrated and described with a rope system including tension member 107, embodiments of this disclosure may be used in elevator systems employing other methods and mechanisms for moving the elevator car within the elevator shaft. For example, embodiments may be used in cordless elevator systems using linear motors to transmit motion to the elevator car. Embodiments may also be used in cordless elevator systems using hydraulic lifts to transmit motion to the elevator car. Embodiments may also be employed in cordless elevator systems using self-propelled elevator cars (e.g., elevator cars equipped with friction wheels, clamping wheels, or traction sheaves, escalator assemblies, and moving walkways). Figure 1 These are non-restrictive examples presented for illustrative and explanatory purposes only.

[0058] Continue to refer to Figure 1 And refer to other sources. Figure 2A and Figure 2B as well as Figure 3 , Figure 1 The elevator system 101 can be provided with application 201 or is typically controlled by application 201.

[0059] like Figure 2AAs shown, application 201 includes: a passenger database 210, which optionally includes information about different types of passengers (e.g., mechanics, facility owners, public servants, salespeople, employees, building residents, and guests); and a passenger profile database 220, which includes optional passenger profiles for each passenger included in passenger database 210 who has chosen to create a passenger profile. The passenger profile for each passenger who has chosen to create a passenger profile may include at least one or more of disability information 221 (as well as passenger preferences and various other characteristics), role information 222, assistive information 223, and device information 224, all of which can be entered by the passenger when deemed appropriate, and all of which can be guarded and protected so that no other person has the right to access them. Disability information 221 describes the corresponding passenger's disability (i.e., any disability, such as but not limited to vision, mobility, memory, communication, hearing, etc.) as well as the passenger's preferences and various other characteristics; role information 222 describes the corresponding passenger's role (i.e., any function, such as but not limited to working in the building, living in the building, visiting the building, etc.); assistive information 223 describes the corresponding passenger's assistive mechanism (e.g., his / her wheelchair); and device information 224 describes the corresponding passenger's portable electronic device (i.e., any device or device type, such as but not limited to a watch, telephone, gadgets, computer, etc.). Application 201 also includes a building profile database 230 and an assistive database 240. The building profile database 230 may include a description of the building where the elevator system 101 is deployed (i.e., offices, layout, rooms, key locations including elevator groups, available robots, etc.). The assistive database 240 may include descriptions of assistive devices with various preferences, expectations, needs, or requirements (i.e., any assistive device, such as but not limited to, talkative, quiet, professional, and / or friendly robots, service pets, gadgets, etc.).

[0060] Similarly, Figure 2A As shown, application 201 can interface with third-party tools 250 (such as wayfinding applications, visual assistance applications or devices, and hearing assistance applications or devices) and can be provided with artificial intelligence (AI) and / or machine learning (ML) capabilities 260. The third-party tool 250 can provide one or more services, including greetings, wheelchair parking, support, navigation services, information provision, elevator calling, and dispatching.

[0061] like Figure 2BAs shown, for example, application 201 can be provided as a two-sided service for both users and building owners. On the passenger side 301, users download and / or use application 201 and register, and then they enter their profile information and any applicable disability information. On the business owner side 302, a representative of the building owner downloads and / or uses application 201 and registers, and then provides a description of the building, including disability support information, layout, available robots, etc. Separately from the passenger side 301 and the business owner side 302, a third-party tool 250 may, in certain circumstances, have access to user information and building information, enabling the third-party tool 250 to provide corresponding services.

[0062] Using the above architecture, application 201 can define operation module 1 for passengers, operation module 2 for mechanics, operation module 3 for building owners, operation module 4 for potential customers, operation module 5 for sales personnel, etc.

[0063] like Figure 3 As shown, in an exemplary instance, Figure 1 The elevator system 101 can be deployed in, for example, an office building 310 having multiple floors 311 and multiple offices 312 on each floor 311 (of course, the building does not have to be an office building). The office building 310 can be owned by an owner who is a registered user of the application 201, and the passenger 320 can be blind or visually impaired and can also be a registered user of the application 201. Upon registration, the passenger 320 identifies himself / herself as blind or visually impaired and requires navigation and wayfinding assistance to the application 201, and the building owner provides the application 201 with the layout of each office 312 on each floor 311 and the layout of the elevator group 313 serving those offices 312 and floors 311. In this exemplary instance, the passenger 320 can input his / her destination into the application 201, in which case the destination can be an apartment, office, or another business location 312 on a specific floor 311 of the office building 310. Thus, the application 201 guides the passenger 201 to the office building 310 via voice navigation through his / her smartphone. Once inside office building 310, application 201 provides additional voice navigation to the nearest elevator group 313, so application 201 can then... Figure 1 The controller 115 calls the elevator 314 without the passenger needing to press a call button, and can also... Figure 1 The elevator system 101 inputs the destination floor. Once the elevator 314 arrives, the application 201 can guide passengers into and out of the elevator 314 without requiring passengers to press floor buttons, and once the elevator 314 reaches the destination floor 311, it can guide passengers to the destination apartment, office or other commercial location 312.

[0064] Continue to refer to Figures 1-3 And refer to other sources Figure 4 A control system 401 is provided, and includes an elevator system 410, for example... Figure 1 The elevator system, or more specifically, the controller 115 deployed in building 420, passenger devices 430 (e.g., portable computing devices and / or smartphones), and building owner devices 440 (e.g., portable computing devices, smartphones, and / or computer systems of building 420). The memory of passenger device 430 has elevator control applications stored thereon (i.e., Figure 2A , Figure 2B and Figure 3 The first executable instruction of the application 201, when executed, causes the processor of the passenger device 430 to register the passenger with the elevator control application, store the passenger profile in the elevator control application, and generate a passenger interface 431 through which the passenger can interface with the elevator control application. The memory of the building owner device 440 has a second executable instruction of the elevator control application stored thereon, which, when executed, causes the processor of the building owner device 440 to register the building 420 with the elevator control application and store a description of the building 420 in the elevator control application. According to an embodiment, the passenger profile may include at least the passenger's disability information, preferences, and various other characteristics (i.e., user-supplied or passenger-supplied disability information entered by the user or the passenger themselves), and the description of the building 420 may include at least the available assistive information of the building 420, as well as the building address, building name, tenant list, and other characteristics of the building 420.

[0065] Typically, a passenger profile includes a description of the passenger's type, as well as information such as the passenger's disability (along with the passenger's preferences and various other characteristics, any other personal information the passenger wishes to share regarding his / her mobility preferences, expectations, and / or needs and requirements), and at least one or more of the passenger's role information, passenger assistance information, and passenger device information. Additionally, the description of building 420 typically includes the location of building 420, a description of the floors and floor layout of building 420, available assistance information for building 420, and a description of the building's services.

[0066] Continue to refer to Figure 4 And in exemplary cases (see Figure 3(and the attached text), when executed, the first executable instruction of the elevator control application causes the processor of passenger device 430 to provide navigation and assistance to passengers traveling to and through building 420 via passenger interface 431, based on passenger profiles, passenger disability information, passenger preferences and various other characteristics, a description of building 420, and available assistance information for building 420. The navigation and assistance may include, for example, finding a way to and through building 420. Furthermore, when executed, the second executable instruction of the elevator control application causes the processor of building owner device 440 to instruct elevator system 410 to provide available assistance to passengers traveling to and through building 420, based on passenger profiles, passenger disability information, passenger preferences and various other characteristics, a description of building 420, and available assistance information for building 420. The available assistance may include, for example, automatic elevator calling and dispatching, and automatic elevator system operation adjustments.

[0067] refer to Figure 5 Provided Figure 4 The control system operation method 500 of control system 401. For example... Figure 5 As shown, the control system operation method 500 includes registering passengers with an elevator control application (box 501), storing passenger profiles in the elevator control application (box 502), registering buildings with the elevator control application (box 503), storing descriptions of buildings in the elevator control application (box 504), providing navigation and assistance to passengers traveling to and through buildings via a passenger interface based on passenger profiles and building descriptions (box 505), and directing the elevator system (i.e., Figure 1 The controller 115 provides available assistance to passengers traveling to and through the building based on passenger profiles and a description of the building (box 506). According to an embodiment, providing navigation and assistance via the passenger interface in box 505 may include, for example, finding one's way to and through the building (box 5051), and providing available assistance by directing the elevator system in box 506 may include, for example, directing the elevator system to perform automatic elevator calls and dispatches, as well as automatic elevator system operation adjustments (box 5061).

[0068] refer to Figure 6 System 601 is provided and includes electromechanical system 610 and controller 620 (e.g., Figure 1The electromechanical system 610 includes a controller 115 and a multimodal navigation system 630. According to embodiments, the electromechanical system 610 may include an elevator system (or escalator or moving walkway) 611, a bank counter 612, a shopping checkout counter 613 and a food ordering counter 614, and any one or more of controlled doors 615 and rotary doors 616. The controller 620 may be, but is not required to be, controllable and operable by the main operator of the electromechanical system 610. In any case, the controller 620 is configured to control the operation of the electromechanical system 610 according to passenger commands.

[0069] The multimodal navigation system 630 can be provided, for example, as an end-to-end multimodal navigation system, wherein the various modes of travel include, but are not limited to, people transport systems such as elevators, escalators and moving walkways, walking systems on sidewalks, through corridors and up and down stairs, drive systems on road networks (including supply to parking garages and parking lots, public transport systems such as trains, subways and buses, bicycle systems, systems for allowing passage through security gates and turntables), etc.

[0070] The multimodal navigation system 630 communicates with the controller 620. In this configuration, the multimodal navigation system 630 receives information related to the operation of the electromechanical system 610 and is configured to control at least a first subset of the operation of the electromechanical system 610 based on at least a second subset of the information received from the controller 620 and passenger commands. According to an embodiment, the multimodal navigation system 630 can be configured to generate a route (or multiple routes selectable by the user) from a starting point to a destination point, wherein the route can traverse multiple “modes,” such as driving a car, taking a train, walking on a sidewalk, taking an elevator, etc. Furthermore, the multimodal navigation system 630 considers convenience factors, such as the time required to traverse a route in a given mode. It is to be understood that, as used herein, the terms “starting point” and “destination point” can refer to geographic location and vertical location, such as the number of floors in a building.

[0071] refer to Figure 7 In cases where the electromechanical system 610 includes, or is provided as, an elevator system 611, as an example, the electromechanical system 610 can be deployed in a building as described above, where the main operator is the building owner. In these or other cases, the wayfinding application 701 is a client of the multimodal navigation system 630 and, within the passenger interface 710, displays navigation information and generates an interface from which at least a first subset of the operation of the electromechanical system 610 can be controlled via information and at least a second subset of passenger commands.

[0072] like Figure 7As shown, the passenger interface 710 may include graphic markers 711 (which may be actuated or clickable, as in virtual or real-world buttons, or may be any other type of interactive element) appearing on the navigation map 702 of the wayfinding application 701 and representing elevator groups and their locations. When the graphic marker 711 is actuated or clicked, the passenger interface 710 provides elevator-specific details 712, including one or more of the following: a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, and car speed. Furthermore, when the graphic marker 711 is actuated or clicked, the passenger interface 710 can be used to call an elevator and may include at least one or more of a two-button interface 713 and a destination entry interface 714. Additionally, when the graphic marker 711 is actuated or clicked and is a waypoint along the passenger's navigation path, the passenger interface 711 may include at least one of a floor selection menu with automatic elevator calling and automatic notification capabilities, which may be provided as a menu button 715.

[0073] In exemplary cases where the electromechanical system 610 includes or is provided as at least one of a bank counter 611, a shopping checkout counter 612, and a food ordering counter 613, the electromechanical system 610 can be deployed in the building or space area described above, where the main operator is the owner of the building or space area. In these or other cases, the multimodal navigation system 630 can again be Figure 7 The publisher of the navigation application 701 can generate an interface within the navigation application 701 through which at least a subset of the operation of the electromechanical system 610 can be controlled via at least a subset of passenger commands. That is, the user of the navigation application 701 will be able to use the navigation application to navigate to and control the bank counter 611, for example, using his / her smartphone without removing his / her bank card or interfacing with the control buttons on the bank counter 611 itself.

[0074] refer to Figure 8 The computing system 801 is provided for pathfinding and elevator system control. This computing system includes components deployed within the building and, for example, [missing information - likely referring to a specific component or unit]. Figure 2A and Figure 2B An elevator control application, such as application 201, can control an elevator system 810, a first device 820, a second device 830, and a third device 840 configured to execute the elevator control application. The second device 830 is configured to execute, for example... Figure 7 The first side of the pathfinding application, such as 701, and generates, for example... Figure 7A passenger interface, such as passenger interface 710, is provided for display within a wayfinding application, through which passengers can interact with a second side of the elevator control application. A third device 840 is configured to execute a second side of the wayfinding application with the passenger interface displayed therein, thereby enabling passengers to interact with the second side of the elevator control application.

[0075] As described above, the passenger interface may include graphic markers (which may be actuated or clickable, as in virtual or real-world buttons, or may be any other type of interactive element) that appear on the navigation map of the wayfinding application and represent elevator groups and their locations. When a graphic marker is actuated or clicked, the passenger interface provides one or more of the following elevator-specific details: a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, car speed, and additional elevator car characteristics (i.e., operating status, car size and speed, whether the elevator car is a glass elevator, elevator car style or theme, etc.). Furthermore, when a graphic marker is actuated or clicked, the passenger interface can be used to call an elevator and may include at least one of a two-button interface and a destination entry interface. Additionally, when a graphic marker is actuated or clicked and is a waypoint along the passenger's navigation path, the passenger interface may include at least one of the following floor selection menus with automatic elevator calling and automatic notification capabilities (see [link to relevant documentation]). Figure 7 ).

[0076] refer to Figure 9 and Figure 10 An automated pathfinding system 901 is provided and includes a robot guide 910 (which may be one of multiple robot guides 910, each with a unique configuration), a passenger interface 920, and a dispatch module 930. The passenger provides input of their desired destination through the passenger interface 920. Upon receiving the desired destination input, the dispatch module 930 dispatches the robot guide 910 to the passenger. In addition to providing destination input, the passenger can also generate a passenger profile through the passenger interface 920, which may include a description of the passenger's disabilities, preferences, and various other characteristics. At least one of the robot guide 910 and the dispatch module 930 has access to a navigation map that includes the desired destination, the passenger's current location, and information related to one or more paths from the passenger's current location to the desired destination. The robotic guide 910 can be provided with a unique configuration corresponding to the passenger's disability, preferences, and various other characteristics, and is programmed to guide the passenger along one or more paths while remaining tethered to the passenger. In this case, the dispatch module 930 selects the robotic guide 910 whose configuration corresponds to the passenger's disability, preferences, and various other characteristics (i.e., Figure 9 The robot guide 910 was selected to correspond to blindness, and Figure 11 and Figure 12 The robotic guide was selected to correspond with passengers who require mobility assistance.

[0077] According to embodiments, the automated pathfinding system 901 can be deployed in buildings including elevator systems as described above, and in these or other cases, the navigation map can include information about the elevator system, and one or more paths can include elevator entrances and exits as well as vertical movement along the elevator shaft. In any case, the robot guide 910 can communicate with the elevators of the elevator system (i.e., make elevator calls on behalf of passengers) and can communicate with passengers, and is provided with storage components 911 for luggage and other packages.

[0078] like Figure 9 and Figure 10 As shown, the robotic guide 910 can be virtually tethered to a passenger and can use detection technologies such as LiDAR to detect the passenger's position while guiding the passenger along one or more paths. It can also be programmed to stay close to the passenger by matching their pace. This could be particularly helpful if the passenger's disability is blindness, for example, as... Figure 10 As shown, the robotic guide 910 is able to guide passengers very closely, but does not require the robotic guide 910 to be physically tethered to the passengers.

[0079] refer to Figure 11 and Figure 12 The robot guide 910 can be physically tethered to the passenger by coupling with the passenger's wheelchair 1101 or by using an independent wheelchair 1201 that is itself the passenger.

[0080] refer to Figure 13 ,For example Figure 1 An operation method 1300 for an automated pathfinding system, such as an automated pathfinding system 901, is provided and can be deployed in buildings including elevator systems as described above. The operation method 1300 includes registering a passenger (box 1301), receiving a passenger profile from the passenger (box 1302), and receiving input of the desired destination from the passenger (box 1303). The operation method 1300 also includes selecting a robot guide with a unique configuration corresponding to the passenger profile from a plurality of robot guides (box 1304), assigning the robot guide to the passenger (box 1305), and programming the robot guide to guide the passenger from the passenger's current location to the desired destination while maintaining tether to the passenger (box 1306).

[0081] refer to Figure 14An integrated system 1401 is provided and executable on a portable computing device 1410. The integrated system includes a passenger interface 1411 and multiple applications 1420 networked together for data sharing. The multiple applications 1420 may include at least: a multimodal navigation system, wherein a wayfinding application of the multimodal navigation system is a client; and a mobility system application for controlling a personnel mobility system (e.g., the elevator system described above). The passenger interface 1411 is configured to present at least the wayfinding application and the mobility system application to a passenger via the portable computing device 1410, such that the wayfinding application and the mobility application interact with the passenger for navigation and control of the personnel mobility system using sensory feedback that can be transmitted to the passenger (from sensors in the portable computing device 1410), the sensory feedback being associated with the passenger's interaction with the wayfinding application and the mobility application. According to an embodiment, the sensory feedback may include at least one of audio feedback, visual feedback, and tactile feedback. According to another embodiment, the wayfinding application may be configured for passengers with disabilities or a preferred set of assistive modalities. In any case, the passenger interface 1411 may present graphic markers in the navigation map of the wayfinding application (see...). Figure 7 The graphic marker represents one or more of the elevator groups, escalators, and moving walkways in the personnel movement system, and their respective locations. As described above, when the graphic marker is actuated or clicked, the passenger interface provides elevator-specific details, including a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, car speed, and one or more additional elevator car characteristics. Furthermore, as described above, when the graphic marker is actuated or clicked, the passenger interface can be used to call an elevator.

[0082] The technical effects and benefits of this disclosure are to provide an elevator system application that enables and assists people (especially those with disabilities) to dock with the elevator for access, use, service, and maintenance. This also enables buildings to generate additional revenue by providing services to customers through rental assistance or services, as well as advertising in robotics and communications. It also improves accessibility for people with disabilities across all user bases and lifecycles. Furthermore, an elevator system is provided that utilizes a navigation application for wayfinding and provides users with a way to dock with the elevator system and its elevators without requiring the installation of an elevator system application. In addition, the robotic assistance of the elevator system effectively provides passengers (e.g., passengers with physical disabilities) with automated doorman and porter services to assist them in navigating within the building, thereby reducing their stress through interactive technology to facilitate their requests and navigation.

[0083] All components or steps plus functional elements in the following claims are intended to include corresponding structures, materials, actions, and equivalents for performing functions in combination with other claimed elements as specifically claimed. The description of this disclosure has been presented for illustrative and descriptive purposes, but is not intended to be exhaustive or limited to the technical concepts of the disclosed forms. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of this disclosure. Embodiments have been chosen and described to best explain the principles and practical application of this disclosure and to enable others skilled in the art to understand the disclosure of various embodiments with various modifications as suited to the particular intended use.

[0084] Although preferred embodiments of this disclosure have been described, it will be understood that those skilled in the art will now and in the future make modifications falling under the following claims. Various improvements and enhancements within the scope. These claims should be interpreted as maintaining the scope of... Appropriate protection for the first public disclosure.

Claims

1. A system comprising: Electromechanical systems; A controller, configured to control the operation of the electromechanical system according to commands; as well as A multimodal navigation system that communicates with the controller to receive information related to the operation of the electromechanical system, and is configured to control at least a subset of the operation of the electromechanical system based on at least a subset of the information and the commands.

2. The system according to claim 1, wherein, The electromechanical system includes a personnel mobility system deployed within the building.

3. The system according to claim 2, wherein, The route-finding application is the client of the multimodal navigation system, and displays navigation information and generates an interface within the passenger interface. A first subset of the operations of the electromechanical system is controlled from the interface through a second subset of the commands.

4. The system according to claim 3, wherein, The passenger interface includes graphic markers that appear on the navigation map of the wayfinding application and represent one or more of elevator groups, escalators, and moving walkways and their locations.

5. The system according to claim 4, wherein, When the graphic marker is activated, the passenger interface provides elevator-specific details, including a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, car speed, and one or more additional elevator car characteristics.

6. The system according to claim 4, wherein, When the graphic marker is activated, the passenger interface can be used to call the elevator.

7. The system according to claim 6, wherein, The passenger interface includes a dual-button interface.

8. The system according to claim 6, wherein, The passenger interface includes a destination entry interface.

9. The system according to claim 1, wherein, The electromechanical system includes at least one of a bank counter, a shopping checkout counter, a food ordering counter, a control door, and a revolving door.

10. An integrated system executable on a portable computing device, comprising: Passenger interface; as well as Multiple applications, which are networked together for data sharing, and the multiple applications include at least: A multimodal navigation system, wherein the pathfinding application of the multimodal navigation system is a client; as well as A mobile system application for controlling a personnel mobility system, wherein the passenger interface is configured to present at least the wayfinding application and the mobile system application to the passenger via the portable computing device, such that the wayfinding application and the mobile application interact with the passenger for navigating and controlling the personnel mobility system with sensory feedback that can be transmitted to the passenger, the sensory feedback being associated with the passenger's interaction with the wayfinding application and the mobile application.

11. The integrated system according to claim 10, wherein, The sensory feedback includes at least one of audio feedback, visual feedback, and tactile feedback.

12. The integrated system according to claim 10, wherein, The wayfinding application is configured for passengers with disabilities.

13. The integrated system according to claim 10, wherein, The passenger interface displays graphic markers on the navigation map of the wayfinding application, which represent one or more of the elevator groups, escalators, and moving walkways of the personnel mobility system and their corresponding locations.

14. The integrated system according to claim 13, wherein, At least one of the following: When the graphic marker is actuated or clicked, the passenger interface provides elevator-specific details, including a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, car speed, and one or more additional elevator car characteristics. When the graphic marker is actuated or clicked, the passenger interface can be used to call the elevator.

15. A computing system for controlling a pathfinding and personnel movement system, the computing system comprising: A personnel movement system, which is deployed in a building and is controllable by a control application; A first device, the first device being configured to execute a first side of the control application; A second device is configured to execute a multimodal navigation application and generate navigation information for display within the wayfinding application; as well as A third device is configured to execute a wayfinding application in which the passenger interface displays navigation information, thereby allowing the passenger to interface with a second side of the control application.

16. The computing system according to claim 15, wherein, The passenger interface includes graphic markers that appear on the navigation map and represent one or more of the elevator groups, escalators, and moving walkways of the personnel mobility system and their locations.

17. The computing system according to claim 16, wherein, When the graphic marker is activated, the passenger interface provides elevator-specific details, including a list of floors served, estimated elevator arrival time, number of elevators, elevator operating status, queue length, elevator car size, car speed, and one or more additional elevator car characteristics.

18. The computing system according to claim 7, wherein, When the graphic marker is activated, the passenger interface can be used to call the elevator.

19. The computing system according to claim 18, wherein, The passenger interface includes a dual-button interface.

20. The computing system according to claim 18, wherein, The passenger interface includes a destination entry interface.

Images