Methods and systems for orientation of users in vehicles or other environments

Abstract

Methods and systems for user orientation within vehicles or other environments are provided. According to exemplary embodiments, the methods and systems include one or more sensors of the user's environment and a processor. The one or more sensors are configured to acquire sensor data about the environment. The processor is coupled to the one or more sensors and configured to at least facilitate: determining one or more available locations within the environment using the sensor data; and providing one or more assistive actions to the user relative to the one or more available locations.

Description

Technical Field

[0001] The technical field generally relates to vehicles and other environments, and more specifically to methods and systems for facilitating orientation within vehicles or other environments, including orientation for passengers, occupants, or other users with visual impairments and / or other disabilities. Background Technology

[0002] Occupants of vehicles and other environments (e.g., cars, buses, trains, cinemas, and other environments) may encounter obstacles or other user orientation problems when entering the environment, including for users who may have visual impairments and / or other disabilities.

[0003] Therefore, it is desirable to provide methods and systems for facilitating user orientation within environments, including for users who may have visual impairments and / or other disabilities. Summary of the Invention

[0004] According to an exemplary embodiment, a method is provided, the method comprising: acquiring sensor data about the environment in which a user is located via one or more sensors of the environment; using the sensor data to determine one or more available locations within the environment for the user to utilize via a processor; and providing one or more assistive actions to the user relative to the one or more available locations via instructions provided by the processor.

[0005] Similarly, in an exemplary embodiment, the step of determining one or more available locations includes: using sensor data, via a processor, determining one or more currently unoccupied available seating locations where the user can sit in the environment; and the step of providing one or more assistance actions includes: via instructions provided by the processor, performing one or more assistance actions to enable the user to find one or more available seating locations.

[0006] Similarly, in an exemplary embodiment, the step of providing one or more assistance actions includes: providing a notification to the user via instructions provided by the processor, through the transmission of a message identifying one or more available seat locations to the user's electronic device.

[0007] Similarly, in an exemplary embodiment, the step of providing one or more assistive actions includes: providing one or more notifications via instructions provided by the processor, through one or more output modalities perceived by the user at a corresponding location in one or more available seating positions.

[0008] Also in an exemplary embodiment, the step of determining one or more available locations further includes: using sensor data, via a processor, determining which of the one or more available seating locations include available clean seating locations that are both clean and currently unoccupied; and the step of providing one or more assistance actions includes: via instructions provided by the processor, performing one or more assistance actions to enable a user to find one or more available clean seating locations.

[0009] Also in an exemplary embodiment, the method further includes: providing one or more additional assistive actions via instructions provided by the processor so that the user can utilize one or more safety features associated with one or more available seating locations, including one or more emergency exits, one or more emergency stop buttons, or both.

[0010] Similarly, in an exemplary embodiment, the step of determining one or more available locations includes: using sensor data, via a processor, determining one or more available interfaces through which a user can interact with the environment; and the step of providing one or more assistive actions includes: via instructions provided by the processor, performing one or more assistive actions so that the user can find one or more available interfaces and learn how to interact with these interfaces.

[0011] Similarly, in the exemplary embodiment, the environment includes a vehicle; the user includes a passenger of the vehicle; and one or more available seating positions include one or more passenger seating positions of the vehicle.

[0012] Also in an exemplary embodiment, the method further includes: using sensor data to determine the route and direction of movement of the vehicle via a processor; and providing passengers with information about the route and direction of movement of the vehicle via instructions provided by the processor.

[0013] Also in an exemplary embodiment, the method further includes: determining the position of a seatbelt for one or more passenger seating positions via a processor; and providing one or more additional assistive actions to assist a passenger in using the seatbelt via instructions provided by the processor.

[0014] In another exemplary embodiment, a system is provided that includes one or more sensors of the user's environment and a processor. The one or more sensors are configured to acquire sensor data about the environment. The processor is coupled to the one or more sensors and is configured to at least facilitate: using the sensor data to determine one or more available locations within the environment for the user to utilize; and providing one or more assistive actions to the user relative to the one or more available locations.

[0015] Similarly, in an exemplary embodiment, one or more available locations include one or more available seating locations that are currently unoccupied using sensor data and that the user can sit in the environment; and the processor is also configured to at least facilitate: performing one or more assistive actions to enable the user to find one or more available seating locations.

[0016] Also in an exemplary embodiment, the processor is configured to at least facilitate: providing a notification to the user via the transmission of a message identifying one or more available seat locations to the user's electronic device.

[0017] Also in an exemplary embodiment, the processor is configured to at least facilitate: providing one or more notifications via instructions provided by the processor, through one or more output modalities perceived by the user at a corresponding location in one or more available seating positions.

[0018] Also in an exemplary embodiment, the processor is configured to at least facilitate: using sensor data to determine which of one or more available seating locations include available clean seating locations that are both clean and currently unoccupied; and, via instructions provided by the processor, to perform one or more assistive actions to enable a user to find one or more available clean seating locations.

[0019] Also in an exemplary embodiment, the processor is configured to at least facilitate: providing one or more additional assistive actions via instructions provided by the processor so that the user can utilize one or more security features associated with one or more available seating locations.

[0020] Also in an exemplary embodiment, the processor is configured to at least facilitate: using sensor data to determine one or more available interfaces through which the user can interact with the environment; and via instructions provided by the processor to perform one or more assistive actions so that the user can find one or more available interfaces and learn how to interact with those interfaces.

[0021] Similarly, in the exemplary embodiment, the environment includes a vehicle; the user includes a passenger of the vehicle; and one or more available seating positions include one or more passenger seating positions of the vehicle.

[0022] Also in an exemplary embodiment, the processor is configured to at least facilitate: determining the position of the seat belt for one or more passenger seating positions; and providing one or more additional assistance actions to assist passengers in using the seat belt.

[0023] In another exemplary embodiment, a vehicle is provided, the vehicle comprising: a main body; a propulsion system for moving the main body; one or more passenger seating positions; one or more sensors configured to acquire sensor data about the environment within the vehicle in which the passenger is located; and a processor coupled to the one or more sensors and configured to at least facilitate: determining, using the sensor data, one or more available passenger seating positions that the passenger can sit in the environment and are currently unoccupied; determining, using the sensor data, which of the one or more available passenger seating positions include available clean passenger seating positions that are both clean and currently unoccupied; determining the positions of one or more corresponding seat belts associated with the one or more available clean passenger seating positions; and performing assistance actions for a user relative to the available clean passenger seating positions and the corresponding seat belts, including: providing a notification to the user via transmission of a message identifying the one or more available clean passenger seating positions to an electronic device of the user; providing one or more visual notifications for the user to see at the corresponding positions among the one or more available clean passenger seating positions; and providing one or more audio notifications for the user to hear at the corresponding positions among the one or more available clean passenger seating positions. Attached Figure Description

[0024] The present disclosure will be described below with reference to the following figures, wherein the same numerals denote the same elements, and wherein:

[0025] Figure 1 This is a functional block diagram of a system according to an exemplary embodiment, the system including an environment (e.g., a vehicle, a movie theater or other environment) and including a control system for facilitating user orientation within that environment, including for users who may have visual impairments and / or other disabilities;

[0026] Figure 2 This is a flowchart of a process according to an exemplary embodiment, the process being used to facilitate contextual awareness of a user within an environment (including for users who may have visual impairments and / or other disabilities), and the process may be combined with remote devices as well as vehicle and control systems. Figure 1 This is achieved through a system;

[0027] Figure 3 This is a flowchart of a subroutine according to an exemplary embodiment, the subroutine representing Figure 2 The steps of the process, namely, the steps to assist the user through any optional or additional alerts (e.g., based on customizable features); and

[0028] Figure 4 This is according to an exemplary embodiment. Figure 1 The diagram shows a subsystem of the system, which includes environment 100 and user devices. Detailed Implementation

[0029] The following detailed description is exemplary in nature only and is not intended to limit this disclosure or its application and use. Furthermore, it is not intended to be bound by the foregoing background information or any theories set forth in the following detailed description.

[0030] Figure 1 This is a functional block diagram of system 10, which includes the environment 100 in which users will exist. For example... Figure 1 As shown, in some embodiments, environment 100 includes vehicles. In some such embodiments, environment 100 includes a car. In some other embodiments, environment 100 includes one or more other types of vehicles, such as one or more buses, trains, trucks, sea vehicles, aircraft, etc. In various other embodiments, environment 100 includes one or more other types of environments in which one or more individuals may be present. In various embodiments, environment 100 may include a cinema, concert hall, restaurant, apartment building, office building, classroom, and / or any number of other types of environments in which passengers, users, and / or other occupants (collectively referred to herein as "users") may be present.

[0031] like Figure 1 As shown, in various embodiments, among other possible features, system 10 may also include a remote device 170 and one or more user devices, such as one or more electronic devices 105 (e.g., smartphones), one or more user audio devices 180 (e.g., speakers or headphones), and / or other user devices 190 (e.g., haptic devices).

[0032] like Figure 1 As shown, system 10 also includes one or more wireless communication networks 160 that communicatively couple environment 100 and remote device 170 together. In some embodiments, environment 100 may represent many different environments (e.g., a fleet of vehicles, a series of movie theaters, etc.), which are also coupled to remote device 170 via wireless communication network 160 and have similar characteristics to... Figure 1 Features similar to those depicted in and described below in conjunction with environment 100. In some embodiments, remote device 170 may represent one or more other environments, remote servers, and / or infrastructures, among various other possible types of remote devices.

[0033] Similarly, Figure 1As shown, in an exemplary embodiment, environment 100 is also coupled to an electronic device 105 of a user of environment 100 via one or more wireless connections 103. In some embodiments, electronic device 105 includes a smartphone or related electronic device on the occupant of environment 100. Also in some embodiments, environment 100 is coupled to electronic device 105 via a short-range wireless network, among other possible wireless connections 103 and / or networks. Figure 1 As shown and as described above, in various embodiments, the environment may similarly be coupled to one or more user audio devices 180 (e.g., speakers or headphones) and / or other devices 190 (e.g., haptic devices) of the user via wireless connection 103 and / or network.

[0034] In an embodiment where the depicted environment 100 includes a vehicle, the environment 100 includes a body 104 disposed on a chassis 116. The body 104 substantially surrounds other components of the environment 100. The body 104 and the chassis 116 may together form a frame. The environment 100 also includes a plurality of wheels 112. Each wheel 112 is rotatably coupled to the chassis 116 near a corresponding corner of the body 104 to facilitate movement of the environment 100. In one embodiment, the environment 100 includes four wheels 112, but this may vary in other embodiments (e.g., for trucks and certain other vehicles).

[0035] The drive system 110 is mounted on the chassis 116 and drives the wheels 112, for example, via axle 114. The drive system 110 preferably includes a propulsion system. In some embodiments, the drive system 110 provides propulsion based on the driver's intention indicated by the driver pressing the accelerator pedal. Also in some embodiments, the drive system 110 may provide automatic propulsion control, where appropriate, based on instructions provided by the control system 102.

[0036] In some exemplary embodiments, drive system 110 includes an internal combustion engine and / or an electric motor / generator coupled to its transmission. In some embodiments, drive system 110 may vary, and / or two or more drive systems 110 may be used. As an example, environment 100 may also include any one or a combination of many different types of propulsion systems, such as, for example, gasoline or diesel fuel internal combustion engines, "mixed fuel vehicle" (FFV) engines (i.e., using a mixture of gasoline and ethanol), gaseous compound (e.g., hydrogen and / or natural gas) fuel engines, combustion / electric motor hybrid engines, and electric motors.

[0037] exist Figure 1In the depicted embodiments, the control system 102 is coupled to the drive system 110, as well as electronic devices 105 and remote devices 170. As described above, in some embodiments, the environment 100 includes one or more functions automatically controlled via the control system 102, including functions for facilitating user orientation within the environment, including for users who may have visual impairments and / or other disabilities.

[0038] like Figure 1 As shown, in various embodiments, the control system 102 includes a sensor array 120, a position system 130, a transceiver 133, a display system 135, and a controller 140.

[0039] In various embodiments, sensor array 120 includes various sensors for facilitating orientation of a user within the environment. In the depicted embodiments, sensor array 120 includes one or more cameras 122, other detection sensors 124, input sensors 126, and wireless sensors 127. In various embodiments, sensor array 120 may also include one or more other sensors 128.

[0040] As used herein, the terms “passenger” or “user” are used to refer to one or more human individuals who are traveling within environment 100 and will be oriented within environment 100 and proceed to the end-user destination after environment 100 stops at its current destination at the end of the journey. As described herein, the terms “occupier” and “user” (and / or similar terms) may also be used interchangeably and have the same meaning as “passenger”.

[0041] In various embodiments, camera 122 acquires camera images of the environment within environment 100.

[0042] In some embodiments, as an alternative to or supplement to camera 122, sensor array 120 also includes one or more other detection sensors 124. In various embodiments, the other detection sensors 124 include one or more radar sensors, lidar sensors, sonar sensors, etc., and acquire detection sensor data about the environment.

[0043] In various embodiments, one or more input sensors 126 receive input regarding user preferences (e.g., preferences for seating and other features related to environment 100). In various embodiments, input sensors 126 may include one or more microphones (e.g., for audio input), touchscreen sensors, buttons, knobs, etc.

[0044] In various embodiments, the wireless sensor 127 is used to locate users (e.g., passengers, occupants, or other users), including when the user is within environment 100. In some embodiments, the wireless sensor 127 includes one or more ultra-wideband (UWB) sensors, such as for locating passengers and / or obstacles, and in other embodiments includes combinations with one or more sensors of electronic device 105 and / or other detection sensors 124 of environment 100.

[0045] In addition, in some embodiments, the sensor array 120 may also include one or more other sensors 128, which may include (as an example) one or more transmission and / or gear position sensors of environment 100 (e.g., regarding whether the engine is running and / or the current gear of environment 100), one or more other types of detection sensors, and one or more other sensors that measure vehicle parameters such as speed and acceleration.

[0046] Similarly, in various embodiments, the location system 130 is configured to acquire and / or generate data about the location and / or position of the environment 100 as it is moving and / or about to stop. In some embodiments, the location system 130 includes and / or is coupled to a satellite-based network and / or system (such as Global Positioning System (GPS) and / or other satellite-based systems), and / or uses Transmission Control Protocol (TCP), etc.

[0047] In some embodiments, environment 100 also includes transceiver 133. In various embodiments, transceiver 133 communicates with remote device 170 via one or more wireless communication networks 160 and with electronic device 105 via wireless connection 103.

[0048] In various embodiments, display system 135 provides information or instructions to one or more users of environment 100, including when they are within environment 100. In various embodiments, display system 135 includes audio devices 137, such as one or more speakers, to provide audible notifications to passengers, and also includes one or more positioning assistance devices 139 to further assist users in environment 100 (e.g., providing flashlights, beeps, etc., to help users locate one or more features of environment 100). In some embodiments, display system 135 may also include one or more other components, such as visual components (e.g., a display screen), tactile components (e.g., by vibrating a passenger seat or electronic device 105), etc.

[0049] In various embodiments, controller 140 is coupled to sensor array 120, location system 130, transceiver 133, and display system 135, as well as to remote device 170 and electronic devices. In some embodiments, control system 102 is also coupled to drive system 110 and / or to one or more other components of environment 100. Also in various embodiments, controller 140 includes a computer system (referred to herein as computer system 140) and includes processor 142, memory 144, interface 146, storage device 148, and computer bus 150. In various embodiments, controller (or computer system) 140 performs contextual assistance for users of environment 100 based on sensor data obtained from sensor array 120 and, in various embodiments, also based on sensor data (e.g., pedestrian traffic data and / or other data related to the level of activity in the environment) obtained via transceiver 133 from location system 130 and remote device 170. In various embodiments, controller 140 performs contextual assistance for users of environment 100 based on sensor data obtained from sensor array 120 and, in various embodiments, also based on sensor data (e.g., pedestrian traffic data and / or other data related to the level of activity in the environment) obtained via transceiver 133 from location system 130 and remote device 170. In various embodiments, controller 140 performs contextual assistance based on... Figures 2 to 4 The description in the text and further related to the following text Figures 2 to 4 The process and implementation steps are described in combination to provide these and other functions.

[0050] In various embodiments, the controller 140 (and in some embodiments, the control system 102 itself) is located within the body 104 of the environment 100. In one embodiment, the control system 102 is mounted on a chassis 116. In some embodiments, the controller 140 and / or the control system 102 and / or one or more components thereof may be located outside the body 104, for example, on a remote device, in the cloud, or in another device that remotely performs image processing.

[0051] Understandably, controller 140 can otherwise interact with Figure 1 The embodiments described herein differ. For example, controller 140 may be coupled to or otherwise utilize one or more remote computer systems and / or other control systems, for example, as part of one or more of the devices and systems in environment 100 described above.

[0052] In the depicted embodiment, the computer system of controller 140 includes processor 142, memory 144, interface 146, storage device 148, and bus 150. Processor 142 performs the computational and control functions of controller 140 and may include any type of processor or multiple processors, a single integrated circuit such as a microprocessor, or any suitable number of integrated circuit devices and / or circuit boards that work together to perform the functions of a processing unit. During operation, processor 142 executes one or more programs 152 contained in memory 144, and thus controls the general operation of controller 140 and the computer system of controller 140, typically in the course of performing the tasks described herein, such as... Figures 2 to 4 The description in the text and further related to the following text Figures 2 to 4 The process and implementation are described in combination.

[0053] Memory 144 can be any suitable type of memory. For example, memory 144 can include various types of dynamic random access memory (DRAM) (such as SDRAM), various types of static RAM (SRAM), and various types of non-volatile memory (PROM, EPROM, and flash memory). In some examples, memory 144 is located on and / or co-located with processor 142 on the same computer chip. In the depicted embodiments, memory 144 stores the aforementioned program 152, as well as map data 153 (e.g., from location system 130 and / or transceiver 133 and / or used in conjunction with location system 130 and / or transceiver 133) and one or more stored values ​​154 (e.g., including thresholds in various embodiments).

[0054] Bus 150 is used to transmit programs, data, status, and other information or signals between various components of the computer system of controller 140. Interface 146 allows communication with the computer system of controller 140 (e.g., from system drivers and / or another computer system) and can be implemented using any suitable methods and means. In one embodiment, interface 146 obtains various data from sensor array 120, position system 130, and / or remote device 170. Interface 146 may include one or more network interfaces for communicating with other systems or components. Interface 146 may also include one or more network interfaces for communicating with technicians, and / or one or more storage interfaces for connecting to storage devices (such as storage device 148).

[0055] Storage device 148 can be any suitable type of storage device, including various types of direct access storage and / or other memory devices. In one exemplary embodiment, storage device 148 includes a program product from which memory 144 can receive program 152, which is executed. Figures 2 to 4 And further as follows Figures 2 to 4 The processes and implementations are described in combination. In another exemplary embodiment, the program product may be stored directly in memory 144 and / or disk (e.g., disk 157) and / or otherwise accessed by memory 144 and / or disk, as referenced below.

[0056] Bus 150 can be any suitable physical or logical means of connecting computer systems and components. This includes, but is not limited to, direct hardwired connections, fiber optic, infrared, and wireless bus technologies. During operation, program 152 is stored in memory 144 and executed by processor 142.

[0057] It is understood that, although this exemplary embodiment is described in the context of a fully functional computer system, those skilled in the art will recognize that the mechanisms of this disclosure are capable of being distributed as a program product, with one or more types of non-transitory computer-readable signal-bearing media used to store the program and its instructions and to perform its distribution, such as a non-transitory computer-readable medium carrying the program and containing computer instructions stored therein for causing a computer processor (such as processor 142) to execute and run the program. Such program products can take many forms, and this disclosure applies equally to any specific type of computer-readable signal-bearing medium used to perform the distribution. Examples of signal-bearing media include recordable media (such as floppy disks, hard disks, memory cards, and optical disks) and transmission media (such as digital and analog communication links). It is understood that cloud-based storage and / or other technologies may also be utilized in some embodiments. It is similarly understood that the computer system of controller 140 can also be otherwise connected to… Figure 1 The embodiments depicted differ from those described in, for example, in that the computer system of controller 140 may be coupled to or may otherwise utilize one or more remote computer systems and / or other control systems.

[0058] Continue to refer to Figure 1 ,like Figure 1 As shown and as described above, in various embodiments, the remote device 170 is coupled to the environment 100 via one or more wireless communication networks 160. Similar to the discussion above, in various embodiments, Figure 1 The remote device 170 described may represent one or more different remote devices 170, which include one or more other vehicles, buildings, other environments, remote servers, infrastructure, etc. and / or are part of or coupled to one or more other vehicles, buildings, other environments, remote servers, infrastructure, etc.

[0059] In various embodiments, remote device 170 provides sensor data (such as pedestrian traffic data and / or other data related to the level of activity in the environment), and / or other information about the environment 100 (including other vehicles, pedestrians, and / or other objects that may be located within or near the user's path).

[0060] Similarly, in various embodiments, electronic device 105 receives information and instructions from control system 102 via transceiver 133 along wireless connection 103, including instructions for user orientation within environment 100. In various embodiments, user audio device 180 and / or other device 190 may be similarly used to facilitate user orientation within environment 100.

[0061] Similarly, Figure 1 As shown, in an exemplary embodiment, Figure 1 The subsystem 101 of system 10 is represented as including environment 100 and user devices 105, 180 and 190.

[0062] Figure 2 This is a flowchart of process 200 according to an exemplary embodiment, which facilitates user orientation within an environment, including for users who may have visual impairments and / or other disabilities. In various embodiments, according to an exemplary embodiment, process 200 may be combined with Figure 1 The system 10 is implemented by the environment 100 and its control system 102, and also includes remote devices 170 and passenger electronic devices 105, user audio devices 180 and other user devices 190.

[0063] In various embodiments, the following is combined with Figure 2 as well as Figure 3 (It provides flowcharts of subroutines according to exemplary embodiments, which represent) Figure 2 The process involves 200 steps, namely steps assisted by any optional or additional alerts, such as those based on customizable features. Figure 4 (It provides an embodiment of the invention) Figure 1 The process 200 is discussed in the block diagram of subsystem 101, which includes environment 100 and user devices 105, 180 and 190.

[0064] like Figure 2 As shown, process 200 begins when the user enters environment 100. In one embodiment, the steps of process 200 are executed continuously while the user is within the environment.

[0065] In various embodiments, it is determined which surfaces or seating locations in the environment (e.g., passenger seats, other seating locations such as those for wheelchairs and / or other equipment) are clean (step 202). In various embodiments, this is determined by... Figure 1 The processor 142 is based on... Figure 1This is performed using wireless sensing data from one or more cameras 122 and / or other detection sensors 124. In some embodiments, the cleanliness of the surface and seating location may also be obtained from one or more other sources, such as databases maintained by building management, service providers, companies, etc., that maintain the environment (e.g., whether a surface or chair is marked as needing cleaning, etc.). Also in some embodiments, as determined using sensor data, the location may include one or more available locations with available interfaces through which the user can interact with the environment (e.g., seat adjustment and control, climate control, lighting, infotainment, etc.).

[0066] In various embodiments, the user is provided with one or more notifications regarding any unclean seating location or surface (step 203). In some embodiments, the notifications are provided based on instructions given by… Figure 1 The processor 142 provides these instructions, and these instructions are implemented and / or provided to one or more display systems 135 (e.g., their audio devices 137 and / or location devices 139), and / or provided or provided to the user's electronic device 105 (e.g., a cellular phone), user audio device 180 (e.g., headphones or speakers), and / or other devices 190 (e.g., haptic devices).

[0067] Similarly, in various embodiments, the locations of other individuals within the environment are determined (step 204). In various embodiments, this is done by... Figure 1 The processor 142 is based on... Figure 1 It is performed by using wireless sensing data from one or more wireless sensors 127, camera 122, and / or other detection sensors 124.

[0068] In various embodiments, the location of the user (i.e., the user who is the subject of process 200 and needs to be oriented within environment 100) is also determined (step 206). In various embodiments, this is done by... Figure 1 The processor 142 is based on... Figure 1 It is performed by using wireless sensing data from one or more wireless sensors 127, camera 122, and / or other detection sensors 124.

[0069] In various embodiments, the characteristics of the environment are determined (step 208). In various embodiments, as examples, characteristics may include the seating arrangement of environment 100, stairs, aisles, seatbelt locations, other safety features, and related information. In various embodiments, this is determined by… Figure 1 The processor 142 is based on... Figure 1 The execution is performed based on the stored value 154 of the memory 144, and / or in some embodiments may also be based on the value from the memory 144. Figure 1Wireless sensing data from one or more wireless sensors 127 and cameras 122 and / or other detection sensors 124.

[0070] In various embodiments, the user is also provided with one or more notifications regarding the interior layout of the environment (e.g., related to seating arrangements) (step 210) and regarding safety features (e.g., seat belts, emergency exits, emergency stop buttons, etc.) (step 212). In some embodiments, the notifications are provided based on instructions given by… Figure 1 The processor 142 provides these instructions, and these instructions are implemented and / or provided to one or more display systems 135 (e.g., their audio devices 137 and / or location devices 139), and / or provided or provided to the user's electronic device 105 (e.g., a cellular phone), user audio device 180 (e.g., headphones or speakers), and / or other devices 190 (e.g., haptic devices).

[0071] In various embodiments, available (e.g., empty or unoccupied) locations in the environment (e.g., seating locations) are determined (step 213). In various embodiments, this is done by... Figure 1 The processor 142 executes based on the clean seat determination in step 202, the individual's location in step 204, the user's location in step 206, and the characteristics in step 208. In various embodiments, an available seat is determined to be a seat in environment 100 that is easily accessible to the user at a given user location and is also unoccupied and clean.

[0072] In various embodiments, the user is provided with one or more notifications regarding available seat locations (step 214). In some embodiments, the notifications are based on available seat locations as determined in step 213 (based on providing information about available seat locations) and according to instructions (these instructions are provided by...). Figure 1 The processor 142 provides the instructions, and these instructions are implemented and / or provided to one or more display systems 135 (e.g., their audio devices 137 and / or location devices 139), and / or provided or provided to the user's electronic devices 105 (e.g., cellular phones), user audio devices 180 (e.g., headphones or speakers), and / or other devices 190 (e.g., haptic devices) and / or one or more modalities. In addition to other possible notifications and actions, the instructions provided via the processor may include and / or be characterized as one or more assistive actions so that the user is aware of the corresponding location of one or more available seats.

[0073] In addition, notifications regarding environmental motion (e.g., in the case of a vehicle) (step 218) and routes and destinations (if applicable) (step 222) are provided. In various embodiments, this information is provided by processor 142 based on information from one or more vehicle systems (e.g., Figure 1 The information provided by the drive system 110, sensor array 120, and / or position system 130 is used to determine this. Similarly, in various embodiments, these notifications are provided based on instructions given by… Figure 1 The processor 142 provides these instructions, and these instructions are implemented and / or provided to one or more display systems 135 (e.g., their audio devices 137 and / or location devices 139), and / or provided or provided to the user's electronic device 105 (e.g., a cellular phone), user audio device 180 (e.g., headphones or speakers), and / or other devices 190 (e.g., haptic devices).

[0074] Similarly, in various embodiments, assistance is provided to the user via any optional or additional alarms (step 224). In various embodiments, processor 142 provides additional instructions for assisting the user in locating internal features of environment 100, such as instructions implemented by the user-assistance device 139 (e.g., assisting the user by providing a flash, a beep, and / or other actions). In some embodiments, these additional instructions are provided according to customizable features, relating to any optional or additional alarms that the user can pre-select. In some embodiments, actions and instructions may also include: performing one or more assistive actions via instructions provided by the processor to enable the user to locate one or more available interfaces and understand methods of interacting with these interfaces (e.g., for seat adjustment and control, climate control, infotainment, etc.).

[0075] Reference Figure 3 A flowchart is provided to illustrate this example. Figure 2 Step 224, which involves providing assistance to the user through any optional or additional alerts. For example... Figure 3 As shown, in an exemplary embodiment, once the subprocess of step 224 begins from step 302, user preferences (step 324) and environmental characteristics (step 326) are obtained.

[0076] In some embodiments, the user preferences in step 324 are via Figure 1 One or more input sensors 126 and / or combined Figure 1The electronic device 105 is used to obtain this information. Similarly, in some embodiments, user preferences may include, among other user inputs, preferences for seat type and / or other characteristics of the environment 100 and / or types of features the user might need assistance with. For example, an individual may have a different set of preferences if they are in their own vehicle (which they are familiar with) compared to being in an unfamiliar environment. Also, in some embodiments, user preferences may include whether and to what extent the user desires assistance with seat recline, other seat adjustments, climate control, window access and / or control, door access and / or locking and unlocking, infotainment controls, etc.

[0077] In some embodiments, environmental characteristics are obtained via stored values ​​154 and / or sensor array 120, and correspond to seating, safety features, and / or other characteristics, such as combinations Figure 2 Step 208 (Vehicle Characteristics) is described.

[0078] Continue to refer to Figure 3 In an exemplary embodiment, it is determined whether any additional features need to be located and / or reported (step 328). In some embodiments, this is determined by the processor 142 based on user preferences from step 324 and vehicle characteristics from step 326. In some embodiments, the additional features are reported to the user, and information about the features is also sent to vehicle 100 to activate location assistance device 139 (e.g., lights, ringtones, etc.).

[0079] In various embodiments, the user is provided with notification regarding any relevant features (step 330). Specifically, in various embodiments, the processor 142 notifies the display system 135 (e.g., its audio device 137) and / or notifies the user of any relevant features. Figure 1 Electronic device 105, user audio device 180 and / or other user equipment 190 provide instructions to the user to provide notification of location, availability and instructions relating to any seats, safety features and / or components of the vehicle characteristics of step 326, which are consistent with the user preferences of step 324 and have not been provided via previous notifications to the user.

[0080] Also in various embodiments, a feature location indicator for any relevant feature is provided to the user (step 332). Specifically, in various embodiments, processor 142 provides instructions to display system 135 (e.g., its location device 139) to provide the user with location assistance (e.g., flashing lights, beeps, etc.) related to any seat, safety feature, and / or component of the vehicle characteristics of step 326, consistent with the user preference of step 324 and not provided via previous notification to the user.

[0081] In various embodiments, the process ends at step 334 once steps 330 and 332 have been performed for each relevant feature (i.e., once it is determined in step 328 that no additional reporting is required).

[0082] As mentioned above, Figure 4 Provided according to exemplary embodiments Figure 1 A block diagram of subsystem 101 of system 10, which includes environment 100 and user devices 105, 180 and 190.

[0083] like Figure 4 As shown, in various embodiments, a user audio device 180 (e.g., one or more headphones, speakers, etc.) is used to connect to the electronic device 105, and a wireless sensor 127 performs wireless sensing 402 relative to these devices. Similarly, as... Figure 4 As shown, the wireless sensor 127 also performs additional wireless sensing 404 relative to other user equipment 190.

[0084] Similarly, Figure 4 As shown, processor 142 includes detection sensor data from camera 122 and other detection sensors 124 in the vehicle, as well as data from electronic device 105 and wireless sensor 127. Furthermore, in various embodiments, processor 142 also receives information from a vehicle system, which includes… Figure 1 The drive system, sensor array 120, and position system 130 contain dynamic information 406 regarding navigation, motion, etc. (e.g., as described above in conjunction with...) Figure 2 and Figure 3 Similarly, in various embodiments, such as Figure 4 As shown, after performing its various determinations using various forms of data, the processor 142 provides instructions to the audio device 137 and the position device 139 of the display system 135, and these instructions are implemented by the audio device 137 and the position device 139 of the display system 135, as also described above. Figure 2 and Figure 3 As stated above.

[0085] Therefore, methods, systems, and vehicles are provided to facilitate user orientation within an environment.

[0086] It is understood that the systems, vehicles, and methods may differ from those depicted in the accompanying drawings and described herein. For example, system 10 (including remote device 170, ...) Figure 1 Environment 100 and its control system 102 and / or other components) can be with Figure 1 The system described in [the text] is different. Similarly, it can be understood that... Figures 2 to 4The steps of the process and implementation may differ from those depicted in the accompanying drawings, and / or various steps may occur simultaneously and / or occur in a different order than those depicted in the accompanying drawings.

[0087] While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be understood that numerous variations exist. It should also be understood that the exemplary embodiments or multiple exemplary embodiments are merely examples and are not intended to limit the scope, applicability, or configuration of this disclosure in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient roadmap for implementing the exemplary embodiments or multiple exemplary embodiments. It should be understood that various changes can be made to the function and arrangement of the elements without departing from the scope of this disclosure as set forth in the appended claims and their legal equivalents.

Claims

1. A method comprising: Sensor data about the environment in which the user is located is obtained through one or more environmental sensors; The sensor data is used by a processor to determine one or more available locations within the environment for the user to utilize; as well as One or more assistive actions are provided to the user relative to the one or more available locations via instructions provided by the processor.

2. The method according to claim 1, wherein: The step of determining the one or more available locations includes: using the sensor data, via the processor, determining one or more currently unoccupied available seating locations where the user can sit within the environment; and The steps of providing the one or more assistance actions include: executing the one or more assistance actions via instructions provided by the processor so that the user can find the one or more available seat locations.

3. The method of claim 2, wherein the step of providing the one or more assistive actions comprises: The notification is provided to the user via instructions provided by the processor and via the transmission of a message identifying the one or more available seat locations to the user's electronic device.

4. The method of claim 2, wherein the step of providing the one or more assistive actions comprises: One or more notifications are provided via instructions provided by the processor, through one or more output modes perceived by the user at a corresponding location in one or more available seats.

5. The method according to claim 2, wherein: The step of determining the one or more available locations further includes: using the sensor data, via the processor, determining which of the one or more available seating locations include available clean seating locations that are both clean and currently unoccupied; and The steps of providing the one or more assistance actions include: executing the one or more assistance actions via instructions provided by the processor so that the user can find one or more available clean seats.

6. The method according to claim 2, further comprising: The processor provides instructions to provide one or more additional assistance actions so that the user can utilize one or more safety features associated with the one or more available seating locations, including one or more emergency exits, one or more emergency stop buttons, or both.

7. The method according to claim 1, wherein: The step of determining the one or more available locations includes: using the sensor data, via the processor, determining one or more available interfaces through which the user can interact with the environment; and The steps of providing the one or more assistance actions include: executing the one or more assistance actions via instructions provided by the processor so that the user can find the one or more available interfaces and understand how to interact with these interfaces.

8. The method according to claim 2, wherein: The environment includes vehicles; The users include passengers of the vehicle; and The one or more available seating positions include one or more passenger seating positions of the vehicle.

9. The method according to claim 8, further comprising: The processor determines the position of the seat belt for the one or more passenger seat positions; as well as The processor provides instructions to provide one or more additional assistance actions to help the passenger use the seat belt.

10. A system comprising: One or more sensors in the user's environment, the one or more sensors being configured to acquire sensor data about the environment; as well as A processor, coupled to the one or more sensors and configured to at least facilitate: The sensor data is used to determine one or more available locations within the environment for the user to utilize; as well as Provide one or more assistance actions to the user relative to the one or more available locations.

Images