Facilitating remote assistance for occupant in response to detection of distress vehicle loading condition

Abstract

In this document, a technique is discussed that facilitates remote assistance for an occupant of a vehicle in response to detection of a distress vehicle loading condition during power assisted loading of cargo into the vehicle. The techniques and skills described herein detect distress conditions occurring during power assisted loading of cargo into a vehicle. Responsive to the detected condition, the techniques and skills notify a telecommunications center and facilitate assistance of the occupant in cooperation with the center.

Description

Background Art

[0001] To improve accessibility and convenience for wheelchair users, some vehicles have power-assisted loading systems that include motorized components that help load and secure the wheelchair. Such systems often include motorized lifts, automated ramps, and / or robotic arms. Summary of the invention

[0002] According to one embodiment, a method includes: monitoring power-assisted loading of cargo into a vehicle, wherein the monitoring includes measuring durations of multiple stages of the loading; detecting a distress condition at one or more of the multiple stages of the loading; in response to the detected distress condition, notifying a telecommunications center of the detection of the distress condition; and facilitating assistance of an occupant of the vehicle in connection with the detection of the distress condition.

[0003] In this embodiment of the method, the method further includes associating a trigger threshold of duration with each of the multiple stages of loading; and the detection of the distress condition includes: comparing the duration of one or more loading stages with their associated trigger thresholds; determining that the duration of at least one of the loading stages exceeds its associated trigger threshold; and in response to determining that the duration of at least one of the loading stages exceeds its associated trigger threshold, indicating that a distress condition exists.

[0004] Regarding this embodiment of the method, wherein the monitoring further comprises: listening to ambient audio in the vicinity of the load during one or more loading stages, and / or visually observing an area in the vicinity of the load during one or more loading stages.

[0005] Regarding this embodiment, wherein the detecting of the distress condition comprises: identifying one or more sounds of distress; and responsive to the identifying of the one or more sounds of distress, indicating that the distress condition exists.

[0006] In this embodiment of the method, the one or more sounds of distress are selected from the group consisting of: human speech requesting assistance; human speech expressing pain or distress; sounds of malfunctioning mechanisms; and repetitive, high-pitched or loud speech from a human.

[0007] In this embodiment of the method, wherein the detecting of the distress condition comprises: recognizing one or more visual symbols of distress; and responsive to the recognizing of the one or more visual symbols of distress, indicating that a distress condition exists.

[0008] In this embodiment of the method, the one or more visual symbols of distress are selected from the group consisting of: humans expressing pain or distress; visuals of malfunctioning mechanisms; rapid and repetitive movements; severe damage to the vehicle; and shaking of the vehicle.

[0009] In this embodiment of the method, further comprising: receiving a message from the telecommunications center in response to the notification and delivering the message to an occupant of the vehicle.

[0010] In this embodiment of the method, facilitating assistance to the occupant includes actions selected from the group consisting of: performing diagnostics; questioning the occupant; troubleshooting a malfunctioning mechanism; contacting nearby human assistance; contacting emergency services; instructions for resetting components of the vehicle; instructions for resetting the vehicle; sounding an alarm; flashing lights; and broadcasting a distress message.

[0011] According to yet another embodiment, a non-transitory machine-readable storage medium is encoded with instructions executable by one or more processors, which instructions, when executed, direct the one or more processors to perform operations including: monitoring power-assisted loading of cargo into a vehicle, wherein the monitoring includes measuring durations of multiple stages of the loading; detecting a distress condition in one or more of the multiple stages of the loading; in response to the detected distress condition, notifying a telecommunications center of the detection of the distress condition; in response to the notification, receiving a message from the telecommunications center and delivering the message to an occupant of the vehicle; and facilitating assistance to an occupant of the vehicle regarding the detection of the distress condition.

[0012] Another non-transitory machine-readable storage medium embodiment includes the following additional operations: associating a trigger threshold of duration with each of the multiple stages of loading, wherein the detection of the distress condition includes: comparing the duration of one or more loading stages with their associated trigger thresholds; determining that the duration of at least one of the loading stages exceeds its associated trigger threshold; and in response to determining that the duration of at least one of the loading stages exceeds its associated trigger threshold, indicating that the distress condition exists.

[0013] Another non-transitory machine readable storage medium embodiment, wherein the monitoring further comprises: listening to ambient audio in the vicinity of the load during one or more loading stages, and / or visually observing an area in the vicinity of the load during one or more loading stages.

[0014] Another non-transitory machine-readable storage medium embodiment, wherein the message received from the telecommunications center is selected from the group consisting of: a short message service communication; an electronic data communication; an audio voice communication; and a telephone communication.

[0015] Another non-transitory machine-readable storage medium embodiment, wherein facilitating assistance to the occupant includes actions selected from the group consisting of: performing diagnostics; questioning the occupant; troubleshooting a malfunctioning mechanism; contacting nearby human assistance; contacting emergency services; instructions for resetting components of the vehicle; instructions for resetting the vehicle; sounding an alarm; flashing lights; and broadcasting a distress message.

[0016] According to yet another embodiment, a method for facilitating remote assistance to occupants of a vehicle in response to detection of a distress vehicle loading condition during power-assisted loading of cargo into the vehicle, the method comprising: monitoring power-assisted loading of cargo into the vehicle, wherein the monitoring comprises measuring durations of multiple stages of the loading; associating a trigger threshold of duration with each of the multiple stages of the loading; detecting a distress condition in one or more of the multiple stages of the loading; in response to the detected distress condition, notifying a remote communication center of the detection of the distress condition; in response to the notification, receiving a message from the remote communication center and delivering the message to the occupants of the vehicle; and facilitating assistance to the occupants of the vehicle regarding the detection of the distress condition.

[0017] Another embodiment of the method, wherein the detection of the distress condition comprises: comparing the duration of one or more loading phases with their associated trigger thresholds; determining that the duration of at least one of the loading phases exceeds its associated trigger threshold; and indicating that the distress condition exists in response to determining that the duration of at least one of the loading phases exceeds its associated trigger threshold.

[0018] Another embodiment of the method, wherein the monitoring further includes listening to ambient audio in the vicinity of the load during one or more loading phases, and the one or more sounds of distress are selected from the group consisting of: human speech requesting assistance; human speech expressing pain or distress; sounds of malfunctioning mechanisms; and repetitive, high-pitched, or loud speech from a human.

[0019] Another embodiment of the method, wherein the monitoring further includes visually observing an area proximate to the load during one or more loading phases, and one or more visual symbols of distress are selected from the group consisting of: humans expressing pain or distress; visuals of malfunctioning mechanisms; rapid and repetitive movements; severe damage to the vehicle; and shaking of the vehicle.

[0020] Another embodiment of the method, wherein the message received from the telecommunication center is selected from the group consisting of: a short message service communication; an electronic data communication; an audio voice communication; and a telephone communication.

[0021] Another embodiment of the method, wherein facilitating assistance to the occupant includes actions selected from the group consisting of: performing diagnostics; questioning the occupant; troubleshooting a malfunctioning mechanism; contacting nearby human assistance; contacting emergency services; instructions for resetting components of the vehicle; instructions for resetting the vehicle; sounding an alarm; flashing lights; and broadcasting a distress message.

[0022] The above features and advantages and other features and advantages of the present teachings are apparent from the following detailed description of some of the best modes for carrying out other embodiments of the present teachings as defined in the appended claims when taken in connection with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 Example scenarios are illustrated for an example vehicle having a power-assisted loading system and employing one or more implementations of the techniques described herein.

[0024] Figure 2 An example of a computer architecture for a computing system capable of performing the techniques described herein is illustrated.

[0025] Figure 3 is a flow chart illustrating a process for executing an example method that facilitates remote assistance to an occupant in response to detection of a distressed vehicle loading condition, according to one or more implementations described herein. DETAILED DESCRIPTION

[0026] The techniques described herein facilitate remote assistance for occupants of a vehicle in response to detection of a distress vehicle loading condition during power-assisted loading of cargo into the vehicle. The techniques and skills described herein detect a distress condition occurring during power-assisted loading of cargo into the vehicle. In response to the detected condition, the techniques and skills notify a remote communication center and cooperatively facilitate assistance for the occupants.

[0027] Referring now to the drawings, wherein like reference numerals indicate like parts throughout the several views of various systems, the approach is shown and described herein. The disclosed approach can be applicable to automotive vehicles, including manual, autonomous, and semi-autonomous driving.

[0028] Figure 1An example scenario 100 is illustrated that includes an automotive vehicle 110 , a satellite 130 , and a telecommunications (“comm”) center 140 suitable for implementation of the techniques described herein.

[0029] The vehicle 110 includes a power-assisted loading system 112 configured to automate or semi-automate the loading of cargo into the vehicle. In this example, the cargo is a wheelchair 114. The vehicle 110 monitors the power-assisted loading of cargo (e.g., wheelchair 114) into the vehicle using the power-assisted loading system 112. The process of loading cargo into the vehicle 110 includes multiple stages.

[0030] An example scenario for a cargo loading process may involve a wheelchair user, such as occupant 120. Occupant 120 may exit their seat 114 and use the driver's door to enter vehicle 110. Once in vehicle 110, the occupant starts the vehicle and initiates the cargo loading process of power-assisted loading system 112.

[0031] In this example scenario, wheelchair 114 may be foldable and capable of being relocated to a location outside of vehicle 110 for loading. As depicted, the location is at the rear of the vehicle because that is where power-assisted loading system 112 is located in vehicle 110. Wheelchair 114 may be motorized so that it may be relocated under its own power of motion. Furthermore, relocating wheelchair 114 may be directed in an automated, semi-automated, or remotely controlled manner.

[0032] With the wheelchair 114 repositioned to the location to be loaded, in this example scenario, the tailgate of the vehicle is opened, the flat sliding panel of the power-assisted loading system 112 is slid out, and the scissor lift is lowered to the ground. The wheelchair 114 is moved onto the scissor lift, and the lift raises the wheelchair. The flat sliding panel is retracted into the vehicle 110, and the tailgate is closed. This completes the cargo loading process in this example scenario.

[0033] The power-assisted loading system 112 includes, for example, a tailgate, a flat sliding panel, and a scissor lift. In other implementations, the power-assisted loading system 112 may include other or different power-assisted mechanisms that perform movements that assist in cargo loading. In this scenario, there may be multiple stages of the loading process, such as: 1) open the tailgate; 2) slide the flat panel out; 3) lower the scissor lift; 4) raise the scissor lift; 5) retract the panel; and 6) close the tailgate.

[0034] The vehicle 110 measures the duration of each of the multiple stages of loading. For example, the vehicle 110 can measure the time it takes for the tailgate opening stage to complete. This can be, for example, 20 seconds.

[0035] The vehicle 110 associates a trigger threshold of duration with each of the multiple stages of loading. The trigger threshold for a particular stage may be, for example, the maximum time expected for that stage to take to complete successfully. For example, the trigger threshold for the tailgate opening stage may be 90 seconds. In other words, the tailgate opening stage is expected to take more than 90 seconds in abnormal situations (such as mechanical failure).

[0036] The trigger threshold for each stage may be factory set. That is, the manufacturer or dealer sets the threshold. The threshold may be adjustable. In some instances, the user may be able to manually adjust the threshold. In some other instances, the vehicle 110 may programmatically adjust the threshold. For example, the vehicle 110 may adjust the threshold based on a statistical relationship with real-world usage (such as three times the average operating time for the stage). In yet other instances, the threshold may be set by the comm center 140.

[0037] The vehicle 110 detects a distress condition for one or more of the multiple stages of loading. As used herein, unless the context indicates otherwise, a distress condition for a stage occurs during that stage.

[0038] Distress conditions include a malfunctioning mechanism of the machine (eg, power-assisted loading system 112), an unsuccessful loading process, an obstruction to the loading process, distress of an occupant, or a situation where assistance would likely aid or expedite the completion of the loading process.

[0039] Detection of the distress condition may include the vehicle 110 comparing the measured duration of one or more loading phases with their associated trigger thresholds. Based on the comparison, the vehicle 110 determines that the duration of at least one of the loading phases exceeds its associated trigger threshold. That is, at least one of the loading phases did not complete its operation within its associated trigger threshold time period. In response, the vehicle 110 indicates that a distress condition associated with the phase exists.

[0040] Other factors that influence the detection of a distress condition include, for example, sensors that indicate whether a door or mechanism is open (eg, ajar) and the state of switches (eg, a powered lift door switch).

[0041] As depicted, vehicle 110 has audio / visual equipment 116 located proximate to power-assisted loading system 112. Audio / visual equipment 116 may include a camera for visual observation of the operation of power-assisted loading system 112 and a microphone for listening to the operation of power-assisted loading system 112.

[0042] The camera is mounted to visually observe the area near the load during one or more loading phases. The area near the load includes the power-assisted loading system 112 itself, the space through which the system moves, and the space immediately surrounding the system. In some examples, the space immediately surrounding the power-assisted loading system 112 can be as small as three inches. In other examples, it can be as small as a foot or possibly several feet. In some examples, the camera can visually observe the occupants in the vehicle 110.

[0043] When observing the area near the loading, the camera can observe the operation of the power-assisted loading system 112 during one or more loading phases of operation. In addition, the camera can observe the behavior of the occupants in the vehicle 110.

[0044] Using the camera, the vehicle 110 can detect a distress condition by identifying one or more visual signs of distress, and in response indicate that a distress condition exists. Examples of visual signs of distress include: humans expressing pain or distress; visuals of malfunctioning mechanisms; rapid and repetitive motion; heavy damage to the vehicle; and shuddering of the vehicle.

[0045] The microphone is mounted to monitor ambient audio near the loading during one or more loading phases. The ambient audio near the loading includes sounds produced by the power-assisted loading system 112 itself or by occupants in the vehicle. When monitoring the power-assisted loading of cargo, the vehicle 110 may monitor ambient audio near the loading during one or more loading phases.

[0046] Using the microphone, the vehicle 110 can detect a distress condition by identifying one or more sounds of distress, and in response indicate that a distress condition exists. Examples of distress sounds include one or more of the following: a human voice requesting assistance; a human voice expressing pain or distress; the sound of a malfunctioning mechanism; and repetitive, high-pitched, or loud speech from a human.

[0047] Recognition of visual signs of distress and sounds of distress may be accomplished using various techniques for comparing real-world audio / image data to signs of distress / sounds. In some instances, this may be accomplished using one or more of these techniques: feature detection and matching for extracting unique features to find correspondences; template matching; deep learning-based methods using pre-trained convolutional neural network (CNN) models; histogram-based methods; and structural similarity index (SSIM).

[0048] In response to the detected distress condition, the vehicle 110 notifies the comm center 140 of the detection of the distress condition via wireless communication. The wireless communication may include, for example, one or more of: satellite communication (as depicted by satellite 130), WI-FI TM 、BLUETOOTH TM , cellular communications, radio communications and / or Internet communications.

[0049] Comm center 140 includes one or more computing systems 142, one or more databases 144, and a staffed call center 146. Figure 1 140 is shown as one location, but the components and functions of the comm center 140 may be distributed geographically and across multiple comm centers. The comm center 140 is remote from the vehicle 110, wherein the comm center 140 is physically and geographically separated from the vehicle 110 and is not connected to the vehicle 110.

[0050] In response to the notification, the vehicle 110 receives a message (i.e., a communication) from the comm center 140. The message received from the comm center 140 may include, for example, a short message service communication (i.e., a "text message"), an electronic data communication, an audio voice communication, and a telephone communication. The vehicle 110 delivers the message to the occupant 120 of the vehicle. The occupant 120 may be an occupant of the vehicle 110. In some examples, the occupant 120 may be a driver or a non-driver of the vehicle.

[0051] The vehicle 110 facilitates assistance to the occupants 120 of the vehicle regarding the detection of a distress condition. Herein, the vehicle 110 facilitates assistance by performing assistance actions itself, being a mechanism for interaction between the comm center 140 and the occupants 120, or a combination of both. Examples of the manner in which the vehicle 110 facilitates assistance to the occupants include performing diagnostics, questioning the occupants, troubleshooting malfunctioning mechanisms, contacting nearby human assistance, contacting emergency services (i.e., "calling 911"), and instructions for resetting components of the vehicle, instructions for resetting the vehicle, sounding alarms, flashing lights, and broadcasting distress messages.

[0052] Figure 2 An example of a computer architecture for a computing system 200 capable of performing the techniques described herein is illustrated. The computer architecture shown in this figure illustrates a typical computer, server computer, workstation, desktop computer, laptop, tablet, web appliance, e-reader, smart phone, embedded system, or another computing device. The computer system 200 can be part of the vehicle 110 and can be utilized to perform the functions presented herein.

[0053] The computing system 200 includes a processor 202 (e.g., a central processing unit or "CPU"), system storage (e.g., memory) 204, input / output (I / O) devices 206 (such as a display, keyboard, mouse, microphone, camera and associated controllers), a secondary storage system 208 (e.g., a hard drive), and various other subsystems 210. In various embodiments, the computing system 200 also includes: a communication ("comm") port 212 that is operative to connect to a communication ("comm") system 220. The computing system 200 may include or be connected to an occupant interaction system 222 that manages interactions with occupants of the vehicle 110. The above components may be interconnected via one or more buses 216 and / or a comm system 220.

[0054] Comm system 200 enables internal communications within vehicle 110 as well as external wireless communications, such as with comm center 140. Internal communications may be, for example, via a local area network. External wireless communications may include, for example, one or more of the following: satellite communications (e.g. Figure 1 Satellite 130 depicted in FIG), WI-FI TM 、BLUETOOTH TM , cellular communications, radio communications and / or Internet communications.

[0055] Power-assisted cargo loading system 224 is a machine for vehicle 110 that automatically or semi-automatically loads cargo into the vehicle. The cargo may be a wheelchair, such as Figure 1 The wheelchair 114 is depicted in FIG. Figure 1 Like the power-assisted loading system 112 of FIG. 1 , the power-assisted cargo loading system 224 may include, for example, a tailgate, a flat sliding panel, and a scissor lift. In other implementations, the power-assisted loading system 112 may include other or different power-assisted mechanisms that perform movements to assist in cargo loading. The power-assisted cargo loading system 224 performs cargo loading in multiple stages, such as: 1) opening the tailgate; 2) sliding the panel out; 3) lowering the scissor lift; 4) raising the scissor lift; 5) retracting the panel; and 6) closing the tailgate.

[0056] System memory 204 may store data and machine-readable instructions (e.g., computer-readable instructions). The machine-readable instructions may configure computing system 200. The machine-readable instructions may include one or more instruction modules. The instruction modules may include computer program modules. The instruction modules may include one or more of a load monitor 230, a distress detector 232, a communication ("comm") manager 234, an auxiliary facilitator 236, and / or other instruction-based modules.

[0057] Although the modules in the example depicted by the figure are implemented using machine-readable instructions, other similarly functioning modules may be implemented using few to no machine-readable instructions. That is, such modules are implemented via hardware (e.g., circuits) and analog and / or digital signals. In other instances, such modules may be implemented via a combination of hardware and machine-implemented instructions.

[0058] The loading monitor 230 can be configured to monitor the power-assisted loading of cargo into the vehicle 110 using the power-assisted loading system 224. The process of loading cargo into the vehicle 110 includes multiple stages. As part of the monitoring, the loading monitor 230 can be configured to measure the duration of each of the multiple stages of loading. For example, the loading monitor 230 can measure the time it takes for the tailgate opening stage to complete. This can be, for example, 20 seconds.

[0059] The distress detector 232 may be configured to detect a distress condition at one or more of the multiple stages of loading. Distress conditions include, for example, a malfunctioning mechanism of the machine (e.g., the power-assisted loading system 224), an unsuccessful loading process, an obstruction to the loading process, distress of an occupant, or a situation where assistance is likely to help or hasten the completion of the loading process.

[0060] In addition, the distress detector 232 can be configured to associate a trigger threshold of duration with each of the multiple stages of loading. The trigger threshold for a particular stage can be, for example, the maximum time expected for that stage to successfully complete. For example, the trigger threshold for the tailgate opening stage can be 90 seconds. In other words, the tailgate opening stage is expected to take more than 90 seconds in abnormal situations (such as mechanical failure).

[0061] As part of the detection of the distress condition, the distress detector 232 may be configured to compare the measured duration of one or more loading phases with their associated trigger thresholds. Based on the comparison, the distress detector 232 may be configured to determine that the duration of at least one of the loading phases exceeds its associated trigger threshold. That is, at least one of the loading phases did not complete its operation within its associated trigger threshold time period. In response, the distress detector 232 may be configured to indicate that a distress condition associated with the phase exists.

[0062] In other implementations, distress detector 232 may be configured to detect distress conditions based on a camera for visual observation and a microphone for listening to the operation of power-assisted loading system 224. The camera and microphone may be part of I / O devices 206.

[0063] The camera is mounted to visually observe the area near the load during one or more loading phases. When observing the area near the load, the camera may observe the operation of the power-assisted loading system 224 during the operation of one or more loading phases. In addition, the camera may be able to observe the behavior of the occupants in the vehicle 110. Using the camera, the distress detector 232 may be configured to detect a distress condition by identifying one or more visual symbols of distress, and in response indicate that a distress condition exists.

[0064] The microphone is mounted to monitor ambient audio near the loading during one or more loading phases. Ambient audio near the loading includes sounds produced by the power-assisted loading system 112 itself or by occupants in the vehicle. When monitoring the power-assisted loading of cargo, the vehicle 110 may monitor ambient audio near the loading during one or more loading phases. Using the microphone, the distress detector 232 may be configured to detect a distress condition by identifying one or more sounds of distress, and in response indicate that a distress condition exists.

[0065] Comm manager 234 may be configured to notify comm center 140 of the detection of a distress condition via wireless communication. The notification may include data related to the detected distress condition. For example, the notification may include an associated error condition of loading system 224, an associated sound detected, and visual material.

[0066] Comm manager 234 may be further configured to receive messages (ie, communications) from comm center 140. Messages received from comm center 140 may include, for example, short message service communications (ie, "text messages"), electronic data communications, audio voice communications, telephone communications, and the like.

[0067] The assistance facilitator 236 may be configured to deliver the message to an occupant of the vehicle 110. The occupant may be an occupant of the vehicle 110. In some instances, the occupant may be a driver or non-driver of the vehicle. The assistance facilitator 236 may further be configured to provide additional assistance to the occupant of the vehicle 110 regarding the detection of the distress condition. Herein, the assistance facilitator 236 may be configured to facilitate assistance by performing assistance actions itself, being a mechanism for interaction between the comm center 140 and the occupant, or a combination of both.

[0068] The functionality of the example modules depicted by the diagram may be organized in different ways. For example, the functionality of the example modules may be distributed across various commonly implemented onboard automotive systems such as body control modules (BCMs), telematics units (TCPs), infotainment control units (VCUs), vehicle displays (VCDs), and power liftgate units (PTMs).

[0069] The BCM is an electronic control unit in a vehicle that manages and controls various electrical and electronic functions within the body of the vehicle. Typically, it controls systems such as lighting, power windows, central locking, wipers, climate control, audio system, instrument cluster, and security systems. Typically, the BCM receives inputs from sensors and switches and sends commands to corresponding components or systems, ensuring the proper operation of these features in the vehicle.

[0070] For example, herein, the BCM may perform operations associated with the loading monitor 230 and the distress detector 232 .

[0071] TCP is an electronic device found in vehicles that combines telecommunications and information technology. It can collect and transmit data related to the performance, location and driver behavior of the vehicle. Typically, TCP uses a global positioning system (GPS) or other positioning systems for vehicle tracking and location services to achieve communication and connectivity through a cellular or satellite network, provide vehicle diagnostics and maintenance information, incorporate safety features, monitor driver behavior, and allow connected services and applications. TCP enhances vehicle functionality, enables data-driven insights, and improves efficiency in areas such as fleet management, vehicle tracking, and connected car services.

[0072] For example, herein, the TCP may perform operations associated with the comm manager 234 and the auxiliary facilitator 236 .

[0073] VCU is an electronic device in a vehicle that combines entertainment and information features into a single interface. Typically, it acts as a centralized control hub for various multimedia and communication functions. VCU is typically composed of hardware such as a display screen and control buttons or a touch screen together with software that enables access to entertainment options, navigation systems, communication features, and vehicle settings. It provides features such as audio and video playback, BLUETOOTH connectivity for hands-free calling and music streaming, integration with smartphone applications, GPS navigation, and access to vehicle settings and information.

[0074] For example, herein, the VCU may perform operations associated with the load monitor 230 and the distress detector 232 .

[0075] VCD refers to an interface or screen in a vehicle that displays information and allows the driver to control various vehicle functions. It can include a digital instrument cluster, an infotainment screen, or a dedicated control panel. The display provides vehicle data like speed, fuel level, and warnings, and allows the driver to interact with features such as audio, navigation, climate control, vehicle settings, and diagnostics. The specific design and features of a VCD can vary between vehicles, but its purpose is to provide a user-friendly interface for monitoring and managing vehicle functions.

[0076] For example, the VCD and VCU may work together to acquire and present audio and video data to / from the I / O device 206 .

[0077] A PTM is an electronic component found in vehicles with powered liftgate features. Typically, a PTM uses an electric motor to control the opening, closing, and adjustment of the liftgate. The PTM receives signals from switches and sensors to ensure safe operation and obstacle detection.

[0078] For example, herein, the PTM may perform operations associated with the power-assisted loading system 224 .

[0079] Figure 3 1 is a flow chart illustrating a process 300 for performing an example method for facilitating remote assistance for an occupant of a vehicle in response to detection of a distressed vehicle loading condition during power-assisted loading of cargo into the vehicle. For ease of illustration, the process 300 may be described as being performed by a system described herein. Such a system may be, for example, a vehicle 110 or a computing system 200, as described herein. However, the process 300 may be performed by other devices or a combination of devices and systems.

[0080] At operation 310, the system monitors power-assisted loading of cargo into a vehicle (e.g., vehicle 110) using a power-assisted loading system (e.g., system 112 or system 224). The process of loading cargo into a vehicle includes multiple stages. As part of the monitoring, the system can measure the duration of each of the multiple stages of loading. For example, the system can measure the time it takes for the tailgate opening stage to complete. This can be, for example, 20 seconds.

[0081] At operation 312, the system detects a distress condition at one or more of the multiple stages of loading. Distress conditions include, for example, a malfunctioning mechanism of the machine (e.g., the power-assisted loading system 224), an unsuccessful loading process, an obstruction to the loading process, distress to an occupant, or a situation where assistance would likely aid or expedite the completion of the loading process.

[0082] In addition, the system can associate a trigger threshold of duration with each of the multiple stages of loading. The trigger threshold for a particular stage can be, for example, the maximum time expected for that stage to successfully complete. For example, the trigger threshold for the tailgate opening stage can be 90 seconds. In other words, the tailgate opening stage is expected to take more than 90 seconds in abnormal situations (such as mechanical failure).

[0083] As part of the detection of the distress condition, the system may compare the measured duration of one or more loading phases with their associated trigger thresholds. Based on the comparison, the system may determine that the duration of at least one of the loading phases exceeds its associated trigger threshold. In response, the system may indicate that a distress condition associated with that phase exists.

[0084] In other implementations, the system may detect a distress condition based on a camera for visual observation of the operation of the power-assisted loading system and a microphone for listening to the operation of the power-assisted loading system. While observing the area near the loading, the camera may observe the operation of the power-assisted loading system during one or more stages of operation of the loading. Additionally, the camera may be able to observe the behavior of occupants in the vehicle. Using the camera, the system may detect a distress condition by identifying one or more visual signs of distress, and in response indicate that a distress condition exists.

[0085] While monitoring ambient audio near loading, the microphone can hear the operation of the power-assisted loading system during one or more loading phases of operation. The ambient audio near loading includes sounds produced by the power-assisted loading system itself or by occupants in the vehicle. Using the microphone, the system can detect a distress condition by identifying one or more sounds of distress, and in response indicate that a distress condition exists.

[0086] At operation 314, the system notifies the comm center 140 of the detection of the distress condition via wireless communication. The notification may include data related to the detected distress condition. For example, the notification may include an associated error condition of the loading system, an associated sound detected, and visual material. In response, the comm center 140 may return a message (i.e., a communication) to the vehicle.

[0087] At operation 316, the system receives a message from the comm center 140. The message received from the comm center 140 may include, for example, a short message service communication (ie, a "text message"), an electronic data communication, an audio voice communication, a telephone communication, or the like.

[0088] At operation 318, the system delivers the message to the occupants of the vehicle. The delivery may be in the form of text, data, images, video, and / or audio. The audio / visual message may be a live interaction with a person at the comm center 140. The occupants may be occupants of the vehicle. In some instances, the occupants may be drivers or non-drivers of the vehicle.

[0089] At operation 320, the system provides additional assistance to the occupants of the vehicle regarding the detection of the distress condition. Herein, the system may facilitate assistance by performing assistance actions itself, being a conduit for interaction between the comm center 140 and the occupants, or a combination of both.

[0090] The above description is intended to be illustrative, not restrictive. Although the size and type of the material described herein are intended to be illustrative, they are by no means restricted, but exemplary embodiments. In the appended claims, the use of the terms "first", "second", "top", "bottom", etc. is only used as a label, and is not intended to impose numerical or positional requirements on their objects. As used herein, the elements or steps recorded in the singular and preceded by the words "one" or "one" should be understood as not excluding multiple such elements or steps, unless such exclusion is clearly stated. In addition, the phrase "at least one of A and B" and the phrase "A and / or B" should all be understood to mean "only A, only B, or both A and B". In addition, unless clearly stated to the contrary, the embodiment of "including" or "having" one or more elements with a specific characteristic can include additional such elements without the characteristic. And when broad descriptive adverbs such as "substantially" and "generally" are used herein to modify adjectives, these adverbs mean "most", "mainly", "for the most part", "to a significant extent", "to a large extent", and / or "at least 51% to 99% of the possible limit of 100%, and do not necessarily mean "perfectly", "completely", "strictly", "entirely" or "100%". In addition, the word "close to..." may be used herein to describe the position of an object or a part thereof with respect to another object or a part thereof, and / or to describe the positional relationship of two objects or their respective parts with respect to each other, and may mean "near...", "adjacent to", "close to", "near", "at...", and the like. And, as used herein, the phrase "substantially equal to" may mean one or more of "exactly equal to", "almost equal to", "equal to somewhere between 90% and 110% of...", and the like.

[0091] This written description uses examples including the best mode to enable any person skilled in the art to make and use devices, systems and compositions of matter and to perform methods according to the present disclosure. It is the following claims including equivalents that define the scope of the present disclosure.

Claims

1. A method comprising: monitoring power-assisted loading of cargo into a vehicle, wherein said monitoring comprises measuring durations of a plurality of phases of said loading; detecting a distress condition at one or more of a plurality of stages of said loading; responsive to the detected distress condition, notifying a telecommunications center of the detection of the distress condition; as well as Assistance to an occupant of the vehicle is facilitated with respect to detection of the distress situation.

2. The method of claim 1 , further comprising associating a trigger threshold of duration with each of a plurality of stages of said loading, wherein the detection of said distress condition comprises: comparing the duration of one or more loading phases to their associated trigger thresholds; determining that the duration of at least one of the loading phases exceeds its associated trigger threshold; and In response to determining that the duration of at least one of the loading phases exceeds its associated trigger threshold, indicating that a distress condition exists.

3. The method of claim 1, wherein the monitoring further comprises: Listening to ambient audio near the loadout during one or more loading phases, and / or visually observing an area near the loadout during one or more loading phases.

4. The method of claim 3, wherein the detection of the distress condition comprises: Identify one or more sounds of distress; as well as In response to the identification of the one or more sounds of distress, an indication is given that a distress condition exists.

5. The method of claim 4, wherein the one or more sounds of distress are selected from the group consisting of: a human voice requesting assistance; a human voice expressing pain or distress; the sound of a malfunctioning mechanism; and repetitive, high-pitched, or loud speech from a human.

6. The method of claim 3, wherein the detection of the distress condition comprises: Recognize one or more visual signs of distress; as well as In response to recognition of the one or more visual symbols of distress, an indication is given that a distress condition exists.

7. The method of claim 6, wherein the one or more visual symbols of distress are selected from the group consisting of: humans expressing pain or distress; visuals of malfunctioning mechanisms; rapid and repetitive motion; severe damage to the vehicle; and shuddering of the vehicle.

8. The method of claim 1, further comprising: In response to the notification, a message is received from the telecommunications center and delivered to an occupant of the vehicle.

9. A method of facilitating remote assistance to an occupant of a vehicle in response to detection of a distressed vehicle loading condition during power-assisted loading of cargo into the vehicle, the method comprising: monitoring power-assisted loading of cargo into a vehicle, wherein said monitoring comprises measuring durations of a plurality of phases of said loading; associating a trigger threshold of duration with each of the plurality of stages of loading; detecting a distress condition at one or more of a plurality of stages of said loading; responsive to the detected distress condition, notifying a telecommunications center of the detection of the distress condition; receiving a message from the telematics center and delivering the message to an occupant of the vehicle in response to the notification; as well as Assistance to an occupant of the vehicle is facilitated with respect to detection of the distress situation.

10. The method of claim 9, wherein the detection of the distress condition comprises: comparing the duration of one or more loading phases to their associated trigger thresholds; determining that the duration of at least one of the loading phases exceeds its associated trigger threshold; and In response to determining that the duration of at least one of the loading phases exceeds its associated trigger threshold, indicating that a distress condition exists.

Images