Method and device for controlling an electrically powered means of transport

The method and device enhance user safety and accessibility by using sensors to adjust the position of electrically powered transportation devices relative to the user, addressing collision risks and environmental obstacles.

DE102020213186B4Active Publication Date: 2024-11-14VOLKSWAGEN AG
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
DE102020213186
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-10-19
Publication Date
2024-11-14
Estimated Expiration
2040-10-19

AI Technical Summary

Technical Problem

Existing electrically powered transportation devices, such as longboards and skateboards, lack an effective method for autonomously following a user in various environments while minimizing collision risks and maintaining user accessibility.

Method used

A method and device that utilize sensors to detect the user and surroundings, evaluate sensor data to determine relative target positions, and control the electric drive to adjust the device's position accordingly, allowing it to follow the user laterally or behind based on environmental conditions, ensuring safe and accessible user interaction.

Benefits of technology

Enables safe and user-friendly operation by allowing the device to dynamically adjust its position relative to the user, reducing collision risks and maintaining user accessibility in diverse environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for controlling an electrically powered means of transport which can be used by a user (N) for locomotion by positioning themselves standing on the means of transport, and which can autonomously follow the user by means of a person-following function when the user is not positioned on the means of transport, in which the person-following function - the user and the environment of the electrically powered means of transport are detected by at least one sensor (S) of the electrically powered means of transport (10), detecting the space available for the electrically powered means of transport on the sides of the user; - the sensor data (SD) generated by the at least one sensor (S) are evaluated (11), evaluating the space available for the electrically powered means of transport at the sides of the user in order to determine a relative target position of the electrically powered means of transport in relation to the position of the user; and - the electric drive (M) of the electrically powered means of transport is controlled (12) based on this such that the electrically powered means of transport assumes the determined target position, wherein the electrically powered means of transport can assume at least two different relative target positions with respect to the position of the user depending on the environment, wherein at least one relative target position is located on one side of the user and the other relative target position is located behind the user and wherein the electrically powered means of transport switches between the relative target position on one side of the user and the relative target position behind the user according to the result of the evaluation.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a method for controlling an electrically powered means of transport, in particular an electrically powered longboard or skateboard. The present invention further relates to a device for controlling an electrically powered means of transport and to an electrically powered means of transport comprising an electric drive unit and such a device.

[0002] Longboards and skateboards have been around for a long time, with longboards in particular enjoying increasing popularity as an alternative means of transportation in recent times. Longboards and skateboards are based on the same principle and typically consist of a board, also called a "deck," to which two trucks and four wheels are attached. A user can then stand on the board to ride the longboard or skateboard and propel themselves by pushing off the ground with one leg. Longboards and skateboards with electric propulsion are also now available.

[0003] US 2019 / 0250615 A1 describes such an electrically powered skateboard. It features an autonomous control system that allows the electric skateboard to travel autonomously from a starting point to an end point using sensors and manually entered waypoints. This can also take into account objects in the environment that could pose a collision hazard.

[0004] An electrically powered longboard, for example, is described in US 2019 / 0031254 A1. This allows multiple electric wheels to be controlled based on a user's input. A camera can be used to identify obstacles in front of the electric vehicle and avoid them. The electric vehicle can also be instructed to follow the user at a specific distance using a follow command.

[0005] DE 20 2017 006 790 U1 discloses a stationary vehicle equipped with environmental sensors and configured for autonomous or automatic driving. This is intended to enable the stationary vehicle to drive independently to frequently used locations, such as a charging station for recharging the electrical energy storage unit or a factory entrance.

[0006] US 10 649 451 B2 describes a “robotic golf caddy” for transporting golf items or golf accessories, such as in particular a golf bag with golf clubs, which can follow a remote control transmitter carried by a golfer at a predetermined distance.

[0007] Finally, the YouTube video “Segway Loomo hands-on” (available at https: / / www.youtube.com / watch?v=8vNbWI42UQc) shows a mobility device called Loomo from Segway Robotics, which can be used as an e-scooter and also has a following function, where it follows a person in front of it.

[0008] It is an object of the invention to provide an improved method for controlling an electrically driven means of transport and an improved device for controlling an electrically driven means of transport.

[0009] This object is achieved by a method having the features of claim 1, as well as by a corresponding device according to claim 6. Preferred embodiments of the invention are the subject of the dependent claims.

[0010] In the method according to the invention for controlling an electrically driven means of transport, which can be used by a user for movement by positioning himself standing on the means of transport, and which can follow the user autonomously by means of a person following function when the user is not positioned on the means of transport, it is provided in the person following function that - the user and the surroundings of the electrically powered means of transport are detected by at least one sensor of the electrically powered means of transport, whereby the space available for the electrically powered means of transport on the sides of the user is detected; - the sensor data generated by the at least one sensor are evaluated, wherein the space available for the electrically powered means of transport on the sides of the user is evaluated in order to determine, as a function thereof, a relative target position of the electrically powered means of transport with respect to the position of the user; and - the electric drive of the electrically powered means of transport is controlled based thereon in such a way that the electrically powered means of transport assumes the determined target position, wherein the electrically powered means of transport can assume at least two different relative target positions with respect to the position of the user depending on the environment, wherein at least one relative target position is arranged on one side of the user and the other relative target position is arranged behind the user, and wherein the electrically powered means of transport changes between the relative target position on one side of the user and the relative target position behind the user according to the result of the evaluation.

[0011] According to the invention, the target position of the electrically powered vehicle is adjusted depending on the environment, enabling a dynamic passenger-following function. In an open environment, the electrically powered vehicle can travel alongside the user, thus being within the user's reach and field of vision. In difficult environments, the electrically powered vehicle can move to a target position behind the user, thus being in the user's "shadow," which minimizes the potential risk of collision with surrounding objects.

[0012] In particular, the method according to the invention can be advantageously applied when the electrically powered means of transport is a longboard or a skateboard.

[0013] This allows the user of an electrically powered longboard or skateboard to move freely in urban spaces, not only while riding, but also when not in use. The longboard or skateboard can safely follow the user and, through appropriate positioning, prevents the user from being disturbed by collisions or obstructions. It moves within sight and reach of the user when needed. The user doesn't have to carry the board; they can have items transported and access them while riding.

[0014] Advantageously, when evaluating the sensor data, obstacles in the environment and / or the user’s legs are detected.

[0015] It is particularly advantageous if in a sensorimotor control loop - when travelling alongside the user, the space available in front of the electrically powered means of transport is determined and the electrically powered means of transport continues to travel alongside the user as long as the space required for the electrically powered means of transport is available and the electrically powered means of transport travels behind the user if the required space is no longer available; and - when driving behind the user, the space available on either side of the user is determined and the electrically powered means of transport moves to one side of the user if the space required for the electrically powered means of transport is available on at least one side.

[0016] According to one embodiment of the invention, behavioral parameters defined by the user for the electrically powered means of transport can be taken into account during position control.

[0017] Accordingly, the device according to the invention for controlling an electrically driven means of transport, which can be used by a user for movement by positioning himself standing on the means of transport, and which can follow the user autonomously by means of a person following function when the user is not positioned on the means of transport, - at least one sensor unit for detecting the user and the surroundings of the electrically powered means of transport in the passenger following function, whereby the space available for the electrically powered means of transport on the sides of the user can be detected; and - an evaluation and control unit configured to evaluate the sensor data generated by the at least one sensor unit, wherein the space available for the electrically powered means of transport in the person-following function on the sides of the user is evaluated in order to determine, as a function thereof, a relative target position of the electrically powered means of transport in relation to the position of the user and to control an electric drive unit of the electrically powered means of transport in the person-following function such that the electrically powered means of transport assumes the determined target position, wherein the electrically powered means of transport can assume at least two different relative target positions in relation to the position of the user depending on the environment,wherein at least one relative target position is arranged on one side of the user and the other relative target position is arranged behind the user, and wherein the electrically driven means of transport changes between the relative target position on one side of the user and the relative target position behind the user according to the result of the evaluation.

[0018] According to one embodiment of the invention, the at least one sensor unit comprises a LiDAR sensor which is arranged in such a way that the user and the area of ​​the environment lying in front of the electrically powered means of transport in the direction of travel are detected.

[0019] An electrically driven means of transport according to the invention comprises an electric drive unit and a device according to the invention.

[0020] Further features of the present invention will become apparent from the following description and claims in conjunction with the figures. Fig. 1 shows a flowchart illustrating the basic steps of the method according to the invention for controlling an electrically powered means of transport; Fig. 2 shows a functional diagram of the position control according to the invention; Fig. 3 shows schematically an electronically driven longboard with the measuring range of a sensor integrated in the tip in a top view (A) and a side view (B); and Fig. 4 shows a block diagram of the sensorimotor control loop of the method according to the invention.

[0021] To better understand the principles of the present invention, embodiments of the invention are explained in more detail below with reference to the figures. It is understood that the invention is not limited to these embodiments and that the described features may also be combined or modified without departing from the scope of the invention as defined in the claims.

[0022] Fig. Figure 1 schematically shows the basic steps of the method according to the invention for controlling an electrically powered means of transportation. The method is described below using a longboard as an example, but can also be used for similar means of transportation such as skateboards and their modifications, such as snakeboards, etc.

[0023] The process can be activated manually by the longboard user, for example, if they have placed the longboard on the ground or if they have positioned an object that is to be transported on the longboard. The process can also be started automatically if the user has been on the longboard and then stepped off.

[0024] In particular, one or more sensors integrated into the longboard are activated. In process step 10, these are then used to detect both the user and the immediate surroundings of the longboard. The sensor data generated in this way is then evaluated in process step 11. On the one hand, the user is recognized using suitable recognition algorithms, whereby in particular the user's legs can be recognized. Likewise, the surroundings detected by the sensors are checked to determine whether it is freely accessible for the longboard or whether obstacles are detected in front of the longboard that could lead to a collision. These could be, for example, objects on the route, buildings, other road users, or other electrically powered means of transport.Curbs or larger uneven surfaces that cannot be overcome by the electrically powered vehicle can also be detected. Based on the recorded sensor data and the result of the evaluation of this sensor data, a relative target position of the longboard is determined in relation to the current position of the user, with one relative target position being located to the side of the user and the other relative target position being located behind the user. In method step 12, the longboard's electric drive is then controlled so that it assumes the determined target position.

[0025] Fig. 2 shows a functional diagram of the position control according to the invention corresponding to a state machine with the different states Z1 to Z8 that a longboard L can assume with respect to a user N, as well as the transition between these different states.

[0026] As shown in each case, one or more of the longboard's sensors monitor the longboard's surroundings to detect any objects O in the surrounding area that could block the longboard's movement. Furthermore, the sensors also detect the user. Additionally, the figure shows velocity vectors for the longboard and the user, which indicate the current walking or traveling direction.

[0027] In state Z1, the longboard L travels next to user N. Using the integrated sensors, the longboard detects that the user is to its left and that there are currently no obstacles in front of the longboard in the direction of travel. The longboard remains in this relative target position until the sensors detect an object in front of the longboard in state Z2. In this case, the longboard falls back behind the user according to state Z3 and assumes the relative target position behind the user according to state Z4. Even in this state, both user N walking in front of the longboard and the wider area around the longboard continue to be detected by sensors and the environmental situation is assessed. The available space on the sides of the user is calculated and it is determined whether one, both, or neither of the sides is free.

[0028] If, according to state Z5, it is detected that there is not enough space for the longboard on either side of the user, for example because environmental objects on both sides of the user are obstructing the longboard's movement, the longboard remains in follow mode, in which it moves behind the user. If, on the other hand, only one of the user's sides is blocked by an environmental object, according to state Z6, or if both sides next to the user are free again, according to state Z7, the longboard automatically moves out of the user's "shadow" according to state Z8. Once the longboard has reached the position next to the user, it then continues moving next to the user, according to state Z1, until obstacles are detected in front of the longboard again or the user ends the longboard's automatic movement.

[0029] Fig. Figure 3 schematically shows an electronically powered longboard L with a measuring range MB of a sensor unit S integrated into the tip, in a top view (A) and a side view (B). The sensor unit S is characterized by a wide detection range with a large aperture angle for detecting the user and the surroundings and can have one or more sensors. Various sensor types can be considered for detecting objects in the vicinity of the electronically powered longboard.

[0030] LiDAR sensors, which can scan or sample a relevant area using one or more laser beams, are well suited for this purpose. Due to the longboard's low height, a 2D LiDAR sensor is well suited for this purpose. This emits light pulses in a rotating motion in a horizontal plane and calculates the distance to objects in the surrounding area based on the reflections or scattering from these objects. This way, distance values ​​are obtained in a two-dimensional coordinate system. In particular, if the longboard is also intended to transport objects and therefore has a significantly higher height, the use of a 3D LiDAR sensor can also be advantageous. This works according to the same principle, but with multiple laser beams distributed along the vertical axis, each performing a horizontal, rotating scan, so that distance values ​​can be determined within a detection volume.The use of such LiDAR sensors has the advantage that, on the one hand, the data can be collected quickly and with great accuracy, and, on the other hand, the amount of data and thus the processing effort is manageable.

[0031] Optical methods can also be used, which are based on image capture by cameras in the visible or infrared spectral range. In addition to mono cameras, stereo cameras can also be used, which also provide depth information. Similarly, TOF cameras with a time-of-flight method, in which the time it takes for a light pulse to reach the object and back again is measured for each pixel, similar to the LiDAR method, allow the distance of the object depicted on it to be determined for each pixel. Image capture using a camera also enables the detection of the detected objects, if necessary using image analysis and image recognition methods. Finally, radar sensors or ultrasonic sensors can also be used.

[0032] If multiple sensors are used simultaneously, they can also be based on different methods. For example, LiDAR sensors can be combined with camera sensors, allowing both the precise determination of the distance to the reflecting object and its detection. In particular, it can also be planned to use different sensors to detect the user and the longboard's surroundings. For example, the user's legs can be detected by a camera, while the surroundings can be detected by a LiDAR sensor.

[0033] In the Fig. 3, the drive unit of the longboard has four wheels or rollers R, which are arranged on axles (not shown) and can be driven, for example, by an electric motor M. In this case, all four wheels can be driven individually, but it is also possible for only some of the wheels to be driven. Likewise, all or only some of the wheels can be steered in order to be able to adjust the direction of travel. Instead of four wheels, an electrically powered means of transport according to the invention can also have a smaller or larger number of wheels or a drive with chains or legs. The electric motor can, for example, be designed as a three-phase motor or a direct current motor, which is mechanically connected to the wheels or rollers via a gear (not shown), a chain or a toothed belt.Rollers are connected and are supplied with electrical energy by an electrical power supply in the form of a rechargeable battery AK. An evaluation and control unit AS, which may, for example, have a microprocessor, an electronic memory, and one or more electrical interfaces, evaluates the sensor data SD from the sensor S and, based on this, controls the electric motor M. The evaluation and control unit AS, like the LiDAR sensor, can also be supplied with electrical energy by the rechargeable battery AK.

[0034] In Fig. Figure 3B shows a side view of the longboard L. As can be seen, the measuring range MB of the sensor unit S spans a horizontal plane parallel to the longboard's deck D. The components described above, such as the evaluation and control unit AS, the electric motor M, and the battery AK, are arranged below the deck to keep the deck area clear for the user or an object to be transported.

[0035] Such an object G to be transported is shown as an example in the figure. It can be provided that the object can be placed directly on the longboard by the user. However, it is also possible to use a transport box adapted to the shape of the longboard, for example, when particularly fragile objects are to be transported. It can also be provided to adapt the automatic driving style of the longboard when transporting fragile objects, for example, avoiding sudden acceleration or deceleration or tight cornering.

[0036] Furthermore, a longboard user can enter various behavior parameters for the longboard. For example, the user can specify whether the longboard should travel to the left or right of them in sideways riding mode. For example, a right-handed person may prefer to ride on the right side in order to have particularly easy access to an object transported on the longboard. The user can also specify a preferred distance between the longboard and their legs. The behavior parameters can be entered, for example, using a manual control element on the longboard (not shown), or by voice input of an operating command with corresponding evaluation by a speech recognition system integrated into the longboard. The behavior parameters and other inputs can also be entered using a software application for operating the longboard on a user's mobile device.

[0037] Fig.Figure 4 shows a block diagram of a sensorimotor control loop for a device according to the invention. As described above, the environment and the user are detected by the sensor unit S and, based on this, generate sensor data SD, which is fed to the evaluation and control unit AS.

[0038] The evaluation and control unit AS contains a unit EK for person and object recognition, in which the user's human legs and objects in the longboard's vicinity are recognized and differentiated using a recognition algorithm. This recognition unit EK determines the user's position, speed, and direction of movement (x, y, φ, v) as well as the position of the user. x ) Nutzer and the positions (x, y) Objekt,jfrom one or more objects detected in the environment, supplemented, if necessary, by their respective speed and direction of movement in the case of moving objects. This unit also contains the current actual position (x, y). Ist of the longboard. The determined user and object parameters are fed to a unit PS for position control, as are the behavioral parameters VP described above. Based on these, the unit PS determines the current target position (x, y) using an optimization algorithm and the described state machine. Soll for the longboard. The deviation (Δx, Δy) between this target position (x, y) Soll and the current actual position (x, y) Ist The value for this deviation (Δx, Δy) is fed to a PR unit for position control, which then calculates setpoints (v x , ω) SollThe speed and direction of movement of the longboard required to reach the target position are determined and output to an AR unit for drive control. This AR unit then controls the drives of the individual wheels so that the longboard assumes the desired target position.

Claims

[1] Method for controlling an electrically driven means of transport, which can be used by a user (N) for movement by positioning himself standing on the means of transport, and which can follow the user autonomously by means of a person following function if the user is not positioned on the means of transport, in which the person following function - the user and the surroundings of the electrically powered means of transport are detected (10) with at least one sensor (S) of the electrically powered means of transport, wherein the space available for the electrically powered means of transport on the sides of the user is detected; - the sensor data (SD) generated by the at least one sensor (S) are evaluated (11), wherein the space available for the electrically powered means of transport on the sides of the user is evaluated in order to determine, as a function thereof, a relative target position of the electrically powered means of transport with respect to the position of the user; and - the electric drive (M) of the electrically driven means of transport is controlled (12) based thereon in such a way that the electrically driven means of transport assumes the determined target position, wherein the electrically driven means of transport can assume at least two different relative target positions with respect to the position of the user depending on the environment, wherein at least one relative target position is arranged on one side of the user and the other relative target position is arranged behind the user, and wherein the electrically driven means of transport changes between the relative target position on one side of the user and the relative target position behind the user according to the result of the evaluation. [2] Method according to claim 1, wherein in a sensorimotor control loop - when travelling alongside the user, the space available in front of the electrically powered means of transport is determined and the electrically powered means of transport continues to travel alongside the user as long as the space required for the electrically powered means of transport is available and the electrically powered means of transport travels behind the user if the required space is no longer available; and - when driving behind the user, the space available on either side of the user is determined and the electrically powered means of transport moves to one side of the user if the space required for the electrically powered means of transport is available on at least one side. [3] Method according to claim 1 or 2, wherein the electrically powered means of transport is a longboard (L) or a skateboard. [4] Method according to one of the preceding claims, wherein obstacles (O) in the environment and / or the legs of the user are detected during the evaluation of the sensor data (SD). [5] Method according to one of the preceding claims, wherein behavioral parameters (VP) defined by the user for the electrically driven means of transport are taken into account in the position control. [6] Device for controlling an electrically driven means of transport, which can be used by a user (N) for movement by positioning himself standing on the means of transport, and which can follow the user autonomously by means of a person following function when the user is not positioned on the means of transport, with - at least one sensor unit (L) for detecting the user and the surroundings of the electrically powered means of transport in the person-following function, whereby the space available for the electrically powered means of transport on the sides of the user can be detected; and - an evaluation and control unit (AS) configured to evaluate the sensor data (SD) generated by the at least one sensor unit, wherein the space available for the electrically powered means of transport in the person-following function on the sides of the user is evaluated in order to determine, as a function thereof, a relative target position of the electrically powered means of transport in relation to the position of the user and to control an electric drive unit (M) of the electrically powered means of transport in the person-following function such that the electrically powered means of transport assumes the determined target position, wherein the electrically powered means of transport can assume at least two different relative target positions in relation to the position of the user depending on the environment,wherein at least one relative target position is arranged on one side of the user and the other relative target position is arranged behind the user, and wherein the electrically driven means of transport changes between the relative target position on one side of the user and the relative target position behind the user according to the result of the evaluation. [7] Device according to claim 6, wherein the at least one sensor unit (L) comprises a LiDAR sensor arranged to detect the user and the area of the environment in front of the electrically powered means of transport in the direction of travel. [8] Electrically driven means of transport comprising an electric drive unit (M) and a device according to one of claims 6 or 7.

Citation Information

Patent Citations

  • Electric motor-driven stationary vehicle for transporting people

    DE202017006790U1

  • Robotic golf caddy

    US10649451B2

  • Electric vehicles, electric vehicle systems and methods of control

    US20190031254A1

  • Autonomous Skateboard

    US20190250615A1

  • US000010649451B2