Slip-based gesture control system and method for vehicle

Abstract

In the present invention, a slide-based gesture control system (100) for doors and glass articles in a vehicle and a corresponding method are disclosed. The system comprises a touch area (101) disposed on the vehicle, the touch area being configured for sensing gesture input from a user, a central control unit (106) configured for receiving gesture input from the touch area (101), and a processor (105) configured for the central control unit (106), the processor is configured to interpret the gesture input. The processor (105) is configured to communicate an action based on the gesture input to the central control unit (106) to trigger an opening / closing operation of the vehicle door or glazing (104), and the touch area (101) is configured to recognize any false gesture input. The invention provides a system for improving a sliding-based gesture control system of a door and a glass product of a vehicle. The system can provide an improved user experience.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to a solution for controlling the opening and closing operations of a door and a glazing of a vehicle, in particular, the present disclosure relates to a sliding-based gesture control system for a door and a glazing in a vehicle. BACKGROUND

[0002] The background description includes information that can be useful in understanding the present disclosure. It is not an admission that any of the information provided herein is prior art or related to the presently claimed disclosure, nor that any publisher is an art-recognized authority as regards any related field of endeavor. It will further be understood that any discussion of a related art in

[0003] In conventional vehicle doors, a handle is provided that allows users to physically interact with each other to hold and open the vehicle door. However, in recent years, some vehicle doors do not include an outer handle. This can comply with better aesthetic requirements. The emergence of electrical technology in motor vehicles has also led to the removal of the vehicle door handle to enhance better aerodynamics.

[0004] With reference to DE102014222410, this document discloses an access system of a vehicle, wherein in a detection area of a vehicle door a detection device is provided, which has at least two sensor surfaces for detecting a change in the volume of a space, and which is formed in such a way that it detects a change in the volume of a space while detecting the direction of a non-contact operating gesture, and operating gestures performed in mutually perpendicular directions are recognized as different operating gestures. However, this document does not talk about any means for recognizing false gestures.

[0005] With reference also to CN115434603, this document discloses a method, device, vehicle and computer storage medium for controlling the opening and closing of a vehicle door, wherein a touch sliding operation performed by a vehicle user is collected by the vehicle provided with a capacitive sensing area, which includes a plurality of capacitive sensing points. This document talks about a means for determining whether the touch sliding operation is mistaken for a touch operation according to the touch sliding operation trigger state information of the plurality of capacitive sensing points, and finally, when it is determined that the touch sliding operation is not mistaken for a touch operation, the opening or closing of the vehicle door is immediately controlled according to the touch sliding operation trigger sequence on the plurality of capacitive sensing points.

[0006] With reference also to CN106945636, this document discloses a vehicle and a control device and control method of an automobile. The control method directly obtains gesture information of a vehicle owner and verifies the gesture information, thereby avoiding the influence of external signals on unlocking or locking.

[0007] Despite the known solutions, there is still a need for improved gesture based control of doors and glazing in vehicles that provides swipe feedback based operation on actuator control and thereby provides an improved user experience. It has been observed that the prior art does not discuss the system architecture to open / control multiple doors, sunroof, glass pull up / down as a function triggered by swipe direction, duration and speed. Further, there is a need for improved false detection means. Therefore, there is a need for an improved system for gesture based swipe control system for vehicles. Further, there is a need for a single sensing area without the need for door handles or flipper for gesture based door opening and closing operation. SUMMARY

[0008] It is an object of the present invention to provide an improved solution that overcomes the drawbacks of the prior art.

[0009] It is a further object of the present invention to provide a single sensing area without the need for door handles or flipper for gesture based door opening and closing operation in vehicles.

[0010] It is yet a further object of the present invention to provide an improved gesture based swipe control system for vehicles with improved means for recognizing false gestures.

[0011] It is yet a further object of the present invention to provide an improved gesture based swipe control system for vehicles with enhanced user experience.

[0012] These and other objects of the present invention are realized by the following aspects of the present invention. The following disclosure presents a simplified summary of the invention in order to provide a basic understanding of some aspects of the invention. This summary is not an extensive overview of the invention. It is intended to neither identify key or critical elements of the invention nor delineate the scope of the invention. Its sole purpose is to present some concepts of the invention in a simplified form as a prelude to the more detailed description of the invention that is presented later. The intent is to present the basic understanding of some aspects of the invention.

[0013] In an aspect of the present disclosure, a sliding based gesture control system for doors and glazing in a vehicle is provided. The system includes a touch area disposed on the vehicle, the touch area configured to sense gesture inputs from a user, a central control unit configured to receive gesture inputs from the touch area, a processor configured for the central control unit, the processor configured to interpret the gesture inputs, an actuator operably configured with the central control unit, and a vehicle door or glazing. The processor is configured to communicate an action based on the gesture inputs to the central control unit to trigger an open / close release operation of the vehicle door or glazing; and, the touch area is configured to identify any false gesture inputs. The processor is configured to perform a sliding gesture in a manner that reduces user cognitive load. The central control unit is configured to control more than one door and / or glazing from one location using sliding based gesture inputs, duration, and scaled distance, thereby controlling the opening and closing of the doors and glazing with positional accuracy and speed. The touch area is divided into separate areas for gesture recognition, false gesture recognition, and pattern overlay. The touch area includes a pattern overlaid on the surface to disperse water / snow movement towards a minimum resistance area, and the pattern includes a hydrophobic surface with nano or micro pattern, or includes a guide surface pattern to deflect water / snow, whereby the touch area prevents false inputs due to water / snow movement. The touch area includes touch sensors positioned on the outer tip of the patterned surface. The touch area includes multiple sensors configured to identify any false gesture inputs and a display unit to display messages to the user. The central control unit is configured to perform sensor data fusion based on inputs received from the multiple sensors. The touch area includes a first sensor to identify touch, a second sensor to identify presence of rain, fog, or snow, a third sensor to detect presence of a person, and a fourth sensor to authorize a user. The central control unit is configured to perform sensor data fusion to identify any false gesture inputs, wherein the multiple sensors work in conjunction to identify false gestures. The touch area is disposed in a glazing or a pillar or a combination of glazing and pillar in the vehicle. The central control unit and / or processor is operably configured with a cloud server and is further configured to implement machine learning techniques to improve gesture recognition. The sliding based gesture control system has a backup power unit configured to provide a secondary power source to the processor and actuator. The system is capable of providing glass positional accuracy, duration, and speed that can be changed using potential voltage generated during a touch / sliding event.In this aspect, the sensor includes one or more sensing layers adapted to interpret input, a spacer layer adapted to separate the one or more sensing layers, and one or more electrodes adapted to generate current. The spacer layer is adapted to prevent false touch and ensure accurate detection. The sensor is arranged in a grid pattern to position to prevent false activation, wherein the pattern is a honeycomb structure, however, is not limited thereto.

[0014] In another aspect of the present invention, a pillar or door of a vehicle is provided. The pillar or door of the vehicle includes a device for receiving and interpreting tactile input from a user. Further, the pillar or door includes a touch area disposed on the vehicle, the touch area configured to sense gesture input from the user. The touch area is divided into separate areas for gesture recognition, false gesture recognition, and pattern overlay, and configured to identify any false gesture input. The touch area includes a plurality of sensors configured to identify any false gesture input and a display unit to display a message to the user. The pillar includes a protective and durable wear-resistant hydrophobic and oleophobic. The sensor includes one or more sensing layers adapted to interpret input, a spacer layer adapted to separate the one or more sensing layers, and one or more electrodes adapted to generate current. The spacer layer is adapted to prevent false touch and ensure accurate detection. The sensor is arranged in a grid pattern to position to prevent false activation, and the pattern is a honeycomb structure.

[0015] In another aspect of the present invention, a sliding-based gesture control method for a door and a glazing in a vehicle is provided. The method includes obtaining, by a plurality of sensors, one or more input data for detecting a sliding-based gesture; detecting, by a central control unit, the sliding-based gesture as a false gesture or a true gesture; communicating, by the central control unit to a processor, the detected sliding-based gesture; identifying, by the processor, an interpretation of the detected sliding-based gesture; communicating, by the processor to the central control unit, an instruction for a trigger action based on the sliding-based gesture; and sending, by the central control unit to one or more actuators, a control signal based on the instruction to release and open the door or the glazing.

[0016] The system according to the present invention can have a single sensing unit without the need for door handles or flipper in the vehicle. The door control is managed in a schematic manner from the driver side to all the doors in the processor. The present invention discloses a door opening mechanism based on feedback from gestures. The present invention contemplates an emergency function system in case of power failure during a crash situation or battery depletion situation. The system includes a unique pattern to detect a user gesture with gloves and to avoid water droplets due to rain / snow.

[0017] Important features of the present application and its advantages will become apparent to those skilled in the art from the following detailed description, in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0018] The accompanying drawings are briefly described below, which illustrate technical solutions of embodiments of the present application or prior art, to assist those skilled in the art in understanding the present application. Obviously, the drawings in the following description only show some embodiments of the present application, and those skilled in the art can derive other drawings from the drawings without departing from the scope of the present disclosure.

[0019] Figure 1 A block diagram of a system according to embodiments of the present application is shown.

[0020] Figure 2A Fig. 2C shows different aspects of a patterned surface of a touch area according to embodiments of the present application.

[0021] Figures 3A-3D Different implementations of a touch area according to embodiments of the present application are shown.

[0022] Figure 4 A block diagram of a method according to embodiments of the present application is shown.

[0023] Figure 5 A block diagram of a system architecture according to embodiments of the present application is shown.

[0024] Figures 6A-6B Different examples of a system according to embodiments of the present application are shown.

[0025] Those skilled in the art will understand that the elements in the figures are shown for the purpose of simplification and clarity and are not necessarily drawn to scale. For example, the dimensions of some of the elements in the figures can be exaggerated relative to other elements to help improve understanding of the embodiments of the present disclosure. DETAILED DESCRIPTION

[0026] The present disclosure is now discussed in greater detail with reference to the accompanying drawings that are submitted with this application. Those skilled in the art will understand that the description is made for the purpose of aiding in the understanding of the present application, but these are considered merely exemplary.

[0027] The terms and words used in the following description are not limited to the bibliographical meanings, but are used so as to enable a clear and consistent understanding of the present application. Accordingly, the terms and words are to be interpreted based on the understanding of the present disclosure in their context. Also, the description is presented in terms of sequential

[0028] Removal of door handles provides enhanced better aerodynamics. The present invention provides a control system for operating handleless doors. Such controls can be provided on the glass area to engage corresponding actuators for opening and closing mechanisms. The overall control system ensures better user experience without compromising any existing door / glass control experience with better functionality and reliability under all environmental and expected operating conditions.

[0029] In an embodiment of the present invention, a sliding based gesture control system (100) for doors and glass of a vehicle is disclosed. Figure 1 A block diagram of a system and its architecture is involved. The system includes a touch area (101) provided on the vehicle, the touch area is configured to sense gesture input from a user. The touch area (101) can be provided on the glass or around the pillar area. The system includes a central control unit (106) configured to receive the gesture input from the touch area (101). The system further includes a processor (105) configured for the central control unit (106), the processor is configured to interpret the gesture input. The system includes an actuator (102) operably configured with the central control unit (106) and a vehicle door or glass (104). The processor (105) is configured to communicate an action based on the gesture input to the central control unit (106) to trigger opening of the vehicle door or glass (104). The touch area (101) is configured to identify any false gesture input. The disclosed system is capable of controlling vehicle doors and glasses without mechanical handles. The system is further configured to access all doors and glasses from one touch area pillar externally. Unique touch surface avoids water based and other potential false touches to avoid false touch. In an embodiment, the present invention provides a device having a single touch area for controlling all doors and glasses of a vehicle. The touch area of the system can preferably be outside the vehicle and in the pillar area. The touch area can include a display unit for displaying appropriate messages to the user. The system includes a backup power unit (103) configured to provide a secondary power source to the processor (105) and actuator (102). The backup power unit acts as a back up when the original power source is cut off or the battery is drained.

[0030] In embodiments of the present application, means are provided for avoiding false touches. False touches can occur on the sensors that activate the sensor. Such false touches can be caused by water droplets, dirt accumulation, accidental contact, insect impact, etc. By combining appropriate materials and design patterns, the occurrence of false touches on the tactile sensor can be significantly reduced, thereby improving the accuracy and reliability of the touch detection system. One of the means is to include a spacing. In embodiments of the present application, in the structure of the tactile sensor, a spacing layer can be provided to separate the sensing layer from the electrode to prevent false touches and ensure accurate detection. The spacing can be made of a non-conductive material such as silicone or polyimide.

[0031] In embodiments of the present application, means are provided for self-cleaning coating on the touch area or region of the column or door. For this purpose, a protective coating can be provided on the upper cover of the sensor or column component to protect the sensor from environmental damage. The material can be selected in such a way that the surface of the B column sensor component is treated with a hydrophobic coating that repels water and dirt to maintain functionality. The material can be a wear-resistant hydrophobic and oleophobic material. In embodiments of the present application, such a material can be two silane-modified surfaces [octadecyltrichlorosilane (OTS) and tridecafluoro-1,1,2,2 tetrahydrooctyl-trichlorosilane (FS)]. The material can be sprayed onto a plastic / glass substrate to modify the surface to be frictionless to water droplets so that water is deflected before it adheres to the surface. In another embodiment, alumina particles can be provided to construct a thin rough surface. This advantageously provides better durability to the surface before spraying the silane compound. These chemicals can be coated with a spraying or dipping method and do not require additional pretreatment / post-treatment.

[0032] In embodiments of the present application, means are provided for patterning the sensor elements. Reference is made to Figure 3D which provides an exemplary embodiment of a grid-like pattern (P1). The grid pattern enables the sensor to more accurately locate the touch. This also helps to distinguish between true activation and false activation. For example, the sensor can be surrounded by six other sensors, such that it creates a honeycomb structure. This pattern is particularly advantageous compared to a conventional square grid, for example, due to the more uniform spacing of the higher density of touch points and increased sensitivity. Reference is made to Figure 3D If the sensors marked 1b, 2a and 2b are activated, a consistent change in capacitance and resistance is achieved, and the pattern will be predicted as a local activation, thereby being identified as a real touch. In a second case, for example, if the sensors marked 1b, 2d and 3a are activated, resulting in a scattered change in capacitance and / or resistance, and thereby interpreted as a false touch.

[0033] In this disclosure, the glassware includes side windows, corner windows, and sunroofs. Doors may include common conventional doors for user entry and exit from the vehicle, trunk doors, hood doors, fuel flaps, etc. The opening / closing operation of a door or glassware, or simply the term "opening / closing," includes locking, unlocking, and releasing the door or glassware, thereby facilitating entry into the vehicle interior or exit from the vehicle exterior. For example, when indicated as a side window opening, it includes a downward sliding operation of the side window. Furthermore, the opening operation herein may take into account parameters such as the speed, degree of opening, and area of ​​opening of the door or glassware. The glass position accuracy, duration, and speed of the glassware can be determined using potential voltage changes generated during a touch / slide event.

[0034] In this implementation, the system with the touch area (101) is linked to the vehicle's centralized electronic control unit (ECU). The ECU is linked to a processor (105) and is powered by the vehicle's power unit. The actuator performs door and / or glass control actions triggered by input in the touch area. The central control unit and processor are capable of receiving feedback to provide positional accuracy for opening / closing the glass / door.

[0035] The central control unit (106) is configured to control more than one door and / or glass object from a single location using swipe-based gesture input. The central control unit / processor also considers duration and proportional distance to control the opening and closing of doors and glass objects with positional accuracy and speed. For example, a swipe by the swiper will result in an opening and closing operation. The central control unit / processor is capable of providing the glass object with direction and movement based on accuracy, speed, and orientation. For example, an input of swiping up halfway will result in a half-sliding operation of a sliding side window. This reduces cognitive load. The glass positional accuracy, duration, and speed of the glass object can be achieved using changes in potential voltage generated during the touch / swipe event.

[0036] In embodiments of the invention, a special algorithm can be configured to provide an appropriate interpretation of touch patterns for an enhanced user experience. This reduces cognitive load and follows existing mental models for performing swipe gestures on the touch area. The system is capable of controlling different doors and glassware from a single location using swipe direction / gesture and duration. In a specific embodiment, the central control unit (106) is configured to control more than one door and / or glassware from a single location using swipe-based gesture input and duration. The system architecture allows it to open / control multiple doors, skylights, and pull-up / pull-down glass as functions triggered by swipe direction and duration. Furthermore, unique patterns set on the surface can be used to resist water droplets and non-human touch-triggered functions.

[0037] In embodiments of the invention, the processor (105) is configured to communicate corresponding actions (or control / signals) to the control unit based on the sliding nature and duration. In embodiments, for example, the disclosed system is capable of opening or controlling multiple doors, skylights, and glass pull-up / pull-down as functions triggered by the sliding direction and duration. Examples of sliding and their corresponding actions are provided in the table below.

[0038] Table 1

[0039] In this embodiment, a central control unit (106) is provided, configured to control more than one door and / or glass object from a single location using swipe-based gesture input, duration, and proportional distance, thereby controlling the opening and closing operations of the door and glass object with positional accuracy and speed. The central control unit (106) is configured to perform sensor data fusion based on input received from multiple sensors. The touch area (101) includes a first sensor for recognizing a touch, a second sensor for recognizing the presence of rain, fog, or snow, a third sensor for detecting the presence of a person, and a fourth sensor for authorizing a user. The central control unit (106) is configured to perform sensor data fusion to recognize any spurious gesture input. The multiple sensors work together to recognize spurious gestures.

[0040] In embodiments of the invention, the system includes an architecture relating to a process of efficient operation when a gesture is detected for effective functioning. In one embodiment, the touch area includes a touch or gesture sensor, a surface sensor (material detector), and a proximity sensor. The central control unit receives data from the sensors. The surface material sensor works in conjunction with the proximity sensor to determine whether the gesture originates from a human touch or from a false detection due to ice, rain, fog, or a person tilting on the surface or other false contact patterns. This is accomplished in a false detector module, which may suitably be part of the central control unit (106), processor (105), or even the touch area (101) itself. The false detector receives information about the type of material on the surface via a sensor (e.g., radar or camera). The proximity sensor is configured to detect the presence of a person or object near the gesture sensor area. This can act as a guiding indication for activating the sensor in the gesture area and at the site, determining whether the gesture is accidental or based on non-human contact (e.g., animal, bird, ice, rain, fog, etc.). Once a touch or contact is verified as a valid contact by the spoofing detector, the central control unit (106) triggers the processor (105) to identify the type of gesture; otherwise, it waits for a spoofing detection cycle for verification. The processor (105) is able to select an appropriate action cycle based on the gesture. An appropriate action may include triggering to control a door or skylight or any other glasswork.

[0041] In embodiments of the present invention, the central control unit (106) and / or processor (105) are operatively configured for use with a cloud server. The central control unit (106) and / or processor (105) are also configured to implement machine learning techniques to improve gesture recognition.

[0042] In an exemplary embodiment, the sensor responses can be provided to an edge device capable of implementing machine learning models. This allows for long-term determination of the type of contact expected by each sensor. The artificial intelligence or machine learning model can be updated with new information during each operating cycle of the system and uses historical data and existing sensor specifications to define the optimal gestures and deviations expected by the user. This reduces response time and false detections at the ECU level itself.

[0043] In an exemplary embodiment, a specific touch or continuous touch or swipe sequence determines the type of operation to be performed on the lowering of the glass in a skylight or side window. The degree to which the glass is lowered or opened in the skylight or side window (i.e., the gap coordinates) is controlled proportionally by the touch length and duration. The touch sensor is configured to detect the swipe length and direction and control the actuator to open / close the glass item to the corresponding percentage. For example, a downward swipe of 75% of the total length may result in a 75% lowering / opening of the glass item. Similarly, an upward swipe of 50% of the total length may result in a 50% closing of the glass item (here, the glass item could be a side window or skylight). The glass item control system detects the position of the glass item and sends feedback to the actuator to perform an action to open or close the glass item based on the touch input provided by the user, taking into account the swipe distance and direction. In this example, the glass position accuracy, duration, and speed can be achieved using changes in potential voltage generated during the touch / swipe event.

[0044] refer to Figure 2A It provides a patterned surface (1011) in which a touch sensor is positioned at the outer tip of the patterned surface. The pattern covers the touch surface to dissipate water droplets toward the area of ​​least resistance (similar to capillary action). Figure 2B The invention provides a top view of a touch area (101) disposed on a glass component or pillar of a vehicle. The touch area (101) is divided into separate areas for gesture recognition (1012), for dummy gesture recognition (1013), and for pattern overlay (1011). The substrate for the touch area may be the same substrate (201) used for the glass component or pillar area, i.e., glass or polymer. In embodiments of the invention, the touch area (101) is disclosed to include a pattern (1011) overlaid on a surface to repel water / snow towards an area of ​​least resistance. The pattern includes a hydrophobic surface with nano or micron patterns, or includes a guiding surface pattern to deflect water / snow, thereby preventing the touch area (101) from being recognized as input due to the movement of water / snow. Reference Figure 2BThe text describes two examples of patterned surfaces. One example may be a hydrophobic surface with nano or micron patterns. Another example may be a guiding surface as an alternative to hydrophobic or hydrophilic surfaces such as patterned glass, polymers, etc. The touch area may be made of polymers such as acrylic resin, epoxy resin, polyethylene, polystyrene, polyvinyl chloride, polytetrafluoroethylene, polydimethylsiloxane, polyester, polyurethane, etc. The touch area may also include composite materials, such as manganese oxide polystyrene (MnO2 / PS) nanocomposite materials or zinc oxide polystyrene (ZnO / PS) nanocomposite materials. It should be understood that such examples are provided by way of illustration and not by way of limitation. The touch area (101) includes a touch sensor positioned on the outer tip of the patterned surface. The touch area (101) includes multiple sensors configured to recognize any fake gesture input and a display unit for displaying messages to the user.

[0045] The touch area (101) is disposed in a glass component or pillar, or a combination of a glass component and a pillar, in the vehicle. The touch area may be disposed in a single glass component or a laminated glass component. (See attached document.) Figures 3A-3C It provides examples of touch areas provided in single glass articles, laminated glass articles, and glass articles with displays. Figure 3A A touch area (10) provided in a single glass article is shown. This touch area includes a glass or polymer substrate (201) having a patterned surface cover (1011), an area for gesture recognition (1012), and an area for dummy gesture recognition (1013). Similarly, Figure 3B A touch area (110) is depicted in a laminated glass article provided between two substrates (201, 202) and a sandwiched interlayer (203). A surface pattern may be overlaid on a suitable substrate, preferably on the substrate facing inwards from the glass article. In some embodiments, an illumination / display layer (301) or display element (301) may be provided to identify the area and provide a quick view of the activated door / system.

[0046] In an embodiment of the invention, a first sensor may be disposed in the touch area. This first sensor aligns with the surface area. The first sensor provides a circumferential touch sensor around the gesture area to distinguish between two areas by any or a combination of capacitance, resistance, or conductivity. This sensor is capable of detecting full-area contact, or, if possible, a spurious gesture, such as contact between ice / fog and the surface. In another embodiment, a second sensor is disposed in the touch area. This sensor may be an optical sensor placed behind the gesture area to detect the presence of fog or ice. In another instance, a third sensor, such as a proximity sensor, may be disposed. A LiDAR / radar or ultrasonic sensor is placed to detect the presence of a person and to detect spurious gestures from any other material. In another instance, a fourth sensor is disposed to ensure selective access control. This selective access control can be used for low-frequency (LF) or high-frequency (HF) based access control to the gesture area. This control can be implemented using an NFC coil. The gesture area will only be activated after access confirmation. This access confirmation can be performed in a manner similar to conventional key access. Each sensing feature or module may be used individually or in combination. In an example case, this can be achieved by using an active layer between a hydrophobic layer and a glass layer. The material differentiation sensor can be a radar sensor or a camera. The radar sensor or camera is configured to function as a false detector because it can distinguish between ice / fog and fingers. In an alternative embodiment, a conductive polymer that can act as a hydrophobic and active layer can be used to modify the surface.

[0047] In embodiments of the present invention, a swipe-based gesture control method for doors and glassware in vehicles is provided, such as... Figure 4 As shown. The method includes: obtaining (S101) one or more input data for detecting a swipe-based gesture by multiple sensors; detecting (S102) whether the swipe-based gesture is a fake or real gesture by a central control unit; communicating (S103) the detected swipe-based gesture by the central control unit to a processor; interpreting (S104) the detected swipe-based gesture by the processor; communicating (S105) a command for triggering an action based on the swipe-based gesture by the processor to the central control unit; and sending (S104) a control signal based on the command to one or more actuators by the central control unit to release and open a door or glass object.

[0048] Industrial Applicability: The disclosed system can be applied to vehicle exteriors and interiors for door control mechanisms to control multiple systems (e.g., infotainment, navigation, ADAS, lighting, HVAC management, and non-automotive systems). The disclosed system can be part of a swipe gesture within an interior interface system in automobiles, trains, etc. The proposed system can be extended to use in door control systems in buildings.

[0049] refer to Figure 5 The figure illustrates the system architecture of the present invention according to an embodiment of the invention. The figure shows a central system according to an embodiment of the invention. The central system is responsible for the general functions of all vehicle systems. The central system is configured to communicatively couple with vehicle subsystems (e.g., but not limited to touch interfaces and sensors, such as touch, gestures, proximity, etc. (of touch area 5031)). For example, a door control system may be coupled with a motor and a power supply (501) for battery information and for device power supply. In some instances, the door control system may be provided with an edge device (504). The edge device here is responsible for transmitting sensor data and algorithm information. The central system performs control functions, such as operating door opening and closing, basic sensor-based responses, subsystem diagnostics, and door control based on custom algorithms, which may be periodically and require updating the basis from the edge device (504) based on a learning model. In embodiments of the invention, an edge device is provided. The edge device acts as an interface unit between the central ECU (502) and the outside world and the Internet. In addition to control commands stored and executed in real time by the central ECU (502), the device is also responsible for acquiring all sensor information. However, the device is configured to transmit only relevant or processed information to external networks (e.g., the cloud (505), other vehicles, infrastructure, etc.). Leveraging integrated processing capabilities, the edge device (504) is configured to perform real-time edge computing at the vehicle level and provide faster and more accurate responses. The edge device can also internally adapt a base learning model and, for higher computational demands, transmit information to cloud devices. Decisions from the processed model can be transmitted to the vehicle's electronic control unit to perform control functions within the vehicle.

[0050] In one or more embodiments of the invention, the system architecture is advantageously modified in a touch area (5031) comprising a combination of proximity sensors, surface sensors, and touch / gesture sensors. The receiver surface of the system has a unique design pattern and material finish to sense user touch / gestures (even with gloves / fabric) and to detect and avoid other external elements (e.g., water, snow, non-human touch, etc.). The system has a separate (not associated with the main power supply) backup power supply unit to operate the door opening in emergency situations (e.g., low or depleted battery / disruption of wiring due to a collision). The backup unit uses mechanical energy to charge the backup battery during manual opening / closing of the door. Figure 5 An exemplary embodiment of the disclosed system is described.

[0051] Example: Reference Figure 5 A and Figure 5B, which describes the control flow according to some embodiments of the invention. In this embodiment, touch / gesture sensors are used for touch detection. If a gesture is recognized as genuine by the processor, the central control unit provides a relevant control signal to the actuator control system. This control signal can be used for door control and sunroof control (e.g., but not limited to). Surface sensors detect materials, and proximity sensors detect the appropriate presence of a person (whether tilted or not). Data from these sensors can be used for sham gesture detection. This detection is performed by a sham detector. Touch detection and recognition of gestures can be performed by the ECU. This control flow and system architecture have been described in [the original text is missing here]. Figure 6A Limited to [the specified range]. Figure 6B Another example is described. In this example, once touch detection is performed by the ECU, the ECU performs gesture recognition and determines the gesture function. Additionally, the ECU recognizes the gesture direction and detects the gesture distance and time. Once these commands are determined and recognized, control is provided to the actuator control system, which is operatively coupled to the door control and sunroof control. The door control and sunroof control are responsible for monitoring the door position and sunroof position, respectively. Feedback from the door control and sunroof control is fed into the actuator control system. This feedback from the glass / door to the control system also provides positioning accuracy.

[0052] In embodiments of the invention, the receiver surface of the system includes a unique design pattern and material finish to sense user touch / gestures (even with gloves / fabric) and detect and avoid other external elements (e.g., water, snow, non-human touch, etc.). The disclosed invention is a centralized system that links and controls all doors and enclosed glass elements, including the roof, within a vehicle. The disclosed system can be mounted on pillar components (but is not limited to pillars) and is configured for operation via swipe gestures that control the doors in multiple modes based on the swipe direction and touch duration. The system may include a separate backup power supply unit (not associated with the main power supply) to operate the door opening in emergency situations (e.g., low or depleted battery / disrupted wiring due to a collision). The backup unit charges the backup battery using mechanical energy during manual opening / closing of the door.

[0053] The features described and / or shown in the embodiments may be used in one or more other embodiments in the same or similar manner and / or combined with or in place of features of other embodiments.

[0054] The following are some advantages of the present invention:

[0055] • The disclosed system has a unique device for controlling vehicle doors and glassware without mechanical handles and for accessing all vehicle doors and glassware from an external pillar.

[0056] • False gesture recognition includes a unique touch surface that avoids water-based and other potential false touches to prevent accidental touches.

[0057] • Removing handles from vehicle doors enhances aerodynamics.

[0058] • This invention implements edge computing and machine learning methods to improve user experience, using column-based technology to control door opening and closing mechanisms.

[0059] List of reference numerals and corresponding features appearing in the attached figures: 100: System 101: Touch Area 102: Actuator 103: Backup Power Unit 104: Vehicle doors / glass products 105: Processor 106: Central Control Unit 107: Power Supply 1011: Patterned Surface 201, 202: Glass substrate 203: Mezzanine 1012: Gesture Area 1013: Fake gesture area 301: Display element 1a, 1b, 1c, 1d...: Indicators of patterned textures 501: Vehicle power supply 502: Centralized ECU 505: Processor 5031: Touch Area 5032: Actuator 5033: Backup Power Unit 5034: Doors and Glassware Unit 504: Edge device 505: Cloud / Internet 506: ML Model P1: Pattern S101-S106: Steps of the Method

Claims

1. A swipe-based gesture control system (100) for doors and glassware in vehicles, wherein, The system includes: a touch area (101) disposed on the vehicle, the touch area being configured to sense gesture input from a user; a central control unit (106) configured to receive the gesture input from the touch area (101); a processor (105) configured for the central control unit (106) to interpret the gesture input; an actuator (102) operably configured with the central control unit (106); and a vehicle door or glass object (104); wherein the processor (105) is configured to communicate to the central control unit (106) an action based on the gesture input to trigger an opening / closing operation of the vehicle door or glass object (104); and the touch area (101) is configured to recognize any spurious gesture input.

2. The swipe-based gesture control system (100) according to claim 1, wherein, The processor (105) is configured to perform swipe gestures in a manner that reduces the cognitive load on the user.

3. The swipe-based gesture control system (100) according to claim 1 or 2, wherein, The central control unit (106) is configured to control more than one door and / or glassware from one location using swipe-based gesture input, duration, and proportional distance, thereby controlling the opening and closing of the doors and glassware with positional accuracy and speed.

4. The swipe-based gesture control system (100) according to any one of claims 1 to 3, wherein, The touch area (101) is divided into a separate area for gesture recognition (1011), an area for fake gesture recognition (1012), and an area for pattern overlay (1013).

5. The swipe-based gesture control system (100) according to any one of claims 1 to 4, wherein, The touch area (101) includes a pattern covering the surface to deflect water / snow toward the area of ​​least resistance; and the pattern includes a hydrophobic surface with a nano or micro pattern, or includes a guiding surface pattern to deflect water / snow, thereby preventing the touch area (101) from being recognized as input due to the movement of water / snow.

6. The swipe-based gesture control system (100) according to any one of claims 1 to 5, wherein, The touch area (101) includes a touch sensor located on the outer tip of the patterned surface.

7. The swipe-based gesture control system (100) according to any one of claims 1 to 6, wherein, The touch area (101) includes multiple sensors configured to recognize any fake gesture input and a display unit for displaying messages to the user.

8. The swipe-based gesture control system (100) according to any one of claims 1 to 7, wherein, The central control unit (106) is configured to perform sensor data fusion based on inputs received from the plurality of sensors.

9. The swipe-based gesture control system (100) according to any one of claims 1 to 8, wherein, The touch area (101) includes a first sensor for recognizing touch, a second sensor for recognizing the presence of rain, fog or snow, a third sensor for detecting the presence of a person, and a fourth sensor for authorizing a user.

10. The swipe-based gesture control system (100) according to any one of claims 1 to 9, wherein, The central control unit (106) is configured to perform sensor data fusion to identify any fake gesture input, wherein the multiple sensors work together to identify fake gestures.

11. The swipe-based gesture control system (100) according to any one of claims 1 to 10, wherein, The touch area (101) is located in the glasswork or pillar in the vehicle or in a combination of glasswork and pillar.

12. The swipe-based gesture control system (100) according to any one of claims 1 to 11, wherein, The central control unit (106) and / or processor (105) are operatively configured for use as a cloud server; and are also configured to implement machine learning techniques to improve gesture recognition.

13. The swipe-based gesture control system (100) according to any one of claims 1 to 12, the swipe-based gesture control system comprising a backup power unit (103) configured to provide an auxiliary power source to the processor (105) and the actuator (102).

14. The swipe-based gesture control system (100) according to any one of claims 1 to 13, wherein, The sensor includes: one or more sensing layers adapted to interpret input, a spacer layer adapted to separate the one or more sensing layers, and one or more electrodes adapted to generate current; wherein the spacer layer is adapted to prevent false touches and ensure accurate detection.

15. The swipe-based gesture control system (100) according to any one of claims 1 to 14, wherein, The sensors are arranged in a grid pattern for positioning to prevent false activation, and the pattern is a honeycomb structure.

16. A pillar or door for a vehicle, said pillar or door having means for receiving and interpreting tactile input from a user, wherein, The pillar or door includes: a touch area disposed on the vehicle, the touch area being configured to sense gesture input from a user, wherein the touch area is divided into separate areas for gesture recognition, areas for fake gesture recognition, and areas for pattern overlay, and is configured to recognize any fake gesture input.

17. The pillar or door of the vehicle according to claim 16, wherein, The touch area includes multiple sensors configured to recognize any fake gesture input and a display unit to display messages to the user.

18. The pillar or door of the vehicle according to claim 16 or 17, wherein, The column includes protective and durable abrasion-resistant hydrophobic and oleophobic properties.

19. The pillar or door of the vehicle according to any one of claims 16 to 18, wherein, The sensor includes: one or more sensing layers adapted to interpret input, a spacer layer adapted to separate the one or more sensing layers, and one or more electrodes adapted to generate current; wherein the spacer layer is adapted to prevent false touches and ensure accurate detection.

20. The pillar or door of the vehicle according to any one of claims 16 to 19, wherein, The sensors are arranged in a grid pattern for positioning to prevent false activation, and the pattern is a honeycomb structure.

21. A swipe-based gesture control method for doors and glassware in vehicles, wherein, The method includes: acquiring (S101) one or more input data from multiple sensors for detecting a swipe-based gesture; detecting (S102) whether the swipe-based gesture is a fake or real gesture by a central control unit; communicating the detected swipe-based gesture to a processor by the central control unit (S103); interpreting the detected swipe-based gesture by the processor (S104); communicating (S105) a command for triggering an action based on the swipe-based gesture to the central control unit by the processor; and sending (S104) a control signal based on the command to one or more actuators by the central control unit to release and open / close a door or glassware.

Images