Providing user interface for controlling touch screen in vehicle using multiple finger gestures

Abstract

To implement a prescribed multiple finger gesture for providing an easier function control without distracting a driver.SOLUTION: A multiple finger gesture user interface control is provided in a vehicle. A relationship between a prescribed function control and a prescribed multiple finger gesture using at least two fingers pressed on a touch screen for a prescribed period of time is set in advance. The prescribed multiple finger gesture is detected using the at least two fingers pressed on the touch screen for the prescribed period of time. A prescribed function control corresponding to the prescribed multiple finger gesture is generated. Multiple finger gestures are configured to provide input to a touch screen in a vehicle for executing functions or operations that are mapped to the multiple finger gestures.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present specification relates to providing a user interface for controlling a touchscreen in a vehicle using multi-finger gestures. [Background technology]

[0002] Input / output (I / O) is the process by which information is sent to a computer and by which a computer interacts with the physical world. Touch-based input / output (I / O) interfaces are present in many types of devices, such as smartphones, tablets, and laptops, and have permeated many aspects of daily life. For example, it is now common for people to organize and conduct social interactions through smartphone or tablet applications. Additionally, businesses often use touch-based devices to communicate with employees, monitor work, and review project data, among any number of other uses.

[0003] Typically, touch-enabled devices run touch-enabled operating systems that inherently utilize touch input to control interaction with the operating system. While such devices are useful and valuable, they suffer from the same limitations: at a primary level, they require the user to directly and manually interact with the device.

[0004] The widespread adoption of touchscreen technology is integrating interactive displays into the modern vehicle environment. Today's vehicles are equipped with an increasing number of sensors, actuators, and peripherals. The rapid increase in I / O is creating a high level of complexity that requires new approaches to electrical and electronic architectures.

[0005] Common examples of human touch-based I / O allow vehicle occupants to turn up the heat, play music, adjust the seat position, roll down the windows, and control vehicle components. However, due to road and driving conditions, user input on such displays often leads to incorrect choices and dangerous driving events. Many laws prohibit drivers from using handheld devices while driving. For this reason, devices with touchscreens are often mounted close to the driver. In some cases, the touchscreen is located in a way that makes it difficult for the driver to operate it while driving. Furthermore, having to look at the touchscreen means the driver is not looking in the direction of travel, which is dangerous. Therefore, operating a device with a touchscreen while driving can increase the risk of danger to the vehicle driver and other vehicle occupants. Summary of the Invention

[0006] In at least one embodiment, a method for providing multi-finger gesture user interface control in a vehicle includes registering a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against a touchscreen for a predetermined time period; detecting the predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined time period; and generating a predetermined function control corresponding to the predetermined multi-finger gesture.

[0007] In at least one embodiment, an apparatus for providing multi-finger gesture user interface control in a vehicle includes a memory storing computer-readable instructions and a processor coupled to the memory, the processor configured to execute the computer-readable instructions to perform operations to register a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against a touchscreen for a predetermined time period, detect a predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined time period, and generate a predetermined function control corresponding to the predetermined multi-finger gesture.

[0008] In at least one embodiment, a non-transitory computer-readable medium stores computer-readable instructions that, when executed by a processor, cause the processor to perform operations including registering a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined time, detecting the predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined time, and generating a predetermined function control corresponding to the predetermined multi-finger gesture. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 illustrates a vehicle having a touchscreen input / output device according to at least one embodiment. [Figure 2] FIG. 2 is a front view of a second vehicle cockpit according to at least one embodiment. [Figure 3] FIG. 3 is a block diagram of a multi-finger gesture system according to at least one embodiment. [Figure 4] FIG. 4 illustrates a first type of multi-finger gesture according to at least one embodiment. [Figure 5] FIG. 5 illustrates a second type of multi-finger gesture according to at least one embodiment. [Figure 6] FIG. 6 illustrates a third type of multi-finger gesture according to at least one embodiment. [Figure 7] FIG. 7 is a flowchart of a method for providing user interface control via a touchscreen in a vehicle according to at least one embodiment. [Figure 8] FIG. 8 is a high-level functional block diagram of a processor-based system according to at least one embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Features, aspects, and advantages of certain exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which like reference numerals indicate like elements, and in which:

[0011] The following detailed description of exemplary embodiments refers to the accompanying drawings. The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit implementations to the precise form disclosed. Modifications and variations are possible in light of the above disclosure or may be acquired from practice of implementations. Moreover, one or more features or components of one embodiment may be incorporated into or combined with another embodiment (or one or more features of another embodiment). Furthermore, in the flowcharts and descriptions of operations provided below, it is understood that one or more operations may be omitted, one or more operations may be added, one or more operations may be performed simultaneously (at least in part), and the order of one or more operations may be rearranged, unless such modifications affect the resulting scope of the invention.

[0012] It will be apparent that the systems and / or methods described herein may be implemented in various forms of hardware, software, or a combination of hardware and software. The actual specialized control hardware or software code used to implement such systems and / or methods is not intended to limit the implementation. Thus, the operation and behavior of the systems and / or methods are described herein without reference to specific software code. It will be understood that software and hardware may be designed to implement the systems and / or methods based on the description herein.

[0013] Although particular combinations of features may be recited in the claims and / or disclosed in the specification, such combinations are not intended to limit the disclosure of possible implementations. Indeed, many of such features may be combined and / or disclosed in the specification in ways not specifically recited in the claims. While the dependent claims listed below may depend directly on a single claim, the disclosure of possible implementations includes any dependent claim in combination with any other claim in the group.

[0014] As used herein, no element, act, or instruction should be construed as critical or required unless explicitly described as such. Additionally, as used herein, the articles "a" and "an" are intended to include one or more items and may be used interchangeably with "one or more." Where one item is intended, "one" or similar language is used. Additionally, as used herein, the terms "have," "having," "include," "including," and the like are intended to be open-ended terms. Furthermore, the phrase "based on" is intended to mean "based at least in part on," unless expressly stated otherwise. Furthermore, phrases such as "at least one of A and B," "A and / or B," or "at least one of A or B" should be understood to include A only, B only, or both A and B.

[0015] Additionally, spatially relative terms such as "below," "lower," "bottom," "above," and "top" are used herein for ease of description to describe the relationship between one element or feature and another, as shown in the figures. Spatially relative terms are intended to encompass various orientations of the device during use or operation in addition to the orientation shown in the figures. If the device is otherwise oriented (rotated 90 degrees or at another orientation), the spatially relative descriptors used herein will be interpreted accordingly.

[0016] The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit the implementations to the precise form disclosed. Modifications and variations are possible in light of the above disclosure or may be acquired from practice of the implementations.

[0017] In at least one embodiment, a method for providing multi-finger gesture user interface control in a vehicle includes registering a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against a touchscreen for a predetermined time period; detecting the predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined time period; and generating a predetermined function control corresponding to the predetermined multi-finger gesture.

[0018] Embodiments described herein provide methods that provide one or more advantages. For example, one or more predetermined multi-finger gestures are configured to provide input to a touchscreen in a vehicle to perform a function or operation mapped to the multi-finger gesture. Thus, the multi-finger gestures provide easier function control without distracting the driver.

[0019] FIG. 1 illustrates a vehicle 100 having a touchscreen input / output device according to at least one embodiment.

[0020] 1, vehicle 100 includes a vehicle cockpit 110. Vehicle cockpit 110 is the area where a driver or operator of the vehicle is located to operate vehicle 100. Vehicle cockpit 110 includes a steering wheel 120, an accelerator pedal 122, a brake pedal 124, and a clutch 126. A left touchscreen 130 is located to the left of steering wheel 120, and a right touchscreen 132 is located to the right of steering wheel 120. Left touchscreen 130 and right touchscreen 132 may control different functions or different aspects of the same function.

[0021] A head-up display 140 is located away from the steering wheel 120 and close to the windshield. The head-up display 140 may be part of the windshield. The head-up display 140 includes a touchscreen 142 for displaying an instrument cluster (IC). The touchscreen 142 may display the vehicle's speed (e.g., referred to as a speedometer), revolutions per minute (RPM) indicating the number of revolutions per minute of the vehicle's crankshaft (e.g., referred to as a tachometer), the vehicle's mileage (e.g., referred to as an odometer), a measurement of the oil pressure in the vehicle (e.g., referred to as an oil pressure gauge), a measurement of the fuel in the vehicle (e.g., referred to as a fuel gauge), various system fault and warning indicators, and the like. The head-up display 140 may use an analog display or a digital display. Here, the digital head-up display 140 may be customized via user input to the touchscreen of the head-up display 140. Other information and arrangements may be implemented in accordance with at least one embodiment.

[0022] An in-vehicle infotainment (IVI) system 150 is shown further to the right of the head-up display 140. The IVI system 150 is often simply referred to as an infotainment system or information system. The IVI system 150 includes a touchscreen 152. The IVI system 150 is a central digital system that allows a user to control various vehicle functions. The IVI system 150 may also connect to certain devices in the vehicle, such as a smartphone. The IVI system 150 may provide features and functionality including at least one of hands-free calling, music player and radio functionality, global positioning system (GPS) navigation, weather forecasts, traffic alerts, climate control, a rear camera display, vehicle performance data, internet connectivity, and the like.

[0023] However, when a user is driving a vehicle, it can be difficult to operate left touchscreen 130, right touchscreen 132, touchscreen 142 of head-up display 140, touchscreen 152 of IVI system 150, etc. Therefore, the embodiments described herein implement one or more predetermined multi-finger gestures to provide easier function control without distracting the driver.

[0024] FIG. 2 is a front view of a second vehicle cockpit 200 according to at least one embodiment.

[0025] 2, in a second vehicle cockpit 200, a touchscreen 210 is located in the center of a steering wheel 220. The touchscreen 210 may be configured as a single display or as a left touchscreen 212 and a right touchscreen 214. Those skilled in the art will appreciate that other configurations may be implemented in accordance with the embodiments described herein.

[0026] An instrument cluster (IC) 230 is located in front of the steering wheel 220. The instrument cluster 230 may be implemented with analog gauges or a digital display 232. Furthermore, the instrument cluster 230 may be configured to provide information as described above with reference to FIG. 1, regardless of whether the instrument cluster 230 is implemented with analog gauges or a digital display 232.

[0027] A windshield having a head-up display (HUD) 240 is provided within the driver's field of view. The windshield having the HUD 240 displays information such as speed, warning signals, and intuitive navigation guidance directly in the driver's field of view without the driver having to look down at the instrument cluster 230. There are various types of windshields having HUDs 240.

[0028] An in-vehicle infotainment (IVI) system 250 is shown to the right of the steering wheel 220.

[0029] The IVI system 250 is often simply referred to as an infotainment system or information system. The IVI system 250 includes a touchscreen 252. As previously mentioned, the IVI system 250 is a central digital system that allows a user to control various vehicle functions. The IVI system 250 may also be connected to certain devices in the vehicle, such as a smartphone. The IVI system 250 may provide features and functionality including at least one of hands-free calling, music player and radio functionality, global positioning system (GPS) navigation, weather forecasts, traffic alerts, climate control, a rear camera display, vehicle performance data, Internet connectivity, and the like.

[0030] However, as discussed above with reference to Figure 1, it can be difficult for a user to operate the touchscreen 210, the instrument cluster 230 with the digital display 232, and the windshield 240 with the HUD while driving a vehicle. For this reason, the embodiments described herein implement one or more predetermined multi-finger gestures to provide easier function control without distracting the driver.

[0031] According to at least one embodiment, at least one sensor 260 detects the position of the steering wheel and thus determines whether the steering wheel has been rotated more than a predetermined amount. Multi-finger gesture command operations are disabled when the driver rotates the steering wheel more than a predetermined angle. This prevents the driver from performing multi-finger command gestures in a dangerous manner. A slight movement does not trigger the use of multi-finger command gestures to be determined as a dangerous operation. Alternatively, rather than using sensor 260 to detect when the steering wheel has been rotated more than a predetermined amount, camera system 270 can determine the angle of the vehicle relative to the road and disable the multi-finger command gestures. Additionally, when the vehicle is moving, the touchscreen can be disabled to display visual interactions. In response to the vehicle coming to a stop, visual interactions are restored to the touchscreen, at which point the multi-finger command gestures are disabled or no longer recognized.

[0032] FIG. 3 is a block diagram of a multi-finger gesture system 300 according to at least one embodiment.

[0033] 3, the multi-finger gesture system 300 includes at least one touchscreen 310 within a vehicle. According to at least one embodiment, a left touchscreen 312 and a right touchscreen 314 are provided. A cockpit domain controller 320 is coupled to the left touchscreen 312 and the right touchscreen 314.

[0034] According to at least one embodiment, the cockpit domain controller 320 stores and recognizes multi-finger gesture operations. The cockpit domain controller 320 converts certain multi-finger gestures into functional controls, similar to button touches on an application interface. The cockpit domain controller 320 outputs operations performed on the left touchscreen 312 and the right touchscreen 314.

[0035] The multi-finger gesture system 300 may also include a head-up display (HUD) 330 and an instrument cluster (IC) 340 with digital information overlays for displaying additional information selected by the user. The actual application interface that recognizes the multi-finger gestures is not displayed on either the HUD 330 or the IC 340.

[0036] The left touchscreen 312 and the right touchscreen 314 include an input detection interface 350 configured to detect predetermined multi-finger gestures by a vehicle driver, which are transmitted to the cockpit domain controller 320. According to at least one embodiment, single-finger touches on the touchscreen are eliminated because a single touch is too common and may lead to an inaccurate action. The cockpit domain controller 320 includes an output generation interface 360 ​​configured to generate predetermined outputs corresponding to multi-finger gesture gestures. The outputs from the multi-finger gesture gestures are predetermined by the output generation interface 360 ​​of the cockpit domain controller 320 to provide operations other than those responsive to single-finger touch gestures. The output generation interface 360 ​​of the cockpit domain controller 320 allows the driver to safely operate I / O devices using multi-finger gestures without distracting the driver from operating the vehicle.

[0037] A driver can activate a finger function control interface 364 via a touchscreen user interface 362 provided by the cockpit domain controller 320 to set predetermined multi-finger gesture operations mapped to multi-finger gestures. In at least one embodiment, the finger function control interface 364 is configured to present candidates for predetermined multi-finger gesture operations to the driver. The touchscreen user interface 362 of the cockpit domain controller 320 controls the operation of at least one touchscreen 310. The driver can access the finger function control interface 364 and assign actions to function controls using the input detection interface 350 of at least the left touchscreen 312 and the right touchscreen 314.

[0038] The finger function control interface 364 provided by the cockpit domain controller 320 can be used to map long presses, e.g., for several seconds, using two or more fingers applied to the left touchscreen 312 and the right touchscreen 314 to associate a function control with a long touch using two or more fingers. For example, a predetermined gesture according to at least one embodiment includes a long press with two fingers for a predetermined time combined with a vertical movement followed by a horizontal movement. Alternatively, or in addition to a long press with two fingers and a vertical / horizontal gesture, a predetermined gesture according to at least one embodiment includes a long press with two fingers for a predetermined time, a long press with three fingers for a predetermined time, a long press with four fingers for a predetermined time, and a long press with five fingers for a predetermined time. The finger function control interface 364 can be used by a user to set the duration of the long press and assign an action to the function control.

[0039] The finger function control interface 364 can be used by a user to configure a double touch using up to several fingers and associate such a double touch with a function control. For example, additional gestures include a double touch with two fingers within a predetermined time period, a double touch with three fingers within a predetermined time period, a double touch with four fingers within a predetermined time period, and a double touch with five fingers within a predetermined time period. The finger function control interface 364 can be used by a user to configure the duration of the double touch and can assign an action to the function control.

[0040] Thus, a predetermined multi-finger operation is an operation using two or more fingers. The relationship between the finger operation and the predetermined output can be defined by the driver via the touchscreen user interface 362. The touchscreen user interface 362 presents a finger function control interface 364 to allow the user to set candidate multi-finger gesture operations. Generating the predetermined output includes displaying the finger function control interface 364 on the touchscreen of the output device to enable a multi-finger command gesture. The zoom-in / zoom-out interface 380 on the left touchscreen 312 and the right touchscreen 314 allows the user to zoom in / out by pinching out on one or more of the left touchscreen 312 and the right touchscreen 314 and to zoom out / out by pinching in on one or more of the left touchscreen 312 and the right touchscreen 314, particularly when the screen is displayed on the head-up display 330. The pinch-out and pinch-in functions can be disabled when the screen is displayed on an IC.

[0041] At least one touchscreen 310 within the vehicle, such as a left touchscreen 312 and a right touchscreen 314, is integrated into the vehicle and is not associated with a touchscreen of a user device such as a smartphone. The at least one touchscreen 310 is positioned so that the driver can use the touchscreen without taking their hands off the steering wheel or diverting their eyes from focusing on the road. Additionally, the at least one touchscreen 310 is positioned so that the touchscreen faces the driver.

[0042] FIG. 4 illustrates a first type of multi-finger gesture 400 according to at least one embodiment.

[0043] In FIG. 4, a first predetermined multi-finger gesture 410 according to at least one embodiment includes a long press using two fingers 412 for a predetermined period of time, combined with an upward vertical movement 414 followed by a rightward horizontal movement 416.

[0044] A second predetermined multi-finger gesture 420 according to at least one embodiment includes a long press for a predetermined time using two fingers 422 combined with an upward vertical movement 424 followed by a leftward horizontal movement 426.

[0045] A third predetermined multi-finger gesture 430 according to at least one embodiment includes a long press for a predetermined time using two fingers 432 combined with a downward vertical movement 434 followed by a leftward horizontal movement 436.

[0046] A fourth predetermined multi-finger gesture 440 according to at least one embodiment includes a long press for a predetermined time using two fingers 442 combined with a downward vertical movement 444 followed by a rightward horizontal movement 446.

[0047] Those skilled in the art will recognize that horizontal movement can be performed first using a long press with two fingers followed by vertical movement.

[0048] Furthermore, those skilled in the art will recognize that diagonal movements can be used instead of a combination of vertical and horizontal movements. Other first-type multi-finger gestures 400 can use curved movements instead of straight movements. Instead of a two-finger press, three-, four-, and five-finger presses can be used in combination with a predetermined movement. As described with reference to FIG. 3 , a long press notifies the cockpit domain controller 320 that a multi-finger gesture command is being activated. Multi-finger gestures 410, 420, 430, and 440 can be mapped to functions or operations using a finger function control interface 364 via a touchscreen user interface 362 provided by the cockpit domain controller 320, as described with reference to FIG. 3 .

[0049] FIG. 5 illustrates a second type of multi-finger gesture 500 according to at least one embodiment.

[0050] 5, a first predetermined multi-finger gesture 510 includes a long press for a predetermined time using two fingers 512. A second predetermined multi-finger gesture 520 includes a long press for a predetermined time using three fingers 522. A third predetermined multi-finger gesture 530 includes a long press for a predetermined time using four fingers 532. A fourth predetermined multi-finger gesture 540 includes a long press for a predetermined time using five fingers 542. As described with reference to FIG. 3, the finger function control interface 364 can be used to allow a user to set the duration of a multi-finger long press and assign an action to the function control. Those skilled in the art will recognize that the finger touch arrangements are presented for illustrative purposes and that other configurations using two, three, four, and five fingers can be used without departing from the embodiments described herein.

[0051] FIG. 6 illustrates a third type of multi-finger gesture 600 according to at least one embodiment.

[0052] In FIG. 6 , a first predetermined multi-finger gesture 610 includes a double touch with two fingers 612 within a predetermined time period. A second predetermined multi-finger gesture 620 includes a double touch with three fingers 622 within a predetermined time period. A third predetermined multi-finger gesture 630 includes a double touch with four fingers 632 within a predetermined time period. A fourth predetermined multi-finger gesture 640 includes a double touch with five fingers 642 within a predetermined time period. As described with reference to FIG. 3 , the finger function control interface 364 can be used by a user to set the duration of the double touch and assign actions to the function controls. Those skilled in the art will recognize that the finger placements for the double touch are provided for illustrative purposes, and that other configurations using two, three, four, and five finger double touches can also be used without departing from the embodiments described herein.

[0053] FIG. 7 is a flowchart 700 of a method for providing user interface control via a touchscreen in a vehicle, according to at least one embodiment.

[0054] In FIG. 7 , the process begins (S702), after which at least one action is assigned to a predetermined multi-finger gesture (S710). Referring to FIG. 3 , the driver can activate the finger function control interface 364 via the touchscreen user interface 362 provided by the cockpit domain controller 320. A predetermined multi-finger gesture operation mapped to the multi-finger gesture is registered. In at least one embodiment, the finger function control interface 364 is configured to present candidate predetermined multi-finger gesture operations to the driver. The touchscreen user interface 362 of the cockpit domain controller 320 controls the operation of at least one touchscreen 310. The driver can access the finger function control interface 364 and assign actions to the function controls using the input detection interface 350 of at least the left touchscreen 312 and the right touchscreen 314.

[0055] The predetermined time for which at least two fingers are pressed down on the touchscreen to initiate at least one action is set by the user (S714). Referring to Figure 3, the finger function control interface 364 provided by the cockpit domain controller 320 can be used to map a long press with two or more fingers, for example, for several seconds, applied to the left touchscreen 312 and the right touchscreen 314 to associate a function control with the long press with two or more fingers. For example, a predetermined gesture according to at least one embodiment includes a long press with two fingers for a predetermined time combined with a vertical movement followed by a horizontal movement.

[0056] A predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined time is detected (S718). Referring to FIG. 3 , the left touchscreen 312 and the right touchscreen 314 include an input detection interface 350 configured to detect predetermined multi-finger operations by the vehicle driver, which are transmitted to the cockpit domain controller 320. According to at least one embodiment, detecting the predetermined multi-finger gesture includes detecting a predetermined multi-finger gesture including presses using multiple fingers for a predetermined time combined with a predetermined movement. According to at least one embodiment, detecting the predetermined multi-finger gesture includes detecting a predetermined multi-finger gesture including at least one of presses using two fingers for a predetermined time, presses using three fingers for a predetermined time, presses using four fingers for a predetermined time, or presses using five fingers for a predetermined time. According to at least one embodiment, detecting a predetermined multi-finger gesture using two or more fingers pressed against the touchscreen for a predetermined time by the vehicle driver includes detecting a double touch using multiple fingers within a time limit. According to at least one embodiment, detecting a predetermined multi-finger gesture by a vehicle driver using two or more fingers pressed against a touchscreen for a predetermined period of time includes disabling a predetermined output corresponding to the finger actions in response to at least one of detecting that the driver has turned the steering wheel or that the angle of the vehicle has exceeded a predetermined angle on the roadway.

[0057] A predetermined function control corresponding to the predetermined multi-finger gesture is generated based on detecting the predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined time (S722). Referring to FIG. 3, the cockpit domain controller 320 includes an output generation interface 360 ​​configured to generate a predetermined output corresponding to the multi-finger gesture operation. The output from the multi-finger gesture operation is predetermined by the output generation interface 360 ​​of the cockpit domain controller 320 to provide an operation other than in response to a single-finger touch gesture. The output generation interface 360 ​​of the cockpit domain controller 320 enables a driver to safely operate an I / O device using multi-finger gestures without reducing the driver's attention while operating the vehicle.

[0058] In response to determining that the vehicle is moving, visual interaction on the touchscreen is stopped and detection of a predetermined multi-finger gesture on the touchscreen is enabled for a predetermined time (S726). Referring to Figure 2, the touchscreen can be disabled to display visual interaction when the vehicle is moving.

[0059] In response to determining that the vehicle has stopped, visual interaction on the touchscreen is restored and detection of predetermined multi-finger gestures on the touchscreen is disabled for a predetermined time (S730). Referring to Figure 2, in response to the vehicle stopping, visual interaction on the touchscreen may be restored and multi-finger command gestures may be disabled or not recognized at that time.

[0060] The process then ends (S740).

[0061] In at least one embodiment, a method for providing multi-finger gesture user interface control in a vehicle includes registering a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against a touchscreen for a predetermined time period; detecting the predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined time period; and generating a predetermined function control corresponding to the predetermined multi-finger gesture. In embodiments described herein, a method provides one or more advantages. For example, one or more predetermined multi-finger gestures are configured to provide input to a vehicle's touchscreen to perform a function or operation mapped to the multi-finger gesture. In this manner, the multi-finger gestures provide easier function control without distracting the driver.

[0062] FIG. 8 is a high-level functional block diagram of a processor-based system 800 according to at least one embodiment.

[0063] In at least one embodiment, processing circuit 800 provides a method for providing user interface controls via a touchscreen in a vehicle. Processing circuit 800 uses processor 802 to implement the method for providing user interface controls via a touchscreen in a vehicle. Processing circuit 800 also includes a non-transitory computer-readable storage medium 804 used to implement the method for providing user interface controls via a touchscreen in a vehicle. Non-transitory computer-readable storage medium 804 is encoded with, or has stored thereon, instructions 806 (i.e., computer program code), among other things. When executed by processor 802, instructions 806 cause processor 802 to perform operations for providing user interface controls via the vehicle's touchscreen. Execution of instructions 806 by processor 802 represents (at least in part) an application that implements at least a portion of the methods described herein (hereinafter, the processes and / or methods described) in accordance with one or more embodiments.

[0064] The processor 802 is electrically coupled to a non-transitory computer-readable storage medium 804 via a bus 808. The processor 802 is electrically coupled to an input / output (I / O) interface 810 by the bus 808. In addition, a network interface 812 is electrically connected to the processor 802 via the bus 808. The network interface 812 connects to a network 814, thereby connecting the processor 802 and the non-transitory computer-readable storage medium 804 to external elements via the network 814. The processor 802 is configured to execute instructions 806 encoded on the non-transitory computer-readable storage medium 804 to enable the processing circuit 800 to perform at least a portion of a process and / or method. In one or more embodiments, the processor 802 is a central processing unit (CPU), a multiprocessor, a distributed processing system, an application-specific integrated circuit (ASIC), and / or other suitable processing unit.

[0065] Processing circuit 800 includes an I / O interface 810. I / O interface 810 is coupled to external circuitry. In one or more embodiments, I / O interface 810 includes a keyboard, keypad, mouse, trackball, trackpad, touchscreen, and / or cursor direction keys for communicating information and commands to processor 802.

[0066] Processing circuit 800 also includes a network interface 812 coupled to processor 802. Network interface 812 enables processing circuit 800 to communicate with a network 814 to which one or more other computer systems are connected. Network interface 812 includes a wireless network interface such as Bluetooth®, Wi-Fi, Worldwide Interoperability for Microwave Access (WiMAX), General Packet Radio Service (GPRS), Wideband Code Division Multiple Access (WCDMA®), or a wired network interface such as Ethernet, Universal Serial Bus (USB), or Institute of Electrical and Electronics Engineers (IEEE) 864.

[0067] The processing circuit 800 is configured to receive information via an I / O interface 810. The information received via the I / O interface 810 includes one or more of instructions, data, design rules, libraries of cells, and / or other parameters for processing by the processor 802. The information is transferred to the processor 802 via the bus 808. The processing circuit 800 is configured to receive information related to a user interface (UI) via the I / O interface 810. The information is stored in the non-transitory computer-readable storage medium 804 as a UI 820.

[0068] In one or more embodiments, one or more non-transitory computer-readable storage media 804 store instructions 806 (in compressed or uncompressed format) that can be used to program a computer, processor, or other electronic device to implement the processes or methods described herein. The one or more non-transitory computer-readable storage media 804 include one or more of an electronic storage medium, a magnetic storage medium, an optical storage medium, a quantum storage medium, etc.

[0069] For example, the non-transitory computer-readable storage medium 804 may include, but is not limited to, a hard drive, a floppy disk, an optical disk, a read-only memory (ROM), a random-access memory (RAM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, a magnetic or optical card, a solid-state memory device, or any other type of physical medium suitable for storing electronic instructions. In one or more embodiments using an optical disk, the one or more non-transitory computer-readable storage media 804 include a compact disk read-only memory (CD-ROM), a compact disk read / write (CD-R / W), and / or a digital video disk (DVD).

[0070] In one or more embodiments, non-transitory computer-readable storage medium 804 stores instructions 806 configured to cause processor 802 to implement at least a portion of a process and / or method for providing user interface controls via a touchscreen in a vehicle. In one or more embodiments, non-transitory computer-readable storage medium 804 also stores information, such as algorithms, that facilitate implementation of at least a portion of a process and / or method for providing user interface controls via a touchscreen in a vehicle.

[0071] To this end, in at least one embodiment, processor 802 executes instructions 806 stored on one or more non-transitory computer-readable storage media 804 to implement cockpit domain controller 830. Processor 802 is configured to cause cockpit domain controller 830 to store and recognize multi-finger gestures. Processor 802 uses a finger function control interface 834 to allow a user to configure one or more multi-finger gesture configurations 840, which cockpit domain controller 830 converts into functions / operations 842 mapped to the multi-finger gestures. Processor 802 uses finger function control interface 834 to register a relationship between a predetermined function / operation control and a predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined period of time. Processor 802 uses finger function control interface 834 to present candidate predetermined multi-finger gesture operations to the driver. The cockpit domain controller 830 outputs operations performed on at least one touchscreen display 880 to a user interface 882, such as a left touchscreen 884 and a right touchscreen 894.

[0072] The processor 802 implements a head-up display (HUD) 896 and an instrument cluster (IC) 898. The left touchscreen 884 and the right touchscreen 894 include an input detection interface 886 configured to detect predetermined multi-finger gestures by a vehicle driver, which are transmitted to a cockpit domain controller 830. The processor 802 implements an output generation 832 that generates predetermined outputs corresponding to the multi-finger gestures. The output from the multi-finger gestures is predetermined by the output generation 832 to provide operations other than single-finger touch gestures. The cockpit domain controller 830 enables the driver to safely operate I / O devices using multi-finger gestures without distracting the driver from operating the vehicle. The user interface 820 illustrates a multi-finger gesture 822 implemented by the processor 802.

[0073] The driver can activate a finger function control interface 834 via a touchscreen user interface control 836 provided by the cockpit domain controller 830 to perform a function / operation mapped to a multi-finger gesture 842 based on the multi-finger gesture configuration 840. The processor uses a predetermined finger pressure duration 858 to activate the function / operation mapped to the multi-finger gesture 842 based on the multi-finger gesture configuration 840. The predetermined finger pressure duration 858 is also set using the finger function control interface 834.

[0074] Touchscreen user interface controls 836 support operation of at least one touchscreen 880. Using input detection interfaces 886 on at least left touchscreen 884 and right touchscreen 894, the driver can access finger function control interface 834 and assign multiple finger gestures to function controls.

[0075] The processor 802 configures the finger function control interface 834 to map a long press using two or more fingers, for example for several seconds, applied to the left touchscreen 884 and the right touchscreen 894, and associates a function control with the long press using two or more fingers. The processor 802 provides the finger function control interface 834 with the ability for a user to set the duration of the long press and assign an action to the function control. The processor 802 provides the finger function control interface 834 with the ability to set a double touch using multiple fingers within several seconds and associate such a double touch with a function control. The processor 802 provides the finger function control interface 834 with the ability to set the duration of the double touch and can assign an action to the function control.

[0076] The processor 802 causes the touchscreen user interface control 836 to present a finger function control interface 834 to allow the user to configure candidate multi-finger gesture operations. Generating the predetermined output includes the processor 802 displaying the finger function control interface 834 on the touchscreen of the output device to enable multi-finger command gestures. A zoom-in / zoom-out interface 888 on the left touchscreen 884 and the right touchscreen 894 allows the user to zoom in / out by pinching out on one or more of the left touchscreen 884 and the right touchscreen 894 and to zoom out / out by pinching in on one or more of the left touchscreen 884 and the right touchscreen 894. The pinch-out and pinch-in functions can be disabled by the processor 802 when the screen is displayed on an instrument panel 898.

[0077] The processor 802 uses the multi-finger gesture detection enable / disable rules 850 so that the at least one touchscreen display 880 can be disabled to display visual interactions when the vehicle is moving. In response to the vehicle stopping, the processor restores visual interactions to the at least one touchscreen display 880, at which point the multi-finger command gestures are disabled or not recognized.

[0078] Processor 802 can also use steering wheel sensor data 852 to determine the position of the steering wheel and detect when the steering wheel is turned more than a predetermined amount. If the driver turns the steering wheel more than a predetermined angle, operation of multi-finger gesture configuration 840 is disabled. This prevents the driver from using multi-finger gesture configuration 840 to unsafely perform the function / operation mapped to multi-finger gesture 842. Processor 802 determines that small movements do not result in a dangerous operation of multi-finger gesture configuration 840. Processor 802 can also use camera road angle data 854 to determine the angle of the vehicle relative to the road and disable multi-finger gesture configuration 840. Processor 802 makes such a determination using camera / sensor enable / disable action 856.

[0079] Separate instances of such programs may be executed on or distributed across any number of separate computer systems. Thus, although particular steps may be described as being performed by particular devices, software programs, processes, or entities, this is not necessarily the case. Those skilled in the art will recognize various alternative implementations.

[0080] Moreover, those skilled in the art will readily recognize that the above-described techniques can be utilized in a variety of devices, environments, and contexts. Although the embodiments have been described in language specific to structural features or methodological acts, the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claims.

Claims

1. 1. A processor-executed method for providing multi-finger gesture user interface control in a vehicle, comprising: registering a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against the vehicle's touchscreen for a predetermined period of time; detecting the predetermined multi-finger gesture using the at least two fingers pressed against the touchscreen for the predetermined time period; generating the predetermined function control corresponding to the predetermined multi-finger gesture; A method comprising:

2. 2. The method of claim 1, wherein the step of registering a relationship between the predetermined function control and the predetermined multi-finger gesture using at least two fingers pressed against the touch screen for the predetermined time period further comprises: assigning at least one action to the predetermined multi-finger gesture; and setting the predetermined time period for the at least two fingers to be pressed against the touch screen to activate the at least one action.

3. 3. The method of claim 1, wherein the step of detecting the predetermined multi-finger gesture comprises detecting presses using multiple fingers for the predetermined time combined with a predetermined movement.

4. 3. The method of claim 1, wherein the step of detecting the predetermined multi-finger gesture includes detecting at least one of a press using two fingers for the predetermined time, a press using three fingers for the predetermined time, a press using four fingers for the predetermined time, or a press using five fingers for the predetermined time.

5. 3. The method of claim 1, wherein detecting the predetermined multi-finger gesture using two or more fingers pressed against the touchscreen for the predetermined time period comprises detecting a double touch using multiple fingers within a time limit.

6. 3. The method of claim 1, wherein the step of detecting the predetermined multi-finger gesture using two or more fingers pressed against the touchscreen for the predetermined time period includes disabling a predetermined output corresponding to the predetermined multi-finger gesture in response to at least one of a steering wheel rotation or detecting that the angle of the vehicle exceeds a predetermined angle on a roadway.

7. 3. The method of claim 1, further comprising: in response to determining that the vehicle is moving, ceasing visual interaction on the touchscreen and enabling detection of the predetermined multi-finger gesture on the touchscreen for the predetermined period of time.

8. 1. An apparatus for providing multi-finger gesture user interface control in a vehicle, comprising: a memory storing computer readable instructions; a processor, coupled to the memory, operable to execute the computer-readable instructions, registering a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined period of time; detecting the predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for the predetermined time period; a processor configured to perform operations to generate the predetermined functional control corresponding to the predetermined multi-finger gesture; An apparatus comprising:

9. 9. The device of claim 8, wherein the processor is further configured to register a relationship between the predetermined function control and the predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for the predetermined time by assigning at least one action to the predetermined multi-finger gesture and setting the predetermined time for the at least two fingers to be pressed against the touchscreen to activate the at least one action.

10. 10. The device of claim 8 or 9, wherein the processor is further configured to detect the predetermined multi-finger gesture by detecting presses using multiple fingers for the predetermined time combined with a predetermined movement.

11. 10. The device of claim 8 or 9, wherein the processor is further configured to detect the predetermined multi-finger gesture by detecting at least one of a press using two fingers for the predetermined time, a press by three fingers for the predetermined time, a press by four fingers for the predetermined time, or a press by five fingers for the predetermined time.

12. 10. The device of claim 8 or 9, wherein the processor is further configured to detect the predetermined multi-finger gesture using two or more fingers pressed against the touchscreen for the predetermined time period by detecting a double touch using multiple fingers within a time limit.

13. 10. The apparatus of claim 8 or 9, wherein the processor is further configured to detect the predetermined multi-finger gesture using two or more fingers pressed against the touchscreen for the predetermined time period by disabling a predetermined output corresponding to the predetermined multi-finger gesture in response to at least one of a steering wheel rotation or detecting that the angle of the vehicle on a road exceeds a predetermined angle.

14. 10. The apparatus of claim 8 or 9, wherein the processor is further configured, in response to determining that the vehicle is moving, to cease visual interaction on the touchscreen and enable detection of the predetermined multi-finger gesture on the touchscreen for the predetermined period of time.

15. registering a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined period of time; detecting the predetermined multi-finger gesture using the at least two fingers pressed against the touchscreen for the predetermined time period; generating the predetermined function control corresponding to the predetermined multi-finger gesture; A computer program that causes a processor to perform operations including:

16. 16. The computer program product of claim 15, wherein the step of registering a relationship between the predetermined functional control and the predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for the predetermined time period further comprises: assigning at least one action to the predetermined multi-finger gesture; and setting the predetermined time period for the at least two fingers to be pressed against the touchscreen to activate the at least one action.

17. 17. The computer program product of claim 15 or 16, wherein detecting the predetermined multi-finger gesture comprises detecting presses using multiple fingers combined with predetermined movements for the predetermined time.

18. 17. The computer program product of claim 15 or 16, wherein detecting the predetermined multi-finger gesture comprises detecting at least one of a press using two fingers for the predetermined time, a press using three fingers for the predetermined time, a press using four fingers for the predetermined time, or a press using five fingers for the predetermined time.

19. 17. The computer program product of claim 15 or 16, wherein detecting the predetermined multi-finger gesture using two or more fingers pressed against the touchscreen for the predetermined time period comprises detecting a double touch using multiple fingers within a time limit.

20. detecting the predetermined multi-finger gesture using two or more fingers pressed against the touchscreen for the predetermined time period, Disabling a predetermined output corresponding to the predetermined multi-finger gesture in response to at least one of a steering wheel rotation or detecting that the angle of the vehicle exceeds a predetermined angle on a roadway; or 17. The computer program product of claim 15 or 16, further comprising, in response to determining that the vehicle is moving, at least one of ceasing visual interaction on the touchscreen and enabling detection of the predetermined multi-finger gesture on the touchscreen for the predetermined period of time.

Images