Providing user interface for controlling touch screen in vehicle using multiple finger gestures

Abstract

To implement a prescribed multiple finger gesture for providing an easier function control without distracting a driver.SOLUTION: A multiple finger gesture user interface control is provided in a vehicle. A relationship between a prescribed function control and a prescribed multiple finger gesture using at least two fingers pressed on a touch screen for a prescribed period of time is set in advance. The prescribed multiple finger gesture is detected using the at least two fingers pressed on the touch screen for the prescribed period of time. A prescribed function control corresponding to the prescribed multiple finger gesture is generated. Multiple finger gestures are configured to provide input to a touch screen in a vehicle for executing functions or operations that are mapped to the multiple finger gestures.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] This specification relates to providing a user interface for controlling a touch screen in a vehicle using gestures of multiple fingers.

Background Art

[0002] Input / output (I / O) is the process of sending information to a computer and is the process by which a computer interacts with the physical world. Touch-based input / output (I / O) interfaces are installed in many types of devices such as smartphones, tablets, and laptops, and have penetrated various aspects of daily life. For example, it is now common for people to organize and conduct social interactions via applications on smartphones or tablets. Furthermore, companies often use touch-based devices to communicate with employees, monitor work, and check project data among any number of other uses.

[0003] Typically, a touch-based device runs a touch-based operating system. This operating system essentially utilizes touch-based input to control interactions with the operating system. Such devices are useful and valuable, but have the same limitations. That is, at a primary level, the user needs to manually interact with the device directly.

[0004] With the spread of touch screen technology, interactive displays are being integrated into modern vehicle environments. Today's vehicles are equipped with increasingly more sensors, actuators, and peripheral devices. The rapid increase in I / O has led to a high level of complexity using new approaches to electrical and electronic architectures.

[0005] Common examples of human-touch I / O include occupants being able to turn up the heating, play music, adjust seat positions, roll down windows, and control vehicle components. However, depending on road and driving conditions, user input on such displays often leads to incorrect selections and dangerous driving incidents. Many laws prohibit drivers from using mobile devices while driving. For this reason, touchscreen devices are often mounted close to the driver. In some cases, the touchscreen is positioned in a location that makes it difficult for the driver to operate while driving. Furthermore, having to look at the touchscreen means the driver is not looking in the direction of travel, which is dangerous. For this reason, operating a touchscreen device while driving can increase the risk to the driver and other occupants of the vehicle. [Overview of the Initiative]

[0006] In at least one embodiment, a method for providing user interface control by multiple finger gestures in a vehicle includes the steps of: registering a relationship between a predetermined function control and a predetermined multiple finger gesture using at least two fingers pressed against a touchscreen for a predetermined period of time; detecting a predetermined multiple finger gesture using at least two fingers pressed against a touchscreen for a predetermined period of time; and generating a predetermined function control corresponding to the predetermined multiple finger gesture.

[0007] In at least one embodiment, a device for providing user interface control by multi-finger gestures in a vehicle includes a memory for storing computer-readable instructions and a processor connected to the memory, wherein the processor is configured to execute computer-readable instructions to register a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against a touchscreen for a predetermined period of time, to detect a predetermined multi-finger gesture using at least two fingers pressed against a touchscreen for a predetermined period of time, and to perform operations to generate a predetermined function control corresponding to the predetermined multi-finger gesture.

[0008] In at least one embodiment, a computer-readable instruction is stored on a non-temporary computer-readable medium. When executed by the processor, the instruction causes the processor to perform an operation that includes: registering a relationship between a predetermined function control and a predetermined number of finger gestures using at least two fingers pressed against a touchscreen for a predetermined period of time; detecting a predetermined number of finger gestures using at least two fingers pressed against a touchscreen for a predetermined period of time; and generating a predetermined function control corresponding to the predetermined number of finger gestures. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 shows a vehicle having a touchscreen input / output device according to at least one embodiment. [Figure 2] Figure 2 is a front view of a second vehicle cockpit according to at least one embodiment. [Figure 3] Figure 3 is a block diagram of a multi-finger gesture system according to at least one embodiment. [Figure 4] Figure 4 shows a first type of multi-finger gesture according to at least one embodiment. [Figure 5] Figure 5 shows a second type of multi-finger gesture according to at least one embodiment. [Figure 6] Figure 6 shows a third type of multi-finger gesture according to at least one embodiment. [Figure 7] Figure 7 is a flowchart of a method for providing user interface control via an in-vehicle touchscreen according to at least one embodiment. [Figure 8] Figure 8 is a high-level functional block diagram of a processor-based system according to at least one embodiment. [Modes for carrying out the invention]

[0010] Features, aspects, and advantages of specific exemplary embodiments of this disclosure are described below with reference to the accompanying drawings. In the accompanying drawings, similar reference numerals indicate similar elements.

[0011] A detailed description of the following exemplary embodiments is provided with reference to the accompanying drawings. The foregoing disclosure provides examples and explanations, but is not intended to be exhaustive or to limit implementations to the exact forms disclosed. Modifications and changes are possible in light of the foregoing disclosure and may be obtained from the practice of implementations. Furthermore, one or more features or components of one embodiment may be incorporated into or combined with another embodiment (or one or more features of another embodiment). Furthermore, it will be understood that in the flowcharts and descriptions of operations provided below, one or more operations may be omitted, one or more operations added, one or more operations performed simultaneously (at least partially), and one or more operations rearranged, provided that such modifications do not affect the resulting scope of the invention.

[0012] It will be apparent that the systems and / or methods described herein can be implemented in various forms, such as hardware, software, or combinations of hardware and software. Actual specific control hardware or software code used to implement such systems and / or methods is not limited to the examples of implementations. For this reason, the operation and behavior of the systems and / or methods are described herein without reference to specific software code. It will be understood that software and hardware can be designed to implement the systems and / or methods based on the descriptions herein.

[0013] Even if specific combinations of features are described in the claims and / or disclosed in the specification, such combinations are not intended to limit the disclosure of possible implementations. In fact, many such features may be combined and / or disclosed in the specification in ways not specifically described in the claims. The dependent claims listed below may depend directly on a single claim, but the disclosure of possible implementations includes dependent claims combined with any other claims in the group of claims.

[0014] Any element, action, or command used herein should not be construed as important or essential unless explicitly stated otherwise. Furthermore, the articles “a” and “an” used herein are intended to include one or more items and may be used interchangeably with “one or more.” When referring to a single item, use “one” or similar language. Additionally, terms such as “have,” “possess,” “include,” and “contain” used herein are intended to be open-ended. Furthermore, the phrase “based on” is intended to mean “based at least partially” unless explicitly stated otherwise. Finally, expressions such as “at least one of A and B,” “A and / or B,” or “at least one of A or B” should be understood to include A only, B only, or both A and B.

[0015] Furthermore, spatially relative terms such as “below,” “downward,” “bottom,” “above,” and “top” are used herein to facilitate descriptions of the relationship between one element or feature and another, as shown in the figures. These spatially relative terms are intended to encompass various orientations of the device in use or operation, in addition to the orientation shown in the figures. If the device is oriented in another direction (90-degree rotation or other orientation), the spatially relative descriptors used herein shall be interpreted accordingly.

[0016] The foregoing disclosures are intended to provide examples and explanations, but are not intended to be exhaustive or to limit implementation examples to the exact form disclosed. Modifications and changes may be made in light of the foregoing disclosures or may be derived from the practice of implementation examples.

[0017] In at least one embodiment, a method for providing user interface control by multiple finger gestures in a vehicle includes the steps of: registering a relationship between a predetermined function control and a predetermined multiple finger gesture using at least two fingers pressed against a touchscreen for a predetermined period of time; detecting a predetermined multiple finger gesture using at least two fingers pressed against a touchscreen for a predetermined period of time; and generating a predetermined function control corresponding to the predetermined multiple finger gesture.

[0018] Embodiments described herein provide a method that offers one or more advantages. For example, one or more predetermined multi-finger gestures are configured to provide input to an in-vehicle touchscreen to perform a function or operation mapped to the multi-finger gestures. Thus, the multi-finger gestures provide easier function control without distracting the driver.

[0019] Figure 1 shows a vehicle 100 having a touchscreen input / output device according to at least one embodiment.

[0020] In FIG. 1, vehicle 100 includes a vehicle cockpit 110. The vehicle cockpit 110 is an area where the driver or operator of the vehicle operates vehicle 100. The vehicle cockpit 110 includes a steering wheel 120, an accelerator pedal 122, a brake pedal 124, and a clutch 126. A left touch screen 130 is located on the left side of the steering wheel 120, and a right touch screen 132 is located on the right side of the steering wheel 120. The left touch screen 130 and the right touch screen 132 can control different functions or different aspects of the same function.

[0021] A head-up display 140 is located far from the steering wheel 120 and close to the front glass. The head-up display 140 may be a part of the front glass. The head-up display 140 includes a touch screen 142 for displaying an instrument cluster (IC). The touch screen 142 can display the speed of the vehicle (e.g., called a speedometer), the revolutions per minute (RPM) indicating the number of revolutions of the vehicle's crankshaft per minute (e.g., called a tachometer), the mileage of the vehicle (e.g., called an odometer), the measured value of the hydraulic pressure in the vehicle (e.g., called a hydraulic pressure gauge), the measured value of the fuel in the vehicle (e.g., called a fuel gauge), various indicators of system failures and warnings, etc. The head-up display 140 can use an analog display or a digital display. Here, the digital head-up display 140 can be customized via user input to the touch screen of the head-up display 140. Other information and arrangements can be implemented according to at least one embodiment.

[0022] The in-vehicle infotainment (IVI) system 150 is shown further to the right of the head-up display 140. The IVI system 150 is often simply called an infotainment system or an information system. The IVI system 150 includes a touch screen 152. The IVI system 150 is a central digital system that enables the user to control various vehicle functions. The IVI system 150 can also be connected to specific devices such as a smartphone inside the vehicle. The IVI system 150 can provide features and functions including at least one of hands-free calling, music player and radio functions, global positioning system (GPS) navigation, weather forecast, traffic alerts, air conditioning control, rear camera display, vehicle performance data, Internet connection, etc.

[0023] However, when the user is driving the vehicle, it is difficult to operate the left touch screen 130, the right touch screen 132, the touch screen 142 of the head-up display 140, the touch screen 152 of the IVI system 150, etc. Therefore, in the embodiments described in this specification, one or more predetermined multiple-finger gestures are implemented to provide easier function control without distracting the driver's attention.

[0024] FIG. 2 is a front view of a second vehicle cockpit 200 according to at least one embodiment.

[0025] In FIG. 2, in the second vehicle cockpit 200, the touch screen 210 is located at the center of the steering wheel 220. The touch screen 210 can be configured as a single display or as a left touch screen 212 and a right touch screen 214. Those skilled in the art will understand that other configurations can be implemented according to the embodiments described in this specification.

[0026] The instrument cluster (IC) 230 is located in front of the steering wheel 220. The instrument cluster 230 can be implemented using analog gauges or a digital display 232. Furthermore, regardless of whether the instrument cluster 230 is implemented using analog gauges or a digital display 232, it can be configured to provide information as described above with reference to Figure 1.

[0027] A windshield with a head-up display (HUD) 240 is positioned within the driver's field of vision. The windshield with the HUD 240 displays information such as speed, warning signals, and intuitive navigation guidance directly in the driver's field of vision, without the driver having to look down at the instrument cluster 230. Various types of windshields with the HUD 240 exist.

[0028] The in-vehicle infotainment (IVI) system 250 is shown to the right of the steering wheel 220.

[0029] The IVI system 250 is often simply called the infotainment system or information system. The IVI system 250 includes a touchscreen 252. As mentioned above, the IVI system 250 is a central digital system that allows the user to control various vehicle functions. The IVI system 250 can also connect to certain devices such as smartphones in the vehicle. The IVI system 250 can provide features and functions including at least one of the following: hands-free calling, music player and radio functions, Global Positioning System (GPS) navigation, weather forecasts, traffic alerts, climate control, rear camera display, vehicle performance data, and internet connectivity.

[0030] However, as mentioned above with reference to Figure 1, it is difficult for the user to operate the touchscreen 210, the instrument cluster 230 with a digital display 232, and the windshield 240 with a HUD while driving the vehicle. For this reason, the embodiments described herein implement one or more predetermined multi-finger gestures to provide simpler function control without distracting the driver.

[0031] According to at least one embodiment, at least one sensor 260 detects the position of the steering wheel and, consequently, determines whether the steering wheel has rotated beyond a predetermined amount. Multi-finger gesture commands are disabled if the driver rotates the steering wheel beyond a predetermined angle. This prevents the driver from performing multi-finger command gestures in a dangerous manner. Even slight movements will not cause the use of multi-finger command gestures to be determined as a dangerous operation. Alternatively, instead of using sensor 260 to detect that the steering wheel has rotated beyond a predetermined amount, the camera system 270 could determine the angle of the vehicle relative to the road and disable multi-finger command gestures. Furthermore, visual interactions can be displayed when the vehicle is moving. Regarding that matter, The touchscreen can be disabled. When the vehicle stops, visual interaction is restored to the touchscreen, and at that point, multi-finger command gestures are disabled or no longer recognized.

[0032] Figure 3 is a block diagram of a multi-finger gesture system 300 according to at least one embodiment.

[0033] In Figure 3, the multi-finger gesture system 300 includes at least one touchscreen 310 in the vehicle. According to at least one embodiment, a left touchscreen 312 and a right touchscreen 314 are provided. A cockpit domain controller 320 is coupled to the left touchscreen 312 and the right touchscreen 314.

[0034] The cockpit domain controller 320 stores and recognizes multi-finger gesture operations in at least one embodiment. The cockpit domain controller 320 converts predetermined multi-finger gestures into functional controls, similar to the contact of buttons on an application interface. The cockpit domain controller 320 outputs operations performed on the left touchscreen 312 and the right touchscreen 314.

[0035] The multi-finger gesture system 300 may also include a head-up display (HUD) 330 and an instrument cluster (IC) 340 having a digital information overlay for displaying additional information selected by the user. The actual application interface that recognizes the multi-finger gestures is not displayed on either the HUD 330 or the IC 340.

[0036] The left touchscreen 312 and the right touchscreen 314 include an input detection interface 350 configured to detect predetermined multi-finger gestures by the vehicle driver, which are transmitted to the cockpit domain controller 320. According to at least one embodiment, single-finger touches to the touchscreens are eliminated because a single touch is too common and could lead to inaccurate actions. The cockpit domain controller 320 includes an output generation interface 360 ​​configured to generate predetermined outputs in response to multi-finger gesture operations. The outputs from multi-finger gesture operations are predetermined by the output generation interface 360 ​​of the cockpit domain controller 320 and provide operations other than those that respond to single-finger touch gestures. The output generation interface 360 ​​of the cockpit domain controller 320 allows the driver to safely operate I / O devices using multi-finger gestures without distraction while driving the vehicle.

[0037] The driver can activate the finger function control interface 364 via the touchscreen user interface 362 provided by the cockpit domain controller 320 to set up a predetermined multi-finger gesture operation mapped to multiple finger gestures. In at least one embodiment, the finger function control interface 364 is configured to present the driver with a selection of predetermined multi-finger gesture operation candidates. The touchscreen user interface 362 of the cockpit domain controller 320 controls the operation of at least one touchscreen 310. The driver can access the finger function control interface 364 using the input detection interfaces 350 of at least the left touchscreen 312 and the right touchscreen 314 to assign actions to function controls.

[0038] The finger function control interface 364 provided by the cockpit domain controller 320 can be used to map long presses using two or more fingers, for example, for several seconds, applied to the left touchscreen 312 and the right touchscreen 314, in order to associate function control with long touches using two or more fingers. For example, a predetermined gesture according to at least one embodiment includes a long press of two fingers for a predetermined time, combined with a vertical movement followed by a horizontal movement. Alternatively, or in addition to long presses using two fingers and vertical / horizontal gestures, a predetermined gesture according to at least one embodiment includes long presses using two fingers for a predetermined time, long presses using three fingers for a predetermined time, long presses using four fingers for a predetermined time, and long presses using five fingers for a predetermined time. The finger function control interface 364 can be used by the user to set the duration of the long press and assign an action to the function control.

[0039] The finger function control interface 364 can be used by the user to configure double touches using up to several fingers and to associate such double touches with function controls. For example, additional gestures include double touches with two fingers within a predetermined time, double touches with three fingers within a predetermined time, double touches with four fingers within a predetermined time, and double touches with five fingers within a predetermined time. The finger function control interface 364 can be used by the user to configure the duration of the double touch and to assign actions to the function controls.

[0040] Therefore, a predetermined multi-finger operation is an operation using two or more fingers. The relationship between a finger operation and a predetermined output can be defined by the driver via the touchscreen user interface 362. The touchscreen user interface 362 presents a finger function control interface 364 so that the user can set up candidates for multi-finger gesture operations. Generating a predetermined output includes displaying the finger function control interface 364 on the touchscreen of the output device in order to enable multi-finger command gestures. The zoom-in / zoom-out interfaces 380 on the left touchscreen 312 and the right touchscreen 314 allow the user to zoom in by pinching out on one or more of the left touchscreen 312 and the right touchscreen 314, and zoom out by pinching in on one or more of the left touchscreen 312 and the right touchscreen 314, especially when the screen is displayed on the head-up display 330. The pinch-out and pinch-in functions can be disabled when the screen is displayed on the IC.

[0041] At least one touchscreen 310 within the vehicle, such as a left touchscreen 312 and a right touchscreen 314, is not associated with a touchscreen of a user device such as a smartphone. The at least one touchscreen 310 is positioned so that the driver can use the touchscreen without taking their hands off the steering wheel or diverting their eyes from the road. The at least one touchscreen 310 is also positioned so that the touchscreen faces the driver.

[0042] Figure 4 shows a first type of multi-finger gesture 400 according to at least one embodiment.

[0043] In Figure 4, a first predetermined plurality of finger gestures 410 according to at least one embodiment includes a combination of a long press using two fingers 412 for a predetermined time, an upward vertical movement 414, and a subsequent rightward horizontal movement 416.

[0044] A second predetermined plurality of finger gestures 420 according to at least one embodiment includes a combination of a long press using two fingers 422 for a predetermined time, an upward vertical movement 424, and a subsequent leftward horizontal movement 426.

[0045] A third predetermined plurality of finger gestures 430 according to at least one embodiment includes a combination of a long press using two fingers 432 for a predetermined time, a downward vertical movement 434, and a subsequent leftward horizontal movement 436.

[0046] A fourth predetermined plurality of finger gestures 440 according to at least one embodiment includes a combination of a long press using two fingers 442 for a predetermined time, a downward vertical movement 444, and a subsequent rightward horizontal movement 446.

[0047] Those skilled in the art will first recognize that a horizontal movement can be performed after a vertical movement following a long press using two fingers.

[0048] Furthermore, those skilled in the art will recognize that diagonal movement can be used instead of a combination of vertical and horizontal movement. Other first types of multi-finger gestures 400 can use curved movement instead of linear movement. Instead of two-finger pressing, three-finger, four-finger, and five-finger pressing can be used in combination with a given movement. As illustrated with reference to Figure 3, a long press informed the cockpit domain controller 320 that a multi-finger gesture command had been activated. The multi-finger gestures 410, 420, 430, and 440 can be mapped to functions or operations using the finger function control interface 364 via the touchscreen user interface 362 provided by the cockpit domain controller 320, as illustrated with reference to Figure 3.

[0049] Figure 5 shows a second type of multi-finger gesture 500 according to at least one embodiment.

[0050] In Figure 5, a first predetermined multi-finger gesture 510 includes a predetermined press using two fingers 512 for a predetermined duration. A second predetermined multi-finger gesture 520 includes a predetermined press using three fingers 522 for a predetermined duration. A third predetermined multi-finger gesture 530 includes a predetermined press using four fingers 532 for a predetermined duration. A fourth predetermined multi-finger gesture 540 includes a predetermined press using five fingers 542 for a predetermined duration. As described with reference to Figure 3, the finger function control interface 364 can be used to set the duration for which the user presses with multiple fingers and to assign actions to the function control. Those skilled in the art will recognize that the finger touch arrangements are presented for illustrative purposes and that other configurations using two, three, four, and five fingers can also be used without departing from the embodiments described herein.

[0051] Figure 6 shows a third type of multi-finger gesture 600 according to at least one embodiment.

[0052] In Figure 6, the first predetermined multi-finger gesture 610 includes a double touch with two fingers 612 within a predetermined time. The second predetermined multi-finger gesture 620 includes a double touch with three fingers 622 within a predetermined time. The third predetermined multi-finger gesture 630 includes a double touch with four fingers 632 within a predetermined time. The fourth predetermined multi-finger gesture 640 includes a double touch with five fingers 642 within a predetermined time. As described with reference to Figure 3, the finger function control interface 364 is available to the user to set the duration of the double touch and to assign actions to the function control. Those skilled in the art will recognize that the finger arrangements for the double touch are presented for illustrative purposes and that other configurations using two, three, four, and five-finger double touches can also be used without departing from the embodiments described herein.

[0053] Figure 7 is a flowchart 700 of a method for providing user interface control via an in-vehicle touchscreen, according to at least one embodiment.

[0054] In Figure 7, the process is initiated (S702), and then at least one action is assigned to a predetermined multi-finger gesture (S710). Referring to Figure 3, the driver can activate the finger function control interface 364 via the touchscreen user interface 362 provided by the cockpit domain controller 320. A predetermined multi-finger gesture operation, mapped to the multi-finger gesture, is registered. In at least one embodiment, the finger function control interface 364 is configured to present the driver with a list of predetermined multi-finger gesture operation candidates. The touchscreen user interface 362 of the cockpit domain controller 320 controls the operation of at least one touchscreen 310. The driver can access the finger function control interface 364 and assign actions to function control using the input detection interfaces 350 of at least the left touchscreen 312 and the right touchscreen 314.

[0055] A predetermined duration for which at least two fingers are pressed on the touchscreen to initiate at least one action is set by the user (S714). Referring to Figure 3, a finger function control interface 364 provided by the cockpit domain controller 320 can be used to map long presses with two or more fingers, for example, for several seconds, applied to the left touchscreen 312 and the right touchscreen 314, in order to associate function control with long presses using two or more fingers. For example, a predetermined gesture according to at least one embodiment includes a long press with two fingers for a predetermined duration, combined with a vertical movement followed by a horizontal movement.

[0056] A predetermined multiple-finger gesture using at least two fingers pressed against the touchscreen for a predetermined period of time is detected (S718). Referring to Figure 3, the left touchscreen 312 and the right touchscreen 314 include an input detection interface 350 configured to detect a predetermined multiple-finger operation by the vehicle driver, which is transmitted to the cockpit domain controller 320. According to at least one embodiment, detecting a predetermined multiple-finger gesture includes detecting a predetermined multiple-finger gesture that includes pressing for a predetermined period of time using multiple fingers, combined with a predetermined movement. According to at least one embodiment, detecting a predetermined multiple-finger gesture includes detecting a predetermined multiple-finger gesture that includes at least one of pressing for a predetermined period of time using two fingers, pressing for a predetermined period of time using three fingers, pressing for a predetermined period of time using four fingers, or pressing for a predetermined period of time using five fingers. According to at least one embodiment, detecting a predetermined multiple-finger gesture using two or more fingers pressed against the touchscreen by the vehicle driver for a predetermined period of time includes detecting a double touch using multiple fingers within a time limit. According to at least one embodiment, detecting a predetermined number of finger gestures using two or more fingers pressed against a touchscreen by a vehicle driver for a predetermined period of time includes disabling a predetermined output corresponding to the finger gesture in response to at least one of the detection of the driver turning the steering wheel or the vehicle angle exceeding a predetermined angle on the road.

[0057] A predetermined function control corresponding to a predetermined multi-finger gesture is generated based on the detection of a predetermined multi-finger gesture using at least two fingers pressed against the touchscreen for a predetermined period of time (S722). Referring to Figure 3, the cockpit domain controller 320 includes an output generation interface 360 ​​configured to generate predetermined outputs corresponding to multi-finger gesture operations. The outputs from multi-finger gesture operations are predetermined by the output generation interface 360 ​​of the cockpit domain controller 320 and provide operations other than those that respond to a single-finger touch gesture. The output generation interface 360 ​​of the cockpit domain controller 320 allows the driver to safely operate I / O devices using multi-finger gestures without reducing their attention while driving the vehicle.

[0058] Upon detecting that the vehicle is moving, the visual interaction on the touchscreen will be stopped for a predetermined period of time. ru Detection of predetermined multiple finger gestures on the touchscreen is enabled (S726). Referring to Figure 2, visual interaction is displayed when the vehicle is moving. Regarding The touchscreen can be disabled.

[0059] Upon determining that the vehicle has stopped, the visual interaction on the touchscreen is restored for a predetermined period of time. ru Detection of predetermined multi-finger gestures on the touchscreen is disabled (S730). Referring to Figure 2, in response to the vehicle stopping, visual interaction on the touchscreen can be restored, and multi-finger command gestures can be disabled or not recognized at that point.

[0060] The process then terminates (S740).

[0061] In at least one embodiment, a method for providing user interface control by multi-finger gestures in a vehicle includes the steps of: registering a relationship between a predetermined function control and a predetermined multi-finger gesture using at least two fingers pressed against a touchscreen for a predetermined period of time; detecting the predetermined multi-finger gesture using at least two fingers pressed against a touchscreen for a predetermined period of time; and generating a predetermined function control corresponding to the predetermined multi-finger gesture. Embodiments described herein provide a method that offers one or more advantages. For example, one or more predetermined multi-finger gestures are configured to provide input to the vehicle's touchscreen in order to perform a function or operation mapped to the multi-finger gesture. In this way, the multi-finger gesture provides simpler function control without distracting the driver's attention.

[0062] Figure 8 is a high-level functional block diagram of a processor-based system 800 according to at least one embodiment.

[0063] In at least one embodiment, the processing circuit 800 provides a method for providing user interface control via a touchscreen in a vehicle. The processing circuit 800 uses a processor 802 to implement the method for providing user interface control via a touchscreen in a vehicle. The processing circuit 800 also includes a non-temporary computer-readable storage medium 804 used to implement the method for providing user interface control via a touchscreen in a vehicle. The non-temporary computer-readable storage medium 804 stores, among other things, an instruction 806 (i.e., computer program code) encoded therein. When the instruction 806 is executed by the processor 802, it causes the processor 802 to perform an operation for providing user interface control via a touchscreen in a vehicle. The execution of the instruction 806 by the processor 802 represents (at least in part) an application that implements at least a portion of the method described herein according to one or more embodiments (hereinafter, the described process and / or method).

[0064] The processor 802 is electrically coupled to a non-temporary computer-readable storage medium 804 via a bus 808. The processor 802 is electrically coupled to an input / output (I / O) interface 810 via the bus 808. In addition, a network interface 812 is also electrically connected to the processor 802 via the bus 808. Since the network interface 812 is connected to a network 814, the processor 802 and the non-temporary computer-readable storage medium 804 are connected to external elements via the network 814. The processor 802 is configured to execute instructions 806 encoded in the non-temporary computer-readable storage medium 804 so that the processing circuit 800 can be used to carry out at least part of a process and / or method. In one or more embodiments, the processor 802 is a central processing unit (CPU), a multiprocessor, a distributed processing system, an application-specific integrated circuit (ASIC), and / or a suitable processing unit.

[0065] The processing circuit 800 includes an I / O interface 810. The I / O interface 810 is coupled to an external circuit. In one or more embodiments, the I / O interface 810 includes a keyboard, keypad, mouse, trackball, trackpad, touchscreen and / or cursor directional keys for transmitting information and commands to the processor 802.

[0066] The processing circuit 800 also includes a network interface 812 coupled to the processor 802. The network interface 812 allows the processing circuit 800 to communicate with a network 814 to which one or more other computer systems are connected. The network interface 812 includes wireless network interfaces such as Bluetooth®, Wi-Fi, WiMAX (Worldwide Interoperability for Microwave Access), GPRS (General Packet Radio Service), and WCDMA® (Wideband Code Division Multiple Access), or wired network interfaces such as Ethernet, USB (Universal Serial Bus), and IEEE (Institute of Electrical and Electronics Engineers) 864.

[0067] The processing circuit 800 is configured to receive information via the I / O interface 810. The information received via the I / O interface 810 includes one or more of the following for processing by the processor 802: instructions, data, design rules, cell libraries, and / or other parameters. The information is transferred to the processor 802 via the bus 808. The processing circuit 800 is configured to receive information related to the user interface (UI) via the I / O interface 810. The information is stored as the UI 820 in the non-temporary computer-readable storage medium 804.

[0068] In one or more embodiments, one or more non-temporary computer-readable storage media 804 store instructions 806 (in compressed or uncompressed form) that can be used to program a computer, processor, or other electronic device to carry out the processes or methods described herein. One or more non-temporary computer-readable storage media 804 include one or more of the following: electronic storage media, magnetic storage media, optical storage media, quantum storage media, etc.

[0069] For example, non-temporary computer-readable storage media 804 may include, but are not limited to, hard drives, floppy disks, optical disks, read-only memory (ROM), random access memory (RAM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic or optical cards, solid-state memory devices, or other types of physical media suitable for storing electronic instructions. In one or more embodiments using optical disks, one or more non-temporary computer-readable storage media 804 include compact disc read-only memory (CD-ROM), compact disc read / write (CD-R / W), and / or digital video discs (DVD).

[0070] In one or more embodiments, the non-temporary computer-readable storage medium 804 stores instructions 806 configured to cause the processor 802 to perform at least part of a process and / or method for providing user interface control via a touchscreen in the vehicle. teeth, It also stores information such as algorithms that facilitate the implementation of at least part of the processes and / or methods for providing user interface control via the in-vehicle touchscreen.

[0071] Therefore, in at least one embodiment, the processor 802 implements the cockpit domain controller 830 by executing instructions 806 stored in one or more non-temporary computer-readable storage media 804. The processor 802 is configured to cause the cockpit domain controller 830 to store and recognize multiple finger gestures. The processor 802 uses a finger function control interface 834 for the user to set one or more multiple finger gesture configurations 840 and for the cockpit domain controller 830 to translate these into functions / operations 842 mapped to the multiple finger gestures. The processor 802 uses the finger function control interface 834 to register a relationship between a predetermined function / operation control and a predetermined multiple finger gesture using at least two fingers pressed against the touchscreen for a predetermined period of time. The processor 802 uses the finger function control interface 834 to present the driver with a selection of predetermined multiple finger gesture operations. The cockpit domain controller 830 outputs operations performed on at least one touchscreen display 880 to the user interface 882, for example, the left touchscreen 884 and the right touchscreen 894.

[0072] The processor 802 implements a head-up display (HUD) 896 and an instrument cluster (IC) 898. The left touchscreen 884 and the right touchscreen 894 include an input detection interface 886 configured to detect predetermined multi-finger gestures by the vehicle driver, which are transmitted to the cockpit domain controller 830. The processor 802 implements an output generator 832 that generates predetermined outputs corresponding to multi-finger gesture operations. The outputs from multi-finger gesture operations are predetermined by the output generator 832 and provide operations other than single-finger touch gestures. The cockpit domain controller 830 allows the driver to safely operate I / O devices using multi-finger gestures without distraction while driving the vehicle. User interface 820 shows multi-finger gesture operations 822 implemented by the processor 802.

[0073] The driver can activate the finger function control interface 834 via the touchscreen user interface control 836 provided by the cockpit domain controller 830 to perform functions / operations mapped to multi-finger gestures 842 based on a multi-finger gesture configuration 840. The processor activates the functions / operations mapped to multi-finger gestures 842 based on the multi-finger gesture configuration 840 using a predetermined finger press time 858. The predetermined finger press time 858 is set using the finger function control interface 834.

[0074] The touchscreen user interface control 836 assists in the operation of at least one touchscreen 880. The driver can access the finger function control interface 834 using the input detection interface 886 of at least the left touchscreen 884 and the right touchscreen 894, and assign multi-finger gestures to function controls.

[0075] The processor 802 configures the finger function control interface 834 to map a long press, for example, of several seconds using two or more fingers, which is applied to the left touchscreen 884 and the right touchscreen 894, and associates the function control with the long press using two or more fingers. The processor 802 provides the finger function control interface 834 with the ability for the user to set the duration of the long press and assign an action to the function control. The processor 802 provides the finger function control interface 834 with the ability to configure a double touch using multiple fingers for a few seconds or less and associate such a double touch with the function control. The processor 802 provides the finger function control interface 834 with the ability to set the duration of the double touch and assign an action to the function control.

[0076] The processor 802 causes the touchscreen user interface control 836 to present the finger function control interface 834, enabling the user to set up candidates for multi-finger gesture operations. Generating a predetermined output includes the processor 802 displaying the finger function control interface 834 on the touchscreen of the output device in order to enable multi-finger command gestures. The zoom-in / zoom-out interfaces 888 on the left touchscreen 884 and the right touchscreen 894 allow the user to zoom in by pinching out on one or more of the left touchscreen 884 and the right touchscreen 894, and zoom out by pinching in on one or more of the left touchscreen 884 and the right touchscreen 894. When the screen is displayed on the instrument panel 898, the above pinch-out and pinch-in functions can be disabled by the processor 802.

[0077] Processor 802 is used when the vehicle is moving. 、 Display visual interaction Regarding that matter, A multi-finger gesture detection enable / disable rule 850 is used so that at least one touchscreen display 880 can be disabled. Upon vehicle stopping, the processor restores visual interaction to at least one touchscreen display 880, at which point multi-finger command gestures are disabled or not recognized.

[0078] The processor 802 can also use steering wheel sensor data 852 to determine the position of the steering wheel and detect if the steering wheel has rotated beyond a predetermined amount. If the driver rotates the steering wheel beyond a predetermined angle, the operation of the multi-finger gesture configuration 840 is disabled. This prevents the driver from using the multi-finger gesture configuration 840 to perform the functions / operations mapped to the multi-finger gesture 842 in an unsafe manner. The processor 802 determines that for slight movements, the multi-finger gesture configuration 840 does not constitute a dangerous operation. The processor 802 can also use camera road angle data 854 to determine the angle of the vehicle relative to the road and disable the multi-finger gesture configuration 840. The processor 802 makes such a decision using the camera / sensor enable / disable action 856.

[0079] Individual instances of such programs can be run on any number of separate computer systems or distributed across them. Therefore, while certain steps are described as being performed by specific devices, software programs, processes, or entities, this is not necessarily required. Those skilled in the art will understand various alternative implementations.

[0080] Furthermore, those skilled in the art will readily recognize that the above-described technologies can be used in a variety of devices, environments, and situations. While embodiments are described in terms specific to structural features or methodological actions, the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described. Rather, specific features and actions are disclosed as exemplary forms of implementing the claims.

Claims

1. A method performed by a processor to provide user interface control using multiple finger gestures in a vehicle, The steps include registering a relationship between a predetermined function control and a predetermined set of multiple finger gestures using at least two fingers pressed against the vehicle's touchscreen for a predetermined period of time, The steps include detecting a predetermined number of finger gestures using at least two fingers pressed against the touchscreen for a predetermined period of time, The steps include generating the predetermined function control corresponding to the predetermined multiple finger gestures, In response to the determination that the vehicle is moving, the steps include stopping the visual interaction on the touchscreen and enabling the detection of a predetermined number of finger gestures on the touchscreen for a predetermined period of time, Methods that include...

2. The method according to claim 1, wherein the step of registering a relationship between a predetermined function control and a predetermined plurality of finger gestures using at least two fingers pressed against the touchscreen for a predetermined period of time further comprises assigning at least one action to the predetermined plurality of finger gestures and setting the predetermined period of time for which the at least two fingers are pressed against the touchscreen to activate the at least one action.

3. The method according to claim 1 or 2, wherein the step of detecting a predetermined number of finger gestures includes detecting a predetermined amount of pressure using the number of fingers for a predetermined time, combined with a predetermined movement.

4. The method according to claim 1 or 2, wherein the step of detecting a predetermined number of finger gestures includes detecting at least one of pressing for a predetermined time using two fingers, pressing for a predetermined time using three fingers, pressing for a predetermined time using four fingers, or pressing for a predetermined time using five fingers.

5. The method according to claim 1 or 2, wherein the step of detecting a predetermined number of finger gestures using two or more fingers pressed against the touchscreen over the predetermined time period includes detecting a double touch using multiple fingers within a time limit.

6. The method according to claim 1 or 2, wherein the step of detecting a predetermined plurality of finger gestures using two or more fingers pressed against the touchscreen for a predetermined period of time includes disabling a predetermined output corresponding to the predetermined plurality of finger gestures in response to detection of rotation of the steering wheel or the vehicle's angle exceeding a predetermined angle on the road.

7. The method according to claim 1 or 2, further comprising the step of restoring the visual interaction on the touchscreen in response to the determination that the vehicle has stopped, and disabling the detection of the predetermined number of finger gestures on the touchscreen for a predetermined period of time.

8. A device for providing user interface control in a vehicle using multiple finger gestures, Memory for storing computer-readable instructions, A processor connected to the memory, which executes the computer-readable instructions, The relationship between a predetermined function control and a predetermined set of multiple finger gestures using at least two fingers pressed against the touchscreen for a predetermined period of time is registered. The system detects the gestures of a predetermined number of fingers using at least two fingers pressed against the touchscreen for the predetermined time, Generate the predetermined function control corresponding to the predetermined multiple finger gestures, A processor configured to perform an operation to stop visual interaction on the touchscreen and enable detection of a predetermined number of finger gestures on the touchscreen for a predetermined period of time, in response to a determination that the vehicle is moving. A device that is equipped with the following.

9. The apparatus according to claim 8, further configured to register a relationship between the predetermined function control and the predetermined plurality of finger gestures using at least two fingers pressed against the touchscreen for the predetermined time, by assigning at least one action to the predetermined plurality of finger gestures and setting the predetermined time for which the at least two fingers are pressed against the touchscreen to activate the at least one action.

10. The apparatus according to claim 8 or 9, wherein the processor is further configured to detect a predetermined gesture of a plurality of fingers by detecting pressing for a predetermined time using a plurality of fingers in combination with a predetermined movement.

11. The apparatus according to claim 8 or 9, wherein the processor is further configured to detect a predetermined number of finger gestures by detecting at least one of pressing for a predetermined time using two fingers, pressing for a predetermined time using three fingers, pressing for a predetermined time using four fingers, or pressing for a predetermined time using five fingers.

12. The apparatus according to claim 8 or 9, wherein the processor is further configured to detect a predetermined number of finger gestures using two or more fingers pressed against the touchscreen over a predetermined period of time by detecting a double touch using multiple fingers within a time limit.

13. The apparatus according to claim 8 or 9, wherein the processor is further configured to detect the predetermined multiple-finger gesture using two or more fingers pressed against the touchscreen for a predetermined period of time, by disabling a predetermined output corresponding to the predetermined multiple-finger gesture in response to detection of rotation of the steering wheel or the vehicle's angle exceeding a predetermined angle on the road.

14. The apparatus according to claim 8 or 9, wherein the processor is further configured to restore visual interaction on the touchscreen and disable detection of a predetermined number of finger gestures on the touchscreen for a predetermined period of time, in response to a determination that the vehicle has stopped.

15. A computer program for providing user interface control by multiple finger gestures in a vehicle, The steps include registering the relationship between a predetermined function control and a predetermined set of multiple finger gestures using at least two fingers pressed against the touchscreen for a predetermined period of time, The steps include detecting a predetermined number of finger gestures using at least two fingers pressed against the touchscreen for a predetermined period of time, The steps include generating the predetermined function control corresponding to the predetermined multiple finger gestures, In response to the determination that the vehicle is moving, the steps include stopping the visual interaction on the touchscreen and enabling the detection of a predetermined number of finger gestures on the touchscreen for a predetermined period of time, A computer program that causes a processor to perform an operation that includes [a specific operation].

16. The computer program according to claim 15, wherein the step of registering a relationship between a predetermined function control and a predetermined plurality of finger gestures using at least two fingers pressed against the touchscreen for a predetermined period of time further comprises assigning at least one action to the predetermined plurality of finger gestures and setting the predetermined period of time for which the at least two fingers are pressed against the touchscreen to activate the at least one action.

17. The computer program according to claim 15 or 16, wherein the step of detecting a predetermined number of finger gestures includes the step of detecting a predetermined amount of pressure using the number of fingers for a predetermined time, combined with a predetermined movement.

18. The computer program according to claim 15 or 16, wherein the step of detecting a predetermined number of finger gestures includes detecting at least one of pressing for a predetermined time using two fingers, pressing for a predetermined time using three fingers, pressing for a predetermined time using four fingers, or pressing for a predetermined time using five fingers.

19. The computer program according to claim 15 or 16, wherein the step of detecting a predetermined number of finger gestures using two or more fingers pressed against the touchscreen over a predetermined period of time includes detecting a double touch using multiple fingers within a time limit.

20. The step of detecting a predetermined number of finger gestures using two or more fingers pressed against the touchscreen for the predetermined time is as follows: A computer program according to claim 15 or 16, comprising, in response to a determination that the vehicle has stopped, restoring the visual interaction on the touchscreen and disabling the detection of the predetermined number of finger gestures on the touchscreen for a predetermined period of time.

Images