Providing user interface for controlling touch screen in vehicle using multiple finger gestures

Abstract

The invention relates to the provision of a user interface for controlling a touch screen in a vehicle using multiple finger gestures. A vehicle is provided with user interface control by gestures of a plurality of fingers. The relationship between the predetermined function control and a predetermined plurality of finger gestures using at least two fingers pressed on the touch panel for a predetermined time is set in advance. Gestures of a plurality of predetermined fingers using at least two fingers pressed on a touch screen for a predetermined time are detected. A prescribed function control corresponding to the gestures of the prescribed plurality of fingers is generated. The gestures of the plurality of fingers are configured to provide input to a touch screen within the vehicle to perform functions or operations mapped to the gestures of the plurality of fingers.

Description

Technical Field

[0001] This specification relates to providing a user interface for controlling a touchscreen in a vehicle using multiple finger gestures. Background Technology

[0002] Input / output (I / O) is the process of sending information to a computer; it's the process by which a computer interacts with the physical world. Touchscreen I / O interfaces are found in many types of devices, such as smartphones, tablets, and laptops, and permeate all aspects of daily life. For example, it's common for people to organize and engage in social interactions via smartphone or tablet applications. Furthermore, in businesses, touchscreen devices are frequently used to communicate with employees, monitor work, and confirm project data for numerous other purposes.

[0003] Typically, touch devices run touch-based operating systems. These systems essentially utilize touch input to control interaction with the operating system. Such devices are useful and valuable, but they suffer from the same limitations: initially, users need to interact with the device directly and manually.

[0004] With the widespread adoption of touchscreen technology, interactive displays are gradually integrating into the modern vehicle environment. Today's vehicles are equipped with an increasing number of sensors, actuators, and peripheral devices. This rapid increase in I / O has created a high degree of complexity, requiring new approaches to electrical and electronic architectures.

[0005] In typical examples of human-operated touchscreen I / O, passengers can adjust the heating, play music, adjust their seat position, lower windows, or control vehicle components. However, depending on road conditions and driving situations, user input on such displays often leads to incorrect selections and dangerous driving behaviors. Many laws prohibit drivers from using portable devices while driving. Therefore, in many cases, devices with touchscreens are placed near the driver. Sometimes, touchscreens are also placed in locations difficult for the driver to operate while driving. Moreover, having to look at the touchscreen means the driver is not observing the direction of travel, which is therefore dangerous. Thus, operating devices with touchscreens while driving can increase the danger to the driver and other passengers in the vehicle. Summary of the Invention

[0006] In at least one embodiment, a method for providing user interface control based on multiple finger gestures in a vehicle includes the steps of: registering a relationship between a specified function control and a specified multiple finger gesture using at least two fingers pressed on a touchscreen for a specified duration; detecting the specified multiple finger gesture using at least two fingers pressed on the touchscreen for a specified duration; and generating a specified function control corresponding to the specified multiple finger gesture.

[0007] In at least one embodiment, an apparatus for providing user interface control based on multiple finger gestures in a vehicle includes: a memory storing computer-readable instructions; and a processor connected to the memory, the processor being configured to execute the computer-readable instructions to perform operations for: registering a relationship between prescribed function control and a prescribed multiple-finger gesture using at least two fingers pressed on a touchscreen for a prescribed duration; detecting the prescribed multiple-finger gesture using at least two fingers pressed on a touchscreen for a prescribed duration; and generating prescribed function control corresponding to the prescribed multiple-finger gesture.

[0008] In at least one embodiment, computer-readable instructions are stored on a non-transitory computer-readable medium. When executed by a processor, the instructions cause the processor to perform operations including: registering a relationship between a defined function control and a gesture of a defined plurality of fingers that have been pressed on a touchscreen for a defined duration; detecting the gesture of the defined plurality of fingers that have been pressed on a touchscreen for a defined duration; and generating a defined function control corresponding to the gesture of the defined plurality of fingers. Attached Figure Description

[0009] Figure 1 This refers to a vehicle with a touchscreen input / output device based on at least one implementation method.

[0010] Figure 2 This is a front view of the second vehicle cabin based on at least one implementation method.

[0011] Figure 3 This is a block diagram of a multi-finger gesture system based on at least one implementation.

[0012] Figure 4 This refers to a gesture of multiple fingers based on a first type of implementation method.

[0013] Figure 5 This refers to a gesture of multiple fingers of a second type based on at least one implementation.

[0014] Figure 6This refers to a gesture of multiple fingers of a third type based on at least one implementation method.

[0015] Figure 7 This is a flowchart of a method for providing user interface control via a touchscreen in a vehicle, based on at least one implementation.

[0016] Figure 8 It is a high-level functional block diagram of a processor-based system based on at least one implementation. Detailed Implementation

[0017] The features, aspects, and advantages of specific exemplary embodiments of the present disclosure will now be described with reference to the accompanying drawings. In the accompanying drawings, similar reference numerals denote similar elements.

[0018] The following detailed description of exemplary embodiments will be made with reference to the accompanying drawings. The foregoing disclosure provides examples and descriptions, but is not intended to be exhaustive or to limit implementations to the exact forms disclosed. Modifications and variations can be made with reference to the foregoing disclosure, and such modifications and variations may arise from the practice of implementations. Furthermore, one or more features or components of one embodiment may be embedded in or combined with another embodiment (or one or more features of another embodiment). Moreover, in the flowcharts and descriptions of operations provided below, it will be understood that one or more operations may be omitted, one or more operations may be added, one or more operations may be implemented (at least partially) while the order of one or more operations may be interchanged, provided that such modifications do not affect the scope of the invention as a result.

[0019] It is evident that the systems and / or methods described in this specification can be implemented in various forms, including hardware, software, or a combination of hardware and software. The specific control hardware or software code used to implement such systems and / or methods does not limit the implementation examples. Therefore, the operation and behavior of the systems and / or methods are described in this specification without reference to specific software code. It is understood that software and hardware can be designed to implement the systems and / or methods based on the descriptions in this specification.

[0020] Even if a specific combination of features is recited in the claims and / or disclosed in the specification, such a combination is not intended to limit the disclosure of possible implementations. In practice, sometimes many such features are combined in a manner not specifically recited in the claims, and / or many such features are disclosed in the specification. The dependent claims listed below are sometimes directly subordinate to a single claim, but the disclosure of possible implementations includes dependent claims combined with all other claims within the same group of claims.

[0021] Unless explicitly stated otherwise, the elements, actions, or instructions used in this specification should not be construed as essential or necessary. Furthermore, the articles “a” and “an” used in this specification are intended to include one or more items and are sometimes used interchangeably with “one or more.” When referring to a single item, “a” or similar language is used. Additionally, the terms “has,” “have,” “having,” “include,” and “including” used in this specification are intended to be open-ended. Moreover, unless explicitly stated otherwise, the phrase “based on” is intended to mean “at least partially based on.” Furthermore, expressions such as “at least one of A and B,” “A and / or B,” or “at least one of A or B” should be understood to include only A, only B, or both A and B.

[0022] Furthermore, to facilitate the description of the relationship between one element or feature and another as shown in the figure, this specification uses spatially relative terms such as "below," "below," "lower part," "above," and "upper part." These spatially relative terms are intended to encompass not only the orientation shown in the figure but also various orientations of the device in use or operation. If the device is oriented in other directions (rotated 90 degrees or other directions), the spatially relative descriptors used in this specification will also be interpreted accordingly.

[0023] The foregoing disclosures provide examples and illustrations, but are not intended to be exhaustive or to limit implementations to the exact forms disclosed. Modifications and changes may be made with reference to the foregoing disclosures, or sometimes derived from the practice of the implementations.

[0024] In at least one embodiment, a method for providing user interface control based on multiple finger gestures in a vehicle includes the steps of: registering a relationship between a specified function control and a specified multiple finger gesture using at least two fingers pressed on a touchscreen for a specified duration; detecting the specified multiple finger gesture using at least two fingers pressed on the touchscreen for a specified duration; and generating a specified function control corresponding to the specified multiple finger gesture.

[0025] In the embodiments described in this specification, a method is provided that offers one or more advantages. For example, one or more defined multi-finger gestures are configured to provide input to a touchscreen within a vehicle to perform functions or operations mapped to the multi-finger gestures. Therefore, multi-finger gestures provide simpler function control in a manner that does not distract the driver.

[0026] Figure 1 This refers to a vehicle 100 having a touchscreen input / output device based on at least one embodiment.

[0027] exist Figure 1 In this vehicle 100, a vehicle cockpit 110 is included. The vehicle cockpit 110 is the area where the driver or operator of the vehicle resides for driving the vehicle 100. The vehicle cockpit 110 includes a steering wheel 120, an accelerator pedal 122, a brake pedal 124, and a clutch 126. A left touchscreen 130 is located to the left of the steering wheel 120, and a right touchscreen 132 is located to the right of the steering wheel 120. The left touchscreen 130 and the right touchscreen 132 can control different functions or different schemes of the same function.

[0028] The head-up display 140 is located away from the steering wheel 120 and close to the windshield. The head-up display 140 may also be part of the windshield. The head-up display 140 includes a touchscreen 142 for displaying the instrument cluster. The touchscreen 142 may display vehicle speed (e.g., referred to as a speedometer), revolutions per minute (RPM) representing the engine speed of the vehicle's crankshaft (e.g., referred to as a tachometer), vehicle distance traveled (e.g., referred to as an odometer), measured oil pressure within the vehicle (e.g., referred to as a hydraulic gauge), measured fuel level within the vehicle (e.g., referred to as a fuel gauge), various indicators for system malfunctions and warnings, etc. The head-up display 140 may use an analog or digital display. Here, the digital head-up display 140 can be customized via user input to the touchscreen of the head-up display 140. Other information and configurations may be implemented according to at least one embodiment.

[0029] The in-vehicle infotainment (IVI) system 150 is shown further to the right of the head-up display 140. The IVI system 150 is often simply referred to as an infotainment system or information system. The IVI system 150 includes a touchscreen 152. The IVI system 150 is a central digital system that allows the user to control various vehicle functions. Additionally, the IVI system 150 can connect to specific devices such as smartphones within the vehicle. The IVI system 150 can provide at least one of the following features and functions: hands-free calling, music player and radio functionality, GPS navigation, weather forecast, traffic alerts, climate control, rear camera display, vehicle performance data, and internet connectivity.

[0030] However, it is difficult to operate the left touchscreen 130, right touchscreen 132, head-up display 140 touchscreen 142, IVI system 150 touchscreen 152, etc., while the user is driving the vehicle. Therefore, in the embodiments described in this specification, one or more predefined multi-finger gestures are implemented to provide easier function control in a manner that does not distract the driver.

[0031] Figure 2 This is a front view of a second vehicle cabin 200 based on at least one implementation.

[0032] exist Figure 2 In the second vehicle cockpit 200, the touchscreen 210 is located in the center of the steering wheel 220. The touchscreen 210 can be configured as a single display, or it can be configured as a left touchscreen 212 and a right touchscreen 214. Those skilled in the art will understand that other configurations can be implemented according to the embodiments described in this specification.

[0033] The instrument cluster (IC) 230 is located in front of the steering wheel 220. The instrument cluster 230 can be implemented using either an analog gauge or a digital display 232. Furthermore, the instrument cluster 230 can be configured independently of whether it is implemented using an analog gauge or a digital display 232, as shown in [reference needed]. Figure 1 And provide information as explained above.

[0034] The windshield with a Head-Up Display (HUD) 240 is positioned within the driver's field of vision. The windshield with a HUD 240 displays information such as speed, warning signs, and intuitive navigation guidance directly in the driver's field of vision without requiring the driver to look down at the instrument cluster 230. Various types of windshields with HUD 240 are available.

[0035] The in-vehicle infotainment (IVI) system 250 is shown on the right side of the steering wheel 220.

[0036] The IVI system 250 is often simply referred to as an infotainment system or information system. The IVI system 250 includes a touchscreen 252. As described above, the IVI system 250 is a central digital system that allows users to control various vehicle functions. The IVI system 250 can also connect to specific devices such as smartphones within the vehicle. The IVI system 250 can provide at least one of the following features and functions: hands-free calling, music player and radio functionality, GPS navigation, weather forecast, traffic alerts, climate control, rear camera display, vehicle performance data, and internet connectivity.

[0037] However, as referencedFigure 1 As mentioned above, it is difficult to operate the touchscreen 210, the instrument cluster 230 with digital display 232, and the windshield 240 with HUD while the user is driving the vehicle. Therefore, in the embodiments described in this specification, one or more predefined multi-finger gestures are implemented to provide simpler function control in a manner that does not distract the driver.

[0038] According to at least one embodiment, at least one sensor 260 detects the position of the steering wheel and then determines whether the steering wheel has been rotated beyond a predetermined amount. When the driver rotates the steering wheel more than a predetermined angle, the operation of multi-finger gesture commands is disabled. Therefore, it is possible to prevent the driver from performing multi-finger command gestures in a dangerous manner. The use of multi-finger command gestures will not be judged as a dangerous operation due to minor movements. Alternatively, instead of using sensor 260 to detect that the steering wheel has rotated beyond a predetermined amount, the camera system 270 can determine the angle of the vehicle relative to the road and disable multi-finger command gestures. Furthermore, the touchscreen can be disabled to display visual interaction while the vehicle is moving. In response to the vehicle stopping, visual interaction is restored on the touchscreen, at which point the multi-finger command gestures are disabled or not recognized.

[0039] Figure 3 This is a block diagram of a multi-finger gesture system 300 based on at least one embodiment.

[0040] exist Figure 3 In this system, a multi-finger gesture system 300 includes at least one touchscreen 310 within the vehicle. According to at least one embodiment, a left touchscreen 312 and a right touchscreen 314 are provided. A cockpit domain controller 320 is coupled to the left touchscreen 312 and the right touchscreen 314.

[0041] According to at least one embodiment, the cockpit domain controller 320 stores and recognizes gesture operations of multiple fingers. Similar to touching a button on an application interface, the cockpit domain controller 320 translates the specified multiple-finger gestures into function controls. The cockpit domain controller 320 outputs the operations performed on the left touchscreen 312 and the right touchscreen 314.

[0042] The multi-finger gesture system 300 may also include a head-up display (HUD) 330 and an instrument cluster (IC) 340 with a digital information overlay for displaying additional information selected by the user. The actual application interface for recognizing multi-finger gestures is neither displayed on the HUD 330 nor on the IC 340.

[0043] The left touchscreen 312 and right touchscreen 314 include an input detection interface 350 configured to detect predefined multi-finger gestures performed by the vehicle's driver and sent to the cockpit domain controller 320. According to at least one embodiment, single-finger touches are excluded because single touches are too common and may lead to inaccurate actions. The cockpit domain controller 320 includes an output generation interface 360 ​​configured to generate predefined outputs corresponding to multi-finger gestures. The outputs from multi-finger gestures are predetermined via the output generation interface 360 ​​of the cockpit domain controller 320, providing operations in response to touch gestures other than those of a single finger. Through the output generation interface 360 ​​of the cockpit domain controller 320, the driver can safely operate I / O devices using multi-finger gestures in a non-distracting manner while driving the vehicle.

[0044] The driver can activate the finger function control interface 364 via a touchscreen user interface 362 provided by the cockpit domain controller 320, and set predefined multi-finger gesture operations mapped to multiple fingers. In at least one embodiment, the finger function control interface 364 is configured to present candidates of predefined multi-finger gesture operations to the driver. The touchscreen user interface 362 of the cockpit domain controller 320 controls the operation of at least one touchscreen 310. The driver can access the finger function control interface 364 using the input detection interfaces 350 of at least the left touchscreen 312 and the right touchscreen 314, thereby assigning actions to function control.

[0045] The finger function control interface 364 provided by the cockpit domain controller 320 can be used to map long presses (e.g., several seconds) using two or more fingers applied to the left touchscreen 312 and right touchscreen 314, to associate function control with long touches using two or more fingers. For example, a defined gesture based on at least one embodiment includes a long press of a specified duration performed by two fingers, combining vertical movement and subsequent horizontal movement. Alternatively, or in addition to long presses using two fingers and vertical / horizontal gestures, a defined gesture based on at least one embodiment may also include long presses of a specified duration performed by two fingers, long presses of a specified duration performed by three fingers, long presses of a specified duration performed by four fingers, and long presses of a specified duration performed by five fingers. The finger function control interface 364 can be used by the user to set the duration of the long press and assign actions to function control.

[0046] The finger function control interface 364 allows users to set up to a certain number of double touches using multiple fingers and associate these double touches with function controls. For example, additional gestures include double touches performed with two fingers within a specified time, double touches performed with three fingers within a specified time, double touches performed with four fingers within a specified time, and double touches performed with five fingers within a specified time. The finger function control interface 364 allows users to set the duration of the double touches and assign actions to function controls.

[0047] Therefore, the specified multi-finger operation refers to the operation using two or more fingers. The relationship between the finger operation and the specified output can be defined by the driver via the touchscreen user interface 362. The touchscreen user interface 362 presents a finger function control interface 364, allowing the user to set candidates for multi-finger gesture operations. Generating the specified output includes displaying the finger function control interface 364 on the touchscreen of the output device to enable multi-finger command gestures. Through the zoom-in / zoom-out interface 380 of the left touchscreen 312 and the right touchscreen 314, especially when the screen is displayed on the head-up display 330, the user can zoom in / out via the pinch-out operation on one or more of the left touchscreen 312 and the right touchscreen 314, and zoom out / zoom out via the pinch-in operation on one or more of the left touchscreen 312 and the right touchscreen 314. Alternatively, when the screen is displayed on the IC, the above-mentioned pinch-out and pinch-in functions can be disabled.

[0048] At least one touchscreen 310, such as the left touchscreen 312 and the right touchscreen 314, assembled in the vehicle, is not associated with the touchscreen of a user device such as a smartphone. At least one touchscreen 310 is positioned so that the driver can use it without taking their hands off the steering wheel or their eyes off the road. Furthermore, at least one touchscreen 310 is positioned so that it faces the driver.

[0049] Figure 4 This refers to a gesture 400 of multiple fingers based on a first type of at least one implementation.

[0050] exist Figure 4 In the first defined gesture 410 based on at least one embodiment, a gesture is obtained by combining an upward vertical movement 414 and a subsequent rightward horizontal movement 416 during a long press using two fingers 412 for a defined time.

[0051] The gesture 420 of the second specified plurality of fingers based on at least one embodiment includes a gesture obtained by combining an upward vertical movement 424 and a subsequent leftward horizontal movement 426 during a long press using two fingers 422 for a specified time.

[0052] The gesture 430 of the third specified multiple fingers based on at least one embodiment includes a gesture obtained by combining a downward vertical movement 434 and a subsequent leftward horizontal movement 436 during a long press using two fingers 432 for a specified time.

[0053] The gesture 440 of the fourth specified multiple fingers based on at least one embodiment includes a gesture obtained by combining a downward vertical movement 444 and a subsequent rightward horizontal movement 446 during a long press using two fingers 442 for a specified time.

[0054] Those skilled in the art will know that a horizontal movement can be performed first by pressing and holding two fingers, followed by a vertical movement.

[0055] Furthermore, those skilled in the art will recognize that diagonal movement can be used instead of a combination of vertical and horizontal movement. In another type 1 multi-finger gesture 400, curvilinear movement can be used instead of linear movement. Pressing with three, four, or five fingers can be used in combination with prescribed movements instead of pressing with two fingers. See reference... Figure 3 As explained, a long press signals to the cockpit domain controller 320 that a multi-finger gesture command has been activated. (See reference...) Figure 3 As explained, gestures 410, 420, 430, and 440 of multiple fingers can be mapped to functions or operations via the touchscreen user interface 362 provided by the cockpit domain controller 320 and the finger function control interface 364.

[0056] Figure 5 This refers to a gesture 500 of multiple fingers of a second type based on at least one implementation.

[0057] exist Figure 5 In the first defined multi-finger gesture 510, a long press using two fingers 512 for a specified duration is included. The second defined multi-finger gesture 520 includes a long press using three fingers 522 for a specified duration. The third defined multi-finger gesture 530 includes a long press using four fingers 532 for a specified duration. The fourth defined multi-finger gesture 540 includes a long press using five fingers 542 for a specified duration. (See reference...) Figure 3As described above, the finger function control interface 364 can be used by the user to set the duration of a long press using multiple fingers and to assign actions to the function control. Those skilled in the art will understand that the finger touch configuration is presented for illustrative purposes only, and other configurations using two, three, four, or five fingers can be used without departing from the embodiments described in this specification.

[0058] Figure 6 This refers to a gesture 600 of multiple fingers of a third type based on at least one implementation.

[0059] exist Figure 6 The first defined multi-finger gesture 610 includes a double touch performed by two fingers 612 within a defined time period. The second defined multi-finger gesture 620 includes a double touch performed by three fingers 622 within a defined time period. The third defined multi-finger gesture 630 includes a double touch performed by four fingers 632 within a defined time period. The fourth defined multi-finger gesture 640 includes a double touch performed by five fingers 642 within a defined time period. (See reference...) Figure 3 As described, the finger function control interface 364 can be used by the user to set the duration of a double touch and to assign actions to the function control. Those skilled in the art will understand that the finger configuration for double touch is presented for illustrative purposes only, and other configurations utilizing two, three, four, or five fingers for double touch can be used without departing from the embodiments described in this specification.

[0060] Figure 7 This is a flowchart 700 of a method for providing user interface control via a touchscreen in a vehicle based on at least one embodiment.

[0061] exist Figure 7 In the process, the process begins (S702), and then at least one action is assigned to a gesture of a specified number of fingers (S710). See reference. Figure 3 The driver can activate the finger function control interface 364 via a touchscreen user interface 362 provided by the cockpit domain controller 320. Prescribed multi-finger gesture operations mapped to multiple fingers are registered. In at least one embodiment, the finger function control interface 364 is configured to present candidates of prescribed multi-finger gesture operations to the driver. The touchscreen user interface 362 of the cockpit domain controller 320 controls the operation of at least one touchscreen 310. The driver can access the finger function control interface 364 using the input detection interfaces 350 of at least the left touchscreen 312 and the right touchscreen 314 to assign actions to function control.

[0062] The user sets a predetermined time (S714) for pressing at least two fingers on the touchscreen to initiate at least one action. (See reference...) Figure 3 The finger function control interface 364 provided by the cockpit domain controller 320 can be used to map long presses (e.g., several seconds) applied to the left touchscreen 312 and right touchscreen 314 using two or more fingers, to associate function control with long presses using two or more fingers. For example, a gesture based on a specified gesture in at least one embodiment includes a gesture obtained by combining vertical movement and subsequent horizontal movement during a long press using two fingers for a specified time.

[0063] The detection uses a specified number of finger gestures (S718) involving pressing at least two fingers on the touchscreen for a defined duration. See reference... Figure 3 The left touchscreen 312 and right touchscreen 314 include an input detection interface 350, which is configured to detect a predetermined multi-finger operation performed by the vehicle's driver and to be sent to the cockpit domain controller 320. According to at least one embodiment, detecting a predetermined multi-finger gesture includes detecting a predetermined multi-finger gesture comprising pressing with multiple fingers for a predetermined duration in combination with a predetermined movement. According to at least one embodiment, detecting a predetermined multi-finger gesture includes detecting a predetermined multi-finger gesture comprising pressing with at least one of two fingers for a predetermined duration, pressing with three fingers for a predetermined duration, pressing with four fingers for a predetermined duration, or pressing with five fingers for a predetermined duration. According to at least one embodiment, detecting a predetermined multi-finger gesture in which the vehicle's driver presses two or more fingers on the touchscreen for a predetermined duration includes detecting a double touch using multiple fingers within a limited time. According to at least one embodiment, detecting a predetermined multiple-finger gesture by which a driver of a vehicle presses two or more fingers on a touchscreen for a predetermined duration includes: disabling a predetermined output corresponding to the finger operation in response to at least one of the following: the driver rotating the steering wheel or the vehicle's angle on the road exceeding a predetermined angle.

[0064] Based on the detection of a specified number of finger gestures, which involve pressing at least two fingers on the touchscreen for a specified duration, a specified function control corresponding to the specified number of finger gestures is generated (S722). See reference... Figure 3The cockpit domain controller 320 includes an output generation interface 360, which is configured to generate predefined outputs corresponding to multi-finger gestures. The outputs from multi-finger gestures are predetermined via the output generation interface 360 ​​of the cockpit domain controller 320, providing responses to actions other than single-finger touch gestures. Through the output generation interface 360 ​​of the cockpit domain controller 320, the driver can safely operate I / O devices using multi-finger gestures without diminishing their attention while driving the vehicle.

[0065] In response to the determination that the vehicle is moving, visual interaction on the touchscreen is stopped, and the detection of a specified number of finger gestures on the touchscreen for a specified duration is enabled (S726). See reference. Figure 2 This could mean disabling the touchscreen to display visual interactions while the vehicle is moving.

[0066] In response to the determination that the vehicle has stopped, visual interaction on the touchscreen is restored, and the detection of specified multi-finger gestures on the touchscreen for a specified duration is disabled (S730). See reference. Figure 2 This could be achieved by resuming visual interaction on the touchscreen in response to the vehicle coming to a stop, at which point command gestures using multiple fingers are disabled or not recognized.

[0067] Then, the process ends (S740).

[0068] In at least one embodiment, a method for providing user interface control based on multi-finger gestures in a vehicle includes the steps of: registering a relationship between prescribed function control and a prescribed multi-finger gesture using at least two fingers pressed on a touchscreen for a prescribed duration; detecting the prescribed multi-finger gesture using at least two fingers pressed on the touchscreen for a prescribed duration; and generating a prescribed function control corresponding to the prescribed multi-finger gesture. In the embodiments described herein, a method is provided that offers one or more advantages. For example, one or more prescribed multi-finger gestures are configured to provide input to a touchscreen of the vehicle to perform a function or operation mapped to the multi-finger gesture. Thus, multi-finger gestures provide simpler function control in a manner that does not distract the driver.

[0069] Figure 8 This is a high-level functional block diagram of a processor-based system 800 based on at least one implementation.

[0070] In at least one embodiment, processing circuitry 800 provides a method for providing user interface control via a touchscreen within a vehicle. Processing circuitry 800 uses processor 802 to implement the method for providing user interface control via a touchscreen within a vehicle. Processing circuitry 800 also includes a non-transitory computer-readable storage medium 804 for implementing the method for providing user interface control via a touchscreen within a vehicle. Instructions 806 (i.e., computer program code) are specifically encoded in the non-transitory computer-readable storage medium 804, i.e., instructions 806 are stored thereon. When instructions 806 are executed by processor 802, the instructions 806 cause processor 802 to perform operations for providing user interface control via a touchscreen within a vehicle. The execution of instructions 806 by processor 802 (at least partially) represents an application program that implements at least a portion of the methods described herein (hereinafter referred to as the described processes and / or methods) according to one or more embodiments.

[0071] Processor 802 is electrically coupled to non-transitory computer-readable storage medium 804 via bus 808. Processor 802 is also electrically coupled to input / output (I / O) interface 810 via bus 808. Additionally, network interface 812 is also electrically connected to processor 802 via bus 808. Since network interface 812 is connected to network 814, processor 802 and non-transitory computer-readable storage medium 804 are connected to external elements via network 814. Processor 802 is configured to execute instructions 806 encoded in non-transitory computer-readable storage medium 804, thereby enabling processing circuitry 800 to be used to implement at least a portion of a process and / or method. In one or more embodiments, processor 802 is a central processing unit (CPU), a multiprocessor, a distributed processing system, an application-specific integrated circuit (ASIC), and / or a suitable processing unit.

[0072] The processing circuitry 800 includes an I / O interface 810. The I / O interface 810 is coupled to external circuitry. In one or more embodiments, the I / O interface 810 includes a keyboard, keypad, mouse, trackball, touchpad, touchscreen, and / or cursor arrow keys for transmitting information and commands to the processor 802.

[0073] The processing circuit 800 also includes a network interface 812 coupled to the processor 802. Through the network interface 812, the processing circuit 800 can communicate with a network 814 connected to one or more other computer systems. The network interface 812 includes wireless network interfaces such as Bluetooth, Wi-Fi, WiMAX, GPRS, and WCDMA (Wideband Code Division Multiple Access), or wired network interfaces such as Ethernet, USB, and IEEE 864.

[0074] Processing circuitry 800 is configured to receive information via I / O interface 810. The information received via I / O interface 810 includes one or more of the following: instructions, data, design rules, cell libraries, and / or other parameters for processing by processor 802. The information is transmitted to processor 802 via bus 808. Processing circuitry 800 is configured to receive information associated with a user interface (UI) via I / O interface 810. The information is stored as UI 820 in non-transitory computer-readable storage medium 804.

[0075] In one or more embodiments, one or more non-transitory computer-readable storage media 804 store instructions 806 (in compressed or uncompressed form) that can be used to program a computer, processor, or other electronic device to implement the processes or methods described herein. The one or more non-transitory computer-readable storage media 804 include one or more of electronic storage media, magnetic storage media, optical storage media, quantum storage media, etc.

[0076] For example, non-transitory computer-readable storage medium 804 may sometimes include hard disk drives, floppy disks, optical disks, read-only memory (ROM), random access memory (RAM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic cards or optical cards, solid-state storage devices, or other types of physical media suitable for storing electronic instructions, but not limited to the media listed herein. In one or more embodiments using optical disks, one or more non-transitory computer-readable storage media 804 include compact disk-read only memory (CD-ROM), compact disk-read / write (CD-R / W), and / or digital video disc (DVD). Furthermore, a computer program product including a computer program that causes a processor to perform the processes or methods described herein may also be distributed in a state stored on a storage medium or via a communication line.

[0077] In one or more embodiments, the non-transitory computer-readable storage medium 804 stores instructions 806 configured to cause the processor 802 to implement at least a portion of a process and / or method for providing user interface control via a touchscreen within a vehicle. In one or more embodiments, the non-transitory computer-readable storage medium 804 also stores information such as algorithms that facilitate the implementation of at least a portion of the process and / or method for providing user interface control via a touchscreen within a vehicle.

[0078] Therefore, in at least one embodiment, processor 802 executes instructions 806 stored in one or more non-transitory computer-readable storage media 804 to implement cockpit domain controller 830. Processor 802 is configured to cause cockpit domain controller 830 to store and recognize gestures of multiple fingers. Processor 802 uses a finger function control interface 834, wherein the finger function control interface 834 is used for a user to set a configuration 840 of one or more finger gestures and for cockpit domain controller 830 to convert the configuration 840 of the multiple finger gestures into functions / operations 842 mapped to the multiple finger gestures. Processor 802 uses finger function control interface 834 to register the relationship between specified function / operation controls and specified multiple finger gestures using at least two fingers pressed on a touchscreen for a specified duration. Processor 802 uses finger function control interface 834 to present candidates of specified multiple finger gesture operations to the driver. Cockpit domain controller 830 outputs the operations performed on at least one touchscreen display 880 through user interface 882, such as left touchscreen 884 and right touchscreen 894.

[0079] Processor 802 implements a head-up display (HUD) 896 and an instrument cluster (IC) 898. The left touchscreen 884 and right touchscreen 894 include an input detection interface 886 configured to detect predefined multi-finger gestures performed by the vehicle's driver and sent to the cockpit domain controller 830. Processor 802 implements an output generation 832 that generates predefined outputs corresponding to the multi-finger gestures. The outputs from the multi-finger gestures are predetermined by output generation 832, providing operations beyond single-finger touch gestures. Through the cockpit domain controller 830, the driver can safely operate I / O devices using multi-finger gestures in a non-distracting manner while driving the vehicle. User interface 820 represents the multi-finger gestures 822 implemented by processor 802.

[0080] The driver can activate the finger function control interface 834 via the touchscreen user interface 836 provided by the cockpit domain controller 830, and execute functions / operations 842 mapped to the gestures of the multiple fingers based on the configuration 840 of the multiple finger gestures. The processor, using a predetermined finger press time 858, activates the functions / operations 842 mapped to the gestures of the multiple fingers based on the configuration 840 of the multiple finger gestures. Furthermore, the predetermined finger press time 858 is set using the finger function control interface 834.

[0081] The touchscreen user interface control 836 assists in the operation of at least one touchscreen display 880. The driver can access the finger function control interface 834 using the input detection interface 886 of at least the left touchscreen 884 and the right touchscreen 894, assigning gestures of multiple fingers to function controls.

[0082] The processor 802 configures the finger function control interface 834, mapping long presses (e.g., a few seconds) using two or more fingers applied to the left touchscreen 884 and right touchscreen 894, thus associating function controls with these long presses. The processor 802 provides the finger function control interface 834 with the ability for the user to set the duration of a long press and to assign actions to the function controls. The processor 802 also provides the finger function control interface 834 with the ability to set double touches using multiple fingers within a few seconds and associate these double touches with function controls. Finally, the processor 802 provides the finger function control interface 834 with the ability to set the duration of double touches and to assign actions to the function controls.

[0083] Processor 802 causes touchscreen user interface control 836 to present finger function control interface 834, allowing the user to set multiple finger gesture operation candidates. The generated output includes: processor 802 displaying finger function control interface 834 on the touchscreen of the output device to enable multiple finger command gestures. Through the zoom-in / zoom-out interface 888 of the left touchscreen 884 and the right touchscreen 894, the user can zoom in / out by opening / closing on one or more of the left touchscreen 884 and the right touchscreen 894, and zoom out / zoom out by pinching on one or more of the left touchscreen 884 and the right touchscreen 894. Alternatively, when the screen is displayed on the dashboard 898, the processor 802 can disable the aforementioned open / close and pinch / zoom-out functions.

[0084] In order to disable at least one touchscreen display 880 for displaying visual interactions while the vehicle is moving, processor 802 uses an enable / disable rule 850 for multi-finger gesture detection. In response to the vehicle stopping, the processor restores visual interactions to at least one touchscreen display 880 at a time when multi-finger command gestures were disabled or not recognized.

[0085] The processor 802 can also use steering wheel sensor data 852 to determine the position of the steering wheel and detect if the steering wheel has been rotated beyond a predetermined amount. When the driver rotates the steering wheel beyond a predetermined angle, the operation of the multi-finger gesture configuration 840 is disabled. Therefore, it prevents the driver from using the multi-finger gesture configuration 840 to perform functions / operations 842 mapped to the multi-finger gesture in an unsafe manner. In minor movements, the processor 802 determines that the multi-finger gesture configuration 840 does not constitute a dangerous operation. The processor 802 can also use camera road angle data 854 to determine the angle of the vehicle relative to the road and disable the multi-finger gesture configuration 840. The processor 802 uses the camera / sensor enable / disable action 856 to make this decision.

[0086] Such a program can be executed individually on any number of individual computer systems, or its individual instances can be distributed across any number of individual computer systems. Therefore, specific steps are described as being performed by specific devices, software programs, processes, or entities, but this is not necessarily required. Those skilled in the art will understand the various alternative implementations.

[0087] Furthermore, those skilled in the art will readily recognize that the above-described techniques can be utilized in various devices, environments, and conditions. The embodiments have been described using terms specific to structural features or methodological behaviors, but the subject matter defined in the appended claims is not necessarily limited to the specific features or behaviors described. Rather, specific features and behaviors are disclosed as exemplary forms of implementing the claims.

Claims

1. A method for providing user interface control based on multi-finger gestures in a vehicle, comprising the following steps: The relationship between the registered functional controls and the specified multiple-finger gestures that use at least two fingers to press on the vehicle's touchscreen for a specified duration; The detection used a gesture involving at least two fingers or a specified number of fingers that were pressed on the touchscreen for a specified duration. as well as Generate the defined function controls corresponding to the gestures of the defined multiple fingers.

2. The method according to claim 1, wherein, The step of registering the relationship between the specified function control and the specified plurality of finger gestures that use at least two fingers to press on the touchscreen for a specified duration further includes: assigning at least one action to the specified plurality of finger gestures; and setting the specified duration for the at least two fingers to press on the touchscreen to initiate the at least one action.

3. The method according to claim 1 or 2, wherein, The step of detecting the specified multiple-finger gesture includes: detecting a press of the specified duration using multiple fingers in combination with the specified movement.

4. The method according to claim 1 or 2, wherein, The step of detecting the specified multiple-finger gesture includes: detecting at least one of the following: pressing for a specified time using two fingers, pressing for a specified time using three fingers, pressing for a specified time using four fingers, or pressing for a specified time using five fingers.

5. The method according to claim 1 or 2, wherein, The step of detecting a specified number of finger gestures, which involve pressing two or more fingers on the touchscreen for a specified duration, includes: detecting two touches using multiple fingers within a specified time.

6. The method according to any one of claims 1 to 5, wherein, The step of detecting a predetermined plurality of finger gestures, which involves pressing two or more fingers on the touchscreen for a predetermined duration, includes: disabling a predetermined output corresponding to the predetermined plurality of finger gestures in response to at least one of a detection of steering wheel rotation or the vehicle angle exceeding a predetermined angle on the road.

7. The method according to any one of claims 1 to 6, wherein, It also includes the following steps: In response to the determination that the vehicle is moving, visual interaction on the touchscreen is stopped, and the detection of the specified number of finger gestures on the touchscreen for the specified duration is enabled.

8. A device for providing user interface control based on multiple finger gestures in a vehicle, comprising: Memory, which stores computer-readable instructions; and A processor, connected to the memory, is configured to execute the computer-readable instructions to perform operations for the following actions: The relationship between the registered functional controls and the specified multiple-finger gestures that use at least two fingers pressed on the touchscreen for a specified duration; The detection used a specified number of finger gestures, including at least two fingers pressed on the touchscreen for a specified duration; and Generate the defined function controls corresponding to the gestures of the defined multiple fingers.

9. The apparatus according to claim 8, wherein, The processor is further configured to: assign at least one action to the gestures of the specified plurality of fingers, and set a specified time for the at least two fingers to press on the touchscreen to initiate the at least one action, thereby registering the relationship between the specified function control and the gestures of the specified plurality of fingers that use at least two fingers to press on the touchscreen for the specified time.

10. The apparatus according to claim 8 or 9, wherein, The processor is also configured to detect a press of a predetermined duration using multiple fingers in combination with a predetermined movement, thereby detecting the predetermined gesture of the multiple fingers.

11. The apparatus according to claim 8 or 9, wherein, The processor is further configured to detect at least one of the following: a press of the specified duration using two fingers, a press of the specified duration using three fingers, a press of the specified duration using four fingers, or a press of the specified duration using five fingers, thereby detecting the specified multiple-finger gesture.

12. The apparatus according to claim 8 or 9, wherein, The processor is also configured to detect double touches using multiple fingers within a limited time, thereby detecting the specified multiple-finger gestures that use two or more fingers to press on the touchscreen for the specified time.

13. The apparatus according to any one of claims 8 to 12, wherein, The processor is also configured to: in response to at least one of the detection of rotation of the steering wheel or the vehicle's angle on the road exceeding a predetermined angle, disable the predetermined output corresponding to the predetermined plurality of finger gestures, thereby detecting the predetermined plurality of finger gestures that use two or more fingers to press on the touchscreen for the predetermined time.

14. The apparatus according to any one of claims 8 to 13, wherein, The processor is also configured to: in response to a determination that the vehicle is moving, stop visual interaction on the touchscreen and enable the detection of the specified multiple finger gestures on the touchscreen for a specified period of time.

15. A computer program product comprising a computer program that causes a processor to perform operations including the following steps: The relationship between the registered functional controls and the specified multiple-finger gestures that use at least two fingers pressed on the touchscreen for a specified duration; The detection used a gesture involving at least two fingers or a specified number of fingers that were pressed against the touchscreen for a specified duration; and Generate the defined function controls corresponding to the gestures of the defined multiple fingers.

16. The computer program product according to claim 15, wherein, The step of registering the relationship between the specified function control and the specified plurality of finger gestures that use at least two fingers to press on the touchscreen for a specified duration further includes: assigning at least one action to the specified plurality of finger gestures; and setting the specified duration for the at least two fingers to press on the touchscreen to initiate the at least one action.

17. The computer program product according to claim 15 or 16, wherein, The step of detecting the specified multi-finger gesture includes the following steps: detecting a press of the specified duration using multiple fingers in combination with the specified movement.

18. The computer program product according to claim 15 or 16, wherein, The step of detecting the specified multiple-finger gesture includes the following steps: The detection involves at least one of the following: a press for a specified time using two fingers, a press for a specified time using three fingers, a press for a specified time using four fingers, or a press for a specified time using five fingers.

19. The computer program product according to claim 15 or 16, wherein, The step of detecting a specified number of finger gestures, which involve pressing two or more fingers on the touchscreen for a specified duration, includes: detecting two touches using multiple fingers within a specified time.

20. The computer program product according to any one of claims 15 to 19, wherein, The step of detecting a specified plurality of finger gestures involving two or more fingers pressed on the touchscreen for a specified duration includes at least one of the following actions: In response to at least one of the detections of steering wheel rotation or vehicle angle exceeding a specified angle on the road, the specified output corresponding to the specified multiple finger gestures is disabled; or In response to the determination that the vehicle is moving, visual interaction on the touchscreen is stopped, and the detection of the specified number of finger gestures on the touchscreen for the specified duration is enabled.

Images