Method for providing an operating option on an operating display of a vehicle and motor vehicle
The method and system on vehicle control displays detect gameplay to deactivate vehicle controls during use, enhancing safety by preventing accidental operation and facilitating post-gameplay access.
Patent Information
- Application Number
- DE102024121033
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-07-24
- Publication Date
- 2025-10-09
- Estimated Expiration
- 2044-07-24
AI Technical Summary
Existing vehicle control displays do not effectively manage the simultaneous operation of vehicle components and computer games, risking accidental vehicle operation during gameplay.
A method and system that detects participation in a computer game on a vehicle's touchscreen and adjusts the visibility and operability of vehicle control elements, such as air conditioning, by deactivating or making them difficult to use during gameplay, and reactivating them based on game termination or vehicle speed.
Enhances safety by preventing accidental vehicle operation during gameplay, while ensuring easy access to vehicle controls when gameplay ends or vehicle starts moving.
Smart Images

Figure 00000000_0000_ABST 
Figure 00000000_0001_ABST
Abstract
Description
[0001] The invention relates to a method for providing an operating option for operating elements for components of a vehicle on a control display of the vehicle. The control display is designed, in particular, as a touchscreen / touch display. Such control displays in motor vehicles are increasingly being used for participation in a computer game. This is also assumed here.
[0002] Such computer games are primarily played by the driver while the vehicle is stationary. Alternatively, the passenger can also play the computer game. While the vehicle is stationary, it is typically possible to operate at least one of the vehicle's air conditioning systems. The controls for this air conditioning system and those for the computer game must then be displayed simultaneously on the vehicle's control display.
[0003] US 2022 / 0 089 029 A1 discloses an information and entertainment system in a motor vehicle that includes a touch-sensitive display and control device for displaying video games and / or air conditioning control options. The display and control device can be used in a full or limited mode based on a vehicle and / or operator status.
[0004] US 2014 / 0 002 743 A1 relates to a display device for a motor vehicle with a function for playing a video game. Video game playback is enabled or disabled depending on the vehicle's driving mode.
[0005] EP 3 401 148 A1 discloses a control device for a motor vehicle with a touch-sensitive control element. The touch-sensitive control element has several control surfaces that can be used in particular to control an air conditioning system and that are automatically and selectively activated or deactivated depending on sensory detection of user behavior.
[0006] Further prior art includes DE 10 2013 009 580 A1, DE 10 2020 104 499 A1, and DE 10 2023 125 792 A1, published after the filing date of the present application.
[0007] It is the object of the present invention to facilitate the playing of computer games using an operating display of a vehicle.
[0008] The object is achieved by a method according to claim 1 for providing an operating option for operating elements for components of a vehicle on an operating display of the vehicle, by a motor vehicle having the features according to claim 6 and by a motor vehicle having the features according to claim 7.
[0009] The method according to the invention for providing an operating option for operating elements for components of a vehicle on an operating display of the vehicle, which can also be used for participation in a computer game, comprises: - Providing a representation of the operating elements that enables operation of the components; - Changing the operating option when predetermined conditions are present, wherein the predetermined conditions include detecting that the operating display is being used to participate in a computer game, and wherein changing the operating option has the effect of making the operation of the components of the vehicle more difficult or preventing it entirely.
[0010] By making it more difficult to operate the vehicle's components (for example by reducing the size of the controls) or by preventing them altogether, computer gaming is made easier because the user of the computer game will not, or is less likely to, inadvertently operate the vehicle's components when making inputs on the vehicle's control display as part of the computer game.
[0011] According to a first alternative of the invention, the controls for the vehicle components remain displayed after the change, but are deactivated. This can be helpful for frequently used controls, as the controls can then be quickly reactivated. This can be particularly useful for controls for the vehicle's air conditioning, which are frequently operated when starting off, when the driver has already ended the computer game. The fact of deactivation can be indicated by a change in the color representation of the controls or by shading them ("they are displayed darker"), whereas the location of the controls on the control display preferably does not change upon deactivation or subsequent reactivation.
[0012] According to another alternative of the invention, which can also be implemented simultaneously with the first alternative, the predetermined conditions include a user being prompted to express a desire to change the control option, and this expression being subsequently made via an input. Thus, upon determining that the user is playing the computer game, the query is then made, in particular by displaying a text or other output on the control display itself. Furthermore, in this embodiment, the user can subsequently or generally be given a pop-up and / or a permanent notification that the change to the control option has been made or is still in effect.
[0013] According to a preferred embodiment of the invention, the components in the vehicle that can be operated by the control elements relate at least partially to the vehicle's air conditioning system. Typically, for example, a lower control bar / strip provided on a touchscreen is provided for the air conditioning system.
[0014] According to a further preferred embodiment of the invention, after detecting that participation in the computer game has ended and / or when the vehicle has reached a minimum speed, the display returns to the initial display; alternatively, a third display may also be provided. This embodiment is helpful if the control elements according to the preferred embodiment are those for the vehicle's air conditioning, since the user often thinks about the air conditioning when stationary after finishing the game ("They suddenly notice that it's very hot."). When starting the vehicle, inputs relating to the air conditioning may also be desired.
[0015] Returning to the initial display at a minimum vehicle speed, or even to a third display, can also be accompanied by the system actively terminating participation in the computer game. Therefore, if such a termination is not detected, but a minimum vehicle speed prevails, the computer game can be aborted. This is naturally only helpful for a computer game played by the driver.
[0016] The invention can generally be implemented for control displays in both the front and rear areas.
[0017] Detecting that participation in a computer game is taking place can be done simply by transmitting the setting of a flag (“transmitting a bit”).
[0018] Alternatively or additionally, whether a user is currently participating in a computer game can be detected using an interior camera and / or an interior microphone in the vehicle. This could record known movement patterns and / or utterances of the user.
[0019] In this context, another preferred embodiment should be mentioned, which is particularly preferably used in conjunction with the interior camera and / or the interior microphone: Detecting whether participation in a computer game is currently taking place is done by an input in a predetermined field and / or a plurality of inputs within a predetermined time. The camera can detect such an input in a predetermined field, and an interior microphone can also detect the sound of rapid inputs ("first-person shooter game"). Alternatively, the individual input or the plurality of inputs can be detected by the operating display itself.
[0020] The motor vehicle according to the invention according to a first aspect comprises an air conditioning device and an operating display as well as a control for the operating display, which is designed to cause operating elements for the air conditioning device of the vehicle to be displayed, and which is further designed to receive the message that participation in a computer game is currently taking place via the operating display by means of an input on the operating display and / or by means of a user observation device (such as an interior camera and / or interior microphone or a combination of both).The control is also designed to deactivate the controls for the air conditioning system upon receipt of the message, whereby the controls for the vehicle components remain displayed (but are deactivated) or to do this (deactivation / no longer display) at least if another condition is met (e.g. confirmation after query).
[0021] This motor vehicle enables the implementation of the method according to the invention as described above according to a preferred embodiment.
[0022] The motor vehicle according to the second aspect of the invention comprises an operating display which can be used for participation in a computer game and is characterized by a detection device which is designed to determine that such participation is already taking place, wherein the detection device a) comprises the operating display itself and / or b) comprises an interior camera and / or an interior microphone and is designed to detect that the operating display is actuated several times in a time interval of predetermined length and to evaluate this as detection of participation, wherein a control unit of the motor vehicle is designed to trigger a measure upon detection of participation (in particular to issue a control command to another unit, such as an actuator).
[0023] In this aspect, there is an immediate reaction to the computer game, which is recognized by the repeated pressing of the control display.
[0024] The motor vehicle according to claim 7 can also be designed as a motor vehicle with the features according to claim 6.
[0025] For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and / or a request to enter user feedback is issued and / or a default setting and / or a predetermined initial state is set.
[0026] The invention also includes the control device for the motor vehicle. The control device can have a data processing device or a processor device (processor circuit) that is configured to carry out an embodiment of the method according to the invention. For this purpose, the processor device can have at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). In particular, a CPU (Central Processing Unit), a GPU (Graphical Processing Unit), or an NPU (Neural Processing Unit) can be used as the microprocessor. Furthermore, the processor device can have program code that is configured to carry out the embodiment of the method according to the invention when executed by the processor device.The program code can be stored in a data memory of the processor device. The processor device can be based, for example, on at least one circuit board and / or on at least one SoC (System on Chip).
[0027] The invention also includes further developments of the motor vehicle according to the invention that have features already described in connection with the further developments of the method according to the invention. For this reason, the corresponding further developments of the motor vehicle according to the invention are not described again here.
[0028] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.
[0029] As a further solution, the invention also encompasses a computer-readable storage medium comprising program code which, when executed by a computer or computer network, causes the computer to carry out an embodiment of the method according to the invention. The storage medium can be provided at least partially as a non-volatile data memory (e.g. as a flash memory and / or as an SSD - solid state drive) and / or at least partially as a volatile data memory (e.g. as a RAM - random access memory). The storage medium can be arranged in the computer or computer network. However, the storage medium can also be operated on the Internet, for example, as a so-called app store server and / or cloud server. The computer or computer network can provide a processor circuit with, for example, at least one microprocessor.The program code can be provided as binary code and / or as assembly code and / or as source code of a programming language (e.g., C) and / or as a program script (e.g., Python). Alternatively, the computer-readable storage medium can be implemented as a signal containing computer-readable data, e.g., a time-variant voltage signal and / or a radio signal.
[0030] The invention also encompasses combinations of the features of the described embodiments. The invention therefore also encompasses implementations that each comprise a combination of the features of several of the described embodiments, unless the embodiments are described as mutually exclusive.
[0031] Exemplary embodiments of the invention are described below. Shown are: Fig. 1a shows a perspective view of an operating display on which operating elements are shown; and Fig. 1b the operating display Fig. 1a with changed representation of the controls; Fig. 2 is a flow chart illustrating steps of an embodiment of the method according to the invention; and Fig. 3 a schematic representation of a motor vehicle according to an embodiment of the invention.
[0032] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, each of which also develops the invention independently of one another. Therefore, the disclosure is intended to encompass combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.
[0033] In the figures, the same reference symbols designate elements with the same function.
[0034] Fig. 1a and b schematically show a touch display, designated as a whole by 100, as an operating display in perspective. Different fields on the display have different functions. As typically intended, the so-called climate bar 110 is shown at the bottom, which, for example, has fields F1, F2, F3, and F4 for operation and temperature displays T1 and T2. Sometimes, the temperature can be changed directly via the temperature displays T1 and T2, separately for the driver (left, T1) and the front passenger (right, T2). Field area 120 contains additional control elements; field area 130 contains menu items, and field area 140 shows the main image. If the user wants to play a computer game, they will typically primarily use area 140 and can make inputs there using buttons, etc., that may be displayed beforehand. Field area 120 can also be used optionally for gaming.
[0035] In this case, it is intended to detect whether the user is playing a computer game at all, and if so, the climate bar is adjusted according to Fig. 1b to 110' is deactivated, which means that the fields F1, F2, F3, F4 and T1, T2 remain displayed but no longer lead to operation of the air conditioning system when touched.
[0036] An embodiment of the method according to the invention is described below with reference to the flow chart in Fig. 2 described: In step S10, a conventional display is carried out, such as according to Fig. 1a. In step S12, it is detected whether the user is even starting a computer game. This can be done, for example, based on an input in field area 130. In step S14, it is detected whether the user is playing the computer game by making multiple inputs within a time period of a predetermined length (“rapid typing”). If step S12 has not been directly transferred to step S16, this takes place after step S14. In step S16, it is thus summarized that a computer game is being played. Accordingly, in step S18, the system changes the operating option, ie, the climate bar 110 from Fig. 1a becomes the deactivated climate bar 110' from Fig. 1b. This remains maintained during the ongoing gaming. Optionally, step S16 can be followed by a step S17 in which the user is first queried via the operating display itself as to whether the change in the operating option (climate bar 110 is deactivated to 110') is actually desired, before this occurs in step S18. In step S20, it can be detected that the user has ended the gaming, for example because no further inputs are made. Alternatively, in step S22, a closing of the gaming menu can be detected. Further alternatively, in step S20', it can be determined that the motor vehicle has exceeded a minimum speed, for example, has even started moving ("speed greater than zero"). This leads in each case to the summary detection of the situation that the gaming has ended or is to be ended in step S24. Accordingly, the process returns from step S24 to step S10, i.e.it will be displayed again according to . Fig. 1a returned with the operable climate bar 110.
[0037] The Fig.The motor vehicle illustrated in Figure 3 and designated therein as a whole by 1 comprises, in particular, the operating element 100, which can be controlled by a control unit 10 of the motor vehicle. The control unit 10 is intended as a data processing device, in particular a processor, such as a microprocessor, which can also run the computer game program played via the operating display 100. The motor vehicle optionally has a communication interface 16 with the Internet, so that a computer game that accesses the Internet can also be played, which can be the case if additional participants are or could be involved. An interior camera 12a and an interior microphone 12b can observe the user, and thereby the control unit can optionally detect whether the user is playing (step S14 or step S20 in the method specified above). The unit 14 represents at least one actuator and preferably comprises an actuator group for the air conditioning.This can be performed by the control unit 10 depending on the operating actions on the control display 100. The control unit 10 can determine that the minimum speed has been exceeded based on measured values from a speed sensor 12c (if this is not determined directly based on actuator commands to the engine and, if applicable, the steering system, etc.).
[0038] Overall, the examples show how detection of gaming execution via touch display and reaction climate can be provided.
Claims
[1] Method for providing an operating option for operating elements (F1, F2, F3, F4; T1, T2) for components (14) of a vehicle (1) on an operating display (100) of the vehicle (1), which can also be used for participating in a computer game, comprising: - Providing a representation (110) of the operating elements (F1, F2, F3, F4; T1, T2) enabling operation of the components; - Changing the operating option when predetermined conditions are present, wherein the predetermined conditions comprise that it is detected that the operating display is being used to participate in a computer game, and wherein the changing of the operating option has the effect that the operation of the components (14) of the vehicle (1) is made more difficult or completely prevented, wherein after the change the operating elements for the components of the vehicle remain displayed but are deactivated, and / or wherein the predetermined conditions comprise that a user has received the request to express the desire to change the operating option and that this has then been done via an input. [2] Method according to claim 1, wherein the components (14) in the vehicle at least partially relate to air conditioning of the vehicle (1). [3] Method according to claim 1 or 2, wherein after detecting termination of participation in the computer game and / or at a minimum speed of the vehicle (1), the initial display is returned to or a third display is made. [4] Method according to one of claims 1 to 3, in which the detection of whether participation in a computer game is currently taking place is carried out by means of an interior camera (12a) and / or an interior microphone (12b) in the vehicle (1). [5] Method according to one of claims 1 to 4, in which a detection of whether participation in a computer game is currently taking place is carried out by an input on a predetermined field (130) and / or by a plurality of inputs in a predetermined time. [6] Motor vehicle (1) with an air conditioning device (14) and an operating display (100), and a control for the operating display (100), which is designed to cause operating elements (F1, F2, F3, F4; T1, T2) for the air conditioning device (14) of the motor vehicle (1) to be displayed, and which is further designed to receive, through an input on the operating display (100) and / or through a user observation device (12a, 12b), the message that participation in a computer game is currently taking place via the operating display (100), and wherein the control (10) is designed, upon receipt of the message, to deactivate the operating elements (F1, F2, F3, F4; T1, T2) for the air conditioning device (14), wherein the operating elements for the components of the motor vehicle (1) remain displayed, or at least to do so if a further condition is met. [7] Motor vehicle (1) with an operating display (100) which can be used for participation in a computer game, characterized by a detection device (10) which is designed to determine that such participation is already taking place, wherein the detection device a) comprises the operating display (100) itself and / or b) comprises an interior camera (12a) and / or an interior microphone (12b) and is designed to detect that the operating display (100) is actuated several times in a time interval of predetermined length and to evaluate this as detection of participation, and wherein a control unit (10) of the motor vehicle (1) is designed to trigger a measure upon detection of participation.
Citation Information
Patent Citations
Motor vehicles with an infotainment system and display unit
DE102013009580A1
Procedures for operating a motor vehicle and motor vehicles
DE102020104499A1
Motor vehicle and method for the parallel use of controls
DE102023125792A1
Vehicle control device mounted on vehicle and method for controlling the vehicle
EP3401148A1
In-vehicle display device
US20140002743A1