Method and apparatus for operating an output system with a display device and at least one further output device

The method and device allow intuitive, three-dimensional gesture control of vehicle output systems, addressing the challenge of complex configuration by enabling distraction-free operation through spatial gesture recognition.

DE102015204978B4Active Publication Date: 2025-12-24VOLKSWAGEN AG
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
DE102015204978
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2015-03-19
Publication Date
2025-12-24
Estimated Expiration
2035-03-19

AI Technical Summary

Technical Problem

Existing vehicle output systems require significant user attention for setup and configuration, especially when operating multiple devices simultaneously, which can be dangerous while driving.

Method used

A method and device utilizing three-dimensional operating gestures to assign output data to vehicle components, allowing users to control and configure output systems without direct contact with the display surface, using gesture recognition technology to detect and interpret gestures in spatial detection areas.

Benefits of technology

Enables quick and intuitive control of vehicle output systems, reducing the need for direct interaction with the display, thereby minimizing distraction and simplifying the configuration process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for operating a dispensing system, in particular in a vehicle (1) with a display device (2) and at least one further dispensing device (3), wherein Output data of a device (4; 5), in particular of the vehicle (1), are recorded, Graphic data of a graphic object (6) can be generated from the output data, the graphic data of the graphic object (6) are transferred to the display device (2) and displayed on a display surface (2a) of the display device (2), three-dimensional operating gestures performed by means of an actuating object (7) are recorded, wherein a marking gesture is detected in a detection space (8a) arranged in front of the display area (2a) and assigned to the displayed graphic object (6), characterized in that a deposit gesture is detected which is performed in a third detection space (8c) in a spatial area which is not attributable to at least one further output device (3) and which is not assigned to any output device (3) of the vehicle (1), and After the insertion gesture is detected in the third detection space (8c), a signal is generated such that the display of the graphic object (6) on the display surface (2a) is terminated and the device (4, 5) does not generate any further output data.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a method for operating a dispensing system, particularly in a vehicle, comprising a display device and at least one further dispensing device. The invention further relates to a device for operating a dispensing system, particularly in a vehicle.

[0002] A vehicle, particularly a motor vehicle, is equipped with a variety of electronic devices that must be operable by the driver or other vehicle occupants. These devices include, for example, a navigation system, a variety of driver assistance systems, and communication and multimedia applications such as a telephone system and devices for playing music and speech, like a radio or CD player. Audiovisual media may also be used, such as a DVD player or other video playback device. Such devices may be permanently integrated into the vehicle, but they may also access data from external devices, such as a mobile phone or a laptop.

[0003] The aforementioned devices provide various types of output data, such as graphic data for displaying a road map, audio data for playing music and speech, or audiovisual output data for displaying moving images with accompanying sound. Modern vehicles therefore often have multiple output devices, such as a display in the instrument cluster, a screen on the center console, and playback devices in the rear of the vehicle. The vehicle must therefore have a control system that determines which output devices output which data. For example, videos can be played in the rear of the vehicle while the driver in the front is shown map information relevant to navigation. The user must therefore be able to control the playback of content by the various output devices and configure which content is displayed where.

[0004] A disadvantage of the known solutions has been that setting up the output system demands a great deal of the user's attention, especially when the user is in a vehicle and must simultaneously observe the surrounding traffic.

[0005] DE 10 2010 056 411 A1 relates to a display device for a motor vehicle for the realization of the display of comfort information, in particular information relating to driver assistance systems.

[0006] DE 10 2011 112 447 A1 concerns a method and an order for providing a user interface, in particular in a vehicle.

[0007] German patent DE 10 2013 000 068 A1 relates to a method for synchronizing two display devices of a motor vehicle, e.g., a head-up display with a display of an infotainment system in the center console. In this method, an optical sensor detects a user's operating gesture to synchronize the display devices.

[0008] The present invention is based on the objective of providing a method and a device that allow for simple and quick adjustment of the output system.

[0009] According to the invention, this problem is solved by a method with the features of claim 1 and a device with the features of claim 10. Advantageous embodiments and further developments are described in the dependent claims.

[0010] In the method according to the invention, output data from a device, particularly from the vehicle, is acquired, and graphic data of a graphic object is generated based on this output data. The graphic data of the graphic object is transferred to the display device and displayed on a display surface of the display device. Three-dimensional operating gestures executed by means of an actuating object are acquired. A marking gesture is acquired in a detection area located in front of the display surface and assigned to the displayed graphic object. Furthermore, a placement gesture executed in a third detection area within a spatial region that cannot be assigned to at least one other output device and is not associated with any output device of the vehicle is acquired.After the placement gesture is detected in the third detection area, a signal is generated such that the display of the graphic object on the display surface is terminated and the system does not generate any further output data.

[0011] The method according to the invention is further characterized in that a placement gesture is detected in a further detection space and assigned to the output device, thus generating a signal that the output data is output by means of the output device.

[0012] In particular, when multiple graphic objects are displayed, the selection gesture is assigned to the position of the displayed graphic object.

[0013] According to the invention, the user assigns the output data of a vehicle component to a vehicle output device using gesture control. The graphic object displayed on the display surface of the display device represents the output data generated by a vehicle component. For example, a symbol can be displayed that represents the output data generated by a specific component. In particular, a symbol can be displayed that represents the display of information from a navigation system. Furthermore, a symbol can represent the output of video data, such as playing a DVD. Instead of a symbol representing the output data of the component, the data can also be displayed in a limited area within the display surface, for example, in a so-called window on the display surface.Such a window can fill the entire display area or only a portion of it. This allows, for example, multiple windows to be displayed side-by-side and the output data from several vehicle systems to be shown simultaneously.

[0014] According to the invention, operating gestures performed by means of an actuating object are detected. These are three-dimensional operating gestures, which are not limited to the two-dimensional surface of the display area.

[0015] For the purposes of this invention, a "gesture" is understood to mean a specific position of an actuating object or a specific movement performed with the actuating object. The gestures can be designed in a manner known per se. They include, in particular, pointing gestures, swiping gestures, and gestures used in everyday life, such as rotations, grasping gestures, and combinations of several such gestures, possibly performed in rapid succession. The gestures are performed within a detection area in which they can be detected without the user having to establish a spatial relationship to the display area. In particular, it is not necessary to touch the display surface, for example, at the position of a specific graphic object on the display surface.By using gesture control, the user is provided with a particularly simple and intuitive input method for controlling the display content in the display area or the associated vehicle equipment.

[0016] Various objects suitable for executing and recording a gesture as defined above can be used as the actuating object. In particular, the actuating object can be the user's hand, but it can also be, for example, a pen. The actuating object is designed in such a way that a gesture executed with it can be recorded.

[0017] Furthermore, the object being actuated can include a mobile device that detects movement and / or position in space. For example, a mobile device worn on the user's wrist or in their hand can include gyroscopic and / or motion sensors and be connected to the vehicle via data transmission. A suitable watch, such as a "smartwatch," or a mobile phone can contain such sensors. A hand or arm movement of the user can thus be detected, and the data can be transmitted to the vehicle.

[0018] According to the invention, the user performs a marking gesture, thereby marking the displayed graphic object that represents the output data. The marking gesture is performed, in particular, within a detection area located in front of the display surface. This allows the marking gesture to be assigned to the displayed graphic object. Specifically, the position of the marking gesture is detected and assigned to the position of the graphic object displayed on the screen, for example, the point on the screen that is closest to the position of the marking gesture.

[0019] In particular, if only one graphic object is displayed on the screen, the selection gesture can be performed in such a way that it is assigned to the screen itself. In this case, no position on the screen needs to be detected, since the gesture can only refer to the single graphic object, and this object is selected when the selection gesture is detected within the detection area in front of the screen.

[0020] Furthermore, a placement gesture is detected in a separate detection area and assigned to the dispensing device. Specifically, the placement gesture is assigned to one of several dispensing devices in the vehicle. The separate detection area in which the placement gesture is detected does not need to be located in the immediate vicinity of the dispensing device. Instead, the separate detection area can be defined arbitrarily, allowing the user to select a dispensing device that is outside their reach. For example, the driver can thus perform a placement gesture that is assigned to a dispensing device in the rear of the vehicle, with the detection area for the placement gesture being located in the front of the vehicle.

[0021] A signal is now generated such that the output data is displayed via the output device. The output data associated with the graphic object selected by the selection gesture is now displayed by the output device selected by the drop gesture. This advantageously allows the user to configure the output system quickly and easily; in particular, the user can easily assign the output data of a vehicle component to a vehicle output device by simply dragging and dropping a graphic object.

[0022] According to a further development of the inventive method, the detected marking and / or placement gesture is performed three-dimensionally at a distance from the display surface and / or output device. In particular, the display surface or output device is not touched during the execution of the gestures. The user is thus advantageously freer in executing the gesture and needs to pay less attention to the process. Specifically, the user does not need to touch the display surface, so the marking gesture can be performed conveniently without the display surface needing to be within the user's reach.

[0023] In a further embodiment, a direction in space is determined from the detected gesture. Depending on this direction, a point is defined on the display surface, and the gesture is assigned to the graphic object if the graphic object lies within a predetermined area around the calculated point. This allows the graphic object to be selected by pointing or executing the gesture in a direction, without the user having to pinpoint the exact location of the graphic object on the display surface. In particular, the assigned graphic object can be graphically highlighted, providing the user with immediate visual feedback on their action. The point on the display surface can also be visualized even if no object has been identified within the area around the point. This prevents the user from having to search through multiple graphic objects in vain until they have selected the desired one.This can further accelerate the marking process. Such activation of a control object, which is displayed on the screen, offers the advantage that the user does not have to touch a specific area, as with a touch-sensitive surface. Instead, it is sufficient for them to move the control object into the detection area and perform the gesture associated with that object.

[0024] According to one embodiment of the inventive method, the actuating object is the user's hand. Advantageously, the user does not need to grasp a separate actuating object to perform the gesture. In particular, the gesture can comprise a movement performed by the user's hand or fingers. The direction of the gesture is specifically related to the direction of hand movement. The gesture corresponds, in particular, to a movement performed, for example, when manipulating mechanical objects, so that the user can easily remember these gestures.

[0025] In one embodiment of the invention, the marking gesture is detected as a grasping movement of the user's hand. The gesture by which the graphic object is marked on the display surface thus corresponds to a movement performed to grasp and hold a mechanical object. The user can therefore perform the marking gesture particularly easily and intuitively.

[0026] In a further embodiment of the invention, the opening of the user's hand is detected when the selection gesture is performed. Analogous to the use of a grasping movement for the marking gesture, the opening of the hand corresponds to the mechanical putting-down movement in which an object held in the closed hand is released and placed down. The user can therefore advantageously assign the graphic object to the output device in an intuitively understandable and simple manner.

[0027] In particular, the combination of the marking gesture performed as a grasping movement and the placing gesture performed as an opening of the hand corresponds to a mechanical holding and placing of an object, which is replicated as a drag-and-drop procedure in many well-known user interfaces, especially in the computer sector, and is therefore already familiar to the user from other contexts.

[0028] In a further development of the invention, after the user performs the placement gesture, both the graphic object is displayed by the display device and the output data is output by the output device. This advantageously allows the user to have the output data associated with the graphic object displayed by the output device while the graphic object remains displayed on the screen. For example, this allows for further assignment, enabling the user to output the data via several different output devices in the vehicle.

[0029] In another embodiment of the invention, after the user performs the drop-down gesture, the display of the graphic object by the display device is terminated. In this case, the assignment of the graphic object to the output device corresponds to a shift; that is, the graphic object disappears, while the output of the data by the output device begins. For example, the driver of the vehicle can shift the output of navigation instructions from a display on the center console to the instrument cluster in order to display other data on the center console instead. The user can thus advantageously assign a specific output location within the vehicle to a particular feature.

[0030] Furthermore, after the drop gesture is detected in a detection area that is not assignable to at least one output device, a signal can be generated that terminates the display of the graphic object on the screen. This allows the user to advantageously stop the output of data, for example, if the output is not currently desired. The drop gesture is performed, in particular, in a spatial area that is not assigned to any output device of the vehicle. Specifically, a signal can be generated in such a way that the device does not produce any further output data.

[0031] In a further development step, a displacement gesture is captured, whereby a three-dimensional trajectory of the actuated object is tracked from the capture of the marking gesture to the capture of the placement gesture. This advantageously tracks the movement of the actuated object while the graphic object has already been selected, but the output device has not yet been determined. The displacement gesture thus captured corresponds to the mechanical displacement of an object that is first held by means of a marking gesture and later placed at the target location by means of a placement gesture.

[0032] In a further embodiment of the inventive method, the graphic data of the graphic object is generated such that, while the displacement gesture is being detected, the graphic object is displayed in a way that describes a movement synchronous with the displacement gesture. In particular, the graphic object appears to follow the movement of the actuating object. The displacement of the graphic object on the display surface represents the process of assigning it to the output device, which is completed with the execution of the placement gesture. This advantageously illustrates the analogy to the mechanical displacement of an object, whereby the object is moved from its origin to its destination. The user can thus perform control via gestures in a particularly intuitive and simple manner.

[0033] In particular, ease of use is facilitated when the marking gesture consists of a grasping movement of the user's hand and the selection gesture of the user's hand opening. The analogy to mechanical displacement becomes especially clear when an object is grasped, moved, and placed down.

[0034] The device according to the invention for operating an output system, particularly in a vehicle, comprises a control device through which output data from a device, particularly of the vehicle, can be acquired via an interface. Furthermore, the control device can generate graphic data of a graphic object based on the output data, which can be transferred to a display device and shown on a display surface of the display device. The device also comprises at least one gesture recognition device through which three-dimensional operating gestures executed by means of an actuating object can be recognized. A marking gesture can be recognized in a detection area arranged in front of the display surface and assigned to the displayed graphic object.Furthermore, a placement gesture can be detected that is executed in a third detection area within a spatial region that cannot be assigned to at least one other output device and is not assigned to any output device of the vehicle. After the placement gesture is detected in the third detection area, the control device can generate a signal such that the display of the graphic object on the display surface is terminated and the device does not generate any further output data. The output device is further characterized by the fact that a placement gesture can be detected in another detection area and assigned to an output device, and that the control device can generate a signal such that the output data can be transmitted to the output device and output by the output device.

[0035] In particular, when multiple graphic objects are displayed, the selection gesture can be assigned to the position of the displayed graphic object.

[0036] The device according to the invention is particularly designed to implement the method described above. The operating device thus has the same advantages as the method according to the invention.

[0037] In particular, the output data can be generated by a device within the vehicle; however, it can also be generated by a device integrated into the vehicle, such as a device that is detachably connected to the vehicle. Such a device could be, for example, a mobile phone, a computer, or a digital media playback device.

[0038] Gestures are preferably captured contactlessly by a camera system that records time-resolved video data from the detection area and, using a connected analysis unit, assigns specific gestures to the detected position and / or direction of movement of the object being actuated. Alternatively or additionally, the gesture detection device includes resistive and / or capacitive surfaces that allow the detection of an initial phase of a gesture, such as the object approaching the display surface. Furthermore, multiple detection areas can be defined, which may be monitored by several cameras.

[0039] The gestures can also be detected by other vehicle sensors, which are particularly suitable for detecting non-contact gestures. These sensors can also be integrated into a mobile device, such as a suitable watch or mobile phone. The gesture detection device allows the user's marking gesture to be assigned a position on the display surface. For this purpose, the marking gesture is detected in a detection area located in front of the display surface, so that the position and / or direction of the executed marking gesture can be linked to a position on the display surface. Furthermore, the location and / or direction of a placed gesture determines the output device.Furthermore, if the detection of a displacement gesture is provided, the movement of the actuated object can be tracked after the marking gesture has been executed until the placement gesture has been executed, so that in particular a graphical representation of the displacement movement on the display surface is made possible.

[0040] In one embodiment of the device according to the invention, the output device comprises several output units. This advantageously combines several output units, allowing the user to select multiple output units with a single gesture. For example, the user can control the output of video data on multiple screens in the rear of the vehicle by selecting a graphic object associated with the video data output on the display surface, such as on the vehicle's center console, and displaying it in the rear of the vehicle.

[0041] In a further development, the output device includes at least one output unit in the rear of the vehicle. This advantageously allows the user to control the output of data in the rear of the vehicle. In particular, the driver can enable data output in the rear of the vehicle using gesture control. For example, the user can perform a marking gesture to select a graphic object on the display surface of a screen on the center console and execute a placing gesture in such a way that it displays a placement gesture directed towards the rear of the vehicle.

[0042] In a further development of the invention, the display device comprises a display on the center console. The output device further comprises a display in the instrument cluster and / or a driver's field-of-view display, a so-called head-up display. This allows the user to advantageously determine and adjust the data and information displayed in the driver's field of vision. The display on the center console typically has a larger display area than the instrument cluster or the head-up display, making it typically suitable for displaying a selection of several graphic objects corresponding to the various types of information that can be displayed. In a further embodiment, the output data includes audiovisual data, and this audiovisual data can be output via the output device.In particular, the output data can include information that cannot be displayed using a purely visual display, such as speech and music. Advantageously, the user can specify the output of audiovisual data through a vehicle output device capable of reproducing all the included information. For example, the output from a DVD player can be provided by a display device that also has speakers. Similarly, music can be output by a device that has speakers. While a graphic object displayed on the screen is required to indicate the output data, the output data itself can also be displayed non-graphically.

[0043] The invention will now be explained using exemplary embodiments with reference to the drawings. Fig. Figure 1 schematically shows the structure of an embodiment of the device according to the invention. Fig. Figure 2 shows an embodiment of the device according to the invention in a vehicle and Fig. 3A and Fig. Figure 3B shows an exemplary sequence of the inventive method in the vehicle described above.

[0044] With reference to the Fig. 1 and Fig. Figure 2 schematically illustrates the structure of an exemplary embodiment of the device according to the invention.

[0045] A vehicle 1 comprises a navigation system 4 and a DVD player 5. These are connected to a control device 9 via an interface 10. Based on the output data from the navigation system 4 and the DVD player 5, the control device 9 generates graphic objects 6a and 6b, which are transmitted to a display device 2 and displayed on the display surface 2a of the display device 2. The control device 9 is also coupled to a gesture recognition device 11, which in this case comprises a camera 11, and to an output device 3, which in this case comprises two monitors 3a and 3b. A detection area 8a is arranged in the space in front of the display surface 2a, and a further detection area 8b is defined, which is assigned to the output device 3.Instead of monitors 3a and 3b, the output device 3 may also include other output devices, for example a windshield display, a field of vision display, a dashboard display or a rear-seat display of the vehicle 1.

[0046] A user performs three-dimensional operating gestures using an actuating object 7, in the illustrated case the user's hand 7, which can be detected by the gesture detection device 11. In particular, a marking gesture is defined in which the user performs a grasping movement with hand 7 in the detection area 8a, which is located in front of the display surface 2a. A position on the display surface 2a is determined based on the precise position and direction of the grasping movement. If one of the graphic objects 6a or 6b is displayed at this position, it is then marked. Furthermore, a movement of hand 7 along the trajectory T is detected, with a placing gesture being performed at the end of the movement. This consists of opening the hand 7. If this placing gesture is performed in the further detection area 8b, the placing gesture is assigned to the output device 3.

[0047] With reference to Fig. Figure 2 shows an embodiment of the device according to the invention in a vehicle 1.

[0048] Vehicle 1 comprises a front section 1a and a rear section 1b. Vehicle 1 also includes an instrument cluster 3, a center console display 2a, and a navigation system 4. It further includes a gesture recognition device 11, which in this case comprises a camera 11. Output data generated by the navigation system 4 is transmitted to a control unit 9. This unit generates graphic objects 6a and 6b, with graphic object 6a being generated based on the output data from the navigation system 4. Graphic objects 6a and 6b are transmitted to and displayed on the center console display 2a. Furthermore, the instrument cluster 3 is coupled to the control unit 9, enabling the control unit 9 to generate displays on the instrument cluster 3. The gesture recognition device 11 is also coupled to the control unit 9, allowing the control unit 9 to generate displays based on detected gestures.

[0049] With reference to the Fig. 3A and Fig. Figure 3B shows an exemplary sequence of the method according to the invention in the vehicle 1 described above.

[0050] At the in Fig. In the situation depicted in Figure 3A, two graphic objects 6a and 6b are displayed on the center console display. Graphic object 6a, displayed in the left area of ​​the center console display 2a, shows output data from the vehicle's navigation system 4. The user performs the marking gesture by making a grasping movement with hand 7 within a detection area 8a. The detection area 8a is located in front of the center console display 2a, and the marking gesture is performed such that, based on the position within the detection area 8a and the direction of the grasping movement, a position on the center console display 2a can be determined where graphic object 6a is located. After completion of the marking gesture, graphic object 6a is marked. The hand, closed after completion of the grasping movement, is moved along trajectory T away from detection area 8a to another detection area 8b.

[0051] As in Fig. As shown in Figure 3B, at the end of trajectory T, the user performs the placement gesture with hand 7 in detection space 8b, which consists of opening hand 7. Detection space 8b is assigned to the instrument cluster 3 and, in the illustrated case, is located in the area in front of the instrument cluster 3. After completion of the placement gesture, the graphic object 6a is displayed in the instrument cluster 3, while it is no longer displayed on the center console display 2a.

[0052] Furthermore, a third detection space 8c is arranged in the space away from the instrument cluster 3 and the center console display 2a, as shown in the Fig. 3A and Fig. 3B is shown. If, after performing the marking gesture, the user does not move hand 7 along trajectory T, but rather towards the third detection area 8c, and performs the placement gesture there, the graphic object 6a is no longer displayed. This corresponds to deactivating the output of the navigation system 4.

[0053] In another embodiment, the output data is not generated by the navigation system 4, but by the DVD player 5 of the vehicle 1, as shown in Fig. Figure 1 shows the DVD player 5 being an external device that is detachably connected to the vehicle 1 via interface 10. Instead of the one shown in Fig.In the instrument cluster 3 shown in Figure 2, monitors 3a and 3b in the rear compartment 1b of vehicle 1 serve as output units. Based on the output data from the DVD player 5, graphic object 6b is displayed on the center console display 2a. Within the detection area 8a, the user performs the marking gesture with hand 7 to mark graphic object 6b. The user moves their closed hand away from the center console display 2a towards the rear of vehicle 1. Graphic object 6b is displayed on the center console display 2a in such a way that it appears to move across the display and follow the movement of hand 7. The user then performs the placement gesture by opening their hand 7. The position of the placement gesture and the direction shown are detected, and monitors 3a and 3b in the rear compartment 1b of vehicle 1 are selected as output units.In particular, the user performs a backward movement towards the rear part 1b of the vehicle 1. The output data of the DVD player 5 is now displayed on monitors 3a and 3b, while the graphic object 6b is no longer displayed on the center console display 2a.

[0054] In another embodiment, the graphic object 6b continues to be displayed on the center console display 2a even while the output data is being displayed on monitors 3a and 3b. The graphic object 6b can be generated differently, for example, with a colored background, depending on whether the associated output data is currently being displayed by another output device 3 or not. This indicates to the user that the output data associated with graphic object 6b is currently being displayed.

[0055] In another embodiment, the navigation system 4 of the vehicle 1 generates output data in the form of acoustic messages. In this case, a graphic object 6a representing the acoustic messages is displayed on the center console display 2a. The selection of an output device 3 is analogous to the cases described above with visual or audiovisual output data. In this case, for example, a loudspeaker of the vehicle 1 served as the output device 3.

[0056] In another embodiment, the graphic object 6a represents a hands-free device of the vehicle 1 and the user can, for example, select different hands-free devices in the vehicle 1 by means of the drop gesture.

[0057] In another embodiment, the output device 3 is an external output device that is detachably connected to the vehicle 1 via data transmission. In this case as well, the user's drop-down gesture is assigned to the output device, and the output data is transferred to the output device. This opens up the possibility, for example, of outputting and using data from the vehicle's systems on mobile devices such as a mobile phone or a laptop.

[0058] Although the invention has been described in particular with reference to its use in a vehicle 1, it is applicable analogously to other areas. For example, in a system with multiple users, output data can be distributed to the output devices of the individual users by means of gesture control. Furthermore, the method according to the invention can be applied to all systems that have at least one display device and another output device. For example, the display of various monitors can be configured without contact, for example in the operating room of a hospital or in other environments where contactless configuration of displays can be advantageously used. Reference symbol list 1 vehicle 1a front area in the vehicle 1b Rear of the vehicle 2 Display device 2a Display area; center console display 3 Output device; instrument cluster; head-up display 3a; 3b Monitors 4. Setup; Navigation system 5 DVD players 6a; 6b Graphic object 7. Object of operation; user's hand 8a Recording area (display area) 8b Capture area (output device) 8c Recording area (not assigned) 9 Control device 10 Interface 11. Gesture detection device; camera T trajectory Z Pointing direction

Claims

[1] Method for operating a dispensing system, in particular in a vehicle (1) with a display device (2) and at least one further dispensing device (3), wherein Output data of a device (4; 5), in particular of the vehicle (1), are recorded, Graphic data of a graphic object (6) can be generated from the output data, the graphic data of the graphic object (6) are transferred to the display device (2) and displayed on a display surface (2a) of the display device (2), three-dimensional operating gestures performed by means of an actuating object (7) are recorded, wherein a marking gesture is detected in a detection space (8a) located in front of the display area (2a) and assigned to the displayed graphic object (6), characterized by , that a deposit gesture is detected which is performed in a third detection space (8c) in a spatial area which is not attributable to at least one further output device (3) and which is not assigned to any output device (3) of the vehicle (1), and After the insertion gesture is detected in the third detection space (8c), a signal is generated such that the display of the graphic object (6) on the display surface (2a) is terminated and the device (4, 5) does not generate any further output data. [2] Method according to claim 1, characterized by , that a placement gesture is recorded in a further detection space (8b) and assigned to the output device (3), and a signal is generated such that the output data is output via the output device (3). [3] Method according to claim 2, characterized bythat the detected marking and / or placement gesture is performed three-dimensionally spaced from the display area (2a) and / or output device (3). [4] Method according to claim 1, 2 or 3 characterized by , that the actuating object (7) is a user's hand (7). [5] Method according to claim 4, characterized by , that when the marking gesture is detected, a grasping movement of the user's hand (7) is detected. [6] Method according to one of claims 4 or 5, characterized by , that when a selection gesture is detected, an opening of the user's hand (7) is detected. [7] Method according to any one of claims 2 to 6, characterized by , that after the user performs the drop gesture, both the graphic object (6) is displayed by the display device (2) and the output data is output by the output device (3). [8] Method according to any one of claims 1 to 7, characterized by, that after the user performs the drop gesture, the display of the graphic object (6) is terminated by the display device (2). [9] Method according to any one of the preceding claims, characterized by , furthermore, that a displacement gesture is detected, whereby a three-dimensional trajectory (T) of the actuating object (7) is tracked from the detection of the marking gesture to the detection of the depositing gesture. [10] Method according to claim 9, characterized by , that the graphic data of the graphic object (6) are generated such that, while the translation gesture is being detected, the graphic object (6) is displayed in such a way that it describes a movement synchronous with the translation gesture. [11] Device for operating a dispensing system, in particular in a vehicle (1) with a control device (9) through which output data of a device (4; 5), in particular of the vehicle (1), can be acquired via an interface (10) and graphic data of a graphic object (6) can be generated on the basis of the output data, which can be transferred to a display device (2) and displayed on a display surface (2a) of the display device (2), and at least one gesture detection device (11) by which three-dimensional operating gestures performed by means of an actuating object (7) can be detected, wherein a marking gesture can be detected in a detection space (8a) which is arranged in front of the display surface (2a) and can be assigned to the displayed graphic object (6), characterized by , that a placing gesture can be detected, which is carried out in a third detection space (8c) in a spatial area that cannot be assigned to at least one further output device (3) and that is not assigned to any output device (3) of the vehicle (1), and after the placing gesture has been detected in the third detection space (8c) by the control device (9) a signal can be generated such that the display of the graphic object (6) on the display surface (2a) is terminated and the device (4, 5) does not generate any further output data. [12] Device according to claim 11, characterized by , that in a further detection space (8b) a deposit gesture can be detected and assigned to an output device (3) and a signal can be generated by the control device (9) such that the output data can be transmitted to the output device (3) and The output data can be output via the output device (3). [13] Device according to claim 12, characterized by , that the output device (3) comprises several output units (3a; 3b). [14] Device according to one of claims 12 or 13, characterized by , that the dispensing device (3) comprises at least one dispensing unit (3a; 3b) in the rear (1b) of the vehicle (1). [15] Device according to any one of claims 11 to 14, characterized by , that the display device (2) comprises a display (2) on a center console and the output device (3) comprises a display in the instrument cluster and / or a field of view display of the vehicle (1). [16] Device according to any one of claims 11 to 15, characterized by , that the output data includes audiovisual data and that the audiovisual data can be output by means of the output device (3).

Citation Information

Patent Citations

  • motor vehicle cockpit

    DE102007035769A1

  • Display device for a motor vehicle

    DE102010056411A1

  • Method and arrangement for providing a graphical user interface, in particular in a vehicle

    DE102011112447A1

  • Method for synchronizing the display devices of a motor vehicle

    DE102013000068A1