Multimedia control device
By using a magnet-based system for wireless signal transmission, the multimedia operating device addresses space constraints and improves user interaction, enabling efficient and intuitive processing of multimedia content.
Patent Information
- Application Number
- DE102023133754
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-01
- Publication Date
- 2025-06-05
AI Technical Summary
Existing multimedia operating devices face challenges with space requirements due to electrical signal generators and connection lines, which hinder the display of parameters and user input registration, especially in time-critical situations.
The multimedia operating device employs a magnet-based system where actuatable operating elements with magnets generate a magnetic field detected by sensors, eliminating the need for electrical connections and allowing for wireless signal transmission, thus optimizing space usage.
This solution reduces space constraints, enables haptic feedback for intuitive operation, and allows for the display of parameters in the vicinity of the operating elements, enhancing user experience and accuracy in multimedia content processing.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
The invention relates to a multimedia operating device for processing multimedia content by means of a user input.Multimedia operating devices with operating elements, for example in the form of rotary controllers, with which multimedia contents can be processed, are known from the prior art. Usually, the rotary controllers are used to actuate electrical signal generators in the form of incremental rotary generators, with which the actuation of the operating element by a user is converted into a digital electrical signal, which is then fed to an evaluation unit for changing the desired parameter of the multimedia content. However, the electrical signal generators absolutely necessary in these embodiments require valuable space for the multimedia operating device, which can then no longer be used otherwise. The same applies to the space requirement of the absolutely necessary electrical connection between the electrical signal generators and the evaluation unit. In particular, if the environment of the operating element is to be used for displaying a parameter changed with the operating element to facilitate operation, this is not possible in the known multimedia operating devices due to the sensors and the lines assigned to them. A particular disadvantage of the space requirement is that the display of the multimedia operating device is concealed by the known operating elements.In addition, multimedia operating devices are known which register a user input on a touchscreen by means of a corresponding movement input. However, due to the lack of haptic feedback in the user input, these multimedia operating devices are difficult and not intuitive to operate. This disadvantage is particularly important in time-critical operating situations, for example in live concerts, in which, due to the need for rapid inputs, the user cannot always direct the gaze to the multimedia operating device for checking the operation. The cumbersome operation via the touchscreen can thus lead to erroneous inputs.U.S. Pat. No. 9,310,901 B2 discloses a multimedia device having operating elements which are provided with optical signal generators and transmit a light signal to sensors which are arranged on the surface of the multimedia operating device. It is disadvantageous that the optical transmission path between the operating element and the sensor must always be free of obstacles and is therefore susceptible to contamination. Since the sensor must be constantly in direct visual contact with the operating element, the sensor is necessarily arranged on the side of the multimedia operating device facing the operating element. This has a disadvantageous effect on the space available for other components of the multimedia operating device. The same disadvantage is also present if a purely electrical transmission path is provided between the operating element and the sensor, since there is also a corresponding space requirement on the side of the surface of the multimedia operating device assigned to the operating element.It is therefore the object of the invention to eliminate the above-mentioned disadvantages from the prior art and in particular to develop a multimedia operating device which optimizes the space requirement of the operating elements without adversely affecting the operability.The object of the invention is achieved by a multimedia operating device having the features of claim 1. the multimedia operating device according to the invention is designed to process a multimedia content by means of a user input and has at least one actuatable operating element for receiving the user input, wherein the operating element has at least one magnet which is designed to generate a magnetic field. The multimedia operating device has at least one sensor assigned to the operating element, which is designed for detecting the magnetic field generated by the magnet and for converting the magnetic field into an electrical signal, wherein the sensor is connected to an evaluation unit in order to transmit the electrical signal to the evaluation unit. The evaluation unit is configured for receiving and evaluating the electrical signal of the sensor in such a way that the user input is thereby registered and the multimedia content is processed.It is a basic idea of the invention that a simple, robust and in particular wireless signal transmission is realized by using a magnetic field for transmitting the information of the user input input via the operating element to the sensor assigned to the operating element. In addition, it is no longer necessary in this way to connect the sensor to the operating element assigned to it via a cable; this eliminates in particular the need to form contacts and connections between the operating element and the sensor. The sensor also no longer has to be located in the immediate vicinity of the operating element assigned to it. By using the magnetic field for signal transmission, the sensor can be arranged at a distance from the operating element assigned to it, without an electrical line being required for transmission. This results in a considerable saving in space, in particular in the environment of the operating element, and has the advantage that the environment of the operating element remains usable for other purposes, such as, for example, a display assigned to the operating element. This is not possible with the known multimedia operating devices.For the purposes of the invention, multimedia contents are, for example, digital or analog audio data or video data or also meta data assigned to these.Preferably, the at least one operating element is movable with respect to at least one spatial axis. The operating element is movable in particular one-dimensionally or two-dimensionally.The at least one operating element can be movable parallel and / or perpendicular to the surface of the multimedia operating device and / or rotatable about its direction of extension. The operating element that can be moved parallel to the surface of the multimedia operating device can be designed as a slider. The operating element that is movable normally to the surface of the multimedia operating device can be designed as a pushbutton and / or as a button. The operating element rotatable about its direction of extension can be configured as a rotary knob. The two-dimensionally movable operating element can be designed as a slide regulator that is capable of being moved in a two-dimensional manner or as a combination of a one-dimensional slide regulator with a pushbutton. The at least one operating element can be movable continuously or between discrete positions in which it can be locked. For the movement options of the operating element, a plurality of the aforementioned movement types can be combined with one another.Preferably, at least two, in particular at least ten, in particular at least twenty, operating elements are provided. In a development of the invention, it can be provided that the multimedia operating device has at least two display subareas, to each of which at least one, in particular at least two, operating elements can be assigned. Preferably, a maximum of 28 operating elements are assigned to each display sub-region. The display subareas can be arranged one above the other and / or next to one another. For example, three display subareas, each comprising a maximum of 28 operating elements, are arranged next to one another and one above the other, thus in a 3x3 pattern. Preferably, a maximum of 28, in particular a maximum of 48, preferably a maximum of 1200, operating elements are provided.The control elements are preferably arranged in a periodic pattern, i.e. at regular distances from one another. The pattern can be one-dimensional or two-dimensional and in the latter case have different periods in different spatial directions. In an advantageous development of the invention, the operating elements are arranged in a rectangular pattern. Since the signal transmission between the operating element and the sensor assigned to it does not require electrical contacts and / or electrical connections, the arrangement of the operating elements on the multimedia operating device can be freely selected.The at least one operating element can have a touch sensor for detecting a touch of the operating element by the user, wherein the touch sensor is connected in particular to a touch evaluation unit of the multimedia operating device. The touch sensor can be configured as a capacitive touch sensor and / or comprise an electrically conductive cap, which can be arranged on the operating element. In particular, the touch sensor is connected to the touch evaluation unit via an in particular transparent conductor track as a transparent connecting line, wherein the conductor track can be manufactured from indium tin oxide. In a further development of the invention, the touch sensor is connected wirelessly to the touch evaluation unit. In a further development of the invention, it can be provided that the evaluation unit is also designed as a touch evaluation unit. Alternatively, the touch evaluation unit can be formed separately from the evaluation unit. Further developments of the invention can provide that the touch evaluation unit is designed to detect touches on the display area, which, as stated, can be designed as a touchscreen. In this respect, the touch evaluation unit can be connected to the display region, in particular to its layer made of glass.The operating element can preferably be switched into an active state or into a deactivated state as a function of a signal of the touch sensor assigned to the operating element, wherein user inputs can be registered in the active state of the operating element and no user inputs can be registered in the deactivated state of the operating element. The evaluation unit can be configured such that signals of a sensor are only registered and further processed when the operating element assigned to the sensor is in an active state. This ensures that only signals of an operating element actually touched by the user are detected and forwarded, which prevents incorrect inputs and enables more efficient operation of the multimedia operating device. In particular, it can be provided that only when the touch sensor registers a touch of the operating element by the user is the operating element switched to the active state. Furthermore, it can be provided that, if the touch sensor of the operating element does not register any touch of the operating element by the user, the operating element is switched to the deactivated state. The operating element can be configured to change at least one parameter, in particular at least two parameters of the multimedia content.The user input is preferably at least one element from the following group: current orientation of the operating element, change in the orientation of the operating element, current position of the operating element, change in the position of the operating element.The magnet can be configured as a permanent magnet and / or arranged in such a way that the magnetic field generated by the magnet is aligned with the sensor. In this respect, the magnetic field generated by the magnet can be inhomogeneous and / or anisotropic. The at least one operating element can have at least two magnets in order to be able to detect an actuation of the operating element by the user, and therefore the user input, more easily by the sensors. The control element preferably has two magnets. In a further development of the invention, the magnet is designed as a bar magnet.The sensor is preferably designed as a magnetoresistive sensor, in particular as a Hall sensor, which is also referred to as a Hall sensor or Hall probe. Magnetoresistive sensors in the sense of the invention are sensors which detect a magnetic field via the detection of an electrical resistance. Hall sensors have advantages over coils in that magnetic fields that are constant over time are also detectable and that, in addition, no ferromagnetic materials are required for detecting the magnetic field. Further developments of the invention can provide that the sensor is designed as an AMR sensor, in which the magnetic field can be detected by taking into account the anisotropic magnetic effect (AMR effect). The sensor can be designed as a giant magnetoresistance sensor, which is also referred to as a GMR sensor and in which the magnetic field is detected taking into account the giant magnetoresistance (GMR) effect. The sensor can also be designed as a fluxgate sensor, which is also referred to as a fluxgate magnetometer. Alternatively or additionally, it can be provided that the sensor is configured to detect at least one, in particular at least two, preferably at least three directional components of the magnetic field generated by the magnet. The directional components of the magnetic field detected by the sensor can be stored, in particular, in the form of a vector for the subsequent evaluation of the sensor signal, which vector can be evaluated for registering the user input. In this respect, the vector of the sensor signal can serve as the basis for registering the position and / or the orientation of the operating element, for example the current rotational position or a changed rotational angle of the operating element. In this respect, the sensor can be designed for vector-wise detection of the magnetic field. The electrical signal generated by the sensor may be analog or digital. The sensor can be configured to detect magnetic fields of up to about 15 mT, in particular up to 10 mT, preferably up to 1.2 mT. At least one sensor, preferably all sensors, can be arranged on a circuit board of the multimedia operating device, which can be arranged in a region of the display region facing away from the user. The board may be connected to the display area.The multimedia operating device preferably has at least one display area, which can be designed to reproduce information. As already stated, the display region can have at least one display sub-region, in particular a plurality of display sub-regions. The at least one operating element can be arranged on or in or above the display area, that is to say in an area of the display area facing the user. In the case of a plurality of display regions, provision can be made for each operating element to be assigned a display region, in particular a display sub-region. Alternatively or additionally, it can be provided that the at least one sensor is arranged on or behind the display area, i.e. in an area of the display area facing away from the user. In an advantageous embodiment of the invention, the operating element is arranged on the display area on the side facing the user and is in contact therewith. In an advantageous embodiment of the invention, the at least one sensor is arranged behind the display region on the side thereof facing away from the user and can be in contact with the display region. In a further embodiment of the invention, it can be provided that the display area is functionally divided, namely into an area facing the user, which is assigned to the operating element and to receive the user input, and an area facing away from the user, which is assigned for detecting the magnetic field, converting it into an electrical signal and processing it further. The sensor may be configured separately from the display area. The magnet is preferably configured such that the magnetic field generated by the magnet penetrates the display region. At least 50%, in particular at least 75%, preferably at least 96%, most preferably the entire surface of the multimedia operating device can be configured as a display region, wherein the details relate to the surface visible from the outside, which in this respect is not covered in particular by the operating elements.The display region can have a touchscreen at least in regions and / or be provided with a protective layer, in particular on the side facing the operating element. As a touchscreen, the display area can have a cover glass facing the user as a protective layer, a layer of glass arranged underneath it, and a display layer. The layer of glass may include a touch sensor for sensing user touches. The display layer can be configured to display graphical information. By configuring the display area as a touchscreen, the receipt of further user inputs directly on the display area is simplified, which improves the operating possibilities of the multimedia operating device without having to simultaneously dispense with haptic feedback of user inputs in the case of user inputs critical for the processing of the multimedia content as a result of the actuatable operating element. At the same time, the display area can be designed to display parameters which are to be changed in particular by means of the user input. In this respect, the display region can be configured as a display with a touch function. The protective layer provides protection against, in particular, mechanical damage to the multimedia operating device, in particular to the display area, wherein the protective layer can comprise a protective glass. In an advantageous development of the invention, the entire display area is designed as a touchscreen.Preferably, the display area has at least in regions a display means which is configured to display the user input registered by the operating element, in particular the parameter of the multimedia content changed thereby, in particular in the form of graphical information. The display means can be configured to display a graphical representation of the operating element, for example of the rotary head, as graphical information. The display means can be arranged in an environment around the operating element, which improves the clarity of operation of the multimedia operating device. Preferably, the display means is configured at least as part of the display layer of the touchscreen.In particular, the multimedia operating device has a pole plate which is designed to align the magnetic field generated by the magnet of the operating element with the sensor assigned to the operating element. Preferably, at least one operating element has a pole plate, in particular when the operating element is designed as a rotary regulator. Further developments of the invention can provide that each operating element has a pole plate. The pole plate can be assigned to at least one sensor. As a result, the magnetic field generated by the magnet of the operating element should, if possible, only reach the sensor assigned to the operating element. For a similar purpose, the multimedia operating device can have, in particular in the display area, at least one magnetic permeability element, in particular a permeability plate, which is arranged in particular on the side of the display area facing away from the operating element, in order to align the magnetic field generated by the magnet of an operating element to the sensor assigned to the operating element. The magnetic permeability element can be arranged as a shielding plate in the vicinity of the sensor, in particular on the printed circuit board.In particular, the multimedia operating device has at least one electromagnetic interference sensor which is designed to detect, in particular, electromagnetic interference influences on the magnetic field detected by the sensor. The interference sensor is thus not assigned to an operating element, but rather detects substantial interference influences which, in the sense of the invention, are not attributable to a magnet of an operating element, but are caused by external sources, such as other electromagnetic transmitters, for example external permanent magnets, in particular supply lines or high-voltage lines which are not sufficiently shielded. The interference sensor can be designed to convert the detected interference influences into electrical signals and transmit them to the evaluation unit. In particular, the electrical signal transmitted from the sensor to the evaluation unit can be processed with the electrical signal transmitted from the interference sensor to the evaluation unit in order to enable a more accurate evaluation of the user input.Preferably, the distance between the operating element and the sensor assigned to it is at least 16 mm, in particular in a direction normal to the surface of the multimedia operating device. The distance between the operating element and the sensor assigned to it can correspond to the thickness of the display area. Another essential parameter within the scope of the invention is the ratio between the distance between the operating elements and the distance between an operating element and the sensor assigned to it. An excessively short distance between the operating elements and / or an excessively long distance between the operating element and the sensor assigned to it in the sense of the invention can lead to the fact that, in the case of a plurality of operating elements, as a result of which even in the case of a plurality of magnets which each generate their own magnetic field, sensors also detect magnetic fields of magnets which are not assigned to them. This could interfere with the correct registration of the user input. However, too large a distance is to be avoided, since otherwise the magnetic field can no longer effectively overcome the large distance and can therefore no longer be detected by the sensor.In particular, the evaluation unit is designed for evaluating the received signals and for changing parameters of a digital signal processing of the multimedia operating device. The evaluation unit can thus have a microcontroller or a PC and / or be connected to such a microcontroller. The digital signal processing can be configured as part of the multimedia operating device. In particular, a transparent conductor track can be arranged in the display area, which connects the sensor to the evaluation unit, so that, in particular in the case of an existing display area, the vision of the user on the latter is possibly not obstructed by conductor tracks. For this purpose, the conductor tracks can be made of indium tin oxide. Further developments of the invention can provide that the connecting line connecting the sensor to the evaluation unit is arranged behind the display layer, as in a region thereof facing away from the user. In the region of the display region, the connecting line can be transparent.The evaluation unit is preferably designed to compensate for interference fields with respect to at least one sensor. A disturbance field in the sense of the invention is a magnetic field which is detected by a sensor, but is generated by a magnet other than by the magnet of the operating element assigned to the sensor. If two or more control elements are present, the magnetic fields generated by magnets of adjacent control elements are superimposed in particular. Thus, the sensor may not only detect the magnetic field generated by the operating element assigned to the sensor, but also the magnetic field of the operating element in its vicinity, which is not assigned to the sensor in this respect. The evaluation unit can be configured such that the compensation of the interference fields is based on all measurement values of the sensors, so that the influence of interference fields on the sensors can be determined in particular with the aid of a model. Since this interference effect is now known, it can be subtracted, for example, from the signal received overall from the sensor, which is also referred to as a raw signal in the sense of the invention, so that only the magnetic field of the magnet of the operating element assigned to the sensor remains, which is also referred to as a clean signal in the sense of the invention. From this, the user input can then be determined.The evaluation unit is preferably configured to compensate for interference fields with respect to the sensor in such a way that the compensation is effected on the basis of measured magnetic fields which originate from at least one operating element which is not assigned to the sensor. In particular, it is provided that the compensation takes into account magnetic fields which originate from magnets of all operating elements which are not assigned to the sensor. In the course of compensating the interference fields, it can be provided that the interference fields are determined and are calculated, in particular subtracted, with the raw signal determined by the sensor.The compensation of interference fields can be effected on the basis of a model, wherein the model is in particular dependent on a position and / or on a movement of an operating element not assigned to the sensor and the detection of the magnetic field detected thereby by the sensor. The model can be designed in such a way that this step is successively repeated with all operating elements not assigned to the sensor.The model can take account of the fact that there is an in particular linear relationship between the actually measured measurement signal of a sensor and the desired target signal actually generated by the operating element assigned to the sensor. In the sense of the invention, the model can take into account that the raw signal measured by the sensor corresponds to the sum of the target signal that is actually to be detected and the interference signal generated in particular by the interference fields. Furthermore, the model can take into account that there is a linear-functional relationship between the interference signal of a sensor, which corresponds to the interference field of a specific operating element not assigned to the sensor, and the target signal, which is generated by this operating element and is detected by the sensor assigned to this operating element. This can be taken into account in particular for all sensors and operating elements. The model preferably takes into account a linear relationship between the target signal of a sensor, which is generated, as stated, by the operating element assigned to the sensor, and at least one raw signal detected by a sensor, in particular the raw signals of all sensors.To compensate for the interference fields, the model can provide for the solution of a linear equation system. To simplify the compensation, the model can provide that predefined user inputs are carried out with at least one, in particular with all, operating elements, such as, for example, the setting of predefined angular alignments in the case of rotary controllers as operating elements. The model is preferably determined before the first startup of the multimedia operating device. This has the advantage that the multimedia operating device is directly ready for use and at the same time offers the possibility of removing influences of interference fields with the aid of the model from the (raw) signal which the sensor detects, in order to improve the accuracy of the multimedia operating device. During operation of the multimedia operating device, the model may be invariable in order to obtain a reproducible behavior in the compensation of the interference fields.In particular, the evaluation unit is configured such that the model can be changed during the operation of the multimedia operating device, in particular in the case of a movement of the operating element. This can improve the operation accuracy of the multimedia operation device. The model can provide that data of the touch sensor are used for compensating the interference fields. The evaluation unit can be configured such that a determination as to which operating element is actuated by the user input is made on the basis of the operating element that carries out the greatest change in movement. In a further embodiment of the invention, the model can be designed analytically in order to increase the process speed.The model can be designed as a trained neural network, wherein the compensation of interference fields is effected by feeding the neural network forwards with the magnetic field detected by the sensor. A trained neural network offers the advantage of simply optimizing the compensation of interference fields for the respectively prevailing application of the multimedia operating device and of continuing this, in particular continuously during the startup thereof.In particular, the neural network is trained by feeding the neural network back with the magnetic field from the operating element not assigned to the sensor. Training data can accordingly be the raw signal detected by the sensor and the interference signal from magnets of the operating element not assigned to the sensor.Further advantages and features of the invention are evident from the claims and the following description, in which exemplary embodiments of the invention are explained in detail. The following are shown: FIG. 1 shows a schematic longitudinal section through a multimedia operating device according to the invention with two operating elements and two sensors assigned to them, FIG. 2 shows a further multimedia operating device in a plan view.FIG. 1 shows a schematic side view of a multimedia operating device 1 according to the invention with digital signal processing, not shown in FIG. 1, and with a display area 2, of which a display sub-area 6 is shown. In the exemplary embodiment shown, the display region 2 is designed as a touchscreen and has a thickness of 16 mm. The display area 2 has, as seen from top to bottom, a cover glass 7 for protecting the multimedia operating device, including a layer 8 made of glass and the actual display layer 9 of the touchscreen 2. The layer 8 made of glass is provided with a touch sensor not shown in FIG. 1 and is therefore designed for the detection of touches of the display region 2 by the user. For this purpose, the touch sensor of the layer 8 is connected to a touch evaluation unit 10 via transparent conductor tracks made of indium tin oxide, which are not shown in FIG. 1, and which will be discussed further below. In this way, the signals of the touch sensor of the layer 8 are evaluated by the touch evaluation unit 10, so that user inputs on the display area 2 can be detected as a touchscreen. The display layer 9 is designed to display graphical information 21.On a side of the display area 2 facing the user, which faces upwards in FIG. 1, two control elements 3 are each inserted into the display area 2 via feet 11 and connected to the latter. The operating elements 3 are each rotatable about their direction of extension and movable translationally along their direction of extension, i.e. each configured as a combined rotating and pressing knob. The operating elements 3 each have two rod magnets 12 which extend substantially axially and generate a magnetic field. On their side facing the user, the bar magnets 12 are provided with a pole plate 13. For reasons of clarity, these features are only shown in connection with the control element 3 on the left in FIG. 1, but are also formed by the right control element 3.In a region of the display region 2 facing away from the operating elements 3 and facing downward in FIG. 1, a printed circuit board 14 of the multimedia operating device 1 is arranged, on which printed circuit board two sensors 4 are arranged, which are configured as Hall sensors. The sensors 4 are each located at the height of the operating element 3 assigned to them. The sensors 4 are configured separately from the display region 2, but are connected to the latter. The distance of a sensor 4 from the operating element 3 assigned to it, which approximately corresponds to the thickness of the display area 2, is approximately 16 mm.The arrangement of the sensors 4 relative to the operating elements 3 ensures that the magnetic field generated by the magnet of the operating element 3 penetrates the display region 2 of the multimedia operating device 1 and is detected by the sensor 4 assigned to the operating element 3. The sensors 4 are designed for detecting the magnetic field generated by the magnet of the operating element 3 in all three spatial directions, in particular for detecting field strength of approximately 1.2 mT, so that a vector-wise detection of the magnetic field takes place. To optimize the detection of the magnetic field, the sensors 4 are each surrounded by a shielding plate 15. The sensors 4 convert the three detected directional components of the magnetic field into a digital electrical signal which is transmitted by means of electrical connections, not shown in FIG. 1, on the printed circuit board 14 and by means of a connecting line 16 to an evaluation unit 17 arranged separately from the printed circuit board 14. The evaluation unit 17 evaluates the signals received from the sensors 4 to the effect that the current position and the current orientation of the operating elements 3 assigned to the sensors 4 are thereby deduced, wherein a change in the position and the orientation of the operating element 3 is also detected. The position, the change in the position, the alignment and the change in the alignment of the operating element 3 are each a user input within the meaning of the invention. In this respect, in the exemplary embodiment shown, both a rotational movement of the operating elements 3 and a pressing movement are detected by the sensors 4. On the basis of this, the evaluation unit 17 causes a parameter of a multimedia content, for example a video, to be changed by the user as a result of the user input. This is done by the digital signal processing already mentioned.The multimedia operating device 1 according to FIG. 1 is designed to detect touches of the operating elements 3 by the user. For this purpose, the operating elements 3 are each provided with an electrically conductive cap 18 as a touch sensor. When the user touches the cap 18, an electrical signal is transmitted via a transparent electrical connecting line 19, which extends axially through the operating element 3 and its foot 11 and is arranged below the cover glass 7 but above the layer 8 of glass on the latter, and via a further connecting line 20 outside the layer 8 to the touch evaluation unit 10 already mentioned and is evaluated there. Due to the transparency of the connecting line 19, in particular in the region of the layer 8, the gaze of the user on the displayed graphical information 21 of the display layer 9 is still enabled. The touch evaluation unit 10 is configured to activate an operating element 3 only upon a detected touch by the user and to enable it for an input. As long as the operating element 3 is not touched, it remains deactivated, so that no touch can be registered. For reasons of clarity, the features described above in connection with the touch sensor 18 are only illustrated with reference to the right-hand control element 3 in FIG. 1, but are also formed by the left-hand control element 3.The display area 2 of the multimedia device according to FIG. 1 is designed such that in an environment 5 adjacent to the operating elements 3, the parameter of the multimedia content to be changed by the operating element 3 is displayed as graphical information 21. Since the display region 2 is configured as a touchscreen, the parameter assigned to the operating element 3 can be changed by a corresponding input of the user, which is likewise displayed to the user by a corresponding item of information 21. The graphical information 21 is displayed by the display layer 9 as display means.In order to detect external magnetic fields which can interfere as disturbing influences with the magnetic fields of the magnets 12 to be registered, the evaluation unit 17 is connected to a disturbing sensor 22 arranged outside the same, which is designed to detect these external magnetic fields and transmits corresponding digital electrical signals to the evaluation unit 17 via an electrical connecting line.FIG. 2 shows a further embodiment of the multimedia operating device 1 with a total of eight operating elements 3, which are substantially analogous to the operating elements 3 of the embodiment according to FIG. 1, i.e. are each configured as a combined rotary and push button. In FIG. 2, the operating elements 3 are each arranged in a rectangular display sub-region 6 and are assigned to it. The eight display regions 6 are arranged in a two-dimensional 4x2 pattern, wherein the control elements 3 are arranged at equal distances in both directions oriented perpendicular to one another. The sensors 4 assigned to the operating elements 3 are covered in perspective by the operating elements 3 in FIG. 2, but are nevertheless arranged behind the operating elements 3 at the same height as the embodiment of FIG. 1. For clarity, the display subareas 6 are delimited from one another by dashed lines.The view of FIG. 2 schematically shows the already described electrical connection between the electrically conductive cap 18 as a touch sensor of the operating element 3 via the transparent electrical connecting line 18 arranged on the layer 8, which is shown in dashed lines in FIG. 2 for reasons of clarity, and the electrical connecting line 20 outside the display region 2 to the touch evaluation unit 10. However, each operating element is connected to the touch evaluation unit 10 by a respective dedicated transparent connecting line 18 and a respective dedicated connecting line 19.The display area 2 of the multimedia operating device 1 according to FIG. 2 is designed such that each display sub-area 6 is designed in an environment 5 of the operating element 3 assigned to the display sub-area 6 in each case for displaying graphical information 21, wherein the graphical information 21 corresponds to the parameter that can be changed by the operating element 3. In the present exemplary embodiment, this is represented by a type of a filling quarter circle, wherein the fill level corresponds to the currently set parameter value. If the user rotates the operating element 3 to the right, for example, the quarter circle fills, which corresponds to an increase in the parameter value, while he flushes on a rotation to the left and the parameter value is reduced. In this way, the user can recognize the currently set parameter value at a glance and, if necessary, correct it. It can thus be seen from the illustration in FIG. 2 that the parameter values assigned to the operating elements 3 are set differently.The evaluation unit 17 is designed to compensate for interference fields, so that the target signal to be used by the sensor 4, which is generated by the operating element 3 assigned to the sensor 4, is determined on the basis of the raw signal measured by a sensor 4. The compensation is effected on the basis of a model that takes into account a linear-functional relationship between the interference field of a sensor 4, which is caused by a specific operating element 3 not assigned to this sensor 4, and the target signal measured by this operating element 3 at the sensor 4 assigned to it. This consideration applies to all operating elements 3. With the further consideration that only the components of the magnetic fields are measured parallel to the surface of the display area 2, the compensation therefore takes place in two-dimensional space, a linear equation system results, the solution of which can be analytically detachable, but at least numerically detachable, in particular in the case of predefined positions of the operating elements 3. Solving the equation system results in the determination of the parameters of the model. On the basis thereof, the target signal, i.e. the magnetic field generated by a sensor 4 by the operating element 3 assigned to this sensor 4, can be determined taking into account the measured raw signals of the sensors 4.The model is determined with its parameters before the multimedia operating device 1 is put into operation. Alternatively, it is possible to set whether the model can be changed or can no longer be changed during startup.To determine the model parameters, in particular to solve the above-mentioned equation system, the model is designed as a trained neural network, wherein the interference fields are compensated by feeding the neural network forward with the magnetic field registered by the sensor 4, which is also referred to as a raw signal in the sense of the invention. The neural network is trained by feeding the neural network backward with the magnetic field of the operating element 3 not assigned to the sensor 4, i.e., with the interference field in the sense of the invention. In this way, the compensation can be optimized, in particular during the startup of the multimedia operating device 1.References included in the specificationThis list of documents cited by the applicant has been produced in an automated manner and is only included for the better information of the reader. The list is not part of the German patent application or utility model application. The DPMA does not take any adhesion for any faults or omissions.Patent Literature citedU.S. Pat. No. 9,310,901 B2
[0004]
Claims
Multimedia operating device (1) for processing a multimedia content by means of a user input, having at least one actuatable operating element (3) for receiving the user input, wherein the operating element (3) has at least one magnet (12) which is designed to generate a magnetic field, having at least one sensor (4) which is assigned to the operating element (3) and is designed to detect the magnetic field generated by the magnet (12) and to convert the magnetic field into an electrical signal, wherein the sensor (4) is connected to an evaluation unit (17) in order to transmit the electrical signal to the evaluation unit (17), wherein the evaluation unit (17) is designed to receive and evaluate the electrical signal of the sensor (4) in such a way that the user input is thereby registered and the multimedia content is processed.Multimedia operating device (1) according to Claim 1, characterized in that the at least one operating element (3) is movable with respect to at least one spatial axis.Multimedia operating device (1) according to Claim 2, characterized in that the at least one operating element (3) is movable parallel and / or perpendicular to the surface of the multimedia operating device (1) and / or is rotatable about its direction of extent.Multimedia operating device (1) according to one of Claims 1 to 3, characterized in that at least two, in particular at least ten, in particular at least twenty, operating elements (3) are provided.Multimedia operating device (1) according to Claim 4, characterized in that the operating elements (3) are arranged in a periodic pattern.Multimedia operating device (1) according to one of Claims 1 to 5, characterized in that the at least one operating element (3) has a touch sensor (19) for detecting a touch of the operating element (3) by the user, wherein the touch sensor (19) is connected in particular to a touch evaluation unit (10) of the multimedia operating device (1).Multimedia operating device (1) according to Claim 6, characterized in that the operating element (3) can be switched into an activated state or into a deactivated state as a function of a signal from the touch sensor (18) assigned to the operating element (3), wherein user inputs can be registered in the active state of the operating element (3) and no user inputs can be registered in the deactivated state of the operating element (3).Multimedia operating device (1) according to one of Claims 1 to 7, characterized in that the user input is at least one element from the following group: current orientation of the operating element (3), change in the orientation of the operating element (3), current position of the operating element (3), change in the position of the operating element (3).Multimedia operating device (1) according to one of Claims 1 to 8, characterized in that the magnet (12) is designed as a permanent magnet and / or is arranged in such a way that the magnetic field generated by the magnet (12) is aligned with the sensor (4).Multimedia operating device (1) according to one of Claims 1 to 9, characterized in that the sensor (4) is designed as a magnetoresistive sensor, in particular as a Hall sensor, and / or is designed for detecting at least one, in particular at least two, preferably three, directional components of the magnetic field.Multimedia operating device (1) according to one of Claims 1 to 10, characterized in that the multimedia operating device (2) has a display region (2), wherein the at least one operating element (3) is arranged on or in or above the display region (2) and / or wherein the sensor (4) assigned to the operating element is arranged on or behind the display region (2).Multimedia operating device (1) according to Claim 11, characterized in that the display region (2) has a touchscreen at least in regions and / or is provided with a protective layer (7), in particular on the side facing the operating element (3).Multimedia operating device (1) according to either of Claims 11 and 12, characterized in that the display region (2) has, at least in regions, a display means (9) which is designed to display the user input registered by the operating element (3), in particular the parameter of the multimedia content which is changed as a result, in particular in the form of graphical information (21).Multimedia operating device (1) according to one of Claims 1 to 13, characterized byat least one pole plate (13) which is designed to align the magnetic field generated by the magnet (12) of the operating element (3) with the sensor (4) assigned to the operating element (3).Multimedia operating device (1) according to one of Claims 1 to 14, characterized byat least one electromagnetic interference sensor (22) which is designed to detect interference influences on the magnetic field detected by the sensor (4).Multimedia operating device (1) according to one of Claims 1 to 15, characterized in that the distance between the operating element (3) and the sensor (4) assigned to it, in particular in a direction normal to the surface of the multimedia operating device (1), is at least 16 mm.Multimedia operating device (1) according to one of Claims 1 to 16, characterized in that the evaluation unit (17) is designed to evaluate the received signal of the sensor (4) and to change parameters of digital signal processing of the multimedia operating device (1).Multimedia operating device (1) according to one of Claims 1 to 17, characterized in that, in particular in the display region (2), an in particular transparent conductor track (16) is arranged, which connects the sensor (4) to the evaluation unit (17).Multimedia operating device (1) according to one of Claims 1 to 18, characterized in that the evaluation unit (17) is designed to compensate for interference fields with respect to at least one sensor (4).Multimedia operating device (1) according to claim 19, characterised in that the evaluation unit (17) is designed to compensate for interference fields with respect to the sensor (4) in such a way that the compensation on the basis of influences, in particular of magnets (12), originates from at least one operating element (3) which is not assigned to the sensor (4).Multimedia operating device (1) according to either of Claims 19 and 20, characterized in that the interference fields are compensated on the basis of a model, the model being in particular dependent on a movement of an operating element (3) not assigned to the sensor (4) and on the detection of the magnetic field registered by the sensor (4) as a result.Multimedia operating device (1) according to Claim 21, characterized in that the model is determined before the first startup of the multimedia operating device (1) and can be changed in particular during the operation of the multimedia operating device (1).Multimedia operating device (1) according to one of claims 21 or 22, characterised in that the evaluation unit (17) is designed in such a way that the model can be changed during the operation of the multimedia operating device (3), in particular in the case of a movement of the operating element (3).Multimedia operating device (1) according to one of Claims 21 to 23, characterized in that the model is designed as a trained neural network, interference fields being compensated by feeding the neural network forwards with the magnetic field registered by the sensor (4).Multimedia operating device (1) according to Claim 24, characterized in that the training of the neural network is effected by feeding the neural network back with the magnetic field of the operating element (3) not assigned to the sensor (4).
Citation Information
Patent Citations
Sensor for motor vehicle has reference sensor for recording and monitoring of variable disturbance of sensor and by recording variable disturbance of measuring signal of sensor, system is put in secure and given state
DE102005010692A1
Method and arrangement for determining the position of a magnetic body using magnetic field sensors
DE102015203686A1
Arrangement and method for providing a control element in a vehicle and vehicle with such an arrangement
DE102018217936A1