Multimedia operating device
By employing a magnetic field to transmit user input in multimedia control devices, the space constraints and operational limitations of existing designs are addressed, resulting in a more efficient and user-friendly device.
Patent Information
- Application Number
- PCT/EP2024/083613
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-01
- Filing Date
- 2024-11-26
- Publication Date
- 2025-06-05
AI Technical Summary
Existing multimedia control devices face challenges with space optimization due to the need for electrical signal generators and cables, which obstruct the display and limit the device's usability.
The use of a magnetic field to transmit user input from actuatable operating elements to sensors, eliminating the need for electrical connections and allowing sensors to be placed at a distance, thereby optimizing space usage.
This solution enables a compact design that preserves space for displays, improves usability by allowing haptic feedback, and reduces the risk of incorrect inputs in time-critical situations.
Smart Images

Figure EP2024083613_05062025_PF_FP_ABST
Abstract
Description
[0001] Multimedia control device
[0002] The invention relates to a multimedia operating device for editing multimedia content by means of user input.
[0003] Multimedia operating devices with operating elements, for example in the form of rotary controls, are known from the prior art and can be used to edit multimedia content. The rotary controls are usually used to control electrical signal transmitters in the form of incremental encoders, which convert actuation of the operating element by a user into a digital electrical signal which is then fed to an evaluation unit to change the desired parameter of the multimedia content. However, the electrical signal transmitters that are absolutely necessary in these designs take up valuable space in the multimedia operating device, which can then no longer be used for any other purpose. The same applies to the space required for the absolutely necessary electrical connection between the electrical signal transmitters and the evaluation unit.In particular, if the area surrounding the control element is to be used to display a parameter changed using the control element in order to make operation easier, this is not possible with known multimedia control devices due to the sensors and the cables assigned to them. A particular disadvantage of the space requirement is that the display of the multimedia control device is covered by the known control elements. There are also known multimedia control devices that register user input by means of a corresponding movement input on a touchscreen. However, due to the lack of haptic feedback during user input, these multimedia control devices are difficult and not intuitive to use.This disadvantage is particularly significant in time-critical operating situations, such as live concerts, where the need for quick inputs means the user cannot always keep an eye on the multimedia control device to check the operation. The cumbersome operation via touchscreen can therefore lead to incorrect inputs.
[0004] US 9 310 901 B2 discloses a multimedia device with operating elements which are provided with optical signal generators and send a light signal to sensors arranged on the surface of the multimedia operating element. A disadvantage is that the optical transmission path between the operating element and the sensor must always be free of obstacles and is therefore susceptible to contamination. Since the sensor must always be in direct visual contact with the operating element, the sensor is inevitably arranged on the side of the multimedia operating device facing the operating element. This has a disadvantageous effect on the space available for the other components of the multimedia operating device.The same disadvantage also exists when a purely electrical transmission path is provided between the control element and the sensor, since this also requires a corresponding amount of space on the side of the surface of the multimedia control device assigned to the control element. It is therefore the object of the invention to eliminate the aforementioned disadvantages of the prior art and, in particular, to develop a multimedia control device that optimizes the space required by the control elements without adversely affecting usability.
[0005] The object of the invention is achieved by a multimedia operating device with the features of claim 1. The multimedia operating device according to the invention is designed to process multimedia content by means of a user input and has at least one actuatable operating element for receiving the user input, wherein the operating element has at least one magnet which is designed to generate a magnetic field. The multimedia operating device has at least one sensor assigned to the operating element which is designed to detect the magnetic field generated by the magnet and to convert the magnetic field into an electrical signal, wherein the sensor is connected to an evaluation unit in order to transmit the electrical signal to the evaluation unit.The evaluation unit is designed to receive and evaluate the electrical signal from the sensor in such a way that the user input is registered and the multimedia content is processed.
[0006] A basic idea of the invention is that the use of a magnetic field to transmit the information of the user input entered via the control element to the sensor assigned to the control element results in simple, robust and, in particular, wireless signal transmission. In addition, it is no longer necessary to connect the sensor to the control element assigned to it via a cable; this eliminates in particular the need to form contacts and connections between the control element and the sensor. Also, the sensor no longer has to be located in the immediate vicinity of the control element assigned to it. By using the magnetic field for signal transmission, the sensor can be arranged at a distance from the control element assigned to it without an electrical line being required for transmission.This results in considerable space savings, particularly in the area surrounding the control element, and has the advantage that the area surrounding the control element remains available for other purposes, such as a display associated with the control element. This is not possible with conventional multimedia control devices.
[0007] For the purposes of the invention, multimedia content includes, for example, digital or analogue audio data or video data or metadata associated with these.
[0008] Preferably, the at least one control element is movable relative to at least one spatial axis. The control element is, in particular, movable one-dimensionally or two-dimensionally.
[0009] The at least one operating element can be movable parallel and / or perpendicular to the surface of the multimedia operating device and / or rotatable about its direction of extension. The operating element movable parallel to the surface of the multimedia operating device can be designed as a slide control. The operating element movable normal to the surface of the multimedia operating device can be designed as a push button and / or a key. The operating element rotatable about its direction of extension can be designed as a rotary knob. The two-dimensionally movable operating element can be designed as a flatly movable slide control or as a combination of a one-dimensional slide control with a push button. The at least one operating element can be movable continuously or between discrete positions in which it can be locked.For the movement options of the control element, several of the above-mentioned movement types can be combined with one another.
[0010] Preferably, at least two, in particular at least ten, in particular at least twenty operating elements are provided, wherein at least one sensor, in particular exactly one sensor, can be assigned to each operating element. In this respect, at least two sensors can be formed. In a further development of the invention, it can be provided that the multimedia operating device has at least two display sub-areas, to which at least one, in particular at least two operating elements can be assigned. Preferably, a maximum of 28 operating elements are assigned to each display sub-area. The display sub-areas can be arranged one above the other and / or next to one another. For example, three display sub-areas, each comprising a maximum of 28 operating elements, are arranged next to one another and one above the other, thus in a 3x3 pattern. Preferably, a maximum of 28, in particular a maximum of 48, preferably a maximum of 1200 operating elements are provided.
[0011] Preferably, the control elements are arranged in a periodic pattern, i.e., at regular intervals from one another. The pattern can be one-dimensional or two-dimensional, and in the latter case, can have different periods in different spatial directions. In an advantageous development of the invention, the control elements are arranged in a rectangular pattern. Since the signal transmission between the control element and the sensor assigned to it does not require electrical contacts and / or electrical connections, the arrangement of the control elements on the multimedia control device can be freely selected.
[0012] The at least one operating element can have a touch sensor for detecting a touch of the operating element by the user, wherein the touch sensor is in particular connected to a touch evaluation unit of the multimedia operating device. The touch sensor can be designed as a capacitive touch sensor and / or comprise an electrically conductive cap which can be arranged on the operating element. In particular, the touch sensor is connected to the touch evaluation unit via a conductor track, in particular a transparent connecting line, wherein the conductor track can be made of indium tin oxide. In one development of the invention, the touch sensor is connected wirelessly to the touch evaluation unit. In one development of the invention, it can be provided that the evaluation unit is also designed as a touch evaluation unit.Alternatively, the touch evaluation unit can be designed separately from the evaluation unit. Further developments of the invention can provide that the touch evaluation unit is designed to detect touches on the display area, which, as mentioned, can be designed as a touchscreen. In this respect, the touch evaluation unit can be connected to the display area, in particular to its glass layer. Preferably, the operating element can be switched into an active state or a deactivated state depending on a signal from the touch sensor assigned to the operating element, wherein user inputs can be registered in the active state of the operating element and no user inputs can be registered in the deactivated state of the operating element.The evaluation unit can be designed in such a way that signals from a sensor are only registered and processed further when the operating element assigned to the sensor is in an active state. This ensures that only signals from an operating element actually touched by the user are recorded and passed on, which avoids incorrect inputs and enables more efficient operation of the multimedia operating device. In particular, it can be provided that the operating element is only switched to the active state when the touch sensor registers a touch of the operating element by the user. Furthermore, it can be provided that if the touch sensor of the operating element does not register a touch of the operating element by the user, the operating element is switched to the deactivated state.The control element can be designed to change at least one parameter, in particular at least two parameters of the multimedia content.
[0013] The user input is preferably at least one element from the following group: current orientation of the operating element, change in the orientation of the operating element, current position of the operating element, change in the position of the operating element. The magnet can be designed as a permanent magnet and / or arranged such that the magnetic field generated by the magnet is aligned with the sensor. In this respect, the magnetic field generated by the magnet can be inhomogeneous and / or anisotropic. The at least one operating element can have at least two magnets in order to be able to detect an actuation of the operating element by the user, and thus the user input, more easily by the sensors. The operating element preferably has two magnets. In one development of the invention, the magnet is designed as a bar magnet.
[0014] The sensor is preferably designed as a magnetoresistive sensor, in particular as a Hall sensor, which is also referred to as a Hall sensor or Hall probe. Magnetoresistive sensors in the sense of the invention are sensors that detect a magnetic field by measuring an electrical resistance. Hall sensors have advantages over coils in that even temporally constant magnetic fields can be detected and, moreover, that no ferromagnetic materials are required to detect the magnetic field. Further developments of the invention can provide for the sensor to be designed as an AMR sensor, in which the magnetic field can be detected by taking the anisotropic magnetic effect (AMR effect) into account. The sensor can be designed as a giant magnetoresistance sensor, which is also referred to as a GMR sensor and in which the magnetic field is detected taking the giant magnetoresistance effect (GMR effect) into account.The sensor can also be designed as a fluxgate sensor, which is also referred to as a fluxgate magnetometer. Alternatively or additionally, it can be provided that the sensor is designed to detect at least one, in particular at least two, preferably at least three directional components of the magnetic field generated by the magnet. The directional components of the magnetic field detected by the sensor can be stored for the subsequent evaluation of the sensor signal, in particular in the form of a vector, which can be evaluated to register the user input. In this respect, the vector of the sensor signal can serve as a basis for registering the position and / or the orientation of the operating element, for example the current rotational position or a changed angle of rotation of the operating element. In this respect, the sensor can be designed for vector-wise detection of the magnetic field.The electrical signal generated by the sensor can be analog or digital. The sensor can be designed to detect magnetic fields of up to approximately 15 mT, in particular up to 10 mT, preferably up to 1.2 mT. At least one sensor, preferably all sensors, can be arranged on a circuit board of the multimedia operating device, which can be arranged in a region of the display area facing away from the user. The circuit board can be connected to the display area.
[0015] The multimedia operating device preferably has at least one display area which can be designed to display information. As already mentioned, the display area can have at least one, in particular a plurality of partial display areas. The at least one operating element can be arranged on, in or above the display area, i.e. in an area of the display area facing the user. If there are several display areas, it can be provided that each operating element is assigned a display area, in particular a partial display area. Alternatively or additionally, it can be provided that the at least one sensor is arranged on and / or behind the display area, i.e. in an area of the display area facing away from the user. In an advantageous embodiment of the invention, the operating element is arranged on the display area, on the side facing the user, and is in contact with it.In an advantageous embodiment of the invention, the at least one sensor is arranged behind the display area, on the side facing away from the user, and / or can be in contact with the display area. In a further embodiment of the invention, it can be provided that the display area is functionally divided, namely into an area facing the user, which is assigned to the operating element and the receipt of the user input, and an area facing away from the user, which is assigned to the detection of the magnetic field, its conversion into an electrical signal and its further processing. The sensor can be designed separately from the display area. The magnet is preferably designed such that the magnetic field generated by the magnet penetrates the display area.At least 50%, in particular at least 75%, preferably at least 96%, most preferably the entire surface of the multimedia operating device can be designed as a display area, wherein the information relates to the area visible from the outside, which is therefore not covered in particular by the operating elements.
[0016] The display area can have a touchscreen at least in part and / or be provided with a protective layer, in particular on the side facing the operating element. As a touchscreen, the display area can have a cover glass facing the user as a protective layer, a layer of glass arranged underneath and a display layer. The layer of glass can have a touch sensor for detecting touches by the user. The display layer can be designed to show graphic information. By designing the display area as a touchscreen, the receipt of further user inputs directly on the display area is simplified, which improves the operating options of the multimedia operating device, without at the same time having to forego haptic feedback from user inputs that are critical for editing the multimedia content as a result of the actuatable operating element.At the same time, the display area can be configured to display parameters that are to be changed, in particular, by user input. In this respect, the display area can be configured as a display with a touch function. The protective layer provides protection, in particular against mechanical damage to the multimedia operating device, in particular to the display area, wherein the protective layer can comprise a protective glass. In an advantageous development of the invention, the entire display area is configured as a touchscreen.
[0017] The display area preferably has, at least in some areas, a display means which is designed to display the user input registered by the operating element, in particular the parameter of the multimedia content changed thereby, in particular in the form of graphic information. The display means can be designed to display a graphic representation of the operating element, for example the rotary head, as graphic information. The display means can be arranged in an environment around the operating element, which improves the clarity of operation of the multimedia operating device. The display means is preferably designed at least as part of the display layer of the touchscreen.
[0018] In particular, the multimedia operating device has a pole plate which is designed to align the magnetic field generated by the magnet of the operating element with the sensor assigned to the operating element. Preferably, at least one operating element has a pole plate, in particular when the operating element is designed as a rotary control. Further developments of the invention can provide that each operating element has a pole plate. The pole plate can be assigned to at least one sensor. As a result, the magnetic field generated by the magnet of the operating element should, if possible, reach only the sensor assigned to the operating element.For a similar purpose, the multimedia operating device can have at least one magnetic permeability element, in particular a permeability plate, in particular in the display area, which is arranged in particular on the side of the display area facing away from the operating element in order to direct the magnetic field generated by the magnet of an operating element onto the sensor assigned to the operating element. The magnetic permeability element can be arranged as a shielding plate in the vicinity of the sensor, in particular on the circuit board.
[0019] In particular, the multimedia operating device has at least one electromagnetic interference sensor which is designed to detect, in particular, electromagnetic interference on the magnetic field detected by the sensor. The interference sensor is therefore not assigned to an operating element, but rather detects significant interference which, within the meaning of the invention, cannot be attributed to a magnet of an operating element, but is caused by external sources, such as other electromagnetic transmitters, for example external permanent magnets, in particular insufficiently shielded supply lines or high-voltage lines. The interference sensor can be designed to convert the detected interference into electrical signals and transmit them to the evaluation unit.In particular, the electrical signal transmitted from the sensor to the evaluation unit can be processed with the electrical signal transmitted from the interference sensor to the evaluation unit in order to enable a more precise evaluation of the user input.
[0020] The distance between the operating element and the sensor assigned to it is preferably at least 16 mm, in particular in a direction normal to the surface of the multimedia operating device. The distance between the operating element and the sensor assigned to it can correspond to the thickness of the display area. A further important parameter within the scope of the invention is the ratio between the distance between the operating elements and the distance between an operating element and the sensor assigned to it. A distance between the operating elements that is too small within the meaning of the invention and / or a distance that is too large between the operating element and the sensor assigned to it can lead to sensors also detecting magnetic fields from magnets that are not assigned to them when there are several operating elements, and therefore also when there are several magnets that each generate their own magnetic field.This could interfere with the correct registration of user input. However, excessive distance should also be avoided, as otherwise the magnetic field will no longer be able to effectively overcome the great distance and thus cannot be detected by the sensor.
[0021] In particular, the evaluation unit is designed to evaluate the received signals and to change parameters of a digital signal processing system of the multimedia operating device. The evaluation unit can therefore have a microcontroller or a PC and / or be connected to one. The digital signal processing system can be designed as part of the multimedia operating device. In particular, a transparent conductor track can be arranged in the display area and connects the sensor to the evaluation unit so that, particularly if a display area is present, the user's view of the area is not obstructed by conductor tracks if possible. For this purpose, the conductor tracks can be made of indium tin oxide.Further developments of the invention may provide for the connecting line connecting the sensor to the evaluation unit to be arranged behind the display layer, i.e., in an area thereof facing away from the user. In the area of the display area, the connecting line may be transparent.
[0022] The evaluation unit is preferably designed to compensate for interference fields with respect to at least one sensor. In the sense of the invention, an interference field is a magnetic field that is detected by a sensor, but is generated by a different magnet than the magnet of the operating element assigned to the sensor. If two or more operating elements are present, the magnetic fields generated by magnets of adjacent operating elements in particular overlap. Thus, under certain circumstances the sensor detects not only the magnetic field generated by the operating element assigned to the sensor, but also the magnetic field of the operating element in its vicinity, which in this respect is not assigned to the sensor. The evaluation unit can be designed such that the compensation of the interference fields is based on all measured values of the sensors, so that the influence of interference fields on the sensors can be determined, in particular with the aid of a model.Since this interference is now known, it can, for example, be subtracted from the total signal received by the sensor, which is also referred to as the raw signal in the context of the invention, so that only the magnetic field of the magnet of the control element assigned to the sensor remains, which is also referred to as the pure signal in the context of the invention. From this, the user input can then be determined.
[0023] The evaluation unit is preferably designed to compensate for interference fields with respect to the sensor in such a way that the compensation is carried out on the basis of measured magnetic fields that originate from at least one operating element that is not assigned to the sensor. In particular, it is provided that the compensation takes into account magnetic fields that originate from magnets of all operating elements that are not assigned to the sensor. In the course of compensating for the interference fields, it can be provided that the interference fields are determined and offset against the raw signal determined by the sensor, in particular subtracted.
[0024] Compensation for interference fields can be based on a model, wherein the model is particularly dependent on the position and / or movement of an operating element not assigned to the sensor and the detection of the magnetic field thereby detected by the sensor. The model can be designed such that this step is successively repeated with all operating elements not assigned to the sensor.
[0025] The model can take into account that there is a particularly linear relationship between the actually measured measurement signal of a sensor and the desired target signal actually generated by the control element assigned to the sensor. In the sense of the invention, the model can take into account that the raw signal measured by the sensor corresponds to the sum of the target signal actually to be detected and the interference signal generated in particular by the interference fields. Furthermore, the model can take into account that there is a linear-functional relationship between the interference signal of a sensor, which corresponds to the interference field of a specific control element not assigned to the sensor, and the target signal generated by this control element and detected by the sensor assigned to this control element. This can be taken into account in particular for all sensors and control elements.Preferably, the model takes into account a linear relationship between the target signal of a sensor, which, as stated, is generated by the control element assigned to the sensor, and at least one raw signal detected by a sensor, in particular the raw signals of all sensors.
[0026] To compensate for the interference fields, the model can provide for the solution of a linear system of equations. To simplify the compensation, the model can provide for predefined user inputs to be made with at least one, in particular with all of the control elements, such as the setting of predefined angular orientations when rotary controls are used as control elements. The model is preferably determined before the multimedia control device is put into operation for the first time. This has the advantage that the multimedia control device is immediately ready for use and at the same time offers the option of removing influences of interference fields from the (raw) signal detected by the sensor with the help of the model in order to improve the accuracy of the multimedia control device. During operation of the multimedia control device, the model can be unchangeable in order to obtain reproducible behavior when compensating for the interference fields.
[0027] In particular, the evaluation unit is designed such that the model can be changed during operation of the multimedia operating device, particularly in the event of a movement of the operating element. This can improve the operating accuracy of the multimedia operating device. The model can provide for the use of data from the touch sensor to compensate for the interference fields.
[0028] The evaluation unit can be configured such that a determination of which control element is activated by the user input is made based on the control element that performs the greatest change in movement. In a further embodiment of the invention, the model can be configured analytically to increase the process speed.
[0029] The model can be designed as a trained neural network, with interference field compensation being achieved by forward-feeding the neural network with the magnetic field detected by the sensor. A trained neural network offers the advantage of easily optimizing interference field compensation for the respective predominant application of the multimedia control device, and of continuing to do so continuously during its commissioning.
[0030] In particular, the neural network is trained by backfeeding the neural network with the magnetic field from the control element not associated with the sensor. Training data can therefore be the raw signal detected by the sensor and the interference signal from magnets of the control element not associated with the sensor.
[0031] The multimedia operating device preferably comprises a multimedia processing device, in particular a mixing console. In a further embodiment of the invention, the multimedia operating device can be designed as a multimedia processing device, in particular as a mixing console.
[0032] Further advantages and features of the invention emerge from the claims and the following description, in which exemplary embodiments of the invention are explained in detail. In the following:
[0033] Fig. 1 shows a schematic longitudinal section through a multimedia operating device according to the invention with two operating elements and two sensors associated therewith,
[0034] Fig. 2 shows a further multimedia operating device in a top view.
[0035] Fig. 1 shows a schematic side view of a multimedia operating device 1 according to the invention with digital signal processing (not shown in Fig. 1) and with a display area 2, of which a partial display area 6 is shown. In the exemplary embodiment shown, the display area 2 is designed as a touchscreen and has a thickness of 16 mm. Viewed from top to bottom, the display area 2 has a cover glass 7 to protect the multimedia operating device, and below this a layer 8 made of glass and the actual display layer 9 of the touchscreen 2. The layer 8 made of glass is provided with a touch sensor (not shown in Fig. 1) and is therefore designed to detect touches of the display area 2 by the user. For this purpose, the touch sensor of the layer 8 is connected to a touch evaluation unit 10, which will be discussed further below, via transparent conductor tracks made of indium tin oxide (not shown in Fig. 1).In this way, the signals from the touch sensor of layer 8 are evaluated by the touch evaluation unit 10, so that user inputs can be recorded on the display area 2 as a touchscreen. The display layer 9 is designed to display graphic information 21.
[0036] On a side of the display area 2 facing the user, which faces upwards in Fig. 1, two operating elements 3 are each inserted into the display area 2 via feet 11 and connected to it. The operating elements 3 can each be rotated about their direction of extension and moved translationally along their direction of extension, i.e. they are each designed as a combined rotary and push button. The operating elements 3 each have two essentially axially extending bar magnets 12 which generate a magnetic field. On their side facing the user, the bar magnets 12 are provided with a pole plate 13. For reasons of clarity, these features are only shown in connection with the operating element 3 on the left in Fig. 1, but are also formed by the right-hand operating element 3.
[0037] In an area of the display area 2 facing away from the operating elements 3, which area points downwards in Fig. 1, there is a circuit board 14 of the multimedia operating device 1, on which two sensors 4 are arranged, which are designed as Hall sensors. The sensors 4 are each located at the height of the operating element 3 assigned to them. The sensors 4 are designed separately from the display area 2, but are connected to it. The distance between a sensor 4 and the operating element 3 assigned to it, which approximately corresponds to the thickness of the display area 2, is approximately 16 mm.
[0038] The arrangement of the sensors 4 relative to the operating elements 3 ensures that the magnetic field generated by the magnet of the operating element 3 penetrates the display area 2 of the multimedia operating device 1 and is detected by the sensor 4 assigned to the operating element 3. The sensors 4 are designed to detect the magnetic field generated by the magnet of the operating element 3 in all three spatial directions, in particular to detect field strengths of approximately 1.2 mT, so that a vector-wise detection of the magnetic field takes place. To optimise the detection of the magnetic field, the sensors 4 are each surrounded by a shielding plate 15. The sensors 4 convert the three detected directional components of the magnetic field into a digital electrical signal which is output by means of the signal converter shown in Fig.1 electrical connections (not shown) on the circuit board 14 and by means of a connecting line 16 to an evaluation unit 17 arranged separately from the circuit board 14. The evaluation unit 17 evaluates the signals received from the sensors 4 in such a way that the current position and the current orientation of the operating elements 3 assigned to the sensors 4 are deduced, wherein a change in the position and the orientation of the operating element 3 is also detected. The position, the change in position, the orientation and the change in the orientation of the operating element 3 are each a user input within the meaning of the invention. In this respect, in the exemplary embodiment shown, both a rotary movement of the operating elements 3 and a pressing movement are detected by the sensors 4.On this basis, the evaluation unit 17 initiates the change of a parameter of a multimedia content, for example, a video, which is to be changed by the user as a result of the user input. This is done by the aforementioned digital signal processing.
[0039] The multimedia operating device 1 according to Fig. 1 is designed to detect touches of the operating elements 3 by the user. For this purpose, the operating elements 3 are each provided with an electrically conductive cap 18 as a touch sensor. When the cap 18 is touched by the user, an electrical signal is transmitted via a transparent electrical connecting line 19, which extends axially through the operating element 3 and its base 11 and is arranged below the cover glass 7 but above the glass layer 8, and via a further connecting line 20 outside the layer 8 to the aforementioned touch evaluation unit 10 where it is evaluated. Due to the transparency of the connecting line 19, particularly in the area of layer 8, the user can still see the graphic information 21 shown on the display layer 9.The touch evaluation unit 10 is designed to activate an operating element 3 and enable it for input only when a touch by the user is detected. As long as the operating element 3 is not touched, it remains deactivated, so that no touch can be registered. For reasons of clarity, the features described above in connection with the touch sensor 18 are only shown with reference to the right-hand operating element 3 in Fig. 1, but are also implemented by the left-hand operating element 3.
[0040] The display area 2 of the multimedia device according to Fig. 1 is designed such that, in an environment 5 adjacent to the control elements 3, the parameter of the multimedia content to be changed by the control element 3 is displayed as graphic information 21. Since the display area 2 is designed as a touchscreen, the parameter assigned to the control element 3 can be changed by a corresponding input from the user, which is also displayed to the user by corresponding information 21. The graphic information 21 is displayed by the display layer 9 as the display means.
[0041] In order to detect external magnetic fields which can interfere with the magnetic fields of the magnets 12 to be recorded as interference, the evaluation unit 17 is connected to an interference sensor 22 which is arranged outside the same and is designed to detect these external magnetic fields and transmits corresponding digital electrical signals to the evaluation unit 17 via an electrical connecting line. Fig. 2 shows a further embodiment of the multimedia operating device 1 with a total of eight operating elements 3 which are designed essentially analogously to the operating elements 3 of the embodiment according to Fig. 1, in particular each is designed as a combined rotary and push button. In Fig. 2 the operating elements 3 are each arranged in a rectangular display sub-area 6 and assigned to this.The eight display areas 6 are arranged in a two-dimensional 4x2 pattern, with the operating elements 3 being arranged at equal distances in both mutually perpendicular directions. The sensors 4 assigned to the operating elements 3 are covered in perspective by the operating elements 3 in Fig. 2, but are nevertheless arranged at the same height behind the operating elements 3, similar to the design in Fig. 1. For reasons of clarity, the display sub-areas 6 are delimited from one another by dashed lines.
[0042] The view in Fig. 2 shows schematically the already described electrical connection between the electrically conductive cap 18 as a touch sensor of the operating element 3 via the transparent electrical connecting line 18 arranged on the layer 8, which is shown in dashed lines in Fig. 2 for reasons of clarity, and the electrical connecting line 20 outside the display area 2 with the touch evaluation unit 10. This is only shown as an example for the upper left operating element 3 in Fig. 2. However, each operating element is connected to the touch evaluation unit 10 with its own transparent connecting line 18 and its own connecting line 19. The display area 2 of the multimedia operating device 1 according to Fig.2 is designed in such a way that each display section 6 in an environment 5 of the control element 3 respectively assigned to the display section 6 is designed to display graphic information 21, wherein the graphic information 21 corresponds to the parameter that can be changed by the control element 3. In the present exemplary embodiment, this is represented by a type of filling quarter circle, wherein the fill level corresponds to the currently set parameter value. If, for example, the user turns the control element 3 to the right, the quarter circle fills up, which corresponds to an increase in the parameter value, whereas if it is turned to the left it empties and the parameter value is reduced. In this way the user can see the currently set parameter value at a glance and correct it if necessary. The representation in Fig.2 shows that the parameter values assigned to the control elements 3 are set differently.
[0043] The evaluation unit 17 is designed to compensate for interference fields, so that the target signal to be evaluated by a sensor 4, which is generated by the control element 3 assigned to the sensor 4, is determined on the basis of the raw signal measured by the sensor 4. The compensation is carried out using a model that takes into account a linear-functional relationship between the interference field of a sensor 4, which is caused by a specific control element 3 not assigned to this sensor 4, and the target signal measured by this control element 3 at the sensor 4 assigned to it. This consideration applies to all control elements 3.Taking further account of the fact that only the components of the magnetic fields parallel to the surface of the display area 2 are measured, and that compensation therefore takes place in two-dimensional space, this results in a linear system of equations whose solution can be solved analytically, particularly with predefined positions of the control elements 3, but is in any case numerically solvable. The solution to the system of equations results in the determination of the parameters of the model. Based on this, the target signal, i.e. the magnetic field generated by a sensor 4 by the control element 3 assigned to this sensor 4, can be determined taking into account the measured raw signals of the sensors 4.
[0044] The model and its parameters are determined before commissioning the multimedia control device 1. It is optionally possible to set whether the model can be changed or no longer changed during commissioning.
[0045] To determine the model parameters, in particular to solve the above-mentioned system of equations, the model is designed as a trained neural network, wherein the interference fields are compensated by forward feeding the neural network with the magnetic field registered by the sensor 4, which is also referred to as the raw signal within the meaning of the invention. The neural network is trained by backward feeding the neural network with the magnetic field of the control element 3 not assigned to the sensor 4, i.e., within the meaning of the invention, with the interference field. In this way, the compensation can be optimized, in particular during commissioning of the multimedia control device 1.
Claims
Patent claims 1. Multimedia operating device (1) for processing multimedia content by means of a user input, with at least one actuatable operating element (3) for receiving the user input, wherein the operating element (3) has at least one magnet (12) which is designed to generate a magnetic field, with at least one sensor (4) assigned to the operating element (3) which is designed to detect the magnetic field generated by the magnet (12) and to convert the magnetic field into an electrical signal, wherein the sensor (4) is connected to an evaluation unit (17) in order to transmit the electrical signal to the Evaluation unit (17), wherein the evaluation unit (17) is designed to receive and evaluate the electrical signal of the sensor (4) in such a way that the user input is registered and the multimedia content is processed.
2. Multimedia operating device (1) according to claim 1, characterized in that the at least one operating element (3) is movable with respect to at least one spatial axis.
3. Multimedia operating device (1) according to claim 2, characterized in that the at least one operating element (3) is movable parallel and / or perpendicular to the surface of the multimedia operating device (1) and / or rotatable about its direction of extension.
4. Multimedia operating device (1) according to one of claims 1 to 3, characterized in that at least two, in particular at least ten, in particular at least twenty operating elements (3) are provided.
5. Multimedia operating device (1) according to claim 4, characterized in that the operating elements (3) are arranged in a periodic pattern.
6. Multimedia operating device (1) according to one of claims 1 to 5, characterized in that the at least one operating element (3) has a touch sensor (19) for detecting a touch of the operating element (3) by the user, wherein the touch sensor (19) is in particular connected to a touch evaluation unit (10) of the multimedia operating device (1) is connected.
7. Multimedia operating device (1) according to claim 6, characterized in that the operating element (3) is controlled in dependence on a signal from the operating element (3) associated touch sensor (18) can be switched into an activated state or into a deactivated state, wherein in the active state of the operating element (3) user inputs can be registered and in the deactivated state of the operating element (3) no user inputs can be registered.
8. Multimedia operating device (1) according to one of claims 1 to 7, characterized in that the user input is at least one element from the following group: Current orientation of the operating element (3) , change in the orientation of the control element (3) , current position of the control element (3) , change in the position of the control element (3) .
9. Multimedia operating device (1) according to one of claims 1 to 8, characterized in that the magnet (12) is designed as a permanent magnet and / or is arranged such that the magnetic field generated by the magnet (12) is directed towards the sensor (4).
10. Multimedia operating device (1) according to one of claims 1 to 9, characterized in that the sensor (4) is designed as a magnetoresistive sensor, in particular as a Hall sensor, and / or is designed to detect at least one, in particular at least two, preferably three directional components of the magnetic field.
11. Multimedia operating device (1) according to one of claims 1 to 10, characterized in that the multimedia operating device (2) has a display area (2), wherein the at least one operating element (3) is arranged on or in or above the display area (2) and / or wherein the sensor (4) assigned to the operating element is arranged on and / or behind the display area (2).
12. Multimedia operating device (1) according to claim 11, characterized in that the display area (2) has at least in some areas a touchscreen and / or with a protective layer (7), in particular on the side facing the operating element (3).
13. Multimedia operating device (1) according to one of claims 11 or 12, characterized in that the display area (2) has, at least in some areas, a display means (9) which is designed to display the user input registered by the operating element (3), in particular the parameter of the multimedia content changed thereby, in particular in the form of graphic information (21).
14. Multimedia operating device (1) according to one of claims 1 to 13, characterized by at least one pole plate (13) which is designed to align the magnetic field generated by the magnet (12) of the operating element (3) with the sensor (4) assigned to the operating element (3).
15. Multimedia operating device (1) according to one of claims 1 to 14, characterized by at least one electromagnetic interference sensor (22) which is designed to detect interference influences on the magnetic field detected by the sensor (4).
16. Multimedia operating device (1) according to one of claims 1 to 15, characterized in that the distance between the operating element (3) and the sensor (4) associated therewith, in particular in a direction normal to the surface of the multimedia operating device (1), is at least 16 mm.
17. Multimedia operating device (1) according to one of claims 1 to 16, characterized in that the evaluation unit (17) is designed to evaluate the received signal of the sensor (4) and to change parameters of a digital signal processing of the multimedia operating device (1).
18. Multimedia operating device (1) according to one of claims 1 to 17, characterized in that in particular in the display area (2) a particularly transparent conductor track (16) is arranged, which connects the sensor (4) with the evaluation unit (17).
19. Multimedia operating device (1) according to one of claims 1 to 18, characterized in that the evaluation unit (17) is designed to compensate for interference fields with respect to at least one sensor (4).
20. Multimedia operating device (1) according to claim 19, characterized in that the evaluation unit (17) is designed to compensate for interference fields with respect to the sensor (4) in such a way that the compensation is based on influences, in particular from magnets (12), from at least one operating element (3) which is not assigned to the sensor (4).
21. Multimedia operating device (1) according to one of claims 19 or 20, characterized in that the compensation of interference fields is carried out on the basis of a model, wherein the model is in particular dependent on a movement of a sensor (4) not associated control element (3) and the detection of the magnetic field registered by the sensor (4).
22. Multimedia operating device (1) according to claim 21, characterized in that the model is determined before the first commissioning of the multimedia operating device (1) and in particular is unchangeable during operation of the multimedia operating device (1).
23. Multimedia operating device (1) according to one of claims 21 or 22, characterized in that the evaluation unit (17) is designed such that the model can be changed during operation of the multimedia operating device (3), in particular in the event of a movement of the operating element (3).
24. Multimedia operating device (1) according to one of claims 21 to 23, characterized in that the model is designed as a trained neural network, wherein the compensation of interference fields is carried out by forward feeding the neural network with the magnetic field registered by the sensor (4).
25. Multimedia operating device (1) according to claim 24, characterized in that the training of the neural network is carried out by back-feeding the neural network with the magnetic field of the operating element (3) not assigned to the sensor (4).
Citation Information
Patent Citations
Detecting a user input with an input device
US9310901B2
Rotation control method and device and computer readable storage medium
CN110086563A
Magnetic controller for device control
US20150370346A1
Non-contact rotary fader
US20190146748A1
Input device, controller, and error detection method
US20230321526A1