Transmitter device and receiver device for a projector

The transmitter device adapts pixel data streams for AR glasses using trajectory information, addressing the energy inefficiencies in current AR glasses by optimizing MEMS mirror operation, resulting in smaller, lighter, and more energy-efficient designs.

WO2025016820A1PCT designated stage expired Publication Date: 2025-01-23OQMENTED GMBH
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2024/069429
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-20
Filing Date
2024-07-10
Publication Date
2025-01-23

AI Technical Summary

Technical Problem

Current augmented reality (AR) glasses are often large, heavy, and have poor energy efficiency, leading to short battery life, necessitating the development of smaller, lighter, and more energy-efficient designs.

Method used

A transmitter device that calculates and adapts pixel data streams based on trajectory information, allowing for efficient projection of graphics using a bi-resonantly driven MEMS mirror, reducing the need for data processing in the receiver device and enabling independent implementation of transmitter and receiver systems.

Benefits of technology

This solution enables the production of more energy-efficient AR glasses by minimizing data processing in the receiver device and optimizing the operation of bi-resonant MEMS mirrors, resulting in smaller and lighter AR glasses with extended battery life.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2024069429_23012025_PF_FP_ABST
    Figure EP2024069429_23012025_PF_FP_ABST
Patent Text Reader

Abstract

The present invention relates to a transmitter device, a receiver device, a combination of transmitter and receiver device, an optical projector, glasses, and a method for providing a pixel data stream for a transmitter device, and to a method for receiving a pixel data stream.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Transmitter device and receiver device for a projector

[0002] The present invention relates to a transmitter device, a receiver device, a combination of transmitter and receiver device, an optical projector, glasses and a method for providing a pixel data stream for a receiver device and a method for receiving a pixel data stream.

[0003] Microelectromechanical systems (MEMS) can be used, in particular, to project content-laden graphics into the field of view of augmented reality glasses (AR glasses), mixed reality glasses (MR glasses), or virtual reality glasses (VR glasses). AR glasses allow something physically visible to be overlaid with digital content, i.e., graphics. MEMS mirrors are particularly used for this purpose. They are used to guide a light beam originating from a light source across a projection surface to illuminate it.

[0004] However, currently available AR glasses are often still relatively large, heavy, and have poor energy efficiency, resulting in short battery life. Against this backdrop, it is desirable to enable the production of smaller, lighter, or more energy-efficient AR glasses.

[0005] A MEMS mirror can be operated particularly energy-efficiently if it is mounted so that it can oscillate along two spatial axes and is driven resonantly, thus bi-resonantly, according to these spatial axes. A light beam reflected by the MEMS mirror then describes a trajectory along a Lissajous figure on a projection surface.

[0006] Against this background, it is an object of the present invention to enable the production of smaller, lighter or more energy-efficient AR glasses. This object is achieved by a transmitter device, in particular a transmitter device designed as a video source, for sending pixel data of a graphic described by means of digital graphic data, wherein the transmitter device has a first data memory or is connectable to the first data memory, wherein the transmitter device has a first calculation device, wherein the first calculation device is designed and configured such that the first calculation device, in the operating state of the transmitter device, accesses the graphic data that is at least temporarily stored on the first data memory or receives the graphic data from the first data memory, wherein the first calculation device is designed and configured such thatthat the first calculation device calculates pixel data with a first pixel data sequence from the received graphics data in the operating state of the transmitter device, wherein the transmitter device has a first data communication interface, wherein the first data communication interface is designed, configured and connected to the first calculation device such that the first data communication interface sends the pixel data as a pixel data stream with the first pixel data sequence as a temporal data sequence of the pixel data in the operating state of the transmitter device, wherein the first data communication interface is additionally designed and configured such that the first data communication interface receives trajectory information data in the operating state of the transmitter device, wherein the transmitter device is designed and configured such thatthat the first calculation device, in the operating state of the transmitter device, determines the first pixel data sequence used for the pixel data stream as a function of the received trajectory information data.,

[0007] This makes it possible to perform many or all of the pixel data stream adjustments relevant for the subsequent optical projection of the graphic in the transmitter device, so that only a few or no data processing steps need to be performed in a receiver device corresponding to the transmitter device. The pixel data stream can therefore be adapted in the receiver device to any special features of an optical projector located further downstream in the data stream.

[0008] Since the information exchange between transmitter device and receiver device is possible bi-directionally via the first data communication interface, transmitter device and receiver device can in particular also be implemented on separate integrated systems.

[0009] The graphic can, in particular, be at least a two-dimensional graphic. Alternatively, it can also be a one-dimensional graphic. A pixel data stream, within the meaning of the present invention, is understood to be a series of pixel data that can be transmitted in a defined temporal sequence—the pixel data sequence. The term "pixel data" encompasses the digital information associated with the pixels of the displayable graphic. A pixel data point within the pixel data stream can, for example, contain information about the RGB colors of an individual pixel of the graphic. Within the meaning of the present application, a pixel is a two-dimensional surface element that covers a fraction of the displayable graphic.The area element can be a pixel of a Cartesian grid, but it can also have other shapes; in particular, it can be a surface element that extends with two opposite side lines parallel to the trajectory of a Lissajous figure. Furthermore, the pixels can be homogeneous as a whole, i.e., all have the same size, but the pixels can also be inhomogeneous, i.e., have different sizes.

[0010] Trajectory information data is data from which a specific trajectory in a three-dimensional, two-dimensional, or one-dimensional space can be derived and, in particular, predicted. For example, trajectory information data can be present as a tuples or triples of real or integer numbers, or as a series of tuples or triples of real or integer numbers, such that each tuple or triple contains the data necessary for the specific determination of the trajectory with respect to a predefined coordinate system (e.g., Cartesian or polar). The predefined coordinate system can, in particular, be a parametric representation of Lissajous figures, such that a specific Lissajous figure and, if applicable, also a specific position on this Lissajous figure can be uniquely determined by specifying a finite number of parameters—in the sense of coordinates.This predefined coordinate system can, in particular, be designed such that six or seven parameters are sufficient to unambiguously determine the Lissajous figure and the position on the Lissajous figure. Such a coordinate system spans the Lissajous space.

[0011] The trajectory information data can, in particular, be configured such that a trajectory representing a Lissajous figure on a projection surface can be predicted from the trajectory information data. In particular, the first calculation device can be configured and set up such that, based on the obtained trajectory information data, it predicts a trajectory, in particular a trajectory representing a Lissajous figure on a projection surface.If a projector with which the light beam is projected onto the projection surface has, for example, a fixed laser and a MEMS mirror, wherein the laser beam of the laser is directed onto the MEMS mirror and is reflected by it onto the projection surface, the trajectory information data can comprise data from which the temporal course of the position of the MEMS mirror is initially derived, since this position also results in the temporal course of the trajectory of the laser beam on the projection surface.

[0012] The trajectory information data can in particular be designed such that they have values ​​for one or more of the following parameters or these values ​​can be derived from the trajectory information data: frequency of an oscillation of a MEMS mirror with respect to a first oscillation axis of the MEMS mirror; amplitude of the oscillation of the MEMS mirror with respect to the first oscillation axis of the MEMS mirror; frequency of an oscillation of the MEMS mirror with respect to a second oscillation axis of the MEMS mirror, wherein the second oscillation axis is preferably arranged perpendicular to the first oscillation axis; amplitude of the oscillation of the MEMS mirror with respect to the second oscillation axis of the MEMS mirror; a phase shift between the oscillation of the MEMS mirror with respect to the first oscillation axis and the oscillation of the MEMS mirror with respect tothe second oscillation axis; a phase of the trajectory and a corresponding time point, preferably the instantaneous phase of the trajectory.

[0013] For the purposes of the present invention, a graphic is understood to mean, in particular, a two-dimensionally representable image or a moving image, hence a video. In other words, a graphic is a pictorial representation that is perceivable by the human eye. The dimension of a graphic, for the purposes of the present application, is the spatial dimension of the pictorial representation relative to the three-dimensional space perceivable by humans.

[0014] For the purposes of the present application, digital graphic data includes, for example, data in RAW, MPEG4 (in particular MP4), WMV, AVI, HTML5 or AVCHD format.

[0015] A calculation device is generally understood to be a hardware and / or software unit with which mathematical calculations can be carried out.

[0016] In particular, the first calculation device can be designed as a hardware unit and comprise a processor. According to one embodiment of the transmitter device according to the invention, the transmitter device is additionally designed and configured such that, in the operating state of the transmitter device, the first calculation device calculates the pixel data as a function of the received trajectory information data. Consequently, both the pixel data and the associated pixel data sequence are calculated as a function of the received trajectory information data. This is used, for example, when the graphic data is already available as pixel data of a raster graphic, but is converted by the first calculation device into a different pixel pattern, for example, a pixel pattern that follows a Lissajous figure.The graphic data then has an intrinsic pixel data sequence, namely a second pixel data sequence, in which the graphic, viewed spatially, is divided into pixels in a tile-like manner, which is traversed row-by-row and column-by-column fashion. Based on this, the first calculation device then calculates at least one new pixel data sequence, namely the first pixel data sequence, for example, following a Lissajous figure. In addition, the first calculation device can also calculate new pixel data, namely when the division of the graphic into pixels, on which the graphic data is based, is to be changed into a new division of the graphic, for example, from an originally homogeneous pixel division to an inhomogeneous pixel division.

[0017] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, the trajectory information data is received periodically, preferably with a constant time period predefined. According to another embodiment of the transmitter device according to the invention, the transmitter device is designed and configured such that the first data communication interface receives trajectory information data when requested to do so by a corresponding receiver device. In other words, the trajectory information data can thus be received adaptively.In particular, the transmitter device can be designed and configured such that the first data communication interface only receives trajectory information data when requested to do so by a corresponding receiver device. This can further improve energy efficiency, as it allows trajectory information data to be transmitted only when absolutely necessary for the configuration of the transmitter and receiver devices.

[0018] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, two temporally consecutive trajectory information data are received with a time interval of at least 1 millisecond and a maximum of 10 seconds. This preferably applies to each pair of temporally consecutive received trajectory information data.

[0019] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, two temporally consecutive trajectory information data are received with a time interval of at least 1 millisecond and a maximum of 1 second. This preferably applies to each pair of temporally consecutive received trajectory information data.

[0020] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, two temporally consecutive trajectory information data are received with a time interval of at least 1 millisecond and a maximum of 100 milliseconds. This preferably applies to each pair of temporally consecutive received trajectory information data.

[0021] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, two temporally consecutive trajectory information data are received with a time interval of at least 1 millisecond and a maximum of 50 milliseconds. This preferably applies to each pair of temporally consecutive received trajectory information data.

[0022] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, two temporally consecutive trajectory information data are received with a time interval of at least 1 millisecond and a maximum of 25 milliseconds. This preferably applies to each pair of temporally consecutive received trajectory information data.

[0023] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, two temporally successive trajectory information data are received with a time interval of at least 10 milliseconds and a maximum of 10 seconds from one another. This preferably applies to each pair of temporally successive received trajectory information data. According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, two temporally successive trajectory information data are received with a time interval of at least 10 milliseconds and a maximum of 1 second from one another. This preferably applies to each pair of temporally successive received trajectory information data.

[0024] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, two temporally consecutive trajectory information data are received with a time interval of at least 10 milliseconds and a maximum of 100 milliseconds from each other. This preferably applies to each pair of temporally consecutive received trajectory information data.

[0025] The smaller the time interval between two consecutively received trajectory information data, the greater the probability that deviations between the positions according to the received trajectory information and the actual positions will be small. At the same time, the greater the time interval between two consecutively received trajectory information data, the more energy-efficiently the transmitter device and receiver device can be operated. The time interval ranges mentioned above therefore each have a different weighting of these two contradictory advantages.

[0026] According to one embodiment of the transmitter device according to the invention, the transmitter device has a second calculation device, wherein the second calculation device is designed, configured, and connected to the first data communication interface such that, in the operating state of the transmitter device, the second calculation device calculates a trajectory of a light beam across a predefined projection surface depending on the trajectory information data received via the first data communication interface. This enables a calculation of the trajectory of the light beam on the transmitter device, so that the information about the trajectory does not have to be continuously provided to the transmitter device.

[0027] According to one embodiment of the transmitter device according to the invention, the second calculation device is designed and configured such that the second calculation device predicts the trajectory for future times. In particular, the second calculation device is designed and configured such that the second calculation device predicts the trajectory after an initial reception of trajectory information data, even independently of the reception of further trajectory information data. This makes it possible for trajectory information data to be transmitted or received only sporadically.

[0028] According to one embodiment of the transmitter device according to the invention, the first calculation device is designed, configured and connected to the second calculation device such that the first calculation device, in the operating state of the transmitter device, determines the first pixel data sequence as a function of the calculated trajectory, namely such that illuminating the predefined projection surface along the calculated trajectory and with the first pixel data sequence as a temporal sequence of the pixels imaged along the trajectory images the graphic on the predefined projection surface in a way that is visible to the human eye, wherein the second calculation device is preferably designed and configured such that the calculated trajectory represents a Lissajous figure, at least in sections, and preferably necessarily a Lissajous figure.This makes it possible to operate the transmitter device together with a bi-resonantly driven MEMS mirror without the need for a reorganization of the pixel data stream on the part of the receiver device.

[0029] Bi-resonant driving of a MEMS mirror means driving two orthogonal axes of the MEMS mirror, where both axes are driven within the respective resonance spectrum.

[0030] According to one embodiment of the transmitter device according to the invention, the second calculation device and the first calculation device are separate hardware devices, so that the first calculation device comprises a first processor or an integrated circuit and so that the second calculation device comprises a second processor separate from the first processor or the first integrated circuit or a second integrated circuit separate from the first processor or the first integrated circuit.

[0031] Alternatively, according to a further embodiment of the transmitter device according to the invention, the first calculation device and the second calculation device can be designed such that the first calculation device and the second calculation device both access a single processor for performing calculations. In particular, the first and second calculation devices can also be formed as a single piece.

[0032] The transmitter device as such can be designed in particular as a hardware and software component of a portable and radio-capable device, for example a mobile phone (smartphone) or a smartwatch.

[0033] According to one embodiment of the transmitter device according to the invention, the first calculation device is designed and configured such that, in addition to determining the pixel data sequence, the first calculation device also performs data processing processes, such as image processing processes, in particular brightness and / or contrast adjustments. As a result, the individual pixel data of the pixel data stream itself is processed, but not the temporal pixel data sequence. Consequently, corresponding data processing processes on the receiver device side become obsolete, which in particular allows the energy efficiency of the receiver device to be improved.

[0034] According to one embodiment of the transmitter device according to the invention, the first calculation device is designed and configured such that the first calculation device converts the graphic data into raster graphic data, and thus divides the graphic in two-dimensional Euclidean space into a rectilinear grid with pixel rows and pixel columns, provided that the graphic data is not already available as raster graphic data. In both cases, i.e. even if the graphic data is already available as raster graphic data, the first calculation device can be designed and configured such that the first calculation device calculates the pixel data stream with the pixel data and the first pixel data sequence from the pixel data of the Cartesian grid. In particular, a two-dimensional Cartesian grid can be read out following a trajectory in the form of a Lissajous figure, so that a projector whose projected light beam orA light point on a projection surface follows exactly this Lissajous figure and is fed with the pixel data determined from it in the temporal sequence of reading it out from the raster, and reproduces the same graphic on the projection surface as is stored in the raster graphic.

[0035] The first calculation device can in particular be designed and configured such that the calculated pixel data stream has a first pixel data sequence which does not correspond to a row-by-row or column-by-column reading of a raster graphic.

[0036] According to one embodiment of the transmitter device according to the invention, the first data communication interface is a hardware interface, in particular an interface designed as a single hardware interface, so that during operation of the transmitter device, the pixel data stream is sent via the same interface type (e.g., an HDMI interface) via which the trajectory information data is received. This allows the architectures of the transmitter device and the receiver device to be designed largely independently of one another—with the exception of the respective interface type.

[0037] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed as a combined hardware interface that combines interface types. For example, the first data communication interface can be designed as a combined wireless network interface for receiving data via WLAN and 5G.

[0038] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, the first data communication interface wirelessly transmits the pixel data stream and / or receives the trajectory information data as wirelessly transmitted data.

[0039] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed as a WLAN interface and / or Bluetooth interface and / or 5G-capable interface. These interface types are particularly suitable for arranging the transmitter device delocalized from the receiver device, for example, within a cloud system and / or on a central server and / or on a portable radio-capable device.

[0040] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed and configured such that, in the operating state of the transmitter device, the first data communication interface transmits the pixel data stream in a wired manner via a data transport channel and / or receives the trajectory information data as wired data via the data transport channel.

[0041] According to one embodiment of the transmitter device according to the invention, the first data communication interface is designed as an HDMI interface and / or VGA interface and / or Ethernet interface and / or DP interface and / or MIPI interface and / or DVI interface. These interface types are particularly suitable for implementing the transmitter device in close proximity to the receiver device, for example, as two components of one and the same device, such as AR glasses.

[0042] The object underlying the invention is also achieved by a receiver device, in particular a receiver device designed as a video sink, for receiving a pixel data stream, wherein the receiver device has a trajectory control device, wherein the trajectory control device is designed and configured such that the trajectory control device, in the operating state of the receiver device, calculates trajectory information data from a desired trajectory of a light beam on a predefined projection surface and / or determines trajectory information data from an actual trajectory of the light beam on the predefined projection surface, so that the coordinates of the desired trajectory and / or the actual trajectory as well as the temporal sequence of the coordinates can be read from the trajectory information data, wherein the receiver device has a second data communication interface,wherein the second data communication interface is designed, configured, and connected to the trajectory control device such that the second data communication interface transmits the trajectory information data in the operating state of the receiver device, wherein the second data communication interface is additionally designed and configured such that the second data communication interface receives a pixel data stream in the operating state of the receiver device, which comprises pixel data with a first pixel data sequence as a temporal data sequence of the pixel data, or in particular consists thereof.

[0043] The receiver device can be described as the counterpart to the transmitter device described above for transmitting the pixel data stream. The receiver device according to the invention makes it possible to shift most of the computational processes necessary for operating a bi-resonant MEMS mirror as a projector, which require a lot of energy and memory, to the transmitter device separate from the receiver device. This is achieved in particular by the fact that the receiver device makes it possible to provide the trajectory information data to a transmitter device via the same interface, namely the second data communication interface, via which the receiver device also receives the pixel data stream from the corresponding transmitter device.

[0044] A predefined projection surface is understood, in particular, to be a parameterizable surface whose parameterization is stored on the receiver device, in particular in the trajectory control device, so that it can be retrieved, or can be retrieved by the trajectory control device. This parameterized surface can correspond to a real projection surface, for example, the projection surface of AR glasses, so that the calculations performed in the trajectory control device are adapted to the real projection surface of the AR glasses. However, it can also deviate from the real projection surface, for example, due to slight curvatures of the real surface compared to an imaginary and stored flat projection surface.

[0045] According to one embodiment of the receiver device according to the invention, the second data communication interface is a hardware interface, in particular an interface designed as a single hardware interface, so that during operation of the receiver device, the pixel data stream is received via the same interface type (e.g., an HDMI interface) via which the trajectory information data is also sent. This allows the architectures of the transmitter device and the receiver device to be designed largely independently of one another—with the exception of the respective interface type.

[0046] According to one embodiment of the transmitter device according to the invention, the second data communication interface is designed as a combined hardware interface that combines different interface types. For example, the second data communication interface can be designed as a combined wireless network interface for receiving data via WLAN and 5G.

[0047] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, the trajectory information data is transmitted periodically, preferably with a constant time period predefined. According to a further embodiment of the receiver device according to the invention, the receiver device is designed and configured such that the second data communication interface transmits trajectory information data depending on a predefined limit value. The predefined limit value can, for example, be a value for a deviation between two temporally successive positions. In other words, the trajectory information data can thus be transmitted adaptively.In particular, the receiver device can be designed and configured such that the second data communication interface only transmits trajectory information data when the predefined limit is reached or exceeded. This can further improve energy efficiency, as it allows trajectory information data to be transmitted only when absolutely necessary for the configuration of the transmitter and receiver devices.According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, the trajectory information data is transmitted periodically, preferably with a constant time period predefined. The receiver device is additionally designed and configured such that the second data communication interface transmits trajectory information data depending on a predefined threshold value. Thus, periodically occurring communication is combined with an adaptive combination.

[0048] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, two temporally consecutive trajectory information data are transmitted with a time interval of at least 1 millisecond and a maximum of 10 seconds. This preferably applies to each pair of temporally consecutive transmitted trajectory information data.

[0049] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, two temporally consecutive trajectory information data are transmitted with a time interval of at least 1 millisecond and a maximum of 1 second. This preferably applies to each pair of temporally consecutive transmitted trajectory information data.

[0050] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, two temporally consecutive trajectory information data are transmitted with a time interval of at least 1 millisecond and a maximum of 100 milliseconds. This preferably applies to each pair of temporally consecutive transmitted trajectory information data.

[0051] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, two temporally successive trajectory information data are sent with a time interval of at least 1 millisecond and a maximum of 50 milliseconds from one another. This preferably applies to each pair of temporally successive sent trajectory information data. According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, two temporally successive trajectory information data are sent with a time interval of at least 1 millisecond and a maximum of 25 milliseconds from one another. This preferably applies to each pair of temporally successive sent trajectory information data.

[0052] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, two temporally consecutive trajectory information data are transmitted with a time interval of at least 10 seconds and a maximum of 100 milliseconds. This preferably applies to each pair of temporally consecutive transmitted trajectory information data.

[0053] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, two temporally consecutive trajectory information data are transmitted with a time interval of at least 10 milliseconds and a maximum of 1 second. This preferably applies to each pair of temporally consecutive transmitted trajectory information data.

[0054] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, two temporally consecutive trajectory information data are transmitted with a time interval of at least 10 milliseconds and a maximum of 100 milliseconds. This preferably applies to each pair of temporally consecutive transmitted trajectory information data.

[0055] The smaller the time interval between two consecutively transmitted trajectory information data, the greater the probability that deviations between the positions according to the transmitted trajectory information and the actual positions will be minimal. At the same time, the greater the time interval between two consecutively transmitted trajectory information data, the more energy-efficiently the transmitter device and receiver device can be operated. The time interval ranges mentioned above therefore each have a different weighting of these two contradictory advantages.

[0056] According to one embodiment of the receiver device according to the invention, the receiver device is designed and configured such that the second data communication interface sends trajectory information data of a desired trajectory of the light beam projected onto the projection surface.

[0057] According to one embodiment of the receiver device according to the invention, the receiver device is designed and configured such that the second data communication interface does not send any trajectory information data of an actual trajectory of the light beam projected onto the projection surface.

[0058] Thus, trajectory information data about the actual trajectory, which may be known, for example, to a trajectory control device of the receiver device, is not, or not necessarily, transmitted to the transmitter device. Instead, the transmitter device receives the trajectory information data of the desired trajectory from the receiver device, hence the desired values ​​for the parameters determining the trajectory of the light beam, so that the transmitter device is able to predict the trajectory of the light beam based on these desired values ​​for a longer period of time, independently of the receiver device. A continuous transmission of trajectory information data from the receiver device to the transmitter device is then unnecessary, which can significantly increase energy efficiency.

[0059] According to one embodiment of the receiver device according to the invention, the receiver device is designed and configured such that, in the operating state of the receiver device, the receiver device maintains the first pixel data sequence of the received pixel data stream unchanged, so that within the receiver device, only one pixel data stream with the first pixel data sequence as the temporal sequence of the pixel data is present. Consequently, only a buffer can be provided within the receiver device as memory, which is exclusively suitable for compensating latencies of the received pixel data stream. This thus enables an extremely energy-efficient design of the receiver device.

[0060] According to one embodiment of the receiver device according to the invention, the trajectory control device is designed and configured such that, in the operating state of the receiver device, the desired trajectory calculated by the trajectory control device represents a Lissajous figure on the predefined projection surface, at least in sections, preferably necessarily a Lissajous figure. This adapts the receiver device to the specific use of operating a bi-resonant MEMS mirror. By excluding other types of trajectories that do not at least partially correspond to a Lissajous figure, further computing capacity can be saved and thus energy efficiency can be increased.

[0061] According to one embodiment of the receiver device according to the invention, the receiver device has a third data communication interface, wherein the third data communication interface is designed and configured such that, during operation of the receiver device, the third data communication interface provides the pixel data stream with the first temporal pixel data sequence received from the second data communication interface as an RGB pixel data stream with the first pixel data sequence for a light source control unit. The receiver device can also be designed and configured such that, during operation of the receiver device, the trajectory control device determines control signals for a light source control unit as a function of the desired trajectory of the light beam on the predefined projection surface and provides them to a light source control unit via the third data communication interface.The third data communication interface therefore allows the receiver device to be coupled to an optical system.

[0062] According to one embodiment of the receiver device according to the invention, the trajectory control device of the receiver device is designed and configured such that, during operation of the receiver device, it provides, on the one hand, a control signal for a first axis of a MEMS mirror and a further control signal for a second axis of a MEMS mirror as a function of the trajectory information data of the actual trajectory and the trajectory information data of the desired trajectory and, on the other hand, receives one or more feedback signals from the MEMS mirror and determines trajectory information data of the actual trajectory of the light beam on the predefined projection surface from this one feedback signal or the multiple feedback signals.

[0063] According to one embodiment of the receiver device according to the invention, the second data communication interface and the trajectory control device are designed together as a partially integrated system. This enables an extremely compact and space-saving design. According to one embodiment of the receiver device according to the invention, the receiver device has a second data memory, wherein the second data memory is preferably designed as a buffer, wherein the second data memory is designed, configured, and connected to the second data communication interface such that the second data memory stores sections of the received pixel data stream exclusively temporarily, wherein the second data memory has a maximum storage capacity of 512 megabytes.

[0064] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 256 megabytes.

[0065] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 128 megabytes.

[0066] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 64 megabytes.

[0067] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 32 megabytes.

[0068] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 16 megabytes.

[0069] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 8 megabytes.

[0070] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 4 megabytes.

[0071] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 1 megabyte.

[0072] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 512 kilobytes.

[0073] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 256 kilobytes. According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 128 kilobytes.

[0074] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 64 kilobytes.

[0075] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 32 kilobytes.

[0076] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 16 kilobytes.

[0077] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 8 kilobytes.

[0078] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 4 kilobytes.

[0079] According to one embodiment of the receiver device according to the invention, the second data memory has a maximum storage capacity of 2 kilobytes.

[0080] According to one embodiment of the receiver device according to the invention, the second data memory has a storage capacity of a maximum of 1 kilobyte.

[0081] In general, the smaller the storage capacity of the data storage device, the lower the energy consumption of the receiver device and the greater its energy efficiency. This also allows for optimized chip manufacturing yield. At the same time, the greater the storage capacity of the data storage device, the greater the resilience of the receiver device to external interference during data transmission between the transmitter device and the receiver device. The above-mentioned embodiments therefore each involve a different weighting of the advantages in terms of energy and cost efficiency on the one hand, and resilience on the other.

[0082] According to one embodiment of the receiver device according to the invention, the second data memory has a storage capacity of at least 1 bit. According to another embodiment of the receiver device according to the invention, the second data memory has a storage capacity of at least 1 byte. According to another embodiment of the receiver device according to the invention, the second data memory has a storage capacity of at least 128 bytes. These lower limits can be combined with each of the previously described possible upper limits, resulting in corresponding intervals for the possible size of the storage capacity. According to one embodiment of the receiver device according to the invention, the second data memory has a storage capacity, wherein the storage capacity is designed such that a complete frame of the graphic to be displayed cannot be stored completely on the second data memory.

[0083] According to one embodiment of the receiver device according to the invention, the second data memory is the only or the largest data memory of the receiver device.

[0084] According to one embodiment of the receiver device according to the invention, the second data communication interface is a hardware interface, in particular an interface designed as a single hardware interface, so that during operation of the transmitter device, the trajectory information data is sent via the same interface type, for example, an HDMI interface, via which the pixel data stream is also received. As already described above, the architectures of the transmitter device and the receiver device can be designed largely independently of one another, with the exception of the respective interface type.

[0085] According to one embodiment of the transmitter device according to the invention, the second data communication interface is designed as a combined hardware interface that combines different interface types. For example, the second data communication interface can be designed as a combined wireless network interface for receiving data via WLAN and 5G.

[0086] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, the second data communication interface wirelessly transmits the trajectory information data and / or receives the pixel data stream as a wirelessly transmitted data stream.

[0087] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed as a WLAN interface and / or Bluetooth interface and / or 5G-capable interface. These interface types are particularly suitable—as already described above—for arranging a transmitter device delocalized from the receiver device, for example, within a cloud system and / or on a central server.

[0088] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed and configured such that, in the operating state of the receiver device, the second data communication interface sends the trajectory information data in a wired manner via a data transport channel and / or receives the pixel data stream as a wired data stream via the data transport channel.

[0089] According to one embodiment of the receiver device according to the invention, the second data communication interface is designed as an HDMI interface, VGA interface, or Ethernet interface. These interface types are particularly suitable—as already described above—for implementing a transmitter device in close proximity to the receiver device, for example, as two components of one and the same device, such as AR glasses.

[0090] The object underlying the invention is also achieved by a combination of a transmitter device according to the invention and a receiver device according to the invention, wherein the transmitter device and the receiver device can be operated in a common operating state. In particular, the transmitter device within the combination can be designed according to one of the previously described embodiments. In particular, the receiver device within the combination can be designed according to one of the previously described embodiments. Such a combination enables, for example, extremely energy-efficient operation of AR glasses.

[0091] According to one embodiment of the combination according to the invention, the first data communication interface and the second data communication interface are designed and configured such that, in the common operating state of the combination of transmitter device and receiver device, the first data communication interface sends the pixel data stream with the first pixel data sequence as a temporal data sequence of the pixel data to the second data communication interface and the second data communication interface receives the pixel data stream with the first pixel data sequence as a temporal data sequence of the pixel data, wherein the second data communication interface is designed, configured and connected to the trajectory control device such thatthat, in the operating state of the combination, the second data communication interface sends the trajectory information data to the first data communication interface, and the first data communication interface receives the sent trajectory information data. This allows all the information necessary for operating AR glasses to be exchanged between a transmitter device configured as a video source and a receiver device configured as a video sink.

[0092] According to one embodiment of the combination according to the invention, the combination is designed and configured such that data communication between the receiver device and the transmitter device in the joint operating state takes place exclusively via a single bidirectional data connection defined by the first data communication interface and the second data communication interface. This allows the architecture of the receiver device to be decoupled from the architecture of the transmitter device.

[0093] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, the first data communication interface sends the pixel data stream, the second data communication interface receives the pixel data stream, and provides it essentially directly via the third data communication interface. The receiver device is designed and configured such that data of the pixel data stream is buffered on the receiver device exclusively to compensate for data transmission latencies between the first data communication interface and the second data communication interface. This also enables a further increase in the energy efficiency of the receiver device.

[0094] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state of the combination, the receiver device regularly transmits a first synchronization signal to the transmitter device via the second data communication interface and the first data communication interface in addition to the trajectory information data, wherein the first calculation device is designed and configured such that the first calculation device calculates the pixel data and / or the first pixel data sequence as a function of the first synchronization signal or adapts a provision of the pixel data and / or the first pixel data sequence as a function of the first synchronization signal.The first calculation device can in particular be designed and configured such that the first calculation device reads out or derives position information data of a position on the projection surface from the first synchronization signal and the first calculation device calculates the pixel data and / or the first pixel data sequence depending on the position information data of the position or adapts a provision of the pixel data and / or the first pixel data sequence depending on the position information data of the individual position.

[0095] As a result, the pixel data stream sent by the transmitter device and the pixel data stream that can be provided or is provided by the receiver device are synchronized in time, minus the latency and propagation time of the data transmission of the pixel data stream between the transmission by the transmitter device and the provision by the receiver device. This makes it possible to achieve temporal synchronization of the transmitter device and the receiver device in a particularly simple manner. Consequently, regardless of possible latencies during transmission, the only pixel data that reaches the receiver device is precisely those that it needs to process in the next step, for example, forward to an optical projector. This minimizes buffering on the receiver device as much as possible; it is only necessary with a capacity that is sufficient to absorb the latencies of the transmission.Since temporal synchronization is achieved by adjusting the calculations of the pixel data stream within the transmitter device, this solution is also called source synchronization.

[0096] According to one embodiment of the combination according to the invention, the first synchronization signal is transmitted periodically to the transmitter device with a predefined period.

[0097] According to a further embodiment of the inventive combination, the first synchronization signal is transmitted adaptively, for example, when a predefined limit is reached or exceeded. The first synchronization signal can also be transmitted exclusively adaptively. Data transmission is considered adaptive within the meaning of the present invention, in particular, if it is event-driven or model-based.

[0098] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive first synchronization signals are transmitted with a time interval of at least 1 microsecond and a maximum of 10 seconds. This preferably applies to each pair of temporally consecutively transmitted first synchronization signals.

[0099] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive first synchronization signals are transmitted with a time interval of at least 1 microsecond and a maximum of 1 second. This preferably applies to each pair of temporally consecutively transmitted first synchronization signals.

[0100] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive first synchronization signals are transmitted with a time interval of at least 1 microsecond and a maximum of 100 milliseconds from each other. This preferably applies to each pair of temporally consecutively transmitted first synchronization signals.

[0101] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive first synchronization signals are transmitted with a time interval of at least 10 microseconds and a maximum of 10 seconds. This preferably applies to each pair of temporally consecutive first synchronization signals.

[0102] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive first synchronization signals are transmitted with a time interval of at least 10 microseconds and a maximum of 1 second. This preferably applies to each pair of temporally consecutively transmitted first synchronization signals.

[0103] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally successive first synchronization signals are transmitted with a time interval of at least 10 microseconds and a maximum of 100 milliseconds from each other. This preferably applies to each pair of temporally successive first synchronization signals.

[0104] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally successive first synchronization signals are transmitted with a time interval of at least 100 microseconds and a maximum of 10 seconds from one another. This preferably applies to each pair of temporally successive first synchronization signals. According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally successive first synchronization signals are transmitted with a time interval of at least 100 microseconds and a maximum of 1 millisecond from one another. This preferably applies to each pair of temporally successive first synchronization signals.

[0105] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, the transmitter device additionally regularly transmits a second synchronization signal to the receiver device via the first data communication interface and the second data communication interface, wherein the trajectory control device is designed and configured such that the trajectory control device determines the desired trajectory of the light beam on the projection surface (42) as a function of the second synchronization signal.In particular, the trajectory control device can be designed and configured such that the trajectory control device reads out or derives a position on the projection surface from the second synchronization signal position information data and the trajectory control device calculates the desired trajectory depending on the position information data of the position or adapts the provision of the desired trajectory depending on the position information data of the position.

[0106] This synchronizes the pixel data stream sent by the transmitter device and the pixel data stream that can be provided or is provided by the receiver device, minus the latency and runtime of the data transmission of the pixel data stream between the transmission by the transmitter device and the provision by the receiver device. This represents an additional, alternative, or redundant option for ensuring the temporally synchronous operation of the transmitter device and the receiver device. It is not the pixel data stream itself that is adjusted, but rather the control of the light source and thus the trajectory of the light spot generated by the light source on the projection surface.If, for example, it turns out that the projection of the graphic is lagging behind the pixel data stream, the light point can take a shortcut that deviates from the actual trajectory in order to return to a point on the projection surface where the projection and the pixel data stream used for it are temporally synchronized. Since temporal synchronization is achieved by adapting the trajectory calculations within the receiver device, this solution is also called sink synchronization. According to one embodiment of the inventive combination, the second synchronization signal is transmitted periodically to the receiver device with a predefined period.

[0107] According to a further embodiment of the combination according to the invention, the second synchronization signal is transmitted adaptively, for example, when a predefined limit is reached or exceeded. The second synchronization signal can, in particular, also be transmitted exclusively adaptively.

[0108] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive second synchronization signals are transmitted with a time interval of at least 1 microsecond and a maximum of 10 seconds. This preferably applies to each pair of temporally consecutively transmitted second synchronization signals.

[0109] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive second synchronization signals are transmitted with a time interval of at least 1 microsecond and a maximum of 1 second. This preferably applies to each pair of temporally consecutively transmitted second synchronization signals.

[0110] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive second synchronization signals are transmitted with a time interval of at least 1 microsecond and a maximum of 100 milliseconds. This preferably applies to each pair of temporally consecutively transmitted second synchronization signals.

[0111] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive second synchronization signals are transmitted with a time interval of at least 10 microseconds and a maximum of 10 seconds. This preferably applies to each pair of temporally consecutively transmitted second synchronization signals.

[0112] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive second synchronization signals are transmitted with a time interval of at least 10 microseconds and a maximum of 1 second. This preferably applies to each pair of temporally consecutively transmitted second synchronization signals.

[0113] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive second synchronization signals are transmitted with a time interval of at least 10 microseconds and a maximum of 100 milliseconds from each other. This preferably applies to each pair of temporally consecutively transmitted second synchronization signals.

[0114] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive second synchronization signals are transmitted with a time interval of at least 100 microseconds and a maximum of 10 seconds. This preferably applies to each pair of temporally consecutively transmitted second synchronization signals.

[0115] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, two temporally consecutive second synchronization signals are transmitted with a time interval of at least 100 microseconds and a maximum of 1 second. This preferably applies to each pair of temporally consecutively transmitted second synchronization signals.

[0116] According to one embodiment of the combination according to the invention, the combination is designed and configured such that, in the common operating state, both the calculation of the pixel data and the first pixel data sequence is carried out continuously as a function of the first synchronization signal, and the calculation of the target trajectory is carried out as a function of the second synchronization signal. Accordingly, both source synchronization and sink synchronization are performed.

[0117] According to one embodiment of the inventive combination, the first data communication interface and the second data communication interface are arranged on different integrated systems, in particular on different chips. According to one embodiment of the inventive combination, the first data communication interface and the second data communication interface are arranged spatially spaced from one another.

[0118] According to one embodiment of the combination according to the invention, the transmitter device and the receiver device are designed such that, in the common operating state, data from the transmitter device to the receiver device and data from the receiver device to the transmitter device in the operating state of the combination can be transmitted exclusively via a data connection defined by the first data communication interface and the second data interface.

[0119] According to one embodiment of the combination according to the invention, the data connection is an HDMI connection and / or a WLAN connection and / or a 5G connection.

[0120] According to one embodiment of the inventive combination, the transmitter device is integrated on a first semiconductor chip and the receiver device is integrated on a second semiconductor chip, wherein the first semiconductor chip and the second semiconductor chip are separate, in particular spatially spaced apart, semiconductor chips. This separation allows, in particular, the semiconductor chip on which the receiver device is integrated to be operated extremely energy-efficiently.

[0121] The object underlying the invention is also achieved by an optical projector for illuminating a predefined two-dimensional projection surface, wherein the projector comprises a receiver device according to one of the previously described embodiments, wherein the projector comprises a mirror arrangement with a mirror, in particular a MEMS mirror, wherein the mirror arrangement is designed such that the mirror is capable of oscillation with respect to a first spatial axis and with respect to a second spatial axis different from the first spatial axis, in particular with respect to a spatial axis oriented orthogonally to the first spatial axis, wherein the projector is designed and configured such that an oscillation of the mirror with respect to the first spatial axis can be driven resonantly and that an oscillation with respect to the second spatial axis can be driven resonantly, wherein the projector comprises a light source, preferably a laser or an LED lamp,The projector is designed and configured such that, in an operating state of the projector, an oscillation of the mirror with respect to the first spatial axis and an oscillation of the mirror with respect to the second spatial axis are each driven resonantly, and a light beam is projected from the light source onto the mirror and reflected by the mirror. This has the effect that a temporally extending trajectory of a finitely large light spot on a predefined projection surface caused by the light beam reflected by the mirror describes a Lissajous figure, at least in sections. In particular, the projector can be designed and configured such that a temporally extending trajectory of a finitely large light spot on a predefined projection surface caused by the light beam reflected by the mirror necessarily describes a Lissajous figure.

[0122] For the purposes of the present invention, a trajectory along a Lissajous figure is understood to mean a trajectory that essentially follows a mathematically defined Lissajous figure. This includes an error tolerance for the trajectory guidance. Deviations from the line of a strictly mathematically defined Lissajous figure, particularly those caused by external environmental influences, do not change the fact that it is nevertheless a trajectory along a Lissajous figure within the meaning of the present invention.

[0123] In particular, the projector can be designed and configured such that a mirror designed as a MEMS mirror is operated bi-resonantly in the operating state of the projector. In such a case, a light beam reflected by the MEMS mirror essentially describes a trajectory along a Lissajous figure on a projection surface. In order to be able to operate the MEMS mirror in a particularly energy-efficient manner, the pixel data stream transmitted to the receiver device can be adapted in advance to the trajectory of the light beam or of the light spot generated thereby on the projection surface, for example by adapting it to the trajectory itself by adapting any existing pixel data sequence of the trajectory accordingly, and by synchronizing it in time with the projection.In other words, the light source always receives exactly the pixel data needed to project the next pixel along the trajectory described by a Lissajous figure. Buffering of the pixel data stream is then minimized as much as possible.

[0124] The optical projector may in particular also comprise one of the previously described combinations of transmitter device and receiver devices.

[0125] According to one embodiment of the optical projector according to the invention, the MEMS mirror has a quality factor greater than 1000. Preferably, the MEMS mirror can be configured such that the quality factor is less than 100,000. According to one embodiment of the optical projector according to the invention, the MEMS mirror has a quality factor greater than 2000. Preferably, the MEMS mirror can be configured such that the quality factor is less than 100,000.

[0126] According to one embodiment of the optical projector according to the invention, the MEMS mirror has a quality factor greater than 3000. Preferably, the MEMS mirror can be designed such that the quality factor is less than 100,000.

[0127] According to one embodiment of the optical projector according to the invention, the MEMS mirror has a quality factor greater than 10,000. Preferably, the MEMS mirror can be designed such that the quality factor is less than 100,000.

[0128] MEMS mirrors with such high quality factors have low thermal energy losses and are therefore particularly well suited for energy-efficient operation.

[0129] According to one embodiment of the optical projector according to the invention, the projector has exactly one MEMS mirror. Consequently, the projector has no more than one MEMS mirror.

[0130] According to one embodiment of the optical projector according to the invention, the mirror is gimbal-mounted. According to an alternative embodiment of the optical projector according to the invention, the mirror is non-gimbal-mounted. In particular, the mirror can be designed and mounted as described in patent DE102021116151 B3, the content of patent DE102021116151 B3 being incorporated by reference. Descriptions of the mirror suspension can also be found in patent documents DE102004060576B4 and EP2514211 B1, the content of which is also incorporated by reference.

[0131] The object underlying the invention is also achieved by glasses, in particular AR glasses, comprising a receiver device according to one of the previously described embodiments.

[0132] According to one embodiment of the glasses according to the invention, the glasses comprise a projector according to one of the previously described embodiments.

[0133] According to one embodiment of the spectacles according to the invention, the spectacles comprise a transmitter device according to one of the previously described embodiments. According to one embodiment of the spectacles according to the invention, the spectacles comprise a combination of a transmitter device and a receiver device according to one of the previously described embodiments.

[0134] According to one embodiment of the glasses according to the invention, the glasses comprise a surface which includes the predefined projection surface either only partially or completely.

[0135] The object underlying the invention is also achieved by a head-up display, in particular a head-up display installed in a vehicle such as an automobile or a truck for displaying graphics in the field of vision of a driver, comprising a receiver device according to one of the previously described embodiments.

[0136] According to one embodiment of the head-up display according to the invention, the head-up display comprises a projector according to one of the previously described embodiments.

[0137] According to one embodiment of the head-up display according to the invention, the head-up display comprises a transmitter device according to one of the previously described embodiments.

[0138] According to one embodiment of the head-up display according to the invention, the head-up display comprises a combination of transmitter device and receiver device according to one of the previously described embodiments.

[0139] Head-up displays according to the invention can be significantly smaller and more energy-efficient than previously known head-up displays.

[0140] The object underlying the invention is also achieved by a method, in particular a computer-implemented method, for providing a pixel data stream for a receiver device, in particular a receiver device designed as a video sink, with the steps (A) receiving or reading out digital graphic data of a graphic with a transmitter device, (B) receiving trajectory information data of a trajectory via a first data communication interface of the transmitter device, (C) with a first calculation device of the transmitter device: calculating pixel data with a first temporal pixel data sequence as a function of the trajectory information data obtained in step B), (D) providing the pixel data calculated in step C) as a pixel data stream with the first pixel data sequence as a temporal sequence of the pixel data via the first data communication interface.

[0141] According to one embodiment of the method according to the invention for providing a pixel data stream for a receiver device, the receiving of the trajectory information data in step B) and the providing of the pixel data stream in step D) takes place exclusively via a single data communication interface, namely the first data communication interface, in particular a first data communication interface designed as an HDMI, VGA, DP, 5G, WLAN or Bluetooth interface.

[0142] According to one embodiment of the method according to the invention for providing a pixel data stream for a receiver device, in step B) the trajectory is a trajectory of a light beam controlled by means of a MEMS mirror on a projection surface, wherein in step C) the pixel data are calculated with the first temporal pixel data sequence such that illuminating a projection surface along the trajectory mentioned in step B) with the first pixel data sequence reproduces the graphic on the projection surface visibly for the human eye.

[0143] The object underlying the invention is also achieved by a method, in particular a computer-implemented method, for receiving a pixel data stream, comprising the steps of (E) receiving a pixel data stream with a first temporal pixel data sequence via a second data communication interface of a receiver device, (F) with a trajectory control device of the receiver device: calculating a desired trajectory and the associated trajectory information data of a light beam on a predefined projection surface or determining an actual trajectory of a light beam on a predefined projection surface, such that the coordinates of the desired trajectory and / or the actual trajectory as well as a temporal sequence of the coordinates can be read from the trajectory information data, (G) sending or providing the trajectory information data calculated in step G) via the second data communication interface.

[0144] According to one embodiment of the method according to the invention for receiving a pixel data stream, the method is additionally designed for providing a pixel data stream for a light source control unit of a projector with a MEMS mirror, wherein in step F), the desired trajectory is calculated or the actual trajectory is determined as a function of a feedback signal, wherein the trajectory control device receives the feedback signal from the MEMS mirror, wherein the receiver device additionally provides control signals for bi-resonantly controlling the MEMS mirror. According to one embodiment of the invention, the previously described method for providing a pixel data stream for a receiver device, the method for receiving a pixel data stream, and their specific embodiments can also be carried out jointly, resulting in an embodiment of a method according to the invention with steps (A) to (G).

[0145] Features of the receiver device or the transmitter device which have been described exclusively with reference to the combination of receiver device and transmitter device or with reference to the optical projector or the glasses also represent individual features of an embodiment of a receiver device according to the invention or an embodiment of a transmitter device according to the invention. Accordingly, features which have been described exclusively in connection with a transmitter device as such or a receiver device as such are also to be understood as features of a respective embodiment of a combination of receiver device and transmitter device or of an optical projector or glasses.

[0146] The transmitter device and the receiver device can alternatively be described as a transmitter system or a receiver system. The terms "transmitter" and "receiver" refer here to the sending and receiving of the pixel data stream, respectively. These terms should therefore not be understood to imply that a transmitter device exclusively transmits and a receiver device exclusively receives. Thus, a receiver device can also send data, and a transmitter device can receive data.

[0147] If lists such as "first" or "second" are or have been used, these are to be understood solely as naming terms and do not necessarily imply that a corresponding number of the affected units is present. Thus, the term "second data communication interface" cannot be inferred from the fact that a "first data communication interface" must necessarily be present.

[0148] Further features, advantages, and possible applications of the present invention will become clear from the following description of preferred embodiments and the accompanying figures. They show: Fig. 1 is a schematic circuit diagram of an embodiment of the inventive combination of transmitter device and receiver device or an embodiment of the inventive optical projector,

[0149] Fig. 2 is a schematic representation of the calculation of the first pixel data sequence of the pixel data stream and the temporal synchronization of the transmitter device and the receiver device by means of source synchronization,

[0150] Fig. 3 is a schematic representation of the calculation of the first pixel data sequence of the pixel data stream and the temporal synchronization of the transmitter device and the receiver device by means of sink synchronization,

[0151] Fig. 4 is a schematic representation of the calculation of the first pixel data sequence of the pixel data stream and the temporal synchronization of the transmitter device and the receiver device by means of a combination of source synchronization and sink synchronization,

[0152] Fig. 5 is a schematic representation of an embodiment of a method according to the invention,

[0153] Fig. 6 is a schematic representation of a further embodiment of a method according to the invention,

[0154] Fig. 7 is a schematic representation of an embodiment of a spectacle device according to the invention with an optical projector according to the invention.

[0155] Fig. 1 shows a transmitter device 1 and a receiver device 9. The receiver device 9, together with an optical system 41, forms an optical projector 18. Fig. 1 is a circuit diagram which particularly shows the system of communication between the transmitter device 1 and the receiver device 9, i.e. the system for sending and receiving data. In the embodiment shown here, the transmitter device 1 has a first data memory s on which the graphic data 2 of the graphic to be displayed is stored. The graphic data 2 can, in particular, also be stored only temporarily on the first data memory 3. As a rule, such graphic data 2 is in the form of pixel data which is based on a pixel grid which is formed according to Cartesian coordinate axes of the projection surface 42.In other words, the graphic data 2 is often present in the form of pixel data, with the associated pixels on the projection surface 42 being arranged in a tile-like manner in rows and columns. If an optical system following later in the data processing chain were to read out this pixel data in an order following the rows and columns and illuminate a projection surface 42 accordingly, following the rows and columns, the structure of the graphic data 2 could be used directly to display the graphic on the projection surface 42. In the embodiment shown here, however, the light source 20 of the optical system 41 is directed onto a bi-resonantly driven MEMS mirror 19 associated with the optical system 41, so that the light beam 28 reflected by the MEMS mirror 19 onto the projection surface does not pass through rows and columns of a Cartesian coordinate system on the projection surface 42.This is because the light beam 28, or in other words the light spot produced by the light beam 28, follows a Lissajous figure on the projection surface 42, so that the projection surface 42 is illuminated following this Lissajous figure. Therefore, the pixel data sequence usually inherent in the graphic data 2 located on the first data storage device 3, according to rows and columns of a Cartesian coordinate system, does not match the subsequent trajectory of the light beam 28 generated by the light source 20 and the MEMS mirror 19 on the projection surface 42.

[0156] In order to enable a display of the graphic in a particularly energy-efficient manner and regardless of the format in which the graphic data 2 is present - whether, for example, as a pixel graphic or vector graphic - and in the case of a pixel graphic, regardless of the pixel data sequence in which the graphic data 2 is present, the graphic data 2 are therefore, in the embodiment shown here, first read out by the first calculation device 4 of the transmitter device 1. The first calculation device 4 calculates pixel data 16 and an associated pixel data sequence 17 from the graphic data 2, so that the graphic is displayed on the projection surface 42 when the projection surface 42 is illuminated along the Lissajous figure with the calculated pixel data sequence 17. In order for the first calculation device 4 to be able to do this, it requires information about the trajectory along which the projection surface 42 is illuminated, i.e.In the embodiment shown here, along which Lissajous figure the projection surface 42 is illuminated. The first calculation device 4 receives this so-called trajectory information data 7 from the second calculation device 8 of the transmitter device 1. This second calculation device 8 can, in particular, be designed such that it predicts the trajectory of the light beam 28 on the projection surface 42 based on trajectory information data 7', which the second calculation device 8 in turn receives via the first data communication interface 5.

[0157] In the embodiment shown here, the first data communication interface 5 is a hardware interface that is connected to the second data communication interface 11 of the receiver device 9 via a wireless data connection, wherein the second data communication interface 11 is also designed as a hardware interface. A component of the receiver device 9 is the trajectory control device 10, which is connected to the MEMS drive 24 and the MEMS sensor 25 in such a way that the trajectory control device 10 can send control signals to the MEMS drive 24 and receive feedback signals from the MEMS sensor 25. The trajectory control device 10 thereby controls or regulates the trajectory of the light beam 28 on the projection surface 42 by controlling or regulating the bi-resonant oscillation of the MEMS mirror 19.The information about the actually controlled trajectory of the light beam 28 on the production surface 42—which is also referred to as the desired trajectory in the context of the present invention—is therefore available to the trajectory control device 10. This information about the actually controlled trajectory is transmitted as trajectory information data 7 to the second data communication interface 11 by the trajectory control device 10.Via the bidirectional connection between the first data communication interface 5 and the second data communication interface 11, the trajectory information data 7, which originally originate from the trajectory control device 10, are then transmitted to the transmitter device 1 and there internally to the second calculation device 8, so that - as described above - the second calculation device 8 of the transmitter device 1 can transmit trajectory information data 7 to the first calculation device 4 of the transmitter device 1 based thereon in order to calculate pixel data 16 adapted to the trajectory of the light beam 28 and the associated pixel data sequence 17.

[0158] This completes the information chain required to calculate the pixel data 16 and the pixel data sequence 17 with the first calculation device 4. The pixel data 16 calculated in this way are now sent in the corresponding pixel data sequence 17 as a chronological sequence of the pixel data 16 from the first data communication interface 5 to the second data communication interface 11, so that a pixel data stream 6 is formed from the first data communication interface 5 to the second data communication interface 11.

[0159] The bidirectional connection between the first data communication interface 5 and the second data communication interface 11 is thus configured such that a pixel data stream 6 is transmitted from the first data communication interface to the second data communication interface 11, while trajectory information data 7 is transmitted, for example in the form of a backlink, from the second data communication interface 11 to the first data communication interface 5. The first data communication interface 5 and the second data communication interface 11 can, in particular, be arranged spatially spaced from one another.In the embodiment shown here, the trajectory information data 7 is not transmitted continuously, but rather in a time-discrete manner, thus with a time interval between the transmission of two consecutively transmitted trajectory information data 7 or corresponding data packets. As a result, the database on the trajectory available to the second calculation device 8 and, accordingly, also the database on the trajectory available to the first calculation device 4 are regularly updated. Thus, the actually controlled trajectory of the light beam 28 on the projection surface and the trajectory of the light beam 28 on the projection surface 42 predicted by the second calculation device 8 are regularly synchronized. In this regard, this is also referred to as parametric synchronization between the transmitter device 1 and the receiver device 9.

[0160] The embodiment shown in Fig. 1 offers a further advantage, since the transmitter device 1 transmits pixel data to the receiver device 9 not only with a pixel data sequence that matches the actually controlled trajectory of the light beam 28, but also in such a way that these pixel data can be transmitted essentially directly to the light source control unit 13 and the light source 20, without intermediate storage of the pixel data necessarily having to be provided.To enable this, the transmitter device 1 and the receiver device 9 must be temporally synchronized so that the receiver device 9 always receives precisely the pixel data that, taking into account the transmission times and transmission latencies, are required in the next moment by the light source control unit 13 and the light source 20 in order to illuminate the projection surface 42 at the point on the trajectory currently being addressed by the MEMS mirror 19. This temporal synchronization has the consequence that the second data memory 23 connected behind the second data communication interface 11 is present in the embodiment shown here, but is only equipped with a small storage capacity. The second data memory 23 serves only to compensate for transmission latencies between the first data communication interface 5 and the second data communication interface 11.A deviating predefined intermediate storage of the pixel data on the second data memory 23 does not take place.

[0161] The trajectory control device 10 can additionally be designed - as shown in Fig. 1 - such that it transmits control signals to the third data communication interface 12 for the light source control unit 13.

[0162] In order to establish the temporal synchronization of transmitter device 1 and receiver device 9 and to track them over time, in the embodiment shown here, a first synchronization signal 15 is regularly sent from receiver device 9 to transmitter device 1 - in addition to the trajectory information data 10 that is also transmitted. This first synchronization signal 15 is designed such that a specific position of light beam 28 on trajectory 31 of light beam 28 can be determined therefrom. For example, synchronization signal 15 can be a simple heartbeat signal, wherein it is predefined that this heartbeat is always sent when light beam 28 reaches a specific position of the trajectory on projection surface 42 or at fixed or adaptively determined time intervals.The first synchronization signal is then received by the first data communication interface 5 and - in the embodiment shown here - transmitted directly to the first calculation device 4. The first calculation device 4 then adapts the calculations of the pixel data 16 and the pixel data sequence 17 in such a way that the pixel data stream output by the first data communication interface 5 is shifted either forwards or backwards in time, so that, taking the transmission times into account, precisely the pixel data required for that specific position on the trajectory are transmitted by the first data communication interface 5 at the exact time when, taking the transmission times into account, the light beam 28 of the light source 20 reaches precisely that position on the projection surface 42. Intermediate storage of this pixel data in the second data memory 23 is then no longer necessary oronly necessary to compensate for latencies - as described above. Such a temporal synchronization of the trajectory of the light beam 28 with the pixel data stream 6 arriving at the receiver device 9 is referred to as source synchronization, since the synchronization, ie, the adaptation of the data, takes place in the data source, i.e., here in the transmitter device 1.

[0163] Alternatively or additionally, in the embodiment shown in Fig. 1, a temporal sink synchronization can also be carried out with a second synchronization signal 32.

[0164] Temporal source synchronization and the upstream parametric synchronization are shown schematically in Fig. 2. The large arrow 29, pointing from left to right, represents the temporal progression during the initialization of transmitter device 1 and receiver device 9. The top row shows three two-dimensional Cartesian coordinate systems with a first Cartesian coordinate axis 36 and a second Cartesian coordinate axis 37. These coordinate systems each represent an imaginary projection surface. Each of these imaginary projection surfaces contains a trajectory 30 of the light beam 28 together with the current position 38 of the light beam 28 according to the trajectory information data currently available to the transmitter device, i.e., at the time indicated by the arrow 29. The trajectory 30 is therefore a trajectory 30 predicted by the second calculation device 8.

[0165] Consequently, the lower row represents the trajectories 31 actually controlled at different times and the actually currently controlled positions 39 on the respective trajectory 31, while the upper row represents the trajectories 30 predicted at different times and the predicted positions 38 on the respective trajectory.

[0166] In the first column of Fig. 2 (the coordinate systems shown one above the other on the left), the trajectory 30 predicted within the transmitter device 1 and the trajectory 31 actually controlled within the receiver device 9 are different and therefore not parametrically synchronized in the sense of the present application.

[0167] Based on the transmission of the trajectory information data 7 from the receiver device 9 to the transmitter device 1, the parametric synchronization then takes place - as described above - so that, as represented by the two central coordinate systems lying one above the other, the currently controlled trajectory 31 is known to the transmitter device 1, so that at the time of the parametric synchronization it is identical to the predicted trajectory 30.

[0168] In the case shown in Fig. 2, the actually controlled trajectory 31 corresponds to a Lissajous figure. However, it can be seen that the transmitter device 1 is starting from a different current position 38 of the light beam on the predicted trajectory 30 than is the case with the receiver device. Consequently, intermediate storage of the pixel data would be necessary in order to store the intermediate region of the trajectory, i.e., the trajectory section between the positions 38 and 39 marked with the two arrowheads. By means of the first synchronization signal 15, which in the case shown here is a periodically occurring heartbeat signal that always deflects or is transmitted when the light beam is controlled to the position 39 shown in the bottom row, the intermediate trajectory section 40 is skipped by the first calculation device 4 of the transmitter device (in Fig.2 shown in dashed lines), so that in the further course, precisely those pixel data are transmitted from the transmitter device 1 to the receiver device 9 which, taking into account the transmission times, are required by the receiver device 9 for the optical projection of the graphic. Alternatively, as shown in Fig. 3, temporal synchronization by means of sink synchronization is also conceivable. Fig. 3 corresponds to Fig. 2 with regard to the first two columns (viewed from left to right). The parametric synchronization also takes place here as described above. In order to effect temporal synchronization, however, the pixel data stream 6 in the transmitter device 1 is not adjusted. Instead, a second synchronization signal is transmitted from the transmitter device 1 to the receiver device 9 - via the bidirectional connection between the first data communication interface 5 and the second data communication interface 11.Here, too, the second synchronization signal can be a heartbeat signal associated with a specific position of the light beam 28 on the trajectory. Upon receipt of this heartbeat signal, the MEMS mirror 19 is then controlled by the trajectory control device 10 such that the current position of the light beam 28 jumps to this specific position. Consequently, it is not the pixel data stream 6 that is adjusted to effect the temporal synchronization, but rather the actually controlled trajectory 31 of the light beam 28 on the projection surface 42. The transmitter device 1 and the receiver device 9 can be configured accordingly for this purpose.

[0169] A hybrid of these two synchronization types, sink and source synchronization, is shown in Fig. 4. The last column shows that the transmitter device and the receiver device are configured to transmit both a first synchronization signal 15 and a second synchronization signal, so that both the pixel data stream 6 and the actually controlled trajectory 31 of the light beam 28 on the projection surface 42 are adjusted to effect temporal synchronization.

[0170] The control and / or regulation of the MEMS mirror is effected - as shown in Fig. 1 - by the trajectory control device 10. This is integrated with a first part into the receiving device 9 and with a second part into the optical system. Both parts are connected to each other by a bidirectional data connection 26. The trajectory control device 10 sends control signals 27 to the MEMS drive 24 in order to adjust the oscillation of the MEMS mirror. In order to be able to regulate the oscillation of the MEMS mirror 19, the trajectory control device 10 also receives a feedback signal 21 from the MEMS mirror 19 via the MEMS sensor 25, from which the actual oscillation behavior of the MEMS mirror can be derived. The MEMS drive drives the MEMS mirror with a drive signal 14 depending on the received control signal.Thus, the MEMS mirror can be controlled by means of the trajectory control device 10 in order to guide the light beam 28 reflected by the MEMS mirror along a specific trajectory on the projection surface 42 or to align it to a specific position. The light beam 28 emitted by the light source 20 then carries the information, in particular the color and brightness information, for the position just addressed on the projection surface 42 according to the received pixel data for the pixel associated with the position. The light source control unit 13 and the associated light source 20 receive this information from the third data communication interface 12, as shown here. The third data communication interface 12 is arranged downstream of the second data memory 23 in the pixel data stream and provides the pixel data stream in a format readable by the light source control unit 13.

[0171] After an initial initialization of the system shown in Fig. 1, comprising transmitter device 1, receiver device 9, and optical system 41, the transmitter device 1 and the receiver device 9 are synchronized both parametrically and temporally, with both synchronizations being performed regularly and thus tracked. This enables extremely energy-efficient operation.

[0172] Fig. 5 shows a simplified illustration of an embodiment of the method according to the invention for providing a pixel data stream. First, in method step (A) 45, digital graphic data 2 of a graphic is read out or received by a transmitter device 1. Then, in method step (B) 46, trajectory information data 7 of a trajectory is received from the transmitter device 1 via a first data communication interface 5 of the transmitter device 1. Subsequently, in method step (C) 47, a first calculation device 4 of the transmitter device 1 calculates pixel data 16 with a first temporal pixel data sequence 17 as a function of the trajectory information data 7 obtained in step (B). Finally, in method step (D) 48, the pixel data stream calculated in step (C) with the first pixel data sequence as the temporal sequence of the pixel data is transmitted via the first data communication interface.

[0173] Fig. 6 shows a simplified representation of an embodiment of the method according to the invention for receiving a pixel data stream. First, in method step (E) 49, a pixel data stream 6 with a first temporal pixel data sequence 17 is received via a second data communication interface 11 of a receiver device 9. Then, in method step (F) 50, a desired trajectory of a light beam 28 on the projection surface 42 and the associated trajectory information data 7 are calculated using a trajectory control device 10 of the receiver device 9, or an actual trajectory of the light beam 28 on the projection surface 42 is determined, so that the coordinates of the desired trajectory and / or the actual trajectory as well as a temporal sequence of the coordinates can be read from the trajectory information data 7.Finally, in method step (G) 51, the trajectory information data 7 calculated in method step (F) are provided via the second data communication interface 11.

[0174] List of reference symbols

[0175] 1 transmitter device

[0176] 2 graphic data

[0177] 3 First data storage

[0178] 4 First calculation device

[0179] 5 First data communication interface

[0180] 6 pixel data stream

[0181] 7 Trajectory information data

[0182] 8 Second calculation device

[0183] 9 Receiver device

[0184] 10 Trajectory control device

[0185] 11 Second data communication interface

[0186] 12 Third data communication interface

[0187] 13 Light source control unit

[0188] 14 Drive signal

[0189] 15 First synchronization signal

[0190] 16 pixel data

[0191] 17 pixel data sequence

[0192] 18 Optical projector

[0193] 19 MEMS mirrors

[0194] 20 light source

[0195] 21 Feedback signal

[0196] 22 Control signal

[0197] 23 Second data memory (buffer)

[0198] 24 MEMS drive

[0199] 25 MEMS sensors

[0200] 26 bidirectional data connection

[0201] 27 Control signal or control signals

[0202] 28 light beam

[0203] 29 System timeline

[0204] 30 Trajectory of the light beam predicted in the transmitter device

[0205] 31 Actual trajectory of the light beam controlled in the receiver device / desired trajectory

[0206] 32 Second synchronization signal

[0207] 33 Glasses device

[0208] 34 Control signal 38 Predicted current position of the light beam within the trajectory

[0209] 39 Actual controlled position of the light beam within the trajectory

[0210] 40 Skipped section of the predicted trajectory

[0211] 41 Optical system 42 Projection surface

[0212] 43 Imaginary projection surface

[0213] 44 Skipped section of the actually controlled trajectory

[0214] 45 Process step (A)

[0215] 46 Process step (B) 47 Process step (C)

[0216] 48 Process step (D)

[0217] 49 Process step (E)

[0218] 50 Process step (F)

[0219] 51 Process step (G)

Claims

P a t e n t a n s p r ü c h e 1. A transmitter device (1), in particular a transmitter device (1) designed as a video source, for transmitting pixel data (16) of a graphic described by means of digital graphic data (2), wherein the transmitter device (1) has a first data memory (3) or is connectable to the first data memory (3), wherein the transmitter device (1) has a first calculation device (4), wherein the first calculation device (4) is designed and configured such that the first calculation device (4) accesses the graphic data (2) that are at least temporarily stored on the first data memory (3) in the operating state of the transmitter device (1) or receives the graphic data (2) from the first data memory (3), wherein the first calculation device (4) is designed and configured such thatthat the first calculation device (4) calculates pixel data (16) with a first pixel data sequence (17) from the received graphic data (2) in the operating state of the transmitter device (1), wherein the transmitter device (1) has a first data communication interface (5), wherein the first data communication interface (5) is designed, configured and connected to the first calculation device (4) such that the first data communication interface (5) in the operating state of the transmitter device (1) sends the pixel data (16) as a pixel data stream (6) with the first pixel data sequence (17) as a temporal data sequence of the pixel data (16), wherein the first data communication interface (5) is additionally designed and configured such that the first data communication interface (5) receives trajectory information data (7) in the operating state of the transmitter device (1), wherein the transmitter device (1) is designed and configured such thatthat the first calculation device (4) in the operating state of the transmitter device (1) determines at least the first pixel data sequence (17) used for the pixel data stream (6) as a function of the received trajectory information data (7).

2. Transmitter device (1) according to claim 1, wherein the transmitter device (1) has a second calculation device (8), wherein the second calculation device (8) is designed, configured and connected to the first data communication interface (5) in such a way that the second calculation device (8) in the operating state of the transmitter device (1) Trajectory of a light beam (28) over a predefined projection surface (42) is determined as a function of the trajectory information data (7) received via the first data communication interface (5).

3. Transmitter device (1) according to the preceding claim, wherein the second calculation device (8) is designed and configured such that the second calculation device (8) predicts the trajectory for future times.

4. Transmitter device according to one of claims 2 or 3, wherein the first calculation device (4) is designed, configured and connected to the second calculation device (8) such that the first calculation device (4) determines the first pixel data sequence (17) in the operating state of the transmitter device (1) as a function of the calculated trajectory, namely such that illuminating the predefined projection surface (42) along the determined trajectory and with the first pixel data sequence (17) as a temporal sequence of the pixels imaged along the trajectory images the graphic on the predefined projection surface (42) in a way that is visible to the human eye, wherein the second calculation device (8) is preferably designed and configured such that the calculated trajectory represents a Lissajous figure at least in sections and preferably necessarily a Lissajous figure.

5. Transmitter device (1) according to one of the preceding claims, wherein the first data communication interface (5) is designed and configured according to a first possibility such that the first data communication interface (5) in the operating state of the transmitter device (1) wirelessly transmits the pixel data stream (6) and / or receives the trajectory information data (7) as wirelessly transmitted data, wherein the first data communication interface (5) according to the first possibility is preferably a WLAN interface and / or Bluetooth interface and / or SG-capable interface and / or wherein the first data communication interface (5) is designed and configured according to a second possibility such thatthat the first data communication interface (5) in the operating state of the transmitter device (1) transmits the pixel data stream (6) by wire via a data transport channel and / or receives the trajectory information data (7) as wired data via the data transport channel, wherein the first data communication interface (5) according to the second possibility is preferably an HDMI interface, VGA interface, Ethernet interface, DP interface, MIPI interface or DVI interface.

6. Receiver device (9), in particular a receiver device (9) designed as a video sink, for receiving a pixel data stream (6), wherein the receiver device (9) has a trajectory control device (10), wherein the trajectory control device (10) is designed and configured such that the trajectory control device (10), in the operating state of the receiver device (9), calculates trajectory information data (7) of a desired trajectory of a light beam on a predefined projection surface and / or determines trajectory information data (7) of an actual trajectory of the light beam on the predefined projection surface, so that the coordinates of the desired trajectory and / or the actual trajectory as well as a temporal sequence of the coordinates can be read from the trajectory information data (7), wherein the receiver device (9) has a second data communication interface (11),wherein the second data communication interface (11) is designed, configured, and connected to the trajectory control device (10) such that the second data communication interface (11) transmits the trajectory information data (7) in the operating state of the receiver device (9), wherein the second data communication interface (11) is additionally designed and configured such that the second data communication interface (11) receives a pixel data stream (6) in the operating state of the receiver device (9) which comprises, or in particular consists of, pixel data (16) with a first pixel data sequence (17) as a temporal data sequence of the pixel data (16).

7. Receiver device (9) according to claim 6, wherein the receiver device (9) is designed and configured such that the second data communication interface (11) sends trajectory information data of a desired trajectory of the light beam (28) projected onto the projection surface (42) and preferably does not send trajectory information data of an actual trajectory of the light beam (28) projected onto the projection surface (42).

8. Receiver device (9) according to claim 6 or 7, wherein the receiver device (9) is designed and configured such that the receiver device (9) in the operating state of the receiver device (9) the first Pixel data sequence (17) of the received pixel data stream (6) is retained unchanged, so that within the receiver device (9) there is only one pixel data stream (6) with the first pixel data sequence (17) as the temporal sequence of the pixel data (16).

9. Receiver device (9) according to one of claims 6 to 8, wherein the trajectory control device (10) is designed and configured such that, in the operating state of the receiver device (9), the desired trajectory calculated by the trajectory control device (10) on the predefined projection surface (42) represents a Lissajous figure at least in sections, preferably necessarily represents a Lissajous figure.

10. Receiver device (9) according to one of claims 6 to 9, wherein the receiver device (9) has a third data communication interface (12), wherein the third data communication interface (12) is designed and configured such that the third data communication interface (12) provides the pixel data stream (6) with the first temporal pixel data sequence (17) received from the second data communication interface (5) as an RGB pixel data stream with the first pixel data sequence (17) for a light source control unit (13) during operation of the receiver device (9), wherein the receiver device (9) is preferably designed and configured such thatthat the trajectory control device (10) determines control signals (34) for the light source control unit (13) as a function of the desired trajectory of the light beam (28) on the predefined projection surface (42) during operation of the receiver device (9) and provides them to the light source control unit (13) via the third data communication interface (12).

11. Receiver device (9) according to one of claims 6 to 10, wherein the second data communication interface (11) is designed and configured according to a first possibility such that the second data communication interface (11) in the operating state of the receiver device (9) wirelessly transmits the trajectory information data (7) and / or receives the pixel data stream (6) as a wirelessly transmitted data stream, wherein the second data communication interface (11) is preferably a WLAN interface and / or Bluetooth interface and / or 5G-capable interface, wherein the second data communication interface (11) is designed and configured according to a second possibility such that the second Data communication interface (11) in the operating state of the receiver device (9) sends the trajectory information data (7) wired via a data transport channel and / or receives the pixel data stream (6) as a wired data stream via the data transport channel, wherein the second data communication interface (11) is preferably an HDMI interface, VGA interface, Ethernet interface, DP interface, DVI interface or Ml Pl interface.

12. Combination of a transmitter device (1) according to one of claims 1 to 5 with a receiver device (9) according to one of claims 6 to 11, wherein the transmitter device (1) and the receiver device (9) are operable in a common operating state.

13. Combination according to the preceding claim, wherein the first data communication interface (5) and the second data communication interface (11) are designed and configured such that, in the common operating state of the combination of transmitter device (1) and receiver device (9), the first data communication interface (5) sends the pixel data stream (6) with the first pixel data sequence (17) as a temporal data sequence of the pixel data (16) to the second data communication interface (11) and the second data communication interface (11) receives the pixel data stream (6) with the first pixel data sequence (17) as a temporal data sequence of the pixel data (16), wherein the second data communication interface (11) is designed, configured and connected to the trajectory control device (10) such thatthat the second data communication interface (11) sends the trajectory information data (7) to the first data communication interface (5) in the common operating state of the combination and the first data communication interface (5) receives the sent trajectory information data (7), wherein the combination is preferably designed and configured such that data communication between the receiver device (9) and the transmitter device (1) takes place exclusively via a single bidirectional data connection defined by the first data communication interface (5) and the second data communication interface (11).

14. Combination according to one of claims 12 or 13, wherein the combination is designed and arranged such that in the common operating state of the combination, the first data communication interface (5) Pixel data stream (6) is sent, the second data communication interface (11) receives the pixel data stream (6) and makes it available essentially directly via a third data communication interface (12), wherein the receiver device (9) is designed and configured such that data of the pixel data stream (6) is temporarily stored on the receiver device (9) exclusively for compensating for latencies in the data transmission between the first data communication interface (5) and the second data communication interface (11).

15. Combination according to one of claims 12 to 14, wherein the combination is designed and configured such that, in the common operating state of the combination, the receiver device (9) regularly transmits a first synchronization signal (15) to the transmitter device (1) via the second data communication interface (11) and the first data communication interface (5) in addition to the trajectory information data (7), wherein the first calculation device (4) is designed and configured such that the first calculation device (4) calculates the pixel data (16) and / or the first pixel data sequence (17) depending on the first synchronization signal (15) or adapts a provision of the pixel data (16) and / or the first pixel data sequence (17) depending on the first synchronization signal (15), wherein the first calculation device (4) is preferably designed and configured such thatthat the first calculation device (4) reads out or derives position information data of a position on the projection surface from the first synchronization signal (15), and the first calculation device (4) calculates the pixel data (16) and / or the first pixel data sequence (17) depending on the position information data of the position or adapts the provision of the pixel data (16) and / or the first pixel data sequence (17) depending on the position information data of the individual position.

16. Combination according to one of claims 12 to 15, wherein the combination is designed and arranged such that in the common operating state, the transmitter device (1) additionally regularly transmits a second synchronization signal (32) to the receiver device (9) via the first data communication interface (5) and the second data communication interface (11), wherein the trajectory control device (10) is designed and arranged such that the trajectory control device (10) determines the desired trajectory of the light beam (28) on the projection surface (42) as a function of the second synchronization signal (32), wherein the trajectory control device (10) is preferably designed and configured such that the trajectory control device (10) reads out or derives a position on the projection surface from the second synchronization signal position information data and the trajectory control device (10) calculates the desired trajectory as a function of the position information data of the position or adapts the provision of the desired trajectory as a function of the position information data of the position.

17. Combination according to one of claims 12 to 16, wherein the transmitter device is integrated on a first semiconductor chip and the receiver device is integrated on a second semiconductor chip, wherein the first semiconductor chip and the second semiconductor chip are separate, preferably spatially spaced apart, semiconductor chips.

18. An optical projector (18) for illuminating a predefined two-dimensional projection surface (42), wherein the projector (18) comprises a receiver device (9) according to one of claims 6 to 11 or a combination according to one of claims 12 to 17, wherein the projector comprises a mirror arrangement with a mirror, in particular a MEMS mirror, wherein the mirror arrangement is designed such that the mirror (19) is capable of oscillation with respect to a first spatial axis and with respect to a second spatial axis different from the first spatial axis, in particular with respect to a spatial axis oriented orthogonally to the first spatial axis, wherein the optical projector (18) is designed and configured such that an oscillation of the mirror (19) with respect to the first spatial axis can be driven resonantly and that an oscillation with respect to the second spatial axis can be driven resonantly, wherein the projector (18) comprises a light source (20),preferably a laser or an LED lamp, wherein the projector (18) is designed and arranged such that, in an operating state of the projector (18), an oscillation of the mirror with respect to the first spatial axis and an oscillation of the mirror (19) with respect to the second spatial axis are each driven resonantly and a light beam is projected from the light source (20) onto the mirror (19) and reflected by the mirror (19).

19. Glasses device (33) comprising a receiver device (9) according to one of claims 6 to 11, wherein the glasses device preferably comprises an optical projector (18) according to claim 18, wherein the glasses device particularly preferably comprises a transmitter device (1) according to one of claims 1 to 5 or a combination according to one of claims 12 to 17, wherein the glasses device comprises the predefined projection surface (42).

20. Method, in particular computer-implemented method, for providing a pixel data stream (6) for a receiver device (9), in particular a receiver device (9) designed as a video sink, comprising the steps A) receiving or reading digital graphic data (2) of a graphic with a transmitter device (1), B) receiving trajectory information data (7) of a trajectory via a first data communication interface (5) of the transmitter device (1), C) With a first calculation device (4) of the transmitter device (1): calculating pixel data (16) with a first temporal pixel data sequence (17) depending on the trajectory information data (7) obtained in step B), D) Providing the pixel data (16) calculated in step C) as a pixel data stream (6) with the first pixel data sequence (17) as a temporal sequence of the pixel data (16) via the first data communication interface (5).

21. Method according to the preceding claim, wherein the receiving of the trajectory information data (7) in step B) and the providing of the pixel data stream (6) in step D) are carried out exclusively via a single data communication interface (5), namely the first data communication interface (5), in particular a first data communication interface (5) designed as an HDMI, VGA, DP, DVI, 5G, WLAN or Bluetooth interface.

22. Method according to one of claims 20 or 21, wherein in step B) the trajectory is a trajectory of a light beam (28) controlled by means of a MEMS mirror (19) on a projection surface (42), wherein in step C) the pixel data (16) are calculated with the first temporal pixel data sequence (17) in such a way that an illumination of a projection surface (42) along the trajectory mentioned in step B) with the first pixel data sequence (17) reproduces the graphic on the projection surface (42) in a way that is visible to the human eye.

23. Method, in particular computer-implemented method, for receiving a pixel data stream (6), comprising the steps E) receiving a pixel data stream (6) with a first temporal pixel data sequence (17) via a second data communication interface (11) of a receiver device (9), F) With a trajectory control device (10) of the receiver device (9): Calculating a desired trajectory and the associated trajectory information data (7) of a light beam (28) on a predefined projection surface (42) or determining an actual trajectory of a light beam on a predefined projection surface (42), so that the coordinates of the desired trajectory and / or the actual trajectory as well as a temporal sequence of the coordinates can be read from the trajectory information data (7), G) Sending or providing the trajectory information data (7) calculated in step F) via the second data communication interface (11).

24. Method according to the preceding claim, wherein the method is additionally designed for providing a pixel data stream (6) for a light source control unit (13) of a projector (18) with a MEMS mirror (19), wherein in step F) the calculation of the desired trajectory or the determination of the actual trajectory takes place as a function of a feedback signal (21), wherein the trajectory control device (10) receives the feedback signal (21) directly or indirectly from the MEMS mirror, wherein the receiver device (9) additionally provides control signals (22) for bi-resonantly controlling the MEMS mirror (19).

Citation Information

Patent Citations

  • procedure and projector for image projection

    DE102004060576B4

  • Projection system for projecting LISSAJOUS figures and microscanner with coupled oscillators

    DE102021116151B3

  • Deflection system for a projection device, projection device for projecting an image and method for actuating a deflection system for a projection device

    EP2514211B1

  • Processor, display control device and system, image processing method and device

    CN109752839A