Laser scanning display control device and system and near-to-eye display equipment

Abstract

The embodiment of the utility model provides a laser scanning display control device and system and near-to-eye display equipment. The laser scanning display control device comprises an image receiving module which receives image data transmitted by an image source on one side of binocular sides of the near-to-eye display equipment; the image sending module determines the working state of the image data according to the type of the image data and forwards or does not process the image data based on the state; the image processing module processes the image data; the image buffer receives the processed image data from the image processing module; the light source driving module reads the processed image data from the image buffer, converts the processed image data and drives the light source to be lightened so as to display an image; the scanning driving module generates a scanning driving signal to scan the scanner according to the image data processed by the light source driving module and driving waveform data required by the scanner; the clock module obtains a second clock according to the first clock received by the image processing module and provides the second clock to the light source driving module and the scanning driving module to achieve synchronization of the light source and the scanner.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a laser scanning display control device, system and near-eye display equipment. Background Art

[0002] Laser scanning display, as an emerging display imaging technology, can be realized by scanners such as micro-electro-mechanical systems (MEMS) scanning mirrors and fiber scanners. This technology can be applied to various display environments such as projection display and near-eye display. Among them, in the near-eye display environment, the image displayed by the scanner is different from the traditional display mode, and the image output needs to be coordinated with the scanning mode and display mode.

[0003] Therefore, laser scanning display often requires a larger image buffer to achieve image output. The larger the area of ​​the dedicated integrated circuit occupied by the image buffer, the greater the power consumption generated by the dedicated integrated circuit. In addition, while providing a variety of display modes, there will also be a waste of some resources, further affecting the overall power consumption of the dedicated integrated circuit. Utility Model Content

[0004] In view of this, embodiments of the present application provide a laser scanning display control device, system and near-eye display equipment to at least partially solve the above-mentioned problems.

[0005] According to a first aspect of an embodiment of the present application, a laser scanning display control device is provided, which is applied to a near-eye display device, characterized in that the device includes: an image receiving module, which is used to receive image data on one side of the binocular side of the near-eye display device; an image sending module, which is used to determine its own working state according to the type of the image data, and synchronously forward or do not process the image data based on the working state; an image processing module, which is used to process the image data; an image buffer, which is used to receive the processed image data from the image processing module; a light source driving module, which is used to read the processed image data from the image buffer, convert the processed image data and drive the light source to light up to display an image; a scanning driving module, which is used to generate a scanning driving signal according to the processed image data read by the light source driving module and the driving waveform data required by the scanner, and scan the scanner according to the scanning driving signal; a clock module, which is used to obtain a second clock according to the first clock received by the image processing module, and provide the second clock to the light source driving module and the scanning driving module respectively to achieve synchronization between the light source and the scanner.

[0006] In another implementation of the present application, the type of the image data includes single-channel image data and dual-channel image data. When the image data is single-channel image data, the image sending module is used to adjust itself to a use state to start reading the image data and synchronously transmit the read image data to the other side of the binocular side of the near-eye display device; and

[0007] When the image data is dual-channel image data, the image sending module is used to adjust itself to a closed state to prohibit operation on the image data.

[0008] In another implementation of the present application, the first clock and the second clock come from the same crystal oscillator or phase-locked loop circuit.

[0009] In another implementation of the present application, the clock module is a second clock obtained by dividing or multiplying the first clock.

[0010] In another implementation of the present application, the size of the image buffer is calculated using Formula 1, which is: size1 = H*(1-Fa / (Fa+ Δ f)); wherein size1 is the size of the image buffer, Fa is the first line frequency at which the image receiving module receives the image data, H is the total height of the image data, Δ f is the process frequency deviation.

[0011] In another implementation of the present application, the image buffer includes a used part and a remaining part, the cache blocks of the used part are in a used state, and the cache blocks of the remaining part are in a closed state.

[0012] In another implementation of the present application, if the first line frequency is equal to the second line frequency scanned by the scanner, the size of the used part of the image buffer is greater than or equal to 1 line of image data; if the first line frequency is greater than the second line frequency, the size of the used part of the image buffer is calculated using Formula 2, which is: size2=H*(1 / Fb-1 / Fa) / (1 / Fb); if the first line frequency is less than the second line frequency, the size of the used part of the image buffer is calculated using Formula 3, which is: size2=H*(1 / Fa-1 / Fb) / (1 / Fa); wherein size2 is the size of the used part of the image buffer, and Fb is the second line frequency.

[0013] In another implementation of the present application, the size of the remaining portion is determined according to the size of the used portion.

[0014] In another implementation of the present application, the light source driving module includes: a driving unit, which is used to read the processed image data from the image buffer and generate a light source driving signal; a light source DAC unit, which is used to perform DAC conversion according to the light source driving signal provided by the driving unit, and drive the light source to light up and display an image; a light source feedback unit, which is used to monitor the response of the light source and collect feedback data of the light source; and a control unit, which is used to adjust the intensity of the light source driven by the light source DAC unit according to the feedback data provided by the light source feedback unit.

[0015] In another implementation of the present application, the scanning drive module includes: a waveform unit, which is used to store the driving waveform data required by the scanner; a scanning feedback unit, which is used to monitor the response of the scanner and collect the scanning feedback data of the scanner; a DDS unit, which is used to generate a scanning drive signal according to the driving waveform data provided by the waveform unit and the processed image data provided by the drive unit, and adjust the drive signal according to the scanning feedback data provided by the scanning feedback unit; a scanning DAC unit, which is used to perform DAC conversion on the adjusted scanning drive signal sent by the DDS unit, and drive the scanner to scan.

[0016] According to a second aspect of an embodiment of the present application, a laser scanning display control system is provided, comprising a scanner and the laser scanning display control device of the first aspect described above.

[0017] According to a third aspect of an embodiment of the present application, there is provided a near-eye display device, comprising a waveguide and the laser scanning display control system of the second aspect described above.

[0018] In the scheme of the embodiment of the present application, the image receiving module receives image data on one side of the binocular side of the near-eye display device, the image sending module determines its own working state according to the type of the image data, and synchronously forwards or does not process the image data based on the working state, the image processing module processes the received image data and stores it in the image buffer, the light source driving module reads the image data from the image buffer, converts it and drives the light source to light up and display the image, the scanning driving module generates a scanning driving signal, and scans the scanner according to the scanning driving signal, and the clock module obtains the second clock according to the first clock received by the image receiving module, and provides the second clock to the light source driving module and the scanning driving module respectively to achieve synchronization between the light source and the scanner. Therefore, the embodiment of the present application reduces the size of the image buffer configured for the laser scanning display, thereby saving the area of ​​the dedicated integrated circuit and reducing the power consumption generated by the dedicated integrated circuit, and by adaptively adjusting the binocular synchronous transmission of the image data in the near-eye display device according to the image data type corresponding to different display modes, it can reduce the resources occupied by some modules while taking into account multiple display modes, and further reduce the power consumption generated by the dedicated integrated circuit. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0020] Figure 1 A schematic diagram of an existing fiber optic scanning display system.

[0021] Figure 2 Schematic diagram of the grid-type optical fiber scanning trajectory.

[0022] Figure 3 Schematic diagram of a laser scanning display control device according to an embodiment of the present application.

[0023] Figure 4 Schematic diagram of a laser scanning display control device according to another embodiment of the present application.

[0024] Figure 5 4 is a structural block diagram of a light source driving module of a laser scanning display control device according to another embodiment of the present application.

[0025] Figure 6 4 is a structural block diagram of a scanning driving module of a laser scanning display control device according to another embodiment of the present application.

[0026] Figure 7 Schematic diagram of a fiber optic scanning display system according to another embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the embodiments of the present application should fall within the scope of protection of the embodiments of the present application.

[0028] Reference is made to the accompanying drawings in the following detailed description, which form a part of the detailed description and illustrate exemplary embodiments. In addition, it is to be understood that other embodiments may be utilized and structural and / or logical changes may be made without departing from the scope of the claimed subject matter. It should also be noted that directions and references (e.g., up, down, top, bottom, etc.) may be used merely to facilitate the description of features in the accompanying drawings. Therefore, the following detailed description is not to be understood in a limiting sense, and the scope of the claimed subject matter is limited only by the appended claims and their equivalents.

[0029] In the following description, numerous details are set forth. However, it will be apparent to those skilled in the art that the embodiments herein can be practiced without these specific details. In some cases, known methods and devices are shown in block diagram form, rather than in detail, to avoid blurring the embodiments herein. References to "embodiment" or "one embodiment" or "some embodiments" throughout this specification mean that the specific features, structures, functions or characteristics described in conjunction with the embodiment are included in at least one embodiment herein. Therefore, the phrases "in an embodiment" or "in one embodiment" or "some embodiments" appearing throughout this specification do not necessarily refer to the same embodiment. In addition, in one or more embodiments, specific features, structures, functions or characteristics may be combined in any suitable manner. For example, the first embodiment may be combined with the second embodiment in any case where the specific features, structures, functions or characteristics associated with the two embodiments are not mutually exclusive.

[0030] As used in the description and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0031] The terms "coupled" and "connected" together with their derivatives may be used in this article to describe the functional or structural relationship between components. It should be understood that these terms are not intended to be synonymous with each other. On the contrary, in a particular embodiment, "connected" can be used to indicate that two or more elements are in direct physical, optical or electrical contact with each other. "Coupled" can be used to indicate that two or more elements are in direct or indirect (with other intermediate elements between them) physical or electrical contact with each other, and / or that two or more elements cooperate or interact with each other (e.g., as in a cause-and-effect relationship).

[0032] As used herein, the terms "above," "below," "between," and "on" refer to the relative position of one component or material with respect to other components or materials where such physical relationship is noteworthy. For example, in the context of materials, a material or materials disposed above or below another material may be in direct contact, or may have one or more intervening materials. Also, a material disposed between two materials or materials may be in direct contact with both layers, or may have one or more intervening layers. In contrast, a first material or material "above" a second material or material is in direct contact with the second material / materials. Similar distinctions are made in the context of component assembly.

[0033] As used throughout the description herein and in the claims, a list of items connected by the term "at least one of" or "one or more of" may mean any combination of the listed items. For example, the phrase "at least one of A, B, or C" may mean A; B; C; A and B; A and C; B and C; or A, B, and C.

[0034] The term "circuit" or "module" may refer to one or more passive and / or active components that are arranged to cooperate with each other to provide a desired functionality. The term "signal" may refer to at least one current signal, voltage signal, or magnetic signal. The terms "substantially," "close," "approximately," "close to," and "approximately" generally refer to within + / - 10% of a target value.

[0035] In order to facilitate the understanding of the implementation of the embodiments of the present application, the special terms involved in the embodiments of the present application are explained.

[0036] FLASH: Flash memory, non-volatile memory, internal data can still be saved after power failure.

[0037] DAC: Digital to analog converter, digital to analog conversion.

[0038] RAM: Random access memory.

[0039] DDS: Direct digital synthesizer.

[0040] MIPI: Mobile industry processor interface, mobile industry processor interface.

[0041] HDMI: High definition multimedia interface.

[0042] DP: DisplayPort, display interface.

[0043] PLL: Phase locked loop.

[0044] ASIC: Application specific integrated circuit.

[0045] The specific implementation of the embodiment of the present application is further explained below in conjunction with the accompanying drawings of the embodiment of the present application.

[0046] See also Figure 1 The main principle of fiber scanning display (FSD) technology is: the electric field drives the scanner 11 to generate high-frequency, high-speed, and tiny two-dimensional motion. The scanner 11 is fixed with an optical fiber 12, and the end face of the optical fiber 12 resonates with the scanner 11 to generate fast two-dimensional motion. The laser output by the laser 13 is coupled into the optical fiber 12, transmitted in the optical fiber 12, and scanned through the end face of the optical fiber 12 to form an image.

[0047] When the system based on scanning imaging is working, the laser 13 (RGB laser) is modulated according to the image data to be displayed, and the image display is realized by controlling the switching of the laser 13 and the change of the output power.

[0048] The microcircuit 14 is used to drive the scanner 11 to scan, thereby driving the optical fiber 12 to generate rapid two-dimensional motion, and scanning and outputting the light beam transmitted in the optical fiber 12.

[0049] Figure 1 The connection relationship between the microcircuit 14 and the drive scanner 11 and the laser 13 is shown in FIG. Figure 1 The dashed lines are used in the figure).

[0050] The light beam output by the optical fiber 12 acts on a certain pixel position on the surface of the medium and forms a light spot at the pixel position, thus realizing the scanning of the pixel position. In the actual scanning process, the light beam output by the transmission optical fiber will form a light spot with corresponding image information at each pixel position. In one frame of time, the light beam traverses each pixel position at a sufficiently high speed to complete the scanning of one frame of image. Due to the characteristic of residual vision when the human eye observes things, it is impossible to perceive the movement of the light beam at each pixel position. Therefore, the human eye can see a complete frame of image.

[0051] The image buffer of fiber scanning display is different from the traditional display mode, and needs to be matched with the fiber scanning mode for image output. Generally speaking, there are three types of fiber scanning modes, namely grid type, Lissajous figure and spiral type. Taking the grid type as an example, Figure 2 Schematic diagram of the grid-type optical fiber scanning trajectory.

[0052] The optical fiber moves periodically from top to bottom and then from bottom to top in the longitudinal direction (vertical direction); the optical fiber moves periodically from left to right and then from right to left in the transverse direction (horizontal direction). Scanning in two directions is called two-dimensional scanning. So the actual scanning trajectory of the optical fiber is Figure 2 The track shown starts from the starting point on the upper left, moves to the right, reaches the end of the first row, and the fiber turns back, and gradually moves downward. When it scans to the end (lower right position), it scans back (from bottom to top). This goes back and forth.

[0053] If you want to display an image, you need to output the pixels on a frame of the image one by one in the order of the scanning trajectory during the scanning process. Therefore, when caching the image, you also need to cache it according to the corresponding rules.

[0054] The image caching of Lissajous figures and spiral scanning is similar, and the image caching needs to be performed in the order of optical fiber scanning, so it will not be repeated here.

[0055] Therefore, laser scanning display often requires a larger image buffer to achieve image output. The larger the area of ​​the dedicated integrated circuit occupied by the image buffer, the greater the power consumption generated by the dedicated integrated circuit. In addition, while providing a variety of display modes, there will also be a waste of some resources, further affecting the overall power consumption of the dedicated integrated circuit.

[0056] To solve the above problems, see Figure 3 The embodiment of the present application provides a laser scanning display control device 3, which is applied to a near-eye display device, including:

[0057] An image receiving module 31 is used to receive image data on one side of the binocular side of the near-eye display device;

[0058] The image sending module 37 is used to determine its own working state according to the type of the image data, and synchronously forward the image data or not process it based on the working state.

[0059] The image processing module 38 is used to process the image data.

[0060] The image buffer 32 is used to receive the processed image data from the image processing module.

[0061] The light source driving module 33 is used to read the processed image data from the image buffer, convert the processed image data and drive the light source to light up to display the image.

[0062] The scanning driving module 34 is used to generate a scanning driving signal according to the processed image data read by the light source driving module and the driving waveform data required by the scanner, and scan the scanner according to the scanning driving signal.

[0063] The clock module 35 is used to obtain a second clock according to the first clock received by the image receiving module, and provide the second clock to the light source driving module and the scanning driving module respectively to achieve synchronization between the light source and the scanner.

[0064] The laser scanning display control device 3 of the embodiment of the present application is arranged Figure 1 In the microcircuit 14, the scanner 11 is driven to scan, thereby driving the optical fiber 12 to generate a fast two-dimensional motion, and the light beam transmitted in the optical fiber 12 is scanned and output.

[0065] Specifically, the image receiving module 31 of the present application is an image interface located on one side of the binocular side of the near-eye display device, which is used to complete image reception (such as MIPI, LVDS interface, etc.).

[0066] The image sending module 37 is used to adaptively adjust its own working state according to the type of image data in different display modes, and realize synchronous forwarding or no processing of the image data according to its own working state.

[0067] The image processing module 38 is used to perform necessary image processing (such as Gamma correction, etc.) before display.

[0068] The image buffer 32 is usually an image buffer RAM, which buffers the image data processed by the image processing module 38 .

[0069] See also Figure 4The embodiment of the present application further includes: a parameter storage module 36 (FLASH). The parameter storage module 36 completes parameter storage and parameter initialization when power is turned on. The parameters include: parameters of the scanning driving module, parameters of the light source driving module, etc.

[0070] Specifically, the display modes of near-eye display devices (such as AR glasses) may include a planar vision mode and a stereoscopic vision mode. The planar vision mode is suitable for some ordinary image viewing, document browsing and other scenarios. In the planar vision mode, the user can only see the image on the plane and cannot perceive the depth and stereoscopic effect of the image. The image source of the near-eye display device outputs single-channel image data, and the image data is mainly transmitted at the image interface of one eye of the near-eye display device. An additional configuration module is required to realize binocular synchronous transmission of image data; while in the stereoscopic vision mode, since this mode is suitable for VR, AR and other scenarios that require stereoscopic perception, in the stereoscopic vision mode, the user can perceive the depth and stereoscopic effect through binocular observation, thereby obtaining a more immersive visual experience. The image source of the near-eye display device will output dual-channel image data, and the dual-channel image data is two sets of parallax image data containing different information. The image data will be transmitted at the image interfaces of the two eyes of the near-eye display device respectively, and each eye receives different parallax image data, thereby producing a stereoscopic effect on the user's two eyes. In this display mode, no additional configuration module is required to realize the synchronous transmission of image data in both eyes. In order to provide diversified display functions, the display mode of the near-eye display device will be designed in combination with the planar vision mode and the stereoscopic vision mode. Therefore, in order to ensure that the image data can be synchronously displayed and controlled in both eyes regardless of the display mode, in the design of the dedicated integrated circuit, an additional configuration module is often used to ensure the synchronous transmission of the image according to the image output type of the planar vision mode, and the above module is always turned on by default, that is, whether in the planar vision or stereoscopic vision display mode, the module is in use. Even in the stereoscopic vision mode, when no additional configuration module is required to realize the synchronous transmission of image data in both eyes, the above module will still occupy and consume part of the system resources, thereby increasing the power consumption generated by the dedicated integrated circuit. In order to solve the above problems, The image sending module in the implementation of the present application can adjust itself to a use state according to the type of received image data when it is determined that the image data is single-channel image data. After the image receiving module receives the image data from the image interface of one eye of the near-eye display device, it spontaneously starts reading the image data and synchronizes the read image data to the image interface of the other eye of the near-eye display device, so as to achieve binocular synchronization of the image data. When it is determined that the image data is dual-channel image data, it adjusts itself to a closed state, thereby prohibiting any processing of the image data, thereby adaptively adjusting the data transmission according to the different image data types, reducing unnecessary resource occupation, and providing different display modes while further reducing the power consumption generated by the dedicated integrated circuit.

[0071] The embodiment of the present application uses a second clock to achieve synchronization between the light source driving module and the scanning driving module, and the second clock is obtained according to the first clock received by the image receiving module. Therefore, the embodiment of the present application reduces the size of the image buffer configured for the laser scanning display, thereby saving the area of ​​the application-specific integrated circuit (ASIC) and reducing the power consumption generated by the application-specific integrated circuit.

[0072] Specifically, the first clock and the second clock come from the same crystal oscillator or phase-locked loop circuit (PLL).

[0073] Crystal oscillator is a commonly used clock component in circuits. Its full name is crystal oscillator. Phase locked loop (PLL) is a negative feedback control system that uses the voltage generated by phase synchronization to tune the voltage controlled oscillator to produce the target frequency.

[0074] In the embodiment of the present application, the first clock and the second clock are homologous clocks. The scanning drive module generates a scanning drive signal and completes the synchronous image output of the light source drive module. The display can be completed using a very small image buffer. If the system is implemented as a dedicated integrated circuit, the area of ​​the dedicated integrated circuit will be reduced and the power consumption of the dedicated integrated circuit will be reduced.

[0075] The crystal oscillator or phase-locked loop circuit used in the embodiment of the present application is used as the first clock and the second clock to achieve the same source of the first clock and the second clock, making the design of the clock circuit simpler and enabling easy implementation of area saving and power consumption reduction of the dedicated integrated circuit.

[0076] In a specific implementation of the first embodiment of the present application, the clock module is a second clock obtained by dividing or multiplying the first clock.

[0077] The embodiment of the present application can achieve synchronization between the scanning driving module and the light source driving module through simple clock processing, thereby simplifying the circuit design and reducing the cost of the dedicated integrated circuit.

[0078] In the specific implementation of the first embodiment of the present application, the size of the image buffer is calculated using Formula 1, which is: size1 = H*(1-Fa / (Fa+ Δ f)).

[0079] Wherein size1 is the size of the image buffer, Fa is the first line frequency at which the image receiving module receives the image data, H is the total height of the image data, Δ f is the process frequency deviation.

[0080] The embodiment of the present application determines the image buffer size according to the deviation between the first line frequency of the image data received by the image receiving module and the process frequency, so as to achieve that the size of the image buffer meets the requirements of the scanner at Fa±Δ f, so that the image buffer meets the scanning rule of the scanner, that is, during the scanning process, the pixels on a frame of image need to be output one by one in the order of the scanning trajectory.

[0081] Specifically, the process frequency deviation is a frequency deviation of the first line frequency of the image data caused by the process. As the process becomes more uniform, the process frequency deviation will gradually decrease.

[0082] In a specific implementation of the first embodiment of the present application, the image buffer includes a used part and a remaining part, the cache blocks of the used part are in a used state, and the cache blocks of the remaining part are in a closed state.

[0083] The embodiment of the present application separates the used part from the remaining part, the cache blocks of the used part are in use state, and the cache blocks of the remaining part are in a closed state, thereby reducing the power consumption of the cache blocks of the remaining part.

[0084] Specifically, the first line frequency of the image data received by the image receiving module in the embodiment of the present application and the second line frequency of the scanning by the scanner determine the image buffer size, including:

[0085] If the first line frequency is equal to the second line frequency, the size of the image buffer is greater than or equal to one line of image data.

[0086] If the first line frequency is greater than the second line frequency, the size of the image buffer is calculated using Formula 1. Formula 2 is: size2=H*(1 / Fb-1 / Fa) / (1 / Fb).

[0087] If the first line frequency is less than the second line frequency, the size of the image buffer is calculated using Formula 2. Formula 3 is: size2=H*(1 / Fa-1 / Fb) / (1 / Fa).

[0088] Among them, size2 is the size of the used part of the image buffer, Fb is the second line frequency, Fa is the first line frequency of the image receiving module receiving the image data, and H is the total height of the image data.

[0089] In the embodiment of the present application, the size of the image buffer is obtained by establishing different formulas based on the size relationship between the first line frequency and the second line frequency, so that the image buffer can meet the requirements of different scanners and image receiving modules.

[0090] See also Figure 5 In the specific implementation of the first embodiment of the present application, the light source driving module 35 includes:

[0091] The driving unit 331 is used to read the processed image data from the image buffer 32 and generate a light source driving signal.

[0092] The light source DAC unit 332 is used to perform DAC conversion according to the light source driving signal provided by the driving unit 331, and drive the light source to light up to display an image.

[0093] The light source feedback unit 333 is used to monitor the response of the light source and collect feedback data of the light source.

[0094] The control unit 334 is used to adjust (in some embodiments, the adjustment can be considered as positive compensation or negative compensation) the intensity of the light source driven by the light source DAC unit 332 according to the feedback data of the light source provided by the light source feedback unit 334.

[0095] Since the laser is susceptible to the influence of temperature, humidity, and long-term working aging, which leads to performance degradation, wavelength drift, output power changes, etc., it will cause color and grayscale distortion, as well as brightness changes caused by light loss during fiber optic transmission. Therefore, during the fiber optic scanning display process, it is necessary to monitor the response of the light source. The light source feedback unit generally collects the optical characteristics of the scanned image (including brightness, chromaticity, etc.) as feedback data, and adjusts the intensity of the light source DAC unit driving the light source to achieve this. The embodiment of the present application monitors the light source response through the light source feedback unit, collects light source feedback data, and adjusts the intensity of the light source driven by the light source DAC unit according to the light source feedback data provided by the light source feedback unit, thereby improving the effect of the light source driving module and avoiding brightness changes caused by laser performance degradation.

[0096] See also Figure 6 In the specific implementation of the first embodiment of the present application, the scanning driving module 34 includes:

[0097] The waveform unit 341 is used to store the driving waveform data required by the scanner.

[0098] The scanning feedback unit 342 is used to monitor the response of the scanner and collect scanning feedback data of the scanner.

[0099] The DDS unit 343 is used to generate a scanning driving signal according to the driving waveform data provided by the waveform unit 341 and the processed image data provided by the driving unit 331, and adjust the scanning driving signal according to the scanning feedback data provided by the scanning feedback unit 342.

[0100] The scanning DAC unit 344 is used to perform DAC conversion on the scanning driving signal sent by the DDS unit 343 and drive the scanner to scan.

[0101] Specifically, the waveform unit 341 is a RAM memory, which stores the driving waveform required by the scanner, is updated by the parameter storage module 35 when powered on, and stores waveforms in the two axes of X and Y in two-dimensional scanning.

[0102] The DDS unit 343 generates driving signals for two axes X and Y for two-dimensional scanning. The scanning DAC unit 344 performs digital-to-analog conversion on the driving signals output by the DDS unit 333 to drive the scanner to scan. Two-dimensional scanning requires driving signals for two axes X and Y.

[0103] Fiber scanning display uses a scanner to drive the optical fiber to vibrate at high speed. In order to achieve the maximum amplitude of vibration, the optical fiber generally works in a resonant mode. The scanning characteristics of the optical fiber in the resonant state are complex. Due to the nonlinear effect of vibration, the symmetry and stability of the installation of the optical fiber and the scanner, when the optical fiber vibrates at a large amplitude in the resonance area, the scanning trajectory may be distorted, affecting the image display effect. Therefore, during the fiber scanning display process, it is necessary to monitor the response of the scanner.

[0104] The feedback of the scanning feedback unit 342 includes visual feedback, sensor feedback, electrical signal feedback, etc. Different feedback methods collect feedback signals from different sources, but the feedback principles are similar. The real-time status of the scanner is reflected through the scanning feedback data, and the scanning drive signal is adjusted, so that the scanned image is finally close to the ideal state to ensure the image display effect.

[0105] Figure 7 This is another embodiment of the fiber scanning display system according to the present application. The fiber scanning display system of this embodiment includes: a laser scanning display control device 701 , an optical fiber 702 , and a scanner 703 .

[0106] The laser scanning display control device 701 is as described in any of the above embodiments.

[0107] The present application also provides a near-eye display device, including a waveguide and Figure 7 Laser scanning display control system.

[0108] Therefore, the embodiment of the present application reduces the size of the image buffer configured for the laser scanning display, thereby saving the area of ​​the dedicated integrated circuit and reducing the power consumption generated by the dedicated integrated circuit.

[0109] In addition, the specific implementation of each step in the program can refer to the corresponding description of the corresponding steps and units in the above method embodiment, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above method embodiment, which will not be repeated here.

[0110] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present application.

[0111] The above-mentioned method according to the embodiment of the present application can be implemented in hardware, firmware, or implemented as software or computer code that can be stored in a recording medium (such as a CD ROM, RAM, floppy disk, hard disk or magneto-optical disk), or implemented as a computer code originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the method described herein can be stored in such software processing on a recording medium using a general-purpose computer, a special-purpose processor or programmable or special-purpose hardware (such as an ASIC or FPGA). It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code, and when the software or computer code is accessed and executed by a computer, a processor or hardware, the method described herein is implemented. In addition, when a general-purpose computer accesses the code for implementing the method shown here, the execution of the code converts the general-purpose computer into a special-purpose computer for executing the method shown here.

[0112] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.

[0113] The above implementation methods are only used to illustrate the embodiments of the present application, and are not limitations on the embodiments of the present application. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present application. The scope of patent protection of the embodiments of the present application should be limited by the claims.

Claims

1. A laser scanning display control device, characterized in that: Applied to a near-eye display device, the device comprises: An image receiving module, configured to receive image data at one side of the binocular side of the near-eye display device; An image sending module, used to determine its own working state according to the type of the image data, and synchronously forward or not process the image data based on the working state; An image processing module, used for processing the image data; An image buffer, used for receiving the processed image data from the image processing module; A light source driving module, used for reading the processed image data from the image buffer, converting the processed image data and driving the light source to light up to display an image; a scanning driving module, used for generating a scanning driving signal according to the processed image data read by the light source driving module and the driving waveform data required by the scanner, and scanning the scanner according to the scanning driving signal; The clock module is used to obtain a second clock according to the first clock received by the image processing module, and provide the second clock to the light source driving module and the scanning driving module respectively to achieve synchronization between the light source and the scanner.

2. The laser scanning display control device according to claim 1, characterized in that: The types of the image data include single-channel image data and dual-channel image data. When the image data is single-channel image data, the image sending module is used to adjust itself to a use state to start reading the image data and synchronously transmit the read image data to the other side of the binocular side of the near-eye display device; as well as When the image data is dual-channel image data, the image sending module is used to adjust itself to a closed state to prohibit operation on the image data.

3. The laser scanning display control device according to claim 2, characterized in that: The first clock and the second clock come from the same crystal oscillator or phase-locked loop circuit.

4. The laser scanning display control device according to claim 3, characterized in that: The clock module is a second clock obtained by dividing or multiplying the first clock.

5. The laser scanning display control device according to claim 4, characterized in that: The size of the image buffer is calculated using Formula 1, which is: size1 = H*(1-Fa / (Fa+ Δ f)); Wherein size1 is the size of the image buffer, Fa is the first line frequency at which the image receiving module receives the image data, H is the total height of the image data, Δ f is the process frequency deviation.

6. The laser scanning display control device according to claim 5, characterized in that: The image buffer includes a used part and a remaining part, the cache blocks of the used part are in a used state, and the cache blocks of the remaining part are in a closed state.

7. The laser scanning display control device according to claim 6, characterized in that: If the first line frequency is equal to the second line frequency of the scanner, the size of the used portion of the image buffer is greater than or equal to one line of image data; If the first line frequency is greater than the second line frequency, the size of the used portion of the image buffer is calculated using Formula 2, which is: size2=H*(1 / Fb-1 / Fa) / (1 / Fb); If the first line frequency is less than the second line frequency, the size of the used portion of the image buffer is calculated using Formula 3, where: size2=H*(1 / Fa-1 / Fb) / (1 / Fa); Among them, size2 is the size of the used part of the image buffer, and Fb is the second line frequency.

8. The laser scanning display control device according to claim 7, characterized in that: The size of the remaining portion is determined according to the size of the used portion.

9. The laser scanning display control device according to any one of claims 1 to 8, characterized in that: The light source driving module comprises: A driving unit, configured to read the processed image data from the image buffer and generate a light source driving signal; A light source DAC unit, used for performing DAC conversion according to the light source driving signal provided by the driving unit, and driving the light source to light up to display an image; A light source feedback unit, used to monitor the response of the light source and collect feedback data of the light source; A control unit is used to adjust the intensity of the light source driven by the light source DAC unit according to the feedback data of the light source provided by the light source feedback unit.

10. The laser scanning display control device according to claim 9, characterized in that: The scanning driving module comprises: A waveform unit, used for storing driving waveform data required by the scanner; A scanning feedback unit, used to monitor the response of the scanner and collect scanning feedback data of the scanner; a DDS unit, configured to generate a scan drive signal according to the drive waveform data provided by the waveform unit and the processed image data provided by the drive unit, and to adjust the scan drive signal according to the scan feedback data provided by the scan feedback unit; The scanning DAC unit is used to perform DAC conversion on the adjusted scanning driving signal sent by the DDS unit and drive the scanner to scan.

11. A laser scanning display control system, characterized in that: It comprises a scanner and the laser scanning display control device as described in any one of claims 1-10.

12. A near-eye display device, characterized in that: It comprises a waveguide and a laser scanning display control system as claimed in claim 11.

Images