Laser scanning display control device and system and near-to-eye display equipment

Abstract

The embodiment of the invention provides a laser scanning display control device and system and near-to-eye display equipment, and the device comprises an image receiving module which is used for receiving image data at one side of the binocular sides of the near-to-eye display equipment; the image sending module is used for determining the working state of the image sending module according to the type of the image data and synchronously forwarding or not processing the image data based on the working state; the image processing module is used for processing the image data; the image buffer is used for receiving the processed image data from the image processing module; the light source driving module is used for reading the processed image data from the image buffer, converting the processed image data and driving a light source to be lightened so as to display an image; the scanning driving module is used for generating a scanning driving signal according to the processed image data read by the light source driving module and driving waveform data required by the scanner, and scanning the scanner according to the scanning driving signal; and the clock module is used for obtaining a second clock according to the first clock received by the image processing module and respectively providing the second clock to the light source driving module and the scanning driving module so as to realize synchronization of the light source and the scanner.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of computer, and particularly, to a laser scanning display control device, system and near-eye display device. BACKGROUND

[0002] As an emerging display imaging technology, laser scanning display can be realized by a scanner such as a Micro-Electro-Mechanical Systems (MEMS) scanning mirror or a Fiber Scanner. The technology can be applied to various display environments such as projection display and near-eye display. In the near-eye display environment, the image displayed by the scanner is different from that in the traditional display mode, and needs to be output in cooperation with the scanning mode and the display mode.

[0003] Therefore, laser scanning display often needs to configure a large image buffer to realize image output. The larger the area of the image buffer occupies in the application-specific integrated circuit, the greater the power consumption of the application-specific integrated circuit will be. In addition, while providing diversified display modes, there is also a waste of part of the resources, which further affects the overall power consumption of the application-specific integrated circuit. SUMMARY

[0004] In view of the above, embodiments of the present application provide a laser scanning display control device, system and near-eye display device to at least partially solve the above problems.

[0005] According to a first aspect of embodiments of the present application, a laser scanning display control device is provided, applied to a near-eye display device, and characterized in that the device comprises: an image receiving module, configured to receive image data at one side of binocular sides of the near-eye display device; an image sending module, configured to determine a working state of itself according to a type of the image data, and to synchronously forward the image data or not to process the image data based on the working state; an image processing module, configured to process the image data; an image buffer, configured to receive the processed image data from the image processing module; a light source driving module, configured to read the processed image data from the image buffer, to convert the processed image data and to drive a light source to light up to display an image; a scanning driving module, configured to generate a scanning driving signal according to the processed image data read by the light source driving module and driving waveform data required by a scanner, and to scan the scanner according to the scanning driving signal; and a clock module, configured to obtain a second clock according to a first clock received by the image processing module, and to provide the second clock to the light source driving module and the scanning driving module respectively to realize synchronization of the light source and the scanner.

[0006] In another implementation of this application, the image data type includes single-channel image data and dual-channel image data. When the image data is single-channel image data, the image transmitting module is configured to adjust itself to a working state to initiate the reading of the image data and synchronously transmit the read image data to the other side of the binocular side of the near-eye display device; and

[0007] When the image data is dual-channel image data, the image sending module is used to turn itself off to prevent operation on the image data.

[0008] In another implementation of this application, the first clock and the second clock come from the same crystal oscillator or phase-locked loop circuit.

[0009] In another implementation of this application, the clock module is a second clock obtained by dividing or multiplying the first clock.

[0010] In another implementation of this application, the size of the image buffer is calculated using Formula 1, which is: size1 = H * (1 - Fa / (Fa + ... Δ f)); where size1 is the size of the image buffer, Fa is the first line frequency of the image data received by the image receiving module, and H is the total height of the image data. Δ f represents the process frequency deviation.

[0011] In another implementation of this application, the image buffer includes a used portion and a remaining portion, wherein the buffer blocks of the used portion are in a used state and the buffer blocks of the remaining portion are in a closed state.

[0012] In another implementation of this application, if the first line frequency is equal to the second line frequency scanned by the scanner, the size of the used portion of the image buffer is greater than or equal to one line of image data; if the first line frequency is greater than the second line frequency, the size of the used portion of the image buffer is calculated using Formula 2, which is: size2 = H * (1 / Fb - 1 / Fa) / (1 / Fb); if the first line frequency is less than the second line frequency, the size of the used portion of the image buffer is calculated using Formula 3, which is: size2 = H * (1 / Fa - 1 / Fb) / (1 / Fa); where size2 is the size of the used portion of the image buffer, and Fb is the second line frequency.

[0013] In another implementation of this application, the size of the remaining portion is determined based on the size of the used portion.

[0014] In another implementation of the present application, the light source driving module comprises: a driving unit configured to read the processed image data from the image buffer and generate a light source driving signal; a light source DAC unit configured to perform DAC conversion on the light source driving signal provided by the driving unit and drive the light source to display an image; a light source feedback unit configured to monitor the response of the light source and collect feedback data of the light source; and a control unit configured to adjust the intensity of the light source driven by the light source DAC unit according to the feedback data provided by the light source feedback unit.

[0015] In another implementation of the present application, the scanning driving module comprises: a waveform unit configured to store driving waveform data required by the scanner; a scanning feedback unit configured to monitor the response of the scanner and collect scanning feedback data of the scanner; a DDS unit configured to generate a scanning driving signal according to the driving waveform data provided by the waveform unit and the processed image data provided by the driving unit, and adjust the driving signal according to the scanning feedback data provided by the scanning feedback unit; and a scanning DAC unit configured to perform DAC conversion on the adjusted scanning driving signal sent by the DDS unit and drive the scanner to perform scanning.

[0016] According to a second aspect of the embodiments of the present application, a laser scanning display control system is provided, comprising a scanner and the laser scanning display control device of the first aspect.

[0017] According to a third aspect of the embodiments of the present application, a near-eye display device is provided, comprising a waveguide and the laser scanning display control system of the second aspect.

[0018] In the scheme of the embodiment of the present application, the image receiving module receives image data at one side of the binocular side of the near-eye display device, the image sending module determines the working state of itself according to the type of the image data, and synchronously forwards the image data or does not process the image data based on the working state, the image processing module processes the received image data and stores the image data into the image buffer, the light source driving module reads the image data from the image buffer, converts the image data and drives the light source to display the image, the scanning driving module generates a scanning driving signal and scans the scanner according to the scanning driving signal, and the clock module obtains a second clock according to a first clock received by the image receiving module, and provides the second clock to the light source driving module and the scanning driving module to realize the synchronization of the light source and the scanner. Therefore, the embodiment of the present application reduces the size of the image buffer configured for the laser scanning display, thereby saving the area of the application-specific integrated circuit and reducing the power consumption generated by the application-specific integrated circuit, and by adaptively adjusting the binocular synchronization transmission of the image data in the near-eye display device according to the image data type corresponding to different display modes, the resources occupied by part of the modules can be reduced while multiple display modes are taken into account, and the power consumption generated by the application-specific integrated circuit is further reduced. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the embodiments of the present application, and other drawings can also be obtained by those skilled in the art based on these drawings.

[0020] Figure 1 It is a schematic diagram of an existing optical fiber scanning display system.

[0021] Figure 2 It is a schematic diagram of a grid format optical fiber scanning track.

[0022] Figure 3 It is a schematic diagram of a laser scanning display control device according to an embodiment of the present application.

[0023] Figure 4 It is a schematic diagram of a laser scanning display control device according to another embodiment of the present application.

[0024] Figure 5 It is a structural block diagram of a light source driving module of a laser scanning display control device according to still another embodiment of the present application.

[0025] Figure 6 It is a structural block diagram of a scanning driving module of a laser scanning display control device according to still another embodiment of the present application.

[0026] Figure 7 FIG. 6 is a schematic diagram of a fiber scanning display system according to yet another embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to make persons skilled in the art better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and specifically described below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by persons skilled in the art should belong to the scope of protection of the present application.

[0028] Reference will now be made to the drawings, which depict example embodiments, in which like reference numerals identify like elements in the various figures. Reference to these drawings is not intended as a limitation on the scope of the present application. Any

[0029] In the following description, numerous specific details are set forth. However, it is understood that embodiments herein can be practiced without the specific details. In some instances, well-known methods and devices are shown in block diagram form, rather than in detail, in order to avoid obscuring the embodiments herein. Reference throughout this specification to "an embodiment" or "one embodiment" or "some embodiments" means that a particular feature, structure, function, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Therefore, the appearance of the phrases "in one embodiment" or "in some embodiments" in various places throughout this specification are not necessarily referring to the same embodiment. Furthermore, the particular features, structures, functions, or characteristics can be combined in any suitable manner in one or more embodiments. For example, a first embodiment can be combined with a second embodiment in any case where the particular features, structures, functions, or characteristics associated with the two embodiments are not mutually exclusive.

[0030] As used in the description and the appended claims, the singular forms "a," "an," and "the" are intended to include plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0031] The terms "coupled" and "connected," along with their derivatives, can be used herein to describe functional or structural relationships between components. It should be understood that these terms are not intended as synonyms for each other. Rather, in particular embodiments, "connected" can be used to indicate that two or more elements are in direct physical, optical, or electrical contact with each other. "Coupled" can be used to indicate that two or more elements are in either direct or indirect (with other intermediate elements between them) physical or electrical contact with each other, and / or that the two or more elements co-operate or interact with each other (e.g., as in a cause an effect relationship).

[0032] The terms "over," "under," "between," and "on," as used herein refer to a relative position of one component or material with respect to other components or materials where such physical relationships are noteworthy. For example, in the context of materials, one material or material disposed over or under another can have a direct contact or can have one or more intervening materials. Also, one material or material disposed between two materials or materials can have direct contact with the two layers or can have one or more intervening layers. In contrast, a first material or material "on" a second material or material is in direct contact with that second material / material. Similar distinctions are to be made in the context of assembly of components.

[0033] As used throughout this description and in the claims, a list of items joined by the term "at least one of" or "one or more of can mean any combination of the listed terms. For example, the phrases "at least one of A, B, or C" can mean A; B; C; A and B; A and C; B and C; or A, B, and C.

[0034] The term "circuit" or "module" can refer to one or more passive and / or active components that are arranged to co-operate with each other to provide a desired function. The term "signal" can refer to at least one current signal, voltage signal, or magnetic signal. The terms "substantially," "close," "approximately," "near," and "about" typically mean within + / - 10% of a target value.

[0035] In order to facilitate the understanding of the embodiments of the present application, the special terms involved in the embodiments of the present application are explained.

[0036] FLASH: Flash, non-volatile memory, internal data can still be saved after power off.

[0037] DAC: Digitial to analog converter, digital to analog conversion.

[0038] RAM: Random access memory, random access memory.

[0039] DDS: Direct digital synthesizer

[0040] MIPI: Mobile industry processor interface

[0041] HDMI: High definition multimedia interface

[0042] DP: DisplayPort

[0043] PLL: Phase locked loop

[0044] ASIC: Application specific integrated circuit

[0045] The specific implementation of the embodiments of the present application is further described below in conjunction with the accompanying drawings of the embodiments of the present application.

[0046] Referring to Figure 1 , the main principle of the fiber scanning display (FSD) technology is that a high-frequency high-speed micro two-dimensional motion is generated by an electric field driving scanner 11. The scanner 11 is fixed with an optical fiber 12, and the end face of the optical fiber 12 resonates with the scanner 11 to generate rapid two-dimensional motion. The laser output by the laser 13 is coupled into the optical fiber 12, transmitted in the optical fiber 12, and scanned to form an image through the end face of the optical fiber 12.

[0047] When the system based on scanning imaging works, the laser 13 (RGB laser) is modulated according to the image data to be displayed, and the image display is realized by controlling the on-off and output power change of the laser 13.

[0048] The microcircuit 14 is used to drive the scanner 11 to perform scanning, so as to drive the optical fiber 12 to generate rapid two-dimensional motion, and scan the light beam transmitted in the optical fiber 12 to output.

[0049] Figure 1 The connection relationship between the microcircuit 14 and the driving scanner 11 and the laser 13 is shown in Figure 1 , which is represented by a horizontal dotted line.

[0050] The light beam output by the optical fiber 12 acts on a pixel position on the medium surface and forms a light spot on the pixel position, thereby realizing scanning of the pixel position. In the actual scanning process, the light beam output by the transmission optical fiber will form a light spot with corresponding image information at each pixel position. In a frame of time, the light beam traverses each pixel position at a high enough speed to complete scanning of a frame of image. Since the human eye has a visual residual characteristic when observing things, the movement of the light beam on each pixel position cannot be perceived, and therefore the human eye can see a complete image of a frame.

[0051] The image buffer of the optical fiber scanning display is different from the traditional display mode and needs to cooperate with the optical fiber scanning mode for image output. Generally, the optical fiber scanning mode includes three types, namely, a grid format, a Lissajous figure, and a spiral type. Taking the grid format as an example, Figure 2 FIG. 1 is a schematic diagram of a grid format optical fiber scanning trajectory.

[0052] The optical fiber is periodically moved from top to bottom and then from bottom to top in the longitudinal direction (vertical direction); and the optical fiber is periodically moved from left to right and then from right to left in the transverse direction (horizontal direction). The scanning in the two directions is called two-dimensional scanning. Therefore, the actual scanning trajectory of the optical fiber is the trajectory shown in FIG. 1, that is, starting from the starting point at the top left, running to the right, reaching the end position of the first row, returning while gradually moving downward, scanning to the end position (the position at the bottom right), and then returning (scanning from bottom to top once). Such reciprocation is repeated. Figure 2

[0053] If an image is to be displayed, the pixel points on a frame of image need to be output one by one in the order of the scanning trajectory during the scanning process. Therefore, the image needs to be buffered according to the corresponding rule during the image buffering.

[0054] The image buffering of the Lissajous figure and the spiral type scanning is similar to the image buffering of the grid format scanning, and therefore is not described herein.

[0055] Therefore, the laser scanning display often needs to be configured with a large image buffer to realize image output. The larger the area of the image buffer occupied by the application-specific integrated circuit, the greater the power consumption of the application-specific integrated circuit. In addition, while providing diversified display modes, there is also a waste of part of the resources, which further affects the overall power consumption of the application-specific integrated circuit.

[0056] To solve the above problems, with reference to Figure 3 The embodiment of the present application provides a laser scanning display control device 3, which is applied to a near-eye display device and includes:

[0057] An image receiving module 31 is configured to receive image data on one side of the binocular side of the near-eye display device.

[0058] ​The image sending module 37 is configured to determine a working state of the image sending module 37 according to the type of the image data, and forward the image data synchronously or without processing based on the working state.

[0059] The image processing module 38 is configured to process the image data.

[0060] The image buffer 32 is configured to receive the processed image data from the image processing module.

[0061] The light source driving module 33 is configured to read the processed image data from the image buffer 32, convert the processed image data, and drive a light source to display an image.

[0062] The scanning driving module 34 is configured to generate a scanning driving signal according to the processed image data read by the light source driving module 33 and driving waveform data required by a scanner, and scan the scanner according to the scanning driving signal.

[0063] The clock module 35 is configured to obtain a second clock according to a first clock received by the image receiving module 31, and provide the second clock to the light source driving module 33 and the scanning driving module 34 to synchronize the light source and the scanner.

[0064] The laser scanning display control device 3 is arranged in the microcircuit 14 to drive the scanner 11 to scan, so as to drive the optical fiber 12 to generate rapid two-dimensional motion, and scan the light beam transmitted in the optical fiber 12. Figure 1

[0065] Specifically, the image receiving module 31 is an image interface arranged on one side of the binocular side of the near-eye display device, and is configured to receive an image (such as a MIPI interface, an LVDS interface, or the like).

[0066] The image sending module 37 is configured to adjust the working state of the image sending module 37 according to the type of the image data in different display modes, and forward the image data synchronously or without processing according to the working state.

[0067] The image processing module 38 is configured to perform necessary image processing (such as Gamma correction) before display.

[0068] The image buffer 32 is generally an image buffer RAM, and is configured to buffer the image data processed by the image processing module 38.

[0069] Referring to Figure 4 ​The embodiment of the present application further comprises a parameter storage module 36 (FLASH). The parameter storage module 36 completes parameter storage and parameter initialization at power-on, and the parameters include parameters of the scan driving module, parameters of the light source driving module, and the like.

[0070] Specifically, the display mode of a near-eye display device (such as AR glasses) can include a flat vision mode and a stereoscopic vision mode, the flat vision mode is suitable for some general image viewing, document browsing and the like, in the flat vision mode, the user can only see the image on the plane and cannot perceive the depth and stereoscopic effect of the image, the image source of the near-eye display device outputs single-channel image data, the image data is mainly transmitted at the image interface of one eye of the near-eye display device, and an additional configuration module is needed to realize binocular synchronous transmission of the image data; and in the stereoscopic vision mode, since the mode is suitable for VR, AR and the like which need to provide stereoscopic perception, in the stereoscopic vision mode, the user can perceive the depth and stereoscopic effect by observing with both eyes, thereby obtaining a more immersive visual experience, the image source of the near-eye display device will output double-channel image data, the double-channel image data is two sets of parallax image data containing different information, the image data will be transmitted at the image interfaces of the two eyes of the near-eye display device respectively, each eye receives different parallax image data, thereby producing a stereoscopic effect on the two eyes of the user, in such a display mode, no additional configuration module is needed to realize binocular synchronous transmission of the image data. In order to provide diversified display functions, the display mode of the near-eye display device will be designed in combination with the flat vision mode and the stereoscopic vision mode, therefore, in order to ensure that the image data can be displayed synchronously in both eyes in any display mode, in the design of the application-specific integrated circuit, an additional module will be configured according to the image output type of the flat vision mode to ensure synchronous transmission of the image, and the above module is always turned on by default, that is, the module is in use state in both the flat vision mode and the stereoscopic vision mode, even in the case that no additional configuration module is needed to realize binocular synchronous transmission of the image data in the stereoscopic vision mode, the above module will still occupy and consume part of the resources of the system, thereby increasing the power consumption of the application-specific integrated circuit, in order to solve the above problem, the image sending module in the embodiment of the present application can adjust itself to use state when it is determined that the received image data is single-channel image data, and then start reading the image data automatically after the image receiving module receives the image data from the image interface of one eye of the near-eye display device, and synchronously transmit the read image data to the image interface of the other eye of the near-eye display device, so as to realize binocular synchronous transmission of the image data, and adjust itself to the off state when it is determined that the image data is double-channel image data, and then prohibit any processing of the image data, thereby adaptively adjusting the transmission of the data according to the type of the image data, reducing unnecessary resource occupation, and further reducing the power consumption of the application-specific integrated circuit while providing different display modes.

[0071] The embodiment of the present application adopts the second clock to realize the synchronization of the light source driving module and the scanning driving module, and the second clock is obtained according to the first clock received by the image receiving module. Therefore, the embodiment of the present application reduces the size of the image buffer configured by the laser scanning display, thereby saving the area of the application specific integrated circuit (ASIC) and reducing the power consumption of the ASIC.

[0072] Specifically, the first clock and the second clock come from the same crystal oscillator or phase-locked loop circuit (PLL).

[0073] The crystal oscillator is a commonly used clock element in a circuit, and the full name is crystal oscillator. The phase-locked loop is a negative feedback control system that uses a phase-synchronized voltage to tune a voltage-controlled oscillator to generate a target frequency.

[0074] The first clock and the second clock of the embodiment of the present application are homologous clocks, the scanning driving module generates a scanning driving signal and completes the synchronization image output of the light source driving module, a very small image buffer can be used to complete the display, and if the system is implemented by an ASIC, the area of the ASIC will be reduced and the power consumption of the ASIC will be reduced.

[0075] The crystal oscillator or the phase-locked loop circuit used in the embodiment of the present application is used as the first clock and the second clock, the homology of the first clock and the second clock is realized, the design of the clock circuit is simpler, and the area saving and power consumption reduction of the ASIC can be realized.

[0076] In a specific implementation of the embodiment of the present application, the clock module is a second clock obtained by frequency division or frequency multiplication processing on the first clock.

[0077] The embodiment of the present application realizes the synchronization of the scanning driving module and the light source driving module through simple clock processing, so that the circuit design is simpler and the cost of the ASIC is reduced.

[0078] In a specific implementation of the embodiment of the present application, the size of the image buffer is obtained by using formula one, and formula one is: size1=H*(1-Fa / (Fa+f)). Δ

[0079] Wherein, size1 is the size of the image buffer, Fa is the first line frequency of the image data received by the image receiving module, H is the total height of the image data, and f is the process frequency deviation. Δ

[0080] The embodiment of the present application determines the size of the image buffer according to the first line frequency of the image data received by the image receiving module and the process frequency deviation, so that the size of the image buffer meets the scanning requirement of the scanner at Fa​​±Δ The image buffer can work at both the frequency of f, and meet the scanning rule of the scanner, that is, during the scanning process, the pixel points of one frame of image need to be outputted one by one in the order of the scanning track.

[0081] Specifically, the process frequency deviation is a frequency deviation of the first line frequency of the image data caused by the process, and with the development of process standardization, the process frequency deviation will gradually decrease.

[0082] In the specific implementation of the embodiment of the present application, the image buffer includes a used part and a remaining part, the cache blocks of the used part are in a used state, and the cache blocks of the remaining part are in an off state.

[0083] The embodiment of the present application separates the used part and the remaining part, the cache blocks of the used part are in a used state, and the cache blocks of the remaining part are in an off state, so that the power consumption of the cache blocks of the remaining part can be reduced.

[0084] Specifically, the first line frequency of the image data received by the image receiving module and the second line frequency at which the scanner scans determine the size of the image buffer, and the size of the image buffer includes:

[0085] If the first line frequency is equal to the second line frequency, the size of the image buffer is greater than or equal to 1 line of image data.

[0086] If the first line frequency is greater than the second line frequency, the size of the image buffer is obtained by using Formula 1, and Formula 2 is: size2=H*(1 / Fb-1 / Fa) / (1 / Fb).

[0087] If the first line frequency is less than the second line frequency, the size of the image buffer is obtained by using Formula 2, and Formula 3 is: size2=H*(1 / Fa-1 / Fb) / (1 / Fa).

[0088] Wherein, size2 is the size of the used part of the image buffer, Fb is the second line frequency, Fa is the first line frequency of the image data received by the image receiving module, and H is the total height of the image data.

[0089] The embodiment of the present application can obtain the size of the image buffer by the size relationship between the first line frequency and the second line frequency, and by setting different formulas for the first line frequency and the second line frequency, so that the image buffer can meet the requirements of different scanners and image receiving modules.

[0090] Referring to Figure 5 In the specific implementation of the embodiment of the present application, the light source driving module 35 includes:

[0091] The driving unit 331 is configured to read the processed image data from the image buffer 32 and generate a light source driving signal.

[0092] a light source DAC unit 332, configured to perform DAC conversion on the light source driving signal provided by the driving unit 331, and drive the light source to display an image.

[0093] a light source feedback unit 333, configured to monitor the response of the light source, and collect feedback data of the light source.

[0094] a control unit 334, configured to adjust (in some embodiments, the adjustment can be considered as positive compensation or negative compensation) the intensity of the light source driven by the light source DAC unit 332 according to the feedback data of the light source provided by the light source feedback unit 334.

[0095] Since the laser is susceptible to temperature, humidity, and long-time working aging, the performance of the laser will decline, wavelength drift, output power change, etc. will cause color and gray scale distortion, and brightness change caused by optical loss in the process of fiber transmission. Therefore, during the process of fiber scanning display, the response of the light source needs to be monitored. The light source feedback unit generally collects the optical properties (including brightness, chrominance, etc.) of the scanned image as feedback data, and adjusts the intensity of the light source driven by the light source DAC unit to achieve the adjustment. The embodiment of the present application monitors the response of the light source through the light source feedback unit, collects the feedback data of the light source, adjusts the intensity of the light source driven by the light source DAC unit according to the feedback data of the light source provided by the light source feedback unit, and improves the effect of the light source driving module, avoiding the brightness change caused by the performance decline of the laser.

[0096] Referring to Figure 6 , the scanning driving module 34 in the specific implementation of the embodiment of the present application includes:

[0097] a waveform unit 341, configured to store the driving waveform data required by the scanner.

[0098] a scanning feedback unit 342, configured to monitor the response of the scanner, and collect scanning feedback data of the scanner.

[0099] a DDS unit 343, configured to generate a scanning driving signal according to the driving waveform data provided by the waveform unit 341 and the processed image data provided by the driving unit 331, and adjust the scanning driving signal according to the scanning feedback data provided by the scanning feedback unit 342.

[0100] a scanning DAC unit 344, configured to perform DAC conversion on the scanning driving signal sent by the DDS unit 343, and drive the scanner to scan.

[0101] Specifically, the wave form unit 341 is a RAM memory storing drive waveforms required by the scanner, which is updated at power-on by the parameter storage module 35, and the two-dimensional scanning stores waveforms in X and Y axial directions.

[0102] The DDS unit 343 generates drive signals in X and Y axial directions required by the two-dimensional scanning. The scanning DAC unit 344 performs digital-to-analog conversion on the drive signals output by the DDS unit 333 to drive the scanner to perform scanning, and generates drive signals in X and Y axial directions required by the two-dimensional scanning.

[0103] In order to achieve maximum amplitude of vibration, the optical fiber generally works in resonance mode in the optical fiber scanning display. However, the scanning characteristics of the optical fiber in the resonance state are complex, and due to the nonlinear effect of vibration, the symmetry and stability of the installation of the optical fiber and the scanner, etc., the scanning trajectory may be distorted when the vibration amplitude of the optical fiber in the resonance region is large, which affects the image display effect. Therefore, the response of the scanner needs to be monitored during the optical fiber scanning display.

[0104] The scanning feedback unit 342 feeds back in a manner including visual feedback, sensor feedback, and electrical signal feedback. Different feedback modes collect feedback signals from different sources, and the feedback principles are similar. The scanning feedback data is used to reflect the real-time situation of the scanner, and the scanning drive signal is adjusted, so that the scanning image is close to the ideal state, and the image display effect is ensured.

[0105] Figure 7 Another embodiment of the optical fiber scanning display system according to the present application is provided. The optical fiber scanning display system of the embodiment includes a laser scanning display control device 701 and an optical fiber 702 and a scanner 703.

[0106] The laser scanning display control device 701 is as described in any of the above embodiments.

[0107] The embodiment of the present application also provides a near-eye display device including a waveguide and a laser scanning display control system as described above. Figure 7

[0108] Therefore, the embodiment of the present application reduces the size of the image buffer configured by the laser scanning display, thereby saving the area of the application specific integrated circuit and reducing the power consumption of the application specific integrated circuit.

[0109] In addition, the specific implementation of each step in the program can refer to the corresponding description in the corresponding description of the corresponding steps and units in the above method embodiments, and will not be described here. Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the foregoing method embodiments, and will not be described here. ​

[0110] It should be noted that, according to the needs of implementation, each component / step described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or part operations of the components / steps can be combined into a new component / step, to achieve the purpose of the embodiments of the present application.

[0111] The above method according to the embodiments of the present application can be implemented in hardware, firmware, or as software or computer code that can be stored in a recording medium such as a CD ROM, a RAM, a floppy disk, a hard disk or an optical disk, or be downloaded through a network originally stored in a remote recording medium or a non-transitory machine readable medium and then stored in a local recording medium, so that the method described herein can be processed by such software using a general computer, a special purpose processor or programmable or special hardware (such as ASIC or FPGA). It can be understood that the computer, processor, microprocessor controller or programmable hardware includes a storage component (for example, RAM, ROM, flash memory, etc.) that can store or receive software or computer code, when the software or computer code is accessed and executed by the computer, processor or hardware, the method described herein is implemented. In addition, when a general computer accesses the code for implementing the method shown herein, the execution of the code will convert the general computer into a special computer for executing the method shown herein.

[0112] Those of ordinary skill in the art can realize that the units and method steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of the present application.

[0113] The above embodiments are only used to illustrate the present application, and not to limit the present application, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present application, therefore all equivalent technical solutions also belong to the scope of the present application, the patent protection scope of the present application should be defined by the claims.

Claims

1. A laser scanning display control device, characterized by comprising: Applied to a near-eye display device, the device comprises: an image receiving module, configured to receive image data in one side of binocular sides of the near-eye display device; an image sending module, configured to determine a working state of itself according to a type of the image data, and to synchronously forward or not process the image data based on the working state; an image processing module, configured to process the image data; an image buffer, configured to receive the processed image data from the image processing module; a light source driving module, configured to read the processed image data from the image buffer, convert the processed image data, and drive a light source to light up to display an image; a scanning driving module, configured to generate a scanning driving signal according to the processed image data read by the light source driving module and driving waveform data required by a scanner, and to scan the scanner according to the scanning driving signal; a clock module, configured to obtain a second clock according to a first clock received by the image processing module, and to provide the second clock to the light source driving module and the scanning driving module respectively to realize synchronization of the light source and the scanner.

2. The laser scanning display control device according to claim 1, wherein The type of the image data comprises single-channel image data and double-channel image data, when the image data is single-channel image data, the image sending module is configured to adjust itself to a using state to start reading the image data and synchronously transmit the read image data to the other side of the binocular sides of the near-eye display device; and when the image data is double-channel image data, the image sending module is configured to adjust itself to an off state to prohibit operation on the image data. The first clock and the second clock are from a same crystal oscillator or a phase-locked loop circuit.

3. The laser scanning display control device according to claim 2, wherein The clock module is a second clock obtained by frequency division or frequency multiplication processing on the first clock.

4. The laser scanning display control device according to claim 3, wherein The image buffer comprises a using part and a remaining part, cache blocks of the using part are in a using state, and cache blocks of the remaining part are in an off state.

5. The laser scanning display control device according to claim 4, wherein The size of the image buffer is calculated by using Formula One, which is size1=H*(1-Fa / (Fa Δ f)); wherein size1 is the size of the image buffer, Fa is the first line frequency at which the image receiving module receives the image data, H is the total height of the image data, and Δ f is the process frequency deviation.

6. The laser scanning display control device according to claim 5, wherein If the first line frequency is equal to a second line frequency at which the scanner scans, a size of the using part of the image buffer is greater than or equal to 1 line of image data; 7. The laser scanning display control device according to claim 6, wherein if the first line frequency is greater than the second line frequency, the size of the using part of the image buffer is obtained by calculation using Formula Two, Formula Two being: size2=H*(1 / Fb-1 / Fa) / (1 / Fb); if the first line frequency is less than the second line frequency, the size of the using part of the image buffer is obtained by calculation using Formula Three, Formula Three being: size2=H*(1 / Fa-1 / Fb) / (1 / Fa); wherein, size2 is the size of the using part of the image buffer, and Fb is the second line frequency. The size of the remaining part is determined according to the size of the using part.

8. The laser scanning display control device according to claim 7, wherein The light source driving module comprises:

9. The laser scanning display control apparatus according to any one of claims 1 to 8, wherein a driving unit, configured to read the processed image data from the image buffer, and generate a light source driving signal. ​ a light source DAC unit, configured to perform DAC conversion on the light source driving signal provided by the driving unit, and drive the light source to light up to display an image; a light source feedback unit, configured to monitor the response of the light source, and collect feedback data of the light source; a control unit, configured to adjust the intensity of the light source driven by the light source DAC unit according to the feedback data of the light source provided by the light source feedback unit.

10. The laser scanning display control apparatus according to any one of claims 1 to 8, wherein the scanning driving module comprises: a waveform unit, configured to store driving waveform data required by the scanner; a scanning feedback unit, configured to monitor the response of the scanner, and collect scanning feedback data of the scanner; a DDS unit, configured to generate a scanning driving signal according to the driving waveform data provided by the waveform unit and the processed image data provided by the driving unit, and adjust the scanning driving signal according to the scanning feedback data provided by the scanning feedback unit; a scanning DAC unit, configured to perform DAC conversion on the adjusted scanning driving signal sent by the DDS unit, and drive the scanner to scan. 11.A laser scanning display control system, comprising a scanner and the laser scanning display control device according to any one of claims 1-10. 12.A near-eye display device, comprising a waveguide and the laser scanning display control system according to claim 11.

Images