Projection processing method and device, projection processing system and storage medium

Abstract

The invention provides a projection processing method and device, a projection processing system and a storage medium. The method comprises the following steps: in response to a received control instruction as a correction instruction, caching a target video frame matched with the control instruction in a video stream to a memory; reading the target video frame from the memory and correcting the target video frame to obtain a corrected video frame; outputting and displaying the corrected video frame; the frame rate of the received video stream is the same as the frame rate of the output video stream. In the embodiment, the video streams are transmitted at the same frame rate all the time, so that processing resource consumption caused by frame rate change is avoided, and the processing efficiency of a projection processing system is ensured; moreover, the video frames are cached to the memory, the target video frame is read from the memory for correction processing, and the original initial frame is reserved for display when the communication error occurs, so that normal display can be realized when the communication error occurs.

Description

Technical Field

[0001] This disclosure relates to the field of control technology, and in particular to a projection processing method, apparatus, projection processing system and storage medium. Background Technology

[0002] As communication scenarios increase, the demand for projection equipment also increases, and the requirements for the display clarity of projection equipment also rise.

[0003] Existing projection processing systems include a CPU and a GPU. The CPU downclocks the video stream of 4K@60Hz video frames to 4K@30Hz; the GPU processes each video frame and then multiplies the frequency through MEMS, converting it into a 4K@60Hz video stream for output display. Summary of the Invention

[0004] This disclosure provides a projection processing method, apparatus, system, and storage medium to solve the aforementioned technical problems.

[0005] According to a first aspect of this disclosure, a projection processing method is provided, the method comprising:

[0006] In response to a received control command that is a correction command, the target video frame in the video stream that matches the control command is cached in the memory.

[0007] The target video frame is read from the memory and corrected to obtain a corrected video frame.

[0008] Output corrected video frames for display; the frame rate of the received video stream is the same as the frame rate of the output video stream.

[0009] Optionally, the method further includes:

[0010] If the received control command is not a correction command, the video frames of the video stream are directly output and displayed.

[0011] Optionally, the method further includes:

[0012] In response to the detection of a communication error, an adjustment request is sent to the processor, and video frames are read from the memory and displayed before communication is restored.

[0013] Optionally, the method further includes:

[0014] Obtain a brightness adjustment command; the brightness adjustment command is generated based on the brightness levels of each video frame in the video stream.

[0015] Adjust the display brightness of the backlight module according to the brightness adjustment command.

[0016] According to a second aspect of this disclosure, a projection processing apparatus is provided, the apparatus comprising:

[0017] The video frame caching module is used to cache the target video frame in the video stream that matches the control command in response to the received control command being a correction command, and to cache it in the memory.

[0018] A video frame correction module is used to read the target video frame from the memory and perform correction processing on the target video frame to obtain a corrected video frame;

[0019] The video frame output module is used to output corrected video frames for display; the frame rate of the received video stream is the same as the frame rate of the output video stream.

[0020] Optionally, the video frame output module is further configured to directly output and display the video frames of the video stream in response to the received control command not being a correction command.

[0021] Optionally, the device further includes:

[0022] The adjustment request sending module is used to send an adjustment request to the processor in response to the detection of a communication error;

[0023] The video frame output module is also used to read video frames from the memory and output them for display before communication is restored to normal.

[0024] Optionally, the device further includes:

[0025] A brightness instruction acquisition module is used to acquire brightness adjustment instructions; the brightness adjustment instructions are generated based on the brightness levels of each video frame in the video stream.

[0026] The display brightness adjustment module is used to adjust the display brightness of the backlight module according to the brightness adjustment command.

[0027] According to a third aspect of this disclosure, a projection processing system is provided, the system comprising: a processor and a correction chip; the processor and the correction chip transmit a video stream through a first transmission channel and transmit control commands through a second transmission channel; the output frame rate of the processor, the input frame rate of the correction chip, and the output frame rate of the correction chip are the same;

[0028] The correction chip is used to perform correction processing on the target video frame of the video stream when the control command is a correction command, and output the corrected video frame for display.

[0029] Optionally, the system further includes a memory; the memory is electrically connected to the calibration chip;

[0030] The correction chip is used to cache the target video frame into the memory when a correction instruction is received, and to read the target video frame from the memory for correction processing.

[0031] Optionally, the system further includes a memory; the memory is electrically connected to the calibration chip;

[0032] The correction chip is used to cache each video frame of the received video stream into the memory, and then read the video frames from the memory for forwarding or correction processing.

[0033] Optionally, the system further includes a projection module and a backlight module; the backlight module is electrically connected to the processor.

[0034] The processor is used to generate brightness adjustment instructions based on the brightness of video frames and transmit them to the backlight module.

[0035] The backlight module is used to adjust the display brightness of the backlight module after receiving the brightness adjustment command.

[0036] Optionally, the system further includes at least one sensor; the at least one sensor is electrically connected to the processor;

[0037] The at least one sensor is used to collect sensor data from the projection processing system and send it to the processor;

[0038] The processor is also configured to generate the control instructions based on the sensing data, so that the correction chip can correct the video frames.

[0039] According to a fourth aspect of this disclosure, a non-transitory computer-readable storage medium is provided, which, when an executable computer program in the storage medium is executed by a processor, enables the implementation of the method as described in any of the first aspects.

[0040] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:

[0041] The projection processing method provided in this embodiment can, in response to a received control command being a correction command, cache a target video frame in the video stream that matches the control command into a memory; then, read the target video frame from the memory and perform correction processing on the target video frame to obtain a corrected video frame; finally, output the corrected video frame for display; the frame rate of the received video stream is the same as the frame rate of the output video stream. Thus, this embodiment always transmits the video stream at the same frame rate, avoiding the processing resource consumption caused by frame rate changes and ensuring the processing efficiency of the projection processing system; furthermore, by caching video frames into memory and then reading target video frames from memory for correction processing, this embodiment retains the original initial frame for display in the event of a communication error, enabling normal display even during communication failures.

[0042] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0043] Figure 1 This is a block diagram of a projection processing system according to an embodiment of the present disclosure.

[0044] Figure 2 This is a flowchart of a projection processing method according to an embodiment of the present disclosure.

[0045] Figure 3 This is a schematic diagram of the display shape before and after trapezoidal correction according to an embodiment of the present disclosure.

[0046] Figure 4 This is a flowchart of a projection processing method according to an embodiment of the present disclosure.

[0047] Figure 5 This is a flowchart of another projection processing method according to an embodiment of the present disclosure.

[0048] Figure 6 This is a flowchart of another projection processing method according to an embodiment of the present disclosure.

[0049] Figure 7 This is a block diagram of a projection processing system according to an embodiment of the present disclosure. Detailed Implementation

[0050] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses consistent with some aspects of this disclosure as detailed in the appended claims.

[0051] To address the aforementioned technical problems, this disclosure provides a projection processing method, apparatus, system, and storage medium. The projection processing method described above is applicable to projection processing systems. See also... Figure 1 The projection processing system includes a processor 11 and a correction chip 12.

[0052] Processor 11 and calibration chip 12 transmit video streams through a first transmission channel (such as a transmission channel implemented using VbyOne technology) and control commands through a second transmission channel (such as a transmission channel implemented using a Serial Peripheral Interface (SPI)). The output frame rate of the video stream output by processor 11, the input frame rate of calibration chip 12, and the output frame rate of calibration chip 12 are the same. Figure 1 Examples are provided for scenarios where all video frames are at 60Hz.

[0053] The processor 11 can generate control instructions based on the trigger signal, and these control instructions may include correction instructions. The correction chip 12 is used to perform correction processing on the target video frame of the video stream when the control instruction is a correction instruction, and outputs the corrected video frame for display.

[0054] In this embodiment, the correction chip 12 performs correction processing on the target video frame, including keystone correction. Keystone correction refers to using an interpolation algorithm to geometrically transform the trapezoidal distortion generated during projection, producing a reversed compensating trapezoidal image to offset the trapezoidal distortion caused by the projection optical path, resulting in a regular rectangular image. It is understood that in this embodiment, the correction chip 12 can store the correction algorithm for calculating the trapezoidal angle of the output video image, and then adjust and compensate according to the scan amplitude to achieve the effect of image keystone correction. Alternatively, in this embodiment, the correction chip 12 can be implemented using hardware circuitry, capable of performing geometric correction, image quality correction, and adjustment functions on the input image to achieve the effect of keystone correction.

[0055] See also Figure 1 The projection processing system also includes a memory 13, which is electrically connected to the correction chip 12. The correction chip 12 caches the target video frame in the memory 13 upon receiving a correction command and reads the target video frame from the memory 13 for correction processing. Compared to directly processing the target video frame, caching the original target video frame facilitates its reading and output display in case of subsequent communication errors, ensuring correct display of the video frame even in the event of a communication error and improving the user experience.

[0056] In one embodiment, even if the correction chip 12 receives a video frame from the video stream but does not receive a correction command, it can still cache the video frame in the memory 13. Subsequently, the cached video frame is read from the memory 13 and output to the projection module 14 for display. This facilitates the reading and output of the target video frame in the event of a subsequent communication error, ensuring correct display of the video frame even in the event of a communication error, thus improving the user experience.

[0057] In one embodiment, see further. Figure 1 The projection processing system described above also includes a projection module 14, which is electrically connected to the correction chip 12. The correction chip 12 can transmit corrected or forwarded video frames to the projection module 14. The projection module 14 displays the received video frames. In one example, the projection module 14 can be implemented using an LCD component, which can adjust the angle of the liquid crystal according to the pixel data of each pixel in the video frame to achieve a matching effect between light transmission and pixel data.

[0058] In one embodiment, see further. Figure 1 The aforementioned projection processing system also includes a backlight module 15, which is electrically connected to the processor 11. The processor 11 generates brightness adjustment commands based on the brightness levels of video frames and transmits them to the backlight module 15. Upon receiving the brightness adjustment commands from the processor 11, the backlight module 15 adjusts its display brightness. Thus, in this embodiment, by adjusting the output power, i.e., the display brightness, of the backlight module 15, the power consumption of the projection processing system can be dynamically adjusted, ultimately reducing the overall power consumption of the projection processing system to achieve energy saving.

[0059] Understandably, this embodiment can also compensate for video frames while dynamically adjusting the power consumption of the backlight module, so that the displayed image matches the brightness before and after adjustment without distortion. Assume that the pixel value of a certain pixel on the screen before compensation is (R0, G0, B...). 00 The backlight brightness α before compensation; the pixel value of a certain pixel on the screen after compensation is (R, G, B), and the backlight brightness β after compensation. To ensure that the visual effect remains unchanged, the pixel values ​​before and after compensation and the backlight brightness satisfy the following formula (1):

[0060]

[0061] In equation (1), γ represents the compensation coefficient.

[0062] In one embodiment, the projection processing system further includes at least one sensor. See also... Figure 1The aforementioned sensors may include, but are not limited to, Time-of-Flight (TOF) sensors, G-sensors, temperature sensors, and CMOS cameras. Those skilled in the art can select appropriate sensors based on the specific scenario, such as gyroscopes or infrared sensors. When the attitude of the projection processing system or projection module 14, and its distance from the screen, are sensed, the corresponding solution falls within the protection scope of this disclosure. Thus, in this embodiment, by adding sensors, the attitude of the projection processing system and / or the environment in which the projection processing system is located can be sensed, achieving an adaptive matching effect with the environment.

[0063] In one embodiment, the projection processing system further includes a wireless communication module. See also... Figure 1 The wireless communication module can include, but is not limited to, a Wi-Fi module or a Bluetooth module. This allows the wireless communication module to communicate with other devices and acquire files to be displayed, such as videos, images, or text. Thus, this embodiment expands the data sources through the wireless communication module, thereby increasing the application scenarios of the projection processing system.

[0064] In one embodiment, the projection processing system further includes a wired communication module. See also... Figure 1 The wired communication module may include a High Definition Multimedia Interface (HDMI) or other interfaces capable of transmitting video streams. The wired communication module can be electrically connected to the processor 11 via a decoding module. In this way, external devices can be electrically connected to the projection processing system through the wired communication module to transmit files to be displayed to the projection processing system.

[0065] In one embodiment, the projection processing system further includes a power adjustment module (PMU). See also... Figure 1 The power adjustment module (PMU) can supply power to the processor 11, the calibration chip 12, and the backlight module 15. Furthermore, the processor 11 can output control commands to the PMU based on the display brightness of the video frames. Upon receiving the control commands, the PMU can adjust its output power to adjust the backlight brightness. In this way, when transmitting 4K resolution video frames, the projection processing system can dynamically adjust the backlight brightness, reducing heat generation and cooling fan noise.

[0066] Based on the above projection processing system, this disclosure also provides a projection processing method, see [link to relevant documentation]. Figure 2 This includes steps 21 to 23.

[0067] In step 21, in response to the received control command being a correction command, the target video frame in the video stream that matches the control command is cached in the memory 13.

[0068] In this embodiment, the processor 11 of the projection processing system can generate control commands. These control commands can include calibration commands, screen-off commands, and brightness adjustment commands, etc., and can be adjusted according to specific scenarios, without limitation here.

[0069] Taking the aforementioned control command as a correction command as an example, the process by which processor 11 generates a correction command includes: First, processor 11 can detect whether a correction condition has been triggered. The correction condition may include, but is not limited to, the projection processing system being powered on, the correction button on the projection processing system being triggered, or a change in the posture of the projection processing system, which can be set according to the specific scenario. When the correction condition is detected to be triggered, processor 11 can generate a correction command. This correction command may include, but is not limited to, parameters that instruct the correction chip 12 to correct the video frame, such as the sequence number of the target video frame to be corrected, the distance between the lens and the screen, the target shape, and / or the backlight brightness before and after compensation. The parameter composition of the correction command can be set according to the specific scenario. Finally, processor 11 can transmit the aforementioned correction command to the correction chip 12.

[0070] In this embodiment, the calibration chip 12 can receive the aforementioned calibration command via the SPI interface. When a control command is received, the calibration chip 12 can parse the control command to determine its type. When the control command is a calibration command, the calibration chip 12 can cache the target video frame matching the calibration command in the memory 13.

[0071] In step 22, the target video frame is read from the memory 13 and the target video frame is corrected to obtain a corrected video frame.

[0072] In this embodiment, the correction chip 12 can read the target video frame matching the correction instruction from the memory 13. See also Figure 3 The target video frame is displayed on the screen in the shape of quadrilateral ABCD, which is not a rectangle and belongs to the video frame to be corrected. The correction chip 12 can correct the target video frame according to the four-point trapezoidal correction method to obtain the corrected video frame. It can be understood that the corrected video frame is displayed on the screen in the shape of quadrilateral A'BCD.

[0073] It should be noted that in this embodiment, the video frames are cached in the memory 13, and then the target video frames are read from the memory 13 for correction processing. The original initial frames are retained for display in case of communication errors, so that they can be displayed normally in case of communication errors.

[0074] It should be noted that the calibration chip 12 calibrates the target video frame for approximately one video cycle (e.g., 17ms). During this period, the processor 11 may send a calibration command for the next video frame, at which point the calibration chip 12 will be unable to complete the calibration of the current video frame. Therefore, upon detecting a new calibration command, the calibration chip 12 can abandon the current calibration operation, read the target video frame from the memory 13, and forward it to the projection module. Then, it executes the new calibration command, performs the calibration operation on the next target video frame, and outputs the calibrated video frame corresponding to the next target video frame to the projection module. In this way, this embodiment can achieve smooth video display and avoid stuttering.

[0075] In step 23, the corrected video frames are output and displayed; the frame rate of the received video stream is the same as the frame rate of the output video stream.

[0076] In this embodiment, the calibration chip 12 can output the calibration video frame to the projection module, and the projection module can display the calibration video frame, ultimately displaying a rectangular video frame on the screen.

[0077] It should be noted that for the calibration chip 12, the frame rate of its input video stream and the frame rate of its output video stream are the same, both equal to the frame rate of the video frames output by the processor 11. For example, if the processor 11 outputs a video stream with a resolution of 4K and a frame rate of 60Hz, the calibration chip 12 receives the same 4K video stream and outputs a 4K video stream with a frame rate of 60Hz. In this embodiment, the video stream is always transmitted at the same frame rate to avoid the processing resource consumption caused by frame rate changes and to ensure the processing efficiency of the projection processing system.

[0078] In one embodiment, in Figure 2 This is an improvement upon the illustrated embodiment. See also... Figure 4 The projection processing includes: 41. The calibration chip 12 can receive and parse control commands. 42. The calibration command is parsed. 43. Understandably, the video stream output by the video processor is received synchronously when the control command is received. 44. After the calibration is parsed, it is determined whether each video frame is the target video frame. 45. When the target video frame is determined, it can be cached in the memory 13. 46. Then the target video frame is read from the memory 13. 47. The read target video frame is calibrated. 48. The calibrated video frame is output. When it is determined that the video frame is not the target video frame, the calibration chip 12 can jump to step 48, that is, directly output the video frame to the projection module for display. In this way, in scenarios where video frame processing is not required, data storage and retrieval time can be reduced, and the consumption of processing resources can be reduced.

[0079] In another embodiment, Figure 4This is an improvement upon the illustrated embodiment. See also... Figure 5 The projection processing includes: 51. The correction chip 12 can determine whether a control command is received in each cycle. 52. When a control command is received, it can parse the control command. 53. The correction command is determined. 54. The video stream output by the processor is received. 55. When the correction command is parsed, the target video frame in the received video stream is determined. 56. After the target video frame is determined, it can be cached in the memory 13. 57. The target video frame is read from the memory 13 for correction. 58. The corrected video frame is output. When it is determined that the video frame is not the target video frame, the correction chip 12 can jump to step 58, that is, directly output the video frame to the projection module for display. When no control command is received, the correction chip 12 can jump to step 58, that is, directly output the video frame to the projection module for display. In this way, in scenarios where video frame processing is not required or no control command is received, data storage and retrieval time can be reduced, and the consumption of processing resources can be reduced.

[0080] In yet another embodiment, Figure 4 or Figure 5 Improvements are made based on the illustrated embodiment. In the context of… Figure 5 For example, see the improvements made to the illustrated embodiment. Figure 6 The projection processing includes: 60. The correction chip 12 can determine whether a control command is received in each cycle. 61. If a control command is received, it is parsed. 62. A correction command is determined. 63. The video stream output by the processor is received. 64. When the correction command is parsed, the target video frame in the received video stream is determined. 65. After determining the target video frame, it can be cached in the memory 13. 66. The target video frame is then read from the memory 13. 67. The target video frame is corrected. 68. The corrected video frame is output. 69. If it is determined that the video frame is not the target video frame, the correction chip 12 can cache the video frame in the memory 13. 70. After reading the video frame from the memory 13, the process jumps to step 68, i.e., outputting it to the projection module for display. 69. When no control command is received, the calibration chip 12 can buffer the video frame into the memory 13. 70. Then, the video frame is read from the memory 13 and the process jumps to step 68, i.e., outputting it to the projection module for display. In this way, in scenarios where video frame processing is not required or no control command is received, data storage and retrieval time can be reduced, and processing resource consumption can be lowered.

[0081] Based on the projection processing method provided in the embodiments of this disclosure, the embodiments of this disclosure also provide a projection processing apparatus, see [link to relevant documentation]. Figure 7 The device includes:

[0082] Video frame caching module 71 is used to cache target video frames in the video stream that match the control command in response to the received control command being a correction command into a memory;

[0083] The video frame correction module 72 is used to read the target video frame from the memory and perform correction processing on the target video frame to obtain a corrected video frame;

[0084] The video frame output module 73 is used to output corrected video frames for display; the frame rate of the received video stream is the same as the frame rate of the output video stream.

[0085] Optionally, the video frame output module is further configured to directly output and display the video frames of the video stream in response to the received control command not being a correction command.

[0086] Optionally, the device further includes:

[0087] The adjustment request sending module is used to send an adjustment request to the processor in response to the detection of a communication error;

[0088] The video frame output module is also used to read video frames from the memory and output them for display before communication is restored to normal.

[0089] Optionally, the device further includes:

[0090] A brightness instruction acquisition module is used to acquire brightness adjustment instructions; the brightness adjustment instructions are generated based on the brightness levels of each video frame in the video stream.

[0091] The display brightness adjustment module is used to adjust the display brightness of the backlight module according to the brightness adjustment command.

[0092] It should be noted that the device embodiment shown in this embodiment matches the content of the above method embodiment, and the content of the above method embodiment can be referred to, and will not be repeated here.

[0093] This disclosure also provides a computer-readable storage medium that, when an executable computer program in the storage medium is executed by a processor, enables the implementation of the methods described above.

[0094] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the disclosure herein. This disclosure is intended to cover any variations, uses, or adaptations that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0095] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A projection processing method characterized by, The method comprises: in response to the received control instruction being a correction instruction, buffering a target video frame in the video stream matching the control instruction to a memory; reading the target video frame from the memory and performing correction processing on the target video frame to obtain a corrected video frame; outputting the corrected video frame for display; the frame rate of the received video stream is the same as the frame rate of the output video stream.

2. The method of claim 1, wherein, The method further comprises: in response to the received control instruction not being a correction instruction, directly outputting and displaying the video frame of the video stream.

3. The method of claim 1, wherein, The method further comprises: in response to detecting a communication error, sending an adjustment request to the processor, and reading the video frame from the memory and outputting and displaying before the communication returns to normal.

4. The method of claim 1, wherein, The method further comprises: obtaining a brightness adjustment instruction; the brightness adjustment instruction is generated according to the light and dark degree of each video frame in the video stream; adjusting the display brightness of the backlight module according to the brightness adjustment instruction.

5. A projection processing device, characterized by, The device comprises: a video frame buffering module, configured to, in response to the received control instruction being a correction instruction, buffer a target video frame in the video stream matching the control instruction to a memory; a video frame correction module, configured to read the target video frame from the memory and perform correction processing on the target video frame to obtain a corrected video frame; a video frame output module, configured to output the corrected video frame for display; the frame rate of the received video stream is the same as the frame rate of the output video stream.

6. A projection processing system characterized by comprising: The system comprises: a processor and a correction chip; the processor and the correction chip transmit a video stream through a first transmission channel and transmit a control instruction through a second transmission channel; the output frame rate of the processor, the input frame rate of the correction chip, and the output frame rate of the correction chip are the same; the correction chip is configured to perform correction processing on a target video frame of the video stream when the control instruction is a correction instruction, and output a corrected video frame for display.

7. The system of claim 6, wherein, The system further comprises a memory; the memory is electrically connected with the correction chip; the correction chip is configured to buffer the target video frame into the memory when a correction instruction is received, and read the target video frame from the memory for correction processing.

8. The system of claim 6, wherein, The system further comprises a memory; the memory is electrically connected with the correction chip; the correction chip is configured to buffer each frame of the video stream into the memory after receiving the video stream, and then read the video frame from the memory for forwarding or correction processing.

9. The system of claim 6, wherein, The system further comprises a projection module and a backlight module; the backlight module is electrically connected with the processor; the processor is configured to generate a brightness adjustment instruction according to the light and dark degree of the video frame and transmit it to the backlight module; the backlight module is configured to adjust the display brightness of the backlight module after receiving the brightness adjustment instruction.

10. The system of claim 6, wherein, The system further comprises at least one sensor; the at least one sensor is electrically connected with the processor; the at least one sensor is configured to collect sensing data of the projection processing system and send it to the processor; the processor is further configured to generate the control instruction according to the sensing data, so that the correction chip corrects the video frame.

11. A non-transitory computer-readable storage medium, comprising: When the executable computer program in the storage medium is executed by a processor, it can implement the method as described in any one of claims 1 to 4.

Images