Projection image processing method, projection equipment and storage medium
By calculating and sending the target vertex coordinates of the target pixel partition through the system-level chip, the digital optical processor updates the original vertex coordinates, solving the problem that the existing technology cannot move the pixel points inside the projected image, and achieving more efficient geometric correction and adaptability.
Patent Information
- Application Number
- CN202311134948.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-04
- Publication Date
- 2025-03-04
AI Technical Summary
The prior art cannot realize the movement of pixel points inside the projected image, and can only adjust the position of four edges.
The system-level chip calculates the target vertex coordinates of the target pixel partition and sends it to the digital optical processor. The digital optical processor updates the original vertex coordinates of the target pixel partition, thereby achieving updates to the position of pixel points inside the projected image.
The movement of pixel points inside the projected image is realized, the adaptability between the projected image and the projected screen is improved, and the geometric correction processing efficiency is enhanced.
Smart Images
Figure CN119562038A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of projection display technology, and in particular to a method for processing a projection image, a projection device, and a storage medium. Background Art
[0002] As a high-end TV product, laser TV uses ultra-short-throw projection to project a larger display screen at a short distance compared to traditional projection equipment. During the projection process, laser TV needs to debug the projected image in order to make it match the projection screen. At present, the projected image of the projection device is mainly debugged through the algorithms on the main chip and geometric correction chip of the projection device.
[0003] However, based on the above method, only the four edges of the projected image can be moved, but the pixels inside the projected image cannot be moved. Therefore, how to move the pixels inside the projected image is an urgent problem to be solved. Summary of the invention
[0004] In order to solve or at least partially solve the above technical problems, the present disclosure provides a method for processing a projected image, a projection device and a storage medium, which calculates the target vertex coordinates of a target pixel partition to which a target pixel block belongs by using a system-level chip and sends them to a digital light processor, and the digital light processor updates the original vertex coordinates of the target pixel partition to the target vertex coordinates, thereby updating the position of each pixel point in the target pixel partition by updating the original vertex coordinates of the target pixel partition, thereby realizing the movement of pixel points inside the projected image.
[0005] In a first aspect, the present disclosure provides a method for processing a projection image, which is applied to a projection component, wherein the projection component includes: a system-level chip and a digital light processor;
[0006] The system-level chip is configured with an algorithm module, and the algorithm module is used to calculate the target vertex coordinates of the target pixel partition in the projection image, the target pixel partition is the pixel partition to which the target pixel block belongs among the multiple pixel partitions corresponding to the projection image, and the target pixel block is any pixel block in the projection image;
[0007] The digital light processor is configured with a correction module, and the correction module is used to update the original vertex coordinates of the target pixel partition according to the target vertex coordinates;
[0008] The method includes:
[0009] In response to a correction instruction input by a user for a target pixel block in the projection image, the system-level chip calculates target vertex coordinates of a target pixel partition to which the target pixel block belongs through the algorithm module, and sends the target vertex coordinates to the digital light processor;
[0010] The digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module, so as to update the display position of the target pixel block.
[0011] As an optional implementation manner of the present disclosure, before the system-level chip calculates the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module, the method further includes:
[0012] determining an initial pixel partition of the projected image;
[0013] The initial pixel partition is interpolated according to the number of pixel blocks in the projection image to obtain a plurality of pixel partitions corresponding to the projection image, wherein the number of the plurality of pixel partitions is equal to the number of pixel blocks in the projection image.
[0014] As an optional implementation manner of the present disclosure, in response to a correction instruction input by a user for a target pixel block in the projection image, the system-level chip calculates the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module, including:
[0015] In response to a correction instruction input by a user for a target pixel block in the projection image, determining a length and a width of each pixel partition in the plurality of pixel partitions;
[0016] Based on the length and width of each pixel partition and the original coordinates of the target pixel block, the target vertex coordinates of the target pixel partition to which the target pixel block belongs are determined.
[0017] As an optional implementation manner of the present disclosure, determining the length and width of each pixel partition in the multiple pixel partitions includes:
[0018] The length and width of each pixel partition in the plurality of pixel partitions are determined according to the number of initial pixel partitions of the projection image and the resolution of a digital micromirror element in the digital light processor.
[0019] As an optional implementation manner of the present disclosure, before the system-level chip calculates the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module in response to the correction instruction for the target pixel block in the projection image, the method further includes:
[0020] The digital light processor receives a correction instruction sent by a user based on a control device, and sends the received correction instruction to the system-level chip, where the correction instruction includes a correction direction and a correction range.
[0021] As an optional implementation of the present disclosure, the digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module to update the display position of the target pixel block, including:
[0022] The digital light processor receives the target vertex coordinates, and moves the original vertex of the target pixel partition to the received vertex coordinates through the correction module according to the correction direction, so as to update the display position of the target pixel block.
[0023] As an optional implementation of the present disclosure, the digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module to update the display position of the target pixel block, including:
[0024] The digital light processor receives the target vertex coordinates and compares them with the original vertex coordinates of the target pixel partition, and updates the original vertex coordinates of the vertices whose original vertex coordinates are inconsistent with the target vertex coordinates.
[0025] In a second aspect, an embodiment of the present disclosure provides a projection device, including: a system-level chip and a digital light processor;
[0026] The system-level chip is configured to: in response to a correction instruction input by a user for a target pixel block in a projection image, calculate the target vertex coordinates of a target pixel partition to which the target pixel block belongs through an algorithm module in the system-level chip, and send the target vertex coordinates to the digital light processor;
[0027] The digital light processor is configured to: receive the target vertex coordinates, and update the original vertex coordinates of the target pixel partition to the target vertex coordinates through a correction module in the digital light processor, so as to update the display position of the target pixel block.
[0028] As an optional implementation manner of the present disclosure, before calculating the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module, the system-level chip is further configured as follows:
[0029] determining an initial pixel partition of the projected image;
[0030] The initial pixel partition is interpolated according to the number of pixel blocks in the projection image to obtain a plurality of pixel partitions corresponding to the projection image, wherein the number of the plurality of pixel partitions is equal to the number of pixel blocks in the projection image.
[0031] As an optional implementation of the present disclosure, the system-level chip is specifically configured to determine the length and width of each pixel partition in the multiple pixel partitions in response to a correction instruction input by a user for a target pixel block in the projection image;
[0032] Based on the length and width of each pixel partition and the original coordinates of the target pixel block, the target vertex coordinates of the target pixel partition to which the target pixel block belongs are determined.
[0033] As an optional embodiment of the present disclosure, the system-level chip is specifically configured to determine the length and width of each pixel partition in the multiple pixel partitions according to the number of initial pixel partitions of the projected image and the resolution of the digital micromirror element in the digital light processor.
[0034] As an optional embodiment of the present disclosure, in response to a correction instruction for a target pixel block in the projection image, before the system-level chip calculates the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module, the digital light processor is also configured to: receive a correction instruction sent by a user based on a control device, and send the received correction instruction to the system-level chip, the correction instruction including a correction direction and a correction range.
[0035] As an optional implementation of the present disclosure, the digital light processor is specifically configured to: receive the target vertex coordinates, and move the original vertex of the target pixel partition to the received vertex coordinates according to the correction direction through the correction module to update the display position of the target pixel block.
[0036] As an optional implementation of the present disclosure, the digital light processor is specifically configured to: receive the target vertex coordinates, compare them with the original vertex coordinates of the target pixel partition, and update the original vertex coordinates of the vertices whose original vertex coordinates are inconsistent with the target vertex coordinates.
[0037] In a third aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the method for processing a projection image as described in the first aspect is implemented.
[0038] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:
[0039] The projection device provided in the embodiment of the present disclosure includes: a system-level chip and a digital light processor, the system-level chip is configured with an algorithm module, the algorithm module is used to calculate the target vertex coordinates of the target pixel partition in the projection image, the target pixel partition is a pixel partition to which a target pixel block belongs among a plurality of pixel partitions corresponding to the projection image, and the target pixel block is any pixel block in the projection image; the digital light processor is configured with a correction module, the correction module is used to update the original vertex coordinates of the target pixel partition according to the target vertex coordinates; when the projection device executes the projection image processing method provided in the embodiment of the present disclosure, in response to a correction instruction input by a user for the target pixel block in the projection image, the system-level chip calculates the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module, and sends the target vertex coordinates to the digital light processor; the digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module to update the display position of the target pixel block. On the one hand, the embodiment of the present disclosure places an algorithm module on the system-level chip side to calculate the target vertex coordinates of the target pixel partition. The digital light processor side only needs to adjust the vertex coordinates of the target pixel partition according to the received target vertex coordinates, which can reduce the computing power of the DLP and increase the efficiency of geometric correction processing. On the other hand, the embodiment of the present disclosure divides the pixel blocks in the projected image into different pixel partitions, and updates the position of each pixel point in the target pixel partition by updating the original vertex coordinates of the target pixel partition, thereby realizing the movement of pixel points inside the projected image. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0041] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0042] Figure 1 A schematic diagram of an application scenario of a method for processing a projection image provided according to one or more embodiments of the present disclosure;
[0043] Figure 2A is a hardware configuration block diagram of a control device 100 according to one or more embodiments of the present disclosure;
[0044] Figure 2Bis a hardware configuration block diagram of a projection device 200 according to one or more embodiments of the present disclosure;
[0045] Figure 2C A schematic diagram of software configuration in a projection device 200 according to one or more embodiments of the present disclosure;
[0046] Figure 2D A schematic diagram of software configuration in a projection device 200 according to one or more embodiments of the present disclosure;
[0047] Figure 3 is a flowchart of a method for processing a projection image according to one or more embodiments of the present disclosure;
[0048] Figure 4 A schematic diagram of a process of processing a projection image provided by one or more embodiments of the present disclosure;
[0049] Figure 5A A schematic diagram of the display position of each pixel point of a projection image provided by one or more embodiments of the present disclosure;
[0050] Figure 5B A schematic diagram of the display position of each pixel point of a projection image provided by one or more embodiments of the present disclosure;
[0051] Fig. 6A A schematic diagram of displaying a projection image provided for one or more embodiments of the present disclosure;
[0052] Figure 6B A schematic diagram of displaying a projection image provided for one or more embodiments of the present disclosure. DETAILED DESCRIPTION
[0053] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0054] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0055] The terms "first" and "second" in this disclosure are used to distinguish different objects rather than to describe a specific order of objects. For example, a first processing result and a second processing result are used to distinguish different processing results rather than to describe a specific order of processing results.
[0056] First, the application scenarios of the present disclosure are illustrated. As a high-end TV product, laser TV can project a screen of more than 100 inches in a short distance, giving the audience a better visual enjoyment and bringing a cinema-like TV viewing experience. However, laser TV is an ultra-short-throw projection, and it is a bottom-up projection method. In order to make the picture coincide with the screen, a cumbersome debugging and correction process is required. The commonly used correction method is to correct the projected image through the correction APP (Application) installed on the terminal device, for example, take a photo of the projected image and the projection screen through the correction APP installed on the mobile phone, and send the obtained picture to the TV SoC (System on Chip) system of the TV host. The TV SoC system recognizes the image and calculates the correction parameters through the automatic geometric correction algorithm, and outputs the pixel coordinate data required by the geometric correction execution module to realize the correction function. However, the correction APP has certain limitations. When the projection screen is uneven, the correction effect is not good. For example, the corrected projection image appears concave, including: the upper boundary of the projection image is concave downward, the lower boundary of the projection image is concave upward, the left boundary of the projection image is concave to the right, and the right boundary of the projection image is concave to the left. In the case of such concave projection image, correction can be made by moving the four sides of the projection image. However, this correction method is based on the main chip and the geometric correction chip, and based on the above method, only the four sides of the projection image can be moved, but the internal pixel points of the projection image cannot be moved.
[0057] Based on this, the embodiments of the present disclosure provide a method for processing a projected image, a projection device, and a storage medium. The target vertex coordinates of a target pixel partition to which a target pixel block belongs are calculated by utilizing a system-level chip, and sent to a digital light processor. The digital light processor updates the original vertex coordinates of the target pixel partition to the target vertex coordinates, thereby updating the position of each pixel point in the target pixel partition by updating the original vertex coordinates of the target pixel partition, thereby realizing the movement of pixel points inside the projected image.
[0058] The control device in the embodiments of the present disclosure may be a remote controller or a mobile device such as a mobile phone, which is not specifically limited in the embodiments of the present disclosure.
[0059] For example, refer to Figure 1 As shown, Figure 1The present invention is a schematic diagram of an application scenario of a method for processing a projection image according to an embodiment of the present invention. The control device 100 can communicate with a system-on-chip (TV SoC) based on an IIC communication protocol, and the system-on-chip communicates with a digital light processor (DLP) via a USB. For example, the system-on-chip sends the calculated target vertex coordinates of the target pixel partition to the digital light processor. The system-on-chip is configured with an algorithm module for calculating the target vertex coordinates of the target pixel partition in the projection image; the digital light processor is configured with a correction module for updating the original vertex coordinates of the target pixel partition according to the target vertex coordinates.
[0060] In some embodiments, the control device 100 may be a remote controller, and the user may input user commands through buttons on the remote controller, voice input, control panel input, etc. to control the geometric correction of the projected image on the projection screen.
[0061] Figure 2A In FIG. 1 , a configuration block diagram of the control device 100 is exemplarily shown. Figure 2A As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the projection device 200 can recognize and respond to, and play an interactive intermediary role between the user and the projection device 200.
[0062] The embodiment of the present disclosure provides a projection device 200, including: a system-level chip and a digital light processor, and the projection device 200 also communicates data with a server. The projection device 200 can be allowed to communicate and connect via a local area network (LAN), a wireless local area network (WLAN) and other networks. The server can provide various content and interactions to the projection device 200. The server can be a cluster or multiple clusters, and can include one or more types of servers.
[0063] Figure 2B The hardware configuration block diagram of the projection device 200 is shown in FIG. Figure 2BAs shown, the projection device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface (i.e., a user input interface) 280. The controller 250 includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output. The display 260 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner 210 receives broadcast television signals by wired or wireless reception, and demodulates audio and video signals from multiple wireless or wired broadcast television signals, such as and EPG data signals. The communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example: the communicator can include other network communication protocol chips or near field communication protocol chips such as Wifi modules, Bluetooth modules, wired Ethernet modules, and at least one of infrared receivers. The virtual conference terminal 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the business server 500 through the communicator 220. The detector 230 is used to collect signals of the external environment or the external interaction. The first controller 250 and the tuner-demodulator 210 can be located in different split devices, that is, the tuner-demodulator 210 can also be in an external device of the main device where the first controller 250 is located, such as an external set-top box. The user interface 280 can be used to receive control operations of a control device (such as a keyboard, etc.).
[0064] In some embodiments, the controller 250 controls the operation of the TV host and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the TV host 200. The user can enter a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can enter a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
[0065] In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, and control displayed on the display screen of an electronic device, where the control can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.
[0066] Figure 2C FIG. 1 is a schematic diagram of software configuration in a projection device 200 according to one or more embodiments of the present disclosure. Figure 2C As shown in the figure, the system is divided into four layers, from top to bottom, namely the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.
[0067] In some embodiments, at least one application is running in the application layer, and these applications may be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the applications in the application layer include but are not limited to the above examples.
[0068] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.
[0069] In some embodiments, the kernel layer is a layer between hardware and software, and includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0070] Figure 2D FIG. 2 is a schematic diagram showing a software configuration of a system-level chip in a projection device 200. Figure 2D As shown, the software configuration is divided into three layers, from top to bottom: upper-layer application, middleware, and bottom-layer driver.
[0071] The projection image processing method provided by the present disclosure is applied to a projection device, wherein a projection component is provided in the projection device, and the projection component includes: a system-level chip and a digital light processor, wherein the system-level chip is configured with an algorithm module, and the algorithm module is used to calculate the target vertex coordinates of the target pixel partition in the projection image, wherein the target pixel partition is a pixel partition to which a target pixel block belongs among multiple pixel partitions corresponding to the projection image, and the target pixel block is any pixel block in the projection image; the digital light processor is configured with a correction module, and the correction module is used to update the original vertex coordinates of the target pixel partition according to the target vertex coordinates. The projection image processing method provided by the present disclosure will be exemplarily described below through specific embodiments.
[0072] Reference Figure 3 As shown, Figure 3 A flowchart of a method for processing a projection image provided in an embodiment of the present disclosure is provided. The method for processing a projection image specifically includes the following steps S310 to S330.
[0073] S310 , in response to a correction instruction input by a user for a target pixel block in the projection image, the system-level chip calculates target vertex coordinates of a target pixel partition to which the target pixel block belongs through the algorithm module.
[0074] Among them, the projected image includes multiple pixel blocks, and the target pixel block is a pixel block that needs to be corrected among the multiple pixel blocks. The target pixel block can be a pixel block located at the edge of the projected image, or a pixel block located inside the projected image. For example, the uneven position in the middle of the projection screen causes the projected image to be incompatible with the projection screen, and the display position of the pixel points in the target pixel block needs to be corrected. The target pixel block can be one or more.
[0075] The projection image may be divided into a plurality of pixel partitions, such that one pixel partition includes at least one pixel block, and the target vertex coordinates of the target pixel partition are the coordinates corresponding to the vertices of the target pixel partition when the projection image is adapted to the projection screen.
[0076] Exemplarily, the algorithm module configured in the system-level chip is an M*N point geometric correction algorithm, which can process M*N pixels, such as processing a projection image with 32*62 pixels. Correspondingly, the multiple pixel partitions are at most 32 rows and 62 columns, totaling 1984. When each pixel partition is moved (the vertex coordinates are changed), the movement of the pixel points on the entire projection screen can be controlled.
[0077] In the above step S310, the correction instruction may be a correction instruction sent by the user based on the control device to the digital light processor, the digital light processor receives the correction instruction sent by the user based on the control device, and sends the received correction instruction to the system-level chip, wherein the correction instruction may include a correction direction and a correction range.
[0078] The user can perform a selection operation through the control device and use the selected pixel partition as the target pixel partition. The correction range is the maximum movable displacement, or can be understood as the value range of the target vertex coordinates of the target pixel partition, and the correction direction is the direction of moving the vertex coordinates of the target pixel partition. Exemplarily, if the user operates the corresponding key for upward movement on the control device shown, the correction direction of the correction instruction sent by the control device to the digital light processor is upward, if the user operates the corresponding key for downward movement on the control device shown, the correction direction of the correction instruction sent by the control device to the digital light processor is downward, if the user operates the corresponding key for left movement on the control device shown, the correction direction of the correction instruction sent by the control device to the digital light processor is left, and if the user operates the corresponding key for right movement on the control device shown, the correction direction of the correction instruction sent by the control device to the digital light processor is right.
[0079] S320, sending the target vertex coordinates to the digital light processor.
[0080] The disclosed embodiment places the algorithm module on a system-level chip, that is, the process of calculating the target vertex coordinates is completed on the system-level chip side, and the digital light processor side only needs to make adjustments based on the target vertex coordinates, which can reduce the computing power of the DLP and increase the efficiency of geometric correction processing.
[0081] S330: The digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module, so as to update the display position of the target pixel block.
[0082] Exemplarily, the digital light processor receives the target vertex coordinates, and moves the original vertex of the target pixel partition to the received vertex coordinates according to the correction direction through the correction module to update the display position of the target pixel block.
[0083] In the embodiment of the present disclosure, after the projection component projects onto the projection screen and displays the projection image on the projection screen, the digital light processor determines whether the projection screen and the projection image are compatible, and if not, a prompt message is displayed on the projection screen. The prompt message is used to prompt the user to perform geometric correction on the projection image, and can be a text prompt message. The mismatch between the projection image and the projection screen includes: the boundary of any pixel block does not overlap or is not parallel to the boundary of the projection screen corresponding to the boundary.
[0084] The projection device provided in the embodiment of the present disclosure includes: a system-level chip and a digital light processor, the system-level chip is configured with an algorithm module, the algorithm module is used to calculate the target vertex coordinates of the target pixel partition in the projection image, the target pixel partition is a pixel partition to which a target pixel block belongs among a plurality of pixel partitions corresponding to the projection image, and the target pixel block is any pixel block in the projection image; the digital light processor is configured with a correction module, the correction module is used to update the original vertex coordinates of the target pixel partition according to the target vertex coordinates; when the projection device executes the projection image processing method provided in the embodiment of the present disclosure, in response to a correction instruction input by a user for the target pixel block in the projection image, the system-level chip calculates the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module, and sends the target vertex coordinates to the digital light processor; the digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module to update the display position of the target pixel block. On the one hand, the embodiment of the present disclosure places an algorithm module on the system-level chip side to calculate the target vertex coordinates of the target pixel partition. The digital light processor side only needs to adjust the vertex coordinates of the target pixel partition according to the received target vertex coordinates, which can reduce the computing power of the DLP and increase the efficiency of geometric correction processing. On the other hand, the embodiment of the present disclosure divides the pixel blocks in the projected image into different pixel partitions, and updates the position of each pixel point in the target pixel partition by updating the original vertex coordinates of the target pixel partition, thereby realizing the movement of pixel points inside the projected image.
[0085] Reference Figure 4 As shown, Figure 4 A flowchart of another method for processing a projection image provided by an embodiment of the present disclosure is provided. The method for processing a projection image specifically includes the following steps S410 to S460.
[0086] S410: The system-level chip determines an initial pixel partition of the projection image.
[0087] The embodiment of the present disclosure does not limit the division method of the initial pixel partition. For example, when the pixels of the projected image are 32*62, it can be understood that the projected image includes 32 rows and 62 columns, a total of 1984 pixel blocks. When the 1984 pixel blocks are controlled to be movable, the movement of each pixel point in the entire projected image can be achieved. For example, if the initial adjustable pixel points are 20 pixels, the initial pixel partition is 15. Figure 5A As shown, Figure 5AThe following is a schematic diagram of the display position of each pixel point of the projection image in an embodiment of the present disclosure. It is assumed that the original coordinates of each pixel point are A1(0,0), A2(960,360), A3(1920,0), A4(2880,0), A5(3839,0), B1(0,720), B2(960,720), B3(1920,720), B4(2880,720), B5(3839,720), C1(0,1440 ), C2(960,1440), C3(1920,1440), C4(2880,1440), C5(3839,14440), D1(0,2159), D2(960,2159), D3(1920,2159), D4(2880,2159), D5(3839,2159), when the coordinates of the A2 point of the first pixel partition are changed from (960,360) to (960,0), refer to Figure 5B As shown, Figure 5B This is a schematic diagram of the display position of each pixel point of the projection image in an embodiment of the present disclosure. It can be seen that by updating the coordinates of point A2, the display positions of multiple pixel points in the first pixel partition and the second pixel partition can be moved.
[0088] S420: Perform interpolation processing on the initial pixel partition according to the number of pixel blocks in the projection image to obtain a plurality of pixel partitions corresponding to the projection image.
[0089] The number of the plurality of pixel partitions is equal to the number of pixel blocks in the projection image.
[0090] In order to realize the movement of the pixel points in the entire projected image, each original pixel partition shown in 5A is interpolated so that the number of the obtained multiple pixel partitions is equal to the number of pixel blocks. Continuing with the above example, the interpolation process obtains 32*62 pixel partitions.
[0091] S430: In response to a correction instruction input by a user for a target pixel block in the projection image, determine a length and a width of each pixel partition in the plurality of pixel partitions.
[0092] Determine the length and width of each pixel partition in the plurality of pixel partitions according to the number of initial pixel partitions of the projection image and the resolution of a digital micromirror device (DMD) in the digital light processor
[0093] Exemplarily, the length and width of each pixel partition are determined according to the division method of the initial pixel partition. Following the above example, when the initial pixel partition is M*N, the length of each pixel partition is (DMDWidth-1) / (NumCloumns-1)*CloumnNumber, and the width is (DMDHeight-1) / (NumRows-1)*RowNumber, where DMDWidth=3840, DMDHeight=2160, NumCloumns=62, CloumnNumber indicates the column in which the pixel block is located, NumRows=32, RowNumber indicates the row in which the pixel block is located, refer to Figure 5A As shown, Figure 5A Taking M=4, N=5 as an example, the length of each pixel partition is (3840-1) / 5=767, and the width is (2160-1) / 4=431, that is, each pixel partition includes 767*431 pixels.
[0094] S440 : Determine target vertex coordinates of a target pixel partition to which the target pixel block belongs based on the length and width of each pixel partition and the original coordinates of the target pixel block.
[0095] Exemplarily, the pixel partition to which the control point (target pixel point) selected by the user belongs can be determined based on the coordinates of the control point (target pixel point). Since the length and width of each pixel partition are known, the target vertex coordinates of the four vertices of the current partition can be calculated.
[0096] S450: Send the target vertex coordinates to the digital light processor.
[0097] Exemplarily, by sending a control instruction to a digital light processor through a control device to correct the vertices of each pixel partition, image distortion caused by an uneven screen can be resolved.
[0098] S460: The digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module, so as to update the display position of the target pixel block.
[0099] The digital light processor receives the target vertex coordinates and compares them with the original vertex coordinates of the target pixel partition, and updates the original vertex coordinates of the vertices whose original vertex coordinates are inconsistent with the target vertex coordinates.
[0100] For example, refer to Figure 5A and Figure 5BAs shown in the figure, the original vertex coordinates of point A2 are inconsistent with the target vertex coordinates, so the original vertex coordinates of point A2 are updated: A1(0,0), A3(1920,0), A4(2880,0), A5(3839,0), B1(0,720), B2(960,720), B3(1920,720), B4(2880,720), B5(3839,720), C1(0, 1440), C2(960,1440), C3(1920,1440), C4(2880,1440), C5(3839,14440), D1(0,2159), D2(960,2159), D3(1920,2159), D4(2880,2159), D5(3839,2159), the original vertex coordinates of these pixels are not updated.
[0101] Reference Fig. 6A and Figure 6B hour, Fig. 6A FIG. 1 is a schematic diagram of a display of a projection image in an embodiment of the present disclosure. The upper edge and the interior of the projection image are distorted. After being processed based on the projection image processing method provided by the present disclosure, the effect is as follows: Figure 6B As shown, the upper edge of the projected image and the internal display area where display distortion occurs are corrected.
[0102] This embodiment provides an electronic device, including: a memory and a processor, the memory is used to store a computer program; the processor is used to execute the steps in the projection image processing method provided in the above method embodiment when calling the computer program, and its implementation principle and technical effect are similar, which will not be repeated here. The projection image processing method provided in the embodiment of the present disclosure is applied to a projection device, and the projection device includes: a system-level chip and a digital light processor;
[0103] The system-level chip is configured to: in response to a correction instruction input by a user for a target pixel block in the projection image, calculate the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module, and send the target vertex coordinates to the digital light processor;
[0104] The digital light processor is configured to: receive the target vertex coordinates, and update the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module, so as to update the display position of the target pixel block.
[0105] On the one hand, the embodiment of the present disclosure places an algorithm module on the system-level chip side to calculate the target vertex coordinates of the target pixel partition. The digital light processor side only needs to adjust the vertex coordinates of the target pixel partition according to the received target vertex coordinates, which can reduce the computing power of the DLP and increase the efficiency of geometric correction processing. On the other hand, the embodiment of the present disclosure divides the pixel blocks in the projected image into different pixel partitions, and updates the position of each pixel point in the target pixel partition by updating the original vertex coordinates of the target pixel partition, thereby realizing the movement of pixel points inside the projected image.
[0106] An embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned virtual conference scene display method are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0107] The computer readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0108] The present disclosure provides a computer program product, including: when the computer program product is run on a computer, the computer is enabled to implement the above-mentioned virtual conference scene display method.
[0109] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.
Claims
1. A method for processing a projection image, characterized in that: Applicable to a projection component, the projection component comprising: a system-level chip and a digital light processor; The system-level chip is configured with an algorithm module, and the algorithm module is used to calculate the target vertex coordinates of the target pixel partition in the projection image, the target pixel partition is the pixel partition to which the target pixel block belongs among the multiple pixel partitions corresponding to the projection image, and the target pixel block is any pixel block in the projection image; The digital light processor is configured with a correction module, and the correction module is used to update the original vertex coordinates of the target pixel partition according to the target vertex coordinates; The method for processing the projection image comprises: In response to a correction instruction input by a user for a target pixel block in the projection image, the system-level chip calculates target vertex coordinates of a target pixel partition to which the target pixel block belongs through the algorithm module, and sends the target vertex coordinates to the digital light processor; The digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module, so as to update the display position of the target pixel block.
2. The method according to claim 1, characterized in that Before the system-level chip calculates the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module, the method further includes: determining an initial pixel partition of the projected image; The initial pixel partition is interpolated according to the number of pixel blocks in the projection image to obtain a plurality of pixel partitions corresponding to the projection image, wherein the number of the plurality of pixel partitions is equal to the number of pixel blocks in the projection image.
3. The method according to claim 2, characterized in that In response to the correction instruction input by the user for the target pixel block in the projection image, the system-level chip calculates the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module, including: In response to a correction instruction input by a user for a target pixel block in the projection image, determining a length and a width of each pixel partition in the plurality of pixel partitions; Based on the length and width of each pixel partition and the original coordinates of the target pixel block, the target vertex coordinates of the target pixel partition to which the target pixel block belongs are determined.
4. The method according to claim 3, characterized in that The determining the length and width of each pixel partition in the plurality of pixel partitions comprises: The length and width of each pixel partition in the plurality of pixel partitions are determined according to the number of initial pixel partitions of the projection image and the resolution of a digital micromirror element in the digital light processor.
5. The method according to claim 1, characterized in that Before the system-level chip calculates the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module in response to the correction instruction for the target pixel block in the projection image, the method further includes: The digital light processor receives a correction instruction sent by a user based on a control device, and sends the received correction instruction to the system-level chip, where the correction instruction includes a correction direction and a correction range.
6. The method according to claim 5, characterized in that The digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module to update the display position of the target pixel block, including: The digital light processor receives the target vertex coordinates, and moves the original vertex of the target pixel partition to the received vertex coordinates through the correction module according to the correction direction, so as to update the display position of the target pixel block.
7. The method according to claim 1, characterized in that The digital light processor receives the target vertex coordinates, and updates the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module to update the display position of the target pixel block, including: The digital light processor receives the target vertex coordinates and compares them with the original vertex coordinates of the target pixel partition, and updates the original vertex coordinates of the vertices whose original vertex coordinates are inconsistent with the target vertex coordinates.
8. A projection device, characterized in that: include: System-on-chip and digital light processors; The system-level chip is configured to: in response to a correction instruction input by a user for a target pixel block in a projection image, calculate the target vertex coordinates of a target pixel partition to which the target pixel block belongs through an algorithm module in the system-level chip, and send the target vertex coordinates to the digital light processor; The digital light processor is configured to: receive the target vertex coordinates, and update the original vertex coordinates of the target pixel partition to the target vertex coordinates through the correction module, so as to update the display position of the target pixel block.
9. The projection device according to claim 8, characterized in that: Before calculating the target vertex coordinates of the target pixel partition to which the target pixel block belongs through the algorithm module in the system-on-chip, the system-on-chip is further configured as follows: determining an initial pixel partition of the projected image; The initial pixel partition is interpolated according to the number of pixel blocks in the projection image to obtain a plurality of pixel partitions corresponding to the projection image, wherein the number of the plurality of pixel partitions is equal to the number of pixel blocks in the projection image.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for processing a projection image according to any one of claims 1 to 7 is implemented.