A method for controlling the black border cutting of the display screen of a mobile phone's secondary screen and a secondary screen device

Abstract

The present invention discloses a method for controlling black border cutting of the display screen of a mobile phone secondary screen and a secondary screen device, including receiving video signals from different signal sources; parsing the video signals to obtain image data information of the video signals; detecting black border areas based on the image data information; when a black border area is detected, discarding pixel points within the black border area and recording the number of pixel points discarded within the black border area; when a non-black border area is detected, stopping discarding pixel points and recording the starting position of the non-black border screen; performing display screen matching verification based on the number of pixel points discarded within the black border area and the starting position of the non-black border screen; if the verification passes, obtaining the resolution and set value of the target display device; after performing image scaling processing based on the resolution and set value of the target display device, transmitting the image data information to the subsequent screen processing module. The present invention can ensure the accuracy of video playback and image display and effectively improve the display quality of the secondary screen device.

Description

Technical Field

[0001] The present invention relates to the field of display technologies, and particularly to a method for controlling black border cutting of a display screen on a secondary screen of a mobile phone and a secondary screen device. Background Art

[0002] With the popularization of smart phones, people are increasingly accustomed to taking selfies or live streaming using mobile phones. However, when taking selfies or live streaming using the rear camera of a mobile phone, users often cannot see the mobile phone screen, resulting in an inability to accurately determine whether the screen meets their needs. To solve this problem, a mobile phone secondary screen device has emerged in the prior art. By setting the secondary screen back-to-back with the mobile phone, users can see the image captured by the rear camera of the mobile phone when taking selfies or live streaming using the rear camera of the mobile phone. The mobile phone secondary screen device provides users with an instant visual feedback, enabling better control of the screen content and quality during selfies and live streaming.

[0003] The working principle of the existing mobile phone secondary screen device is generally as follows: The user activates the selfie or live streaming mode. The rear camera starts capturing image data and sends the image data to the processor of the mobile phone. The processor performs necessary processing on the image and sends the data to the secondary screen by wired or wireless means. The secondary screen receives the image data and displays it to the user in real time. The user adjusts the shooting angle, light, and other settings according to the display on the secondary screen.

[0004] However, different signal sources often have different output screen sizes and ratios. Due to the inability to adapt to the diversity of outputs from various signal sources, the mobile phone secondary screen device cannot well present the original image content. Specifically, when the output screen size or ratio of the signal source does not match the screen size or ratio of the mobile phone secondary screen device, in order to adapt to the screen size, the displayed image on the mobile phone secondary screen device may be unevenly stretched or compressed, resulting in a black border phenomenon and causing image distortion. Or, if the image ratio of the signal source is inconsistent with the ratio of the mobile phone secondary screen device, a part of the image may exceed the screen range, or a black area may appear at the edge of the screen. Therefore, inventing a method for controlling black border cutting of a display screen on a mobile phone secondary screen device that can effectively improve the display quality is an urgent problem to be solved by those skilled in the art. Summary of the Invention

[0005] The purpose of this application is to provide a method for controlling black border cutting of a display screen on a mobile phone secondary screen and a secondary screen device. In this solution, it is possible to achieve control of black border cutting of the display screen, ensure the accuracy of video playback and image display, ensure complete display of the screen, and improve the user experience.

[0006] To solve the above technical problems, this application provides a method for controlling black border cutting of a display screen on a mobile phone secondary screen, including:

[0007] Controlling the Scaler module to receive video signals from different signal sources;

[0008] Control the Scaler module to parse the video signal to obtain the image data information of the video signal;

[0009] Detect the black border area based on the image data information and determine whether there is a black border area;

[0010] When a black border area is detected, control the Scaler module to discard the pixel points within the black border area and record the number of pixel points discarded within the black border area;

[0011] When a non-black border area is detected, control the Scaler module to stop discarding pixel points and record the starting position of the non-black border screen;

[0012] Perform a display screen matching check based on the number of pixel points discarded within the black border area and the starting position of the non-black border screen;

[0013] If the check passes, control the Scaler module to generate a new pixel matrix and obtain the resolution and set value of the target display device;

[0014] After performing image scaling processing based on the resolution and set value of the target display device, transfer the new pixel matrix to the subsequent screen processing module.

[0015] Preferably, the performing a display screen matching check based on the number of pixel points discarded within the black border area and the starting position of the non-black border screen includes:

[0016] Calculate the total number of pixel points in the black border area based on the number of pixel points discarded within the black border area to determine the width of the first black border area discarded;

[0017] Calculate the total number of pixel points in the non-black border area based on the starting position of the non-black border screen to determine the width of the first non-black border area;

[0018] Determine whether the sum of the width of the first black border area and the width of the first non-black border area is equal to the width of the original image data information;

[0019] If they are equal, the width of the screen after cutting the black border matches the original image data information.

[0020] Preferably, the method for controlling the cutting of the black border of the secondary screen display of a mobile phone further includes:

[0021] If the check fails, control the Scaler module to adjust the black border cutting range according to the check result;

[0022] Determine the width of the second black border area discarded according to the adjusted black border cutting range;

[0023] Determine the width of the second non-black edge area to be retained according to the adjusted black edge cutting range;

[0024] Judge whether the sum of the width of the second black edge area and the width of the second non-black edge area is equal to the width of the original image data information;

[0025] If they are equal, adjust the width of the screen after cutting the black edge to match the original image data information.

[0026] Preferably, the black edge area detection based on the image data information and judging whether there is a black edge area includes:

[0027] Detect from the horizontal direction according to the display screen and capture the first column pixel area; wherein, the first column pixel area includes the pixels of the (1, x) column, and each column of pixels includes y pixel points;

[0028] Judge the pixel levels of the pixel points in the first column pixel area one by one;

[0029] If there is a 0-level pixel point, determine the 0-level pixel point as a black pixel point;

[0030] If all the pixel points in the first column pixel area are 0-level pixel points, discard all the pixel points in the first column pixel area;

[0031] If the first column pixel area contains both 0-level pixel points and non-0-level pixel points at the same time, gradually narrow the detection range through a recursive algorithm, and discard after identifying the 0-level pixel points.

[0032] Preferably, the black edge area detection based on the image data information and judging whether there is a black edge area further includes:

[0033] Detect from the horizontal direction according to the display screen and capture the second column pixel area; wherein, the second column pixel area includes the pixels of the (x + 1, x + t) column, and each column of pixels includes y pixel points;

[0034] Judge the pixel levels of the pixel points in the second column pixel area one by one;

[0035] If there is a 0-level pixel point, determine the 0-level pixel point as a black pixel point;

[0036] If all the pixel points in the second column pixel area are 0-level pixel points, discard all the pixel points in the second column pixel area;

[0037] If the second column pixel area contains both 0-level pixel points and non-0-level pixel points at the same time, gradually narrow the detection range through a recursive algorithm, and discard after identifying the 0-level pixel points.

[0038] Preferably, the method for detecting a black border area based on the image data information and determining whether there is a black border area includes:

[0039] Detect from the vertical direction according to the display screen and capture the first row pixel area; wherein, the first row pixel area includes the pixels of the (1, m) -th row, and each column of pixels includes n pixel points;

[0040] Judging the pixel levels of the pixel points in the first row pixel area one by one;

[0041] If there is a 0 - level pixel point, then determine the 0 - level pixel point as a black pixel point;

[0042] If all the pixel points in the first row pixel area are 0 - level pixel points, then discard all the pixel points in the first row pixel area;

[0043] If the first row pixel area contains both 0 - level pixel points and non - 0 - level pixel points at the same time, gradually narrow the detection range through a recursive algorithm, and discard after identifying the 0 - level pixel points.

[0044] Preferably, the method for detecting a black border area based on the image data information and determining whether there is a black border area includes:

[0045] Detect from the vertical direction according to the display screen and capture the second row pixel area; wherein, the second row pixel area includes the pixels of the (m + 1, m + t) -th row, and each column of pixels includes n pixel points;

[0046] Judging the pixel levels of the pixel points in the second row pixel area one by one;

[0047] If there is a 0 - level pixel point, then determine the 0 - level pixel point as a black pixel point;

[0048] If all the pixel points in the second row pixel area are 0 - level pixel points, then discard all the pixel points in the second row pixel area;

[0049] If the second row pixel area contains both 0 - level pixel points and non - 0 - level pixel points at the same time, gradually narrow the detection range through a recursive algorithm, and discard after identifying the 0 - level pixel points.

[0050] Preferably, the method for controlling the black border cutting of the secondary screen display of a mobile phone further includes:

[0051] Analyze the video frames of the continuous video signal in real - time and identify the changes in the black border area;

[0052] According to the changes in the black border area, predict the change trend of the black border area;

[0053] Based on the prediction results, adaptively adjust the black edge detection threshold and detection area of the Scaler module to adapt to dynamic scenarios.

[0054] Preferably, the method for controlling the black edge cutting of the secondary screen display image of a mobile phone further includes:

[0055] Obtain the light change value of the surrounding environment in real time;

[0056] Adaptively adjust the supplementary light value of the supplementary light device according to the light change value;

[0057] Control the Scaler module to receive the video signals of different signal sources after supplementary light;

[0058] Automatically adjust the black edge cutting area in the image data information of the video signal according to the video signals of different signal sources after supplementary light.

[0059] To solve the above technical problems, the present application provides a secondary screen device, and the method for controlling the black edge cutting of the secondary screen display image of a mobile phone is applied to the secondary screen device.

[0060] The method for controlling the black edge cutting of the secondary screen display image of a mobile phone and the secondary screen device of the present invention have the following beneficial effects. The method for controlling the black edge cutting of the secondary screen display image of a mobile phone disclosed in the present invention includes receiving video signals of different signal sources; parsing the video signals to obtain the image data information of the video signals; detecting the black edge area according to the image data information; when the black edge area is detected, discard the pixel points in the black edge area and record the number of pixel points in the discarded black edge area; when the non-black edge area is detected, stop discarding pixel points and record the starting position of the non-black edge screen; perform display screen matching verification according to the number of pixel points in the discarded black edge area and the starting position of the non-black edge screen; if the verification passes, obtain the resolution and set value of the target display device; after performing image scaling processing according to the resolution and set value of the target display device, transfer the image data information to the subsequent screen processing module. Therefore, the present invention can ensure the accuracy of video playback and image display and effectively improve the display quality of the secondary screen device. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will further illustrate the present invention in conjunction with the drawings and embodiments. The drawings in the following description are only partial embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts:

[0062] Figure 1 It is a flowchart of a method for controlling the black edge cutting of the secondary screen display image of a mobile phone in a preferred embodiment of the present invention.

[0063] Figure 2 It is a schematic flowchart of a process for verifying the matching of a display screen according to the number of pixel points in the discarded black edge area and the starting position of the non-black edge screen in a preferred embodiment of the present invention.

[0064] Figure 3 It is a schematic flowchart of another method for controlling the black edge cutting of the display screen of the mobile phone secondary screen in a preferred embodiment of the present invention.

[0065] Figure 4 It is a schematic flowchart of a process for detecting a black edge area according to the image data information and determining whether there is a black edge area in a preferred embodiment of the present invention.

[0066] Figure 5 It is a schematic diagram of the principle for detecting a black edge area in the vertical direction according to the display screen in a preferred embodiment of the present invention.

[0067] Figure 6 It is a schematic diagram of the principle for detecting a black edge area in the horizontal direction according to the display screen in a preferred embodiment of the present invention.

[0068] Figure 7 It is a schematic flowchart of another method for controlling the black edge cutting of the display screen of the mobile phone secondary screen in a preferred embodiment of the present invention.

[0069] Figure 8 It is a schematic flowchart of another method for controlling the black edge cutting of the display screen of the mobile phone secondary screen in a preferred embodiment of the present invention. Detailed implementation manners

[0070] The core of this application is to provide a method for controlling the black edge cutting of the display screen of the mobile phone secondary screen and a secondary screen device. In this solution, it is possible to achieve the control of black edge cutting of the display screen, ensure the accuracy of video playback and image display, ensure the complete display of the screen, and improve the user experience.

[0071] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are some but not all of the embodiments of this application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in this application without creative efforts shall fall within the protection scope of this application.

[0072] Please refer to Figure 1 , Figure 1 It is a flowchart of a method for controlling the black edge cutting of the display screen of the mobile phone secondary screen provided by this application, including:

[0073] S1. Control the Scaler module to receive video signals from different signal sources;

[0074] Specifically, in this embodiment, the Scaler module receives video signals from different signal sources such as HDMI, Typec, USB, and DP. Therefore, this application supports multiple signal sources, and the system has strong flexibility and applicability. Among them, different signal sources such as HDMI, Typec, USB, and DP can come from one or more of mobile phones, computers, and cameras, and no specific limitation is made here.

[0075] Specifically, the Scaler module, whose full name is "Scaling Module", is a key component in display technology and is used to scale video signals and perform display image processing to meet the requirements of different display devices.

[0076] S2. Control the Scaler module to parse the video signal to obtain the image data information of the video signal;

[0077] Specifically, in this embodiment, the video signal received by the Scaler module contains a series of image data information, and this image data information represents the color information of each pixel point of the image. The Scaler module parses the image data information to determine the resolution, color format, and other attributes of the image, providing an accurate data basis for subsequent black edge detection and image processing.

[0078] S3. Detect the black edge area based on the image data information and determine whether there is a black edge area;

[0079] Specifically, in this embodiment, since the output screen sizes and ratios of different signal sources are different, the Scaler module needs to optimize the display of the received image data information.

[0080] Specifically, before scaling the image, the Scaler module first identifies the black edge area in the video signal and cuts it off after detecting the black edge area. It can be understood that the black edge area refers to the area where the gray values of the RGB three colors at the screen edge are all 0.

[0081] S4. When the black edge area is detected, control the Scaler module to discard the pixel points in the black edge area and record the number of pixel points in the discarded black edge area;

[0082] Specifically, in this embodiment, after the Scaler module identifies the black edge area, it discards the pixel points in this area to achieve black edge cutting. At the same time, the Scaler module records the number of pixel points in the discarded black edge area for subsequent accuracy verification of black edge cutting.

[0083] It is worth noting that if the Scaler module recognizes that the entire screen is black, it is considered that there is no signal or a prompt message such as device recognition failure is made.

[0084] S5. When a non-black-edge area is detected, control the Scaler module to stop discarding pixel points and record the starting position of the non-black-edge screen.

[0085] Specifically, in this embodiment, after the Scaler module identifies the non-black-edge area, it stops discarding pixel points, retains the valid screen content, and ensures the integrity and quality of the image. At the same time, the Scaler module records the starting position of the non-black-edge screen for subsequent accuracy verification of black-edge cutting.

[0086] S6. Perform display screen matching verification based on the number of pixel points in the discarded black-edge area and the starting position of the non-black-edge screen.

[0087] Specifically, in this application, the total number of discarded black-edge pixels plus the total number of non-black-edge pixels is used to verify whether the new pixel matrix matches the width of the original signal, so as to ensure that the width and ratio of the output screen are consistent with the original signal, maintain the original content and quality of the image, and improve the user's visual experience.

[0088] S7. If the verification passes, control the Scaler module to generate a new pixel matrix and obtain the resolution and set value of the target display device.

[0089] S8. After performing image scaling processing based on the resolution and set value of the target display device, transfer the new pixel matrix to the subsequent screen processing module.

[0090] Specifically, after the verification passes, the Scaler module performs scaling processing on the image according to the selected scaling algorithm. This process includes calculating new pixel values and writing them into the new pixel matrix.

[0091] Specifically, in this embodiment, after processing, the Scaler module outputs the optimized video signal to the subsequent screen processing module in formats such as LVDS, EDP, VBO, MIPI, TTL, etc. to further optimize the display quality.

[0092] In summary, the present invention provides a method for controlling the black border cutting of the display screen of a mobile phone secondary screen. In this solution, video signals from different signal sources are received; the video signals are analyzed to obtain the image data information of the video signals; the black border area is detected based on the image data information; when the black border area is detected, the pixel points within the black border area are discarded, and the number of pixel points discarded within the black border area is recorded; when the non-black border area is detected, the discarding of pixel points is stopped, and the starting position of the non-black border screen is recorded; the display screen matching check is performed based on the number of pixel points discarded within the black border area and the starting position of the non-black border screen; if the check passes, the resolution and set value of the target display device are obtained; after performing image scaling processing based on the resolution and set value of the target display device, the image data information is transmitted to the subsequent screen processing module. Therefore, the present invention can ensure the accuracy of video playback and image display, and effectively improve the display quality of the secondary screen device.

[0093] Based on the above embodiments:

[0094] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a display screen matching check provided by this application based on the number of pixel points discarded within the black border area and the starting position of the non-black border screen.

[0095] As a preferred embodiment, the display screen matching check based on the number of pixel points discarded within the black border area and the starting position of the non-black border screen includes:

[0096] S61. Calculate the total number of pixels in the black border area based on the number of pixel points discarded within the black border area to determine the width of the first black border area discarded;

[0097] Specifically, the number of pixel points discarded within the black border area is the total number of pixels in the black border area. Taking 1920*1080 as an example, 1920 is the number of column pixels, 1080 is the number of row pixels, and the width of each column pixel is 1. Assuming that 1-10 column pixels are discarded, the total number of pixel points is 1080*10 pixel points, and the pixel width is 10, then the width of the first black border area discarded is 10.

[0098] S62. Calculate the total number of pixels in the non-black border area based on the starting position of the non-black border screen to determine the width of the first non-black border area;

[0099] Specifically, calculate the total number of pixels in the non-black border area based on the starting position of the non-black border screen. The total number of pixels in the non-black border area is the product of the number of row pixels and the number of column pixels. Assuming that 1-10 column pixels are discarded, the total number of pixel points in the non-black border area is 1080*(1920 - 10) pixel points, and the pixel width is (1920 - 10), then the width of the first non-black border area is (1920 - 10).

[0100] S63. Determine whether the sum of the width of the first black border area and the width of the first non-black border area is equal to the width of the original image data information;

[0101] S64. If they are equal, the width of the screen after cutting the black border matches the original image data information.

[0102] Specifically, in this embodiment, determine whether the sum of the width of the black border area and the width of the non-black border area is equal to the width of the original image data information. If they are equal, the width of the screen after cutting the black border matches the original image data information.

[0103] Please refer to Figure 3 , Figure 3 , which is a schematic flowchart of a method for controlling black border cutting of the display screen of the secondary screen of a mobile phone provided by this application.

[0104] As a preferred embodiment, a method for controlling black border cutting of the display screen of the secondary screen of a mobile phone further includes:

[0105] S71. If the verification fails, control the Scaler module to adjust the black border cutting range according to the verification result;

[0106] S72. Determine the width of the second black border area to be discarded according to the adjusted black border cutting range;

[0107] S73. Determine the width of the second non-black border area to be retained according to the adjusted black border cutting range;

[0108] S74. Determine whether the sum of the width of the second black border area and the width of the second non-black border area is equal to the width of the original image data information;

[0109] S75. If they are equal, adjust the width of the screen after cutting the black border to match the original image data information.

[0110] Specifically, in this embodiment, if the sum of the width of the black border area and the width of the non-black border area is not equal to the width of the original image data information, it means that the width of the screen after cutting the black border is incorrect, and the threshold or area for black border detection needs to be readjusted until the width of the screen after cutting the black border matches the original image data information. Therefore, this application can maintain the original width and ratio of the screen, ensure the correct display of the image on the display device, and improve the display effect and user experience.

[0111] Please refer to Figure 4 , Figure 4 , which is a schematic flowchart of a method for detecting black border areas based on image data information and determining whether there are black border areas provided by this application.

[0112] As a preferred embodiment, black edge region detection is performed based on image data information. Determining whether there is a black edge region includes:

[0113] S31. Detect from the horizontal direction according to the display screen, and capture the first column pixel region; wherein, the first column pixel region includes the pixels of the (1, x) column, and each column of pixels includes y pixel points;

[0114] S32. Judging the pixel levels of the pixel points in the first column pixel region one by one;

[0115] S33. If there are 0-level pixel points, determine the 0-level pixel points as black pixel points;

[0116] S34. If all the pixel points in the first column pixel region are 0-level pixel points, discard all the pixel points in the first column pixel region;

[0117] S35. If the first column pixel region contains both 0-level pixel points and non-0-level pixel points at the same time, gradually narrow the detection range through a recursive algorithm, and discard after identifying the 0-level pixel points.

[0118] As a preferred embodiment, black edge region detection is performed based on image data information. Determining whether there is a black edge region further includes:

[0119] Detect from the horizontal direction according to the display screen, and capture the second column pixel region; wherein, the second column pixel region includes the pixels of the (x + 1, x + t) column, and each column of pixels includes y pixel points;

[0120] Judging the pixel levels of the pixel points in the second column pixel region one by one;

[0121] If there are 0-level pixel points, determine the 0-level pixel points as black pixel points;

[0122] If all the pixel points in the second column pixel region are 0-level pixel points, discard all the pixel points in the second column pixel region;

[0123] If the second column pixel region contains both 0-level pixel points and non-0-level pixel points at the same time, gradually narrow the detection range through a recursive algorithm, and discard after identifying the 0-level pixel points.

[0124] Specifically, taking the display screen resolution of 1920 * 1080 as an example, the Scaler module starts from the left side of the screen and captures pixels column by column. The initial capture range is set to 1 - 10 columns, and each column contains 1080 rows of pixels.

[0125] Specifically, the Scaler module checks whether all the pixels within these 1 - 10 columns are 0-level, that is, the RGB three-color values are all 0. If they are 0-level, it means black. If all the detected pixels are black, it is determined that this region is a black edge region.

[0126] Specifically, when the screen is all 0s, the Scaler module discards the black border area of the screen and simultaneously records how many pixels are captured. Further, the Scaler module continues to capture 1080 rows of pixels in columns 11 - 20 to the right until a non-zero value is captured, and then determines it as a non-black border screen.

[0127] It should be noted that the capture range of columns 1 - 10 can be set as needed and is not specifically limited here. If there are both black border and non-black border screens in the captured column range, the present application uses a recursive algorithm to gradually narrow the selected range to determine the size of the black border.

[0128] Specifically, in this embodiment, detecting from the horizontal direction of the display screen includes detecting from left to right or from right to left, which is not specifically limited here.

[0129] Please refer to Figure 5 , Figure 5 which is a schematic diagram of the principle for detecting the black border area from the horizontal direction according to the display screen provided by the present application.

[0130] As a preferred embodiment, detecting the black border area according to the image data information and determining whether there is a black border area includes:

[0131] Detecting from the vertical direction of the display screen and capturing the first row of pixel areas; wherein, the first row of pixel areas includes pixels in the (1, m)th row, and each column of pixels includes n pixel points;

[0132] Judging the pixel levels of the pixel points in the first row of pixel areas one by one;

[0133] If there are 0-level pixel points, the 0-level pixel points are determined as black pixel points;

[0134] If all the pixel points in the first row of pixel areas are 0-level pixel points, all the pixel points in the first row of pixel areas are discarded;

[0135] If the first row of pixel areas contains both 0-level pixel points and non-0-level pixel points, the detection range is gradually narrowed through a recursive algorithm, and after identifying the 0-level pixel points, they are discarded.

[0136] As a preferred embodiment, detecting the black border area according to the image data information and determining whether there is a black border area includes:

[0137] Detecting from the vertical direction of the display screen and capturing the second row of pixel areas; wherein, the second row of pixel areas includes pixels in the (m + 1, m + t)th row, and each column of pixels includes n pixel points;

[0138] Judge the pixel levels of the pixel points in the second row pixel area one by one;

[0139] If there are 0-level pixel points, determine the 0-level pixel points as black pixel points;

[0140] If all the pixel points in the second row pixel area are 0-level pixel points, discard all the pixel points in the second row pixel area;

[0141] If the second row pixel area contains both 0-level pixel points and non-0-level pixel points at the same time, gradually narrow the detection range through a recursive algorithm, and discard the 0-level pixel points after identification.

[0142] Specifically, in this embodiment, the principle of detecting the black edge area from the vertical direction is the same as that of detecting the black edge area from the horizontal direction, and will not be elaborated here.

[0143] Specifically, in this embodiment, detecting from the vertical direction of the display screen includes detecting from top to bottom or from bottom to top, and no specific limitation is made here.

[0144] Please refer to Figure 6 , Figure 6 , which is a schematic diagram of the principle of detecting the black edge area from the vertical direction according to the display screen provided by this application.

[0145] Please refer to Figure 7 , Figure 7 , which is a schematic flowchart of another method for controlling the black edge cutting of the mobile phone secondary screen display screen provided by this application.

[0146] As a preferred embodiment, a method for controlling the black edge cutting of the mobile phone secondary screen display screen further includes:

[0147] S9. Analyze the video frames of the continuous video signal in real time and identify the changes in the black edge area;

[0148] S10. Predict the change trend of the black edge area according to the changes in the black edge area;

[0149] Specifically, in this embodiment, when the secondary screen device is applied to dynamic application scenarios such as live broadcast and video recording, this application analyzes the continuous video frames in real time through algorithms adapted to dynamic changes, such as real-time convolutional neural network (RCNN) or target tracking algorithm.

[0150] Specifically, this application uses machine learning algorithms, such as time series analysis and pattern recognition, to identify and predict the change trend of the black edge area, so as to automatically and quickly make corresponding adjustments.

[0151] S11. Based on the prediction result, adaptively adjust the black edge detection threshold and detection area of the Scaler module to adapt to the dynamic scenario.

[0152] Specifically, in this embodiment, by adaptively adjusting the threshold and region of black edge detection, the adaptability of the system in a dynamic scenario is improved.

[0153] Please refer to Figure 8 , Figure 8 , which is a schematic flowchart of another method for controlling black edge cutting of the display screen of the secondary screen of a mobile phone provided by this application.

[0154] As a preferred embodiment, a method for controlling black edge cutting of the display screen of the secondary screen of a mobile phone further includes:

[0155] S101. Real-time obtain the light change value of the surrounding environment;

[0156] S102. Adaptively adjust the light supplement value of the light supplement device according to the light change value;

[0157] Specifically, in this embodiment, the light intensity of the current environment is measured by an ambient light sensor and converted into a light change value, and the light supplement value of the light supplement device set on the secondary screen device is adaptively adjusted according to the light change value.

[0158] S103. Control the Scaler module to receive the video signals of different signal sources after light supplement;

[0159] S104. Automatically adjust the black edge cutting area in the image data information of the video signal according to the video signals of different signal sources after light supplement.

[0160] It can be understood that poor lighting conditions will cause more black edge areas in the display screen. In an environment with poor lighting conditions, the images captured by the camera may contain more shadows and low-contrast areas. These areas may be misidentified as black edges during display, resulting in an increase in the black edge area in the display screen.

[0161] Specifically, since the light supplement value changes, the video signals collected by the camera also change accordingly. This application automatically adjusts the light supplement value of the light supplement device according to the ambient light conditions, improves the brightness and contrast of the image, so as to automatically adjust the black edge cutting area in the image data information of the video signal during subsequent black edge area detection, thereby reducing the possibility of being misidentified as a black edge and improving the accuracy of black edge cutting.

[0162] This application also provides a secondary screen device, and a method for controlling black edge cutting of the display screen of the secondary screen of a mobile phone is applied to the secondary screen device.

[0163] For the introduction of a method for controlling black edge cutting of the display screen of the secondary screen of a mobile phone provided by this application, please refer to the above embodiments, and this application will not elaborate here.

[0164] It should be noted that in this specification, the terms "comprising", "including" or any other variation thereof are intended to cover non-exclusive inclusion, such that a process, method, article or apparatus comprising a series of elements not only includes those elements but also other elements not expressly listed, or elements inherent to such process, method, article or apparatus. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising the element.

[0165] The foregoing description of the disclosed embodiments enables those skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for controlling the black border of a mobile phone secondary screen display, characterized in that: include: Control the Scaler module to receive video signals from different signal sources; Controlling the Scaler module to parse the video signal to obtain image data information of the video signal; Perform black border area detection based on the image data information to determine whether there is a black border area; When a black border area is detected, the Scaler module is controlled to discard the pixels in the black border area, and the number of the discarded pixels in the black border area is recorded; When a non-black-border area is detected, the Scaler module is controlled to stop discarding pixels and record the starting position of the non-black-border image; Performing a display image matching check based on the number of pixels in the discarded black border area and the starting position of the non-black border image; If the verification passes, control the Scaler module to generate a new pixel matrix and obtain the resolution and setting value of the target display device; After performing image scaling processing according to the resolution and setting value of the target display device, the new pixel matrix is ​​transmitted to the subsequent image processing module; Analyzing continuous video frames of the video signal in real time to identify changes in the black border area; Predicting a change trend of the black border area according to the change of the black border area; Based on the prediction results, the black edge detection threshold and the detection area of ​​the Scaler module are adaptively adjusted to adapt to the dynamic scene; Obtain the lighting change value of the surrounding environment in real time; Adaptively adjusting the fill light value of the fill light device according to the illumination change value; Control the Scaler module to receive video signals from different signal sources after fill light; According to the video signals of different signal sources after fill light, the black edge cutting area in the image data information of the video signal is automatically adjusted.

2. A method for controlling the black border cutting of a mobile phone secondary screen display according to claim 1, characterized in that: The display image matching check based on the number of pixels in the discarded black border area and the starting position of the non-black border image includes: Calculating the total number of pixels in the black border area according to the number of pixels in the discarded black border area to determine the width of the discarded first black border area; Calculating the total number of pixels in the non-black-border area according to the starting position of the non-black-border image to determine the width of the first non-black-border area; Determine whether the sum of the width of the first black border area and the width of the first non-black border area is equal to the width of the original image data information; If they are equal, the width of the picture after cutting the black border matches the original image data information.

3. A method for controlling the black border cutting of a mobile phone secondary screen display according to claim 1, characterized in that: The method for controlling the black border cutting of the display screen on the secondary screen of a mobile phone also includes: If the verification fails, the Scaler module is controlled to adjust the black edge cutting range according to the verification result; Determine the width of the discarded second black border area according to the adjusted black border cutting range; Determine the width of the second non-black border area to be retained according to the adjusted black border cutting range; Determine whether the sum of the width of the second black border area and the width of the second non-black border area is equal to the width of the original image data information; If they are equal, the width of the picture after cutting the black border is adjusted to match the original image data information.

4. A method for controlling the black border cutting of a mobile phone secondary screen display according to claim 1, characterized in that: The performing black border region detection according to the image data information to determine whether a black border region exists includes: Detecting in a vertical direction according to the display screen, grabbing a first column of pixel areas; wherein the first column of pixel areas includes the (1, x)th column of pixels, and each column of pixels includes y pixels; Determine the pixel classes of the pixels in the first column of pixel areas one by one; If there is a 0-order pixel point, the 0-order pixel point is determined as a black pixel point; If all the pixels in the first column of pixel areas are 0-order pixels, all the pixels in the first column of pixel areas are discarded; If the first column of pixel areas contains both 0th-order pixels and non-0th-order pixels, the detection range is gradually narrowed down through a recursive algorithm, and the 0th-order pixels are discarded after being identified.

5. A method for controlling the black border cutting of a mobile phone secondary screen display according to claim 4, characterized in that: The performing black border region detection according to the image data information and determining whether there is a black border region further comprises: Detecting in a vertical direction according to the display screen, capturing a second column of pixel areas; wherein the second column of pixel areas includes the (x+1, x+t)th column of pixels, and each column of pixels includes y pixels; Determine the pixel classes of the pixels in the second column of pixel areas one by one; If there is a 0-order pixel point, the 0-order pixel point is determined as a black pixel point; If all the pixels in the second column of pixel areas are 0-order pixels, all the pixels in the second column of pixel areas are discarded; If the second column of pixel areas contains both 0-order pixels and non-0-order pixels, the detection range is gradually narrowed down through a recursive algorithm, and the 0-order pixels are discarded after being identified.

6. A method for controlling the black border cutting of a mobile phone secondary screen display according to claim 1, characterized in that: The performing black border region detection according to the image data information to determine whether a black border region exists includes: Detecting the display image from the horizontal direction, capturing the first row of pixel areas; wherein the first row of pixel areas includes the (1, m)th row of pixels, and each column of pixels includes n pixel points; Determine the pixel classes of the pixels in the first row of pixel areas one by one; If there is a 0-order pixel point, the 0-order pixel point is determined as a black pixel point; If all the pixels in the first row of pixel areas are 0-order pixels, all the pixels in the first row of pixel areas are discarded; If the first row of pixel areas contains both 0th-order pixels and non-0th-order pixels, the detection range is gradually narrowed down through a recursive algorithm, and the 0th-order pixels are discarded after being identified.

7. A method for controlling the black border cutting of a mobile phone secondary screen display according to claim 6, characterized in that: The performing black border region detection according to the image data information to determine whether a black border region exists includes: Detecting in the horizontal direction according to the display screen, capturing the second row of pixel areas; wherein the second row of pixel areas includes the (m+1, m+t)th row of pixels, and each column of pixels includes n pixel points; Determine the pixel classes of the pixels in the second row of pixel areas one by one; If there is a 0-order pixel point, the 0-order pixel point is determined as a black pixel point; If all the pixels in the second row of pixel areas are 0-order pixels, all the pixels in the second row of pixel areas are discarded; If the second row of pixel areas contains both 0-order pixels and non-0-order pixels, the detection range is gradually narrowed down through a recursive algorithm, and the 0-order pixels are discarded after being identified.

8. A secondary screen device, characterized in that: The method for controlling the cutting of black borders on the secondary screen display of a mobile phone as described in any one of claims 1 to 7 is applied to the secondary screen device.

Images