Screen projection method and system suitable for vertical screen display and related equipment

Abstract

The invention relates to a screen projection method and system suitable for vertical screen display and related equipment, and the method comprises the following steps: obtaining display data of screen projection equipment, and decoding and converting the display data into first decoding data with a first preset resolution; obtaining a cutting proportion for cutting and hiding the display content of the display data; based on the cutting proportion, cutting the first decoding data to obtain second decoding data with a second preset resolution; and transmitting the address of the second decoded data to a display device for screen projection display. According to the invention, the display data displayed on the vertical screen can be displayed according to the size of the display screen, the picture is kept complete, and meanwhile, the content needing to be hidden in the display data can be cut off, so that the effect of customized screen projection is achieved.

Description

Technical Field

[0001] The present invention is applicable to the field of screen projection technology, and in particular relates to a method, system and related equipment adapted to vertical screen display. Background Art

[0002] With the changes in smart device hardware and the expansion of usage methods, there are more and more scenarios for screen projection display based on handheld devices such as smartphones. In entertainment scenarios, short videos or pictures displayed on the phone screen can be projected onto a larger screen for viewing through smartphone projection.

[0003] In existing screen projection solutions, the content displayed on the smart device is generally based on the actual content displayed on the screen. That is, the content displayed on the screen is what is displayed on the screen. However, this solution has the following problems:

[0004] First, the projection screen may not be suitable for the screen size. The display ratio of existing smart devices is inconsistent with the display ratio of the projected monitor. When displaying a vertical screen, the projection content cannot fill the screen, resulting in poor display effect.

[0005] Second, the display content of smart devices may contain privacy information or information that affects the display content, such as pop-up reminders of chat messages, the status bar and operation bar of smartphones, etc. These will be displayed together when projecting the screen, resulting in a poor projection experience.

[0006] Therefore, it is necessary to optimize for the above usage scenarios. Summary of the Invention

[0007] The present invention provides a screen projection method, system and related equipment adapted to vertical screen display, aiming to solve the technical problems in existing vertical screen display projection solutions in which the picture does not adapt to the screen and the displayed content is easily affected.

[0008] To solve the above technical problems, in a first aspect, the present invention provides a screen projection method adapted to vertical screen display, the screen projection method comprising the following steps:

[0009] Obtaining display data of the screen projection device, and decoding the display data into first decoded data of a first preset resolution;

[0010] Obtaining a cropping ratio for cropping and hiding displayed content of the display data;

[0011] cropping the first decoded data based on the cropping ratio to obtain second decoded data with a second preset resolution;

[0012] The address of the second decoded data is transmitted to the display device for screen projection display.

[0013] Furthermore, the horizontal resolution of the first preset resolution is greater than the vertical resolution, and the horizontal resolution and / or vertical resolution of the second preset resolution are respectively smaller than the horizontal resolution and / or vertical resolution of the first preset resolution.

[0014] Furthermore, in the step of decoding the display data into first decoded data of a first preset resolution:

[0015] If the display data is in a vertical screen display direction with a horizontal resolution smaller than a vertical resolution, the display data is aligned to be the same as the vertical resolution of the first preset resolution according to its vertical resolution byte, and black pixels of the same size are filled on its left and right sides to decode and obtain the first decoded data.

[0016] Furthermore, the step of cropping the first decoded data based on the cropping ratio to obtain second decoded data of a second preset resolution includes the following sub-steps:

[0017] Calculating the image content that needs to be cropped in the first decoded data according to the cropping ratio to obtain cropped decoded data;

[0018] The cropped decoded data is rotated according to a display direction of the display device to obtain the second decoded data.

[0019] Furthermore, in the step of calculating the picture content to be cropped in the first decoded data according to the cropping ratio, a plane rectangular coordinate system is established with the upper left vertex of the picture area of ​​the first decoded data as the origin;

[0020] Define the horizontal resolution size of the first decoded data as w, the vertical resolution size as h, the horizontal cropping size of the cropped decoded data as cw, the vertical cropping size as ch, the original cropping horizontal coordinate as x, the original cropping vertical coordinate as y, the cropping ratio as n, and the cropped decoded data satisfies:

[0021] cw=h×(1-n)×w÷h;

[0022] ch=h×(1-n);

[0023] x=(w-cw)÷2;

[0024] y=0.

[0025] Furthermore, in the step of decoding and converting the display data into first decoded data of a first preset resolution, the display data is decoded and converted into the first decoded data based on the h.264 video codec protocol.

[0026] In a second aspect, the present invention further provides a screen projection system adapted to vertical screen display, comprising:

[0027] A decoding module, configured to obtain display data of a screen projection device and decode the display data into first decoded data of a first preset resolution;

[0028] A cropping function module, used to obtain a cropping ratio for cropping and hiding the display content of the display data;

[0029] a cropping processing module, configured to crop the first decoded data based on the cropping ratio to obtain second decoded data with a second preset resolution;

[0030] The screen projection display module is used to transmit the address of the second decoded data to the display device for screen projection display.

[0031] Furthermore, the horizontal resolution of the first preset resolution is greater than the vertical resolution, and the horizontal resolution and / or vertical resolution of the second preset resolution are respectively smaller than the horizontal resolution and / or vertical resolution of the first preset resolution;

[0032] The cutting processing module is further used for:

[0033] Calculating the image content that needs to be cropped in the first decoded data according to the cropping ratio to obtain cropped decoded data;

[0034] The cropped decoded data is rotated according to a display direction of the display device to obtain the second decoded data.

[0035] In the third aspect, the present invention also provides a computer device, comprising: a memory, a processor, and a screen projection program adapted to vertical screen display stored in the memory and runnable on the processor, wherein when the processor executes the screen projection program adapted to vertical screen display, the steps in the screen projection method adapted to vertical screen display as described in any one of the above embodiments are implemented.

[0036] In a fourth aspect, the present invention also provides a computer-readable storage medium, on which a screen projection program adapted to vertical screen display is stored. When the screen projection program adapted to vertical screen display is executed by a processor, the steps in the screen projection method adapted to vertical screen display as described in any one of the above embodiments are implemented.

[0037] The beneficial effect achieved by the present invention is that a screen projection method adapted to vertical screen display is proposed. The method processes the display data by means of fixed-resolution decoding, thereby improving the editability of the original data. At the same time, the method crops the display data by means of variable secondary decoding, so that the display data of the vertical screen display can be displayed according to the size of the display screen and the picture can be kept intact. At the same time, the content that needs to be hidden in the display data can be cropped to achieve the effect of customized screen projection. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 This is a flowchart of the steps of a screen projection method adapted to vertical screen display provided by an embodiment of the present invention;

[0039] Figure 2 2 is a schematic diagram of first decoded data in a screen projection method adapted to vertical screen display provided by an embodiment of the present invention;

[0040] Figure 3 2 is a schematic diagram of second decoded data in the screen projection method adapted to vertical screen display provided by an embodiment of the present invention;

[0041] Figure 4 2 is a schematic diagram of the structure of a screen projection system adapted to vertical screen display provided by an embodiment of the present invention;

[0042] Figure 5 It is a structural diagram of a computer device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0043] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0044] Please refer to Figure 1 , Figure 1 : This is a flowchart of the steps of a screen projection method adapted to vertical screen display provided by an embodiment of the present invention, the screen projection method comprising the following steps:

[0045] S101. Obtain display data of a screen projection device, and decode the display data into first decoded data of a first preset resolution.

[0046] Specifically, in an embodiment of the present invention, the horizontal resolution of the first preset resolution is greater than the vertical resolution, that is, the first preset resolution is a horizontal resolution. Generally, existing display devices (displays) are all horizontally oriented, while smartphones are primarily vertically oriented. Short video applications, unlike conventional video applications, also have a vertical orientation. Therefore, in a screen projection scenario, vertically displayed content cannot be fully displayed on a horizontally oriented display device.

[0047] In the step of decoding the display data into first decoded data of a first preset resolution:

[0048] If the display data is in a vertical screen display direction with a horizontal resolution smaller than a vertical resolution, the display data is aligned to be the same as the vertical resolution of the first preset resolution according to its vertical resolution byte, and black pixels of the same size are filled on its left and right sides to decode and obtain the first decoded data.

[0049] For details, please refer to Figure 2 , Figure 2 This is a schematic diagram of the first decoded data provided by an embodiment of the present invention. In this embodiment, according to the above method, the display data for vertical display is decoded and converted into decoded data with a fixed horizontal orientation. This process involves the use of black pixel padding. Based on this step, the display data is centered within the first decoded data, while its sides are padded with black pixels of the same size. This design facilitates the subsequent secondary decoding process.

[0050] Preferably, the display data is decoded and converted into the first decoded data based on the h.264 video codec protocol. This type of video decoding can adapt to different video editing programs to the greatest extent, and can also adapt to reading by display devices.

[0051] In the above steps, the embodiment of the present invention decodes the black pixel filling for the display data displayed in a vertical orientation. It is understandable that for the display data displayed in a horizontal orientation, if its aspect ratio is the same as the first preset resolution, no black pixel filling processing is required. However, the display data displayed in a horizontal orientation is easy to project on an existing display device, and the methods in the embodiments of the present invention only discuss the process of processing the display data displayed in a vertical orientation.

[0052] S102: Obtain a cropping ratio for cropping and hiding displayed content of the display data.

[0053] The cropping ratio in the embodiment of the present invention is determined by the user. The cropping ratio is used to determine the size of the displayed content to be cropped and hidden. Since the resolution and ratio of different devices are different, the cropping ratio can be determined according to actual needs, thereby realizing a customized screen projection process.

[0054] S103: Crop the first decoded data based on the cropping ratio to obtain second decoded data with a second preset resolution.

[0055] Since the second decoded data is obtained by cropping the first decoded data, the horizontal resolution and / or vertical resolution of the second preset resolution is respectively smaller than the horizontal resolution and / or vertical resolution of the first preset resolution.

[0056] Step S103, cropping the first decoded data based on the cropping ratio to obtain second decoded data of a second preset resolution, includes the following sub-steps:

[0057] S1031 : Calculate the picture content that needs to be cropped in the first decoded data according to the cropping ratio to obtain cropped decoded data.

[0058] In step S1031, a plane rectangular coordinate system is established with the upper left vertex of the picture area of ​​the first decoded data as the origin;

[0059] like Figure 3 As shown, the horizontal resolution size of the first decoded data is defined as w, the vertical resolution size is defined as h, the horizontal cropping size of the cropped decoded data is defined as cw, the vertical cropping size is defined as ch, the original cropping horizontal coordinate is defined as x, the original cropping vertical coordinate is defined as y, the cropping ratio is defined as n, and the cropped decoded data satisfies:

[0060] cw=h×(1-n)×w÷h;

[0061] ch=h×(1-n);

[0062] x=(w-cw)÷2;

[0063] y=0.

[0064] Through the above steps, specific content that needs to be displayed on the display device can be obtained based on the calculation of the resolution size. This process does not involve complex processing flows such as image recognition, and can improve the adaptability of the method proposed in the embodiment of the present invention on various devices.

[0065] S1032: Rotate the cropped decoded data according to the display direction of the display device to obtain the second decoded data.

[0066] In order to completely display the second decoded data on the display device, a certain rotation process is required. Since there is a direct directional relationship between vertical display and horizontal display, the rotation angle can be 90 degrees or 270 degrees.

[0067] S104: Transmit the address of the second decoded data to a display device for screen projection display.

[0068] The display device obtains the data to be projected and displayed by reading the address of the second decoded data, thereby avoiding the data copying process and ensuring the real-time transmission of the projection data.

[0069] It is understandable that the above-mentioned projection method adapted to vertical screen display processes the display data for vertical display so as to display it on the display device. However, for horizontal display data of a specific ratio, when it is displayed on the display device, the screen may not be fully filled and pop-up information may easily appear in specific positions. Therefore, it can also refer to the method in the embodiment of the present invention to perform fixed resolution decoding and proportional cropping processing, thereby improving its projection effect. Refer to the description in the above embodiment, which will not be repeated here.

[0070] The beneficial effect achieved by the present invention is that a screen projection method adapted to vertical screen display is proposed. The method processes the display data by means of fixed-resolution decoding, thereby improving the editability of the original data. At the same time, the method crops the display data by means of variable secondary decoding, so that the display data of the vertical screen display can be displayed according to the size of the display screen and the picture can be kept intact. At the same time, the content that needs to be hidden in the display data can be cropped to achieve the effect of customized screen projection.

[0071] The embodiment of the present invention also provides a projection system 200 adapted to vertical screen display, please refer to Figure 4 , Figure 4 : is a structural diagram of a screen projection system adapted to vertical screen display provided by an embodiment of the present invention, which includes:

[0072] A decoding module 201 is used to obtain display data of the screen projection device and decode the display data into first decoded data of a first preset resolution;

[0073] The cropping function module 202 is used to obtain a cropping ratio for cropping and hiding the display content of the display data;

[0074] A cropping processing module 203, configured to crop the first decoded data based on the cropping ratio to obtain second decoded data with a second preset resolution;

[0075] The screen projection display module 204 is used to transmit the address of the second decoded data to the display device for screen projection display.

[0076] The horizontal resolution of the first preset resolution is greater than the vertical resolution, and the horizontal resolution and / or vertical resolution of the second preset resolution are respectively smaller than the horizontal resolution and / or vertical resolution of the first preset resolution;

[0077] The cutting processing module 203 is further configured to:

[0078] Calculating the image content that needs to be cropped in the first decoded data according to the cropping ratio to obtain cropped decoded data;

[0079] The cropped decoded data is rotated according to a display direction of the display device to obtain the second decoded data.

[0080] The screen projection system 200 adapted to vertical screen display can implement the steps in the screen projection method adapted to vertical screen display in the above embodiment, and can achieve the same technical effects. Please refer to the description in the above embodiment and will not be repeated here.

[0081] The embodiment of the present invention also provides a computer device, please refer to Figure 5 , Figure 5 It is a structural diagram of a computer device provided in an embodiment of the present invention. The computer device 300 includes: a memory 302, a processor 301, and a screen projection program adapted to vertical screen display stored in the memory 302 and executable on the processor 301.

[0082] The processor 301 calls the screen projection program adapted to vertical screen display stored in the memory 302, and executes the steps of the screen projection method adapted to vertical screen display provided by the embodiment of the present invention. Figure 1 , specifically including the following steps:

[0083] S101. Obtain display data of a screen projection device, and decode the display data into first decoded data of a first preset resolution.

[0084] The horizontal resolution of the first preset resolution is greater than the vertical resolution.

[0085] The display data is decoded and converted into the first decoded data based on the h.264 video codec protocol.

[0086] In the step of decoding the display data into first decoded data of a first preset resolution:

[0087] If the display data is in a vertical screen display direction with a horizontal resolution smaller than a vertical resolution, the display data is aligned to be the same as the vertical resolution of the first preset resolution according to its vertical resolution byte, and black pixels of the same size are filled on its left and right sides to decode and obtain the first decoded data.

[0088] S102: Obtain a cropping ratio for cropping and hiding displayed content of the display data.

[0089] S103: Crop the first decoded data based on the cropping ratio to obtain second decoded data with a second preset resolution.

[0090] The horizontal resolution and / or the vertical resolution of the second preset resolution are respectively smaller than the horizontal resolution and / or the vertical resolution of the first preset resolution.

[0091] Step S103, cropping the first decoded data based on the cropping ratio to obtain second decoded data of a second preset resolution, includes the following sub-steps:

[0092] S1031 : Calculate the picture content that needs to be cropped in the first decoded data according to the cropping ratio to obtain cropped decoded data.

[0093] In step S1031, a plane rectangular coordinate system is established with the upper left vertex of the picture area of ​​the first decoded data as the origin;

[0094] Define the horizontal resolution size of the first decoded data as w, the vertical resolution size as h, the horizontal cropping size of the cropped decoded data as cw, the vertical cropping size as ch, the original cropping horizontal coordinate as x, the original cropping vertical coordinate as y, the cropping ratio as n, and the cropped decoded data satisfies:

[0095] cw=h×(1-n)×w÷h;

[0096] ch=h×(1-n);

[0097] x=(w-cw)÷2;

[0098] y=0.

[0099] S1032: Rotate the cropped decoded data according to the display direction of the display device to obtain the second decoded data.

[0100] S104: Transmit the address of the second decoded data to a display device for screen projection display.

[0101] The computer device 300 provided in an embodiment of the present invention can implement the steps in the screen projection method adapted to vertical screen display in the above embodiment, and can achieve the same technical effects. Please refer to the description in the above embodiment and will not be repeated here.

[0102] An embodiment of the present invention also provides a computer-readable storage medium, which stores a screen projection program that adapts to vertical screen display. When the screen projection program that adapts to vertical screen display is executed by a processor, the various processes and steps in the screen projection method that adapts to vertical screen display provided by an embodiment of the present invention are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0103] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware (which can be a mobile phone, computer, server, air conditioner, or network equipment, etc.) through a screen projection program adapted to vertical screen display. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0104] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0105] The embodiments of the present invention are described above in conjunction with the accompanying drawings. What is disclosed is only a preferred embodiment of the present invention. However, the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms and equivalent changes without departing from the scope of protection of the purpose of the present invention and the claims, which are all within the protection of the present invention.

Claims

1. A screen projection method adapted to vertical screen display, characterized in that: The screen projection method comprises the following steps: Acquire display data of the screen projection device, and decode the display data into first decoded data with a first preset resolution; Obtaining a cropping ratio for cropping and hiding displayed content of the display data; Based on the cropping ratio, cropping the first decoded data to obtain second decoded data with a second preset resolution; The address of the second decoded data is transmitted to the display device for screen projection display.

2. The screen projection method adapted to vertical screen display according to claim 1, characterized in that: The lateral resolution of the first preset resolution is greater than the longitudinal resolution, and the lateral resolution and / or longitudinal resolution of the second preset resolution are respectively smaller than the lateral resolution and / or longitudinal resolution of the first preset resolution.

3. The screen projection method adapted to vertical screen display according to claim 2, characterized in that: In the step of decoding the display data into first decoded data of a first preset resolution: If the display data is in a vertical screen display direction with a horizontal resolution smaller than a vertical resolution, the display data is aligned according to its vertical resolution byte to be the same as the vertical resolution of the first preset resolution, and black pixels of the same size are filled on its left and right sides to decode and obtain the first decoded data.

4. The screen projection method adapted to vertical screen display according to claim 2, characterized in that: The step of cropping the first decoded data based on the cropping ratio to obtain second decoded data with a second preset resolution includes the following sub-steps: Calculating the picture content to be cropped in the first decoded data according to the cropping ratio to obtain cropped decoded data; The cropped decoded data is rotated according to a display direction of the display device to obtain the second decoded data.

5. The screen projection method adapted to vertical screen display according to claim 4, characterized in that: According to the cropping ratio, the picture content to be cropped in the first decoded data is calculated, and in the step of obtaining the cropped decoded data, a plane rectangular coordinate system is established with the upper left vertex of the picture area of ​​the first decoded data as the origin; Define the horizontal resolution size of the first decoded data as w, the vertical resolution size as h, the horizontal cropping size of the cropped decoded data as cw, the vertical cropping size as ch, the original horizontal coordinate of the cropping as x, the original vertical coordinate of the cropping as y, the cropping ratio as n, and the cropped decoded data satisfies: cw=h×(1-n)×w÷h; ch=h×(1-n); x=(w-cw)÷2; y＝0。 6. The screen projection method adapted to vertical screen display according to claim 1, characterized in that: In the step of decoding and converting the display data into first decoded data with a first preset resolution, the display data is decoded and converted into the first decoded data based on the h.264 video codec protocol.

7. A projection system adapted to vertical screen display, characterized in that: include: A decoding module, used for acquiring display data of the screen projection device, and decoding the display data into first decoded data of a first preset resolution; A cropping function module, used to obtain a cropping ratio for cropping and hiding the display content of the display data; A cropping processing module, configured to crop the first decoded data based on the cropping ratio to obtain second decoded data with a second preset resolution; A screen projection display module is used to transmit the address of the second decoded data to a display device for screen projection display.

8. The screen projection system adapted to vertical screen display according to claim 7, characterized in that: The lateral resolution of the first preset resolution is greater than the longitudinal resolution, and the lateral resolution and / or longitudinal resolution of the second preset resolution are respectively smaller than the lateral resolution and / or longitudinal resolution of the first preset resolution; The cutting processing module is also used for: Calculating the picture content to be cropped in the first decoded data according to the cropping ratio to obtain cropped decoded data; The cropped decoded data is rotated according to a display direction of the display device to obtain the second decoded data.

9. A computer device, characterized in that: include: A memory, a processor, and a screen projection program adapted to vertical screen display stored in the memory and executable on the processor, wherein the processor implements the steps in the screen projection method adapted to vertical screen display as described in any one of claims 1 to 6 when executing the screen projection program adapted to vertical screen display.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a screen projection program adapted to vertical screen display, and when the screen projection program adapted to vertical screen display is executed by the processor, the steps in the screen projection method adapted to vertical screen display as described in any one of claims 1-6 are implemented.

Images