Screen projection method, device, equipment, system, storage medium and program product

Abstract

The invention discloses a screen projection method, device, equipment and system, a storage medium and a program product, and the method comprises the steps: obtaining the display resolution of flexible display equipment, and determining the display resolution of an effective image in a screen projection image transmitted by a transmitting end; according to the display resolution of the flexible display device and the display resolution of an effective picture in the screen projection picture sent by the sending end, the position of a screen projection area in the display picture of the flexible display device is determined, at least two adjacent edges of the screen projection area coincide with the edge of the display picture of the flexible display device, and at least two adjacent edges of the screen projection area coincide with the edge of the display picture of the flexible display device. The display scale of the screen projection area is the same as the display scale of an effective picture in a screen projection picture sent by the sending end; and displaying the effective picture at the position of the screen projection area.

Description

Technical Field

[0001] The present application belongs to the field of display technology, and specifically relates to a screen projection method, device, equipment, system, storage medium and program product. Background Art

[0002] Electronic devices can send images to be displayed on a connected display device for projection. However, current screen projection applications suffer from the problem of mismatched screen ratios. For example, if the screen is projected on a mobile device with a vertical screen and the screen is projected on a horizontal screen, the display ratios of the receiving and sending ends may be inconsistent. In this case, a black area can be added around the projected image to match the display ratio, but this will affect the display quality. Summary of the Invention

[0003] The present application provides a screen projection method, device, equipment, system, storage medium and program product, which aim to solve the problem of black edges around the projected screen to at least a certain extent and improve the display effect.

[0004] In a first aspect of the present application, a screen projection method is provided, the method comprising: Obtain the display resolution of the flexible display device and determine the display resolution of the effective image in the projection image sent by the sender; Determining, according to the display resolution of the flexible display device and the display resolution of the effective picture in the projected picture sent by the sender, a position of a projection area in the display picture of the flexible display device, wherein at least two adjacent sides of the projection area coincide with edges of the display picture of the flexible display device, and a display ratio of the projection area is the same as a display ratio of the effective picture in the projected picture sent by the sender; The effective picture is displayed at the position of the projection area.

[0005] In some embodiments, determining the display resolution of the effective image in the projection image sent by the sending end includes: Receive the projection image sent by the sender; Perform image recognition on the projection screen sent by the sending end to determine the display resolution of the effective screen in the projection screen sent by the sending end.

[0006] In some embodiments, the projection screen sent by the sending end includes only a valid screen, or the projection screen sent by the sending end includes a valid screen and black screens located on opposite sides of the valid screen.

[0007] In some embodiments, performing image recognition on the projection screen sent by the sender to determine the display resolution of the effective screen in the projection screen sent by the sender includes: Binarizing the projection image sent by the sending end to obtain a binary image; Performing image edge detection on the binary image to obtain the edge of a valid image in the projection image sent by the sending end; The edge of the effective picture in the projection picture sent by the sending end is circumscribed by a minimum rectangle, and the display resolution of the effective picture in the projection picture sent by the sending end is determined according to the length and width of the circumscribed rectangle.

[0008] In some embodiments, displaying the valid image at the location of the projection area includes: Determine the position of the circumscribed rectangle in the projection picture sent by the sending end, and use it as the position of the effective picture in the projection picture sent by the sending end; According to the position of the effective picture in the projection picture sent by the sending end, the effective picture is displayed at the position of the projection area.

[0009] In some embodiments, displaying the valid image at a position in the projection area according to the position of the valid image in the projection image sent by the transmitting end includes: According to the position of the effective picture in the projection picture sent by the sending end, intercept the effective picture from the projection picture sent by the sending end, and display the intercepted effective picture at the position of the projection area; or According to the position of the effective picture in the projection picture sent by the sending end and the position of the projection area in the display picture of the flexible display device, the projection picture is displayed in the display picture of the flexible display device so that the effective picture is located in the projection area.

[0010] In some embodiments, the method further comprises: The display resolution of the flexible display device is sent to the sending end, so that the sending end generates and sends the projection screen according to the display resolution of the flexible display device and the display resolution of the sending end. The display ratio of the projection screen sent by the sending end is the same as the display ratio of the flexible display device, and the display ratio of the effective screen in the projection screen sent by the sending end is the same as the display ratio of the sending end.

[0011] In some embodiments, determining the position of the projection area in the display screen of the flexible display device according to the display resolution of the flexible display device and the display resolution of the effective screen in the projection screen sent by the transmitting end includes: Comparing, according to the display resolution of the flexible display device and the display resolution of the effective picture in the projected picture sent by the sender, a display ratio of the effective picture in the projected picture sent by the sender and the display ratio of the flexible display device, where the display ratio is a ratio of the number of pixels in a first direction to the number of pixels in a second direction in the display resolution, where the first direction is an extension direction of the flexible display device and the second direction is perpendicular to the first direction; If the display ratio of the effective screen in the projection screen sent by the sending end is less than or equal to the display ratio of the flexible display device, then at least determine the position of the projection area in the display screen of the flexible display device; If the display ratio of the effective picture in the projection screen sent by the sending end is greater than the display ratio of the flexible display device, the position of the projection area and the position of the desktop area for displaying system operation icons are determined in the display screen of the flexible display device, and the sum of the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction is equal to the number of pixels of the flexible display device in the second direction.

[0012] In some embodiments, the method of determining the position of the projection area and the position of the desktop area for displaying system operation icons in the display image of the flexible display device includes: If the display screen of the flexible display device has been unfolded, the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction are both determined as the number of pixels of the unfolded display screen in the first direction, and the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction are determined; If the display screen of the flexible display device is not unfolded, the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction are both determined as the number of pixels of the flexible display device in the first direction, and the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction are determined; If the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area in the first direction, the display screen of the flexible display device is unfolded according to the number of pixels of the projection area in the first direction.

[0013] In some embodiments, determining the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction includes: Determine the number of pixels of the projection area in the second direction according to the number of pixels of the projection area in the first direction and the display ratio of the effective picture in the projection picture sent by the sending end; Determining the number of pixels of the desktop area in the second direction according to the number of pixels of the projection area in the second direction and the number of pixels of the flexible display device in the second direction; If the number of pixels of the desktop area in the second direction is less than the minimum number of pixels of the desktop area, the number of pixels of the desktop area in the second direction is updated to the minimum number of pixels of the desktop area, and the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction are updated.

[0014] In some embodiments, determining at least a position of a projection area in a display image of the flexible display device includes: Determine the number of pixels of the projection area in the second direction as the number of pixels of the flexible display device in the second direction; Determine the number of pixels of the projection area in the first direction according to the number of pixels of the projection area in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end; In response to the user selecting the operation of projecting only the screen, if the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area in the first direction, the display screen of the flexible display device is expanded according to the number of pixels of the projection area in the first direction.

[0015] In some embodiments, determining at least a position of a projection area in a display image of the flexible display device further includes: In response to a user selecting a split-screen operation, determining the number of pixels of the desktop area in the second direction as the number of pixels of the flexible display device in the second direction, and determining the number of pixels of the desktop area in the first direction as the minimum number of pixels of the desktop area; If the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction is less than or equal to the number of pixels of the flexible display device in the first direction, unfolding the display screen of the flexible display device according to the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction; If the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction is greater than the number of pixels of the flexible display device in the first direction, updating the number of pixels of the desktop area in the second direction to the minimum number of pixels of the desktop area, and updating the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction; If the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area after being updated in the first direction, the display screen of the flexible display device is expanded according to the number of pixels of the projection area after being updated in the first direction.

[0016] In some embodiments, updating the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction includes: updating the number of pixels of the projection area in the second direction according to the updated number of pixels of the desktop area in the second direction and the number of pixels of the flexible display device in the second direction; According to the updated number of pixels in the projection area in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end, the number of pixels in the projection area in the first direction and the number of pixels in the desktop area in the first direction are updated.

[0017] In some embodiments, the flexible display device is a rollable display device or a sliding display device.

[0018] In a second aspect of the present application, a screen projection device is provided, comprising: An acquisition module is used to obtain the display resolution of the flexible display device and determine the display resolution of the effective image in the projection image sent by the sender; a determination module, configured to determine, based on the display resolution of the flexible display device and the display resolution of the effective picture in the projected picture sent by the sender, a position of a projection area in the display picture of the flexible display device, wherein at least two adjacent sides of the projection area coincide with edges of the display picture of the flexible display device, and a display ratio of the projection area is the same as a display ratio of the effective picture in the projected picture sent by the sender; A display module is used to display the effective image at the position of the projection area.

[0019] In a third aspect of the present application, a flexible display device is provided, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method provided in the first aspect when executing the computer program.

[0020] In a fourth aspect of the present application, a screen projection system is provided, comprising: The flexible display device provided in the third aspect; The electronic device is communicatively connected to the flexible display device and is configured to project a screen onto the flexible display device.

[0021] In a fifth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method provided in the first aspect are implemented.

[0022] In a sixth aspect of the present application, a computer program product is provided, comprising a computer program, which implements the steps of the method provided in the first aspect when executed by a processor.

[0023] According to the screen projection method, apparatus, equipment, system, storage medium and program product provided by one or more embodiments of the present application, the display resolution of the flexible display device is obtained to determine the display resolution of the effective picture in the projection picture sent by the sender, and the position of the projection area in the display picture of the flexible display device is determined according to the display resolution of the flexible display device and the display resolution of the effective picture in the projection picture sent by the sender. Since the display ratio of the projection area is the same as the display ratio of the effective picture in the projection picture sent by the sender, the effective picture can be displayed at the position of the projection area. Since at least two adjacent edges of the projection area coincide with the edges of the display picture of the flexible display device, the addition of black areas around the projection picture can be avoided, thereby improving the display effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0025] Figure 1 An application scenario diagram of the screen projection method in one or more embodiments of the present application is shown.

[0026] Figure 2 A schematic diagram comparing the display images of the screen projection receiving end and the sending end in the related art is shown.

[0027] Figure 3 A schematic diagram showing another display screen of a screen projection receiving end in the related art is shown.

[0028] Figure 4 Shown Figure 1Schematic diagram of an application scenario in which the electronic device is in landscape mode and the flexible display device only displays the screen in projection.

[0029] Figure 5 Shown Figure 1 Schematic diagram of an electronic device with a horizontal screen and a flexible display device with a split-screen display in an application scenario.

[0030] Figure 6 Shown Figure 1 Schematic diagram of an electronic device with a vertical screen and a flexible display device with split-screen display in an application scenario.

[0031] Figure 7 Shown Figure 1 Schematic diagram of an electronic device with a vertical screen and a flexible display device only displaying projection in an application scenario.

[0032] Figure 8 A flow chart of a screen projection method in one or more embodiments of the present application is shown.

[0033] Figure 9 Shown Figure 8 Schematic diagram of the flow of step S101.

[0034] Figure 10 Shown Figure 9 Schematic diagram of the process of step S202.

[0035] Figure 11 Shown Figure 8 Schematic diagram of the process of step S103.

[0036] Figure 12 Shown Figure 1 Schematic diagram of the projection screen when the flexible display device is unfolded to the left to display the screen.

[0037] Figure 13 Shown Figure 1 Schematic diagram of the projection screen when the flexible display device is unfolded to the right to display the screen.

[0038] Figure 14 Shown Figure 1 Schematic diagram of a split-screen display when the flexible display device has been unfolded at least partially.

[0039] Figure 15 Shown Figure 8 Schematic diagram of the process of step S102.

[0040] Figure 16 Shown Figure 15 FIG. 1 is a flow chart of step S503 of FIG.

[0041] Figure 17 Shown Figure 15 Schematic diagram of the process of step S502.

[0042] Figure 18 Shown Figure 15 Another flowchart of step S502 is shown.

[0043] Figure 19 A schematic structural diagram of a screen projection device in one or more embodiments of the present application is shown.

[0044] Figure 20 The figure shows the internal structure of the flexible display device in one or more embodiments of the present application. DETAILED DESCRIPTION

[0045] In order to enable those skilled in the art to understand the present application more clearly, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of this application.

[0046] Figure 1 For an application scenario diagram of the screen projection method in one or more embodiments of this application, please refer to Figure 1 The flexible display device 100 and the electronic device 200 are connected in communication, such as wireless WiFi, and the electronic device 200 projects a screen onto the flexible display device 100.

[0047] For example, see Figure 1 The flexible display device 100 can be a horizontal screen display device, such as a smart screen, a TV, a projector, etc. The electronic device 200 can be a mobile vertical screen device, such as a smart phone, a tablet computer, etc.

[0048] The screen projection sender is a mobile vertical screen device, and the screen projection receiver is a horizontal screen display device. The display ratio of the receiver and the sender is inconsistent. Figure 2 For a comparison diagram of the display screens of the screen projection receiving end and the sending end in the related technology, please refer to Figure 2 In the related art, a black area is added around the projection screen to match the display ratio. When the projection sending end is a mobile vertical screen device and the projection receiving end is a horizontal screen display device, the display screen of the projection sending end is located in the middle area of ​​the display screen of the projection receiving end, and the left and right sides of the display screen of the projection receiving end are both black areas. Figure 3 This is a schematic diagram of another display screen of the screen projection receiving end in the related art, please refer to Figure 3When the screen-casting sender is in landscape orientation and the screen-casting receiver is in portrait orientation, the screen on the screen-casting sender is located in the center of the screen on the screen-casting receiver, with the top and bottom of the screen on the screen being black. This allows the display ratio of the screen-casting receiver to match the display ratio of the screen-casting receiver, but it affects the display quality.

[0049] In this embodiment, the flexible display device 100 may include a flexible display screen, such as an OLED (Organic Light-Emitting Diode) display screen, a QLED (Quantum Dot Light-Emitting Diodes) display screen, or a miniLED (mini Light-Emitting Diode) display screen, which can be unfolded to display images as needed. Furthermore, the flexible display device 100 may display only the projection screen, or may display the projection screen and the system screen in a split screen. Furthermore, the electronic device 200 may be displayed in either a vertical or horizontal orientation.

[0050] Figure 4 for Figure 1 For a schematic diagram of an application scenario in which the electronic device is in landscape mode and the flexible display device only displays the screen, see Figure 4 When the electronic device 200 is displayed in landscape mode, the display ratios of the flexible display device 100 and the electronic device 200 are substantially the same. The flexible display device 100 can adjust the expanded display screen to match the display ratio of the electronic device 200 and only display the projected screen.

[0051] Figure 5 for Figure 1 For a schematic diagram of a horizontal screen electronic device and a split-screen display of a flexible display device in an application scenario, see Figure 5 When the electronic device 200 is displayed in landscape mode, the display ratios of the flexible display device 100 and the electronic device 200 are substantially the same. The unfolded display screen of the flexible display device 100 can display the projection screen and the system screen in a split-screen manner, wherein the projection screen matches the display ratio of the electronic device 200.

[0052] Figure 6 for Figure 1 For a schematic diagram of an electronic device with a vertical screen and a flexible display device with split screen display in an application scenario, please refer to Figure 6 When the electronic device 200 is in portrait orientation, the display ratios of the flexible display device 100 and the electronic device 200 are quite different. The unfolded display screen of the flexible display device 100 can display the projection screen and the system screen in a left-right split screen, where the projection screen matches the display ratio of the electronic device 200.

[0053] Figure 7for Figure 1 For a schematic diagram of an application scenario where the electronic device is in portrait mode and the flexible display device only displays the screen, please refer to Figure 7 When the electronic device 200 is in portrait orientation, the display ratios of the flexible display device 100 and the electronic device 200 are quite different. The flexible display device 100 can adjust the expanded display screen to match the display ratio of the electronic device 200 and only display the projected screen.

[0054] In summary, the embodiment of the present application can adjust the display screen of the flexible display device 100 to match the display ratio of the electronic device 200, so that the display screen of the flexible display device 100 can only display the projection screen, thereby avoiding the addition of black areas around the projection screen and improving the display effect. Moreover, when the display screen of the flexible display device 100 cannot match the display ratio of the electronic device 200, the projection screen and the system screen can be displayed in split screen, wherein the projection screen can match the display ratio of the electronic device 200, thereby ensuring that no black areas are added around the projection screen, thereby ensuring the display effect. In addition, when the split screen is displayed, the projection screen will not block the system screen, thereby avoiding affecting the desktop operation of the system screen.

[0055] Figure 8 For a flowchart of the screen projection method in one or more embodiments of this application, please refer to Figure 8 In the first embodiment of the present application, a screen projection method is provided, which includes the following steps S101 to S103.

[0056] Step S101: Obtain the display resolution of the flexible display device and determine the display resolution of the effective picture in the projection picture sent by the sending end.

[0057] Exemplarily, the flexible display device may be a rollable display device or a scrollable display device, and the receiving end may be an electronic device.

[0058] Step S102 : determining the position of the projection area in the display image of the flexible display device according to the display resolution of the flexible display device and the display resolution of the effective image in the projection image sent by the transmitter.

[0059] In this embodiment, at least two adjacent sides of the projection area coincide with the edges of the display screen of the flexible display device, and the display ratio of the projection area is the same as the display ratio of the effective screen in the projection screen sent by the sending end.

[0060] Step S103: Display the valid image at the location of the projection area.

[0061] The above-mentioned screen projection method determines the display resolution of the effective picture in the projection screen sent by the transmitter by obtaining the display resolution of the flexible display device, and determines the position of the projection area in the display screen of the flexible display device according to the display resolution of the flexible display device and the display resolution of the effective picture in the projection screen sent by the transmitter. Since the display ratio of the projection area is the same as the display ratio of the effective picture in the projection screen sent by the transmitter, the effective picture can be displayed at the position of the projection area. Since at least two adjacent edges of the projection area coincide with the edges of the display screen of the flexible display device, it is possible to avoid adding a black area around the projection screen, thereby improving the display effect. Moreover, only the software of the flexible display device needs to be modified, and there is no need to modify the sending end of the projection interconnection.

[0062] In this embodiment, the display resolution of the flexible display device is the display resolution when the display screen of the flexible display device is fully expanded. The display resolution is the product of the number of pixels of the display screen in two mutually perpendicular directions. For example, the display resolution of the flexible display device is the product of the number of pixels of the display screen of the flexible display device in a first direction and the number of pixels in a second direction, where the first direction is the direction of expansion of the flexible display device and the second direction is perpendicular to the first direction. In this embodiment, the display ratio is the ratio of the number of pixels in the first direction to the number of pixels in the second direction in the display resolution.

[0063] The display ratio is the ratio of the number of pixels in two perpendicular directions in the display resolution. For example, the display ratio of the flexible display device is the ratio of the number of pixels in the first direction to the number of pixels in the second direction in the display resolution.

[0064] In actual applications, the sender will first send a screen projection request to the flexible display device. After confirming the screen projection, the flexible display device will establish a wireless connection with the sender. The sender then obtains its own display resolution and obtains the display resolution of the flexible display device from the flexible display device. Based on the display resolution of the sender and the display resolution of the flexible display device, it determines whether the display ratio of the sender and the flexible display device are consistent. If the display ratio of the sender and the flexible display device are consistent, the sender can send the original projection screen directly to the flexible display device for display. If the display ratio of the sender and the flexible display device are inconsistent, the sender will first add black areas on opposite sides of the original projection screen to form a new projection screen. The new projection screen is consistent with the display ratio of the flexible display device, and then the new projection screen is sent to the flexible display device for display.

[0065] In some embodiments, the method may further include the following steps: sending the display resolution of the flexible display device to the sending end, so that the sending end generates and sends the projection screen according to the display resolution of the flexible display device and the display resolution of the sending end, the display ratio of the projection screen sent by the sending end is the same as the display ratio of the flexible display device, and the display ratio of the effective screen in the projection screen sent by the sending end is the same as the display ratio of the sending end.

[0066] Exemplarily, the projection screen sent by the transmitting end may include at least a valid screen. In one possible embodiment, the projection screen sent by the transmitting end may include only a valid screen. In another possible embodiment, the projection screen sent by the transmitting end may include a valid screen and black screens located on opposite sides of the valid screen.

[0067] Figure 9 for Figure 8 For a flow chart of step S101, please refer to Figure 9 In some embodiments, the step S101 may include the following steps S201 to S202.

[0068] Step S201, receiving the projection image sent by the sending end.

[0069] Step S202: perform image recognition on the projection screen sent by the sending end to determine the display resolution of the effective screen in the projection screen sent by the sending end.

[0070] In the above embodiment, by receiving the projection screen from the sending end and performing image recognition on the projection screen sent by the sending end, the display resolution of the effective screen in the projection screen sent by the sending end can be determined.

[0071] As previously mentioned, the projected image sent by the sender can include only the valid image, or it can include the valid image and black images on opposite sides of the valid image. Therefore, the invalid image in the projected image sent by the sender is the black image. The difference between the black image and other images can be reflected in the binary image. Therefore, the binary image generated by binarizing the projected image sent by the sender can distinguish between the valid and invalid images.

[0072] Figure 10 for Figure 9 For a flow chart of step S202, please refer to Figure 10 , exemplarily, the step S202 may include the following steps S301 to S303.

[0073] Step S301: binarize the projection image sent by the sending end to obtain a binary image.

[0074] In this embodiment, the flexible display device can sequentially obtain the grayscale value of each pixel in the projection image sent by the transmitter and update its grayscale value based on the relationship between the grayscale value of each pixel and the set threshold. For example, if the grayscale value of a pixel is less than or equal to the set threshold (such as 0), the grayscale value of the pixel is updated to 0. If the grayscale value of the pixel is greater than the set threshold, the grayscale value of the pixel is updated to 255. The updated pixels form a binary image.

[0075] Step S302: perform image edge detection on the binary image to obtain the edge of the effective image in the projection image sent by the sending end.

[0076] In this embodiment, the flexible display device may start from the edge of the binary image and select the first pixel with a grayscale value greater than 0 along the direction toward the center of the binary image. The selected pixels constitute the edge of the effective image in the projection image sent by the sending end.

[0077] Step S303: circumscribe the minimum rectangle around the edge of the effective screen in the projection screen sent by the sending end, and determine the display resolution of the effective screen in the projection screen sent by the sending end based on the length and width of the circumscribed rectangle.

[0078] In this embodiment, the flexible display device can move the edge of the projection image sent by the transmitter from the edge of the binary image toward the center of the binary image until it intersects with the edge of the valid image in the projection image sent by the transmitter. The moved edge lines are connected to form the edge of the circumscribed rectangle.

[0079] In the above embodiment, the projection screen sent by the sender is first binarized to obtain a binary image, and then the binary image is subjected to image edge detection to obtain the edge of the effective picture in the projection screen sent by the sender. Finally, a minimum rectangle is circumscribed around the edge of the effective picture in the projection screen sent by the sender, and based on the length and width of the circumscribed rectangle, the display resolution of the effective picture in the projection screen sent by the sender can be determined. In this way, the amount of data processed is small, the processing speed is fast, the requirements for processing hardware are low, and the implementation cost is low.

[0080] In other embodiments, a pre-trained neural network model can also be used to perform image recognition on the projection screen sent by the sender, determine the effective screen in the projection screen sent by the sender, and then determine the display resolution of the effective screen in the projection screen sent by the sender.

[0081] Exemplarily, during the execution of step S303, the position of the effective picture in the projection picture sent by the sender can also be determined, and then the effective picture is matched with the projection area, so that the effective picture is displayed just in the projection area.

[0082] Figure 11 for Figure 8 For a flow chart of step S103, please refer to Figure 11 In some embodiments, step S103 may include the following steps S401 to S402.

[0083] Step S401: determine the position of the circumscribed rectangle in the projection image sent by the sending end, and use it as the position of the effective image in the projection image sent by the sending end.

[0084] Step S402: Display the valid image at the position of the projection area according to the position of the valid image in the projection image sent by the sending end.

[0085] In the above embodiment, by determining the position of the circumscribed rectangle in the projection screen sent by the sending end and using it as the position of the effective picture in the projection screen sent by the sending end, the effective picture can be displayed at the position of the projection area according to the position of the effective picture in the projection screen sent by the sending end.

[0086] In a possible embodiment, step S402 may include the following steps: displaying the projected screen in the display screen of the flexible display device according to the position of the effective screen in the projected screen sent by the sending end and the position of the projected area in the display screen of the flexible display device, so that the effective screen is located in the projected area.

[0087] Figure 12 for Figure 1 For a diagram of the projection screen when the flexible display device is unfolded to the left, please refer to Figure 12 The projection screen sent by the sender is originally located in the fully expanded display screen of the flexible display device. When the flexible display device expands the display screen to the left, the projection screen sent by the sender shifts to the right until the effective screen is located in the projection area. At this time, the black screen on the left side of the effective screen can be located in the undeployed display screen of the flexible display device, and the black screen on the right side of the effective screen can be located outside the display screen of the flexible display device.

[0088] Figure 13 for Figure 1 For a diagram of the projection screen when the flexible display device is unfolded to the right, please refer to Figure 13 The projection screen sent by the sender is originally located in the fully expanded display screen of the flexible display device. When the flexible display device expands the display screen to the right, the projection screen sent by the sender shifts to the left until the effective screen is located in the projection area. At this time, the black screen on the left side of the effective screen can be located outside the display screen of the flexible display device, and the black screen on the right side of the effective screen can be located in the undeployed display screen of the flexible display device.

[0089] Taking the flexible display device in landscape orientation and the transmitter in portrait orientation as an example, assuming the display resolution of the flexible display device is X*Y, and the length and width of the bounding rectangle are a and b respectively, the display resolution of the effective image in the flexible display device's display is (b*Y / a)*Y. Since the effective image is located in the center of the flexible display device's display, when the flexible display device unfolds its display to the left, the projected image sent by the transmitter shifts to the right by (Xb*Y / a) / 2 pixels; when the flexible display device unfolds its display to the right, the projected image sent by the transmitter shifts to the left by (Xb*Y / a) / 2 pixels.

[0090] In the above embodiment, by changing the relative position relationship between the projection screen sent by the sending end and the display screen of the flexible display device, the effective screen just appears in the projection area, and the black screens on the opposite sides of the effective screen can be located outside the display screen of the flexible display device and in the unfolded display screen of the flexible display device respectively, which will not affect the display effect. It is mainly suitable for application scenarios where only the screen is projected.

[0091] In another possible embodiment, step S402 may include the following steps: according to the position of the effective picture in the projection picture sent by the sending end, capture the effective picture from the projection picture sent by the sending end, and display the captured effective picture at the position of the projection area.

[0092] Figure 14 for Figure 1 Schematic diagram of a split screen image when the flexible display device is unfolded at least partially, see Figure 14 Only the valid screen is retained in the projection screen sent by the sender. The valid screen and the system screen are presented in sequence along the expansion direction of the display screen of the flexible display device. The projection screen will not block the system screen.

[0093] Taking the flexible display device in landscape orientation and the transmitter in portrait orientation as an example, assuming the display resolution of the unfolded display screen of the flexible display device is X'*Y, and the length and width of the bounding rectangle are a and b respectively, the display resolution of the effective screen in the display screen of the flexible display device is (b*Y / a)*Y. Since the effective screen is located on the far right of the display screen of the flexible display device, the display resolution of the system screen in the display screen of the flexible display device is (X1-b*Y / a)*Y.

[0094] In the above embodiment, by removing the black area from the projection screen sent by the transmitter, the flexible display device is prevented from displaying a black screen and affecting the display quality. This also prevents the black screen from obscuring the original system screen, thereby avoiding affecting desktop operations on the system screen. This is not only applicable to screen-only application scenarios, but also to split-screen application scenarios.

[0095] Figure 15 for Figure 8 For a flow chart of step S102, please refer to Figure 15 In some embodiments, step S102 may include the following steps S501 to S503.

[0096] Step S501: Compare the display ratio of the effective image in the projected image sent by the sender with the display ratio of the flexible display device based on the display resolution of the flexible display device and the display resolution of the effective image in the projected image sent by the sender. If the display ratio of the effective image in the projected image sent by the sender is less than or equal to the display ratio of the flexible display device, then execute step S502; if the display ratio of the effective image in the projected image sent by the sender is greater than the display ratio of the flexible display device, then execute step S503.

[0097] In this embodiment, the display ratio is a ratio of the number of pixels in a first direction to the number of pixels in a second direction in the display resolution. The first direction is an extension direction of the flexible display device, and the second direction is perpendicular to the first direction.

[0098] Step S502: determining at least the position of the projection area in the display image of the flexible display device.

[0099] Step S503 : determining the position of the projection area and the position of the desktop area for displaying system operation icons in the display image of the flexible display device.

[0100] In this embodiment, the sum of the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction is equal to the number of pixels of the flexible display device in the second direction.

[0101] In the above embodiment, by comparing the display ratio of the effective picture in the projected picture sent by the sending end and the display ratio of the flexible display device, it is determined whether the display ratio of the effective picture can match the flexible display device, and when the display ratio of the effective picture and the flexible display device cannot match, the projected picture and the system picture are uniformly displayed in a split-screen manner, which can avoid adding a black area around the projected picture to match the display ratio, thereby avoiding affecting the display effect of the black picture.

[0102] Figure 16 for Figure 15 For a flow chart of step S503, please refer to Figure 16 In some embodiments, step S503 may include the following steps S601 to S603.

[0103] Step S601: If the display screen of the flexible display device has been unfolded, the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction are both determined as the number of pixels of the unfolded display screen in the first direction, and the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction are determined.

[0104] Exemplarily, step S601 may include the following steps: determining the number of pixels of the projection area in the second direction based on the number of pixels of the projection area in the first direction and the display ratio of the effective picture in the projection picture sent by the sender; determining the number of pixels of the desktop area in the second direction based on the number of pixels of the projection area in the second direction and the number of pixels of the flexible display device in the second direction; if the number of pixels of the desktop area in the second direction is less than the minimum number of pixels of the desktop area, updating the number of pixels of the desktop area in the second direction to the minimum number of pixels of the desktop area, and updating the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction.

[0105] Exemplarily, updating the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction may include the following steps: updating the number of pixels of the projection area in the second direction according to the updated number of pixels of the desktop area in the second direction and the number of pixels of the flexible display device in the second direction; updating the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction according to the updated number of pixels of the projection area in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end.

[0106] Step S602: If the display screen of the flexible display device is not expanded, the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction are both determined as the number of pixels of the flexible display device in the first direction, and the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction are determined.

[0107] Exemplarily, step S602 may include the following steps: determining the number of pixels of the projection area in the second direction based on the number of pixels of the projection area in the first direction and the display ratio of the effective picture in the projection picture sent by the sender; determining the number of pixels of the desktop area in the second direction based on the number of pixels of the projection area in the second direction and the number of pixels of the flexible display device in the second direction; if the number of pixels of the desktop area in the second direction is less than the minimum number of pixels of the desktop area, updating the number of pixels of the desktop area in the second direction to the minimum number of pixels of the desktop area, and updating the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction.

[0108] Exemplarily, updating the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction may include the following steps: updating the number of pixels of the projection area in the second direction according to the updated number of pixels of the desktop area in the second direction and the number of pixels of the flexible display device in the second direction; updating the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction according to the updated number of pixels of the projection area in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end.

[0109] Step S603: If the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area in the first direction, unfold the display screen of the flexible display device according to the number of pixels of the projection area in the first direction. Step S603 can be performed after step S601 or step S602.

[0110] In the above embodiment, the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction are determined respectively according to whether the display screen of the flexible display device is unfolded. When the display screen of the flexible display device is unfolded, the number of pixels of the unfolded display screen in the first direction is directly used as the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction. When the display screen of the flexible display device is not unfolded, the number of pixels of the flexible display device in the first direction is used as the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction. Then, the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction can be determined based on the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction. Moreover, when the unfolded display screen of the flexible display device does not meet the determined number of pixels, the unfolded display screen of the flexible display device is adjusted in time, and the display effect is good.

[0111] If the display ratio of the effective image and the flexible display device does not match, the flexible display device will uniformly display the projected image and the system image in a split-screen display. If the display ratio of the effective image and the flexible display device does match, the flexible display device can display only the projected image, or a split-screen display of the projected image and the system image, based on the user's choice.

[0112] Figure 17 for Figure 15 For a flow chart of step S502, please refer to Figure 17 In some embodiments, step S502 may include the following steps S701 to S703.

[0113] Step S701: Determine the number of pixels of the projection area in the second direction as the number of pixels of the flexible display device in the second direction.

[0114] Step S702: Determine the number of pixels of the projection area in the first direction based on the number of pixels of the projection area in the second direction and the display ratio of the effective image in the projection image sent by the sending end.

[0115] Step S703, in response to the user selecting the operation of only projecting the screen, if the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area in the first direction, the display screen of the flexible display device is expanded according to the number of pixels of the projection area in the first direction.

[0116] In the above embodiment, regardless of whether the user chooses to project the screen only or split the screen, the flexible display device first uniformly determines the number of pixels in the projection area in the second direction as the number of pixels in the second direction of the flexible display device, and determines the number of pixels in the projection area in the first direction based on the number of pixels in the projection area in the second direction and the display ratio of the effective image in the projection image sent by the sender, so that the projection area can be determined in the display image of the flexible display device. If the user chooses to project the screen only, it is only necessary to determine whether the display image expanded by the flexible display device meets the determined number of pixels. If it meets the requirements, the effective image can be directly displayed in the projection area. If the display image expanded by the flexible display device does not meet the determined number of pixels, the display image expanded by the flexible display device is adjusted in time to ensure the display effect.

[0117] Figure 18 for Figure 15 For another flow chart of step S502, please refer to Figure 18 , exemplarily, the step S502 may further include the following steps S704 to S707.

[0118] In step S704, in response to the user selecting a split-screen operation, the number of pixels in the second direction of the desktop area is determined as the number of pixels in the second direction of the flexible display device, and the number of pixels in the first direction of the desktop area is determined as the minimum number of pixels in the desktop area. Step S704 is performed after step S702. If the sum of the number of pixels in the first direction of the projection area and the number of pixels in the first direction of the desktop area is less than or equal to the number of pixels in the first direction of the flexible display device, step S705 is performed; if the sum of the number of pixels in the first direction of the projection area and the number of pixels in the first direction of the desktop area is greater than the number of pixels in the first direction of the flexible display device, step S706 is performed.

[0119] Step S705 : Expand the display screen of the flexible display device according to the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction.

[0120] Step S706, update the number of pixels of the desktop area in the second direction to the minimum number of pixels of the desktop area, and update the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction.

[0121] Exemplarily, step S706 may include the following steps: updating the number of pixels in the projection area in the second direction according to the number of pixels in the desktop area after being updated in the second direction and the number of pixels of the flexible display device in the second direction; updating the number of pixels in the projection area in the first direction and the number of pixels in the desktop area in the first direction according to the number of pixels in the projection area after being updated in the second direction and the display ratio of the effective picture in the projection picture sent by the sender.

[0122] Step S707: If the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area after the update in the first direction, the display screen of the flexible display device is unfolded according to the number of pixels of the projection area after the update in the first direction. Step S707 is performed after step S706.

[0123] In the above embodiment, after the projection area can be determined in the display screen of the flexible display device, when the user selects split screen, the number of pixels of the desktop area in the second direction is first determined as the number of pixels of the flexible display device in the second direction, and the number of pixels of the desktop area in the first direction is determined as the minimum number of pixels of the desktop area. Then, different processing is performed based on whether the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction is greater than the number of pixels of the flexible display device in the first direction. If the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction is less than or equal to the number of pixels of the flexible display device in the first direction, the display screen of the flexible display device is directly unfolded according to the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction for display. If the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction is greater than the number of pixels of the flexible display device in the first direction, the number of pixels of the desktop area in the second direction needs to be updated to the minimum number of pixels of the desktop area, and the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction are updated to ensure normal display. Moreover, when the display screen of the flexible display device does not meet the determined number of pixels, the display screen of the flexible display device is adjusted in time to ensure the display effect.

[0124] In some embodiments, step S501 may include the following steps: determining the display ratio of the flexible display device based on the display resolution of the flexible display device; determining the display ratio of the effective picture in the projection picture sent by the sender based on the display resolution of the effective picture in the projection picture sent by the sender; comparing the display ratio of the effective picture in the projection picture sent by the sender and the display ratio of the flexible display device.

[0125] Figure 19 For a structural diagram of the screen projection device in one or more embodiments of this application, please refer to Figure 19 In a second embodiment of the present application, a screen projection device is provided, which is applied to the above-mentioned flexible display device and includes an acquisition module 801, a determination module 802 and a display module 803.

[0126] The acquisition module 801 is configured to acquire the display resolution of the flexible display device and determine the display resolution of the effective picture in the projection picture sent by the sending end.

[0127] The determination module 802 is configured to determine the position of the projection area in the display screen of the flexible display device based on the display resolution of the flexible display device and the display resolution of the effective screen in the projection screen sent by the sender, at least two adjacent sides of the projection area coincide with the edges of the display screen of the flexible display device, and the display ratio of the projection area is the same as the display ratio of the effective screen in the projection screen sent by the sender.

[0128] The display module 803 is configured to display a valid image at the location of the projection area.

[0129] In some embodiments, the acquisition module 801 may include a receiving unit and an identification unit.

[0130] The receiving unit is configured to receive the projection image sent by the sending end.

[0131] The recognition unit is configured to perform image recognition on the projection screen sent by the sender and determine the display resolution of the effective screen in the projection screen sent by the sender.

[0132] Exemplarily, the projection image sent by the sending end includes at least a valid image.

[0133] In a possible embodiment, the projection image sent by the sending end may only include valid images.

[0134] In another possible embodiment, the projection screen sent by the transmitting end may include a valid screen and black screens located on opposite sides of the valid screen.

[0135] Exemplarily, the acquisition module 801 may further include a sending unit.

[0136] The sending unit is configured to send the display resolution of the flexible display device to the sending end, so that the sending end generates and sends the projection screen according to the display resolution of the flexible display device and the display resolution of the sending end. The display ratio of the projection screen sent by the sending end is the same as the display ratio of the flexible display device, and the display ratio of the effective screen in the projection screen sent by the sending end is the same as the display ratio of the sending end.

[0137] In some embodiments, the recognition unit may include a binarization subunit, a detection subunit, and a determination subunit.

[0138] The binarization subunit is configured to perform binarization processing on the projection screen sent by the sending end to obtain a binary image.

[0139] The detection subunit is configured to perform image edge detection on the binary image to obtain the edge of the effective image in the projection image sent by the sending end.

[0140] The determination subunit is configured to circumscribe the minimum rectangle of the edge of the effective picture in the projection picture sent by the sending end, and determine the display resolution of the effective picture in the projection picture sent by the sending end based on the length and width of the circumscribed rectangle.

[0141] Exemplarily, the display module 803 may include a determining unit and a display unit.

[0142] The determination unit is configured to determine the position of the circumscribed rectangle in the projection picture sent by the sending end, and use it as the position of the effective picture in the projection picture sent by the sending end.

[0143] The display unit is configured to display the valid picture at the position of the projection area according to the position of the valid picture in the projection picture sent by the sending end.

[0144] In a possible embodiment, the display unit is configured to capture the valid picture from the projection screen sent by the sending end according to the position of the valid picture in the projection screen sent by the sending end, and display the captured valid picture at the position of the projection area.

[0145] In another possible embodiment, the display unit is configured to display the projected screen in the display screen of the flexible display device based on the position of the effective screen in the projected screen sent by the sending end and the position of the projected area in the display screen of the flexible display device, so that the effective screen is located in the projected area.

[0146] In some embodiments, the determination module 802 may include a comparison unit, a first determination unit, and a second determination unit.

[0147] The comparison unit is configured to compare the display ratio of the effective picture in the projection picture sent by the sending end and the display ratio of the flexible display device according to the display resolution of the flexible display device and the display resolution of the effective picture in the projection picture sent by the sending end, wherein the display ratio is the ratio of the number of pixels in the first direction to the number of pixels in the second direction in the display resolution, the first direction is the expansion direction of the flexible display device, and the second direction is perpendicular to the first direction.

[0148] The first determination unit is configured to determine at least the position of the projection area in the display picture of the flexible display device when the display ratio of the effective picture in the projection picture sent by the sending end is less than or equal to the display ratio of the flexible display device.

[0149] The second determination unit is configured to determine the position of the projection area and the position of the desktop area for displaying system operation icons in the display screen of the flexible display device when the display ratio of the effective screen in the projection screen sent by the sending end is greater than the display ratio of the flexible display device, and the sum of the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction is equal to the number of pixels of the flexible display device in the second direction.

[0150] In some embodiments, the second determining unit may include a first determining subunit, a second determining subunit, and a first expanding subunit.

[0151] The first determination subunit is configured to, when the display screen of the flexible display device has been unfolded, determine the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction as the number of pixels of the unfolded display screen in the first direction, and determine the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction.

[0152] Exemplarily, the first determination subunit can be configured to determine the number of pixels of the projection area in the second direction based on the number of pixels of the projection area in the first direction and the display ratio of the effective picture in the projection picture sent by the sending end; determine the number of pixels of the desktop area in the second direction based on the number of pixels of the projection area in the second direction and the number of pixels of the flexible display device in the second direction; if the number of pixels of the desktop area in the second direction is less than the minimum number of pixels of the desktop area, update the number of pixels of the desktop area in the second direction to the minimum number of pixels of the desktop area, and update the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction.

[0153] Exemplarily, the first determination subunit can be configured to update the number of pixels in the projection area in the second direction based on the number of pixels in the desktop area after being updated in the second direction and the number of pixels of the flexible display device in the second direction; and update the number of pixels in the projection area in the first direction and the number of pixels in the desktop area in the first direction based on the number of pixels in the projection area after being updated in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end.

[0154] The second determination subunit is configured to, when the display screen of the flexible display device is not unfolded, determine the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction as the number of pixels of the flexible display device in the first direction, and determine the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction.

[0155] Exemplarily, the second determination subunit can be configured to determine the number of pixels of the projection area in the second direction based on the number of pixels of the projection area in the first direction and the display ratio of the effective picture in the projection picture sent by the sending end; determine the number of pixels of the desktop area in the second direction based on the number of pixels of the projection area in the second direction and the number of pixels of the flexible display device in the second direction; if the number of pixels of the desktop area in the second direction is less than the minimum number of pixels of the desktop area, update the number of pixels of the desktop area in the second direction to the minimum number of pixels of the desktop area, and update the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction.

[0156] Exemplarily, the second determination subunit can be configured to update the number of pixels in the projection area in the second direction based on the number of pixels in the desktop area after being updated in the second direction and the number of pixels of the flexible display device in the second direction; and update the number of pixels in the projection area in the first direction and the number of pixels in the desktop area in the first direction based on the number of pixels in the projection area after being updated in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end.

[0157] The first unfolding subunit is configured to unfold the display screen of the flexible display device according to the number of pixels of the projection area in the first direction when the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area in the first direction.

[0158] In some embodiments, the first determining unit may include a third determining subunit, a fourth determining subunit, and a second expanding subunit.

[0159] The third determining subunit is configured to determine the number of pixels of the projection area in the second direction as the number of pixels of the flexible display device in the second direction.

[0160] The fourth determining subunit is configured to determine the number of pixels of the projection area in the first direction based on the number of pixels of the projection area in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end.

[0161] The second expansion sub-unit is configured to respond to the user's selection of only screen projection. If the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area in the first direction, the display screen of the flexible display device is expanded according to the number of pixels of the projection area in the first direction.

[0162] Exemplarily, the first determining unit may further include a fifth determining subunit, a third expanding subunit, a sixth determining subunit, and a fourth expanding subunit.

[0163] The fifth determining subunit is configured to, in response to the user selecting a split screen operation, determine the number of pixels of the desktop area in the second direction as the number of pixels of the flexible display device in the second direction, and determine the number of pixels of the desktop area in the first direction as the minimum number of pixels of the desktop area.

[0164] The third expansion sub-unit is configured to expand the display screen of the flexible display device according to the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction when the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction is less than or equal to the number of pixels of the flexible display device in the first direction.

[0165] The sixth determination subunit is configured to update the number of pixels of the desktop area in the second direction to the minimum number of pixels of the desktop area when the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction is greater than the number of pixels of the flexible display device in the first direction, and to update the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction.

[0166] The fourth unfolding subunit is configured to unfold the display screen of the flexible display device according to the number of pixels of the projection area after the update in the first direction when the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area after the update in the first direction.

[0167] Exemplarily, the sixth determination subunit can be configured to update the number of pixels in the projection area in the second direction based on the number of pixels in the desktop area after being updated in the second direction and the number of pixels of the flexible display device in the second direction; and update the number of pixels in the projection area in the first direction and the number of pixels in the desktop area in the first direction based on the number of pixels in the projection area after being updated in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end.

[0168] See also Figure 1In a third embodiment of the present application, a screen projection system is provided, which includes a flexible display device 100 and an electronic device 200. The electronic device 200 is communicatively connected to the flexible display device 100 and is configured to project a screen to the flexible display device 100.

[0169] In a fourth aspect of the present application, a flexible display device is provided, which includes a display screen, a memory, and a processor. The memory stores computer program code, which, when executed by the processor, prompts the processor to execute a screen projection method according to one or more embodiments of the present disclosure.

[0170] Figure 20 For an internal structure diagram of a flexible display device in one or more embodiments of the present application, please refer to Figure 20 , the flexible display device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor is used to provide computing and control capabilities. The memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface is used to exchange information between the processor and an external device. The communication interface is used to communicate with an external terminal in a wired or wireless manner. The wireless manner can be implemented through Wi-Fi (Chinese: mobile hotspot), mobile cellular network, NFC (English: Near Field Communication, Chinese: near field communication) or other technologies. When the computer program is executed by the processor, a device interaction method is implemented. The display unit is used to form a visually visible image, and can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the device casing, or an external keyboard, touchpad or mouse, etc.

[0171] Those skilled in the art will understand that Figure 20 The structure shown in the figure is merely a block diagram of a portion of the structure related to the solution of the present disclosure, and does not constitute a limitation on the computer device to which the solution of the present disclosure is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0172] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. In particular, any reference to memory, database, or other media used in the embodiments provided in the present disclosure can include at least one of non-volatile and volatile memory. Non-volatile memory can include ROM (Read-Only Memory), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, ReRAM (Resistive Random Access Memory), MRAM (Magnetoresistive Random Access Memory), FRAM (Ferroelectric Random Access Memory), PCM (Phase Change Memory), graphene memory, etc. Volatile memory can include RAM (Random Access Memory) or external cache memory, etc. By way of illustration and not limitation, RAM can take various forms, such as SRAM (Static Random Access Memory) or DRAM (Dynamic Random Access Memory). The databases involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the various embodiments provided herein may be, but are not limited to, general-purpose processors, central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), programmable logic devices (PLDs), quantum computing-based data processing logic devices, and the like.

[0173] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0174] In this application, unless otherwise expressly specified or limited, a first feature being "above" or "below" a second feature may include the first and second features being in direct contact, or may include the first and second features being in contact not directly but through another feature between them. Moreover, a first feature being "above," "above," and "above" a second feature may include the first feature being directly above or obliquely above the second feature, or may simply mean that the first feature is higher in level than the second feature. A first feature being "below," "below," and "below" a second feature may include the first feature being directly below or obliquely below the second feature, or may simply mean that the first feature is lower in level than the second feature.

[0175] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise" and "counterclockwise" indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0176] In this application, unless otherwise specified or limited, the terms "connect," "fix," etc. should be understood broadly. For example, "fix" can mean fixed connection, detachable connection, or integration; it can mean mechanical connection or electrical connection; it can mean direct connection or indirect connection through an intermediate medium; it can mean internal communication between two elements or interaction between two elements. Those skilled in the art will understand the specific meanings of the above terms in this application based on specific circumstances.

[0177] In addition, the terms "first," "second," and so on, used in this application are for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, features specified as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, "plurality" means two or more, unless otherwise specifically defined.

[0178] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions, and variations may be made to the embodiments without departing from the principles and intent of the present application, and that the scope of the present application is defined by the claims and their equivalents.

Claims

1. A screen projection method, characterized in that: The method comprises: Obtain the display resolution of the flexible display device and determine the display resolution of the effective image in the projection image sent by the sender; Determining, according to the display resolution of the flexible display device and the display resolution of the effective picture in the projected picture sent by the sender, a position of a projection area in the display picture of the flexible display device, wherein at least two adjacent sides of the projection area coincide with edges of the display picture of the flexible display device, and a display ratio of the projection area is the same as a display ratio of the effective picture in the projected picture sent by the sender; The effective picture is displayed at the position of the projection area.

2. The method according to claim 1, characterized in that Determining the display resolution of the effective image in the projection image sent by the sending end includes: Receive the projection image sent by the sender; Perform image recognition on the projection screen sent by the sending end to determine the display resolution of the effective screen in the projection screen sent by the sending end.

3. The method according to claim 2, characterized in that The projection screen sent by the sending end includes only the valid screen, or the projection screen sent by the sending end includes the valid screen and black screens located on opposite sides of the valid screen.

4. The method according to claim 3, characterized in that The performing image recognition on the projection screen sent by the sending end to determine the display resolution of the effective screen in the projection screen sent by the sending end includes: Binarizing the projection image sent by the sending end to obtain a binary image; Performing image edge detection on the binary image to obtain the edge of a valid image in the projection image sent by the sending end; The edge of the effective picture in the projection picture sent by the sending end is circumscribed by a minimum rectangle, and the display resolution of the effective picture in the projection picture sent by the sending end is determined according to the length and width of the circumscribed rectangle.

5. The method according to claim 4, characterized in that Displaying the valid image at the position of the projection area includes: Determine the position of the circumscribed rectangle in the projection picture sent by the sending end, and use it as the position of the effective picture in the projection picture sent by the sending end; According to the position of the effective picture in the projection picture sent by the sending end, the effective picture is displayed at the position of the projection area.

6. The method according to claim 5, characterized in that The displaying the valid picture at the position of the projection area according to the position of the valid picture in the projection picture sent by the sending end includes: According to the position of the effective picture in the projection picture sent by the sending end, intercept the effective picture from the projection picture sent by the sending end, and display the intercepted effective picture at the position of the projection area; or According to the position of the effective picture in the projection picture sent by the sending end and the position of the projection area in the display picture of the flexible display device, the projection picture is displayed in the display picture of the flexible display device so that the effective picture is located in the projection area.

7. The method according to claim 3, characterized in that The method further comprises: The display resolution of the flexible display device is sent to the sending end, so that the sending end generates and sends the projection screen according to the display resolution of the flexible display device and the display resolution of the sending end. The display ratio of the projection screen sent by the sending end is the same as the display ratio of the flexible display device, and the display ratio of the effective screen in the projection screen sent by the sending end is the same as the display ratio of the sending end.

8. The method according to claim 1, characterized in that The determining, according to the display resolution of the flexible display device and the display resolution of the effective picture in the projection picture sent by the transmitting end, a position of the projection area in the display picture of the flexible display device includes: Comparing, according to the display resolution of the flexible display device and the display resolution of the effective picture in the projected picture sent by the sender, a display ratio of the effective picture in the projected picture sent by the sender and the display ratio of the flexible display device, where the display ratio is a ratio of the number of pixels in a first direction to the number of pixels in a second direction in the display resolution, where the first direction is an extension direction of the flexible display device and the second direction is perpendicular to the first direction; If the display ratio of the effective screen in the projection screen sent by the sending end is less than or equal to the display ratio of the flexible display device, then at least determine the position of the projection area in the display screen of the flexible display device; If the display ratio of the effective picture in the projection screen sent by the sending end is greater than the display ratio of the flexible display device, the position of the projection area and the position of the desktop area for displaying system operation icons are determined in the display screen of the flexible display device, and the sum of the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction is equal to the number of pixels of the flexible display device in the second direction.

9. The method according to claim 8, characterized in that The method of determining the position of the projection area and the position of the desktop area for displaying system operation icons in the display screen of the flexible display device includes: If the display screen of the flexible display device has been unfolded, the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction are both determined as the number of pixels of the unfolded display screen in the first direction, and the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction are determined; If the display screen of the flexible display device is not unfolded, the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction are both determined as the number of pixels of the flexible display device in the first direction, and the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction are determined; If the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area in the first direction, the display screen of the flexible display device is unfolded according to the number of pixels of the projection area in the first direction.

10. The method according to claim 9, characterized in that The determining the number of pixels of the projection area in the second direction and the number of pixels of the desktop area in the second direction includes: Determine the number of pixels of the projection area in the second direction according to the number of pixels of the projection area in the first direction and the display ratio of the effective picture in the projection picture sent by the sending end; Determining the number of pixels of the desktop area in the second direction according to the number of pixels of the projection area in the second direction and the number of pixels of the flexible display device in the second direction; If the number of pixels of the desktop area in the second direction is less than the minimum number of pixels of the desktop area, the number of pixels of the desktop area in the second direction is updated to the minimum number of pixels of the desktop area, and the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction are updated.

11. The method according to claim 8, characterized in that The determining at least a position of a projection area in a display image of the flexible display device includes: Determine the number of pixels of the projection area in the second direction as the number of pixels of the flexible display device in the second direction; Determine the number of pixels of the projection area in the first direction according to the number of pixels of the projection area in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end; In response to the user selecting the operation of projecting only the screen, if the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area in the first direction, the display screen of the flexible display device is expanded according to the number of pixels of the projection area in the first direction.

12. The method according to claim 11, characterized in that The step of determining at least a position of a projection area in a display image of the flexible display device further includes: In response to a user selecting a split-screen operation, determining the number of pixels of the desktop area in the second direction as the number of pixels of the flexible display device in the second direction, and determining the number of pixels of the desktop area in the first direction as the minimum number of pixels of the desktop area; If the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction is less than or equal to the number of pixels of the flexible display device in the first direction, unfolding the display screen of the flexible display device according to the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction; If the sum of the number of pixels of the projection area in the first direction and the number of pixels of the desktop area in the first direction is greater than the number of pixels of the flexible display device in the first direction, updating the number of pixels of the desktop area in the second direction to the minimum number of pixels of the desktop area, and updating the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction; If the number of pixels of the display screen of the flexible display device in the first direction is different from the number of pixels of the projection area after being updated in the first direction, the display screen of the flexible display device is expanded according to the number of pixels of the projection area after being updated in the first direction.

13. The method according to claim 10 or 12, characterized in that The updating of the number of pixels of the projection area in the second direction, the number of pixels of the projection area in the first direction, and the number of pixels of the desktop area in the first direction includes: updating the number of pixels of the projection area in the second direction according to the updated number of pixels of the desktop area in the second direction and the number of pixels of the flexible display device in the second direction; According to the updated number of pixels in the projection area in the second direction and the display ratio of the effective picture in the projection picture sent by the sending end, the number of pixels in the projection area in the first direction and the number of pixels in the desktop area in the first direction are updated.

14. The method according to any one of claims 1 to 12, characterized in that The flexible display device is a rollable display device or a sliding display device.

15. A screen projection device, characterized in that: The device comprises: An acquisition module is used to obtain the display resolution of the flexible display device and determine the display resolution of the effective image in the projection image sent by the sender; a determination module, configured to determine, based on the display resolution of the flexible display device and the display resolution of the effective picture in the projected picture sent by the sender, a position of a projection area in the display picture of the flexible display device, wherein at least two adjacent sides of the projection area coincide with edges of the display picture of the flexible display device, and a display ratio of the projection area is the same as a display ratio of the effective picture in the projected picture sent by the sender; A display module is used to display the effective image at the position of the projection area.

16. A flexible display device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 14 are implemented.

17. A screen projection system, characterized in that: The screen projection system includes: The flexible display device according to claim 16; The electronic device is communicatively connected to the flexible display device and is configured to project a screen onto the flexible display device.

18. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 14 are implemented.

19. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 14 are implemented.

Images