Display data sharing methods and display device

Abstract

Provided in the present disclosure are display data sharing methods and a display device, which are used for improving a screen mirroring display effect. A method comprises: a first device determining a screen mirroring area, wherein a display area of the first device comprises a plurality of sub-areas, and the screen mirroring area comprises some of the plurality of sub-areas (500); the first device sending display data of the screen mirroring area to a second device, wherein a communication connection is established between the first device and the second device (501); and the second device adjusting the display data of the screen mirroring area on the basis of the resolution of the second device, and displaying the adjusted display data of the screen mirroring area (502).

Description

Method and display device for sharing display data TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of display, and in particular to a method and display device for sharing display data. BACKGROUND

[0002] With the development of large-screen electronic devices, it is a strong demand for people to cast the content displayed by a small-size mobile device to a large-size display device, or to cast the content displayed by a large-size display device to a small-size mobile device for reverse control. The large-size display device not only has a large resolution, but also has a special-shaped display screen, such as a strip-shaped screen placed in a smart cabin of a vehicle.

[0003] Currently, if the content displayed by the special-shaped display screen of the large-size display device needs to be cast to the small-size mobile device, the aspect ratio difference between the special-shaped display screen and the small-size mobile device is large, and the picture will be small after scaling at the same ratio, which is not suitable for watching and reverse control.

[0004] SUMMARY

[0005] The present disclosure provides a method and display device for sharing display data, which can improve the effect of casting display.

[0006] In a first aspect, a method for sharing display data is provided, and the method comprises the following steps:

[0007] A first device determines a casting area, the display area of the first device comprises a plurality of sub-areas, and the casting area comprises part of the plurality of sub-areas;

[0008] The first device sends display data of the casting area to a second device, and the first device and the second device have established a communication connection;

[0009] The second device adjusts the display data of the casting area based on its own resolution, and displays the adjusted display data of the casting area.

[0010] In a second aspect, a method for sharing display data is provided, and the method comprises the following steps:

[0011] A casting area is determined, the display area of the first device comprises a plurality of sub-areas, and the casting area comprises part of the plurality of sub-areas;

[0012] Display data of the casting area is sent to a second device, for instructing the second device to adjust the display data of the casting area based on its own resolution, and to display the adjusted display data of the casting area; the first device and the second device have established a communication connection.

[0013] In a third aspect, the embodiments of the present disclosure provide a method for sharing display data, which comprises the following steps:

[0014] receiving display data of a screen projection area sent by a first device, the display area of the first device comprising a plurality of sub-areas, the screen projection area comprising part of the plurality of sub-areas; the first device and the second device being connected by a communication connection;

[0015] adjusting the display data of the screen projection area based on the resolution of the second device, and displaying the adjusted display data of the screen projection area.

[0016] In a fourth aspect, the embodiments of the present disclosure further provide a display device, which comprises a processor and a memory, the memory being used to store programs executable by the processor, and the processor being used to read the programs in the memory and perform the following steps:

[0017] determining a screen projection area, the display area of the first device comprising a plurality of sub-areas, the screen projection area comprising part of the plurality of sub-areas;

[0018] sending the display data of the screen projection area to a second device, for instructing the second device to adjust the display data of the screen projection area based on the resolution of the second device, and display the adjusted display data of the screen projection area; the first device and the second device being connected by a communication connection.

[0019] In a fifth aspect, the embodiments of the present disclosure further provide a display device, which comprises a processor and a memory, the memory being used to store programs executable by the processor, and the processor being used to read the programs in the memory and perform the following steps:

[0020] receiving display data of a screen projection area sent by a first device, the display area of the first device comprising a plurality of sub-areas, the screen projection area comprising part of the plurality of sub-areas; the first device and the second device being connected by a communication connection;

[0021] adjusting the display data of the screen projection area based on the resolution of the second device, and displaying the adjusted display data of the screen projection area.

[0022] In a sixth aspect, the embodiments of the present disclosure further provide an apparatus for sharing display data, which comprises:

[0023] a region determining module, configured to determine a screen projection area, the display area of the first device comprising a plurality of sub-areas, the screen projection area comprising part of the plurality of sub-areas;

[0024] The area projection module is used to send the display data of the projection area to the second device, and to instruct the second device to adjust the display data of the projection area based on its own resolution, and to display the adjusted display data of the projection area; the first device and the second device establish a communication connection.

[0025] In a seventh aspect, embodiments of this disclosure also provide an apparatus for displaying data sharing, the apparatus comprising:

[0026] A data receiving module is used to receive display data of the projection area sent by the first device. The display area of ​​the first device includes multiple sub-areas, and the projection area includes some sub-areas of the multiple sub-areas. The first device and the second device establish a communication connection.

[0027] The screen projection adjustment module is used to adjust the display data of the projection area based on its own resolution, and then display the adjusted display data of the projection area.

[0028] Eighthly, embodiments of this disclosure also provide a computer storage medium having a computer program stored thereon, which, when executed by a processor, is used to implement the steps of the method described in any one of the first, second, or third aspects above.

[0029] In a ninth aspect, this disclosure provides a computer program product comprising: computer program code that, when executed on a computer, causes the computer to perform the method described in any one of the first, second, or third aspects.

[0030] These or other aspects of this disclosure will become more apparent in the following description of embodiments. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 is a schematic diagram of an in-vehicle irregular-shaped display screen provided in an embodiment of this disclosure;

[0033] Figure 2 is a schematic diagram of a multi-area display on a vehicle-mounted irregularly shaped screen provided in an embodiment of this disclosure;

[0034] Figure 3 is a schematic diagram of a reverse-controlled irregular screen display provided in an embodiment of this disclosure;

[0035] Figure 4 is a schematic diagram of a screen projection display system framework provided in an embodiment of this disclosure;

[0036] FIG. 5 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0037] FIG. 6 is a schematic diagram of a screen recording function according to an embodiment of the present disclosure;

[0038] FIG. 7 is a schematic diagram of a display area according to an embodiment of the present disclosure;

[0039] FIG. 8 is a schematic diagram of a screen projection display according to an embodiment of the present disclosure;

[0040] FIG. 9 is a schematic diagram of a screen projection display according to an embodiment of the present disclosure;

[0041] FIG. 10 is a schematic diagram of an effect of scaling display data according to an embodiment of the present disclosure;

[0042] FIG. 11 is a schematic diagram of an effect of a screen projection display according to an embodiment of the present disclosure;

[0043] FIG. 12 is a schematic diagram of a communication flow between a first device and a second device according to an embodiment of the present disclosure;

[0044] FIG. 13 is a flowchart of a screen projection operation of a first device according to an embodiment of the present disclosure;

[0045] FIG. 14 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0046] FIG. 15 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0047] FIG. 16 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0048] FIG. 17 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0049] FIG. 18 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0050] FIG. 19 is a schematic diagram of a display device according to an embodiment of the present disclosure;

[0051] FIG. 20 is a schematic diagram of a display device according to an embodiment of the present disclosure;

[0052] FIG. 21 is a schematic diagram of an apparatus for displaying data sharing according to an embodiment of the present disclosure;

[0053] FIG. 22 is a schematic diagram of an apparatus for displaying data sharing according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0054] In order to make the purposes, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure and not all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present disclosure.

[0055] The term "and / or" in the embodiments of the present disclosure describes the association relationship of the associated objects and indicates that there can be three relationships, for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after it.

[0056] Before introducing the method for sharing display data provided by the embodiments of the present disclosure, in order to facilitate understanding, the technical background of the embodiments of the present disclosure is first introduced in detail.

[0057] With the development of large-screen electronic devices, it is a strong demand for people to project the content displayed by a small-size mobile device to a large-size display device or to project the content displayed by a large-size display device to a small-size mobile device for reverse control. The large-size display device not only has a large resolution, but also has a special-shaped display screen, such as a strip-shaped screen placed in a vehicle intelligent driver compartment, as shown in FIG. 1, which is a schematic diagram of a vehicle special-shaped display screen. The special-shaped display screen includes three display areas, and the content displayed by different display areas is different. Since the vehicle special-shaped screen has different central control functions, different central control functions can be displayed through different display areas. Area 1 is used to display vehicle state information, area 2 is used to display vehicle control information, and area 3 is used to display audio-visual entertainment information. As shown in FIG. 2, the embodiments of the present disclosure can also provide a schematic diagram of multi-area display of a vehicle special-shaped screen. Based on the shape and size of the special-shaped screen, different central control functions can be displayed in different areas, and the positions and sizes of different areas are set. At present, the special-shaped display screen can be logically divided into areas, and the divided areas can be displayed by hardware FPGA (Field Programmable Gate Array, field programmable gate array) splicing to realize multi-area and multi-functional display of the special-shaped display screen, which is used to solve the problem that the width of the resolution of the special-shaped screen exceeds the conventional display output.

[0058] If it is needed to project the content displayed on the irregular display screen of a large-size display device to a small-size mobile device, due to the large difference in the width-to-height ratio between the irregular display screen and the small-size mobile device, the picture after the equal proportion scaling will be small, which is not suitable for watching and reverse control. As shown in FIG. 3, the embodiment provides a display picture diagram of reverse control of an irregular screen. When the content displayed on the irregular screen is projected to a mobile device, the display picture of the mobile device is small. If the zooming is only performed by the view displayed on the mobile device, although the problem of adapting the mobile device proportion in the display area can be solved, since the whole picture of the bar-shaped screen is still encoded, compressed and collected, in order to ensure the transmission rate, the resolution will be reduced, and thus the pure zooming of the display of a certain area, for example, the content of the area 1, will cause the problem of unclear picture of the area 1.

[0059] To solve the above technical problem, the embodiment provides a display data sharing method, which sends the projection area in the display area of the first device to the second device, and adjusts the display data of the projection area based on the resolution of the second device, so that the projection area is displayed adaptively to the resolution of the second device, thereby improving the projection display effect, and solving the problem of unclear display data in the projection picture when the display data of a large-size display screen is projected to a small-size display device. The display data sharing method provided in the embodiment can adjust the projection area and ensure the projection display resolution, and can project the picture of the required sub-area in the display area according to the suitable display resolution.

[0060] It should be noted that the first device in the embodiment includes but is not limited to a large-size (generally more than 50 inches) smart interactive display device with touch handwriting function, a vehicle-mounted display screen, etc., and the first device can include a liquid crystal display (LCD), an organic electroluminescence display (OLED), an electronic ink, etc.

[0061] The second device includes but is not limited to a mobile phone, a tablet computer, a smart watch, etc.

[0062] As shown in FIG. 4, the embodiment provides a system framework diagram for screen projection display. A VirtualDisplay device is created by a Native layer of a first device to obtain Surface display data, and MediaCodec is used for encoding to obtain an H.264 code stream. The H.264 code stream is sent to an APK of a second device through a Deamon process by using any one of UDP, UDT or TCP link modes. Then, the H.264 code stream is decoded by MediaCodec, and displayed in a window created by SurfaceView.

[0063] As shown in FIG. 5, the embodiment provides an implementation process of the method for sharing display data as follows.

[0064] In step 500, the first device determines a screen projection area. The display area of the first device includes a plurality of sub-areas, and the screen projection area includes part of the plurality of sub-areas.

[0065] The display area of the first device in the embodiment includes a plurality of sub-areas, and the contents displayed in different sub-areas are different. For example, when the first device is a vehicle display screen, the display area of the vehicle display screen includes a plurality of sub-areas. One sub-area is used to display the vehicle state, another sub-area is used to display the vehicle control state, and another sub-area is used to display audio and video entertainment. The first device can determine one or more sub-areas from the plurality of sub-areas as the screen projection area. For example, when the display area includes three sub-areas, the screen projection area can be one or two sub-areas. Optionally, the resolutions of the plurality of sub-areas in the embodiment can be the same or different, which is not limited in the embodiment.

[0066] In some embodiments, the first device determines the screen projection area in the following manner.

[0067] The first device receives sub-area information indicated by a user, and determines the screen projection area according to the sub-area information. The sub-area information represents position information of a sub-area in the display area of the first device.

[0068] Optionally, the first device receives the sub-area information indicated by the user in the following any one manner.

[0069] 1) the user directly indicates the sub-region on the first device;

[0070] In response to the user indicating the sub-region information on the display region of the first device, the first device determines that the user-indicated sub-region information is received.

[0071] 2) the user indicates the sub-region on the second device and sends the sub-region information to the first device;

[0072] The first device determines the received sub-region information of the second device as the user-indicated sub-region information, wherein the sub-region information of the second device is determined based on the user indicating the sub-region on the display region of the second device.

[0073] Optionally, in this embodiment, the sub-region information represents the position information of the sub-region in the display region of the first device, and the sub-region information in this embodiment includes but is not limited to sub-region identification information, sub-region position information, etc.

[0074] Step 501, the first device sends the display data of the screen projection region to the second device, and the first device and the second device have established a communication connection;

[0075] In some embodiments, the first device determines the display data of the screen projection region in any of the following ways:

[0076] a. The first device records the display screen of the screen projection region, and determines the recorded display data as the display data of the screen projection region.

[0077] In this embodiment, the first device only records the display screen of the screen projection region, does not record the display screen of the non-screen projection region in the display region of the first device, and sends the recorded display data to the second device for display.

[0078] In some embodiments, the first device records the display screen of the screen projection region in the following way:

[0079] The first device sets a recording region according to the position information of the screen projection region through the screen recording interface of the Android native layer, and records the display screen of the recording region.

[0080] As shown in FIG. 6, the embodiment provides a recording screen function diagram. For a first device using an Android system, a virtual display device can be created by a SurfaceComposerClient (a tool class) of an Android Native layer, and registered to a DisplayDevice (a display device) list of the system. When there is a picture update in a SurfaceFlinger (a display engine), the picture update is sent to the virtual display device for GLES (OpenGL for Embedded Systems) synthesis display, so that the data of the picture update of the large-size display device can be obtained in the virtual display device. At the same time of creating the virtual display device, a Surface (a surface layer) used for encoding by a MediaCodec (a media codec) is used as a BufferQueue (a data transmission component) to synchronously obtain the display data of the GLES synthesis. The display data is encoded by the MediaCodec to form a code stream data, and sent to a second device.

[0081] The embodiment uses a screen recording interface of an Android Native layer, instead of an API (Application Programming Interface) interface of an Android standard framework layer. The embodiment can set the position and size of the recording area by a setDisplayProjection method of a SurfaceComposerClient of the Native layer, and the API interface of the Android standard framework layer cannot realize the function.

[0082] As shown in FIG. 7, the embodiment provides a display area diagram. The display area of the first device includes three sub-areas, and the position information of the three sub-areas is as follows:

[0083] The position information of the sub-area A is (x A1 ,y A1 ) = (0, 0), (x A2 ,y A2 ) = (2984, 500);

[0084] The position information of the sub-area B is (x B1 ,y B1 ) = (2984, 0), (x B2 ,y B2 ) = (5976, 500);

[0085] Position information of sub-region C: (x C1 ,y C1 ) = (5976, 0), (x C2 ,y C2 ) = (8800, 500)

[0086] When the user selects a different sub-region for screen projection display, only the position information of the sub-region needs to be set as a Rect object, and the Rect object is passed to the setDisplayProjection method to set the required recording screen projection area, so that only the display screen of the screen projection area is recorded, and the recorded display data of the screen projection area is sent to the second device for display.

[0087] Method b: The first device records the display screen of the display area, and according to the position information of the screen projection area, the recorded full-screen display data is cropped, and the cropped display data is determined as the display data of the screen projection area.

[0088] In this embodiment, the first device records the full display screen of the display area, and then according to the position of the screen projection area, the recorded full-screen display data is cropped to obtain the display data of the screen projection area, and the display data of the screen projection area is sent to the second device for display.

[0089] In the implementation, based on the Android OpenGL (Open Graphics Library, Open Graphics Library) clipping rendering principle, the recorded full-screen display data is cropped to obtain the display data of the screen projection area, thereby realizing the method of setting the recording area, and thereby the first device divides the display area into multiple sub-areas suitable for the second device to display, and provides the second device. It can solve the problem that the screen projection of a large resolution to a small resolution is not clear and difficult to touch and control.

[0090] As shown in FIG. 8, the embodiment provides a schematic diagram of screen projection display. In the implementation, the first device can record the display picture to obtain full-screen display data, and use OpenGL (Open Graphics Library) to crop the full-screen display data, encode the cropped display data using MediaCodec to obtain H.264 code stream, and send the H.264 code stream to the APK (Android application package) of the second device through any one of UDP (User Datagram Protocol) or TCP (Transmission Control Protocol) link mode. Then the second device decodes the H.264 code stream through MediaCodec and displays the decoded code stream in the window created by SurfaceView. When the first device dynamically adjusts the display area in real time, the position of the screen projection area can be dynamically set in real time through OpenGL, without the need to re-project the screen, and the aspect ratio of the screen projection area is not limited.

[0091] In the implementation, after the second device receives the display data of the screen projection area, the second device adjusts the display data of the screen projection area based on the resolution of the second device, so that the adjusted display data is displayed in the resolution of the second device, thereby solving the problem of poor screen projection effect when the display content of the first device is projected to the second device.

[0092] In some embodiments, the second device determines the display data of the screen projection area and displays the adjusted display data of the screen projection area in the following manner:

[0093] The second device receives the full-screen display data sent by the first device, wherein the full-screen display data is obtained by recording the display picture of the display area of the first device. The second device determines the display data of the screen projection area in the full-screen display data according to the position information of the screen projection area, and displays the display data of the screen projection area in the display area of the second device.

[0094] Optionally, in the embodiment, since the first device determines the screen projection area, when the first device sends the recorded full-screen display data to the second device, in order to not reduce the transmission rate and ensure the screen projection effect, the first device can compress the display data of the screen projection area without affecting the resolution of the screen projection area, and normally compress the display data of other non-screen projection areas, so as to ensure the transmission rate and not affect the screen projection display effect of the display data of the screen projection area.

[0095] The embodiment is based on the drawing principle of GLSurfaceView (graphics library surface view), calculates the resolution difference between the first device and the second device, enlarges and moves the screen projection area to a specified position through an algorithm, and achieves the effect of displaying only part of the sub-area of the display area of the first device. When the first device dynamically adjusts the display area in real time, the screen projection area can be dynamically displayed on the second device in real time without re-projection.

[0096] The GLSurfaceView is a view used for rendering 3D or 2D graphics in Android, which is used in conjunction with the Renderer interface. The basic principle of drawing graphics by GLSurfaceView is as follows: create a GLSurfaceView instance and set a class that implements the Renderer interface as a renderer. Start the view, and a rendering thread will be created at this time, in which the onDrawFrame method of the renderer is called continuously. The onDrawFrame method internally calls the OpenGL ES API to execute the drawing command. When the view state of the screen changes (for example: rotation), the GLSurfaceView calls the onSurfaceChanged method of the renderer to notify the change. When the device screen visibility changes (for example: the user unlocks the screen), the GLSurfaceView calls the onSurfaceCreated method of the renderer to notify the creation or reset of the rendering surface.

[0097] As shown in FIG. 9, the embodiment provides a schematic diagram of screen projection display. In the implementation, the full-screen display data is obtained by recording the display screen of the display area of the first device, encoded by using MediaCodec, and H.264 code stream is obtained. The H.264 code stream is sent to the APK of the second device through any one of the linkage modes of UDP or TCP. Then, the H.264 code stream is decoded by the second device through MediaCodec, and the display data of the screen projection area in the full-screen display data is enlarged and displaced through the OpenGL interface of GLSurfaceView, and is displayed in the display area of the second device according to the resolution suitable for the second device. When the first device dynamically adjusts the display area in real time, the position of the screen projection area in the display area of the second device can be dynamically adjusted in real time through OpenGL, without re-projection.

[0098] In step 502, the second device adjusts the display data of the screen projection area based on the resolution of the second device, and displays the adjusted display data of the screen projection area.

[0099] In some embodiments, the second device adjusts the display data of the screen projection area based on the resolution of the second device in any one of the following ways:

[0100] The second device scales the display data of the screen projection area according to the resolution of the second device, and displays the scaled display data in the display area.

[0101] In an implementation, the display data of the screen projection area can be scaled first, so that the second device scales the display data of the screen projection area according to the resolution of the second device, and displays the display data in the display area.

[0102] The second device moves the screen projection area to the display area, and scales the display data of the screen projection area according to the resolution of the second device.

[0103] In an implementation, the display data of the screen projection area can be moved to the display area first, and then scaled according to the resolution of the second device, so that the display data is displayed in the display area and the effect of the screen projection display is improved.

[0104] In some embodiments, the present embodiment provides any one of the following ways in which the second device adjusts the display data of the screen projection area according to the resolution of the second device.

[0105] The second device aligns the center of the screen projection area with the center of the display area of the second device, scales the display data of the screen projection area until the width of the scaled display data reaches the width of the display area of the second device, or the height of the scaled display data reaches the height of the display area of the second device.

[0106] It should be noted that the scaling of the display data of the screen projection area in the present embodiment is performed in a proportional manner according to the width and height of the display data of the screen projection area.

[0107] As shown in FIG. 10, the present embodiment provides an effect diagram of scaling display data. After aligning the center of the screen projection area with the center of the display area of the second device, the display data of the screen projection area is enlarged, that is, the resolution of the display data of the screen projection area is enlarged, so that the display data is displayed on the screen. In an implementation, after aligning the center of the screen projection area with the center of the display area of the second device, the display data of the screen projection area is scaled, and the first side of the screen projection area that reaches the display area of the second device is taken as a reference, and the other side is scaled in a proportional manner. If the height of the screen projection area reaches the height of the display area of the second device first, the width of the screen projection area is scaled in a proportional manner. If the width of the screen projection area reaches the width of the display area of the second device first, the height of the screen projection area is scaled in a proportional manner.

[0108] It should be noted that the resolution of the display data of the screen projection area can not match the resolution of the second device, so that the display data of the screen projection area after being enlarged is more suitable for the resolution of the second device for display.

[0109] The second device aligns one vertex corresponding to the position in the screen mirroring area and the display area of the second device, scales the display data of the screen mirroring area until the diagonal vertex of the one vertex in the screen mirroring area and the display area of the second device is aligned.

[0110] In implementation, it is assumed that the width and height of the display data of the screen mirroring area are X1 (the top-left vertex coordinate of the screen mirroring area) and Y1 (the bottom-right vertex coordinate of the screen mirroring area), and the width and height of the display area of the second device are X2 (the top-left vertex coordinate of the display area of the second device) and Y2 (the bottom-right vertex coordinate of the display area of the second device).

[0111] Step 1) judging up-down and / or left-right equal scaling to achieve proportional display of width and height.

[0112] The width and height ratios of the display data and the display area of the second device are respectively:

[0113] The width and height ratio of the display data of the screen mirroring area is scale1 = X1 / Y1.

[0114] The width and height ratio of the display area of the second device is scale2 = X2 / Y2.

[0115] The sizes of scale1 and scale2 are judged. If scale1>scale2, the display data is scaled in the Y-axis direction and is displayed in the X-axis direction in equal proportion. If scale1<scale2, the display data is scaled in the X-axis direction and is displayed in the Y-axis direction in equal proportion. If scale1 = scale2, the display data is scaled in the X-axis direction and the Y-axis direction in equal proportion.

[0116] The X-axis direction and the Y-axis direction are determined based on the coordinate axes of the display area of the second device.

[0117] Step 2) moving the X1 coordinate to the X2 coordinate, so that the X1 screen mirroring area reaches the left vertex of the display area of the second device, that is, the X1 coordinate and the X2 coordinate are overlapped.

[0118] Step 3) using the render.zoom interface to proportionally enlarge the screen mirroring area, so that the Y1 moves to the Y2, that is, the Y1 coordinate and the Y2 coordinate are overlapped, so that the screen mirroring area and the display area of the second device are the same in size and position.

[0119] In implementation, when the user dynamically adjusts the size of the display area of the first device, the size and position information of the adjusted screen mirroring area can be sent to the second device in real time, which is used for the second device to repeat steps 2) and 3) for real-time screen mirroring display without re-screen mirroring.

[0120] In some embodiments, the embodiment also provides a screen projection reverse control function, and the implementation steps are as follows:

[0121] In response to the touch instruction of the user to the display data of the second device, the second device sends the touch instruction to the first device.

[0122] The first device converts the touch instruction into a touch instruction matched with its own resolution, and performs the operation indicated by the touch instruction on the sub-region corresponding to the touch instruction.

[0123] In the implementation, when the second device obtains the screen projection area display data of the first device, the touch operation of the second device can be fed back to the first device in reverse, so as to remotely control the first device to perform the touch operation. Since the screen projection area of the second device and the first device usually have the problem of resolution mismatch, the coordinate data related to the touch instruction collected by the second device needs to be converted, so as to accurately control the first device to perform the corresponding operation. Considering that the first device can be controlled by multiple different second devices, and the resolutions of the second devices cannot be unified, the logic of coordinate conversion needs to be executed in each second device and the first device respectively, and both sides perform conversion according to the same display resolution (such as 1920x1080), and the coordinate data contained in the converted touch instruction is sent to the first device to perform the touch operation.

[0124] In the process of establishing communication between the first device and the second device, the second device first sends its own information by broadcasting, and then starts the screen recording stage. The second device sends the sub-region ID required for screen projection. After the first device receives the sub-region ID of the second device, the actual resolution (W a , H a ) of the sub-region is calculated with the target resolution (W m , H m ), and the proportion (W d =W a / W m , H d =H a / H m ) is obtained for subsequent coordinate conversion. The target resolution refers to the resolution of the display data after adjustment by the second device.

[0125] In some embodiments, before the second device sends the touch instruction to the first device, the touch position of the touch instruction can also be calibrated, and the calibrated touch instruction is sent to the first device.

[0126] In the implementation, when part of the sub-region in the first device display area is projected to the second device for display, the user can perform a touch instruction for the display data on the second device. Since the projection area is moved to the second device display area and then scaled, or the projection area is scaled and then moved to the second device display area, if only the touch position in the touch instruction is scaled, an offset value will be generated, which will cause the touch instruction to be offset after being converted to the first device. Therefore, the touch position of the touch instruction is calibrated in the embodiment, and the calibrated touch instruction is sent to the first device, so that the first device performs the touch instruction on the sub-region corresponding to the touch instruction.

[0127] In some embodiments, the closer the touch position is to the center of the second device display area, the smaller the calibration degree of the touch position.

[0128] In some embodiments, the second device calibrates the touch position of the touch instruction in the following manner:

[0129] a) The second device determines a target resolution of the adjusted display data according to the resolution of the projection area and the resolution of the second device.

[0130] b) The second device calibrates the touch position of the touch instruction according to the resolution of the second device and the target resolution.

[0131] Optionally, the touch position of the touch instruction is calibrated in the following manner:

[0132] i) The second device determines an offset reference value according to the difference between the resolution of the second device and the target resolution, and determines a calibration ratio according to the ratio of the target resolution to the resolution of the second device.

[0133] In the implementation, after the center points of the second device display area and the projection area are aligned, the resolution of the display data of the projection area is enlarged to adapt to display on the second device. At this time, since the projection area is scaled according to the target resolution of the display data of the projection area in order to fill the second device display area as much as possible, coordinate calibration is required.

[0134] offset X = (W x -W m ) / 2, offset Y = (H x -H m ) / 2

[0135] wherein the resolution of the second device is (W x , H x ), and the target resolution is (W m , H m) ; the center coordinates of the display data under the second device resolution, i.e. the second device center point coordinates are (x MiddleX = W x / 2, x MiddleY = H x / 2) ; the center coordinates of the display data under the target resolution are (m MiddleX = W m / 2, m MiddleY = H m / 2) ;

[0136] Determine the calibration ratio according to the ratio of the target resolution (W m , H m ) and the second device resolution (W x , H x ) : D x = W m / W x , D y = H m / H x .

[0137] ii) The second device calibrates the touch position of the touch instruction according to the center coordinates of the display data under the self resolution and the target resolution respectively, the offset reference value and the calibration ratio.

[0138] In the implementation, any one side of the height and width of the projection area is taken as the basis to reach the second device resolution, and the other side is scaled in equal proportion, and the result will appear horizontal or vertical black edges, such as a projection display effect diagram shown in FIG. 11.

[0139] When the projection area has vertical black edges in the Y-axis direction of the second device display area: offset X = (W x -W m ) / 2, offset Y = 0; x MiddleX = W x / 2, x MiddleY = H x / 2; m MiddleX = W m / 2, m MiddleY = H m / 2;

[0140] When the projection area has horizontal black edges in the X-axis direction of the second device display area: offset Y = (H x -H m ) / 2, offset X = 0; x MiddleY = H x / 2, x MiddleX = W x / 2; m MiddleY = H m / 2, m MiddleX = W m / 2;

[0141] Finally, the touch coordinates (I x , I y ) of the touch instruction collected by the second device are calibrated by the following formula: X = (I x -offset X × (x MiddleX -I x ) / m MiddleX )×D x ; Y = (I y -offset Y × (x MiddleY -I y ) / m MiddleY )×D y Formula (1);

[0142] In Formula (1), (I x , I y ) represents the touch coordinates of the touch instruction, (offset X , offset Y ) represents the offset reference value, (x MiddleX , x MiddleY ) represents the second device center point coordinates; (m MiddleX , m MiddleY ) represents the center coordinates of the display data at the target resolution; (D x , D y ) represents the calibration ratio; (X, Y) represents the calibrated touch coordinates.

[0143] In some embodiments, the first device converts the touch instruction into a touch instruction matching its own resolution by the following way:

[0144] The first device determines the target resolution at which the display data is displayed by the second device, and converts the touch instruction into a touch instruction matching its own resolution according to the ratio of its own resolution and the target resolution.

[0145] Optionally, the first device determines the target resolution at which the display data is displayed by the second device by any of the following ways:

[0146] The first device determines the target resolution of the adjusted display data according to the resolution of the display data and the resolution of the second device; or, the first device receives the target resolution sent by the second device.

[0147] In the implementation, after the touch coordinates of the touch instruction are calibrated, the calibrated touch coordinates are sent to the first device, and the first device converts the touch instruction into a touch instruction matching the resolution of the first device according to the ratio of the resolution of the first device to the target resolution. For example, after the first device receives the sub-region ID of the second device, the actual resolution (W a , H a ) of the sub-region is calculated with the target resolution (W m , H m ), and the ratio (W d = W a / W m , H d = H a / H m ) is obtained.

[0148] In the implementation, the calibrated touch coordinates (X, Y) are sent to the first device, and the ratio (W d = W a / W m , H d = H a / H m ) of the resolution of the first device to the target resolution is calculated. In addition, the matching touch coordinates can be obtained according to the sub-region offset value of the projection region relative to the top left corner vertex of the display region of the first device.

[0149] Specifically, the touch coordinates of the touch instruction matching the resolution of the first device are calculated by the following formula: Q x = X × W d +offset Sx , Q y = Y × H d +offset Sy Formula (2).

[0150] In formula (2), (offset Sx , offset Sy ) represents the sub-region offset value, (X, Y) represents the calibrated touch coordinates, (W d , H d ) represents the ratio of the resolution of the projection region to the target resolution, and (Q x , Q y ) represents the touch coordinates of the converted touch instruction.

[0151] offset Sx = the width of the adjacent region on the left side of the projection region in the X-axis direction, and offset Sy=0, at this time if the projection area is the leftmost sub-area of ​​the first device's display area, then (offset) Sx offset Sy ) is 0; or, offset is 0. Sx = The width of the adjacent area to the right of the projection area along the X-axis, offset Sy =0, at this time if the projection area is the rightmost sub-area of ​​the first device's display area, then (offset) Sx offset Sy ) is 0; or, offset is 0. Sx =0, offset Sy = The height of the adjacent area above the projection area in the Y-axis direction. If the projection area is the uppermost sub-area of ​​the first device's display area, then (offset) Sx offset Sy ) is 0; or, offset is 0. Sx =0, offset Sy = The height of the adjacent area below the projection area in the Y-axis direction. If the projection area is the lowest sub-area in the first device's display area, then (offset) Sx offset Sy The value is 0.

[0152] As shown in Figure 12, this embodiment also provides a schematic diagram of the communication process between the first device and the second device. The first device and the second device communicate with each other via a local area network using either a wireless or wired connection, and the communication process is divided into the following three stages:

[0153] Phase 1: Exploration Phase.

[0154] Before enabling screen mirroring control, the resolution / screen size and device type information of the second device need to be added during the negotiation phase.

[0155] The second device sends a probe broadcast frame via UDP. The probe broadcast frame includes its own IP (Internet Protocol) and MAC (Media Access Control) information.

[0156] After the first device listens for and receives the search broadcast frame, it sends a response frame via UDP, which includes its own IP address, MAC address, the sub-region ID that can be projected, and the resolution information of each sub-region.

[0157] After receiving the response frame, the second device stores the relevant information.

[0158] Phase 2, screen mirroring phase.

[0159] To ensure the accuracy of the screen projection control command, a control channel TCP link needs to be established separately in the first device and the second device.

[0160] The second device sends a control frame for starting screen projection, which contains the sub-area ID that needs to be projected.

[0161] After receiving the sub-area ID, the first device selects the sub-area for screen recording and encoding, and sends it to the second device for display through the RTP (Real-Time Transport Protocol) protocol.

[0162] Stage 3, reverse control stage

[0163] To ensure the accuracy of the touch point, the control channel TCP link in the first device and the second device is used to realize the transmission of touch data (touch coordinates).

[0164] As shown in FIG. 13, the embodiment also provides a first device screen projection operation flowchart, and the specific implementation process is as follows:

[0165] Step 1300, receiving a probe broadcast frame of the second device;

[0166] Step 1301, sending a response frame carrying device information of itself;

[0167] The device information includes but is not limited to sub-area ID, IP, MAC, and sub-area resolution.

[0168] Step 1302, receiving a screen projection instruction;

[0169] Step 1303, projecting the sub-area according to the sub-area ID carried by the screen projection instruction;

[0170] Step 1304, receiving a touch coordinate for reverse control;

[0171] Step 1305, converting the touch coordinate into a touch coordinate matched with the resolution of itself;

[0172] Step 1306, reporting the converted touch coordinate to the system to perform corresponding operations;

[0173] Step 1307, judging whether the second device ends the screen projection, if yes, executing step 1308, otherwise executing step 1303;

[0174] Step 1308, ending the screen projection.

[0175] As shown in FIG. 14, the embodiment provides a method for sharing display data, and the specific implementation process is as follows:

[0176] Step 1400, the first device and the second device establish a communication connection;

[0177] Step 1401, the second device selects a sub-region in the first device for screen projection display, and sends position information of the selected sub-region to the first device;

[0178] Step 1402, the first device determines a screen projection region according to the position information of the sub-region, records a display picture of the screen projection region, and sends the recorded display data to the second device;

[0179] Step 1403, the second device moves the screen projection region to a display region, and scales the display data of the screen projection region according to a resolution of the second device;

[0180] Step 1404, in response to a touch instruction of a user on the display data of the second device, the second device calibrates a touch position of the touch instruction, and sends the calibrated touch instruction to the first device;

[0181] Step 1405, the first device converts the touch instruction into a touch instruction matched with a resolution of the first device, and executes an operation indicated by the touch instruction on a sub-region corresponding to the touch instruction.

[0182] As shown in FIG. 15, the embodiment provides a method implementation flowchart of display data sharing, and the specific implementation flowchart is as follows:

[0183] Step 1500, the first device and the second device establish a communication connection;

[0184] Step 1501, the second device selects a sub-region in the first device for screen projection display, and sends position information of the selected sub-region to the first device;

[0185] Step 1502, the first device records a display picture of a display region, clips full-screen display data obtained by recording according to the position information of the sub-region, obtains display data of a screen projection region, and sends the display data to the second device;

[0186] Step 1503, the second device moves the screen projection region to a display region, and scales the display data of the screen projection region according to a resolution of the second device;

[0187] Step 1504, in response to a touch instruction of a user on the display data of the second device, the second device calibrates a touch position of the touch instruction, and sends the calibrated touch instruction to the first device;

[0188] Step 1505, the first device converts the touch instruction into a touch instruction matched with a resolution of the first device, and executes an operation indicated by the touch instruction on a sub-region corresponding to the touch instruction.

[0189] As shown in FIG. 16, the embodiment provides a method for displaying data sharing, and the implementation process is shown as follows:

[0190] Step 1600, the first device and the second device establish a communication connection.

[0191] Step 1601, the second device sends a screen projection instruction to the first device.

[0192] Step 1602, the first device records the display screen of the display area, and sends the full-screen display data obtained by recording to the second device.

[0193] Step 1603, the second device moves the screen projection area to the display area according to the position information of the screen projection area, and scales the display data of the screen projection area according to the resolution of the second device.

[0194] Step 1604, in response to the touch instruction of the user to the display data of the second device, the second device calibrates the touch position of the touch instruction, and sends the calibrated touch instruction to the first device.

[0195] Step 1605, the first device converts the touch instruction into a touch instruction matched with the resolution of the first device, and executes the operation indicated by the touch instruction on the sub-area corresponding to the touch instruction.

[0196] Based on the same inventive concept, the embodiment of the disclosure also provides a method for displaying data sharing, applied to a first device, as shown in FIG. 17, and the implementation process of the method is shown as follows:

[0197] Step 1700, determine a screen projection area, the display area of the first device includes a plurality of sub-areas, and the screen projection area includes part of the plurality of sub-areas.

[0198] Step 1701, send the display data of the screen projection area to a second device, for instructing the second device to adjust the display data of the screen projection area based on the resolution of the second device, and display the display data of the adjusted screen projection area; the first device and the second device have a communication connection.

[0199] As an optional implementation, the determination of the screen projection area includes:

[0200] Receiving the sub-area information indicated by the user, and determining the screen projection area according to the sub-area information; the sub-area information represents the position information of the sub-area in the display area of the first device.

[0201] As an optional implementation, the display data of the screen projection area is determined in the following manner:

[0202] record a display picture of the screen projection area, and determine the recorded display data as the display data of the screen projection area; or

[0203] record a display picture of the display area, crop the recorded full-screen display data according to the position information of the screen projection area, and determine the cropped display data as the display data of the screen projection area.

[0204] As an optional implementation, the recording of the display picture of the screen projection area comprises:

[0205] The recording area is set according to the position information of the screen projection area through a screen recording interface of an Android native layer, and a display picture of the recording area is recorded.

[0206] As an optional implementation, the method further comprises:

[0207] receiving a touch instruction sent by the second device;

[0208] The touch instruction is converted into a touch instruction matching the resolution of the second device, and an operation indicated by the touch instruction is performed on a sub-area corresponding to the touch instruction.

[0209] As an optional implementation, the conversion of the touch instruction into a touch instruction matching the resolution of the second device comprises:

[0210] The target resolution of the display data displayed on the second device is determined, and the touch instruction is converted into a touch instruction matching the resolution of the second device according to a ratio of the resolution of the first device to the target resolution.

[0211] Based on the same inventive concept, the embodiments of the present disclosure also provide a method for sharing display data, which is applied to a second device. As shown in FIG. 18, the implementation process of the method is as follows:

[0212] Step 1800: receiving display data of a screen projection area sent by a first device, the display area of the first device comprising a plurality of sub-areas, the screen projection area comprising part of the plurality of sub-areas; the first device and the second device being communicatively connected;

[0213] Step 1801: adjusting the display data of the screen projection area based on the resolution of the second device, and displaying the adjusted display data of the screen projection area.

[0214] As an optional implementation, the display of the adjusted display data of the screen projection area comprises:

[0215] receiving full-screen display data sent by the first device, the full-screen display data being obtained by recording a display picture of the display area of the first device;

[0216] According to the position information of the projection area, display data of the projection area in the full-screen display data is determined, and the display data of the projection area is moved to be displayed in the display area.

[0217] As an optional implementation, the display data of the projection area is adjusted based on the self resolution, including:

[0218] After the center of the projection area and the self display area is aligned, the display data of the projection area is scaled until the width of the scaled display data reaches the width of the self display area, or the height of the scaled display data reaches the height of the self display area, or,

[0219] After one vertex in the projection area and the self display area corresponding to a position is aligned, the display data of the projection area is scaled until the diagonal vertex of the one vertex in the projection area and the self display area is aligned.

[0220] As an optional implementation, the method further includes:

[0221] In response to a touch instruction of the user on the display data of the second device, the touch instruction is sent to the first device, so that the first device converts the touch instruction into a touch instruction matched with the self resolution, and performs an operation indicated by the touch instruction on a sub-area corresponding to the touch instruction.

[0222] As an optional implementation, before the touch instruction is sent to the first device, the method further includes:

[0223] The touch position of the touch instruction is calibrated, and the calibrated touch instruction is sent to the first device.

[0224] As an optional implementation, the closer the touch position is to the center of the display area of the second device, the smaller the calibration degree of the touch position is.

[0225] As an optional implementation, the calibration of the touch position of the touch instruction includes:

[0226] According to the resolution of the projection area and the self resolution, a target resolution of the adjusted display data is determined;

[0227] According to the self resolution and the target resolution, the touch position of the touch instruction is calibrated.

[0228] As an optional implementation, the calibration of the touch position of the touch instruction according to the self resolution and the target resolution includes:

[0229] According to the difference between the self resolution and the target resolution, an offset reference value is determined, and according to the ratio of the target resolution to the self resolution, a calibration ratio is determined.

[0230] The display data respectively at the center coordinates of the self resolution and the target resolution, the offset reference value and the calibration ratio are used to calibrate the touch position of the touch instruction.

[0231] Based on the same inventive concept, the display device is also provided in the embodiments of the present disclosure. Since the display device is the display device in the method in the embodiments of the present disclosure, and the principle of solving the problem of the display device is similar to that of the method, the implementation of the display device can be referred to the implementation of the method, and the repeated parts will not be described herein.

[0232] As shown in FIG. 19, the display device includes a processor 1900 and a memory 1901, the memory 1901 is used to store programs executable by the processor 1900, and the processor 1900 is used to read the programs in the memory 1901 and perform the following steps:

[0233] Determine a projection area, the display area of the first device includes a plurality of sub-areas, and the projection area includes part of the plurality of sub-areas;

[0234] Send the display data of the projection area to the second device, to instruct the second device to adjust the display data of the projection area based on the self resolution, and display the adjusted display data of the projection area; the first device and the second device have a communication connection.

[0235] Based on the same inventive concept, the display device is also provided in the embodiments of the present disclosure. Since the display device is the display device in the method in the embodiments of the present disclosure, and the principle of solving the problem of the display device is similar to that of the method, the implementation of the display device can be referred to the implementation of the method, and the repeated parts will not be described herein.

[0236] As shown in FIG. 20, the display device includes a processor 2000 and a memory 2001, the memory 2001 is used to store programs executable by the processor 2000, and the processor 2000 is used to read the programs in the memory 2001 and perform the following steps:

[0237] Receive the display data of the projection area sent by the first device, the display area of the first device includes a plurality of sub-areas, and the projection area includes part of the plurality of sub-areas; the first device and the second device have a communication connection;

[0238] Adjust the display data of the projection area based on the self resolution, and display the adjusted display data of the projection area.

[0239] Based on the same inventive concept, the embodiment of the disclosure further provides a device for sharing display data. Since the device is the device in the method of the embodiment of the disclosure, and the principle of the device for solving the problem is similar to that of the method, the implementation of the device can be referred to the implementation of the method, and the repeated parts will not be described here.

[0240] As shown in FIG. 21, the device comprises:

[0241] The area determination module 2100 is configured to determine a projection area, the display area of the first device comprising a plurality of sub-areas, and the projection area comprising part of the plurality of sub-areas.

[0242] The area projection module 2101 is configured to send the display data of the projection area to the second device, to instruct the second device to adjust the display data of the projection area based on the resolution of the second device, and to display the adjusted display data of the projection area. The first device and the second device have a communication connection.

[0243] Based on the same inventive concept, the embodiment of the disclosure further provides a device for sharing display data. Since the device is the device in the method of the embodiment of the disclosure, and the principle of the device for solving the problem is similar to that of the method, the implementation of the device can be referred to the implementation of the method, and the repeated parts will not be described here.

[0244] As shown in FIG. 22, the device comprises:

[0245] The receiving data module 2200 is configured to receive the display data of the projection area sent by the first device, the display area of the first device comprising a plurality of sub-areas, and the projection area comprising part of the plurality of sub-areas. The first device and the second device have a communication connection.

[0246] The projection adjustment module 2201 is configured to adjust the display data of the projection area based on the resolution of the second device, and to display the adjusted display data of the projection area.

[0247] Based on the same inventive concept, the embodiment of the disclosure provides a computer storage medium, which comprises computer program code. When the computer program code runs on a computer, the computer program code causes the computer to execute any of the methods for sharing display data as discussed above. Since the principle of the computer storage medium for solving the problem is similar to that of the method for sharing display data, the implementation of the computer storage medium can be referred to the implementation of the method, and the repeated parts will not be described here.

[0248] In specific implementation process, the computer storage medium can include: universal serial bus flash drive (USB, Universal Serial Bus Flash Drive), mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and various storage medium that can store program codes.

[0249] Based on the same inventive concept, the embodiments of the present disclosure further provide a computer program product, which comprises computer program codes, and when the computer program codes run on a computer, the computer is caused to execute the method for displaying data sharing as any of the foregoing. Since the above computer program product solves problems in the same principle as the method for displaying data sharing, the implementation of the above computer program product can refer to the implementation of the method, and the repeated parts will not be described herein.

[0250] The computer program product can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium may, for example, be but is not limited to an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination of the above. More specific examples (non-exhaustive list) of readable storage medium include: electrical connection with one or more conductive wires, portable disk, hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

[0251] Those skilled in the art should understand that the embodiments of the present disclosure can be provided as a method, a system, or a computer program product. Therefore, the present disclosure can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present disclosure can take the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer usable program codes.

[0252] The present disclosure is described in reference to flow diagrams and / or block diagrams of methods, display devices (systems), and computer program products according to embodiments of the present disclosure. It will be understood that each block of the flow diagrams and / or block diagrams, and combinations of blocks in the flow diagrams and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processing device or other programmable data processing device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing device, create means for implementing the functions specified in the flow diagrams and / or block diagrams block or blocks.

[0253] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flow diagrams and / or block diagrams block or blocks.

[0254] These computer program instructions can also be loaded onto a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer implemented process such that the instructions which execute on the computer or other programmable device provide steps for implementing the functions specified in the flow diagrams and / or block diagrams block or blocks.

[0255] It will be apparent to those skilled in the art that various modifications and variations can be made to the present disclosure without departing from the spirit or scope of the disclosure. Thus, it is intended that the present disclosure cover the modifications and variations of this disclosure provided such modifications and variations come within the scope of the application and the equivalents thereof.

Claims

1. A method of displaying data sharing, wherein, The method comprises: The first device determines a projection area, the display area of the first device comprises a plurality of sub-areas, and the projection area comprises part of the sub-areas; The first device sends display data of the projection area to the second device, and the first device and the second device have established a communication connection; The second device adjusts the display data of the projection area based on its own resolution and displays the adjusted display data of the projection area.

2. The method of claim 1, wherein, The first device determines the projection area, comprising: The first device receives sub-area information indicated by a user and determines the projection area according to the sub-area information; the sub-area information represents position information of a sub-area in the display area of the first device.

3. The method of claim 1, wherein, The first device determines the display data of the projection area in the following manner: The first device records a display picture of the projection area, and determines the recorded display data as the display data of the projection area; Or, The first device records a display picture of the display area, clips the recorded full-screen display data according to the position information of the projection area, and determines the clipped display data as the display data of the projection area.

4. The method of claim 3, wherein, The first device records a display picture of the projection area, comprising: The first device sets a recording area according to the position information of the projection area through a screen recording interface of an Android native layer, and records a display picture of the recording area.

5. The method of claim 1, wherein, The second device displays the adjusted display data of the projection area, comprising: The second device receives full-screen display data sent by the first device, the full-screen display data being recorded from a display picture of the display area of the first device; The second device determines display data of the projection area in the full-screen display data according to the position information of the projection area, and displays the display data of the projection area in the display area of the second device.

6. The method of claim 1, wherein, The second device adjusts the display data of the projection area based on its own resolution, comprising: The second device aligns the center of the projection area with the center of its own display area, and then scales the display data of the projection area until the width of the scaled display data reaches the width of the display area of the second device, or the height of the scaled display data reaches the height of the display area of the second device; or The second device aligns one vertex corresponding to a position in the projection area with one vertex in its own display area, and then scales the display data of the projection area until the diagonal vertex of the one vertex in the projection area aligns with the diagonal vertex of the one vertex in its own display area.

7. The method of claim 1, wherein, The method further comprises: In response to a touch instruction of a user on the display data of the second device, the second device sends the touch instruction to the first device; The first device converts the touch instruction into a touch instruction matched with its own resolution, and executes an operation indicated by the touch instruction on a sub-area corresponding to the touch instruction.

8. The method of claim 7, wherein, Before the second device sends the touch instruction to the first device, the method further comprises: The second device calibrates a touch position of the touch instruction, and sends the calibrated touch instruction to the first device.

9. The method of claim 8, wherein, The closer the touch position is to the center of the display area of the second device, the smaller the calibration degree of the touch position.

10. The method of claim 8, wherein, The second device calibrates the touch position of the touch instruction, comprising: The second device determines a target resolution of the adjusted display data according to a resolution of the screen mirroring area and a resolution of the second device; The second device calibrates the touch position of the touch instruction according to the resolution of the second device and the target resolution.

11. The method of claim 10, wherein, The second device calibrates the touch position of the touch instruction according to the resolution of the second device and the target resolution, including: The second device determines an offset reference value according to a difference between the resolution of the second device and the target resolution, and determines a calibration ratio according to a ratio between the target resolution and the resolution of the second device; The second device calibrates the touch position of the touch instruction according to the center coordinates of the display data under the resolution of the second device and the target resolution, the offset reference value and the calibration ratio.

12. The method of claim 7, wherein, The first device converts the touch instruction into a touch instruction matched with the resolution of the first device, including: The first device determines a target resolution of display data displayed by the second device, and converts the touch instruction into a touch instruction matched with the resolution of the first device according to a ratio between the resolution of the first device and the target resolution.

13. A method of displaying data sharing, wherein, The method applied to the first device, including: determining a screen mirroring area, the display area of the first device including a plurality of sub-areas, the screen mirroring area including part of the plurality of sub-areas; sending display data of the screen mirroring area to the second device, for instructing the second device to adjust the display data of the screen mirroring area based on a resolution of the second device, and display adjusted display data of the screen mirroring area; the first device and the second device having a communication connection established.

14. A method of displaying data sharing, wherein, The method applied to the second device, including: receiving display data of the screen mirroring area sent by the first device, the display area of the first device including a plurality of sub-areas, the screen mirroring area including part of the plurality of sub-areas; the first device and the second device having a communication connection established; adjusting the display data of the screen mirroring area based on a resolution of the second device, and displaying adjusted display data of the screen mirroring area.

15. A display device, wherein, The display device includes a processor and a memory, the memory being used to store programs executable by the processor, and the processor being used to read the programs in the memory and execute the steps of the method of claim 13 or 14.

16. A non-transitory computer storage medium having stored thereon a computer program, wherein, The program is executed by the processor to implement the steps of the method of any one of claims 1-14.

Images