Display data sharing methods and display device

Abstract

Provided in the present disclosure are display data sharing methods and a display device, which are used for improving a screen mirroring display effect. A method comprises: a first device determining a screen mirroring area, wherein a display area of the first device comprises a plurality of sub-areas, and the screen mirroring area comprises some of the plurality of sub-areas (500); the first device sending display data of the screen mirroring area to a second device, wherein a communication connection is established between the first device and the second device (501); and the second device adjusting the display data of the screen mirroring area on the basis of the resolution of the second device, and displaying the adjusted display data of the screen mirroring area (502).

Description

Method and display device for sharing display data TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of display, and in particular to a method and display device for sharing display data. BACKGROUND

[0002] With the development of large-screen electronic devices, it is a strong demand for people to cast the content displayed by a small-size mobile device to a large-size display device, or to cast the content displayed by a large-size display device to a small-size mobile device for reverse control. The large-size display device not only has a large resolution, but also has a special-shaped display screen, such as a strip-shaped screen placed in a smart driving cabin of a vehicle.

[0003] Currently, if the content displayed by the special-shaped display screen of the large-size display device needs to be cast to the small-size mobile device, the aspect ratio difference between the special-shaped display screen and the small-size mobile device is large, and the picture will be small after scaling at the same ratio, which is not suitable for watching and reverse control.

[0004] SUMMARY

[0005] The present disclosure provides a method and display device for sharing display data, which can improve the effect of casting display.

[0006] In a first aspect, a method for sharing display data is provided, and the method comprises the following steps:

[0007] A first device determines a casting area, the display area of the first device comprises a plurality of sub-areas, and the casting area comprises part of the plurality of sub-areas;

[0008] The first device sends display data of the casting area to a second device, and the first device and the second device have established a communication connection;

[0009] The second device adjusts the display data of the casting area based on its own resolution, and displays the adjusted display data of the casting area.

[0010] In a second aspect, a method for sharing display data is provided, and the method comprises the following steps:

[0011] A casting area is determined, the display area of the first device comprises a plurality of sub-areas, and the casting area comprises part of the plurality of sub-areas;

[0012] Display data of the casting area is sent to a second device, for instructing the second device to adjust the display data of the casting area based on its own resolution, and to display the adjusted display data of the casting area; the first device and the second device have established a communication connection.

[0013] In a third aspect, the embodiments of the present disclosure provide a method for sharing display data, which comprises the following steps:

[0014] receiving display data of a screen projection area sent by a first device, the display area of the first device comprising a plurality of sub-areas, the screen projection area comprising part of the plurality of sub-areas; the first device and the second device being connected by a communication connection;

[0015] adjusting the display data of the screen projection area based on the resolution of the second device, and displaying the adjusted display data of the screen projection area.

[0016] In a fourth aspect, the embodiments of the present disclosure further provide a display device, which comprises a processor and a memory, the memory being used to store programs executable by the processor, and the processor being used to read the programs in the memory and perform the following steps:

[0017] determining a screen projection area, the display area of the first device comprising a plurality of sub-areas, the screen projection area comprising part of the plurality of sub-areas;

[0018] sending the display data of the screen projection area to a second device, for instructing the second device to adjust the display data of the screen projection area based on the resolution of the second device, and display the adjusted display data of the screen projection area; the first device and the second device being connected by a communication connection.

[0019] In a fifth aspect, the embodiments of the present disclosure further provide a display device, which comprises a processor and a memory, the memory being used to store programs executable by the processor, and the processor being used to read the programs in the memory and perform the following steps:

[0020] receiving display data of a screen projection area sent by a first device, the display area of the first device comprising a plurality of sub-areas, the screen projection area comprising part of the plurality of sub-areas; the first device and the second device being connected by a communication connection;

[0021] adjusting the display data of the screen projection area based on the resolution of the second device, and displaying the adjusted display data of the screen projection area.

[0022] In a sixth aspect, the embodiments of the present disclosure further provide an apparatus for sharing display data, which comprises:

[0023] a region determining module, configured to determine a screen projection area, the display area of the first device comprising a plurality of sub-areas, the screen projection area comprising part of the plurality of sub-areas;

[0024] The area projection module is used to send the display data of the projection area to the second device, and to instruct the second device to adjust the display data of the projection area based on its own resolution, and to display the adjusted display data of the projection area; the first device and the second device establish a communication connection.

[0025] In a seventh aspect, embodiments of this disclosure also provide an apparatus for displaying data sharing, the apparatus comprising:

[0026] A data receiving module is used to receive display data of the projection area sent by the first device. The display area of ​​the first device includes multiple sub-areas, and the projection area includes some sub-areas of the multiple sub-areas. The first device and the second device establish a communication connection.

[0027] The screen projection adjustment module is used to adjust the display data of the projection area based on its own resolution, and then display the adjusted display data of the projection area.

[0028] Eighthly, embodiments of this disclosure also provide a computer storage medium having a computer program stored thereon, which, when executed by a processor, is used to implement the steps of the method described in any one of the first, second, or third aspects above.

[0029] In a ninth aspect, this disclosure provides a computer program product comprising: computer program code that, when executed on a computer, causes the computer to perform the method described in any one of the first, second, or third aspects.

[0030] These or other aspects of this disclosure will become more apparent in the following description of embodiments. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 is a schematic diagram of an in-vehicle irregular-shaped display screen provided in an embodiment of this disclosure;

[0033] Figure 2 is a schematic diagram of a multi-area display on a vehicle-mounted irregularly shaped screen provided in an embodiment of this disclosure;

[0034] Figure 3 is a schematic diagram of a reverse-controlled irregular screen display provided in an embodiment of this disclosure;

[0035] Figure 4 is a schematic diagram of a screen projection display system framework provided in an embodiment of this disclosure;

[0036] FIG. 5 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0037] FIG. 6 is a schematic diagram of a screen recording function according to an embodiment of the present disclosure;

[0038] FIG. 7 is a schematic diagram of a display area according to an embodiment of the present disclosure;

[0039] FIG. 8 is a schematic diagram of a screen projection display according to an embodiment of the present disclosure;

[0040] FIG. 9 is a schematic diagram of a screen projection display according to an embodiment of the present disclosure;

[0041] FIG. 10 is a schematic diagram of an effect of scaling display data according to an embodiment of the present disclosure;

[0042] FIG. 11 is a schematic diagram of an effect of a screen projection display according to an embodiment of the present disclosure;

[0043] FIG. 12 is a schematic diagram of a communication flow between a first device and a second device according to an embodiment of the present disclosure;

[0044] FIG. 13 is a flowchart of a screen projection operation of a first device according to an embodiment of the present disclosure;

[0045] FIG. 14 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0046] FIG. 15 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0047] FIG. 16 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0048] FIG. 17 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0049] FIG. 18 is an implementation flowchart of a method for displaying data sharing according to an embodiment of the present disclosure;

[0050] FIG. 19 is a schematic diagram of a display device according to an embodiment of the present disclosure;

[0051] FIG. 20 is a schematic diagram of a display device according to an embodiment of the present disclosure;

[0052] FIG. 21 is a schematic diagram of an apparatus for displaying data sharing according to an embodiment of the present disclosure;

[0053] FIG. 22 is a schematic diagram of an apparatus for displaying data sharing according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0054] In order to make the purposes, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure and not all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present disclosure.

[0055] The term "and / or" in the embodiments of the present disclosure describes the association relationship of the associated objects and indicates that there can be three relationships, for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after it.

[0056] Before introducing the method for sharing display data provided by the embodiments of the present disclosure, in order to facilitate understanding, the technical background of the embodiments of the present disclosure is first introduced in detail.

[0057] With the development of large-screen electronic devices, it is a strong demand for people to project the content displayed by a small-size mobile device to a large-size display device or to project the content displayed by a large-size display device to a small-size mobile device for reverse control. The large-size display device not only has a large resolution, but also has a special-shaped display screen, such as a strip-shaped screen placed in a vehicle intelligent driver compartment, as shown in FIG. 1. The present embodiment provides a schematic diagram of a vehicle special-shaped display screen, which includes three display areas, and the content displayed by different display areas is different. Since the vehicle special-shaped screen has different central control functions, different central control functions can be displayed through different display areas. Area 1 is used to display vehicle state information, area 2 is used to display vehicle control information, and area 3 is used to display audio-visual entertainment information. As shown in FIG. 2, the present embodiment can also provide a schematic diagram of multi-area display of a vehicle special-shaped screen. Based on the shape and size of the special-shaped screen, different central control functions can be displayed in different areas, and the positions and sizes of different areas are set. At present, the special-shaped display screen can be logically divided into areas, and the divided areas can be displayed by hardware FPGA (Field Programmable Gate Array, field programmable gate array) splicing, so as to realize multi-area and multi-functional display of the special-shaped display screen, and solve the problem that the width of the resolution of the special-shaped screen exceeds the conventional display output.

[0058] If it is needed to project the content displayed on the irregular display screen of a large-size display device to a small-size mobile device, due to the large difference in the width-to-height ratio between the irregular display screen and the small-size mobile device, the picture after the equal proportion scaling will be small, which is not suitable for watching and reverse control. As shown in FIG. 3, the embodiment provides a display picture diagram of reverse control of an irregular screen. When the content displayed on the irregular screen is projected to a mobile device, the display picture of the mobile device is small. If the zooming is only performed by the view displayed on the mobile device, although the problem of adapting the mobile device proportion in the display area can be solved, since the whole picture of the bar-shaped screen is still encoded, compressed and collected, in order to ensure the transmission rate, the resolution will be reduced, and thus the pure zooming of the display of a certain area, for example, the content of the area 1, will cause the problem of unclear picture of the area 1.

[0059] To solve the above technical problem, the embodiment provides a display data sharing method, which sends the projection area in the display area of the first device to the second device, and adjusts the display data of the projection area based on the resolution of the second device, so that the projection area is displayed adaptively to the resolution of the second device, thereby improving the projection display effect, and solving the problem of unclear display data in the projection picture when the display data of a large-size display screen is projected to a small-size display device. The display data sharing method provided in the embodiment can adjust the projection area and ensure the projection display resolution, and can project the picture of the required sub-area in the display area according to the suitable display resolution.

[0060] It should be noted that the first device in the embodiment includes but is not limited to a large-size (generally more than 50 inches) smart interactive display device with touch handwriting function, a vehicle-mounted display screen, etc., and the first device can include a liquid crystal display (LCD), an organic electroluminescence display (OLED), an electronic ink, etc.

[0061] The second device includes but is not limited to a mobile phone, a tablet computer, a smart watch, etc.

[0062] As shown in FIG. 4, the embodiment provides a system framework diagram for screen projection display. A VirtualDisplay device is created by a Native layer of a first device to obtain Surface display data, and MediaCodec is used for encoding to obtain an H.264 code stream. The H.264 code stream is sent to an APK of a second device through a Deamon process by using any one of UDP, UDT or TCP link modes. Then, the H.264 code stream is decoded by MediaCodec, and displayed in a window created by SurfaceView.

[0063] As shown in FIG. 5, the embodiment provides an implementation process of the method for sharing display data as follows.

[0064] In step 500, the first device determines a screen projection area. The display area of the first device includes a plurality of sub-areas, and the screen projection area includes part of the plurality of sub-areas.

[0065] The display area of the first device in the embodiment includes a plurality of sub-areas, and the contents displayed in different sub-areas are different. For example, when the first device is a vehicle display screen, the display area of the vehicle display screen includes a plurality of sub-areas. One sub-area is used to display the vehicle state, another sub-area is used to display the vehicle control state, and another sub-area is used to display audio and video entertainment. The first device can determine one or more sub-areas from the plurality of sub-areas as the screen projection area. For example, when the display area includes three sub-areas, the screen projection area can be one or two sub-areas. Optionally, the resolutions of the plurality of sub-areas in the embodiment can be the same or different, which is not limited in the embodiment.

[0066] In some embodiments, the first device determines the screen projection area in the following manner.

[0067] The first device receives sub-area information indicated by a user, and determines the screen projection area according to the sub-area information. The sub-area information represents position information of a sub-area in the display area of the first device.

[0068] Optionally, the first device receives the sub-area information indicated by the user in the following any one manner.

[0069] 1) the user directly indicates the sub-region on the first device;

[0070] In response to the user indicating the sub-region information on the display region of the first device, the first device determines that the user-indicated sub-region information is received.

[0071] 2) the user indicates the sub-region on the second device and sends the sub-region information to the first device;

[0072] The first device determines the received sub-region information of the second device as the user-indicated sub-region information, wherein the sub-region information of the second device is determined based on the user indicating the sub-region information on the display region of the second device.

[0073] Optionally, in this embodiment, the sub-region information represents the position information of the sub-region in the display region of the first device, and the sub-region information in this embodiment includes but is not limited to sub-region identification information, sub-region position information, etc.

[0074] Step 501, the first device sends the display data of the screen projection region to the second device, and the first device and the second device have established a communication connection;

[0075] In some embodiments, the first device determines the display data of the screen projection region in any of the following ways:

[0076] a. The first device records the display screen of the screen projection region, and determines the recorded display data as the display data of the screen projection region.

[0077] In this embodiment, the first device only records the display screen of the screen projection region, does not record the display screen of the non-screen projection region in the display region of the first device, and sends the recorded display data to the second device for display.

[0078] In some embodiments, the first device records the display screen of the screen projection region in the following way:

[0079] The first device sets a recording region according to the position information of the screen projection region through the screen recording interface of the Android native layer, and records the display screen of the recording region.

[0080] As shown in FIG. 6, the embodiment provides a recording screen function diagram. For a first device using an Android system, a virtual display device can be created by a SurfaceComposerClient (a tool class) of an Android Native layer, and registered to a DisplayDevice (a display device) list of the system. When there is a picture update in a SurfaceFlinger (a display engine), the picture update is sent to the virtual display device for GLES (OpenGL for Embedded Systems) synthesis display, so that the data of the picture update of the large-size display device can be obtained in the virtual display device. At the same time of creating the virtual display device, a Surface (a surface layer) used for encoding by a MediaCodec (a media codec) is used as a BufferQueue (a data transmission component) to synchronously obtain the display data of the GLES synthesis. The display data is encoded by the MediaCodec to form a code stream data, and sent to a second device.

[0081] The embodiment uses a screen recording interface of an Android Native layer, instead of an API (Application Programming Interface) interface of an Android standard framework layer. The embodiment can set the position and size of the recording area by a setDisplayProjection method of a SurfaceComposerClient of the Native layer, and the API interface of the Android standard framework layer cannot realize the function.

[0082] As shown in FIG. 7, the embodiment provides a display area diagram. The display area of the first device includes three sub-areas, and the position information of the three sub-areas is as follows:

[0083] The position information of the sub-area A is (x A1 ,y A1 ) = (0, 0), (x A2 ,y A2 ) = (2984, 500);

[0084] The position information of the sub-area B is (x B1 ,y B1 ) = (2984, 0), (x B2 ,y B2 ) = (5976, 500);

[0085] Location information of sub-region C: (x C1 ,y C1 )=(5976,0),(x C2 ,y C2 ) = (8800, 500);

[0086] When a user selects different sub-areas for screen projection, they only need to set the location information of the sub-area to a Rect object and pass the Rect object to the setDisplayProjection method to set the projection area to be recorded. This way, only the display screen of the projection area can be recorded, and the recorded display data of the projection area can be sent to the second device for display.

[0087] Method b: The first device records the display screen of the display area, and crops the recorded full-screen display data according to the position information of the projection area, and determines the cropped display data as the display data of the projection area.

[0088] In this embodiment, the first device records the entire display screen of the display area, then crops the recorded full-screen display data according to the position of the projection area to obtain the display data of the projection area, and sends the display data of the projection area to the second device for display.

[0089] In implementation, based on the Android OpenGL (Open Graphics Library) clipping and rendering principle, the recorded full-screen display data is clipped to obtain the display data for the projection area. This allows for a configurable recording area, dividing the display area of ​​the first device into multiple sub-areas suitable for the second device's display. This solves the problem of unclear display and difficulty in touch control when projecting a higher resolution screen to a lower resolution.

[0090] As shown in Figure 8, this embodiment provides a schematic diagram of screen projection display. In practice, a first device can record the display screen to obtain full-screen display data, and use OpenGL (Open Graphics Library) to crop the full-screen display data. The cropped display data is then encoded using MediaCodec to obtain an H.264 bitstream, which is sent to the second device's APK (Android application package) via either UDP (User Datagram Protocol) or TCP (Transmission Control Protocol). The second device then decodes the H.264 bitstream using MediaCodec and displays it in a window created by SurfaceView. When the first device dynamically adjusts the display area in real time, the position of the projection area can be dynamically set in real time using OpenGL, eliminating the need for re-projection and imposing restrictions on the aspect ratio of the projection area.

[0091] During implementation, after receiving the display data from the projection area, the second device adjusts the display data of the projection area based on its own resolution so that the adjusted display data can be displayed to adapt to the resolution of the second device, thus solving the problem of poor projection effect when the display content of the first device is projected to the second device.

[0092] In some embodiments, the second device determines the display data of the projection area and displays the adjusted display data of the projection area in the following manner:

[0093] The second device receives full-screen display data sent by the first device. The full-screen display data is obtained by recording the display screen of the first device's display area. The second device determines the display data of the projection area in the full-screen display data according to the position information of the projection area, and moves the display data of the projection area to the display area of ​​the second device for display.

[0094] Optionally, in this embodiment, since the first device determines the projection area, when the first device sends the full-screen display data recorded by the second device, in order not to reduce the transmission rate and ensure the projection effect, it can compress the data without affecting the resolution of the projection area, while compressing the display data of other non-projection areas normally. In this way, the transmission rate is guaranteed while the projection display effect of the data in the projection area is not affected.

[0095] This embodiment is based on the GLSurfaceView (Graphics Library Surface View) rendering principle. It calculates the resolution difference between the first and second devices, and uses an algorithm to enlarge and move the projection area to a specified position, achieving the effect of displaying only a sub-area of ​​the first device's display area. When the first device dynamically adjusts its display area in real time, the projection area can be dynamically displayed on the second device in real time without re-projection.

[0096] GLSurfaceView is a view in Android used for rendering 3D or 2D graphics, and it works closely with the Renderer interface. Here's the basic principle behind GLSurfaceView's graphics rendering: A GLSurfaceView instance is created and a class implementing the Renderer interface is set as the renderer. The view is started, which creates a rendering thread that continuously calls the renderer's onDrawFrame method. The onDrawFrame method internally calls the OpenGL ES API to execute drawing commands. When the screen's view state changes (e.g., rotation), GLSurfaceView calls the renderer's onSurfaceChanged method to notify of the change. When the device screen's visibility changes (e.g., the user unlocks the screen), GLSurfaceView calls the renderer's onSurfaceCreated method to notify the creation or reset of the rendering surface.

[0097] As shown in Figure 9, this embodiment provides a schematic diagram of screen projection display. In practice, the first device records the screen of the display area to obtain full-screen display data, encodes it using MediaCodec to obtain an H.264 bitstream, and sends it to the APK of the second device via either UDP or TCP. The second device then decodes the H.264 bitstream using MediaCodec and uses the OpenGL interface of GLSurfaceView to enlarge and shift the display data of the projection area in the full-screen display data, displaying it on the second device's display area according to a resolution suitable for the second device. When the first device dynamically adjusts the display area in real time, the position of the projection area on the second device's display area can be dynamically adjusted in real time via OpenGL, without the need for re-projection.

[0098] Step 502: The second device adjusts the display data of the projection area based on its own resolution and displays the adjusted display data of the projection area.

[0099] In some embodiments, the second device adjusts the display data of the projection area based on its own resolution in any of the following ways:

[0100] Method a) The second device scales the display data of the projection area according to its own resolution and moves the scaled display data to the display area for display.

[0101] In practice, the display data of the projection area can be scaled first so that the second device can scale the display data of the projection area to a size suitable for its own resolution and display it completely within the display area.

[0102] Method b) The second device moves the projection area to the display area and scales the display data of the projection area according to its own resolution.

[0103] In practice, the display data of the projection area can be moved to the display area first, and then the display data can be scaled according to its own resolution size to display it all in the display area and improve the projection display effect.

[0104] In some embodiments, this embodiment provides a second device that adjusts the display data of the projection area according to its own resolution in any of the following ways:

[0105] Method b1) After aligning the center of the projection area with its own display area, the second device scales the display data of the projection area until the width of the scaled display data reaches the width of its own display area, or the height of the scaled display data reaches the height of its own display area, and then stops scaling.

[0106] It should be noted that in this embodiment, the scaling of the data displayed in the projection area is done proportionally according to the width and height of the data displayed in the projection area.

[0107] As shown in Figure 10, this embodiment provides a schematic diagram of the effect of scaling display data. After aligning the centers of the projection area and the display area, the display data of the projection area is enlarged, that is, the resolution of the display data of the projection area is increased, so that it is displayed on the screen. In practice, when scaling the display data of the projection area after aligning the centers of the projection area and the display area, the side whose width and height first reach the display area of ​​the second device is used as a reference, and the other side is scaled proportionally in both width and height. Specifically, if the height of the projection area first reaches the height of the display area of ​​the second device, then the width of the projection area is scaled proportionally in both width and height; if the width of the projection area first reaches the width of the display area of ​​the second device, then the height of the projection area is scaled proportionally in both width and height.

[0108] It should be noted that since the resolution of the data displayed in the projection area may not match the resolution of the second device, enlarging the data displayed in the projection area can make the enlarged data more suitable for display at the resolution of the second device.

[0109] Method b2): The second device aligns a vertex corresponding in position in the screen mirroring area and its own display area, and scales the display data of the screen mirroring area until the scaling stops when the diagonal vertices of the one vertex in the screen mirroring area and its own display area are aligned.

[0110] In implementation, assume that the width and height of the display data of the screen mirroring area are X1 (the upper left vertex coordinate of the screen mirroring area) and Y1 (the lower right vertex coordinate of the screen mirroring area) respectively, and the width and height of the display area of the second device are X2 (the upper left vertex coordinate of the display area) and Y2 (the lower right vertex coordinate of the display area) respectively.

[0111] Step 1): Determine the up-and-down equal ratio scaling and / or left-and-right equal ratio scaling to achieve equal ratio display of width and height.

[0112] Calculate the width-to-height ratios of the display data and the display area of the second device respectively as:

[0113] Width-to-height ratio of the display data of the screen mirroring area: scale1 = X1 / Y1;

[0114] Width-to-height ratio of the display area of the second device: scale2 = X2 / Y2;

[0115] Judge the sizes of scale1 and scale2. If scale1 > scale2, perform up-and-down scaling in the Y-axis direction and left-and-right equal ratio display in the X-axis direction on the display data; if scale1 < scale2, perform left-and-right scaling in the X-axis direction and up-and-down equal ratio display in the Y-axis direction on the display data. If scale1 = scale2, equal ratio scaling can be performed in both the X-axis direction and the Y-axis direction.

[0116] Among them, the X-axis direction and the Y-axis direction are determined based on the coordinate axes of the display area of the second device.

[0117] Step 2): Move the X1 coordinate to the X2 coordinate to make the X1 screen mirroring area reach the left vertex of the display area of the second device, that is, make the X1 coordinate coincide with the X2 coordinate.

[0118] Step 3): Use the render.zoom interface to magnify the screen mirroring area in equal ratio to make Y1 move to Y2, that is, make the Y1 coordinate coincide with the Y2 coordinate, so that the screen mirroring area and the display area of the second device have the same size and position.

[0119] In implementation, when the user dynamically adjusts the size of the display area of the first device on the first device, the size and position information of the adjusted screen mirroring area can be sent to the second device in real time for the second device to repeat Step 2) and Step 3) for real-time screen mirroring display without re-screen mirroring.

[0120] In some embodiments, this embodiment also provides a screen mirroring and control function, the specific implementation steps of which are as follows:

[0121] In response to a user's touch command regarding the display data of the second device, the second device sends the touch command to the first device;

[0122] The first device converts the touch command into a touch command that matches its own resolution, and executes the operation indicated by the touch command for the sub-region corresponding to the touch command.

[0123] In practice, once the second device obtains the display data of the projection area of ​​the first device, it can feed back its own touch operations to the first device, thereby remotely controlling the first device to perform touch operations. Since the projection areas of the second and first devices often have resolution mismatches, the coordinate data related to the touch commands collected by the second device needs to be converted to accurately control the first device to perform the corresponding operations. Considering that the first device can be controlled by multiple different second devices, and the resolutions of the second devices cannot be standardized, the coordinate conversion logic needs to be executed separately in each second and first device. Both devices convert according to the same display resolution (e.g., 1920×1080), and the coordinate data contained in the converted touch commands is sent to the first device for touch operation execution.

[0124] During the communication establishment process between the first and second devices, the second device first broadcasts its own information, then initiates the screen recording phase, sending the ID of the sub-region to be projected. Upon receiving the sub-region ID from the second device, the first device calculates the actual resolution (W) of the sub-region. a H a ) and target resolution (W m H m ) is calculated to obtain the ratio (W) d =W a / W m H d =H a / H m This is used for subsequent coordinate transformations. The target resolution refers to the resolution at which the displayed data is adjusted by the second device.

[0125] In some embodiments, before the second device sends a touch command to the first device, it may also calibrate the touch position of the touch command and send the calibrated touch command to the first device.

[0126] In practice, when a sub-area of ​​the display area of ​​the first device is projected onto the second device for display, the user can execute touch commands for the displayed data on the second device. Since the projection area is moved to the display area of ​​the second device and then scaled, or the projection area is scaled and then moved to the display area of ​​the second device, scaling only the touch position in the touch command will produce an offset value, causing the touch command to be offset after being transferred to the first device. Therefore, in this embodiment, the touch position of the touch command is calibrated and then sent to the first device, so that the first device can execute the touch command for the sub-area corresponding to the touch command.

[0127] In some embodiments, the closer the touch position is to the center of the display area of ​​the second device, the less calibrated the touch position is.

[0128] In some embodiments, the second device calibrates the touch position of the touch command in the following manner:

[0129] a) The second device determines the target resolution of the adjusted display data based on the resolution of the projection area and its own resolution;

[0130] b) The second device calibrates the touch position of the touch command based on its own resolution and the target resolution.

[0131] Optionally, the touch position of the touch command can be calibrated using the following steps:

[0132] i) The second device determines the offset reference value based on the difference between its own resolution and the target resolution, and determines the calibration ratio based on the ratio of the target resolution to its own resolution;

[0133] During implementation, after aligning the center points of the second device's display area and the projection area, the resolution of the data displayed in the projection area is enlarged to adapt for display on the second device. At this point, because the projection area is scaled according to the target resolution of the data displayed in the projection area in order to fill the second device's display area as much as possible, coordinate calibration is required.

[0134] The offset baseline value after the data in the projection area is magnified is as follows: offset X =(W x -W m ) / 2, offset Y =(H x -H m ) / 2;

[0135] The resolution of the second device is (W) x H x The target resolution is (W). m H mThe display shows the center coordinates of the data at the second device resolution, i.e., the coordinates of the center point of the second device are (x...). MiddleX =W x / 2,x MiddleY =H x / 2); The center coordinates of the displayed data at the target resolution are (m MiddleX =W m / 2,m MiddleY =H m / 2);

[0136] According to the target resolution (W) m H m The resolution of the second device is (W) x H x The ratio of D to the value of D determines the calibration ratio. x =W m / W x D y =H m / H x .

[0137] ii) The second device calibrates the touch position of the touch command based on the center coordinates of its own resolution and the target resolution, the offset reference value, and the calibration ratio, respectively, according to the display data.

[0138] In practice, the height and width of the projection area are scaled proportionally to the resolution of the second device first, and the other side is scaled proportionally. The result will be a horizontal or vertical black border, as shown in Figure 11, which is a schematic diagram of a projection display effect.

[0139] When the projection area displays a vertical black border along the Y-axis in the second device's display area: offset X =(W x -W m ) / 2, offset Y =0; x MiddleX =W x / 2,x MiddleY =H x / 2; m MiddleX =W m / 2,m MiddleY =H m / 2;

[0140] When the projection area displays a horizontal black border along the X-axis in the second device's display area: offset Y =(H x -H m ) / 2, offset X =0; x MiddleY =H x / 2,x MiddleX =W x / 2; m MiddleY =H m / 2,m MiddleX =W m / 2;

[0141] Finally, the touch coordinates (I) of the touch commands collected by the second device will be used. x I y The calibration is performed using the following formula: X = (I x -offset X ×(x MiddleX -I x ) / m MiddleX )×D x ; Y=(I y -offset Y ×(x MiddleY -I y ) / m MiddleY )×D y Formula (1);

[0142] In formula (1), (I x I y (offset) represents the touch coordinates of the touch command. X offset Y (x) represents the offset reference value. MiddleX x MiddleY (m) represents the coordinates of the center point of the second device; MiddleX m MiddleY () indicates the center coordinates of the displayed data at the target resolution; (D) x D y () represents the calibration ratio; (X, Y) represents the calibrated touch coordinates.

[0143] In some embodiments, the first device converts touch commands into touch commands that match its own resolution in the following manner:

[0144] The first device determines the target resolution for displaying data on the second device, and converts touch commands into touch commands that match its own resolution based on the ratio of its own resolution to the target resolution.

[0145] Optionally, the first device determines the target resolution for displaying the data on the second device using any of the following methods:

[0146] The first device determines the target resolution of the adjusted display data based on the resolution of the display data and the resolution of the second device; or, the first device receives the target resolution sent by the second device.

[0147] In practice, after calibrating the touch coordinates of the touch command, the calibrated touch coordinates are sent to the first device. The first device then converts the touch command into a touch command matching its own resolution based on the ratio of its own resolution to the target resolution. For example, after receiving the sub-region ID from the second device, the first device will convert the actual resolution (W) of the sub-region... a H a ) and target resolution (W m H m ) is calculated to obtain the ratio (W) d =W a / W m H d =H a / H m ).

[0148] During implementation, the calibrated touch coordinates (X, Y) are sent to the first device, along with the ratio of its own resolution to the target resolution (W). d =W a / W m H d =H a / H m Furthermore, the calculation can also be performed based on the sub-region offset value of the projection area relative to the upper left corner vertex of the first device's display area to obtain the matching touch coordinates.

[0149] Specifically, the touch coordinates of the touch command matching its own resolution are calculated using the following formula: Q x =X×W d +offset Sx Q y =Y×H d +offset Sy Formula (2);

[0150] In formula (2), (offset) Sx offset Sy () represents the sub-region offset value, (X, Y) represents the calibrated touch coordinates, (W) represents the offset value of the sub-region, (X, Y) represents the calibrated touch coordinates, and (W) represents the offset value of the sub-region. d H d (Q) represents the ratio of the resolution of the projection area to the target resolution. x Q y ) represents the touch coordinates of the converted touch command.

[0151] Among them, offset Sx = The width of the adjacent area to the left of the projection area along the X-axis, offset Sy=0, at this time if the projection area is the leftmost sub-area of ​​the first device's display area, then (offset) Sx offset Sy ) is 0; or, offset is 0. Sx = The width of the adjacent area to the right of the projection area along the X-axis, offset Sy =0, at this time if the projection area is the rightmost sub-area of ​​the first device's display area, then (offset) Sx offset Sy ) is 0; or, offset is 0. Sx =0, offset Sy = The height of the adjacent area above the projection area in the Y-axis direction. If the projection area is the uppermost sub-area of ​​the first device's display area, then (offset) Sx offset Sy ) is 0; or, offset is 0. Sx =0, offset Sy = The height of the adjacent area below the projection area in the Y-axis direction. If the projection area is the lowest sub-area in the first device's display area, then (offset) Sx offset Sy The value is 0.

[0152] As shown in Figure 12, this embodiment also provides a schematic diagram of the communication process between the first device and the second device. The first device and the second device communicate with each other via a local area network using either a wireless or wired connection, and the communication process is divided into the following three stages:

[0153] Phase 1: Exploration Phase.

[0154] Before enabling screen mirroring control, the resolution / screen size and device type information of the second device need to be added during the negotiation phase.

[0155] The second device sends a probe broadcast frame via UDP. The probe broadcast frame includes its own IP (Internet Protocol) and MAC (Media Access Control) information.

[0156] After the first device listens for and receives the search broadcast frame, it sends a response frame via UDP, which includes its own IP address, MAC address, the sub-region ID that can be projected, and the resolution information of each sub-region.

[0157] After receiving the response frame, the second device stores the relevant information.

[0158] Phase 2, screen mirroring phase.

[0159] To ensure the accuracy of screen mirroring control commands, separate control channel TCP connections need to be established between the first and second devices.

[0160] The second device sends a control frame to start screen projection, which contains the ID of the sub-area to be projected.

[0161] After receiving the sub-region ID, the first device selects the sub-region for screen recording and encoding, and sends it to the second device for display via RTP (Real-Time Transport Protocol).

[0162] Phase 3, Counter-control Phase

[0163] To ensure the accuracy of the touch points, the control channel TCP link between the first and second devices is used to transmit touch data (touch coordinates).

[0164] As shown in Figure 13, this embodiment also provides a flowchart of the first device screen projection operation, and the specific implementation process is as follows:

[0165] Step 1300: Receive the probe broadcast frame from the second device;

[0166] Step 1301: Send a response frame, carrying your own device information;

[0167] The device information includes, but is not limited to, the ID, IP address, MAC address, and resolution of each sub-region.

[0168] Step 1302: Receive screen mirroring command;

[0169] Step 1303: Cast the sub-region according to the sub-region ID carried in the casting command;

[0170] Step 1304: Receive the touch coordinates of the reverse control;

[0171] Step 1305: Convert the touch coordinates to touch coordinates that match its own resolution;

[0172] Step 1306: Report the converted touch coordinates to the system and perform the corresponding operations;

[0173] Step 1307: Determine whether the second device has finished screen mirroring. If yes, proceed to step 1308; otherwise, proceed to step 1303.

[0174] Step 1308: End screen mirroring.

[0175] As shown in Figure 14, this embodiment provides a flowchart of a method for displaying data sharing. The specific implementation process is as follows:

[0176] Step 1400: The first device and the second device establish a communication connection;

[0177] Step 1401: The second device selects a sub-area from the first device for screen projection and sends the location information of the selected sub-area to the first device;

[0178] Step 1402: The first device determines the projection area based on the location information of the sub-area, records the display screen of the projection area, and sends the recorded display data to the second device.

[0179] Step 1403: The second device moves the projection area to the display area and scales the display data of the projection area according to its own resolution.

[0180] Step 1404: In response to the user's touch command on the display data of the second device, the second device calibrates the touch position of the touch command and sends the calibrated touch command to the first device;

[0181] Step 1405: The first device converts the touch command into a touch command that matches its own resolution, and executes the operation indicated by the touch command for the sub-region corresponding to the touch command.

[0182] As shown in Figure 15, this embodiment provides a flowchart of a method for displaying data sharing. The specific implementation process is as follows:

[0183] Step 1500: The first device and the second device establish a communication connection;

[0184] Step 1501: The second device selects a sub-area from the first device for screen projection and sends the location information of the selected sub-area to the first device;

[0185] Step 1502: The first device records the display screen of the display area, and crops the recorded full-screen display data according to the position information of the sub-area to obtain the display data of the projection area and sends it to the second device;

[0186] Step 1503: The second device moves the projection area to the display area and scales the display data of the projection area according to its own resolution.

[0187] Step 1504: In response to the user's touch command on the display data of the second device, the second device calibrates the touch position of the touch command and sends the calibrated touch command to the first device;

[0188] Step 1505: The first device converts the touch command into a touch command that matches its own resolution, and executes the operation indicated by the touch command for the sub-region corresponding to the touch command.

[0189] As shown in Figure 16, this embodiment provides a flowchart of a method for displaying data sharing. The specific implementation process is as follows:

[0190] Step 1600: The first device and the second device establish a communication connection;

[0191] Step 1601: The second device sends a screen projection command to the first device;

[0192] Step 1602: The first device records the display screen of the display area and sends the recorded full-screen display data to the second device;

[0193] Step 1603: The second device moves the projection area to the display area according to the location information of the projection area, and scales the display data of the projection area according to its own resolution.

[0194] Step 1604: In response to the user's touch command on the display data of the second device, the second device calibrates the touch position of the touch command and sends the calibrated touch command to the first device;

[0195] Step 1605: The first device converts the touch command into a touch command that matches its own resolution, and executes the operation indicated by the touch command for the sub-region corresponding to the touch command.

[0196] Based on the same inventive concept, this disclosure also provides a method for displaying data sharing, applied to a first device, as shown in FIG17. The implementation flow of this method is as follows:

[0197] Step 1700: Determine the projection area. The display area of ​​the first device includes multiple sub-areas, and the projection area includes some sub-areas within the multiple sub-areas.

[0198] Step 1701: Send the display data of the projection area to the second device to instruct the second device to adjust the display data of the projection area based on its own resolution, and display the adjusted display data of the projection area; the first device and the second device establish a communication connection.

[0199] As an optional implementation, determining the projection area includes:

[0200] The system receives sub-region information indicated by the user and determines the projection area based on the sub-region information; the sub-region information represents the location information of the sub-region within the display area of ​​the first device.

[0201] As an optional implementation method, the display data of the projection area is determined in the following way:

[0202] Record the display screen of the projection area, and use the recorded display data as the display data for the projection area; or,

[0203] The screen displayed in the projection area is recorded. The recorded full-screen display data is then cropped based on the location information of the projection area, and the cropped display data is used as the display data for the projection area.

[0204] As an optional implementation, recording the display screen of the projection area includes:

[0205] By using the Android local layer screen recording interface, the recording area is set according to the location information of the projection area, and the display screen of the recording area is recorded.

[0206] As an optional implementation, the method further includes:

[0207] Receive touch commands sent by the second device;

[0208] The touch command is converted into a touch command that matches its own resolution, and the operation indicated by the touch command is executed for the sub-region corresponding to the touch command.

[0209] As an optional implementation, the step of converting touch commands into touch commands that match its own resolution includes:

[0210] Determine the target resolution for displaying the data on the second device, and convert the touch commands into touch commands that match the target resolution based on the ratio of the user's own resolution to the target resolution.

[0211] Based on the same inventive concept, this disclosure also provides a method for displaying data sharing, applied to a second device, as shown in FIG18. The implementation flow of this method is as follows:

[0212] Step 1800: Receive display data of the projection area sent by the first device. The display area of ​​the first device includes multiple sub-areas, and the projection area includes some sub-areas within the multiple sub-areas. The first device and the second device establish a communication connection.

[0213] Step 1801: Adjust the display data of the projection area based on its own resolution, and display the adjusted display data of the projection area.

[0214] As an optional implementation, the display data of the adjusted projection area includes:

[0215] Receive full-screen display data sent by a first device, wherein the full-screen display data is obtained by recording the display screen of the display area of ​​the first device;

[0216] Based on the location information of the projection area, determine the display data of the projection area in the full-screen display data, and move the display data of the projection area to the display area for display.

[0217] As an optional implementation, the adjustment of the display data of the projection area based on its own resolution includes:

[0218] After aligning the center of the projection area with the center of the display area, scale the displayed data in the projection area until the width of the scaled data reaches the width of the display area, or the height of the scaled data reaches the height of the display area; or,

[0219] Align a vertex corresponding to the position of the projection area with the vertex in the display area, and scale the display data of the projection area until the diagonal vertex of the projection area and the vertex in the display area are aligned, then stop scaling.

[0220] As an optional implementation, the method further includes:

[0221] In response to a user's touch command on the display data of the second device, the touch command is sent to the first device, which converts the touch command into a touch command that matches its own resolution, and performs the operation indicated by the touch command for the sub-area corresponding to the touch command.

[0222] As an optional implementation, before sending the touch command to the first device, the method further includes:

[0223] The touch position of the touch command is calibrated, and the calibrated touch command is sent to the first device.

[0224] As an optional implementation, the closer the touch position is to the center of the display area of ​​the second device, the less the calibration degree of the touch position.

[0225] As an optional implementation, calibrating the touch position of the touch command includes:

[0226] Determine the target resolution for the adjusted display data based on the resolution of the projection area and your own resolution.

[0227] The touch position of the touch command is calibrated based on its own resolution and the target resolution.

[0228] As an optional implementation, calibrating the touch position of the touch command based on its own resolution and the target resolution includes:

[0229] The offset reference value is determined based on the difference between its own resolution and the target resolution, and the calibration ratio is determined based on the ratio between the target resolution and its own resolution.

[0230] The display data, including the center coordinates at its own resolution and the target resolution, the offset reference value, and the calibration ratio, are used to calibrate the touch position of the touch command.

[0231] Based on the same inventive concept, this disclosure also provides a display device. Since the display device is the same as the display device in the method of this disclosure, and the principle of the display device in solving the problem is similar to that of the method, the implementation of the display device can refer to the implementation of the method, and the repeated parts will not be described again.

[0232] As shown in Figure 19, the display device includes a processor 1900 and a memory 1901. The memory 1901 is used to store programs executable by the processor 1900. The processor 1900 is used to read the programs in the memory 1901 and perform the following steps:

[0233] The projection area is determined, wherein the display area of ​​the first device includes multiple sub-areas, and the projection area includes a portion of the sub-areas within the multiple sub-areas;

[0234] The first device sends the display data of the projection area to the second device, which instructs the second device to adjust the display data of the projection area based on its own resolution, and displays the adjusted display data of the projection area; the first device and the second device establish a communication connection.

[0235] Based on the same inventive concept, this disclosure also provides a display device. Since the display device is the same as the display device in the method of this disclosure, and the principle of the display device in solving the problem is similar to that of the method, the implementation of the display device can refer to the implementation of the method, and the repeated parts will not be described again.

[0236] As shown in Figure 20, the display device includes a processor 2000 and a memory 2001. The memory 2001 is used to store programs executable by the processor 2000. The processor 2000 is used to read the programs in the memory 2001 and perform the following steps:

[0237] The device receives display data of the projection area sent by the first device. The display area of ​​the first device includes multiple sub-areas, and the projection area includes some sub-areas of the multiple sub-areas. The first device and the second device establish a communication connection.

[0238] Adjust the display data of the projection area based on its own resolution, and display the adjusted display data of the projection area.

[0239] Based on the same inventive concept, this disclosure also provides a device for displaying data sharing. Since this device is the same as the device in the method of this disclosure, and the principle of the device in solving the problem is similar to that of the method, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be described again.

[0240] As shown in Figure 21, the device includes:

[0241] The area determination module 2100 is used to determine the projection area. The display area of ​​the first device includes multiple sub-areas, and the projection area includes some sub-areas among the multiple sub-areas.

[0242] The area projection module 2101 is used to send the display data of the projection area to the second device, and to instruct the second device to adjust the display data of the projection area based on its own resolution, and to display the adjusted display data of the projection area; the first device and the second device establish a communication connection.

[0243] Based on the same inventive concept, this disclosure also provides a device for displaying data sharing. Since this device is the same as the device in the method of this disclosure, and the principle of the device in solving the problem is similar to that of the method, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be described again.

[0244] As shown in Figure 22, the device includes:

[0245] The data receiving module 2200 is used to receive display data of the projection area sent by the first device. The display area of ​​the first device includes multiple sub-areas, and the projection area includes some sub-areas of the multiple sub-areas. The first device and the second device establish a communication connection.

[0246] The screen projection adjustment module 2201 is used to adjust the display data of the projection area based on its own resolution and display the adjusted display data of the projection area.

[0247] Based on the same inventive concept, this disclosure provides a computer storage medium comprising: computer program code, which, when executed on a computer, causes the computer to perform any of the display data sharing methods described above. Since the principle by which the computer storage medium solves the problem is similar to that of the display data sharing method, the implementation of the computer storage medium can be found in the implementation of the method, and repeated details will not be elaborated further.

[0248] In specific implementation, computer storage media can include: Universal Serial Bus Flash Drive (USB), portable hard drive, Read-Only Memory (ROM), Random Access Memory (RAM), magnetic disk or optical disk, and other storage media that can store program code.

[0249] Based on the same inventive concept, this disclosure also provides a computer program product, which includes computer program code that, when executed on a computer, causes the computer to perform any of the display data sharing methods discussed above. Since the principle by which the above computer program product solves the problem is similar to that of the display data sharing method, the implementation of the above computer program product can be referred to the implementation of the method, and repeated details will not be elaborated further.

[0250] Computer program products may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0251] Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, systems, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0252] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, display devices (systems), and computer program products according to embodiments of this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing display device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing display device, create a display device for implementing the functions specified in one or more flowchart illustrations and / or one or more block diagrams.

[0253] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing display device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including an instruction display device that implements the functions specified in one or more flowcharts and / or one or more block diagrams.

[0254] These computer program instructions may also be loaded onto a computer or other programmable data processing display device to cause a series of operational steps to be performed on the computer or other programmable display device to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable display device, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0255] Obviously, those skilled in the art can make various modifications and variations to this disclosure without departing from its spirit and scope. Therefore, if such modifications and variations fall within the scope of the claims of this disclosure and their equivalents, this disclosure is also intended to include such modifications and variations.

Claims

1. A method for displaying data sharing, wherein, The method comprises: The first device determines a projection area, the display area of the first device comprises a plurality of sub-areas, and the projection area comprises part of the sub-areas; The first device sends display data of the projection area to the second device, and the first device and the second device have established a communication connection; The second device adjusts the display data of the projection area based on its own resolution and displays the adjusted display data of the projection area.

2. The method of claim 1, wherein, The first device determines the projection area, comprising: The first device receives sub-area information indicated by a user and determines the projection area according to the sub-area information; the sub-area information represents position information of a sub-area in the display area of the first device.

3. The method of claim 1, wherein, The first device determines the display data of the projection area in the following manner: The first device records a display picture of the projection area, and determines the recorded display data as the display data of the projection area; Or, The first device records a display picture of the display area, clips the recorded full-screen display data according to the position information of the projection area, and determines the clipped display data as the display data of the projection area.

4. The method of claim 3, wherein, The first device records a display picture of the projection area, comprising: The first device sets a recording area according to the position information of the projection area through a screen recording interface of an Android native layer, and records a display picture of the recording area.

5. The method of claim 1, wherein, The second device displays the adjusted display data of the projection area, comprising: The second device receives full-screen display data sent by the first device, the full-screen display data being recorded from a display picture of the display area of the first device; The second device determines display data of the projection area in the full-screen display data according to the position information of the projection area, and displays the display data of the projection area in the display area of the second device.

6. The method of claim 1, wherein, The second device adjusts the display data of the projection area based on its own resolution, comprising: The second device aligns the center of the projection area with the center of its own display area, and then scales the display data of the projection area until the width of the scaled display data reaches the width of the display area of the second device, or the height of the scaled display data reaches the height of the display area of the second device; or The second device aligns one vertex corresponding to a position in the projection area with one vertex in its own display area, and then scales the display data of the projection area until the diagonal vertex of the one vertex in the projection area aligns with the diagonal vertex of the one vertex in its own display area.

7. The method of claim 1, wherein, The method further comprises: In response to a touch instruction of a user on the display data of the second device, the second device sends the touch instruction to the first device; The first device converts the touch instruction into a touch instruction matched with its own resolution, and executes an operation indicated by the touch instruction on a sub-area corresponding to the touch instruction.

8. The method of claim 7, wherein, Before the second device sends the touch instruction to the first device, the method further comprises: The second device calibrates a touch position of the touch instruction, and sends the calibrated touch instruction to the first device.

9. The method of claim 8, wherein, The closer the touch position is to the center of the display area of the second device, the smaller the calibration degree of the touch position.

10. The method of claim 8, wherein, The second device calibrates the touch position of the touch instruction, comprising: The second device determines a target resolution of the adjusted display data according to a resolution of the screen mirroring area and a resolution of the second device; The second device calibrates the touch position of the touch instruction according to the resolution of the second device and the target resolution.

11. The method of claim 10, wherein, The second device calibrates the touch position of the touch instruction according to the resolution of the second device and the target resolution, including: The second device determines an offset reference value according to a difference between the resolution of the second device and the target resolution, and determines a calibration ratio according to a ratio between the target resolution and the resolution of the second device; The second device calibrates the touch position of the touch instruction according to the center coordinates of the display data under the resolution of the second device and the target resolution, the offset reference value and the calibration ratio.

12. The method of claim 7, wherein, The first device converts the touch instruction into a touch instruction matched with the resolution of the first device, including: The first device determines a target resolution of display data displayed by the second device, and converts the touch instruction into a touch instruction matched with the resolution of the first device according to a ratio between the resolution of the first device and the target resolution.

13. A method of displaying data sharing, wherein, The method applied to the first device, including: determining a screen mirroring area, the display area of the first device including a plurality of sub-areas, the screen mirroring area including part of the plurality of sub-areas; sending display data of the screen mirroring area to the second device, for instructing the second device to adjust the display data of the screen mirroring area based on a resolution of the second device, and display adjusted display data of the screen mirroring area; the first device and the second device having a communication connection established.

14. A method of displaying data sharing, wherein, The method applied to the second device, including: receiving display data of the screen mirroring area sent by the first device, the display area of the first device including a plurality of sub-areas, the screen mirroring area including part of the plurality of sub-areas; the first device and the second device having a communication connection established; adjusting the display data of the screen mirroring area based on a resolution of the second device, and displaying adjusted display data of the screen mirroring area.

15. A display device, wherein, The display device includes a processor and a memory, the memory being used to store programs executable by the processor, and the processor being used to read the programs in the memory and execute the steps of the method of claim 13 or 14.

16. A non-transitory computer storage medium having stored thereon a computer program, wherein, The program is executed by the processor to implement the steps of the method of any one of claims 1-14.

Images