Remote screen switching method and apparatus, and client terminal and storage medium

Abstract

The present application is applicable to the technical field of computers. Provided are a remote screen switching method and apparatus, and a client terminal and a storage medium. The method is applied to a client of airviewer, and the method comprises: determining a screen to be switched of a payment terminal; using a virtual display technique to create an initial screen; by means of a data frame monitor, determining the current display image of the screen to be switched; and sending the initial screen and the current display image to a platform terminal, and instructing the platform terminal to display the initial screen and display the current display image on the initial screen. Compared with the prior art, the method can realize the remote switching of different screens, and can also monitor, by means of a data frame monitor, in real time an image displayed on a screen to be switched, so as to implement the reproduction of real-time states of different screens of a payment terminal, thereby improving the accuracy of remote control over the different screens.

Description

Remote screen switching method, device, client terminal and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on December 15, 2023, with application number 202311737976.2, and entitled “A remote screen switching method, device, client terminal and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of computer technology, and in particular to a remote screen switching method, device, client terminal, and storage medium. Background Art

[0003] In actual applications, payment terminals, due to changes in usage scenarios, now have dual-screen devices for both merchants and customers, such as dual-screen terminals used for commodity checkout in supermarkets. Remote control or troubleshooting of these devices requires operating both screens simultaneously to save manpower. Therefore, it is necessary to switch between the two screens when using a remote application (airviewer), monitor the current status of the payment terminal in real time, and fully reproduce the actual problem encountered by the customer to facilitate faster problem resolution. However, current related technologies are difficult to meet actual needs and cannot achieve remote switching between different screens, which reduces the accuracy of remote control of different screens. Summary of the Invention

[0004] The embodiments of the present application provide a remote screen switching method, device, client terminal and storage medium, which improve the accuracy of remote control of different screens.

[0005] In a first aspect, an embodiment of the present application provides a remote screen switching method, which is applied to a client of a remote application, and the method includes:

[0006] Determine the screen to be switched to on the payment terminal;

[0007] Create splash screens using virtual display technology;

[0008] Determine the current display image of the screen to be switched through a data frame listener;

[0009] The initial screen and the currently displayed image are sent to the platform terminal to instruct the platform terminal to display the initial screen and to display the currently displayed image on the initial screen.

[0010] Optionally, determining the screen to be switched to on the payment terminal includes:

[0011] receiving a screen switching request sent by the platform terminal; the screen switching request carries a screen identifier;

[0012] The screen corresponding to the screen identifier is determined as the screen to be switched.

[0013] Optionally, before receiving the screen switching request sent by the platform terminal, the method further includes:

[0014] Determining the number of screens of the payment terminal;

[0015] The screen number is sent to the platform terminal to instruct the platform terminal to generate a corresponding screen switching control according to the screen number, and after detecting that the screen switching control is triggered, the platform terminal sends the screen switching request to the client terminal.

[0016] Optionally, the creating the initial screen by using virtual display technology includes:

[0017] Obtaining the screen size of the screen to be switched;

[0018] Using the virtual display technology, initializing the rectangle class based on the screen size to obtain a content rectangle at the screen size;

[0019] The initial screen is created according to the screen identifier and the content rectangle.

[0020] Optionally, sending the currently displayed image to the platform terminal includes:

[0021] Determining pixel formats and pixel data of all pixels in the currently displayed image;

[0022] Performing format conversion on the pixel formats and pixel data of all the pixels to obtain a binary data stream corresponding to the currently displayed image;

[0023] The binary data stream is sent to the platform terminal.

[0024] Optionally, after sending the initial screen and the currently displayed image to the platform terminal, the method further includes:

[0025] When a change in the display image of the to-be-switched screen is detected through the data frame listener, acquiring the changed display image;

[0026] The changed display image is sent to the platform terminal to instruct the platform terminal to replace the current display image with the changed display image.

[0027] Optionally, after sending the initial screen and the currently displayed image to the platform terminal, the method further includes:

[0028] Receiving a screen operation instruction sent by the platform terminal; the screen operation instruction carries a target operation, screen coordinates corresponding to the target operation, and a screen zoom ratio;

[0029] determining, according to the screen coordinates and the screen zoom ratio, actual coordinates of the target operation on the screen to be switched;

[0030] Generate a simulated click event according to the target operation and the actual coordinates;

[0031] The simulated click event is sent to the payment terminal to instruct the payment terminal to execute the simulated click event on the screen to be switched.

[0032] In a second aspect, an embodiment of the present application provides a remote screen switching device, which is applied to a client of a remote application, and the device includes:

[0033] a first determining unit, configured to determine a screen to be switched to on the payment terminal;

[0034] A first creating unit, configured to create an initial screen using a virtual display technology;

[0035] A second determining unit, configured to determine the current display image of the to-be-switched screen through a data frame listener;

[0036] The first sending unit is configured to send the initial screen and the currently displayed image to the platform terminal, so as to instruct the platform terminal to display the initial screen and the currently displayed image on the initial screen.

[0037] In a third aspect, an embodiment of the present application provides a client terminal comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the remote screen switching method as described in any one of the first aspects above is implemented.

[0038] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the remote screen switching method as described in any one of the above-mentioned first aspects is implemented.

[0039] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a client terminal, enables the client terminal to execute the remote screen switching method described in any one of the above-mentioned first aspects.

[0040] In a sixth aspect, an embodiment of the present application provides a remote screen switching system, comprising a payment terminal, a platform terminal, and a client terminal as described in the third aspect.

[0041] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0042] The embodiment of the present application provides a remote screen switching method, which is applied to the client of a remote application, by determining the screen to be switched of the payment terminal; creating an initial screen using virtual display technology; determining the current display image of the screen to be switched through a data frame listener; sending the initial screen and the current display image to the platform terminal to instruct the platform terminal to display the initial screen and display the current display image on the initial screen. Compared with the existing technology, this method can not only realize the remote switching of different screens, but also monitor the image displayed on the screen to be switched in real time through the data frame listener to complete the reproduction of the real-time status of different screens on the payment terminal, thereby improving the accuracy of remote control of different screens. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0044] FIG1 is a schematic structural diagram of a remote screen switching system provided in an embodiment of the present application.

[0045] FIG2 is a schematic structural diagram of a remote screen switching system provided in another embodiment of the present application.

[0046] FIG3 is a flowchart of an implementation of a remote screen switching method provided in an embodiment of the present application.

[0047] FIG4 is a flowchart of an implementation of a remote screen switching method provided in another embodiment of the present application.

[0048] FIG5 is a flowchart of an implementation of a remote screen switching method provided in yet another embodiment of the present application.

[0049] FIG6 is a flowchart of an implementation of a remote screen switching method provided in another embodiment of the present application.

[0050] FIG7 is a flowchart of an overall implementation of a remote screen switching method provided in an embodiment of the present application.

[0051] FIG8 is a schematic structural diagram of a remote screen switching device provided in an embodiment of the present application.

[0052] FIG9 is a schematic structural diagram of a client terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0054] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0055] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0056] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0057] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0058] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0059] It should be noted that in all embodiments of the present application, the client of the remote application can run on the payment terminal and the platform terminal, or the client of the remote application can run on other terminals independent of the payment terminal and the platform terminal, such as the client terminal.

[0060] Please refer to Figure 1, which is a schematic diagram of the structure of a remote screen switching system provided in one embodiment of the present application. As shown in Figure 1, the remote screen switching system 1 includes: a payment terminal 10, a client terminal 20, and a platform terminal 30. The client terminal 20 is wirelessly connected to the payment terminal 10 and the platform terminal, respectively.

[0061] In practical applications, the payment terminal 10 is a hardware device of a payment system.

[0062] The client terminal is equipped with a remote application (airviewer). Client terminals include but are not limited to laptops, desktop computers and other devices.

[0063] The platform terminal is also equipped with a remote application (airviewer). The platform terminal includes but is not limited to notebooks, desktop computers and computers.

[0064] In one embodiment of the present application, to reduce costs, please refer to Figure 2, which is a schematic diagram of the structure of a remote screen switching system provided in another embodiment of the present application. As shown in Figure 2, the remote screen switching system 1 includes a payment terminal 10 and a platform terminal 30. The payment terminal 10 includes a remote application 11, and the platform terminal 30 includes a remote application 31.

[0065] Therefore, in this embodiment, the payment terminal 10 and the platform terminal 30 can specifically implement the remote screen switching method corresponding to any one of the following embodiments through the remote application 11 and the remote application 31.

[0066] The following describes the remote screen switching method in detail by taking the remote application client running on the client terminal as an example.

[0067] It should be noted that the specific process of how the remote application client runs on the payment terminal and the platform terminal to implement the remote screen switching method is the same as the process of how the remote application client runs on the client terminal, and will not be repeated here.

[0068] Please refer to Figure 3, which is a flowchart of a remote screen switching method provided by an embodiment of the present application. In the embodiment of the present application, the execution subject of the remote screen switching method is a client terminal.

[0069] As shown in FIG3 , the remote screen switching method provided in one embodiment of the present application may include S101 to S104 , which are described in detail as follows:

[0070] In S101 , a screen to be switched of the payment terminal is determined.

[0071] In an embodiment of the present application, when a payment terminal includes multiple display screens, in order to remotely switch between different screens of the payment terminal in real time, the user can trigger a preset operation for the platform terminal, causing the platform terminal to generate a screen switching request based on the preset operation and transmit the screen switching request to the client terminal. The preset operation can be set according to actual needs and is not limited here.

[0072] Based on this, the client terminal may receive the screen switching request sent by the platform terminal, and determine the screen to be switched of the payment terminal according to the screen switching request.

[0073] In one embodiment of the present application, the client terminal may specifically determine the screen switching request of the payment terminal through steps S201 to S202 as shown in FIG4 , as detailed below:

[0074] In S201, a screen switching request sent by the platform terminal is received; the screen switching request carries a screen identifier.

[0075] In one embodiment of the present application, in order to ensure that the client terminal can accurately determine the screen to be switched to the payment terminal, the client terminal may further perform steps S301 to S302 as shown in FIG5 before receiving the screen switching request sent by the platform terminal, as detailed below:

[0076] In S301 , the number of screens of the payment terminal is determined.

[0077] In one implementation of this embodiment, the client terminal may obtain the screen number of the payment terminal in real time through the payment terminal to which the client terminal is wirelessly connected.

[0078] In one embodiment of the present application, the client terminal may also obtain screen identifiers corresponding to different screens in the payment terminal, wherein the screen identifiers include but are not limited to serial numbers and serial numbers.

[0079] In S302, the screen number is sent to the platform terminal to instruct the platform terminal to generate a corresponding screen switching control according to the screen number, and after detecting that the screen switching control is triggered, the platform terminal sends the screen switching request to the client terminal.

[0080] In this embodiment, after obtaining the screen number of the payment terminal, the client terminal may send the screen number to the platform terminal.

[0081] In combination with S301 , in some possible embodiments, the client terminal may further send screen identifiers corresponding to different screens to the platform terminal.

[0082] After receiving the number of screens, the platform terminal can determine the screen identifiers corresponding to different screens according to a preset rule, and store the different screens in association with the different screen identifiers.

[0083] In some other possible embodiments, in combination with S301 to S302 , the platform terminal may directly store the received screen identification.

[0084] After receiving the number of screens, the platform terminal can detect whether the number of screens is greater than 1.

[0085] When the platform terminal detects that the number of screens is greater than 1, it can generate a screen switching control and display the screen switching control on its own display interface.

[0086] Based on this, when the user needs to switch screens remotely, he can click the above screen switching control.

[0087] When the platform terminal detects that the screen switching control is clicked, it can determine the screen identifier of the screen that needs to be switched, and generate a screen switching request according to the screen identifier.

[0088] Afterwards, the platform terminal may send the screen switching request to the client terminal.

[0089] Based on this, the client terminal can receive the screen switching request sent by the platform terminal.

[0090] In S202, the screen corresponding to the screen identifier is determined as the screen to be switched.

[0091] In this embodiment, the client terminal can extract the screen identifier from the received screen switching request, and determine the screen corresponding to the screen identifier extracted from the screen switching request based on the screen identifier and the pre-stored correspondence between different screens and different screen identifiers in the payment terminal, and determine the screen as the screen to be switched.

[0092] Specifically, the client terminal may compare the screen identifier carried in the received screen switching request with the different screen identifiers in the pre-stored correspondence between different screens and different screen identifiers in the payment terminal one by one, determine the screen identifier in the above correspondence that is the same as the screen identifier carried in the received screen switching request, and then determine the screen corresponding to the screen identifier carried in the received screen switching request based on the above correspondence.

[0093] In S102 , an initial screen is created using virtual display technology.

[0094] In the embodiment of the present application, after the client terminal determines the screen to be switched, the client terminal can use the virtual display technology of the Android system to create an initial screen corresponding to the screen to be switched.

[0095] Specifically, in combination with S201 to S202, the client terminal can create an initial screen according to the following steps, which are detailed as follows:

[0096] Obtaining the screen size of the screen to be switched;

[0097] Using the virtual display technology, initializing the rectangle class based on the screen size to obtain a content rectangle at the screen size;

[0098] The initial screen is created according to the screen identifier and the content rectangle.

[0099] In one implementation of this embodiment, the client terminal can determine the screen size of the screen to be switched through the payment terminal to which it is wirelessly connected, wherein the screen size includes but is not limited to the width and height of the screen to be switched.

[0100] In this embodiment, after obtaining the screen size of the screen to be switched, the client terminal can use the virtual display technology of the Android system to initialize the rectangle class Rect based on the screen size to obtain a content rectangle that is consistent with the screen size of the screen to be switched.

[0101] Afterwards, the client terminal can continue to use the Android system's virtual display technology to initialize the SurfaceComposerClient object in the Android system, call the createDisplay method of SurfaceComposerClient to create a virtual display, and determine the real screen layer of the payment terminal targeted by the virtual display based on the screen identifier, that is, the screen to be switched. Afterwards, the client terminal can generate the initial screen corresponding to the screen to be switched based on the content rectangle determined above.

[0102] In S103, the current display image of the screen to be switched is determined through a data frame monitor.

[0103] In an embodiment of the present application, the client terminal can call the createBufferQueue method of the BufferQueue in the Android system, and use the IGraphicBufferProducer object in the Android system and the IGraphicBufferConsumer object in the Android system as the producer and consumer of the buffer queue to create a buffer queue. Afterwards, the client terminal can create a CpuConsumer object, associate the previously created IGraphicBufferConsumer object with it, and call the setFrameAvailableListener of the CpuConsumer object to set the data frame listener. The data frame listener can monitor in real time whether the screen graphic data displayed on the screen to be switched in the payment terminal has changed. After the data frame listener detects that the screen graphic data displayed on the screen to be switched in the payment terminal has changed, the Android system will send the changed screen graphic data to the client terminal through the monitoring event and the buffer queue in its encapsulated data structure.

[0104] Based on this, the client terminal can determine the current display image of the screen to be switched through the data frame monitor.

[0105] In S104, the initial screen and the currently displayed image are sent to the platform terminal to instruct the platform terminal to display the initial screen and to display the currently displayed image on the initial screen.

[0106] In an embodiment of the present application, after acquiring the currently displayed image, the client terminal may send the initial screen and the currently displayed image to the platform terminal.

[0107] In one embodiment of the present application, the client terminal may specifically perform step S104 according to the following steps, which are described in detail as follows:

[0108] Determining pixel formats and pixel data of all pixels in the currently displayed image;

[0109] Performing format conversion on the pixel formats and pixel data of all the pixels to obtain a binary data stream corresponding to the currently displayed image;

[0110] The binary data stream is sent to the platform terminal.

[0111] In practical applications, pixel format refers to the format used to store pixel data and defines how pixels are encoded in memory.

[0112] Pixel data includes, but is not limited to, the color and brightness of each pixel.

[0113] In this embodiment, the client terminal may convert the pixel format and pixel data of all pixels in the currently displayed image to obtain a binary data stream that is easy to transmit, and send the binary data stream to the platform terminal.

[0114] After obtaining the above binary data stream, the platform terminal can convert the binary data stream to obtain the pixel format and pixel data of all pixels in the above current display image, and restore the current display image according to the pixel format and pixel data of all pixels.

[0115] Afterwards, after receiving the initial screen and the current display image sent by the client terminal, the platform terminal may display the initial screen on its own display interface and display the current display image on the displayed initial screen.

[0116] From the above, it can be seen that the remote screen switching method provided by the embodiment of the present application is applied to the client of the remote application, by determining the screen to be switched of the payment terminal; creating the initial screen using virtual display technology; determining the current display image of the screen to be switched through a data frame listener; sending the initial screen and the current display image to the platform terminal to instruct the platform terminal to display the initial screen and display the current display image on the initial screen. Compared with the existing technology, this method can not only realize the remote switching of different screens, but also monitor the image displayed on the screen to be switched in real time through the data frame listener to complete the reproduction of the real-time status of different screens on the payment terminal, thereby improving the accuracy of remote control of different screens.

[0117] Please refer to FIG6 , which is a remote screen switching method provided by another embodiment of the present application. Compared with the embodiment corresponding to FIG1 , this embodiment may further include S401 to S404 after S104 , as detailed below:

[0118] In S401, a screen operation instruction sent by the platform terminal is received; the screen operation instruction carries a target operation, screen coordinates corresponding to the target operation, and a screen zoom ratio.

[0119] In this embodiment, after the platform terminal displays the initial screen corresponding to the screen to be switched and the currently displayed image, when the platform terminal detects that the user performs a target operation on the initial screen (such as clicking on an area in the initial screen), the platform terminal can determine the screen coordinates corresponding to the target operation based on the area corresponding to the target operation performed by the user.

[0120] It should be noted that after receiving the initial screen, the platform terminal may adjust the size of the initial screen to suit the size of the platform terminal's display interface and improve the user experience. Based on this, in order to improve the accuracy of controlling the screen to be switched to by the payment terminal, the platform terminal may determine the screen scaling ratio of the initial screen on the platform terminal.

[0121] In some possible embodiments, the platform terminal may determine the ratio between the adjusted size of the initial screen and the screen size of the screen to be switched as the screen zoom ratio of the initial screen on the platform terminal.

[0122] Based on this, the platform terminal can generate a screen operation instruction according to the above target operation, the screen coordinates corresponding to the target operation, and the screen zoom ratio, and send the screen operation instruction to the client terminal.

[0123] The client terminal may receive the screen operation instruction sent by the platform terminal, and extract the target operation, the screen coordinates corresponding to the target operation, and the screen zoom ratio from the screen operation instruction.

[0124] In S402 , actual coordinates of the target operation on the screen to be switched are determined according to the screen coordinates and the screen zoom ratio.

[0125] In S403, a simulated click event is generated according to the target operation and the actual coordinates.

[0126] In S404, the simulated click event is sent to the payment terminal to instruct the payment terminal to execute the simulated click event on the screen to be switched.

[0127] In this embodiment, after obtaining the target operation, the screen coordinates corresponding to the target operation, and the screen zoom ratio, the client terminal can determine the actual coordinates of the screen to be switched on the payment terminal targeted by the target operation based on the screen coordinates and the screen zoom ratio.

[0128] Afterwards, the client terminal may generate a simulated click event according to the above time coordinates and target operation, and send the simulated click event to the payment terminal.

[0129] After receiving the simulated click event, the payment terminal can extract the target operation and the actual coordinates of the screen to be switched from the simulated click event. Thereafter, the payment terminal can perform the target operation at the actual coordinates of the screen to be switched.

[0130] As can be seen above, the remote screen switching method provided in this embodiment receives a screen operation instruction sent by a platform terminal; the screen operation instruction carries the screen coordinates corresponding to the target operation and the screen zoom ratio; based on the screen coordinates and screen zoom ratio, the actual coordinates of the target operation on the screen to be switched are determined; based on the target operation and the actual coordinates, a simulated click event is generated; and the simulated click event is sent to the payment terminal, instructing the payment terminal to execute the simulated click event on the screen to be switched. This method can remotely perform various operations on the screen of the payment terminal, thereby achieving real-time remote control of the screen in the payment terminal.

[0131] In another embodiment of the present application, in order to determine the status of the screen to be switched on the payment terminal in real time, after step S104, the client terminal may further perform the following steps, which are detailed as follows:

[0132] When a change in the display image of the to-be-switched screen is detected through the data frame listener, acquiring the changed display image;

[0133] The changed display image is sent to the platform terminal to instruct the platform terminal to replace the current display image with the changed display image.

[0134] In this embodiment, when the state of the screen to be switched on the payment terminal changes, the display image on the screen to be switched will also change to a certain extent. At the same time, since the data frame listener monitors the display image of the screen to be switched in real time, when the client terminal monitors the change of the display image of the screen to be switched through the data frame listener, in order to facilitate the user at the platform terminal to determine the state of the screen to be switched in real time, the client terminal can obtain the changed display image of the screen to be switched.

[0135] Afterwards, the client terminal can convert the pixel format and pixel data of all pixels in the changed display image to obtain a binary data stream that is easy to transmit, and send the binary data stream to the platform terminal, that is, send the changed display image to the platform terminal.

[0136] After obtaining the above binary data stream, the platform terminal can convert the binary data stream to obtain the pixel format and pixel data of all pixels in the above changed display image, and restore the changed display image according to the pixel format and pixel data of all pixels.

[0137] Afterwards, the platform terminal may replace the current display image displayed on the initial screen with the changed display image, that is, display the changed display image on the initial screen.

[0138] Please refer to Figure 7, which is an overall implementation flow chart of the remote screen switching method provided by an embodiment of the present application. As shown in Figure 7, when implementing remote switching of different screens of the payment terminal, the client terminal can send a screen number acquisition request to the payment terminal, as shown in step S501 in Figure 7; thereafter, the payment terminal can receive the screen number acquisition request sent by the client terminal, as shown in step S502 in Figure 7, and determine its own screen number; thereafter, the payment terminal can send the screen number to the client terminal, as shown in step S503 in Figure 7; thereafter, the client terminal can receive the screen number sent by the payment terminal, as shown in step S504 in Figure 7, and send the screen number to the platform terminal, as shown in step S505 in Figure 7; thereafter, the platform terminal can generate and display a screen switching control according to the screen number, as shown in step S506 in Figure 7; the user at the platform terminal can remotely switch the payment terminal by clicking the screen switching control. Based on this, the user can send a screen switching request to the platform terminal, as shown in step S507 of Figure 7; thereafter, the platform terminal can receive the screen switching request sent by the user, as shown in step S508 of Figure 7; thereafter, the platform terminal can send the screen switching request to the client terminal, as shown in step S509 of Figure 7; thereafter, the client terminal can receive the screen switching request, as shown in step S5010 of Figure 7; thereafter, the client terminal can determine the screen corresponding to the screen identifier as the screen to be switched, as shown in step S5011 of Figure 7; thereafter, the client terminal can create an initial screen by using virtual display technology, as shown in step S5012 of Figure 7; wherein, the specific process of how the client terminal creates the initial screen by using virtual display technology can refer to the embodiment corresponding to Figure 3, which will not be elaborated here.

[0139] Afterwards, the client terminal can register a data monitoring event with the screen to be switched of the payment terminal, as shown in step S5013 in Figure 7, to monitor in real time whether the display image on the screen to be switched sends changes; afterward, the client terminal can obtain the current display image of the screen to be switched through the data frame listener, as shown in step S5014 in Figure 7; afterward, the client terminal can send the initial screen and the current display image to the platform terminal, as shown in step S5015 in Figure 7; among them, the specific process of how the client terminal sends the current display image to the platform terminal can be referred to the embodiment corresponding to Figure 3, and will not be repeated here.

[0140] Finally, the platform terminal may receive and display the initial screen and the current display image, as shown in step S5016 of FIG. 7 .

[0141] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0142] Corresponding to the remote screen switching method described in the above embodiment, FIG8 shows a schematic diagram of the structure of a remote screen switching device provided by an embodiment of the present application. For ease of explanation, only the parts relevant to the embodiment of the present application are shown. Referring to FIG8 , the remote screen switching device 800 includes: a first determination unit 81, a first creation unit 82, a second determination unit 83, and a first sending unit 84. Among them:

[0143] The first determining unit 81 is configured to determine a screen to be switched on the payment terminal.

[0144] The first creating unit 82 is configured to create an initial screen using a virtual display technology.

[0145] The second determining unit 83 is configured to determine the current display image of the to-be-switched screen through a data frame monitor.

[0146] The first sending unit 84 is configured to send the initial screen and the currently displayed image to the platform terminal, so as to instruct the platform terminal to display the initial screen and to display the currently displayed image on the initial screen.

[0147] In one embodiment of the present application, the first determining unit 81 specifically includes: a first receiving unit and a second determining unit.

[0148] in:

[0149] The first receiving unit is configured to receive a screen switching request sent by the platform terminal; the screen switching request carries a screen identifier.

[0150] The second determining unit is configured to determine the screen corresponding to the screen identifier as the screen to be switched.

[0151] In one embodiment of the present application, the remote screen switching device 800 further includes: a third determining unit and a second sending unit.

[0152] in:

[0153] The third determining unit is configured to determine the number of screens of the payment terminal.

[0154] The second sending unit is used to send the screen number to the platform terminal to instruct the platform terminal to generate a corresponding screen switching control according to the screen number, and after detecting that the screen switching control is triggered, the platform terminal sends the screen switching request to the client terminal.

[0155] In one embodiment of the present application, the first creation unit 82 specifically includes: a first acquisition unit, an initialization unit, and a second creation unit.

[0156] The first acquiring unit is configured to acquire the screen size of the screen to be switched.

[0157] The initialization unit is used to utilize the virtual display technology to perform an initialization operation on the rectangle class based on the screen size to obtain a content rectangle under the screen size.

[0158] The second creating unit is configured to create the initial screen according to the screen identifier and the content rectangle.

[0159] In one embodiment of the present application, the first sending unit 84 specifically includes: a fourth determining unit, a converting unit, and a second sending unit.

[0160] The fourth determining unit is configured to determine the pixel format and pixel data of all pixels in the currently displayed image.

[0161] The conversion unit is used to perform format conversion on the pixel formats and pixel data of all the pixels to obtain a binary data stream corresponding to the currently displayed image.

[0162] The second sending unit is used to send the binary data stream to the platform terminal.

[0163] In one embodiment of the present application, the remote screen switching device 800 further includes: a second acquiring unit and a third sending unit.

[0164] in:

[0165] The second acquiring unit is configured to acquire the changed display image when a change in the display image of the to-be-switched screen is detected through the data frame listener.

[0166] The third sending unit is configured to send the changed display image to the platform terminal to instruct the platform terminal to replace the current display image with the changed display image.

[0167] In one embodiment of the present application, the remote screen switching device 800 further includes: a second receiving unit, a fifth determining unit, a generating unit, and a fourth sending unit.

[0168] The second receiving unit is used to receive a screen operation instruction sent by the platform terminal; the screen operation instruction carries a target operation, screen coordinates corresponding to the target operation, and a screen zoom ratio.

[0169] The fifth determining unit is configured to determine actual coordinates of the target operation on the screen to be switched according to the screen coordinates and the screen zoom ratio.

[0170] The generating unit is used to generate a simulated click event according to the target operation and the actual coordinates.

[0171] The fourth sending unit is configured to send the simulated click event to the payment terminal to instruct the payment terminal to execute the simulated click event on the screen to be switched.

[0172] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0173] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0174] FIG9 is a schematic diagram of the structure of a client terminal provided in one embodiment of the present application. As shown in FIG9 , the client terminal 9 of this embodiment includes: at least one processor 90 (only one is shown in FIG9 ), a memory 91, and a computer program 92 stored in the memory 91 and executable on the at least one processor 90. When the processor 90 executes the computer program 92, it implements the steps of any of the aforementioned remote screen switching method embodiments.

[0175] The client terminal may include, but is not limited to, a processor 90 and a memory 91. Those skilled in the art will appreciate that FIG9 is merely an example of the client terminal 9 and does not limit the client terminal 9. The client terminal 9 may include more or fewer components than shown, or a combination of certain components, or different components. For example, the client terminal may also include input and output devices, network access devices, etc.

[0176] The processor 90 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. A general-purpose processor may be a microprocessor or any conventional processor.

[0177] In some embodiments, the memory 91 may be an internal storage unit of the client terminal 9, such as the memory of the client terminal 9. In other embodiments, the memory 91 may also be an external storage device of the client terminal 9, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the client terminal 9. Furthermore, the memory 91 may include both the internal storage unit of the client terminal 9 and an external storage device. The memory 91 is used to store an operating system, application programs, a boot loader, data, and other programs, such as the program code of the computer program. The memory 91 may also be used to temporarily store data that has been output or is about to be output.

[0178] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned various method embodiments can be implemented.

[0179] An embodiment of the present application provides a computer program product. When the computer program product runs on a client terminal, the client terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0180] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. Among them, the computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying the computer program code to the client terminal, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0181] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0182] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A remote screen switching method, characterized in that: Applied to a client of a remote application, the method comprises: Determine the screen to be switched to of the payment terminal; Create splash screens using virtual display technology; Determine the current display image of the screen to be switched through a data frame listener; The initial screen and the currently displayed image are sent to the platform terminal to instruct the platform terminal to display the initial screen and to display the currently displayed image on the initial screen.

2. The remote screen switching method according to claim 1, characterized in that: The step of determining the screen to be switched of the payment terminal includes: receiving a screen switching request sent by the platform terminal; the screen switching request carries a screen identifier; The screen corresponding to the screen identifier is determined as the screen to be switched.

3. The remote screen switching method according to claim 2, characterized in that: Before receiving the screen switching request sent by the platform terminal, the method further includes: determining the number of screens of the payment terminal; The screen number is sent to the platform terminal to instruct the platform terminal to generate a corresponding screen switching control according to the screen number, and after the platform terminal detects that the screen switching control is triggered, the screen switching request is sent to the client terminal.

4. The remote screen switching method according to claim 2, characterized in that: The method of creating the initial screen by using the virtual display technology includes: Obtaining the screen size of the screen to be switched; Using the virtual display technology, initializing the rectangle class based on the screen size to obtain a content rectangle at the screen size; The initial screen is created according to the screen identifier and the content rectangle.

5. The remote screen switching method according to claim 1, characterized in that: The sending the currently displayed image to the platform terminal includes: Determining pixel formats and pixel data of all pixels in the currently displayed image; Performing format conversion on the pixel formats and pixel data of all the pixels to obtain a binary data stream corresponding to the currently displayed image; The binary data stream is sent to the platform terminal.

6. The remote screen switching method according to claim 1, characterized in that: After sending the initial screen and the current display image to the platform terminal, the method further includes: When the data frame listener monitors that the display image of the to-be-switched screen changes, acquiring the changed display image; The changed display image is sent to the platform terminal to instruct the platform terminal to replace the current display image with the changed display image.

7. The remote screen switching method according to any one of claims 1 to 6, characterized in that: After sending the initial screen and the current display image to the platform terminal, the method further includes: Receiving a screen operation instruction sent by the platform terminal; the screen operation instruction carries a target operation, screen coordinates corresponding to the target operation, and a screen zoom ratio; Determining actual coordinates of the target operation on the screen to be switched according to the screen coordinates and the screen zoom ratio; Generate a simulated click event according to the target operation and the actual coordinates; The simulated click event is sent to the payment terminal to instruct the payment terminal to execute the simulated click event on the screen to be switched.

8. A remote screen switching device, characterized in that: Applied to a client of a remote application, the device comprises: A first determining unit, configured to determine a screen to be switched to the payment terminal; A first creating unit, configured to create an initial screen using a virtual display technology; A second determining unit, configured to determine the current display image of the to-be-switched screen through a data frame listener; The first sending unit is configured to send the initial screen and the currently displayed image to the platform terminal to instruct the platform terminal to display the initial screen and to display the currently displayed image on the initial screen.

9. A client terminal, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the remote screen switching method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the remote screen switching method according to any one of claims 1 to 7 is implemented.

Images