A method for controlling screen mirroring of a display screen, a display screen, and a storage medium

Abstract

This application belongs to the field of communication technologies, and particularly relates to a display screen screen mirroring control method, a display screen, and a storage medium. The method applies an operation equivalent conversion method to equivalent the operations of a user on the display screen to the screen mirroring end, enabling the screen mirroring end to execute corresponding software response actions. As a result, the user can directly control the software installed on the screen mirroring end on the display screen, eliminating the need for the user to simultaneously attend to operating the screen mirroring end and the display screen, thus greatly improving the convenience of the user for screen mirroring presentations.

Description

Technical Field

[0001] This application belongs to the field of communication technologies, and particularly relates to a method for controlling screen mirroring of a display screen, a display screen, and a storage medium. Background Art

[0002] Screen mirroring of a display screen is a technology for wirelessly transmitting the content on an electronic device (such as a mobile phone, a tablet computer, a computer, etc.) to a large screen for display, and it has a wide range of applications in various scenarios such as meetings and teaching;

[0003] However, currently, using an electronic device to perform screen mirroring on a display screen can only achieve the effect of screen mirroring, that is, only the content on the screen of the electronic device is displayed on the display screen, and to perform corresponding operations on the displayed page, the user still needs to execute them on the electronic device; but in application scenarios such as meetings and teaching where screen mirroring is used, the user needs to give corresponding instructions to the audience on the display screen. If operations on the displayed content are required at this time, the user needs to take into account operating both the display screen and the electronic device simultaneously, which is very inconvenient. Summary of the Invention

[0004] In view of this, embodiments of this application provide a method for controlling screen mirroring of a display screen, a display screen, and a storage medium, which can solve the above technical problems.

[0005] A first aspect of the embodiments of this application provides a method for controlling screen mirroring of a display screen, which is applied to a display screen. The method for controlling screen mirroring of the display screen includes:

[0006] S1: When receiving a screen mirroring signal from a screen mirroring end, identify whether the first page currently displayed on the screen mirroring end is a software page. If so, display the software page on the display screen;

[0007] S2: If the first page is not a software page, query the built-in software information of the screen mirroring end, where the built-in software information includes the software icons of all the built-in software of the screen mirroring end;

[0008] S3: After receiving the built-in software information sent by the screen mirroring end, generate a software bar on the display screen, and place each received software icon in the software bar;

[0009] S4: When it is recognized that the user clicks any software icon in the software bar, send the software icon to the screen mirroring end so that the screen mirroring end determines the software to be launched and launches the software;

[0010] S5: Display the software page of the launched software on the display screen;

[0011] S6: Determine the operations on the software page on the display screen, determine the equivalent operations corresponding to these operations on the screen mirroring terminal, control the screen mirroring terminal to execute the software response actions corresponding to the equivalent operations according to the equivalent operations, and display the software response actions on the software page on the display screen accordingly;

[0012] S7: Execute steps S6 to S7 until the software page is removed from the display screen after the user completes the software operations;

[0013] S8: Repeat steps S4 to S7 until a signal to end screen mirroring is received from the user.

[0014] In a second aspect of the embodiments of the present application, a display screen is provided, including a memory and a processor. A computer program is stored in the memory. When the computer program is executed by the processor, the processor is caused to execute the steps of the screen mirroring control method for the display screen.

[0015] In a third aspect of the embodiments of the present application, a storage medium is provided. A computer program is stored on the storage medium. When the computer program is executed by a processor, the processor is caused to execute the steps of the screen mirroring control method for the display screen.

[0016] The beneficial effects of the embodiments of the present application compared with the prior art are as follows: The method provided by the present invention includes when receiving a screen mirroring signal from the screen mirroring terminal, identifying whether the first page currently displayed on the screen mirroring terminal is a software page. If so, display the software page on the display screen; if the first page is not a software page, inquire about the built-in software information of the screen mirroring terminal; after receiving the built-in software information sent by the screen mirroring terminal, generate a software bar on the display screen, and place each received software icon in the software bar; when it is recognized that the user clicks any software icon in the software bar, send the software icon to the screen mirroring terminal so that the screen mirroring terminal determines the software to be started and starts the software; display the started software page on the display screen; determine the operations of the user on the software page on the display screen, determine the equivalent operations corresponding to these operations on the screen mirroring terminal, control the screen mirroring terminal to execute the software response actions corresponding to the equivalent operations according to the equivalent operations, and display the software response actions on the software page on the display screen accordingly; repeat the above steps until a signal to end screen mirroring is received from the user. In the present application, the method of operation equivalent conversion is applied to equivalent the operations of the user on the display screen to the screen mirroring terminal, so that the screen mirroring terminal can execute the corresponding software response actions, thereby enabling the user to directly control the software installed on the screen mirroring terminal on the display screen, without the user having to take into account the operations of both the screen mirroring terminal and the display screen at the same time, greatly improving the convenience of the user for screen mirroring presentations. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0018] Figure 1 It is a schematic flowchart of the implementation of the display screen mirroring control method provided by the embodiment of the present application;

[0019] Figure 2 It is a schematic diagram of the implementation environment of the display screen mirroring control method provided by the embodiment of the present application;

[0020] Figure 3 It is a schematic diagram of the coordinate system of the display screen mirroring control method provided by the embodiment of the present application;

[0021] Figure 4 It is a schematic diagram of the display screen provided by the embodiment of the present application. Detailed implementation manners

[0022] In the following description, for the purpose of illustration rather than limitation, specific details such as specific system structures and technologies are presented to thoroughly understand the embodiments of the present application. However, those skilled in the art should clearly understand that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from interfering with the description of the present application.

[0023] To illustrate the technical solutions described in the present application, the following will be described through specific embodiments.

[0024] Figure 1 There is shown a display screen mirroring control method provided in Embodiment 1 of the present application, which is applied to a display screen. The display screen mirroring control method includes:

[0025] S1: When receiving a mirroring signal from the mirroring end, identify whether the first page currently displayed on the mirroring end is a software page. If so, display the software page on the display screen;

[0026] S2: If the first page is not a software page, query the built-in software information of the mirroring end, where the built-in software information includes the software icons of all the built-in software of the mirroring end;

[0027] S3: After receiving the built-in software information sent by the mirroring end, generate a software bar on the display screen and place each received software icon in the software bar;

[0028] S4: When any software icon in the software bar is recognized as being clicked by the user, send the software icon to the screen mirroring end so that the screen mirroring end can determine the software to be launched and launch the software;

[0029] S5: Display the launched software page on the display screen;

[0030] S6: Determine the operations of the user on the software page on the display screen, determine the equivalent operations corresponding to these operations on the screen mirroring end, and control the screen mirroring end to execute the software response actions corresponding to the equivalent operations, and display the software response actions correspondingly on the software page on the display screen;

[0031] S7: Execute steps S6 to S7 until the software page is removed from the display screen after the user completes the software operations;

[0032] S8: Repeat steps S4 to S7 until a signal to end screen mirroring is received from the user.

[0033] In this embodiment, as Figure 2 shown, this method is executed on a display screen (such as a large LCD TV). The display screen can communicate with the screen mirroring end (the electronic device that sends screen mirroring). The screen mirroring end can be a mobile phone, a tablet computer, a laptop computer, a desktop computer, etc., which is not limited here; after the screen mirroring end mirrors the screen on the display screen, the display screen can interact with the screen mirroring end for information, thereby realizing the functions of this method.

[0034] In this embodiment, when a user conducts screen mirroring display, they often display the content of a certain software running on the screen mirroring device, such as a PPT, a video software, or other software. Therefore, when a software page has been opened on the screen mirroring device, the software page can be directly displayed. If no software is opened, due to the screen size limitations of some screen mirroring devices, their software is often arranged in multiple pages (such as on a mobile phone), and it is necessary to repeatedly search when opening the software. In this embodiment, all the software on the screen mirroring device can be placed therein by generating a software bar (the arrangement method and order are the same as those on the screen mirroring device), enabling the user to directly view all the built-in software on the screen mirroring device on the display screen, and thus quickly find the software to be launched without excessive searching, thereby improving the efficiency of the user to open the software. After the user finds the software to be opened, they can directly click the icon on the display screen. The display screen can determine which software icon the user clicks based on the coordinate position of the click and the coordinate position of the icon, and then send the determined software icon information to the screen mirroring device to enable the screen mirroring device to launch the software. After the software page is displayed on the display screen, the software bar is hidden. When the software page is displayed, a virtual button for removing the software page will be generated on the display screen. After the user clicks the virtual button, the software page can be removed, and then the software bar is redisplayed, enabling the user to open other software. This process repeats until the user clicks the end screen mirroring button on the display screen or the screen mirroring device sends a signal to end the screen mirroring to the display screen to end the screen mirroring.

[0035] In this embodiment, since the launched software is installed on the screen mirroring device, the user cannot directly control the software through the display screen. This method creatively applies the method of equivalent operation conversion to equivalent the user's operations on the display screen to the screen mirroring device, enabling the screen mirroring device to execute corresponding software response actions, and thus enabling the user to directly control the software installed on the screen mirroring device on the display screen, eliminating the need for the user to operate both the screen mirroring device and the display screen simultaneously, greatly improving the convenience of the user for screen mirroring demonstrations.

[0036] As a preferred embodiment, determining the operation of the software page on the display screen by the user, determining the equivalent operation corresponding to the operation on the screen mirroring device, and controlling the screen mirroring device to execute the software response action corresponding to the equivalent operation, and correspondingly displaying the software response action on the software page on the display screen includes:

[0037] When it is detected that the software page on the display screen is pressed each time, identify the first pressing position on the display screen;

[0038] Determine the equivalent pressing position of the first pressing position on the screen of the screen mirroring device;

[0039] Send the equivalent pressing position to the screen mirroring device, so that the screen mirroring device determines the action instruction when the equivalent pressing position is pressed on the current display page, and executes the corresponding software response action according to the action instruction;

[0040] Monitor the page change of the screen mirroring device when it executes the software response action, and control the display screen to display the page change of the screen mirroring device at the software page.

[0041] In this embodiment, all operations of the user on the display screen can be regarded as pressing (wherein, the sliding operation of the user on the display screen can be regarded as continuously pressing multiple adjacent points). Determining the operation of the user on the software page of the display screen means determining the pressing position of each time the user presses on the display screen, and determining the equivalent operation means determining the equivalent pressing position; after the screen mirroring device receives the equivalent pressing position, it is equivalent to being pressed at this position, so as to execute the corresponding response action; when the screen mirroring device executes the response action, the content displayed on its screen will change accordingly (i.e., page change). Due to the screen mirror projection of the display screen and the screen of the screen mirroring device, when the page of the screen mirroring device changes, the software page on the display screen also changes accordingly.

[0042] Such as Figure 3 shown, as a preferred embodiment, the shape of the software page on the display screen is in proportion to the shape of the screen of the screen mirroring device; the screen coordinate system of the display screen is used as the first coordinate system. Whenever the display screen is pressed, the display screen can recognize the coordinates of the pressing position on the first coordinate system, that is, the first coordinate;

[0043] Determining the equivalent pressing position of the first pressing position on the screen of the screen mirroring device includes:

[0044] Generate a second coordinate system with the upper left corner of the software page on the display screen as the origin, wherein the second coordinate system is the equivalent coordinate system of the screen coordinate system of the screen mirroring device, and the two coordinate axes of the second coordinate system coincide with two adjacent sides intersecting at the upper left corner of the software page respectively;

[0045] Identify the abscissa and the ordinate of the origin of the second coordinate system in the first coordinate system ;

[0046] Determine the scaling ratio of the abscissa of the second coordinate system relative to the abscissa of the first coordinate system and the scaling ratio of the ordinate of the second coordinate system relative to the ordinate of the first coordinate system ;

[0047] Every time a first coordinate is recognized, according to the determined , , and Calculate the second coordinate of the first coordinate in the second coordinate system, that is, the equivalent pressing position.

[0048] Calculate the second coordinate of the first coordinate in the second coordinate system through the following formula:

[0049]

[0050] where is the abscissa of the first coordinate, is the ordinate of the first coordinate, is the abscissa of the second coordinate, is the ordinate of the second coordinate.

[0051] In this embodiment, both the display screen and the screen of the screen mirroring terminal are built-in with a screen coordinate system. The screen coordinate system is a two-dimensional coordinate system used to determine the position of points on the screen. In this coordinate system, usually the upper left corner of the screen is used as the origin (0, 0) position, the positive direction of the X-axis is horizontally to the right, and the positive direction of the Y-axis is vertically downward; the shape of the software page on the display screen is proportional to the shape of the screen of the screen mirroring terminal, that is, the length ratio and width ratio of the two shapes are the same; the scaling ratio is the ratio of the coordinate values in the two coordinate systems corresponding to the same distance interval in the two coordinate systems. The scaling ratio is the same as the aforementioned length ratio / width ratio. For example, if the length ratio is 0.1, then = =0.1; under normal circumstances is 0, but when the user needs to rotate the software page on the display screen to take care of some audiences, the second coordinate system rotates accordingly, thereby causing to change accordingly; in this embodiment, since the display screen can only monitor the first coordinate of the pressing position in its own screen coordinate system (i.e., the first coordinate system), through the conversion method of this embodiment, the monitored first coordinate can be directly converted into its second coordinate on the screen of the screen mirroring terminal, so as to accurately determine the equivalent operation.

[0052] As a preferred embodiment, the software corresponding to the software page on the display screen is used as the target software; during the execution of step S7, it further includes:

[0053] Query the task that the target software on the screen mirroring terminal is executing;

[0054] After receiving the task that the target software on the screen mirroring terminal is executing replied, determine whether the task is a splittable task;

[0055] If so, determine whether there is a matching software in the built-in software of the display screen that can execute the task;

[0056] If so, mobilize the matching software to assist the target software to complete the task.

[0057] Mobilizing the matching software to assist the target software to complete the task includes:

[0058] Inquire the screen mirroring end about the total amount of the task and the remaining amount of the task;

[0059] When receiving the total amount of the task and the remaining amount of the task, determine the first efficiency of the target software to complete the task;

[0060] Determine the second efficiency of the matching software to complete the task according to historical data;

[0061] Split the remaining amount of the task according to the first efficiency and the second efficiency, so as to obtain the first partial task assigned to the target software and the second partial task assigned to the matching software;

[0062] Send the splitting information to the screen mirroring end, so that the screen mirroring end returns the input information of the second partial task, and execute the second partial task according to the input information;

[0063] Return the execution result of the second partial task to the screen mirroring end, so that the screen mirroring end combines the execution result of the first partial task and the execution result of the second partial task, so as to obtain the execution result of the task.

[0064] Determining the first efficiency of the target software to complete the task includes:

[0065] Subtract the remaining amount of the task from the total amount of the task to obtain the amount of the completed task;

[0066] Determine the first duration from the moment when the task starts to be executed to the current moment;

[0067] Divide the amount of the completed task by the first duration to obtain the first efficiency;

[0068] Determining the second efficiency of the matching software to complete the task according to historical data includes:

[0069] Retrieve the task execution information of the matching software for each time it executes a historical task identical to this task. Among them, the task execution information includes the amount of the historical task and the second duration of the matching software to execute this historical task;

[0070] For each historical task, divide the amount of the historical task by the corresponding second duration to obtain the execution efficiency corresponding to this historical task;

[0071] Calculate the average value of the execution efficiencies of each historical task to obtain the second efficiency.

[0072] The remaining task volume is split according to the first efficiency and the second efficiency, so as to obtain the first partial task assigned to the target software and the second partial task assigned to the matching software, including:

[0073] Add the first efficiency and the second efficiency to obtain the total efficiency;

[0074] Divide the first efficiency by the total efficiency to obtain the first efficiency ratio;

[0075] Multiply the remaining task volume by the first efficiency ratio to obtain the first task volume;

[0076] Divide out the partial task of the first task volume from the remaining task volume, that is, the first partial task, and use the partial task corresponding to the remaining task volume as the second partial task.

[0077] In this embodiment, a task database is preset in the display screen, which includes all splittable tasks, such as 'extracting text from a PDF file', and non-splittable tasks, such as 'video playback'; after the display screen obtains the task being executed by the screen mirroring end, it can compare the task with the tasks in the task database to determine whether it can be split;

[0078] In this embodiment, for example, for the task of 'extracting text from a PDF file', since text extraction is performed page by page on the PDF, the pages of the PDF can be split and then assigned to two software for execution; the remaining page volume of the PDF that has not been text-extracted is the remaining task volume, and the corresponding proportion of pages is divided out from the remaining pages according to the first efficiency ratio. The first partial task is to extract text from the divided PDF pages. Similarly, extracting text from the other part of the remaining PDF pages is the second partial task; the completion of each task requires importing input information into the software, and the execution result will be generated after the software finishes execution. Taking PDF text extraction as an example, the input information is the page of the PDF, and the execution result is the extracted text; furthermore, the display screen can store the historical task information in the cloud and call it when needed; in this embodiment, if the task is splittable, the remaining tasks can be split and allocated according to the execution efficiency (the task volume completed per unit time) of the target software and the matching software (the higher the execution efficiency, the more task volume is allocated), so that the target software and the matching software can roughly complete the assigned partial tasks at the same time, and thus the task can be completed fastest.

[0079] A display screen provided in the second embodiment of the present application includes a memory and a processor. A computer program is stored in the memory. When the computer program is executed by the processor, the processor executes the steps of the display screen screen mirroring control method, specifically including:

[0080] S1: When receiving the screen mirroring signal from the screen mirroring terminal, identify whether the first page currently displayed on the screen mirroring terminal is a software page. If so, display the software page on the display screen;

[0081] S2: If the first page is not a software page, query the built-in software information of the screen mirroring terminal, where the built-in software information includes the software icons of all the built-in software of the screen mirroring terminal;

[0082] S3: After receiving the built-in software information sent by the screen mirroring terminal, generate a software bar on the display screen and place each received software icon in the software bar;

[0083] S4: When it is recognized that the user clicks any software icon in the software bar, send the software icon to the screen mirroring terminal so that the screen mirroring terminal determines the software to be launched and launches the software;

[0084] S5: Display the launched software page on the display screen;

[0085] S6: Determine the operations of the user on the software page on the display screen, determine the equivalent operations corresponding to these operations on the screen mirroring terminal, and control the screen mirroring terminal to execute the software response actions corresponding to the equivalent operations according to the equivalent operations, and display the software response actions corresponding to the software response actions on the software page on the display screen accordingly;

[0086] S7: Execute steps S6 to S7 until the software page is removed from the display screen after the user completes the software operations;

[0087] S8: Repeat steps S4 to S7 until a signal to end screen mirroring is received from the user.

[0088] A storage medium provided in Embodiment 3 of the present application, on which a computer program is stored. When the computer program is executed by a processor, the processor is caused to execute the steps of the screen mirroring control method for the display screen, specifically including:

[0089] S1: When receiving the screen mirroring signal from the screen mirroring terminal, identify whether the first page currently displayed on the screen mirroring terminal is a software page. If so, display the software page on the display screen;

[0090] S2: If the first page is not a software page, query the built-in software information of the screen mirroring terminal, where the built-in software information includes the software icons of all the built-in software of the screen mirroring terminal;

[0091] S3: After receiving the built-in software information sent by the screen mirroring terminal, generate a software bar on the display screen and place each received software icon in the software bar;

[0092] S4: When any software icon in the software bar is recognized as being clicked by the user, send the software icon to the screen mirroring end so that the screen mirroring end can determine the software to be launched and launch the software;

[0093] S5: Display the launched software page on the display screen;

[0094] S6: Determine the operations of the user on the software page on the display screen, determine the equivalent operations corresponding to these operations on the screen mirroring end, and control the screen mirroring end to execute the software response actions corresponding to the equivalent operations, and display the software response actions correspondingly on the software page on the display screen;

[0095] S7: Execute steps S6 to S7 until the software page is removed from the display screen after the user completes the software operations;

[0096] S8: Repeat steps S4 to S7 until a signal to end the screen mirroring is received from the user.

[0097] It should be understood that the magnitudes of the sequence numbers of the steps in the above embodiments do not mean the order of execution. The order of execution of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0098] It should be understood that when used in the specification of the present application, the term "comprising" indicates the presence of the described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or their combinations.

[0099] It should also be understood that the term "and / or" used in the specification of the present application refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0100] As used in the specification of the present application, the term "if" can be interpreted as "when", "once", "in response to determining", or "in response to detecting" depending on the context. Similarly, the phrases "if determined" or "if [the described condition or event] is detected" can be interpreted as meaning "once determined", "in response to determining", "once [the described condition or event] is detected", or "in response to detecting [the described condition or event]" depending on the context.

[0101] In addition, in the description of the specification of this application, the terms "first", "second", "third", etc. are only used for differential description and should not be construed as indicating or implying relative importance. It should also be understood that although the terms "first", "second", etc. are used in the text in some embodiments of this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, the first table can be named the second table, and similarly, the second table can be named the first table, without departing from the scope of the various described embodiments. The first table and the second table are both tables, but they are not the same table.

[0102] Reference to "one embodiment" or "some embodiments" etc. described in the specification of this application means that a specific feature, structure, or characteristic described in connection with that embodiment is included in one or more embodiments of this application. Thus, statements such as "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification do not necessarily all refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "comprising", "including", "having" and their variants all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0103] Figure 4 It is a schematic structural diagram of a display screen provided by an embodiment of this application. As Figure 4 shown, the display screen of this embodiment includes: at least one processor ( Figure 4 only one is shown in the figure), a memory, and a computer program that can run on the processor is stored in the memory. When the processor executes the computer program, the steps in the above-mentioned embodiments of the display screen screen mirroring control method are implemented, for example Figure 1 the steps S1 to S8 shown.

[0104] The display screen can be a computing device such as a desktop computer, a notebook, a palm computer, and a cloud server. The display screen may include, but is not limited to, a processor and a memory. Those skilled in the art can understand that Figure 4 this is only an example of the display screen and does not constitute a limitation on the display screen. It may include more or fewer components than shown in the figure, or combine certain components, or different components. For example, the display screen may further include an input sending device, a network access device, a bus, etc.

[0105] The so-called processor may be a Central Processing Unit (CPU), or may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0106] In some embodiments, the memory may be an internal storage unit of the display screen, such as the hard disk or memory of the display screen. The memory may also be an external storage device of the display screen, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, Flash Card, etc. equipped on the display screen. Further, the memory may also include both the internal storage unit and the external storage device of the display screen. The memory is used to store an operating system, application programs, a BootLoader, data, and other programs, such as the program code of the computer program. The memory may also be used to temporarily store data that has been sent or will be sent.

[0107] In addition, in each embodiment of the present application, the functional units may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit. The above integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0108] The embodiments of the present application provide a computer program product. When the computer program product runs on a mobile display screen, it enables the mobile display screen to implement the steps in the above various method embodiments when executed.

[0109] When the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, to implement all or part of the processes in the above-described embodiment methods of the present application, it can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of the above-described method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file, or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disc, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc.

[0110] In the above embodiments, the descriptions of the various embodiments have their own emphases. For the parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0111] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of the present application.

[0112] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they can be located in one place, or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0113] The above-described embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A display screen projection control method, applied to a display screen, characterized in that: The display screen projection control method comprises: S1: when receiving a projection signal from the projection end, identifying whether the first page currently displayed on the projection end is a software page, and if so, displaying the software page on the display screen; S2: If the first page is not a software page, query the built-in software information of the projection end, wherein the built-in software information includes software icons of all built-in software of the projection end; S3: after receiving the built-in software information sent by the projection end, a software bar is generated on the display screen, and each received software icon is placed in the software bar; S4: When it is recognized that the user clicks on any software icon in the software bar, the software icon is sent to the projection end, so that the projection end determines the software to be started and starts the software; S5: Displaying the started software page on the display screen; S6: Determine the operation of the user on the software page on the display screen, determine the equivalent operation corresponding to the operation on the projection end, control the projection end to execute the software response action corresponding to the equivalent operation according to the equivalent operation, and display the software response action accordingly on the software page on the display screen; S7: Execute steps S6 to S7 until the user completes the software operation and removes the software page from the display screen; S8: Repeat steps S4 to S7 until a signal input by the user to end screen projection is received; The software corresponding to the software page on the display screen is used as the target software; in the process of executing step S7, it also includes: Query the tasks being performed by the target software on the screen projection end; After receiving the task being executed by the target software replied by the projection end, determine whether the task is a splittable task; If yes, determine whether there is matching software in the built-in software of the display screen that can perform the task; If so, the matching software is mobilized to assist the target software in completing the task; Mobilizing the matching software to assist the target software in completing the task includes: Query the projection end for the total number of tasks and the remaining number of tasks for the task; When receiving the total amount of tasks and the remaining amount of tasks, determining a first efficiency of the target software in completing the tasks; Determine the second efficiency of the matching software to complete the task based on historical data; The remaining task volume is split according to the first efficiency and the second efficiency, so as to obtain a first partial task assigned to the target software and a second partial task assigned to the matching software; Send split information to the projection end, so that the projection end returns the input information of the second partial task and executes the second partial task according to the input information; The execution result of the second partial task is transmitted back to the projection end, so that the projection end merges the execution result of the first partial task with the execution result of the second partial task, thereby obtaining the execution result of the task.

2. The method according to claim 1, characterized in that Determining an operation of a user on a software page on a display screen, determining an equivalent operation corresponding to the operation on a projection end, controlling the projection end to perform a software response action corresponding to the equivalent operation according to the equivalent operation, and correspondingly displaying the software response action on the software page on the display screen includes: After each time it is detected that a software page on the display screen is pressed, a first pressing position is identified on the display screen; Determine an equivalent pressing position of the first pressing position on the projection end screen; The equivalent pressing position is sent to the projection end, so that the projection end determines the action instruction when the equivalent pressing position is pressed on the current display page, and executes the corresponding software response action according to the action instruction; Monitor the page changes of the projection end when executing software response actions, and control the display screen to display the page changes of the projection end on the software page.

3. The method according to claim 2, characterized in that The shape of the software page on the display screen is proportional to the shape of the screen on the projection end; the screen coordinate system of the display screen is used as the first coordinate system, and whenever the display screen is pressed, the display screen can identify the coordinates of the pressed position on the first coordinate system, i.e., the first coordinates; Determining the equivalent pressing position of the first pressing position on the projection end screen includes: A second coordinate system is generated with the upper left corner of the software page on the display screen as the origin, wherein the second coordinate system is an equivalent coordinate system of the screen coordinate system of the projection end, and two coordinate axes of the second coordinate system coincide with two adjacent edges intersecting at the upper left corner of the software page; Identify the x coordinate of the origin of the second coordinate system in the first coordinate system t , vertical coordinate y t and a rotation angle θ of the second coordinate system relative to the first coordinate system; Determine the scaling ratio S of the abscissa of the second coordinate system relative to the abscissa of the first coordinate system x , and the scaling ratio S of the ordinate of the second coordinate system relative to the ordinate of the first coordinate system y ; Each time a first coordinate is identified, the x t ,y t ,θ,S x and S y The second coordinate of the first coordinate in the second coordinate system, ie, the equivalent pressing position, is calculated.

4. The method according to claim 3, characterized in that The second coordinate of the first coordinate in the second coordinate system is calculated by the following formula: Among them, x1 is the horizontal coordinate of the first coordinate, y1 is the vertical coordinate of the first coordinate, x2 is the horizontal coordinate of the second coordinate, and y2 is the vertical coordinate of the second coordinate.

5. The method according to claim 3, characterized in that: Determine the first efficiency of the target software to complete the task including: Subtract the remaining task amount from the total task amount to get the completed task amount; Determine the first duration from the time when the task is started to the current time; Divide the amount of completed tasks by the first duration to get the first efficiency; The second efficiency of matching software to complete this task based on historical data includes: Retrieving task execution information of each time the matching software executes a historical task that is the same as the task, wherein the task execution information includes the task amount of the historical task and the second duration for which the matching software executes the historical task; For each historical task, the task amount of the historical task is divided by the corresponding second duration to obtain the execution efficiency of the historical task; Find the average of the execution efficiency of each historical task and get the second efficiency.

6. The method according to claim 5, characterized in that The remaining task volume is split according to the first efficiency and the second efficiency, so as to obtain the first partial task assigned to the target software and the second partial task assigned to the matching software, including: Add the first efficiency and the second efficiency to get the total efficiency; Divide the first efficiency by the total efficiency to obtain the first efficiency ratio; Multiply the remaining task volume by the first efficiency ratio to obtain the first task volume; A partial task of the first task amount is divided out from the remaining task amount, namely, a first partial task, and the partial task corresponding to the remaining task amount is used as a second partial task.

7. A display screen, characterized in that: It includes a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the display screen projection control method described in any one of claims 1 to 6.

8. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the display screen projection control method described in any one of claims 1 to 6.

Images