Display screen projection control method, display screen and storage medium
By identifying the page type of the screen projection end and generating the software bar on the display screen, users can control the software on the screen projection end on the display screen, solving the problem that users need to operate the display screen and the screen projection device at the same time, and improving operational convenience.
Patent Information
- Application Number
- CN202510183788.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-19
- Publication Date
- 2025-03-18
- Estimated Expiration
- 2045-02-19
AI Technical Summary
In conferences, teaching and other scenarios, users need to operate the display screen and the projection device at the same time, resulting in inconvenience in operation.
By identifying the page type of the screen projection end on the display screen and generating a built-in software icon for the screen projection end on the software bar, users can click the software icon on the display screen to start and control the software on the screen projection end to achieve operational equivalent conversion.
Users can directly control the software on the projection end on the display screen, avoiding the need to operate the projection end and the display screen at the same time, and significantly improving the convenience of users in the projection demonstration.
Smart Images

Figure CN119645338A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of communication technology, and in particular, relates to a display screen projection control method, a display screen and a storage medium. Background Art
[0002] Screen projection is a technology that wirelessly transmits the content on electronic devices (such as mobile phones, tablets, computers, etc.) to a large screen for display. It is widely used in various scenarios such as conferences and teaching; However, currently, projecting the screen on a display screen using an electronic device can only achieve the effect of mirroring the screen, that is, only the content on the electronic device screen is displayed on the display screen, and the user needs to perform corresponding operations on the displayed page on the electronic device; but in screen projection application scenarios such as meetings and teaching, the user needs to give corresponding instructions to the audience on the display screen. If the displayed content needs to be operated at this time, the user needs to operate the display screen and the electronic device at the same time, which is very inconvenient. Summary of the invention
[0003] In view of this, an embodiment of the present application provides a display screen projection control method, a display screen and a storage medium, which can solve the above-mentioned technical problems.
[0004] A first aspect of an embodiment of the present application provides a display screen projection control method, which is applied to a display screen. The display screen projection control method includes: S1: when receiving a projection signal from the projection end, identifying whether the first page currently displayed on the projection end is a software page, and if so, displaying the software page on the display screen; S2: If the first page is not a software page, query the built-in software information of the projection end, wherein the built-in software information includes software icons of all built-in software of the projection end; S3: after receiving the built-in software information sent by the projection end, a software bar is generated on the display screen, and each received software icon is placed in the software bar; S4: When it is recognized that the user clicks on any software icon in the software bar, the software icon is sent to the projection end, so that the projection end determines the software to be started and starts the software; S5: Displaying the started software page on the display screen; S6: Determine the operation of the user on the software page on the display screen, determine the equivalent operation corresponding to the operation on the projection end, control the projection end to execute the software response action corresponding to the equivalent operation according to the equivalent operation, and display the software response action accordingly on the software page on the display screen; S7: Execute steps S6 to S7 until the user completes the software operation and removes the software page from the display screen; S8: Repeat steps S4 to S7 until a signal from the user to end screen projection is received.
[0005] A second aspect of an embodiment of the present application provides a display screen, including a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the display screen projection control method.
[0006] A third aspect of an embodiment of the present application provides a storage medium, on which a computer program is stored. When the computer program is executed by a processor, the processor executes the steps of the display screen projection control method.
[0007] Compared with the prior art, the embodiments of the present application have the following beneficial effects: the method provided by the present invention includes, when receiving a projection signal from the projection end, identifying whether the first page currently displayed on the projection end is a software page, and if so, displaying the software page on the display screen; if the first page is not a software page, querying the built-in software information of the projection end; after receiving the built-in software information sent by the projection end, generating a software bar on the display screen, and placing each received software icon in the software bar; when recognizing that a user clicks on any software icon in the software bar, sending the software icon to the projection end, so that the projection end determines the software to be started and starts the software; displaying the started software page on the display screen; determining whether the user clicks on the display screen The operation of the software page on the display screen is performed, and the equivalent operation corresponding to the operation on the projection end is determined; according to the equivalent operation, the projection end is controlled to execute the software response action corresponding to the equivalent operation, and the software page on the display screen displays the software response action accordingly; the above steps are repeated until a signal input by the user to end the screen projection is received; in the present application, an operation equivalent conversion method is applied to equate the user's operation on the display screen to the projection end, so that the projection end can execute the corresponding software response action, and then the user can directly control the software installed on the projection end on the display screen, so that the user does not need to take into account the operation of the projection end and the display screen at the same time, which greatly improves the convenience of the user in performing screen projection demonstration. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0009] Figure 1 It is a schematic diagram of the implementation process of the display screen projection control method provided in the embodiment of the present application; Figure 2It is a schematic diagram of the implementation environment of the display screen projection control method provided in the embodiment of the present application; Figure 3 It is a schematic diagram of a coordinate system of a display screen projection control method provided in an embodiment of the present application; Figure 4 Schematic diagram of a display screen provided in an embodiment of the present application. DETAILED DESCRIPTION
[0010] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0011] In order to illustrate the technical solution described in this application, a specific embodiment is provided below for illustration.
[0012] Figure 1 A display screen projection control method provided in the first embodiment of the present application is shown, which is applied to a display screen. The display screen projection control method includes: S1: when receiving a projection signal from the projection end, identifying whether the first page currently displayed on the projection end is a software page, and if so, displaying the software page on the display screen; S2: If the first page is not a software page, query the built-in software information of the projection end, wherein the built-in software information includes software icons of all built-in software of the projection end; S3: after receiving the built-in software information sent by the projection end, a software bar is generated on the display screen, and each received software icon is placed in the software bar; S4: When it is recognized that the user clicks on any software icon in the software bar, the software icon is sent to the projection end, so that the projection end determines the software to be started and starts the software; S5: Displaying the started software page on the display screen; S6: Determine the operation of the user on the software page on the display screen, determine the equivalent operation corresponding to the operation on the projection end, control the projection end to execute the software response action corresponding to the equivalent operation according to the equivalent operation, and display the software response action accordingly on the software page on the display screen; S7: Execute steps S6 to S7 until the user completes the software operation and removes the software page from the display screen; S8: Repeat steps S4 to S7 until a signal from the user to end screen projection is received.
[0013] In this embodiment, if Figure 2 As shown, the method is executed in a display screen (such as a large LCD TV), and the display screen can communicate with a projection end (an electronic device that sends the projection), which can be a mobile phone, a tablet computer, a laptop computer, a desktop computer, etc., and is not limited here; after the projection end projects the screen on the display screen, the display screen can interact with the projection end for information, thereby realizing the function of the method.
[0014] In this embodiment, when the user performs screen projection, he often displays the content of a certain software running on the projection end, such as PPT, video software or other software; therefore, when a certain software page has been opened on the projection end, the software page can be directly displayed; if no software is opened, due to the limitation of the screen size of some projection ends, the software is often arranged in multiple pages (such as mobile phones), and it is necessary to repeatedly search when opening the software. In this embodiment, all the software of the projection end can be placed in it by generating a software column (the arrangement and order are consistent with those in the projection end), so that the user can directly view all the built-in software of the projection end on the display screen, and then quickly find the software to be started without too much searching, thereby improving the user's opening speed. The efficiency of opening software is improved; after the user finds the software to be opened, he can directly click the icon on the display screen. The display screen can determine which software icon the user clicked according to the coordinate position of the click and the coordinate position of the icon, and then send the determined software icon information to the projection end to enable the projection end to start the software; after the software page is displayed on the display screen, the software bar is hidden. When the software page is displayed, a virtual button for removing the software page is generated on the display screen. The user can remove the software page by clicking the virtual button, and then redisplay the software bar, so that the user can open other software. This cycle repeats until the user clicks the end projection button on the display screen, or sends a signal to end projection to the display screen through the projection end, so that the projection ends.
[0015] In this embodiment, since the software being launched is installed on the projection end, the user cannot directly control the software through the display screen. This method creatively applies the operation equivalent conversion method to equate the user's operation on the display screen to the projection end, so that the projection end can execute the corresponding software response action, thereby allowing the user to directly control the software installed on the projection end on the display screen, so that the user does not need to operate the projection end and the display screen at the same time, which greatly improves the convenience of the user's projection demonstration.
[0016] As a preferred embodiment, determining the operation of the user on the software page on the display screen, determining the equivalent operation corresponding to the operation on the projection end, controlling the projection end to perform the software response action corresponding to the equivalent operation according to the equivalent operation, and correspondingly displaying the software response action on the software page on the display screen includes: After each time it is detected that a software page on the display screen is pressed, a first pressing position is identified on the display screen; Determine an equivalent pressing position of the first pressing position on the projection end screen; The equivalent pressing position is sent to the projection end, so that the projection end determines the action instruction when the equivalent pressing position is pressed on the current display page, and executes the corresponding software response action according to the action instruction; Monitor the page changes of the projection end when executing software response actions, and control the display screen to display the page changes of the projection end on the software page.
[0017] In this embodiment, the user's operations on the display screen can be regarded as pressing (wherein, the user's sliding operation on the display screen can be regarded as continuously pressing multiple adjacent points), and the user's operation on the software page on the display screen is determined, that is, the pressing position of the user on the display screen each time is determined, and the equivalent operation is determined, that is, the equivalent pressing position is determined; after the projection end receives the equivalent pressing position, it is equivalent to receiving a pressing operation at that position, and thus executes a corresponding response action; when the projection end executes the response action, the content displayed on its screen will change accordingly (that is, the page changes). Since the display screen and the projection end are mirrored, when the screen of the projection end changes page, the software page on the display screen also changes accordingly.
[0018] like Figure 3 As shown, as a preferred embodiment, the shape of the software page on the display screen is proportional to the shape of the screen on the projection end; the screen coordinate system of the display screen is used as the first coordinate system, and whenever the display screen is pressed, the display screen can identify the coordinates of the pressed position on the first coordinate system, that is, the first coordinates; Determining the equivalent pressing position of the first pressing position on the projection end screen includes: A second coordinate system is generated with the upper left corner of the software page on the display screen as the origin, wherein the second coordinate system is an equivalent coordinate system of the screen coordinate system of the projection end, and two coordinate axes of the second coordinate system coincide with two adjacent edges intersecting at the upper left corner of the software page; Identify the horizontal coordinate of the origin of the second coordinate system in the first coordinate system , vertical coordinate And the rotation angle of the second coordinate system relative to the first coordinate system ; Determine the scale of the abscissa of the second coordinate system relative to the abscissa of the first coordinate system , and the scaling ratio of the ordinate of the second coordinate system relative to the ordinate of the first coordinate system ; Each time a first coordinate is identified, according to the determined , , as well as The second coordinate of the first coordinate in the second coordinate system, ie, the equivalent pressing position, is calculated.
[0019] The second coordinate of the first coordinate in the second coordinate system is calculated by the following formula: in, is the horizontal coordinate of the first coordinate, is the ordinate of the first coordinate, is the horizontal coordinate of the second coordinate, is the ordinate of the second coordinate.
[0020] In this embodiment, both the display screen and the projection screen have built-in screen coordinate systems. The screen coordinate system is a two-dimensional coordinate system for determining the position of a point on the screen. In this coordinate system, the upper left corner of the screen is usually used as the origin (0, 0), the horizontal rightward direction is the positive direction of the X axis, and the vertical downward direction is the positive direction of the Y axis; the shape of the software page on the display screen is proportional to the shape of the projection screen, that is, the length ratio and width ratio of the two shapes are consistent; the scaling ratio is the ratio of the coordinate values in the two coordinate systems corresponding to the same distance in the two coordinate systems. and The same as the length ratio / width ratio mentioned above, for example, if the length ratio is 0.1, then = =0.1; Under normal circumstances is 0, but when the user needs to take care of some viewers and needs to rotate the software page on the display screen, the second coordinate system rotates accordingly, making Corresponding changes occur; in this embodiment, since the display screen can only monitor the first coordinate of the pressed position in its own screen coordinate system (i.e., the first coordinate system), the conversion method of this embodiment can directly convert the monitored first coordinate into its second coordinate on the projection screen, thereby accurately realizing the determination of equivalent operations.
[0021] As a preferred embodiment, the software corresponding to the software page on the display screen is used as the target software; during the process of executing step S7, it also includes: Query the tasks being performed by the target software on the screen projection end; After receiving the task being executed by the target software replied by the projection end, determine whether the task is a splittable task; If yes, determine whether there is matching software in the built-in software of the display screen that can perform the task; If so, the matching software is mobilized to assist the target software in completing the task.
[0022] Mobilizing the matching software to assist the target software in completing the task includes: Query the projection end for the total number of tasks and the remaining number of tasks for the task; When receiving the total amount of tasks and the remaining amount of tasks, determining a first efficiency of the target software in completing the tasks; Determine the second efficiency of the matching software to complete the task based on historical data; The remaining task volume is split according to the first efficiency and the second efficiency, so as to obtain a first partial task assigned to the target software and a second partial task assigned to the matching software; Send split information to the projection end, so that the projection end returns the input information of the second partial task and executes the second partial task according to the input information; The execution result of the second partial task is transmitted back to the projection end, so that the projection end merges the execution result of the first partial task with the execution result of the second partial task, thereby obtaining the execution result of the task.
[0023] Determine the first efficiency of the target software to complete the task including: Subtract the remaining task amount from the total task amount to get the completed task amount; Determine the first duration from the time when the task is started to the current time; Divide the amount of completed tasks by the first duration to get the first efficiency; The second efficiency of matching software to complete this task based on historical data includes: Retrieving task execution information of each time the matching software executes a historical task that is the same as the task, wherein the task execution information includes the task amount of the historical task and the second duration of the matching software executing the historical task; For each historical task, the task amount of the historical task is divided by the corresponding second duration to obtain the execution efficiency of the historical task; Find the average of the execution efficiency of each historical task and get the second efficiency.
[0024] The remaining task volume is split according to the first efficiency and the second efficiency, so as to obtain the first partial task assigned to the target software and the second partial task assigned to the matching software, including: Add the first efficiency and the second efficiency to get the total efficiency; Divide the first efficiency by the total efficiency to obtain the first efficiency ratio; Multiply the remaining task volume by the first efficiency ratio to obtain the first task volume; A partial task of the first task amount is divided out from the remaining task amount, namely, a first partial task, and the partial task corresponding to the remaining task amount is used as a second partial task.
[0025] In this embodiment, a task database is preset in the display screen, which includes all splittable tasks, such as "extracting text from a PDF file", and non-divisible tasks, such as "video playback". After obtaining the task being executed by the projection end, the display screen can compare the task with the task in the task database to determine whether it can be split; In this embodiment, for example, for the task of 'extracting text from a PDF file', since the text extraction is performed on each page of the PDF one by one, the pages of the PDF can be split and then assigned to two software for execution; the remaining pages of the PDF that have not been extracted are the remaining task volume, and the corresponding proportion of pages are divided from the remaining pages according to the first efficiency ratio. The first local task is to extract text from the divided PDF pages. Similarly, the text extraction from another part of the remaining PDF pages is the second local task; the completion of each task requires the input information to be imported into the software, and the execution result will be generated after the software is executed. Taking PDF text extraction as an example, the input information is the page of the PDF, and the execution result is the extracted text; furthermore, the display screen can store historical task information in the cloud and call it when needed; in this embodiment, if the task can be split, the remaining tasks can be split and allocated according to the execution efficiency (the amount of tasks completed per unit time) of the target software and the matching software (the higher the execution efficiency, the more tasks are allocated), so that the target software and the matching software can complete the assigned local tasks at about the same time, thereby enabling the task to be completed as quickly as possible.
[0026] A display screen provided in a second embodiment of the present application includes a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the display screen projection control method, specifically including: S1: when receiving a projection signal from the projection end, identifying whether the first page currently displayed on the projection end is a software page, and if so, displaying the software page on the display screen; S2: If the first page is not a software page, query the built-in software information of the projection end, wherein the built-in software information includes software icons of all built-in software of the projection end; S3: after receiving the built-in software information sent by the projection end, a software bar is generated on the display screen, and each received software icon is placed in the software bar; S4: When it is recognized that the user clicks on any software icon in the software bar, the software icon is sent to the projection end, so that the projection end determines the software to be started and starts the software; S5: Displaying the started software page on the display screen; S6: Determine the operation of the user on the software page on the display screen, determine the equivalent operation corresponding to the operation on the projection end, control the projection end to execute the software response action corresponding to the equivalent operation according to the equivalent operation, and display the software response action accordingly on the software page on the display screen; S7: Execute steps S6 to S7 until the user completes the software operation and removes the software page from the display screen; S8: Repeat steps S4 to S7 until a signal from the user to end screen projection is received.
[0027] A storage medium is provided in a third embodiment of the present application. A computer program is stored on the storage medium. When the computer program is executed by a processor, the processor executes the steps of the display screen projection control method, specifically including: S1: when receiving a projection signal from the projection end, identifying whether the first page currently displayed on the projection end is a software page, and if so, displaying the software page on the display screen; S2: If the first page is not a software page, query the built-in software information of the projection end, wherein the built-in software information includes software icons of all built-in software of the projection end; S3: after receiving the built-in software information sent by the projection end, a software bar is generated on the display screen, and each received software icon is placed in the software bar; S4: When it is recognized that the user clicks on any software icon in the software bar, the software icon is sent to the projection end, so that the projection end determines the software to be started and starts the software; S5: Displaying the started software page on the display screen; S6: Determine the operation of the user on the software page on the display screen, determine the equivalent operation corresponding to the operation on the projection end, control the projection end to execute the software response action corresponding to the equivalent operation according to the equivalent operation, and display the software response action accordingly on the software page on the display screen; S7: Execute steps S6 to S7 until the user completes the software operation and removes the software page from the display screen; S8: Repeat steps S4 to S7 until a signal from the user to end screen projection is received.
[0028] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0029] It should be understood that when used in the present application specification, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0030] It should also be understood that the term “and / or” used in the specification of the present application refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0031] As used in the present specification, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting" depending on the context. Similarly, the phrase "if it is determined" or "if [the described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [the described condition or event] is detected" or "in response to detecting [the described condition or event]" depending on the context.
[0032] In addition, in the description of the present specification, the terms "first", "second", "third", etc. are only used to distinguish descriptions, and cannot be understood as indicating or implying relative importance. It should also be understood that although the terms "first", "second", etc. are used to describe various elements in some embodiments of the present application in the text, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, the first table can be named as the second table, and similarly, the second table can be named as the first table, without departing from the scope of the various described embodiments. The first table and the second table are both tables, but they are not the same table.
[0033] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0034] Figure 4 Schematic diagram of the structure of a display screen provided by an embodiment of the present application. Figure 4 As shown, the display screen of this embodiment includes: at least one processor ( Figure 4Only one is shown in the figure), a memory, wherein the memory stores a computer program that can be run on the processor. When the processor executes the computer program, the steps in the above-mentioned display screen projection control method embodiments are implemented, such as Figure 1 Steps S1 to S8 are shown.
[0035] The display screen may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The display screen may include, but is not limited to, a processor and a memory. Those skilled in the art will understand that Figure 4 It is only an example of a display screen and does not constitute a limitation of the display screen. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the display screen may also include an input sending device, a network access device, a bus, etc.
[0036] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0037] In some embodiments, the memory may be an internal storage unit of the display screen, such as a hard disk or memory of the display screen. The memory may also be an external storage device of the display screen, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the display screen. Furthermore, the memory may include both an internal storage unit of the display screen and an external storage device. The memory is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory may also be used to temporarily store data that has been sent or is to be sent.
[0038] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0039] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile display screen, the mobile display screen can implement the steps in the above-mentioned method embodiments when executing the computer program product.
[0040] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device that can carry the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc.
[0041] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0042] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0043] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0044] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A display screen projection control method, applied to a display screen, characterized in that: The display screen projection control method comprises: S1: when receiving a projection signal from the projection end, identifying whether the first page currently displayed on the projection end is a software page, and if so, displaying the software page on the display screen; S2: If the first page is not a software page, query the built-in software information of the projection end, wherein the built-in software information includes software icons of all built-in software of the projection end; S3: after receiving the built-in software information sent by the projection end, a software bar is generated on the display screen, and each received software icon is placed in the software bar; S4: When it is recognized that the user clicks on any software icon in the software bar, the software icon is sent to the projection end, so that the projection end determines the software to be started and starts the software; S5: Displaying the started software page on the display screen; S6: Determine the operation of the user on the software page on the display screen, determine the equivalent operation corresponding to the operation on the projection end, control the projection end to execute the software response action corresponding to the equivalent operation according to the equivalent operation, and display the software response action accordingly on the software page on the display screen; S7: Execute steps S6 to S7 until the user completes the software operation and removes the software page from the display screen; S8: Repeat steps S4 to S7 until a signal from the user to end screen projection is received.
2. The method according to claim 1, characterized in that Determining an operation of a user on a software page on a display screen, determining an equivalent operation corresponding to the operation on a projection end, controlling the projection end to perform a software response action corresponding to the equivalent operation according to the equivalent operation, and correspondingly displaying the software response action on the software page on the display screen includes: After each time it is detected that a software page on the display screen is pressed, a first pressing position is identified on the display screen; Determine an equivalent pressing position of the first pressing position on the projection end screen; The equivalent pressing position is sent to the projection end, so that the projection end determines the action instruction when the equivalent pressing position is pressed on the current display page, and executes the corresponding software response action according to the action instruction; Monitor the page changes of the projection end when executing software response actions, and control the display screen to display the page changes of the projection end on the software page.
3. The method according to claim 2, characterized in that The shape of the software page on the display screen is proportional to the shape of the screen on the projection end; the screen coordinate system of the display screen is used as the first coordinate system, and whenever the display screen is pressed, the display screen can identify the coordinates of the pressed position on the first coordinate system, i.e., the first coordinates; Determining the equivalent pressing position of the first pressing position on the projection end screen includes: A second coordinate system is generated with the upper left corner of the software page on the display screen as the origin, wherein the second coordinate system is an equivalent coordinate system of the screen coordinate system of the projection end, and two coordinate axes of the second coordinate system coincide with two adjacent edges intersecting at the upper left corner of the software page; Identify the horizontal coordinate of the origin of the second coordinate system in the first coordinate system , vertical coordinate And the rotation angle of the second coordinate system relative to the first coordinate system ; Determine the scale of the abscissa of the second coordinate system relative to the abscissa of the first coordinate system , and the scaling ratio of the ordinate of the second coordinate system relative to the ordinate of the first coordinate system ; Each time a first coordinate is identified, according to the determined , , as well as The second coordinate of the first coordinate in the second coordinate system, ie, the equivalent pressing position, is calculated.
4. The method according to claim 3, characterized in that The second coordinate of the first coordinate in the second coordinate system is calculated by the following formula: in, is the horizontal coordinate of the first coordinate, is the ordinate of the first coordinate, is the horizontal coordinate of the second coordinate, is the ordinate of the second coordinate.
5. The method according to claim 3, characterized in that: The software corresponding to the software page on the display screen is used as the target software; The process of executing step S7 also includes: Query the tasks being performed by the target software on the screen projection end; After receiving the task being executed by the target software replied by the projection end, determine whether the task is a splittable task; If yes, determine whether there is matching software in the built-in software of the display screen that can perform the task; If so, the matching software is mobilized to assist the target software in completing the task.
6. The method according to claim 5, characterized in that Mobilizing the matching software to assist the target software in completing the task includes: Query the projection end for the total number of tasks and the remaining number of tasks for the task; When receiving the total amount of tasks and the remaining amount of tasks, determining a first efficiency of the target software in completing the tasks; Determine the second efficiency of the matching software to complete the task based on historical data; The remaining task volume is split according to the first efficiency and the second efficiency, so as to obtain a first partial task assigned to the target software and a second partial task assigned to the matching software; Send split information to the projection end, so that the projection end returns the input information of the second partial task and executes the second partial task according to the input information; The execution result of the second partial task is transmitted back to the projection end, so that the projection end merges the execution result of the first partial task with the execution result of the second partial task, thereby obtaining the execution result of the task.
7. The method according to claim 6, characterized in that Determine the first efficiency of the target software to complete the task including: Subtract the remaining task amount from the total task amount to get the completed task amount; Determine the first duration from the time when the task is started to the current time; Divide the amount of completed tasks by the first duration to get the first efficiency; The second efficiency of matching software to complete this task based on historical data includes: Retrieving task execution information of each time the matching software executes a historical task that is the same as the task, wherein the task execution information includes the task amount of the historical task and the second duration of the matching software executing the historical task; For each historical task, the task amount of the historical task is divided by the corresponding second duration to obtain the execution efficiency of the historical task; Find the average of the execution efficiency of each historical task and get the second efficiency.
8. The method according to claim 7, characterized in that The remaining task volume is split according to the first efficiency and the second efficiency, so as to obtain the first partial task assigned to the target software and the second partial task assigned to the matching software, including: Add the first efficiency and the second efficiency to get the total efficiency; Divide the first efficiency by the total efficiency to obtain the first efficiency ratio; Multiply the remaining task volume by the first efficiency ratio to obtain the first task volume; A partial task of the first task amount is divided out from the remaining task amount, namely, a first partial task, and the partial task corresponding to the remaining task amount is used as a second partial task.
9. A display screen, characterized in that: It includes a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the display screen projection control method described in any one of claims 1 to 8.
10. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the display screen projection control method described in any one of claims 1 to 8.
Citation Information
Patent Citations
Application icon display method, intelligent terminal and storage medium
CN115494994A
Cooperative work method and electronic equipment
CN116743761A
Screen projection processing method, device and equipment and computer readable storage medium
CN118192921A
Multi-screen collaborative control method, electronic device, and system
WO2024193301A1