Method and device for controlling screen display

Through wireless communication between smartphones and conference large screens, the use of smartphones to remotely control conference large screens is solved, and the problem of both accurate and remote control in the existing technology is solved, and flexible and efficient control methods are achieved.

CN112114762BActive Publication Date: 2024-12-06SZ PHOTOOL VISION CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010825222.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-08-17
Publication Date
2024-12-06
Estimated Expiration
2040-08-17

AI Technical Summary

Technical Problem

In the operation and control of large conference screens in the prior art, accurate control and control within a certain distance cannot be achieved. The touch screen requires close operation, while the control method of the remote control is limited and inaccurate.

Method used

Through wireless communication between the smartphone and the conference large screen, the smartphone sends screen control requests and receives data. The user operates on the smartphone to control the conference large screen, including clicking, multiple clicks, long pressing, dragging and sliding, etc. Operation, the smartphone sends operation information and position coordinates to the conference large screen for remote precise control.

Benefits of technology

It realizes precise control within a certain distance, avoids conflict problems caused by the large conference screen of multiple terminal devices simultaneously controlling multiple conference devices, and provides a more flexible and efficient control method.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112114762B_ABST
    Figure CN112114762B_ABST
Patent Text Reader

Abstract

The embodiment of the present application relates to a method and device for controlling screen display, the method comprising: a first terminal device sends a screen control request to a second terminal device, the first terminal device and the second terminal device are in a connected state; when the second terminal device determines that the first terminal device meets the screen control condition, the first terminal device receives the screen display data sent by the second terminal device; the first terminal device displays the screen content of the second terminal device according to the screen display data. Through the embodiment of the present application, the first terminal device sends a screen control request to the second terminal device, and when the second terminal determines that the first terminal device meets the screen control condition, the screen content of the second terminal device is mapped and displayed on the first terminal device, and the second terminal device can be controlled by operating the first terminal device, which solves the problem that precise control and control at a certain distance in the prior art cannot be achieved at the same time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of communication technology, and in particular to a method and device for controlling screen display. Background Art

[0002] At present, there are basically two ways to operate and control the conference screen. The first way is to touch the screen, where people stand in front of the screen and touch it directly. The advantage is that it can be controlled accurately, but the disadvantage is that it can only be controlled at a close distance in front of the screen. The second way is to use a remote control for non-touch screens. The advantage is that it can be operated within a certain distance, but the disadvantage is that the control methods supported by the remote control are very limited, and the diversity and accuracy cannot be compared with touch screen control. Generally speaking, the above two methods are not perfect, and they cannot have both accurate control and control at a certain distance. Summary of the invention

[0003] In order to solve at least one problem existing in the prior art, at least one embodiment of the present application provides a method and device for controlling screen display.

[0004] In a first aspect, an embodiment of the present application provides a method for controlling screen display, comprising:

[0005] The first terminal device sends a screen control request to the second terminal device, and the first terminal device and the second terminal device are in a connected state.

[0006] When the second terminal device determines that the first terminal device meets the screen control condition, the first terminal device receives the screen display data sent by the second terminal device.

[0007] The first terminal device displays the screen content of the second terminal device according to the data displayed on the screen.

[0008] It should be understood that in the embodiment of the present application, the first terminal device can be a smart phone, and the second terminal device can be a large conference screen. The smart phone and the large conference screen can be connected via wireless communication, and a screen control request is sent to the large conference screen via the smart phone. When the large conference screen receives the screen control request from the smart phone, it determines that the smart phone meets the screen control conditions, and then displays the content of the large conference screen on the smart phone.

[0009] It should be understood that the large conference screen can be controlled by operating a smart phone, which solves the problem in the prior art that precise control and control at a certain distance cannot be achieved at the same time.

[0010] In some embodiments, the above method further comprises:

[0011] The first terminal device receives a user operation.

[0012] Determine the operation information and the position coordinates corresponding to the operation according to the operation.

[0013] The first terminal device sends the operation information and location coordinates to the second terminal device.

[0014] The first terminal device receives the operation result sent by the second terminal device.

[0015] The operation includes any one of the following operations: single click, multi-click, long press, drag, and slide.

[0016] It should be understood that the content of the large conference screen is displayed on a smart phone. The user operates the smart phone. After the smart phone determines the operation information and the location coordinates corresponding to the operation, the operation information and location coordinates are sent to the large conference screen, thereby directly controlling the large conference screen through the smart phone. After controlling the large conference screen, the smart phone can also receive the control results of the large conference screen.

[0017] In some embodiments, the above method further comprises:

[0018] When the second terminal device determines that the first terminal device meets the screen control condition, the method further includes:

[0019] The first terminal device receives a first message sent by the second terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device; and

[0020] When the second terminal device determines that the first terminal device does not meet the screen control condition, the method further includes:

[0021] The first terminal device receives a second message sent by the second terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

[0022] It should be understood that if there is currently no mobile terminal or terminal such as a tablet computer other than the smartphone corresponding to the first terminal controlling the screen of the conference large screen, the screen control condition is met and the conference large screen sends a feedback message to the smartphone.

[0023] It should be understood that if there is currently a mobile terminal or a tablet computer other than the smartphone corresponding to the first terminal controlling the conference screen, the screen control condition is not met, and the conference screen sends a feedback message to the smartphone.

[0024] In some embodiments, the screen control conditions in the above method include:

[0025] The second terminal device determines that no other terminal device controls the screen of the second terminal device.

[0026] It should be understood that other terminals may be mobile phone terminals other than the smart phone corresponding to the first terminal. If there are currently mobile phone terminals other than the smart phone corresponding to the first terminal or terminals such as tablet computers controlling the conference screen, the screen control conditions are not met, thereby avoiding multiple terminal devices controlling the conference screen at the same time, causing conflicts, inconvenience in controlling the screen, and other problems.

[0027] In a second aspect, an embodiment of the present application provides a method for controlling screen display, including:

[0028] The second terminal device receives the screen control request sent by the first terminal device, and the first terminal device and the second terminal device are in a connected state.

[0029] It is determined that the first terminal device meets the screen control condition.

[0030] The second terminal device sends screen display data to the first terminal device.

[0031] It should be understood that in the embodiment of the present application, the first terminal device can be a smart phone, and the second terminal device can be a large conference screen. The smart phone and the large conference screen can be connected via wireless communication. The large conference screen receives the screen control request sent by the smart phone, and after determining that the smart phone meets the screen control conditions, the content of the large conference screen is displayed on the smart phone.

[0032] It should be understood that the large conference screen can be controlled by operating a smart phone, which solves the problem in the prior art that precise control and control at a certain distance cannot be achieved at the same time.

[0033] In some embodiments, the above method further comprises:

[0034] The second terminal device receives the operation information and the location coordinates corresponding to the operation sent by the first terminal device.

[0035] The second terminal device determines the user's operation based on the operation information and the location coordinates corresponding to the operation, and executes the user's operation.

[0036] The second terminal device determines an operation result after executing the user's operation, and sends the operation result to the first terminal device.

[0037] It should be understood that in the embodiment of the present application, after the smartphone displays the screen content of the conference screen, the smartphone receives the user's operation, wherein the operation includes any one of the following operations: single click, multi-click, long press, drag and slide. For example, when the smartphone displays a video, the video playback is paused by clicking the pause button.

[0038] It should be understood that the smartphone sends the operation information and location coordinates to the conference screen, and the conference screen operates the screen content of the conference screen according to the operation information and location coordinates. After the conference screen operates the screen content of the conference screen according to the operation information and location coordinates, it obtains the operation result, and the conference screen sends the operation result to the smartphone.

[0039] In some embodiments, in the above method, determining that the first terminal device meets the screen control condition includes:

[0040] It is determined that no other terminal device controls the screen of the second terminal device.

[0041] It should be understood that other terminals may be mobile phone terminals other than the smart phone corresponding to the first terminal. If there are currently mobile phone terminals other than the smart phone corresponding to the first terminal or terminals such as tablet computers controlling the conference screen, the screen control conditions are not met, thereby avoiding multiple terminal devices controlling the conference screen at the same time, causing conflicts, inconvenience in controlling the screen, and other problems.

[0042] In some embodiments, the above method further comprises:

[0043] The location coordinates corresponding to the operation performed on the second terminal device are determined according to the resolution of the first terminal device, the resolution of the second terminal device, and the location coordinates.

[0044] For example, the resolution of the smartphone is 2560*1440, and the resolution of the large conference screen is 1920*1080. After the user clicks the point with the position coordinates 300 / 450 on the smartphone, the position coordinates X and Y of the large conference screen are respectively: X=(300 / 1920)*2560=400; Y=(450 / 1080)*1440=600; that is, when the user clicks the position coordinates 300 / 450 on the smartphone, it is equivalent to clicking the position coordinates 400 / 600 of the large conference screen.

[0045] In some embodiments, when it is determined that the first terminal device meets the screen control condition, the method further includes:

[0046] Sending a first message to the first terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device; and

[0047] When it is determined that the first terminal device does not meet the screen control condition, the method further includes:

[0048] A second message is sent to the first terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

[0049] It should be understood that if there is currently no mobile terminal or terminal such as a tablet computer other than the smartphone corresponding to the first terminal controlling the screen of the conference large screen, the screen control condition is met and the conference large screen sends a feedback message to the smartphone.

[0050] It should be understood that if there is currently a mobile terminal or a tablet computer other than the smartphone corresponding to the first terminal controlling the conference screen, the screen control condition is not met, and the conference screen sends a feedback message to the smartphone.

[0051] In a third aspect, an embodiment of the present application provides a device for controlling screen display, including:

[0052] Sending module: used for the first terminal device to send a screen control request to the second terminal device, and the first terminal device and the second terminal device are in a connected state.

[0053] Receiving module: used for the first terminal device to receive the screen display data sent by the second terminal device when the second terminal device determines that the first terminal device meets the screen control condition.

[0054] Display module: used for the first terminal device to display the screen content of the second terminal device according to the data displayed on the screen.

[0055] It should be understood that in the embodiment of the present application, the first terminal device can be a smart phone, and the second terminal device can be a large conference screen. The smart phone and the large conference screen can be connected via wireless communication. When the large conference screen receives a screen control request from the smart phone, it determines that the smart phone meets the screen control conditions and then displays the content of the large conference screen on the smart phone.

[0056] It should be understood that the large conference screen can be controlled by operating a smart phone, which solves the problem in the prior art that precise control and control at a certain distance cannot be achieved at the same time.

[0057] In some embodiments, the receiving module in the above device is further used for:

[0058] The first terminal device receives a user operation.

[0059] Determine the operation information and the position coordinates corresponding to the operation according to the operation.

[0060] The first terminal device sends the operation information and location coordinates to the second terminal device.

[0061] The first terminal device receives the operation result sent by the second terminal device.

[0062] The operation includes any one of the following operations: single click, multi-click, long press, drag, and slide.

[0063] It should be understood that the content of the large conference screen is displayed on a smart phone. After the receiving module of the smart phone receives the user's operation, it determines the operation information corresponding to the operation and the location coordinates corresponding to the operation, and then sends the operation information and location coordinates to the large conference screen, thereby directly controlling the large conference screen through the smart phone. After controlling the large conference screen, the receiving module of the smart phone can also receive the control results of the large conference screen.

[0064] In some embodiments, the receiving module in the above device is further used for:

[0065] When the second terminal device determines that the first terminal device meets the screen control condition, the method further includes:

[0066] The first terminal device receives a first message sent by the second terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device; and

[0067] When the second terminal device determines that the first terminal device does not meet the screen control condition, the method further includes:

[0068] The first terminal device receives a second message sent by the second terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

[0069] It should be understood that if there is currently no mobile terminal or tablet computer other than the smartphone corresponding to the first terminal controlling the conference screen, the screen control condition is met and the smartphone receives the feedback message sent by the conference screen.

[0070] It should be understood that if there is currently a mobile terminal or a tablet computer other than the smartphone corresponding to the first terminal controlling the conference screen, the screen control condition is not met, and the smartphone receives the feedback message sent by the conference screen.

[0071] In some embodiments, the receiving module in the above device is further used for:

[0072] The second terminal device determines that no other terminal device controls the screen of the second terminal device.

[0073] It should be understood that other terminals may be mobile phone terminals other than the smart phone corresponding to the first terminal. If there are currently mobile phone terminals other than the smart phone corresponding to the first terminal or terminals such as tablet computers controlling the conference screen, the screen control conditions are not met, thereby avoiding multiple terminal devices controlling the conference screen at the same time, causing conflicts, inconvenience in controlling the screen, and other problems.

[0074] In a fourth aspect, an embodiment of the present application provides a device for controlling screen display, including:

[0075] Receiving module: used for the second terminal device to receive the screen control request sent by the first terminal device, and the first terminal device and the second terminal device are in a connected state.

[0076] Determination module: used to determine whether the first terminal device meets the screen control condition.

[0077] Sending module: used for the second terminal device to send screen display data to the first terminal device.

[0078] It should be understood that in the embodiment of the present application, the first terminal device can be a smart phone, and the second terminal device can be a large conference screen. The smart phone and the large conference screen can be connected via wireless communication. The large conference screen receives the screen control request sent by the smart phone, and after determining that the smart phone meets the screen control conditions, the content of the large conference screen is displayed on the smart phone.

[0079] It should be understood that the large conference screen can be controlled by operating a smart phone, which solves the problem in the prior art that precise control and control at a certain distance cannot be achieved at the same time.

[0080] In some embodiments, the receiving module of the above device is further used for:

[0081] The second terminal device receives the operation information and the location coordinates corresponding to the operation sent by the first terminal device.

[0082] The second terminal device determines the user's operation based on the operation information and the location coordinates corresponding to the operation, and executes the user's operation.

[0083] The second terminal device determines an operation result after executing the user's operation, and sends the operation result to the first terminal device.

[0084] It should be understood that in the embodiment of the present application, after the smartphone displays the screen content of the conference screen, the smartphone receives the user's operation, wherein the operation includes any one of the following operations: single click, multi-click, long press, drag and slide. For example, when the smartphone displays a video, the video playback is paused by clicking the pause button.

[0085] It should be understood that the smartphone sends the operation information and location coordinates to the conference screen, and the conference screen operates the screen content of the conference screen according to the operation information and location coordinates. After the conference screen operates the screen content of the conference screen according to the operation information and location coordinates, it obtains the operation result, and the conference screen sends the operation result to the smartphone.

[0086] In some embodiments, the determining module in the above apparatus is further configured to include:

[0087] It is determined that no other terminal device controls the screen of the second terminal device.

[0088] It should be understood that other terminals may be mobile phone terminals other than the smart phone corresponding to the first terminal. If there are currently mobile phone terminals other than the smart phone corresponding to the first terminal or terminals such as tablet computers controlling the conference screen, the screen control conditions are not met, thereby avoiding multiple terminal devices controlling the conference screen at the same time, causing conflicts, inconvenience in controlling the screen, and other problems.

[0089] In some embodiments, the determining module in the above apparatus is further configured to include:

[0090] The location coordinates corresponding to the operation performed on the second terminal device are determined according to the resolution of the first terminal device, the resolution of the second terminal device, and the location coordinates.

[0091] For example, the resolution of the smartphone is 2560*1440, and the resolution of the large conference screen is 1920*1080. After the user clicks the point with the position coordinates 300 / 450 on the smartphone, the position coordinates X and Y of the large conference screen are respectively: X=(300 / 1920)*2560=400; Y=(450 / 1080)*1440=600; that is, when the user clicks the position coordinates 300 / 450 on the smartphone, it is equivalent to clicking the position coordinates 400 / 600 of the large conference screen.

[0092] In some embodiments, when the determination module in the above apparatus determines that the first terminal device meets the screen control condition, it is further configured to:

[0093] Sending a first message to the first terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device; and

[0094] When the determining module in the above device determines that the first terminal device does not meet the screen control condition, it is also used to:

[0095] A second message is sent to the first terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

[0096] It should be understood that if the determination module determines that there is currently no mobile terminal or tablet terminal other than the smartphone corresponding to the first terminal controlling the conference screen, the screen control condition is met and the conference screen sends a feedback message to the smartphone.

[0097] It should be understood that if the determination module determines that a mobile terminal or tablet computer other than the smartphone corresponding to the first terminal is currently controlling the conference screen, the screen control condition is not met and the conference screen sends a feedback message to the smartphone. BRIEF DESCRIPTION OF THE DRAWINGS

[0098] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application, and a person skilled in the art can also obtain other drawings based on these drawings.

[0099] Figure 1 is a schematic diagram of a method for controlling screen display provided by an embodiment of the present application;

[0100] Figure 2 is a schematic diagram of another method for controlling screen display provided in an embodiment of the present application;

[0101] Figure 3 is a schematic diagram of another method for controlling screen display provided in an embodiment of the present application;

[0102] Figure 4 is a schematic diagram of another method for controlling screen display provided in an embodiment of the present application;

[0103] Figure 5 is a schematic diagram of a device for controlling screen display provided in an embodiment of the present application;

[0104] Figure 6 This is a schematic diagram of another device for controlling screen display provided in an embodiment of the present application. DETAILED DESCRIPTION

[0105] In order to more clearly understand the above-mentioned purpose, features and advantages of the present application, the present disclosure is further described in detail below in conjunction with the accompanying drawings and examples. It is to be understood that the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. The specific embodiments described herein are merely used to explain the present disclosure, rather than to limit the present application. Based on the described embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0106] It should be noted that, in this document, relational terms such as “first” and “second” are merely used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations.

[0107] At present, there are basically two ways to operate and control the large conference screen. One is the touch screen, where people stand in front of the screen and touch it directly. The advantage is that it can be controlled accurately, but the disadvantage is that it can only be controlled at a close distance. The other is the non-touch screen, where it is controlled by a remote control. The advantage is that it can be operated within a certain distance, but the disadvantage is that the control methods supported by the remote control are very limited, and the diversity and accuracy cannot be compared with touch screen control. Generally speaking, the above two methods are not perfect, and they cannot have both accurate control and control at a certain distance.

[0108] Figure 1 It is a schematic diagram of a method for controlling screen display provided in an embodiment of the present application.

[0109] In view of this, in a first aspect, an embodiment of the present application provides a method for controlling screen display, combining Figure 1 , including the following three steps S101, S102 and S103:

[0110] S101: A first terminal device sends a screen control request to a second terminal device, and the first terminal device and the second terminal device are in a connected state.

[0111] It should be understood that in the embodiment of the present application, the first terminal device can be a smart phone, a computer, a tablet computer and other devices, and the second terminal device can be a television, a large conference screen and other devices. The following will take the first terminal device as a smart phone and the second terminal device as a large conference screen as an example to describe the embodiment of the present application in detail.

[0112] Exemplarily, the smartphone sends a screen control request to the conference screen. Specifically, it may be an application corresponding to the smartphone. When the mirrored reverse control of the application receives a click from the user, the screen control request is sent to the conference screen of the controller.

[0113] In a possible implementation manner, the first terminal device is connected to the second terminal device, and the connection between the first terminal device and the second terminal device may be in the following multiple ways:

[0114] The first method: The smartphone and the conference screen are connected to the same network. The second method: The conference screen shares a hotspot network, and the smartphone connects to the hotspot network shared by the conference screen. The third method: The smartphone and the conference screen have the same user account. The fourth method: The conference screen shares Bluetooth, and the smartphone connects to the Bluetooth shared by the conference screen. The fifth method: The conference screen and the smartphone can also be connected via NFC.

[0115] S102: When the second terminal device determines that the first terminal device meets the screen control condition, the first terminal device receives screen display data sent by the second terminal device.

[0116] It should be understood that when the large conference screen determines that the smartphone meets the screen control conditions, the smartphone receives the screen display data sent by the large conference screen. The screen display data can be sent from the large conference screen to the smartphone in the H264 code stream format.

[0117] Specifically, the screen control conditions in the embodiment of the present application include:

[0118] The second terminal device determines that no other terminal device controls the screen of the second terminal device.

[0119] Specifically, other terminals may be mobile phone terminals other than the smart phone corresponding to the first terminal. If there are currently mobile phone terminals other than the smart phone corresponding to the first terminal or terminals such as tablet computers controlling the conference screen, the screen control conditions are not met, thereby avoiding multiple terminal devices controlling the conference screen at the same time, causing conflicts, inconvenience in controlling the screen, and other problems.

[0120] In some embodiments, the above method further comprises:

[0121] When the second terminal device determines that the first terminal device meets the screen control condition, the method further includes:

[0122] The first terminal device receives a first message sent by the second terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device.

[0123] It should be understood that if there is currently no mobile terminal or tablet computer or other terminal other than the smart phone corresponding to the first terminal to control the screen of the conference large screen, the screen control condition is met, and the conference large screen sends a feedback message to the smart phone, that is, the smart phone meets the screen control condition, and the smart phone receives the screen display data sent by the conference large screen.

[0124] When the second terminal device determines that the first terminal device does not meet the screen control condition, the method further includes:

[0125] The first terminal device receives a second message sent by the second terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

[0126] It should be understood that if there is currently a mobile phone terminal or tablet computer other than the smartphone corresponding to the first terminal controlling the conference screen, the screen control condition is not met, and the conference screen sends a feedback message to the smartphone, indicating that the screen control condition is not met, so that the user can promptly understand that he cannot control the conference screen, promptly identify the cause, and take countermeasures.

[0127] S103: The first terminal device displays the screen content of the second terminal device according to the data displayed on the screen.

[0128] It should be understood that the data displayed on the screen can be data in the H264 code stream format sent from the conference large screen to the smart phone, and the smart phone decodes and displays the data in the H264 code stream format. At this point, the smart phone displays the screen content of the conference large screen, and the screen content can be a PPT document, word document, image, video, etc.

[0129] In summary, the first terminal device can be a smart phone, and the second terminal device can be a large conference screen. The smart phone and the large conference screen can be connected via wireless communication. The smart phone sends a screen control request to the large conference screen. When the large conference screen receives the screen control request from the smart phone, it determines that the smart phone meets the screen control conditions, and then displays the content of the large conference screen on the smart phone. The large conference screen can be controlled by controlling the smart phone.

[0130] It should be understood that after the smartphone displays the screen content of the conference large screen, the user can control the conference large screen by operating the smartphone. The control process is introduced below in conjunction with steps S201, S202, S203 and S204.

[0131] Figure 2 This is a schematic diagram of another method for controlling screen display provided in an embodiment of the present application.

[0132] In some embodiments, in combination Figure 2 , the above method further comprises:

[0133] S201: The first terminal device receives a user operation.

[0134] It should be understood that after the smartphone displays the screen content of the conference screen, the smartphone receives the user's operation, wherein the operation includes any one of the following operations: single click, multi-click, long press, drag and slide. For example, when the smartphone displays a video, the video playback can be paused by clicking the pause button; when the smartphone displays a PPT document, the PPT document can be annotated by sliding.

[0135] S202: Determine operation information and position coordinates corresponding to the operation according to the operation.

[0136] In one possible implementation, after receiving an operation from a user, the smartphone determines the operation information and the location coordinates corresponding to the operation based on the operation. For example, when the smartphone receives a single-click operation from a user, the smartphone determines the operation information and the location coordinates of the single-click operation based on the single-click operation.

[0137] S203: The first terminal device sends the operation information and location coordinates to the second terminal device.

[0138] In a possible implementation, the smart phone sends the operation information and the location coordinates to the large conference screen, and the large conference screen operates the screen content of the large conference screen according to the operation information and the location coordinates.

[0139] S204: The first terminal device receives the operation result sent by the second terminal device.

[0140] Specifically, in the embodiment of the present application, the large conference screen operates the screen content of the large conference screen according to the operation information and the position coordinates to obtain the operation result, and the large conference screen sends the operation result to the smart phone.

[0141] In summary, the content of the conference screen is displayed on the smartphone. The user operates the smartphone. After the smartphone determines the operation information and the location coordinates corresponding to the operation, the operation information and location coordinates are sent to the conference screen, thereby directly controlling the conference screen through the smartphone. After controlling the conference screen, the smartphone can also receive the control results of the conference screen.

[0142] It should be understood that the execution subject of the method for controlling the display of the screen in the first aspect is the first terminal, and the second aspect below will introduce the embodiment of the present application by assuming that the execution subject of the method for controlling the display of the screen is the second terminal.

[0143] Figure 3 This is a schematic diagram of another method for controlling screen display provided in an embodiment of the present application.

[0144] In a second aspect, the present application embodiment provides a method for controlling screen display, combining Figure 3 , including the following steps S301, S302 and S303:

[0145] S301: The second terminal device receives a screen control request sent by the first terminal device, and the first terminal device and the second terminal device are in a connected state.

[0146] It should be understood that in the embodiments of the present application, the first terminal device may be a smart phone, a computer, a tablet computer, or other device, and the second terminal device may be a television, a large conference screen, or other device. The embodiments of the present application are described in detail using the example that the first terminal device is a smart phone and the second terminal device is a large conference screen.

[0147] Exemplarily, the large conference screen receives a screen control request sent by a smart phone. Specifically, the large conference screen receives a screen control request message sent by the smart phone.

[0148] In a possible implementation manner, the first terminal device is connected to the second terminal device, and the connection between the first terminal device and the second terminal device may be in the following multiple ways:

[0149] The first method: The smartphone and the conference screen are connected to the same network. The second method: The conference screen shares a hotspot network, and the smartphone connects to the hotspot network shared by the conference screen. The third method: The smartphone and the conference screen have the same user account. The fourth method: The conference screen shares Bluetooth, and the smartphone connects to the Bluetooth shared by the conference screen. The fifth method: The conference screen and the smartphone can also be connected via NFC.

[0150] S302: Determine whether the first terminal device meets the screen control condition.

[0151] In some embodiments, in the above method, determining that the first terminal device meets the screen control condition includes:

[0152] It is determined that no other terminal device controls the screen of the second terminal device.

[0153] Specifically, other terminals may be mobile phone terminals other than the smart phone corresponding to the first terminal. If there are currently mobile phone terminals other than the smart phone corresponding to the first terminal or terminals such as tablet computers controlling the conference screen, the screen control conditions are not met, thereby avoiding multiple terminal devices controlling the conference screen at the same time, causing conflicts, inconvenience in controlling the screen, and other problems.

[0154] In some embodiments, when it is determined that the first terminal device meets the screen control condition, the method further includes:

[0155] A first message is sent to the first terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device.

[0156] It should be understood that if there is currently no mobile terminal or tablet computer or other terminal other than the smart phone corresponding to the first terminal to control the screen of the conference large screen, the screen control condition is met, and the conference large screen sends a feedback message to the smart phone, that is, the smart phone meets the screen control condition, and the smart phone receives the screen display data sent by the conference large screen.

[0157] When it is determined that the first terminal device does not meet the screen control condition, the method further includes:

[0158] A second message is sent to the first terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

[0159] It should be understood that if there is currently a mobile phone terminal or tablet computer other than the smartphone corresponding to the first terminal controlling the conference screen, the screen control condition is not met, and the conference screen sends a feedback message to the smartphone, indicating that the screen control condition is not met, so that the user can promptly understand that he cannot control the conference screen, promptly identify the cause, and take countermeasures.

[0160] S303: The second terminal device sends screen display data to the first terminal device.

[0161] It should be understood that when the smartphone meets the screen control conditions, the conference screen sends the screen display data to the smartphone. The screen display data can be data in the H264 code stream format. After being sent from the conference screen to the smartphone, the smartphone decodes and displays the H264 code stream format data. At this point, the smartphone displays the screen content of the conference screen. The screen content can be a PPT document, word document, image, video, etc.

[0162] It should be understood that in the embodiment of the present application, the first terminal device may be a smart phone, and the second terminal device may be a large conference screen. The smart phone and the large conference screen may be connected via wireless communication. The large conference screen receives a screen control request sent by the smart phone, and after determining that the smart phone meets the screen control conditions, the content of the large conference screen is displayed on the smart phone. The large conference screen can be controlled by operating the smart phone, which solves the problem in the prior art that precise control and control at a certain distance cannot be achieved at the same time.

[0163] Figure 4 This is a schematic diagram of another method for controlling screen display provided in an embodiment of the present application.

[0164] In some embodiments, in combination Figure 4 , the above method further comprises:

[0165] S401: The second terminal device receives the operation information and the location coordinates corresponding to the operation sent by the first terminal device.

[0166] It should be understood that after the smartphone displays the screen content of the conference screen, the smartphone receives the user's operation, wherein the operation includes any one of the following operations: single click, multi-click, long press, drag and slide. For example, when the smartphone displays a video, the video playback can be paused by clicking the pause button; when the smartphone displays a PPT document, the PPT document can be annotated by sliding.

[0167] In one possible implementation, after receiving an operation from a user, the smartphone determines the operation information and the location coordinates corresponding to the operation based on the operation. For example, when the smartphone receives a single-click operation from a user, the smartphone determines the operation information and the location coordinates of the single-click operation based on the single-click operation.

[0168] S402: The second terminal device determines the user's operation according to the operation information and the location coordinates corresponding to the operation, and executes the user's operation.

[0169] In a possible implementation, the smart phone sends the operation information and the location coordinates to the large conference screen, and the large conference screen operates the screen content of the large conference screen according to the operation information and the location coordinates.

[0170] S403: The second terminal device determines an operation result after executing the user's operation, and sends the operation result to the first terminal device.

[0171] Specifically, in the embodiment of the present application, the large conference screen operates the screen content of the large conference screen according to the operation information and the position coordinates to obtain the operation result, and the large conference screen sends the operation result to the smart phone.

[0172] It should be understood that the resolutions of a smartphone and a large conference screen are different. The following describes how to determine the position coordinates of a large conference screen based on the position coordinates of a smartphone.

[0173] In some embodiments, the above method further comprises:

[0174] The location coordinates corresponding to the operation performed on the second terminal device are determined according to the resolution of the first terminal device, the resolution of the second terminal device, and the location coordinates.

[0175] For example, the resolution of the smartphone is x1*y1, and the resolution of the conference screen is x2*y2. When a click operation is performed on the smartphone, the smartphone determines the position coordinates x and y of the click, and the conference screen can convert the position coordinates X and Y of the conference screen corresponding to the smartphone position coordinates x and y:

[0176] X = (x / x1)*x2;

[0177] Y = (y / y1)*y2;

[0178] For example, if the resolution of a smartphone is 2560*1440 and the resolution of a conference screen is 1920*1080, after the user clicks the point with coordinates 300 / 450 on the smartphone, the X and Y coordinates of the conference screen are:

[0179] X = (300 / 1920) * 2560 = 400;

[0180] Y = (450 / 1080) * 1440 = 600;

[0181] That is, if a user clicks the location coordinates 300 / 450 on a smartphone, it is equivalent to clicking the location coordinates 400 / 600 on the conference screen.

[0182] Through the above steps, the large screen is clicked according to the position coordinates of the smart phone, thereby completing the control of the large screen by the mobile phone.

[0183] Figure 5 This is a schematic diagram of another device for controlling screen display provided in an embodiment of the present application.

[0184] In a third aspect, the present application embodiment provides a device for controlling screen display, in combination with Figure 5 , including a sending module 501, a receiving module 502 and a display module 503:

[0185] Sending module 501: used for a first terminal device to send a screen control request to a second terminal device, and the first terminal device and the second terminal device are in a connected state.

[0186] Receiving module 502: configured for the first terminal device to receive screen display data sent by the second terminal device when the second terminal device determines that the first terminal device meets the screen control condition.

[0187] Display module 503: used for the first terminal device to display the screen content of the second terminal device according to the data displayed on the screen.

[0188] It should be understood that in the embodiment of the present application, the first terminal device can be a smart phone, and the second terminal device can be a large conference screen. The smart phone and the large conference screen can be connected via wireless communication. The sending module of the smart phone sends a screen control request to the large conference screen. When the receiving module of the large conference screen receives the screen control request of the smart phone, it determines that the smart phone meets the screen control conditions, and then the display module displays the content of the large conference screen on the smart phone.

[0189] It should be understood that the large conference screen can be controlled by operating a smart phone, which solves the problem in the prior art that precise control and control at a certain distance cannot be achieved at the same time.

[0190] In some embodiments, the receiving module in the above device is further used for:

[0191] The first terminal device receives a user operation.

[0192] Determine the operation information and the position coordinates corresponding to the operation according to the operation.

[0193] The first terminal device sends the operation information and location coordinates to the second terminal device.

[0194] The first terminal device receives the operation result sent by the second terminal device.

[0195] The operation includes any one of the following operations: single click, multi-click, long press, drag, and slide.

[0196] It should be understood that the content of the large conference screen is displayed on a smart phone. After the receiving module of the smart phone receives the user's operation, it determines the operation information corresponding to the operation and the location coordinates corresponding to the operation, and then sends the operation information and location coordinates to the large conference screen, thereby directly controlling the large conference screen through the smart phone. After controlling the large conference screen, the receiving module of the smart phone can also receive the control results of the large conference screen.

[0197] In some embodiments, the receiving module in the above device is further used for:

[0198] When the second terminal device determines that the first terminal device meets the screen control condition, the method further includes:

[0199] The first terminal device receives a first message sent by the second terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device; and

[0200] When the second terminal device determines that the first terminal device does not meet the screen control condition, the method further includes:

[0201] The first terminal device receives a second message sent by the second terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

[0202] It should be understood that if there is currently no mobile terminal or tablet computer or other terminal other than the smart phone corresponding to the first terminal to control the screen of the conference large screen, the screen control condition is met, and the smart phone receives the feedback message sent by the conference large screen, that is, the smart phone meets the screen control condition, and thus the smart phone receives the screen display data sent by the conference large screen.

[0203] It should be understood that if there is currently a mobile terminal or tablet computer other than the smart phone corresponding to the first terminal controlling the screen of the conference large screen, the screen control condition is not met, and the smart phone receives a feedback message sent by the conference large screen, which indicates that the screen control condition is not met. Thus, the user can promptly understand that he cannot control the conference large screen, promptly identify the cause, and take countermeasures.

[0204] In some embodiments, the receiving module in the above device is further used for:

[0205] The second terminal device determines that no other terminal device controls the screen of the second terminal device.

[0206] It should be understood that other terminals may be mobile phone terminals other than the smart phone corresponding to the first terminal. If there are mobile phone terminals or tablet computers other than the smart phone corresponding to the first terminal currently controlling the conference screen, the screen control conditions are not met.

[0207] In a fourth aspect, an embodiment of the present application provides a device for controlling screen display, including:

[0208] Receiving module 601: used for the second terminal device to receive a screen control request sent by the first terminal device, and the first terminal device and the second terminal device are in a connected state.

[0209] Determination module 602: used to determine whether the first terminal device meets the screen control condition.

[0210] Sending module 603: used for the second terminal device to send screen display data to the first terminal device.

[0211] It should be understood that in the embodiment of the present application, the first terminal device can be a smart phone, and the second terminal device can be a large conference screen. The smart phone and the large conference screen can be connected via wireless communication. The large conference screen receives the screen control request sent by the smart phone, and after determining that the smart phone meets the screen control conditions, the content of the large conference screen is displayed on the smart phone.

[0212] It should be understood that the large conference screen can be controlled by operating a smart phone, which solves the problem in the prior art that precise control and control at a certain distance cannot be achieved at the same time.

[0213] In some embodiments, the receiving module of the above device is further used for:

[0214] The second terminal device receives the operation information and the location coordinates corresponding to the operation sent by the first terminal device.

[0215] The second terminal device determines the user's operation based on the operation information and the location coordinates corresponding to the operation, and executes the user's operation.

[0216] The second terminal device determines an operation result after executing the user's operation, and sends the operation result to the first terminal device.

[0217] It should be understood that in the embodiment of the present application, after the smartphone displays the screen content of the conference screen, the smartphone receives the user's operation, wherein the operation includes any one of the following operations: single click, multi-click, long press, drag and slide. For example, when the smartphone displays a video, the video playback is paused by clicking the pause button.

[0218] It should be understood that the smartphone sends the operation information and location coordinates to the conference screen, and the conference screen operates the screen content of the conference screen according to the operation information and location coordinates. After the conference screen operates the screen content of the conference screen according to the operation information and location coordinates, it obtains the operation result, and the conference screen sends the operation result to the smartphone.

[0219] In some embodiments, the determining module in the above apparatus is further configured to include:

[0220] It is determined that no other terminal device controls the screen of the second terminal device.

[0221] It should be understood that other terminals may be mobile phone terminals other than the smart phone corresponding to the first terminal. If there are currently mobile phone terminals other than the smart phone corresponding to the first terminal or terminals such as tablet computers controlling the conference screen, the screen control conditions are not met, thereby avoiding multiple terminal devices controlling the conference screen at the same time, causing conflicts, inconvenience in controlling the screen, and other problems.

[0222] In some embodiments, the determining module in the above apparatus is further configured to include:

[0223] The location coordinates corresponding to the operation performed on the second terminal device are determined according to the resolution of the first terminal device, the resolution of the second terminal device, and the location coordinates.

[0224] For example, the resolution of the smartphone is 2560*1440, and the resolution of the large conference screen is 1920*1080. After the user clicks the point with the position coordinates 300 / 450 on the smartphone, the position coordinates X and Y of the large conference screen are respectively: X=(300 / 1920)*2560=400; Y=(450 / 1080)*1440=600; that is, when the user clicks the position coordinates 300 / 450 on the smartphone, it is equivalent to clicking the position coordinates 400 / 600 of the large conference screen.

[0225] In some embodiments, when the determination module in the above apparatus determines that the first terminal device meets the screen control condition, it is further configured to:

[0226] Sending a first message to the first terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device; and

[0227] When the determining module in the above device determines that the first terminal device does not meet the screen control condition, it is also used to:

[0228] A second message is sent to the first terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

[0229] It should be understood that if there is currently no mobile terminal or terminal such as a tablet computer other than the smartphone corresponding to the first terminal controlling the screen of the conference large screen, the screen control condition is met and the conference large screen sends a feedback message to the smartphone.

[0230] It should be understood that if there is currently a mobile terminal or a tablet computer other than the smartphone corresponding to the first terminal controlling the conference screen, the screen control condition is not met, and the conference screen sends a feedback message to the smartphone.

[0231] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0232] Those skilled in the art will appreciate that although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features from different embodiments is meant to be within the scope of the present application and to form different embodiments.

[0233] Those skilled in the art will appreciate that the description of each embodiment has its own emphasis, and for parts not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0234] Although the embodiments of the present application have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present application, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A method for controlling screen display, It is characterized in that The method comprises: A first terminal device sends a screen control request to a second terminal device, and the first terminal device and the second terminal device are in a connected state; When the second terminal device determines that the first terminal device meets the screen control condition, the first terminal device receives the screen display data sent by the second terminal device, and the screen control condition includes: the second terminal device determines that no other terminal device controls the screen of the second terminal device; The first terminal device displays the screen content of the second terminal device according to the data displayed on the screen; The first terminal device receives a user operation; Determine operation information and position coordinates corresponding to the operation according to the operation; The first terminal device sends the operation information and the location coordinates to the second terminal device; The first terminal device receives the operation result sent by the second terminal device.

2. The method according to claim 1, It is characterized in that The user operation includes any one of the following operations: single click, multi-click, long press, drag and slide.

3. The method according to claim 1 or 2, It is characterized in that When the second terminal device determines that the first terminal device meets the screen control condition, the method further includes: The first terminal device receives a first message sent by the second terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device; and When the second terminal device determines that the first terminal device does not meet the screen control condition, the method further includes: The first terminal device receives a second message sent by the second terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

4. A method for controlling screen display, It is characterized in that The method comprises: The second terminal device receives a screen control request sent by the first terminal device, and the first terminal device and the second terminal device are in a connected state; Determining that the first terminal device satisfies a screen control condition, wherein the screen control condition includes: determining that no other terminal device performs screen control on the second terminal device; The second terminal device sends screen display data to the first terminal device; The second terminal device receives the operation information and the position coordinates corresponding to the operation sent by the first terminal device; The second terminal device determines the user's operation according to the operation information and the position coordinates corresponding to the operation, and executes the user's operation; The second terminal device determines an operation result after executing the user's operation, and sends the operation result to the first terminal device.

5. The method according to claim 4, It is characterized in that The method further comprises: The location coordinates corresponding to performing the operation on the second terminal device are determined according to the resolution of the first terminal device, the resolution of the second terminal device, and the location coordinates.

6. The method according to claim 4, It is characterized in that When it is determined that the first terminal device meets the screen control condition, the method further includes: sending a first message to the first terminal device, where the first message is used to instruct the first terminal device to receive screen display data sent by the second terminal device; and When it is determined that the first terminal device does not meet the screen control condition, the method further includes: A second message is sent to the first terminal device, where the second message is used to indicate that the first terminal device does not meet the screen control condition.

7. A device for controlling screen display, It is characterized in that include: A sending module, a determining module and a display module, wherein the sending module, the determining module and the display module cooperate with each other to execute the method according to any one of claims 1 to 6.