Screen transmission output control method, screen transmission device, display device and storage medium
By converting user operations into optical signals through a screen sharing device, the problem of users having to move around to control the display device is solved, enabling convenient remote control and efficient signal transmission.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- GUANGZHOU SHIYUAN ELECTRONICS CO LTD
- Filing Date
- 2021-11-24
- Publication Date
- 2026-04-10
AI Technical Summary
In some application scenarios with display devices, users need to walk to the vicinity of the display device to control it, making the control process cumbersome, especially in meeting scenarios.
By establishing a connection between the screen sharing device and the display device, the user's operation is received and converted into a screen sharing light signal. The corresponding instructions are then executed on the display device using the photoelectric effect, thereby achieving remote control.
It simplifies the user's control process for display devices, improves the convenience and efficiency of screen sharing control, and optimizes the delay and synchronization of signal transmission.
Smart Images

Figure CN116166209B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of screen transmission, in particular to a screen transmission output control method, a screen transmission device, a display device and a storage medium. BACKGROUND
[0002] As a common screen transmission tool in life, the screen transmitter can be connected with an electronic device, and the display content of the electronic device is transmitted to the screen of the display device through wireless transmission, so as to facilitate the user to display and understand the display content more intuitively on the display device.
[0003] In some application scenarios with a display device, when different users need to control the display device, the control process will be very cumbersome due to the relatively fixed position of the display device. For example, in a conference scenario, a user sitting in a seat needs to walk to the vicinity of the display device to complete the control of the display device. SUMMARY
[0004] The present application provides a screen transmission output control method, a screen transmission device, a display device and a storage medium, and the technical solutions are as follows:
[0005] In a first aspect, the present application provides a screen transmission output control method, which is applied to a screen transmission device including a display interface, and the method includes:
[0006] establishing a connection with the display device;
[0007] when receiving a screen projection signal of the display device, switching a display picture in the display interface to a display picture of the display device;
[0008] the display interface is used to receive a user operation and determine parameters of a screen transmission light signal according to the user operation;
[0009] controlling the transmission of the screen transmission light signal to the display device based on the parameters of the screen transmission light signal, so that the display device executes an instruction corresponding to the user operation according to the screen transmission light signal.
[0010] In an optional solution of the first aspect, the screen transmission device includes a transmission component;
[0011] The method further includes:
[0012] determining a display interface position of the display device based on the transmission component of the screen transmission device;
[0013] calculating a display interface reference position of the display device and an initial transmission angle of the transmission component for sending the screen transmission light signal to the display interface reference position of the display device according to the display interface position of the display device.
[0014] In a further alternative of the first aspect, the type of user operation includes at least two types, and different types of user operation correspond to different types of instruction respectively.
[0015] In a further alternative of the first aspect, the user operation is a click operation.
[0016] Determining the parameter of the screen transmission light signal according to the user operation includes:
[0017] Determining the position of the click operation in the display interface of the screen transmission device;
[0018] Determining the position of the click operation in the display interface of the display device according to the position of the click operation in the display interface of the screen transmission device and the position of the display interface of the display device;
[0019] Calculating the distance between the position of the click operation in the display interface of the display device and the reference position of the display interface of the display device, and determining the first emission angle of the emission component for sending the screen transmission light signal according to the distance and the initial emission angle of the emission component;
[0020] Controlling the emission of the screen transmission light signal to the display device based on the parameter of the screen transmission light signal includes:
[0021] Sending the screen transmission light signal to the display device according to the first emission angle by the emission component.
[0022] In a further alternative of the first aspect, the user operation is a click operation, and the method further includes:
[0023] Obtaining the click duration of the click operation in the display interface;
[0024] If the click duration belongs to a preset duration interval, determining the parameter of the screen transmission light signal according to the user operation;
[0025] If the click duration does not belong to the preset duration interval, confirming that it is a false operation.
[0026] In a further alternative of the first aspect, the user operation is a sliding operation.
[0027] Determining the parameter of the screen transmission light signal according to the user operation includes:
[0028] Determining the initial position, the terminal position and the sliding track of the sliding operation in the display interface of the screen transmission device;
[0029] Determining the initial position and the terminal position of the sliding operation in the display interface of the display device according to the initial position, the terminal position and the sliding track of the sliding operation in the display interface of the screen transmission device and the position of the display interface of the display device;
[0030] calculate a distance between an initial position of the sliding operation in the display interface of the display device and a reference position of the display interface of the display device, and determine a second emission angle of the emission component for sending the through-screen light signal according to the distance and an initial emission angle of the emission component;
[0031] calculate a distance between a terminal position of the sliding operation in the display interface of the display device and the reference position of the display interface of the display device, and determine a third emission angle of the emission component for sending the through-screen light signal according to the distance and the initial emission angle of the emission component;
[0032] determine an emission trajectory of the emission component for emitting the through-screen light signal according to the sliding trajectory;
[0033] control the emission component to emit the through-screen light signal to the display device based on a parameter of the through-screen light signal, including:
[0034] send the through-screen light signal to the display device by the emission component from the second emission angle to the third emission angle according to the emission trajectory.
[0035] In a second aspect, the embodiments of the present application further provide a through-screen output control method, the method being applied to a display device, and the method comprising:
[0036] establish a connection with a through-screen device;
[0037] send a screen projection signal to the through-screen device, and project a display picture of the display device to the through-screen device for display;
[0038] receive a through-screen light signal sent by the through-screen device, and convert the received through-screen light signal into an electric signal;
[0039] execute an instruction corresponding to a user operation according to the electric signal.
[0040] In an optional solution of the second aspect, the display interface of the display device comprises a metal plate;
[0041] receive the through-screen light signal emitted by the through-screen device, and convert the received through-screen light signal into an electric signal, including:
[0042] receive the through-screen light signal sent by the through-screen device based on the metal plate, and determine a current value generated by the through-screen light signal on the metal plate;
[0043] execute the instruction corresponding to the user operation according to the electric signal, including:
[0044] determine a position corresponding to the user operation in the display interface of the display device according to the current value generated by the through-screen light signal on the metal plate;
[0045] execute the instruction corresponding to the user operation according to the position corresponding to the user operation in the display interface of the display device.
[0046] In a further alternative of the second aspect, determining the position of the user operation in the display interface of the display device according to the current values generated by the transmission screen light signal in the metal plate comprises:
[0047] calculating the ratio between the current values flowing through the four corners of the metal plate according to the current values flowing through the four corners of the metal plate generated by the transmission screen light signal in the metal plate;
[0048] determining the position of the user operation in the display interface of the display device according to the ratio between the current values flowing through the four corners of the metal plate.
[0049] In a further alternative of the second aspect, the types of the user operations include at least two, and different types of the user operations correspond to different types of the instructions respectively.
[0050] In a third aspect, embodiments of the present application provide a transmission screen device, the transmission screen device comprising a display interface, comprising:
[0051] a first communication module configured to establish a connection with the display device;
[0052] a switching module configured to switch the display screen in the display interface to the display screen of the display device when receiving the screen projection signal of the display device;
[0053] a first processing module configured to receive the user operation based on the display interface, and determine the parameter of the transmission screen light signal according to the user operation;
[0054] a sending module configured to control the transmission of the transmission screen light signal to the display device based on the parameter of the transmission screen light signal, so that the display device executes the instruction corresponding to the user operation according to the transmission screen light signal.
[0055] In an alternative of the third aspect, the transmission screen device comprises a transmission component;
[0056] The apparatus further comprises:
[0057] a fourth processing module configured to determine the display interface position of the display device based on the transmission component of the transmission screen device;
[0058] a fifth processing module configured to calculate the display interface reference position of the display device and the initial transmission angle of the transmission component sending the transmission screen light signal to the display interface reference position of the display device according to the display interface position of the display device.
[0059] In a further alternative of the third aspect, the types of the user operations include at least two, and different types of the user operations correspond to different types of the instructions respectively.
[0060] In a further alternative of the third aspect, the user operation is a click operation.
[0061] The first processing module comprises:
[0062] The first determining unit is configured to determine a position of the click operation in the display interface of the screen transmission device.
[0063] The second determining unit is configured to determine the position of the click operation in the display interface of the display device according to the position of the click operation in the display interface of the screen transmission device and the position of the display interface of the display device.
[0064] The third determining unit is configured to calculate a distance between the position of the click operation in the display interface of the display device and the reference position of the display interface of the display device, and determine a first emission angle of the emission component for sending the screen transmission light signal according to the distance and the initial emission angle of the emission component.
[0065] The sending module is specifically configured to send the screen transmission light signal to the display device according to the first emission angle of the emission component.
[0066] In another optional implementation of the third aspect, the user operation is a click operation, and the apparatus further comprises:
[0067] The obtaining module is configured to obtain a click duration of the click operation in the display interface of the screen transmission device.
[0068] The sixth processing module is configured to determine the parameter of the screen transmission light signal according to the user operation if the click duration belongs to a preset duration interval.
[0069] If the click duration does not belong to the preset duration interval, it is determined that the operation is a false operation.
[0070] In another optional implementation of the third aspect, the user operation is a sliding operation.
[0071] The first processing module comprises:
[0072] The first processing unit is configured to determine an initial position, a terminal position and a sliding track of the sliding operation in the display interface of the screen transmission device.
[0073] The second processing unit is configured to determine the initial position and the terminal position of the sliding operation in the display interface of the display device according to the initial position, the terminal position and the sliding track of the sliding operation in the display interface of the screen transmission device and the position of the display interface of the display device.
[0074] The third processing unit is configured to calculate a distance between the initial position of the sliding operation in the display interface of the display device and the reference position of the display interface of the display device, and determine a second emission angle of the emission component for sending the screen transmission light signal according to the distance and the initial emission angle of the emission component.
[0075] a fourth processing unit, configured to calculate a distance between an end position of the sliding operation in the display interface of the display device and a reference position of the display interface of the display device, and determine a third emission angle at which the emission component sends the light-through screen signal according to the distance and an initial emission angle of the emission component;
[0076] a fifth processing unit, configured to determine an emission trajectory of the emission component emitting the light-through screen signal according to the sliding trajectory.
[0077] The sending module is specifically configured to send the light-through screen signal to the display device by the emission component from the second emission angle to the third emission angle according to the emission trajectory.
[0078] In a fourth aspect, an embodiment of the present application provides a display device, comprising:
[0079] a second communication module, configured to establish a connection with the light-through screen device;
[0080] a screen projection module, configured to send a screen projection signal to the light-through screen device, and project a display picture of the display device to the light-through screen device for display;
[0081] a second processing module, configured to receive the light-through screen signal sent by the light-through screen device, and convert the received light-through screen signal into an electric signal;
[0082] a third processing module, configured to execute an instruction corresponding to the user operation according to the electric signal.
[0083] In an optional solution of the fourth aspect, the display interface of the display device comprises a metal plate.
[0084] The second processing module is specifically configured to receive the light-through screen signal sent by the light-through screen device based on the metal plate, and determine a current value generated by the light-through screen signal on the metal plate.
[0085] The third processing module is specifically configured to determine a position corresponding to the user operation in the display interface of the display device according to the current value generated by the light-through screen signal on the metal plate.
[0086] The instruction corresponding to the user operation is executed according to the position corresponding to the user operation in the display interface of the display device.
[0087] In another optional solution of the fourth aspect, the third processing module comprises:
[0088] a first calculation unit, configured to calculate a ratio between current values flowing through four corners of the metal plate according to the current values flowing through the four corners of the metal plate generated by the light-through screen signal on the metal plate;
[0089] a second calculation unit, configured to determine the position of the user operation in the display interface of the display device according to the ratio between the current values flowing through the four corners of the metal plate.
[0090] In a further alternative of the fourth aspect, the types of user operations include at least two, and different types of user operations correspond to different types of instructions respectively.
[0091] In a fifth aspect, the embodiments of the present application further provide a screen transmission device, comprising a processor, a display screen and a laser emitting head, wherein:
[0092] The display screen is connected with the processor, and is configured to receive a user operation;
[0093] The laser emitting head is connected with the processor, and the processor is configured to determine a parameter of a screen transmission light signal according to the user operation, and control the laser emitting head to emit the screen transmission light signal to a display device based on the parameter of the screen transmission light signal.
[0094] In a sixth aspect, the embodiments of the present application further provide a screen transmission device, comprising a processor and a memory;
[0095] The processor is connected with the memory;
[0096] The memory is configured to store executable program codes;
[0097] The processor runs a program corresponding to the executable program codes by reading the executable program codes stored in the memory, so as to execute the screen transmission output control method provided in the first aspect or any one of the implementation manners of the first aspect of the embodiments of the present application.
[0098] In a seventh aspect, the embodiments of the present application further provide a display device, comprising a processor, a display screen and a metal plate, wherein the metal plate is arranged below the display screen, and the display device comprises:
[0099] The metal plate is connected with the processor, and is configured to receive a screen transmission light signal sent by a screen transmission device, and convert the received screen transmission light signal into an electric signal; wherein the screen transmission device receives a user operation, and controls to send the screen transmission light signal to the metal plate based on the user operation;
[0100] The processor is connected with the display screen, and is configured to execute an instruction corresponding to the user operation on the display screen according to the electric signal.
[0101] In an eighth aspect, the embodiments of the present application further provide a display device, comprising a processor and a memory;
[0102] The processor is connected with the memory;
[0103] The memory is configured to store executable program codes;
[0104] The processor runs a program corresponding to the executable program codes by reading the executable program codes stored in the memory, so as to execute the screen transmission output control method provided in the second aspect or any one of the implementation manners of the second aspect of the embodiments of the present application.
[0105] In a ninth aspect, an embodiment of the present application provides a computer storage medium, which stores a computer program. The computer program includes program instructions. When the program instructions are executed by a processor, the method for screen transmission output control provided by the first aspect of the present application or any one of the implementation manners of the first aspect can be implemented.
[0106] In a tenth aspect, an embodiment of the present application provides a computer storage medium, which stores a computer program. The computer program includes program instructions. When the program instructions are executed by a processor, the method for screen transmission output control provided by the second aspect of the present application or any one of the implementation manners of the second aspect can be implemented.
[0107] In the embodiment of the present application, the screen transmission device receives a user operation based on a display interface, determines a parameter of a screen transmission light signal according to the user operation, and controls the screen transmission light signal to be transmitted to the display device based on the parameter of the screen transmission light signal, so that the display device executes an instruction corresponding to the user operation based on the screen transmission light signal. The user operation obtained by the screen transmission device can make the function of the screen transmission device more diversified, and the display device corresponding to the screen transmission device can convert the screen transmission light signal transmitted by the screen transmission device into an electrical signal, effectively optimize the time delay of signal transmission by using the photoelectric effect, and then guarantee the transmission efficiency and synchronization of signal transmission, thereby bringing a better screen transmission control experience to the user. BRIEF DESCRIPTION OF DRAWINGS
[0108] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without any creative effort based on these drawings.
[0109] Figure 1 An architecture schematic diagram of an existing screen transmission output control system provided by an embodiment of the present application;
[0110] Figure 2 An architecture schematic diagram of a screen transmission output control system provided by an embodiment of the present application;
[0111] Figure 3 A flow schematic diagram of a screen transmission output control method provided by an embodiment of the present application;
[0112] Figure 4 A touch screen current flow direction effect schematic diagram based on a user operation provided by an embodiment of the present application;
[0113] Figure 5 A flow schematic diagram of another screen transmission output control method provided by an embodiment of the present application;
[0114] Figure 6 An application scenario of a screen transmission output control method provided by an embodiment of the present application is shown in the figure.
[0115] Figure 7 An application scenario of another screen transmission output control method provided by an embodiment of the present application is shown in the figure.
[0116] Figure 8 A flowchart of another screen transmission output control method provided by an embodiment of the present application is shown in the figure.
[0117] Figure 9 An application scenario of another screen transmission output control method provided by an embodiment of the present application is shown in the figure.
[0118] Figure 10 A structure diagram of a screen transmission device provided by an embodiment of the present application is shown in the figure.
[0119] Figure 11 A structure diagram of a display device provided by an embodiment of the present application is shown in the figure.
[0120] Figure 12 A structure diagram of another screen transmission device provided by an embodiment of the present application is shown in the figure.
[0121] Figure 13 A structure diagram of another display device provided by an embodiment of the present application is shown in the figure. DETAILED DESCRIPTION
[0122] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application.
[0123] The terms “first”, “second”, “third”, etc. in the specification and claims of the present application and in the above-mentioned drawings are used to distinguish different objects, and are not used to describe a specific order. In addition, the terms “include” and “have” and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but can optionally include steps or units that are not listed, or can optionally include other steps or units that are inherent to the process, method, product or device.
[0124] Please refer to Figure 1 , Figure 1 A structure diagram of an existing screen transmission output control system provided by an embodiment of the present application is shown in the figure.
[0125] As Figure 1 shown, it can be seen that when the screen transmission device performs the screen transmission function, the corresponding screen transmission output control system can include a screen transmission device 101, a mobile terminal 102 and a display device 103, wherein:
[0126] The screen transmission device 101 can be used to transmit the current display screen of the mobile terminal 102 to the display device 103, so that the display screen of the display device 103 is the same as the current display screen of the mobile terminal 102. Specifically, the screen transmission device 101 can establish a first connection with the mobile terminal 102, so as to receive the current display screen transmitted by the mobile terminal 102. It can be understood that the first connection here can be but is not limited to a wired connection such as a USB interface, a TYPE-C interface, etc. After the connection between the screen transmission device 101 and the mobile terminal 102 is completed, the user can perform a screen transmission operation on the screen transmission device to make the mobile terminal 102 transmit the current display screen to the screen transmission device 101 through the wired connection. For example, the user can connect the USB interface of the screen transmission device 101 with the mobile terminal 102, and can receive the current display screen sent by the mobile terminal 102 by pressing the start button of the screen transmission device 101, but is not limited to this. Further, the screen transmission device 101 can also establish a second connection with the display device 103, so as to transmit the received current display screen sent by the mobile terminal 102 to the display device 103. It can be understood that the second connection here can be but is not limited to a wireless connection such as Bluetooth, WIFI, etc. After the connection between the screen transmission device 101 and the display device 103 is completed, the screen transmission device 101 transmits the current display screen sent by the mobile terminal 102 to the display device 103 through the wireless connection.
[0127] The mobile terminal 102 can be provided with a wired connection interface, so that the user can establish a connection with the screen transmission device 101 through the wired connection interface before transmitting the current display screen of the mobile terminal 102 to the display device 103 according to the needs. It can be understood that when the mobile terminal 102 establishes a connection with the screen transmission device 101, the current display interface of the mobile terminal 102 can also pop up a request interface for displaying the connection with the screen transmission device 101. After the user selects the control for confirming the request on the display interface of the mobile terminal 102, the mobile terminal 102 transmits the current display screen to the screen transmission device 101.
[0128] Of course, the mobile terminal 102 can also be installed with a third-party application program corresponding to the screen transmission device 101. After the user establishes a connection between the mobile terminal 102 and the screen transmission device 101, the current display screen of the mobile terminal 102 can be transmitted to the screen transmission device 101 according to the third-party application program, which is not limited in the embodiment.
[0129] The mobile terminal 102 involved in the embodiment can be a tablet computer, a desktop computer, a laptop computer, a notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a PC device, a personal digital assistant (PDA), a virtual reality device, etc.
[0130] The display device 103 can be operated by a user to perform a corresponding display function, for example, the user can click any third-party application icon included in the display interface of the display device 103, and the display device opens the interface of the third-party application according to the sensed third-party application icon. When the display device 103 needs to be used to display the current display interface of the mobile terminal 102, the display device 103 can establish a connection with the screen transmission device 101 through a wireless connection mode. It can be understood that when the display device 103 establishes a connection with the screen transmission device 101, the display interface of the display device 103 can pop up a request interface for displaying the connection of the screen transmission device 101, and the user can select a confirmation control of the request on the display interface of the display device 103, and then receive the current display interface of the mobile terminal 102 sent by the screen transmission device 101.
[0131] In some application scenarios in which a display device is used, when different users need to control the display device, the control process can be very cumbersome due to the relatively fixed position of the display device. For example, in a conference scenario, a user sitting in a seat needs to walk to the vicinity of the display device to complete the control of the display device.
[0132] To solve the above technical problems, please refer to Figure 2 , Figure 2 An architecture schematic diagram of a screen transmission output control system provided by an embodiment of the present application is shown.
[0133] As shown in Figure 2 , the screen transmission output control system includes a screen transmission device 201 and a display device 202, wherein:
[0134] The screen transmission device 201 can be used to obtain a user operation and transmit the user operation to the display interface of the display device 202 in the form of a light signal. The display device 202 can convert the light signal on the display interface into a corresponding electrical signal by using the photoelectric effect, and execute an instruction corresponding to the user operation on the display interface according to the electrical signal. It can be understood that the screen transmission device 201 can be provided with a touch screen for obtaining a user operation, and the position of the user operation on the touch screen can be determined according to the operation of the user on the touch screen. Here, the touch screen can be, but is not limited to, a capacitive touch screen or a touch screen with a temperature sensor. When the touch screen is a capacitive touch screen, the finger corresponding to the user operation can form a coupling capacitance with the capacitive touch screen when the finger is in contact with the capacitive touch screen. Since the capacitive touch screen is connected to a high-frequency signal, the finger corresponding to the user operation can absorb a certain current. The current flows out of the electrodes at the four corners of the capacitive touch screen, and the screen transmission device 201 can obtain the position of the finger corresponding to the user operation on the capacitive touch screen by calculating the proportion of the current flowing out of the electrodes at the four corners of the capacitive touch screen. When the touch screen is a touch screen with a temperature sensor, the data collected by the temperature sensor corresponding to the contact position can be different from the temperature sensor corresponding to the non-contact position when the finger corresponding to the user operation is in contact with the touch screen with a temperature sensor. The screen transmission device 201 can determine the position of the temperature sensor corresponding to the touch screen according to the distribution position of the temperature sensor on the touch screen.
[0135] Further, after the screen transmission device 201 determines the position of the user operation on the touch screen, the screen transmission device 201 can send a light signal representing the position information to the display device 202, and the position of the light signal on the display device 202 corresponds to the position of the user operation on the touch screen of the screen transmission device 201. It can be understood that the screen transmission device 201 can also be provided with a transmission component for emitting a light signal, and the transmission component can be controlled to send the light signal to the display interface of the display device 202. The transmission component can include one or more emission heads. For example, when the user operation is a click operation, the transmission component can include one emission head for emitting a light signal. When the user operation is a sliding operation or a plurality of simultaneous operations, the transmission component can include a plurality of emission heads that can emit light signals simultaneously. Here, the type of the emission head of the transmission component can be, but is not limited to, a laser emission head or an ultraviolet emission head, and the screen transmission device 201 can control the emission angle and the emission duration of each emission head.
[0136] It can also be understood that, in order to allow the user to more quickly and conveniently determine the target position of the user operation on the touch screen of the screen transmission device 201, the screen transmission device 201 can also establish a connection with the display device 202 before obtaining the user operation, so as to display the current display screen sent by the display device 202 on the touch screen of the screen transmission device 201. It can be understood that the connection mode can be, but is not limited to, a wireless connection such as Bluetooth or WIFI. After the screen transmission device 201 and the display device 202 are connected, the display device 202 sends the current display screen to the screen transmission device 201 through the wireless connection mode, and the screen transmission device 201 can scale the current display screen of the display device 202 according to a preset ratio and display it on the display screen of the touch screen, so as to allow the user to quickly determine the target position of the user operation according to the display interface of the touch screen of the screen transmission device 201. Of course, the user can also directly adjust and determine the target position of the user operation according to the position of the user operation on the display device 202. For example, the user can place a finger on the touch screen of the screen transmission device 201 and slide it arbitrarily, and when the display device 202 synchronously displays the corresponding sliding operation, the user can determine the target position of the user operation according to the current display interface of the display device 202 and the synchronous sliding operation. The application is not limited in this way.
[0137] The display device 202 can be operated by the user to perform a corresponding display function. For example, the user can click any third-party application icon included in the display interface of the display device 103, and the display device can open the corresponding interface of the third-party application according to the sensed third-party application icon. When the display interface of the display device 202 receives the optical signal sent by the screen transmission device 201, the optical signal can be converted into an electrical signal to determine the position of the optical signal on the display interface of the display device 202, and a corresponding instruction of the user operation can be executed according to the electrical signal. The display screen of the display device 202 can be provided with a metal plate at the bottom of the tempered glass layer. The metal plate can be used to receive the optical signal sent by the screen transmission device 201. When a certain position of the metal plate is irradiated by the optical signal of the screen transmission device 201, the number of electrons corresponding to the position irradiated by the optical signal increases due to the connection of the high-frequency signal, and the induced current formed increases. The increased induced current flows out of the electrodes at the four corners of the display screen of the display device 202, and the display device 202 can obtain the position of the finger of the user operation on the display screen by calculating the proportion of the current flowing out of the electrodes at the four corners of the display screen.
[0138] In the screen transmission output control system provided in the application, the user can input the user operation on the touch screen of the screen transmission device to synchronously control the current display interface of the display device, thereby avoiding the need for the user to control the display device on the current display interface of the display device and bringing more convenience to the user.
[0139] Next, the application will explain the screen transmission output control method in multiple embodiments.
[0140] Please refer to Figure 3 , Figure 3 The flowchart of a screen transmission output control method provided by the embodiments of the application is shown.
[0141] As Figure 3 shown, the screen transmission output control method at least includes the following steps:
[0142] Step 302, the screen transmission device and the display device establish a connection.
[0143] Step 304, the display device sends a screen projection signal to the screen transmission device, and projects the display screen of the display device to the screen transmission device for display.
[0144] Step 306, when receiving the screen projection signal of the display device, the screen transmission device switches the display screen in the display interface to the display screen of the display device.
[0145] Specifically, for the user to select the operation position more conveniently on the screen transmission device, the screen transmission device and the display device can be first connected wirelessly, and the current display screen of the display device can be selected to be projected to the touch screen of the screen transmission device which has established a wireless connection in the display interface of the display device. Here, when the screen transmission device receives the screen projection instruction sent by the display device, the touch screen of the screen transmission device can pop up a request instruction corresponding to the screen projection instruction, and after confirming the request instruction, the screen transmission device can receive the current display screen sent by the display device, and switch the display screen of the touch screen to the current display screen sent by the display device. Here, please refer to Figure 4 The display screen of the touch screen of the screen transmission device is shown, which can be switched to the current display screen sent by the display device, and the icons of four application programs such as WeChat and Weibo are displayed in the screen. It can be understood that the display screen of the display device is generally larger than the touch screen of the screen transmission device, and when the screen transmission device receives the current display screen sent by the display device, the proportion of the current display screen can be first adjusted to correspond to the display proportion of the touch screen, and then the display screen of the touch screen is switched to the current display screen of the display device after the display proportion is adjusted.
[0146] It should be further noted that after the wireless connection between the screen transmission device and the display device is established, when the current display screen of the display device changes, the screen transmission device can switch the display screen of the touch screen to the changed current display screen of the display device. For example, when the display device executes an instruction corresponding to a user operation to open an application, the current display screen of the display device is switched to the main interface of the application. At this time, the display device can send the main interface of the application to the screen transmission device, so that the screen transmission device switches the display screen of the touch screen to the adjusted main interface of the application after adjusting the display scale of the main interface of the application, thereby facilitating the user to quickly master the current display screen of the display device through the screen transmission device.
[0147] It can also be understood that when the screen transmission process between the screen transmission device and the display device ends, the screen transmission device can send an instruction for disconnecting to the display device, so that the display device disconnects from the screen transmission device after receiving the instruction for disconnecting, and the device information corresponding to the screen transmission device can be saved, so as to quickly establish a wireless connection with the screen transmission device next time. It can be understood here that the end of the screen transmission process can be that after the screen transmission device completes the display interface control of the display device through the screen transmission light signal, the screen transmission device no longer receives other user operations. At this time, the user can send a disconnecting instruction to the display device through the control of the screen transmission device.
[0148] Step 308, the screen transmission device receives a user operation based on the display interface, and determines the parameters of the screen transmission light signal according to the user operation.
[0149] In the embodiment, the screen transmission device has a screen transmission function of transmitting the current display interface of the mobile terminal to the display interface of the display device, and also has a screen transmission output control function of transmitting a user operation to the display interface of the display device.
[0150] Specifically, the screen transmission device can be provided with a touch screen for receiving user operation, and the position of the user operation on the touch screen is determined according to the operation of the user on the touch screen. The touch screen can be, but is not limited to, a capacitive touch screen or a touch screen with a temperature sensor. When the touch screen is a capacitive touch screen, the user operation corresponding finger forms a coupling capacitance with the capacitive touch screen when the finger is in contact with the capacitive touch screen. Since the capacitive touch screen is connected to a high-frequency signal, the user operation corresponding finger can absorb a certain current. The current flows out of the electrodes at the four corners of the capacitive touch screen, and the screen transmission device can determine the position of the user operation corresponding finger on the capacitive touch screen by calculating the proportion of the current flowing out of the electrodes at the four corners of the capacitive touch screen. When the touch screen is a touch screen with a temperature sensor, the data collected by the temperature sensor corresponding to the contact position of the user operation corresponding finger when the finger is in contact with the touch screen with a temperature sensor will be different from the temperature sensor corresponding to the non-contact position. The screen transmission device can determine the position of the temperature sensor corresponding to the different data on the touch screen according to the distribution position of the temperature sensor on the touch screen.
[0151] Here, the touch screen is taken as an example of a capacitive touch screen, and reference can be made to Figure 4 The embodiment of the application shown provides a schematic diagram of the current flow effect of the touch screen based on user operation. As shown in Figure 4 The user operation corresponding finger is placed at a certain position of the touch screen of the screen transmission device, and at this time, the electrodes at the four corners of the touch screen of the screen transmission device flow out current to the position of the user operation corresponding finger. For example, the path of the current flowing out of the electrode at the upper left corner of the touch screen to the position of the user operation corresponding finger can be represented as L1, the path of the current flowing out of the electrode at the upper right corner of the touch screen to the position of the user operation corresponding finger can be represented as L2, the path of the current flowing out of the electrode at the lower left corner of the touch screen to the position of the user operation corresponding finger can be represented as L3, and the path of the current flowing out of the electrode at the lower right corner of the touch screen to the position of the user operation corresponding finger can be represented as L4. The screen transmission device can determine the proportion of the corresponding current path according to the proportion of the current flowing out of the electrodes at the four corners of the touch screen. For example, when the proportion of the current flowing out of the electrode at the upper left corner of the touch screen, the current flowing out of the electrode at the upper right corner of the touch screen, the current flowing out of the electrode at the lower left corner of the touch screen, and the current flowing out of the electrode at the lower right corner of the touch screen is a:b:c:d, the corresponding current path proportion L1:L2:L3:L4 can be equal to a:b:c:d.
[0152] When the screen transmission device determines the proportion of the current paths of the electrodes at the four corners of the touch screen to the position of the finger operated by the user, a plane rectangular coordinate system can be established according to the size of the touch screen, and the actual current paths and the position coordinates of the finger operated by the user on the touch screen can be calculated by measuring the included angle between the current paths and the coordinate axes. Specifically, in the embodiment, the screen transmission device can select the lower left corner of the touch screen as the origin of the coordinate system, and the two adjacent sides as the X-axis and Y-axis of the coordinate system to establish a plane rectangular coordinate system. At this time, the distance from the upper left corner of the touch screen to the origin is the width of the touch screen, the distance from the lower right corner of the touch screen to the origin is the length of the touch screen, and the included angle θ1 between the current path L3 and the X-axis and the included angle θ2 between the current path L4 and the X-axis are measured respectively when the proportion of the current path L3 to the current path L4 is obtained. The actual lengths of the current path L3 and the current path L4 are calculated by multiplying the length of the touch screen, the cosine value of the included angle θ1 and the cosine value of the included angle θ2. It can be understood that when the actual length of the current path L3 is determined, the coordinate X1 of the X-axis of the finger operated by the user in the plane rectangular coordinate system can be obtained according to the product of the actual length of the current path L3 and the cosine value of the included angle θ1, and the coordinate Y1 of the Y-axis of the finger operated by the user in the plane rectangular coordinate system can be obtained according to the product of the actual length of the current path L3 and the sine value of the included angle θ1. It can also be understood that the coordinates of the finger operated by the user in the screen rectangular coordinate system established by the touch screen are (X1, Y1).
[0153] Of course, the plane rectangular coordinate system established in the embodiment can not be limited to the above-mentioned one with the lower left corner of the touch screen as the origin. For example, the upper left corner, the upper right corner or any other position of the touch screen can also be selected as the origin to establish a plane rectangular coordinate system, which will not be described in detail here.
[0154] Further, after obtaining the position of the user's operation on the touch screen, the screen transmission device can determine the screen transmission light signal corresponding to the position of the user's operation on the touch screen, so that the position on the display interface of the display device irradiated by the screen transmission light signal is consistent with the position of the user's operation on the touch screen. It can be understood that the screen transmission device can adjust the emission angle of the screen transmission light signal to transmit the user's operation to the display interface of the display device.
[0155] Step 310: The screen transmission device controls the emission of the screen transmission light signal to the display device based on the parameters of the screen transmission light signal.
[0156] Specifically, after determining the parameters of the screen transmission light signal, the screen transmission device can send the screen transmission light signal to the display interface of the display device, so that the position on the display interface of the display device irradiated by the screen transmission light signal is consistent with the position of the user's operation on the touch screen of the screen transmission device.
[0157] In step 312, the display device receives the screen transmission light signal sent by the screen transmission device and converts the screen transmission light signal into an electric signal.
[0158] In step 314, the display device executes an instruction corresponding to the user operation according to the electric signal.
[0159] Specifically, after receiving the screen transmission light signal sent by the screen transmission device, the display interface of the display device can convert the screen transmission light signal into an electric signal for representing the position of the screen transmission light signal in the display interface of the display device.
[0160] Further, the display device can determine the position of the screen transmission light signal in the display interface according to the electric signal, and execute an instruction corresponding to the user operation at the position of the screen transmission light signal in the display interface by analyzing the position of the screen transmission light signal in the display interface. For example, when the display device detects that the position of the screen transmission light signal in the display interface is on a certain application icon, it can be analyzed that the user operation corresponding to the position of the screen transmission light signal in the display interface is to open a certain application program, and the instruction corresponding to the user operation executed by the display device can be to open a certain application program.
[0161] It can be understood that after the display device executes the instruction corresponding to the user operation, the current display screen of the display device will be switched to a screen corresponding to the instruction, for example, when the instruction is to open a certain application program, the current display screen of the display device will be switched to the main interface of the application program to meet the user's demand for controlling the display screen of the display device through the screen transmission device.
[0162] In the embodiments of the present application, the user operation can be obtained through the screen transmission device, which can make the function of the screen transmission device more diversified, and the display device corresponding to the screen transmission device can convert the screen transmission light signal sent by the screen transmission device into an electric signal, effectively optimize the latency of signal transmission by using the photoelectric effect, and further guarantee the transmission efficiency and synchronization of signal transmission, thereby providing the user with a better screen transmission control experience.
[0163] As a preferred embodiment, the display interface of the display device includes a metal plate.
[0164] The display device receives the screen transmission light signal sent by the screen transmission device and converts the received screen transmission light signal into an electric signal, including:
[0165] The metal plate receives the screen transmission light signal sent by the screen transmission device and determines the current value generated by the screen transmission light signal on the metal plate.
[0166] The display device executes an instruction corresponding to the user operation according to the electric signal, including:
[0167] determine the position corresponding to the user operation in the display interface of the display device according to the current value generated by the metal plate under the transmission screen light signal;
[0168] execute the instruction corresponding to the user operation according to the position corresponding to the user operation in the display interface of the display device.
[0169] Specifically, to improve the induction efficiency of the display device receiving the transmission screen light signal sent by the transmission screen device, a metal plate can be arranged at the bottom of the tempered glass layer corresponding to the display screen of the display device, which can be used to receive the transmission screen light signal sent by the transmission screen device. Here, when a certain position of the metal plate is irradiated by the transmission screen light signal sent by the transmission screen device, the number of electrons corresponding to the position irradiated by the transmission screen light signal increases due to the high-frequency signal connected to the metal plate, and the induced current formed increases. The increased induced current flows out of the electrodes on the four corners of the display screen of the display device, and the display device can obtain the position of the light signal on the display screen by calculating the proportion of the current flowing out of the electrodes on the four corners of the display screen. It can be understood that the size of the metal plate can be the same as that of the display screen, and the position of the transmission screen light signal irradiated on the display screen can be determined by calculating the position of the transmission screen electric signal corresponding to the transmission screen light signal in the metal plate, and the material of the metal plate can be but not limited to copper, aluminum or alloy, etc.
[0170] As another preferred embodiment of the present embodiment, the way of calculating the position of the transmission screen electric signal corresponding to the transmission screen light signal in the metal plate can refer to the calculation method of the transmission screen device determining the position of the user operation on the touch screen mentioned in step 308, that is, the display device can also first determine the proportion of the current path of the electrodes on the four corners of the display screen flowing to the position corresponding to the transmission screen light signal according to the proportion of the current flowing out of the electrodes on the four corners of the display screen, then establish a plane rectangular coordinate system according to the size of the metal plate, and calculate the actual current path and the position coordinates of the transmission screen light signal on the display screen by measuring the angle between the current path and the coordinate axis.
[0171] As another preferred embodiment of the present embodiment, the type of user operation includes at least two types, and different types of user operations correspond to different types of instructions.
[0172] Specifically, the type of the user operation received by the display interface of the screen transmission device can include at least two, such as but not limited to a click operation, a single-finger sliding operation, a multi-finger sliding operation, or a tapping operation, and each type of user operation can correspond to a respective instruction. Possibly, when the user operation is a click operation, the corresponding instruction can be to open the main interface of an application. Possibly, when the user operation is a single-finger sliding operation, the corresponding instruction can be to slide the current interface to the next interface, and the display content of the next interface can be determined according to the sliding direction. Possibly, when the user operation is a multi-finger sliding operation, the corresponding instruction can be to enlarge or reduce the current interface. Possibly, when the user operation is a tapping operation, the corresponding instruction can be to take a screenshot of the current interface.
[0173] As another embodiment of the present application, please refer to Figure 5 , Figure 5 A flowchart of another screen transmission output control method provided by an embodiment of the present application is shown.
[0174] As shown in Figure 5 , the screen transmission output control method is applied to a screen transmission device, and the screen transmission device includes a transmission component. The method includes at least the following steps:
[0175] Step 502: determining the display interface position of the display device based on the transmission component of the screen transmission device.
[0176] The screen transmission device can be provided with a transmission component for transmitting a screen transmission light signal to the display interface of the display device. The transmission component can include one or more transmission heads. For example, when the user operation is a click operation, the transmission component can include one transmission head for transmitting a screen transmission light signal (or multiple transmission heads for transmitting a screen transmission light signal). When the user operation is a sliding operation or multiple simultaneous operations, the transmission component can include multiple transmission heads that can simultaneously transmit a screen transmission light signal. The type of the transmission head of the transmission component can be, but is not limited to, a laser transmission head or an ultraviolet transmission head.
[0177] Specifically, before receiving the user operation, the screen transmission device can identify the display interface position of the display device based on the light signal emitted by the emitting component. Here, taking an example that the emitting component includes an ultraviolet light emitting head, the screen transmission device can control the ultraviolet light emitting head to emit ultraviolet light to the direction where the display device is located, and can control the ultraviolet light to move along a preset path. The preset path can be, but is not limited to, a straight line trajectory along which the screen transmission device controls the ultraviolet light emitting head to move. When the ultraviolet light irradiates the edge of the display interface of the display device, the screen transmission device can control the ultraviolet light emitting head to move along the edge of the display interface of the display device until the ultraviolet light emitted by the ultraviolet light emitting head passes through the four corners of the display interface of the display device in sequence. It can be understood that the screen transmission device can determine the display interface position of the display device according to the emission direction of the ultraviolet light emitting head corresponding to the time when the ultraviolet light passes through the four corners of the display interface of the display device in sequence, and can also calculate the length and width of the display interface of the display device according to the time when the ultraviolet light passes through the four corners of the display interface of the display device in sequence.
[0178] Of course, the screen transmission device can also establish a spatial rectangular coordinate system, and determine the display interface position of the display device according to the spatial coordinates corresponding to the four corners of the display interface of the display device. The present embodiment is not limited thereto.
[0179] It can also be understood that, before controlling the emitting component of the screen transmission device to emit the light signal, the user can also align the initial position of the emitting head of the emitting component to a corner of the display interface of the display device, so as to facilitate the screen transmission device to quickly determine the four corners of the display interface of the display device, thereby improving the efficiency of determining the display interface position of the display device and the size of the display interface.
[0180] Step 504: calculating a display interface reference position of the display device according to the display interface position of the display device, and an initial emission angle at which the emitting component sends the screen transmission light signal to the display interface reference position of the display device.
[0181] Specifically, after obtaining the display interface position of the display device, the screen transmission device can first construct a model consistent with the display interface of the display device, and determine a reference position of the display interface in the model, for example but not limited to the center position of the display interface. It can be understood that the screen transmission device can also use spatial coordinates to represent the reference position of the display interface by establishing a spatial rectangular coordinate system.
[0182] Further, after determining the display interface reference position of the display device, the screen transmission device can control the emission head of the emission component to emit the light signal to the display interface reference position, and collect the initial emission angle corresponding to the light signal emitted by the emission head to the display interface reference position. It can be understood that the initial emission angle here can include, but is not limited to, the included angle between the emitted light signal and the X axis, the included angle between the emitted light signal and the Y axis, and the included angle between the emitted light signal and the Z axis. The X axis, Y axis and Z axis correspond to a space rectangular coordinate system established with a certain corner of the touch screen of the screen transmission device as the origin.
[0183] Step 506, receiving a click operation based on the display interface, and determining the position of the click operation in the display interface of the screen transmission device.
[0184] Specifically, when the user operation is that the finger is pressed on a certain position of the touch screen of the screen transmission device, the user operation can be taken as a click operation, and the position of the click operation on the touch screen of the screen transmission device is determined. The way of determining the position of the click operation can refer to step 302 described above, which will not be described in detail here.
[0185] Step 508, determining the position of the click operation in the display interface of the display device according to the position of the click operation in the display interface of the screen transmission device.
[0186] Specifically, after determining the position of the click operation on the touch screen of the screen transmission device, the screen transmission device can determine the position of the click operation in the display interface of the display device in the determined display interface position of the display device. For the convenience of understanding, the above-mentioned display interface position of the display device can refer to the display interface reference position of the display device. Figure 6 The application scenario schematic diagram of the screen transmission output control method provided by the embodiment of the application is shown in FIG. 6. Figure 6 As shown in FIG. 6, 6a shows the position of the click operation on the touch screen of the screen transmission device, and the distance between the position of the click operation and the touch screen in the length direction can be represented as s1, and the distance between the position of the click operation and the touch screen in the width direction can be represented as s2. 6b shows the position of the click operation in the display interface of the display device, and the distance between the position of the click operation and the display interface of the display device in the length direction can be represented as S1, and the distance between the position of the click operation and the display interface of the display device in the width direction can be represented as S2. Here, the display interface position of the display device and the size of the touch screen of the screen transmission device are known, the scaling ratio can be determined according to the size of the display interface of the display device and the size of the touch screen of the screen transmission device, and the proportional relationship between s1 and S1 and the proportional relationship between s2 and S2 are determined based on the scaling ratio, and then the position of the click operation in the display interface of the display device is obtained. For example, when the scaling ratio can be represented as a, S1 can be equal to the product of s1 and a, and S2 can be equal to the product of s2 and a.
[0187] Of course, the scaling ratio mentioned above is applied to the case that the touch screen of the screen transmission device and the display interface of the display device are similar patterns. When the touch screen of the screen transmission device and the display interface of the display device are not similar patterns, the scale of the touch screen display interface of the screen transmission device can be first adjusted to be consistent with the scale of the display interface of the display device, and then the position corresponding to the click operation in the display interface of the display device is determined according to the position of the click operation in the adjusted touch screen display interface. The embodiment is not limited thereto.
[0188] In step 510, the distance between the position of the click operation in the display interface of the display device and the reference position of the display interface of the display device is calculated, and the first emission angle of the emission component for transmitting the screen transmission light signal is determined according to the distance and the initial emission angle of the emission component.
[0189] Specifically, after determining the position corresponding to the click operation in the display interface of the display device, the distance from the reference position of the display interface of the display device can be calculated, and the first emission angle of the emission component for transmitting the screen transmission light signal is determined according to the distance from the reference position of the display interface of the display device and the initial emission angle mentioned above.
[0190] For ease of understanding, the position corresponding to the click operation in the display interface of the display device and the center position of the display interface of the display device are taken as an example, which can be referred to Figure 7 The application scenario of another screen transmission output control method provided by the embodiment of the application is shown. As shown in Figure 7 The application scenario of the screen transmission output control method is shown, wherein the application scenario includes the touch screen 701 of the screen transmission device, the emission component 702 of the screen transmission device, and the display device 703 in a top view state. The light signal path emitted by the emission component 702 of the screen transmission device to the center position of the display interface of the display device 703 can be represented as A1, the screen transmission light signal path emitted to the position corresponding to the click operation in the display interface of the display device 703 can be represented as A2, and the light signal emitted vertically to the direction of the center position of the display interface of the display device 703 can be represented as A3, that is, it can be understood that the angle between the light signal emitted by the emission component 702 of the screen transmission device and the X axis is relatively fixed, and the angle between the light signal and the Z axis is relatively fixed. At this time, the initial emission angle can be represented as θ1, which corresponds to the angle between the light signal path A1 and the light signal path A3, and the first emission angle can be represented as θ2, which corresponds to the angle between the light signal path A2 and the light signal path A3. θ2 can be calculated by the following formula (1):
[0191]
[0192] L1 can be represented as the distance between the position of the click operation on the display interface of the display device and the center position of the display interface of the display device, and L2 can be calculated by subtracting L1 from the distance between the center position of the display interface of the display device and the position corresponding to the light signal path A3 at the same horizontal line as the center position of the display interface.
[0193] In step 512, the screen transmission device sends the screen transmission light signal to the display device according to the first transmission angle of the transmission component.
[0194] Specifically, after determining the first transmission angle, the screen transmission device can control the transmission component to transmit the screen transmission light signal to the display interface of the display device according to the first transmission angle, so that the display device converts the screen transmission light signal into a screen transmission electrical signal and executes an instruction corresponding to the user operation according to the screen transmission electrical signal.
[0195] In the embodiments of the present application, the screen transmission device can first determine an initial transmission angle of the screen transmission light signal to the center position of the display interface of the display device according to the transmission component, and then determine the first transmission angle according to the position corresponding to the click operation on the display interface of the display device, so as to improve the accuracy of the screen transmission light signal sent to the display interface of the display device by adjusting the transmission angle, and further to ensure that the display device can more accurately execute the instruction corresponding to the click operation.
[0196] As a preferred embodiment of the present application, it further comprises:
[0197] Obtaining the click duration of the click operation on the display interface of the screen transmission device;
[0198] If the click duration belongs to the preset duration interval, determining the parameter of the screen transmission light signal according to the user operation;
[0199] If the click duration does not belong to the preset duration interval, confirming that it is a misoperation.
[0200] Specifically, during the process of receiving the click operation of the user, since the click operation can include the misoperation of the user, for example, the user mistakenly presses the finger or elbow on the display interface of the screen transmission device, the screen transmission device can also obtain the click duration of the click operation on the display interface of the screen transmission device, so as to determine that the click operation is the normal click operation of the user when it is detected that the click duration belongs to the preset duration interval, and then determine the parameter of the screen transmission light signal according to the user operation. If it is detected that the click duration does not belong to the preset duration interval, it is determined that the click operation is the abnormal operation of the user, for example, the user lightly touches the display interface of the screen transmission device or presses the display interface of the screen transmission device for a long time, and then the prompt information for representing the misoperation can be displayed, and the screen transmission light signal is not sent to the display device. It can be understood that the prompt information for representing the misoperation here can be but is not limited to the prompt mode such as voice, text prompt box, etc.
[0201] As another embodiment of the present application, please refer to Figure 8 , Figure 8 Fig. 1 shows a flow diagram of another screen transmission output control method provided by an embodiment of the present application.
[0202] As shown in Figure 8 , the screen transmission output control method is applied to a screen transmission device, the screen transmission device comprises a transmitting component, and the method comprises at least the following steps:
[0203] Step 802: determining a display interface position of a display device based on the transmitting component of the screen transmission device.
[0204] Specifically, step 802 is consistent with step 502, and thus is not described here in detail.
[0205] Step 804: calculating a display interface reference position of the display device and an initial transmission angle of the transmitting component for transmitting a screen transmission light signal to the display interface reference position of the display device according to the display interface position of the display device.
[0206] Specifically, step 804 is consistent with step 504, and thus is not described here in detail.
[0207] Step 806: determining an initial position, a terminal position and a sliding track of a sliding operation in a display interface of the screen transmission device.
[0208] Specifically, when the user operation is a finger movement in a certain area of a touch screen of the screen transmission device, the user operation can be regarded as a sliding operation, and the initial position, the terminal position and the sliding track of the sliding operation on the touch screen of the screen transmission device are determined. It can be understood that the initial position can be a position where the sliding operation is initially pressed on the touch screen of the screen transmission device, the terminal position can be a position where the sliding operation is finally pressed on the touch screen of the screen transmission device, and the sliding track can be a track experienced by the sliding operation from the initial position to the terminal position.
[0209] Here, please refer to Figure 9 Fig. 2 shows an application scenario diagram of another screen transmission output control method provided by an embodiment of the present application. As shown in Figure 9 , the application scenario is that a user performs a sliding operation on a touch screen display interface of a screen transmission device, wherein the initial position of a finger corresponding to the sliding operation on the touch screen of the screen transmission device can be represented as 901, the terminal position of the finger corresponding to the sliding operation on the touch screen of the screen transmission device can be represented as 903, and the sliding track of the finger corresponding to the sliding operation on the touch screen of the screen transmission device can be represented as 902. It can be seen that the sliding operation is a rightward translation from the initial position 901 to the terminal position 903, and the sliding track is a straight line.
[0210] In the embodiment, the initial position, the end position and the sliding track of the sliding operation in the display interface of the screen transmission device can be determined by coordinates, and the corresponding coordinate system can be a plane rectangular coordinate system with a corner of the touch screen of the screen transmission device as the origin.
[0211] In step 808, the initial position and the end position of the sliding operation in the display interface of the display device are determined according to the initial position, the end position and the position of the display interface of the display device of the sliding operation in the display interface of the screen transmission device.
[0212] Specifically, the initial position and the end position of the sliding operation in the display interface of the display device can be determined according to the initial position and the end position of the sliding operation in the display interface of the screen transmission device in step 808, which can be referred to step 508, and thus is not described here.
[0213] In step 810, the distance between the initial position of the sliding operation in the display interface of the display device and the reference position of the display interface of the display device is calculated, and the second emission angle of the transmission component for transmitting the screen transmission light signal is determined according to the distance and the initial emission angle of the transmission component.
[0214] Specifically, the second emission angle of the transmission component for transmitting the screen transmission light signal can be determined according to the initial position of the sliding operation in the display interface of the display device and the initial emission angle of the transmission component in step 810, which can be referred to step 510, and thus is not described here.
[0215] In step 812, the distance between the end position of the sliding operation in the display interface of the display device and the reference position of the display interface of the display device is calculated, and the third emission angle of the transmission component for transmitting the screen transmission light signal is determined according to the distance and the initial emission angle of the transmission component.
[0216] Specifically, the third emission angle of the transmission component for transmitting the screen transmission light signal can be determined according to the end position of the sliding operation in the display interface of the display device and the initial emission angle of the transmission component in step 812, which can be referred to step 510, and thus is not described here.
[0217] In step 814, the emission track of the transmission component for emitting the screen transmission light signal is determined according to the sliding track.
[0218] Specifically, the screen transmission device can determine a plurality of characteristic positions in the sliding track according to the sliding operation from the initial position to the end position. The characteristic positions can be understood as positions used to generate the sliding track. When the sliding track can be two linear line segments connected and forming a certain angle, the characteristic positions of the sliding track can include the initial position, the end position and a connection position at the connection of the two linear line segments. When the sliding track can be a nonlinear line segment, the characteristic positions of the sliding track can include the initial position, the end position and each wave crest and wave trough. When the sliding track can be a linear line segment, the characteristic positions of the sliding track can only include the initial position and the end position.
[0219] Further, after the screen transmission device determines the plurality of characteristic positions in the sliding track, the screen transmission device can correspondingly determine a plurality of positions in the emission track of the emission component for emitting the screen transmission light signal, and sequentially connect the plurality of positions in the connection order from the initial position to the end position to form the emission track. The line segment connecting any two adjacent positions can be but is not limited to a linear line segment or a nonlinear line segment.
[0220] Step 816, the screen transmission device sends the screen transmission light signal to the display device according to the emission track from the second emission angle to the third emission angle by the emission component.
[0221] Specifically, the screen transmission device can control the emission component to first send the screen transmission light signal to the initial position in the display interface of the display device according to the second emission angle, and then control the emission component to move the emission angle of the screen transmission light signal to be consistent with the third emission angle, and move according to the emission track during the moving process, so that the initial position, the end position and the sliding track corresponding to the sliding operation in the display interface of the display device are respectively corresponding to the initial position, the end position and the sliding track of the sliding operation in the touch screen of the screen transmission device. After receiving the screen transmission light signal, the display device can convert the screen transmission light signal into a screen transmission electrical signal, and execute an instruction corresponding to the sliding operation according to the screen transmission electrical signal.
[0222] It can be understood that when the emission track only includes the initial position and the end position, the screen transmission device can control the emission component to directly move from the second emission angle to the third emission angle. When the emission track includes the initial position, the end position and other positions, the screen transmission device can first determine the respective emission angles corresponding to the other positions, and control the emission component to sequentially move through the respective emission angles corresponding to the other positions from the second emission angle until reaching the third emission angle.
[0223] Please refer to Figure 10 , Figure 10 FIG. 1 shows a structural schematic diagram of a screen transmission device provided by an embodiment of the present application.
[0224] As Figure 10 shown, the screen transmission device can at least include a display interface, a first communication module 1001, a switching module 1002, a first processing module 1003, and a sending module 1004, wherein:
[0225] The first communication module 1001 is configured to establish a connection with the display device.
[0226] The switching module 1002 is configured to switch the display screen in the display interface to the display screen of the display device when receiving the screen projection signal of the display device.
[0227] The first processing module 1003 is configured to receive a user operation based on the display interface, and determine the parameters of the screen transmission light signal according to the user operation.
[0228] The sending module 1004 is configured to control the emission of the screen transmission light signal to the display device based on the parameters of the screen transmission light signal, so that the display device executes the instruction corresponding to the user operation according to the screen transmission light signal.
[0229] In some possible embodiments, the screen transmission device includes an emission component.
[0230] The apparatus further includes:
[0231] The fourth processing module is configured to determine the display interface position of the display device based on the emission component of the screen transmission device.
[0232] The fifth processing module is configured to calculate the display interface reference position of the display device and the initial emission angle of the emission component for sending the screen transmission light signal to the display interface reference position of the display device according to the display interface position of the display device.
[0233] In some possible embodiments, the type of user operation includes at least two types, and different types of user operations correspond to different types of instructions.
[0234] In some possible embodiments, the user operation is a click operation.
[0235] The first processing module 1003 includes:
[0236] The first determination unit is configured to determine the position of the click operation in the display interface of the screen transmission device.
[0237] The second determination unit is configured to determine the position of the click operation in the display interface of the display device according to the position of the click operation in the display interface of the screen transmission device and the display interface position of the display device.
[0238] The third determining unit is configured to calculate a distance between a position of the click operation in the display interface of the display device and a reference position of the display interface of the display device, and determine a first emission angle of the transmission component for sending the screen light signal according to the distance and an initial emission angle of the transmission component.
[0239] The sending module 1004 is specifically configured to send the screen light signal to the display device according to the first emission angle based on the transmission component.
[0240] In some possible embodiments, the user operation is a click operation, and the device further includes:
[0241] The obtaining module is configured to obtain a click duration of the click operation in the display interface of the screen transmission device.
[0242] The sixth processing module is configured to determine a parameter of the screen light signal according to the user operation if the click duration belongs to a preset duration interval.
[0243] If the click duration does not belong to the preset duration interval, it is determined that the operation is a false operation.
[0244] In some possible embodiments, the user operation is a sliding operation.
[0245] The first processing module 1003 includes:
[0246] The first processing unit is configured to determine an initial position, a terminal position and a sliding track of the sliding operation in the display interface of the screen transmission device.
[0247] The second processing unit is configured to determine an initial position and a terminal position of the sliding operation in the display interface of the display device according to the initial position, the terminal position and the position of the display interface of the display device.
[0248] The third processing unit is configured to calculate a distance between the initial position of the sliding operation in the display interface of the display device and a reference position of the display interface of the display device, and determine a second emission angle of the transmission component for sending the screen light signal according to the distance and an initial emission angle of the transmission component.
[0249] The fourth processing unit is configured to calculate a distance between the terminal position of the sliding operation in the display interface of the display device and the reference position of the display interface of the display device, and determine a third emission angle of the transmission component for sending the screen light signal according to the distance and the initial emission angle of the transmission component.
[0250] The fifth processing unit is configured to determine an emission track of the transmission component for emitting the screen light signal according to the sliding track.
[0251] The sending module 1004 is specifically configured to send the screen transmission light signal to the display device from the second emission angle to the third emission angle according to the emission trajectory based on the emission component.
[0252] Please refer to Figure 11 , Figure 11 A structural schematic diagram of a display device provided by an embodiment of the present application is shown.
[0253] As Figure 11 shown, the display device can at least include a second communication module 1101, a screen projection module 1102, a second processing module 1103, and a third processing module 1104, wherein:
[0254] The second communication module 1101 is configured to establish a connection with the screen transmission device.
[0255] The screen projection module 1102 is configured to send a screen projection signal to the screen transmission device, and project a display picture of the display device to the screen transmission device for display.
[0256] The second processing module 1103 is configured to receive a screen transmission light signal sent by the screen transmission device, and convert the received screen transmission light signal into an electrical signal.
[0257] The third processing module 1104 is configured to execute an instruction corresponding to a user operation according to the electrical signal.
[0258] In some possible embodiments, the display interface of the display device includes a metal plate.
[0259] The second processing module 1103 is specifically configured to receive the screen transmission light signal sent by the screen transmission device based on the metal plate, and determine a current value generated by the screen transmission light signal on the metal plate.
[0260] The third processing module 1104 is specifically configured to determine a position of the user operation in the display interface of the display device according to the current value generated by the screen transmission light signal on the metal plate.
[0261] In some possible embodiments, the third processing module 1104 includes:
[0262] A first calculation unit is configured to calculate a ratio between current values flowing through four corners of the metal plate according to the current values flowing through the four corners of the metal plate generated by the screen transmission light signal on the metal plate.
[0263] A second calculation unit is configured to determine the position of the user operation in the display interface of the display device according to the ratio between the current values flowing through the four corners of the metal plate.
[0264] In some possible embodiments, the type of the user operation includes at least two types, and different types of user operations correspond to different types of instructions.
[0265] Referring to Figure 12 , Figure 12 Fig. 1 shows a structural schematic diagram of a transmission screen device provided by an embodiment of the present application.
[0266] As Figure 12 shown, the transmission screen device 1200 can include at least one processor 1201, at least one network interface 1204, a user interface 1203, a memory 1205, a display screen 1206, a laser emission head 1207, and at least one communication bus 1202.
[0267] The communication bus 1202 can be used to realize the connection and communication of the above-mentioned components.
[0268] The user interface 1203 can include a key, and the optional user interface can further include a standard wired interface, a wireless interface.
[0269] The network interface 1204 can include, but is not limited to, a Bluetooth module, an NFC module, a Wi-Fi module, etc.
[0270] The display screen 1206 can be, but is not limited to, receiving user operation and switching the display screen to the display screen of the display device.
[0271] The laser emission head 1207 can be determined by the processor 1201 according to the user operation to determine the parameters of the transmission screen light signal, and control the emission of the transmission screen light signal to the display device based on the parameters of the transmission screen light signal.
[0272] The processor 1201 can include one or more processing cores. The processor 1201 connects various parts in the entire electronic device 1200 through various interfaces and lines, executes various functions of the routing device 1200 and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 1205, and calling data stored in the memory 1205. Optionally, the processor 1201 can be realized by at least one of the hardware forms of DSP, FPGA, and PLA. The processor 1201 can integrate one or a combination of CPU, GPU, and modem. Among them, the CPU mainly processes the operating system, user interface, and application program; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; and the modem is used for processing wireless communication. It can be understood that the above-mentioned modem can also not be integrated into the processor 1201, but can be realized by a separate chip.
[0273] The memory 1205 can include a RAM and can also include a ROM. Optionally, the memory 1205 includes a non-transitory computer-readable medium. The memory 1205 can be used to store instructions, programs, codes, code sets, or instruction sets. The memory 1205 can include a program storage area and a data storage area, where the program storage area can store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area can store data involved in the above-mentioned various method embodiments, etc. The memory 1205 can also be at least one storage device located away from the aforementioned processor 1201. As shown in Figure 12 the memory 1205 as a computer storage medium can include an operating system, a network communication module, a user interface module, and a screen transmission output control application.
[0274] Specifically, the processor 1201 can be used to invoke the screen transmission output control application stored in the memory 1205, and specifically perform the following operations:
[0275] establish a connection with the display device;
[0276] when receiving a screen projection signal of the display device, switch the display screen in the display interface to the display screen of the display device;
[0277] The display interface is used to receive user operations and determine parameters of the screen transmission light signal according to the user operations;
[0278] Based on the parameters of the screen transmission light signal, control the emission of the screen transmission light signal to the display device, so that the display device executes instructions corresponding to the user operations according to the screen transmission light signal.
[0279] In some possible embodiments, the processor 1201 is further configured to perform:
[0280] determine the display interface position of the display device based on the emission component of the screen transmission device;
[0281] calculate the display interface reference position of the display device and the initial emission angle of the emission component sending the screen transmission light signal to the display interface reference position of the display device according to the display interface position of the display device.
[0282] In some possible embodiments, the type of user operation includes at least two types, and different types of user operations correspond to different types of instructions.
[0283] In some possible embodiments, the user operation is a click operation.
[0284] When the processor 1201 determines the parameters of the screen transmission light signal according to the user operation, it specifically performs:
[0285] determining the position of the click operation in the display interface of the screen transmission device;
[0286] determining the position of the click operation in the display interface of the display device according to the position of the click operation in the display interface of the screen transmission device;
[0287] calculating the distance between the position of the click operation in the display interface of the display device and the reference position of the display interface of the display device, and determining the first emission angle of the emission component for sending the screen transmission light signal according to the distance and the initial emission angle of the emission component;
[0288] when the processor 1201 controls the emission of the screen transmission light signal to the display device based on the parameter of the screen transmission light signal, the processor 1201 specifically performs:
[0289] sending the screen transmission light signal to the display device according to the first emission angle of the emission component.
[0290] In some possible embodiments, the user operation is a click operation, and the processor 1201 further specifically performs:
[0291] obtaining the click duration of the click operation in the display interface;
[0292] if the click duration belongs to a preset duration interval, determining the parameter of the screen transmission light signal according to the user operation;
[0293] if the click duration does not belong to the preset duration interval, confirming that it is a false operation.
[0294] In some possible embodiments, the user operation is a sliding operation;
[0295] when the processor 1201 determines the parameter of the screen transmission light signal according to the user operation, the processor 1201 specifically performs:
[0296] determining the initial position, the terminal position and the sliding track of the sliding operation in the display interface of the screen transmission device;
[0297] determining the initial position and the terminal position of the sliding operation in the display interface of the display device according to the initial position, the terminal position and the position of the display interface of the display device of the sliding operation in the display interface of the screen transmission device;
[0298] calculating the distance between the initial position of the sliding operation in the display interface of the display device and the reference position of the display interface of the display device, and determining the second emission angle of the emission component for sending the screen transmission light signal according to the distance and the initial emission angle of the emission component;
[0299] The computing device calculates a distance between an end position of the sliding operation in the display interface of the display device and a reference position of the display interface of the display device, and determines a third emission angle of the emission component for sending the screen light signal according to the distance and an initial emission angle of the emission component;
[0300] The emission trajectory of the emission component for emitting the screen light signal is determined according to the sliding trajectory;
[0301] The processor 1201 controls the emission of the screen light signal to the display device based on the parameters of the screen light signal, and specifically performs:
[0302] The emission component sends the screen light signal to the display device according to the emission trajectory from the second emission angle to the third emission angle.
[0303] Please refer to Figure 13 , Figure 13 A structure schematic diagram of another display device provided by an embodiment of the present application is shown.
[0304] As Figure 13 shown, the display device 1300 can include at least one processor 1301, at least one network interface 1304, a user interface 1303, a memory 1305, a display screen 1306, a metal plate 1307, and at least one communication bus 1302.
[0305] The communication bus 1302 can be used to realize the connection and communication of the above-mentioned components.
[0306] The user interface 1303 can include a key, and the optional user interface can also include a standard wired interface, a wireless interface.
[0307] The network interface 1304 can include but is not limited to a Bluetooth module, an NFC module, a Wi-Fi module, etc.
[0308] The metal plate 1307 can receive the screen light signal sent by the screen receiving device and convert the received screen light signal into an electrical signal.
[0309] The processor 1301 may include one or more processing cores. The processor 1301 connects to various parts within the electronic device 1300 using various interfaces and lines. It executes instructions, programs, code sets, or instruction sets stored in the memory 1305, and calls data stored in the memory 1305 to perform various functions and process data within the routing device 1300. Optionally, the processor 1301 may be implemented using at least one hardware form of DSP, FPGA, or PLA. The processor 1301 may integrate one or more of the following: CPU, GPU, and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content required for display; and the modem handles wireless communication. It is understood that the modem may also not be integrated into the processor 1301 and may be implemented as a separate chip.
[0310] The memory 1305 may include RAM or ROM. Optionally, the memory 1305 may include a non-transitory computer-readable medium. The memory 1305 may be used to store instructions, programs, code, code sets, or instruction sets. The memory 1305 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the above-described method embodiments, etc.; the data storage area may store data involved in the above-described method embodiments, etc. Optionally, the memory 1305 may also be at least one storage device located remotely from the aforementioned processor 1301. Figure 13 As shown, the memory 1305, which serves as a computer storage medium, may include an operating system, a network communication module, a user interface module, and a screen sharing output control application.
[0311] Specifically, the processor 1301 can be used to call the screen output control application stored in the memory 1305, and specifically perform the following operations:
[0312] Establish a connection with the screen sharing device;
[0313] Send a projection signal to the screen sharing device and project the display screen of the display device to the screen sharing device for display.
[0314] Receive the screen sharing optical signal sent by the screen sharing device and convert the received screen sharing optical signal into an electrical signal;
[0315] Execute instructions corresponding to user operations based on electrical signals.
[0316] In some possible embodiments, when the processor 1301 receives the screen transmission light signal transmitted by the screen transmission device and converts the received screen transmission light signal into an electric signal, the following is specifically performed:
[0317] based on the screen transmission light signal received by the metal plate, determine a current value generated by the screen transmission light signal on the metal plate;
[0318] When the processor 1301 executes the instruction corresponding to the user operation according to the electric signal, the following is specifically performed:
[0319] According to the current value generated by the screen transmission light signal on the metal plate, determine the position of the user operation in the display interface of the display device;
[0320] According to the position of the user operation in the display interface of the display device, execute the instruction corresponding to the user operation.
[0321] In some possible embodiments, when the processor 1301 determines the position of the user operation in the display interface of the display device according to the current value generated by the screen transmission light signal on the metal plate, the following is specifically performed:
[0322] According to the current value generated by the screen transmission light signal on the metal plate, calculate the proportion between the current values flowing through the four corners of the metal plate;
[0323] According to the proportion between the current values flowing through the four corners of the metal plate, determine the position of the user operation in the display interface of the display device.
[0324] In some possible embodiments, the types of the user operation include at least two types, and different types of the user operation correspond to different types of the instruction respectively.
[0325] The embodiment of the application further provides a computer readable storage medium, which stores instructions, when the instructions are run on a computer or a processor, the computer or the processor executes one or more steps in the above-mentioned Figure 3 or Figure 5 or Figure 8 The above-mentioned screen transmission device and display device and each component module thereof are realized in the form of a software function unit and sold or used as an independent product, and can be stored in the computer readable storage medium.
[0326] In the above embodiments, all or part of the methods can be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the methods can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in or transmitted by a computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through a wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) manner. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes one or more available media sets. The available media can be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a digital versatile disc (DVD)), or a semiconductor medium (for example, a solid state disk (SSD)), etc.
[0327] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by a computer program instructing related hardware, which can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned embodiments. The storage medium includes ROM, RAM, magnetic or optical disc, and other program code storage media. In the case of no conflict, the technical features in the embodiments and the embodiments can be combined arbitrarily.
[0328] The above-described embodiments are merely preferred embodiments of the present application, and do not limit the scope of the present application. Without departing from the design spirit of the present application, various modifications and improvements of the technical solutions of the present application made by those of ordinary skill in the art shall fall within the protection scope of the claims of the present application.
Claims
1. A method for controlling a screen output, the method being applied to a screen transmission device, the screen transmission device comprising a display interface, the method being characterized in that, The method comprises: establishing a connection with a display device; switching a display screen in the display interface to a display screen of the display device when a screen projection signal of the display device is received; the display interface is used to receive a user operation and determine a parameter of a screen projection light signal according to the user operation; controlling the emission of the screen projection light signal to the display device based on the parameter of the screen projection light signal, so that the display device converts the screen projection light signal into an electrical signal and executes an instruction corresponding to the user operation according to the electrical signal; the determination of the parameter of the screen projection light signal according to the user operation comprises: obtaining the position of a finger of the user operation on a capacitive touch screen of the screen projection device by calculating the proportion of the current flowing in the electrodes at the four corners of the capacitive touch screen; determining the parameter of the screen projection light signal according to the position; the method further comprises: after obtaining the position of the user operation on the touch screen, determining the screen projection light signal corresponding to the position of the user operation on the touch screen, so that the position on the display interface of the display device irradiated by the screen projection light signal is consistent with the position of the user operation on the touch screen.
2. The method of claim 1, wherein, the screen projection device comprises an emission component; the method further comprises: determining the display interface position of the display device based on the emission component of the screen projection device; calculating the display interface reference position of the display device and the initial emission angle of the emission component for sending the screen projection light signal to the display interface reference position of the display device according to the display interface position of the display device.
3. The method according to any of claims 1-2, characterized in that, the type of the user operation comprises at least two types, and different types of the user operation correspond to different types of instructions.
4. The method of claim 2, wherein, the user operation is a click operation; the determination of the parameter of the screen projection light signal according to the user operation comprises: determining the position of the click operation in the display interface of the screen projection device; determining the position of the click operation in the display interface of the display device according to the position of the click operation in the display interface of the screen projection device and the display interface position of the display device; calculating the distance between the position of the click operation in the display interface of the display device and the display interface reference position of the display device, and determining the first emission angle of the emission component for sending the screen projection light signal according to the distance and the initial emission angle of the emission component; the control of the emission of the screen projection light signal to the display device based on the parameter of the screen projection light signal comprises: sending the screen projection light signal to the display device according to the first emission angle by the emission component.
5. The method according to claim 1 or 2, characterized in that, the user operation is a click operation, and the method further comprises: obtaining the click duration of the click operation on the display interface; if the click duration belongs to a preset duration interval, determining the parameter of the screen projection light signal according to the user operation; if the click duration does not belong to the preset duration interval, confirming that it is a misoperation.
6. The method of claim 2, wherein, the user operation is a sliding operation; the determination of the parameter of the screen projection light signal according to the user operation comprises: determining the initial position, the terminal position and the sliding track of the sliding operation in the display interface of the screen projection device; determining an initial position and a terminal position of the sliding operation in the display interface of the display device according to the initial position and the terminal position of the sliding operation in the display interface of the screen transmission device and the display interface position of the display device; calculating a distance between the initial position of the sliding operation in the display interface of the display device and the display interface reference position of the display device, and determining a second emission angle of the emission component for sending the screen transmission light signal according to the distance and an initial emission angle of the emission component; calculating a distance between the terminal position of the sliding operation in the display interface of the display device and the display interface reference position of the display device, and determining a third emission angle of the emission component for sending the screen transmission light signal according to the distance and the initial emission angle of the emission component; determining an emission trajectory of the emission component for emitting the screen transmission light signal according to the sliding trajectory; the method comprises: sending the screen transmission light signal to the display device by the emission component from the second emission angle to the third emission angle according to the emission trajectory.
7. A method of controlling a screen transmission output, the method being applied to a display device, characterized by, The method comprises: establishing a connection with the screen transmission device; sending a screen projection signal to the screen transmission device, and projecting the display screen of the display device to the screen transmission device for display; receiving the screen transmission light signal sent by the screen transmission device, and converting the received screen transmission light signal into an electrical signal; wherein the screen transmission device receives a user operation, and controls the sending of the screen transmission light signal to the display device based on the user operation; executing an instruction corresponding to the user operation according to the electrical signal; the display interface of the display device comprises a metal plate, and the execution of the instruction corresponding to the user operation according to the electrical signal comprises: determining the position of the user operation in the display interface of the display device according to the current value generated by the screen transmission light signal in the metal plate; the position of the user operation in the display interface of the display device is consistent with the position of the user operation on the touch screen, and the position of the user operation on the touch screen is obtained by calculating the current proportion flowing out of the electrodes at the four corners of the capacitive touch screen of the screen transmission device; executing the instruction corresponding to the user operation according to the position of the user operation in the display interface of the display device; the determination of the position of the user operation in the display interface of the display device according to the current value generated by the screen transmission light signal in the metal plate comprises: calculating the proportion between the current values flowing through the four corners of the metal plate according to the current values flowing through the four corners of the metal plate generated by the screen transmission light signal in the metal plate; determining the position of the user operation in the display interface of the display device according to the proportion between the current values flowing through the four corners of the metal plate.
8. The method of claim 7, wherein, the receiving of the screen transmission light signal emitted by the screen transmission device and the conversion of the received screen transmission light signal into an electrical signal comprise: receive the screen transmission light signal sent by the screen transmission device based on the metal plate, and determine a current value generated by the screen transmission light signal on the metal plate.
9. The method according to any of claims 7-8, characterized by, The types of the user operations include at least two types, and different types of the user operations correspond to different types of instructions.
10. A screen device, characterized by The device comprises a processor and a memory. The processor is connected with the memory. The memory is configured to store executable program codes. The processor runs a program corresponding to the executable program codes by reading the executable program codes stored in the memory, so as to execute the method according to any one of claims 1-6.
11. A screen device, characterized by The device comprises a processor, a display screen and a laser emitting head. The display screen is connected with the processor, and is configured to receive user operations. The laser emitting head is connected with the processor, and the processor is configured to determine parameters of a screen transmission light signal according to the user operations, and control the laser emitting head to emit the screen transmission light signal to a display device based on the parameters of the screen transmission light signal, so that the display device converts the screen transmission light signal into an electric signal, and executes an instruction corresponding to the user operations according to the electric signal; the processor is further configured to obtain a position of a finger of the user operations on a capacitive touch screen of the screen transmission device by calculating a proportion of currents flowing out of electrodes at four corners of the capacitive touch screen, and determine the parameters of the screen transmission light signal according to the position; and the processor is further configured to determine the screen transmission light signal corresponding to the position of the user operations on the touch screen after obtaining the position of the user operations on the touch screen, so that a position of the screen transmission light signal on a display interface of the display device is consistent with the position of the user operations on the touch screen.
12. A display device, characterized by comprising: The device comprises a processor and a memory. The processor is connected with the memory. The memory is configured to store executable program codes. The processor runs a program corresponding to the executable program codes by reading the executable program codes stored in the memory, so as to execute the method according to any one of claims 7-9.
13. A display device, characterized by comprising: The device comprises a processor, a display screen and a metal plate, and the metal plate is arranged below the display screen. The metal plate is connected with the processor, and is configured to receive a screen transmission light signal transmitted by a screen transmission device, and convert the received screen transmission light signal into an electric signal; wherein the screen transmission device receives a user operation, and controls transmission of the screen transmission light signal to the metal plate based on the user operation; and is further configured to determine a position of the user operation in a display interface of the display device according to a current value generated by the screen transmission light signal in the metal plate; the position of the user operation in the display interface of the display device is consistent with a position of the user operation on a touch screen, and the position of the user operation on the touch screen is obtained by calculating a current proportion flowing out of electrodes at four corners of a capacitive touch screen of the screen transmission device; and is further configured to calculate a proportion between current values flowing through four corners of the metal plate according to the current values flowing through the four corners of the metal plate generated by the screen transmission light signal in the metal plate; and determine the position of the user operation in the display interface of the display device according to the proportion between the current values flowing through the four corners of the metal plate. The processor is connected with the display screen, and is configured to execute an instruction corresponding to the user operation on the display screen according to the electric signal, and execute the instruction corresponding to the user operation according to the position of the user operation in the display interface of the display device.
14. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the method of any one of claims 1-9.
Citation Information
Patent Citations
Multi-screen control system and method thereof
CN107589930A
Wireless screen transmission method, equipment and system
CN109379549A
Intelligent display device, mobile terminal and display control method
CN113485626A