Data processing method and corresponding device

Abstract

The invention provides a data processing method which can be applied to a screen projection scene, and the method comprises the following steps: a first screen projection device projects first data to a conference all-in-one machine, the first data is displayed as a first page, the conference all-in-one machine receives a remote control signal from a remote controller, and the remote control signal is used for indicating to update the first page; the conference all-in-one machine performs reverse control processing on the remote control signal to obtain a reverse control signal; wherein the reverse control signal is used for updating first data on the first screen projection device; outputting a reverse control signal to the first screen projection device; wherein the reverse control signal is used for the first screen projection device to update the screen projection data from the first data to the second data. According to the scheme provided by the invention, the first projection screen device can be operated through the remote controller to perform data updating, and a user does not need to go back to operate the first projection screen device when being far away from the first projection screen device, so that the convenience of operating the projection screen device in a projection screen scene is improved, and the user experience is also improved.

Description

Technical Field

[0001] This application relates to the field of communication technology, specifically to a data processing method and corresponding apparatus. Background Technology

[0002] In meeting settings, all-in-one conference machines or televisions are commonly used to display meeting content. The meeting facilitator can use wired screen sharing to project content from a wired device onto the all-in-one conference machine. Alternatively, the facilitator can use wireless screen sharing to project content from a wireless device onto the all-in-one conference machine.

[0003] Currently, meeting hosts typically operate wired or wireless projection devices to update the content displayed on the all-in-one meeting machine. However, in many scenarios, the meeting host is often far from the wired or wireless projection device. Therefore, improving the ease of operation of meeting content by the meeting host or participants during the meeting has become an urgent problem to be solved. Summary of the Invention

[0004] This application provides a data processing method to improve the ease of operation of screen projection devices in screen projection scenarios. This application also provides corresponding devices, computer-readable storage media, and computer program products.

[0005] The first aspect of this application provides a data processing method applicable to display devices such as conference all-in-one machines and video terminals (hereinafter, "conference all-in-one machine" refers to any display device capable of receiving projected data). The method includes: receiving a remote control signal from a remote controller; wherein the remote control signal is used to instruct the updating of a first page, the first page being the page after the first data is projected from a first projecting device; performing reverse control processing on the remote control signal to obtain a reverse control signal; wherein the reverse control signal is used to update the first data on the first projecting device; and outputting the reverse control signal to the first projecting device; wherein the reverse control signal is used by the first projecting device to update the projected data from the first data to second data.

[0006] In this application, the remote control may be referred to as a pointing remote control, and the remote control signal refers to the signal emitted by the user through operating the remote control.

[0007] In this application, the first projection device may also be referred to as a projection source device, projection source equipment, or projection source terminal; in this application, it is uniformly referred to as a projection device. The first projection device can be a wired projection device or a wireless projection device. Wired projection devices may include personal computers (PCs), laptops, and other electronic devices that can be connected to a conference all-in-one machine via a Type-C cable for projection. Wireless projection devices may include laptops, tablets, mobile phones, wearable devices, and other electronic devices that communicate with a conference all-in-one machine via a wireless network for projection.

[0008] In this application, the first page can be data projected from the first projection device and displayed in full screen or split screen on the conference all-in-one machine. Full screen means the entire screen is occupied by the projection data from the first projection device, while split screen means the projection data from the first projection device only occupies a portion of the screen, with other areas displaying projection content not from the first projection device, such as content from a second projection device, or content already displayed on the conference all-in-one machine.

[0009] In this application, "reverse" is relative to "forward." Forward refers to the direction of the data flow from the first projection device to the conference all-in-one machine. Reverse refers to the direction of the control signal flow from the conference all-in-one machine to the first projection device.

[0010] In this application, "reverse control signal" refers to a signal from the conference all-in-one machine to the first projection device, used to control data updates on the first projection device.

[0011] In this application, "updating" refers to adjusting the projection data on the first projection device. This can include adjusting the font, format, color, and display position of the first data, as well as adjusting the data content. Examples of possible changes include changing the page of the first data, scrolling up or down on the page, adding or deleting content on the page, etc. As long as the second data is not completely identical to the first data, it constitutes a data update. As the first data on the first projection device is updated to the second data, the page displayed on the conference all-in-one machine will also be updated from the first page to the second page, with the presentation of the second page corresponding to the update format of the first data.

[0012] In the first aspect mentioned above, when the conference all-in-one machine is in projection mode, it can receive remote control signals from the remote control and perform reverse control processing on these signals to obtain a reverse control signal. This reverse control signal is then output to the first projection device, allowing for data updates on the first projection device to be controlled via the reverse control signal. This eliminates the need for the user to be constantly near the first projection device to perform data updates, nor does it require the user to walk over from a distance to operate the device. This improves the convenience of operating the projection device in projection scenarios and enhances the user experience.

[0013] In one possible implementation, before receiving the remote control signal from the remote controller, the method further includes: initiating a reverse control process based on the screen position information of the first page; wherein the screen position information of the first page is used to determine whether the remote control signal is used to update the first page, and the reverse control process is used to instruct the remote control signal to be processed in reverse.

[0014] In this application, the screen position information of the first page can be used to determine whether the coordinates of the remote control signal are within the screen position information of the first page. If the coordinates of the remote control signal are within the screen position information of the first page, it means that the user wants to operate the first page. If the coordinates of the remote control signal are not within the screen position information of the first page, it means that the user wants to operate something other than the first page, which may be other content in the split-screen display scene. In this case, it is not necessary to generate a reverse control signal for the first page.

[0015] In this possible implementation, starting the reverse control process based on the screen position information of the first page can reduce erroneous operations of reversing remote control signals that are not operated on the first page, thereby improving the accuracy of generating reverse control signals.

[0016] In one possible implementation, if the first projection device is a wired projection device, then the remote control signal is processed in reverse to obtain a reverse control signal, including: if it is determined that the remote control signal points to the first page, then the remote control signal is converted into a first touch signal according to the reverse control process of the wired projection device.

[0017] Correspondingly, outputting a reverse control signal to the first projection device includes: outputting a first touch signal to the wired projection device through a touch channel; wherein the first touch signal is a reverse control signal.

[0018] In this application, "remote control signal pointing to the first page" means that the coordinates of the remote control signal are located within the screen position information of the first page, indicating that the user wants to update the first page, that is, update the first data on the first projection device. The remote control signal needs to go through the reverse control process, that is, the remote control signal needs to be processed in reverse control.

[0019] In this application, the reverse control process of the wired projection device refers to the process by which the remote control signal is converted into a reverse control signal and output to the wired projection device when the wired projection device projects the screen.

[0020] In this application, "touch channel" refers to the signal transmission channel between the conference all-in-one machine and the wired projection device formed by touch components and touch screen control principles.

[0021] In this possible implementation, for scenarios involving wired screen projection, the remote control signal can be converted into a first touch signal (reverse control signal), and the reverse control signal can be output to the wired screen projection device through the touch channel, thereby updating the first data on the wired screen projection device.

[0022] In one possible implementation, the reverse control flow of the wired projection device involves a remote control driver and a touch driver. The remote control driver is used to drive a remote control receiver, which receives remote control signals, and the touch driver is used to drive a touch component. The remote control driver is used to convert the remote control signal into a first touch signal after determining that the remote control signal points to the first page, and to pass the first touch signal to the touch driver. The touch driver is used to invoke the touch component and output the first touch signal through the touch channel.

[0023] In this application, the remote control receiver and touch component can be hardware on the conference all-in-one machine.

[0024] In this possible implementation, the remote control driver on the conference all-in-one machine determines whether to perform reverse control. If it is determined that reverse control is to be performed, the remote control signal is converted into a first touch signal. Then, the touch driver calls the touch component to transmit the first touch signal to the wired projection device, thereby updating the first data on the wired projection device.

[0025] In one possible implementation, before receiving a remote control signal from a remote controller, the method further includes: initiating a reverse control flow of the touch driver via a screen mirroring application, the reverse control flow of the touch driver being used to instruct the touch component to output a first touch signal.

[0026] In this possible implementation, the screen mirroring application can start the reverse control process of the touch driver after receiving the screen mirroring data. In this way, after the touch driver receives the first touch signal, it can directly transmit the first touch signal to the wireless screen mirroring device through the touch channel, thus improving the efficiency of reverse control.

[0027] In one possible implementation, if the first projection device is a wireless projection device, then the remote control signal is processed in reverse to obtain a reverse control signal, including: if it is determined that the remote control signal points to the first page, then according to the reverse control process of the wireless projection device, the remote control signal is converted into a second touch signal.

[0028] Correspondingly, outputting a reverse control signal to the first projection device includes: outputting a second touch signal to the wireless projection device through a wireless channel; wherein the wireless channel is also used to transmit projection data of the wireless projection device, and the second touch signal is a reverse control signal.

[0029] In this application, a wireless channel refers to a transmission channel formed through a wireless connection.

[0030] In this possible implementation, for scenarios where a wireless screen projection device projects the screen, the remote control signal can be converted into a second touch signal (reverse control signal), and the reverse control signal can be output to the wireless screen projection device through a wireless channel, thereby updating the first data on the wireless screen projection device.

[0031] In one possible implementation, the reverse control flow of the wireless projection device involves a remote control driver, an operating system input subsystem, a projection application, and a wireless network driver. The remote control driver drives a remote control receiver to receive remote control signals, and the wireless network driver drives a wireless communication module. The remote control driver, after determining that the remote control signal points to the first page, converts the remote control signal into a third touch signal and transmits the third touch signal to the projection application via the operating system input subsystem. The projection application, based on the screen position information of the first page, converts the third touch signal into a second touch signal and transmits the second touch signal to the wireless network driver. The wireless network driver invokes the wireless communication module to output the second touch signal via a wireless channel.

[0032] In this possible implementation, the remote control driver on the conference all-in-one machine determines whether to perform reverse control. If reverse control is required, the remote control signal is converted into a third touch signal. The third touch signal is then transmitted to the screen projection application through the operating system input subsystem. The screen projection application converts the third touch signal into a second touch signal and then transmits it to the wireless screen projection device through the wireless network driver and wireless communication module, thereby updating the first data on the wireless screen projection device.

[0033] In one possible implementation, the reverse control process is initiated based on the screen position information of the first page, including: passing the screen position information of the first page to the remote control driver through a screen mirroring application to initiate the reverse control process of the remote control driver.

[0034] In this possible implementation, after receiving the screen mirroring data, the screen mirroring application can pass the screen position information of the first page to the remote control driver. In this way, the remote control driver can determine whether the received remote control signal needs to be reversed based on the screen position information of the first page. This can reduce the erroneous operation of reversing remote control signals that do not operate the first page, thereby improving the accuracy of generating reverse control signals.

[0035] A second aspect of this application provides a data processing apparatus, comprising:

[0036] The receiving unit is used to receive remote control signals from the remote controller; wherein the remote control signals are used to instruct the updating of the first page, the first page being the page after the first data is projected from the first projection device;

[0037] The processing unit is used to perform reverse control processing on the remote control signal to obtain a reverse control signal; wherein the reverse control signal is used to update the first data on the first projection device.

[0038] The sending unit is used to output a reverse control signal to the first projection device; wherein the reverse control signal is used by the first projection device to update the projection data from the first data to the second data.

[0039] In one possible implementation, the processing unit is further configured to initiate a reverse control process based on the screen position information of the first page; wherein the screen position information of the first page is used to determine whether the remote control signal is used to update the first page, and the reverse control process is used to instruct the remote control signal to be processed in reverse.

[0040] In one possible implementation, the first projection device is a wired projection device;

[0041] The processing unit is specifically used to convert the remote control signal into a first touch signal according to the reverse control process of the wired projection device if it is determined that the remote control signal points to the first page.

[0042] The transmitting unit is specifically used to output a first touch signal to the wired projection device through the touch channel; wherein the first touch signal is a reverse control signal.

[0043] In one possible implementation, the reverse control process of the wired projection device involves a remote control driver and a touch driver; wherein, the remote control driver is used to drive the remote control receiver, the remote control receiver is used to receive remote control signals, and the touch driver is used to drive the touch component.

[0044] The remote control driver is used to convert the remote control signal into a first touch signal after determining that the remote control signal is pointing to the first page, and to pass the first touch signal to the touch driver.

[0045] The touch driver is used to invoke the touch component and output the first touch signal through the touch channel.

[0046] In one possible implementation, the processing unit is further configured to initiate the reverse control flow of the touch driver through a screen mirroring application before receiving the remote control signal from the remote controller. The reverse control flow of the touch driver is used to instruct the touch component to output a first touch signal.

[0047] In one possible implementation, the first projection device is a wireless projection device;

[0048] The processing unit is specifically used to convert the remote control signal into a second touch signal according to the reverse control process of the wireless screen projection device if it is determined that the remote control signal points to the first page.

[0049] The transmitting unit is specifically used to output a second touch signal to the wireless projection device via a wireless channel; wherein, the wireless channel is also used to transmit projection data of the wireless projection device, and the second touch signal is a reverse control signal.

[0050] In one possible implementation, the reverse control flow of the wireless projection device involves a remote control driver, an operating system input subsystem, a projection application, and a wireless network driver; wherein, the remote control driver is used to drive the remote control receiver, the remote control receiver is used to receive remote control signals, and the wireless network driver is used to drive the wireless communication module.

[0051] The remote control driver is used to convert the remote control signal into a third touch signal after determining that the remote control signal is pointing to the first page, and to pass the third touch signal to the screen mirroring application through the operating system input subsystem;

[0052] The screen mirroring application converts the third touch signal into a second touch signal based on the screen position information of the first page, and transmits the second touch signal to the wireless network driver;

[0053] The wireless network driver is used to invoke the wireless communication module and output a second touch signal through the wireless channel.

[0054] In one possible implementation, the processing unit is specifically used to transmit the screen position information of the first page to the remote control driver through the screen mirroring application, so as to initiate the reverse control process of the remote control driver.

[0055] A third aspect of this application provides a data processing apparatus. The apparatus may include at least one processor, a memory, and a communication interface. The processor is coupled to the memory and the communication interface. The memory is used to store instructions, the processor is used to execute the instructions, and the communication interface is used to communicate with other devices under the control of the processor. When executed by the processor, the instructions cause the processor to perform the methods of the first aspect or any possible implementation thereof.

[0056] The fourth aspect of this application provides a computer-readable storage medium storing one or more computer-executable instructions, wherein when the computer-executable instructions are executed by a processor, the processor performs a method as described in the first aspect or any possible implementation thereof.

[0057] The fifth aspect of this application provides a computer program product that stores one or more computer execution instructions, wherein when the computer execution instructions are executed by a processor, the processor executes the method described in the first aspect or any possible implementation thereof.

[0058] A sixth aspect of this application provides a chip system including a processor for supporting a computer device in implementing the functions described in the first aspect or any possible implementation thereof. In one possible design, the chip system may further include a memory for storing necessary program instructions and data. This chip system may be composed of chips or may include chips and other discrete devices.

[0059] The seventh aspect of this application provides a screen projection system, including: a first screen projection device and a display device, the display device being used to perform the method of the first aspect or any possible implementation of the first aspect.

[0060] The display device can be a conference all-in-one machine or a video conferencing terminal.

[0061] The projection system may also include a network device for establishing a wired or wireless connection between the first projection device and the display device.

[0062] The network device can be a connection cable, router, or screen projector, etc.

[0063] The technical effects of the second aspect, the third aspect, any possible implementation of the second aspect or the third aspect, and the fourth to seventh aspects can be found in the first aspect or the technical effects of different possible implementations of the first aspect, and will not be repeated here. Attached Figure Description

[0064] Figures 1A to 1D These are schematic diagrams illustrating multiple screen projection scenarios provided in the embodiments of this application;

[0065] Figure 2A and Figure 2B These are two schematic diagrams of a meeting scenario provided in the embodiments of this application;

[0066] Figure 3A and Figure 3B These are two schematic diagrams of a meeting scenario provided in the embodiments of this application;

[0067] Figure 4 This is a schematic diagram of an embodiment of the data processing method provided in this application;

[0068] Figure 5 This is a schematic diagram of another embodiment of the data processing method provided in this application;

[0069] Figure 6 This is a schematic diagram illustrating the structure and working principle of the conference all-in-one machine provided in the embodiments of this application;

[0070] Figure 7 This is a schematic diagram illustrating the working principle of the conference all-in-one machine provided in this application when performing wired screen projection;

[0071] Figure 8 This is a schematic diagram of the wired screen projection process provided in the embodiments of this application;

[0072] Figure 9 This is a schematic diagram illustrating the working principle of the conference all-in-one machine provided in this application when performing wireless screen projection;

[0073] Figure 10 This is a flowchart illustrating the wireless screen projection process provided in an embodiment of this application.

[0074] Figure 11A This is a schematic diagram of the structure of the data processing apparatus provided in an embodiment of this application;

[0075] Figure 11B This is another structural schematic diagram of the data processing device provided in the embodiments of this application. Detailed Implementation

[0076] The embodiments of this application are described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. As those skilled in the art will understand, with the development of technology and the emergence of new scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.

[0077] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0078] In this application, the terms "system" and "network" are used interchangeably. "Multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, "at least one of A, B, and C" includes A, B, C, AB, AC, BC, or ABC. And, unless otherwise specified, the ordinal numbers such as "first" and "second" mentioned in this application are used to distinguish multiple objects and are not used to limit the order, sequence, priority, or importance of multiple objects.

[0079] In the embodiments of this application, "send" and "receive" indicate the direction of signal / data transmission. For example, "send information to XX" can be understood as the destination of the information being XX, which may include direct transmission via the air interface or indirect transmission via the air interface by other units or modules. "Receive information from YY" can be understood as the source of the information being YY, which may include direct reception from YY via the air interface or indirect reception from YY via the air interface by other units or modules. "Send" can also be understood as the "output" of the chip interface, and "receive" can also be understood as the "input" of the chip interface.

[0080] This application provides a data processing method to improve the ease of operation of screen projection devices in screen projection scenarios. This application also provides corresponding devices, computer-readable storage media, and computer program products. These will be described in detail below.

[0081] The data processing method provided in this application can be applied to screen mirroring scenarios or systems. These scenarios or systems may include a display device capable of receiving screen mirroring data and at least one screen mirroring device. The display device, which can receive screen mirroring data, can also be called a screen mirroring display device, and the screen mirroring device can also be called a screen mirroring source device. The display device is used to accept and process screen mirroring requests, receive screen mirroring data, and display the screen mirroring data. The screen mirroring data may include documents, audio, video, or images. The screen mirroring device is used to send screen mirroring requests and screen mirroring data to the display device. After successful screen mirroring, the screen mirroring device can display other data. The mainstream communication protocol for screen mirroring is the Digital Living Network Alliance (DLNA).

[0082] The screen projection devices in this application include, but are not limited to, terminal devices (also referred to as user equipment (UE)) that provide voice and / or data connectivity to users. For example, a screen projection device is a terminal device with unlimited transmission and reception capabilities. The display device provided in this application can be a terminal device with display capabilities. The terminal devices mentioned in this application can be deployed on land, including indoors or outdoors, handheld or vehicle-mounted; they can also be deployed on water (such as ships); and they can also be deployed in the air (such as airplanes, balloons, and satellites). The terminal can be a mobile phone, tablet, desktop, laptop, ultra-mobile personal computer (UMPC), handheld computer, netbook, personal digital assistant (PDA), wearable electronic device, computer with wireless transceiver capability, virtual reality (VR) terminal, augmented reality (AR) terminal, wireless terminal in industrial control, wireless terminal in self-driving, wireless terminal in remote medical care, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, wireless terminal in smart home, and wireless terminal in Internet of Things (IoT), etc. It is understood that the terminal device of this application can be fixed or mobile, and all or part of the functions of the terminal device can be implemented through software functions running on hardware, or through virtualization functions instantiated on a platform (e.g., cloud platform).

[0083] The screen projection scenarios or systems provided in this application can be divided into wired screen projection and wireless screen projection. Wired screen projection refers to screen projection achieved through a wired connection between the screen projection device and a display device capable of receiving screen projection data. The screen projection device in wired screen projection can be referred to as a wired screen projection device. Wireless screen projection refers to screen projection achieved through a wireless connection between the screen projection device and a conference all-in-one machine. The screen projection device in wireless screen projection can be referred to as a wireless screen projection device.

[0084] Display devices that can receive screen projection data can include conference all-in-one machines and video terminals (such as televisions and computers). For ease of description, the term "conference all-in-one machine" will be used to refer to display devices that can receive screen projection data in the following text.

[0085] For information on wired and wireless screen mirroring scenarios, please refer to [link / reference]. Figures 1A to 1D To understand.

[0086] Figure 1A The diagram shows a wired projection scenario, which includes a wired projection device, a conference all-in-one machine, and a connecting cable, which can be a Type-C cable.

[0087] Wired projection devices can include personal computers (PCs), laptops, and other electronic devices that can be connected to conference all-in-one machines via a Type-C cable for projection.

[0088] The interface of a Type-C cable is generally referred to as a Type-C interface. A Type-C interface can include a display port (DP), a universal serial bus (USB) interface, or a high definition multimedia interface (HDMI).

[0089] like Figure 1A In this process, the wired projection device can transmit projection data to the conference all-in-one machine via DP or HDMI, and the conference all-in-one machine can transmit reverse control signals to the wired projection device via USB interface.

[0090] Figure 1B The image shows a wireless screen sharing scenario, which includes a wireless screen sharing device, a conference all-in-one machine, and a router. Both the wireless screen sharing device and the conference all-in-one machine are connected to the router wirelessly. Thus, the wireless screen sharing device and the conference all-in-one machine are located on the same local area network (LAN).

[0091] Figure 1B In the wireless projection scenario shown, the wireless projection device can transmit projection data to the conference all-in-one machine via a wireless network. This projection mode can be called station (STA) projection.

[0092] The wireless screen projection device in this application embodiment may include electronic devices such as laptops, tablets, mobile phones, and wearable devices that communicate with conference all-in-one machines via wireless networks for screen projection.

[0093] Figure 1CThe following is another wireless screen sharing scenario, which includes a wireless screen sharing device, a conference all-in-one machine, and a screen sharing device. The wireless screen sharing device can be connected to the screen sharing device via a USB interface. The conference all-in-one machine and the screen sharing device can be connected wirelessly. The conference all-in-one machine can act as an access point (AP), and the screen sharing device can act as a STA connected to the conference all-in-one machine. The conference all-in-one machine and the screen sharing device are on the same local area network.

[0094] Figure 1C The wireless screen sharing scenario shown can be described as follows: the wireless screen sharing device can transmit screen sharing data to the conference all-in-one machine through the screen sharing device. This screen sharing mode can be called site AP screen sharing.

[0095] Figure 1D The image shows another wireless screen sharing scenario, which includes a wireless screen sharing device and a conference all-in-one machine. The wireless screen sharing device and the conference all-in-one machine can be directly connected via a wireless local area network (WLAN). In this way, the wireless screen sharing device can transmit screen sharing data to the conference all-in-one machine. This screen sharing mode can be called site-to-site screen sharing.

[0096] The above-mentioned Figures 1A to 1D The various screen mirroring methods can be applied to meeting scenarios, daily life scenarios, or other scenarios that require screen mirroring. See below for details. Figure 2A and Figure 2B Let's take a meeting scenario as an example.

[0097] like Figure 2A As shown, the speaker uses a laptop as a projection device, projecting data from the laptop onto the all-in-one conference machine via wired connection so that attendees can view the speaker's content. The projected data is displayed on the all-in-one conference machine in page format, such as... Figure 2A Currently, page 1 is shown. In reality, data on a laptop may also be displayed in page format. For ease of distinction, this application refers to the projected data on the projection device as "data" and the projected data displayed on the all-in-one conference machine as "page." In fact, the content of both is the same.

[0098] from Figure 2A As can be seen, in order to easily operate the laptop to update the screen projection data, the presenter needs to stay near the laptop at all times. If the presenter moves away from the laptop, such as... Figure 2B As shown, the presenter cannot operate the laptop. If the screen projection data needs to be updated, the presenter needs to walk up to the laptop to operate it, which brings great inconvenience to the presenter's operation of the laptop.

[0099] Based on this, this application provides a data processing method for screen projection scenarios. Taking a meeting scenario as an example, for instance... Figure 3A and Figure 3B As shown, the presenter can use a remote control to update the projection data, which brings great convenience to the presenter.

[0100] like Figure 3A As shown, the presenter uses projection device 1 to project data from projection device 1 to the conference all-in-one machine via wired projection. For example: Currently... Figure 3A The image displayed is page 1. If the presenter is far from the projection device 1, they can use a remote control to send a remote control signal to the conference all-in-one machine. The conference all-in-one machine can convert this remote control signal into a reverse control signal and send it to the projection device 1, thereby updating the projection data on the projection device 1.

[0101] Of course, wireless screen sharing is also an option, and the conference all-in-one machine can display data from different sharing devices in a split-screen format. For example... Figure 3B As shown, projection device 1 can connect to the conference all-in-one machine via a wired connection for projection, such as page 1 displayed on the conference all-in-one machine being data projected from projection device 1; projection device 2 can connect to the conference all-in-one machine via a wireless connection for projection, such as page 2 displayed on the conference all-in-one machine being data projected from projection device 2. Of course, this is just an example of splitting the screen into two areas; in reality, it can also be split into multiple areas to display different content.

[0102] The speaker is relatively far from both projection devices 1 and 2. The speaker can send remote control signals to different areas of the conference machine based on the page to be updated. The conference machine converts these signals into reverse control signals and sends them to the respective projection devices. For example, if the speaker uses the remote control to send a signal to the area of ​​page 1, the conference machine will send a reverse control signal to projection device 1, thus updating the projection data on projection device 1. Similarly, if the speaker uses the remote control to send a signal to the area of ​​page 2, the conference machine will send a reverse control signal to projection device 2, thus updating the projection data on projection device 2.

[0103] Of course, the above Figure 3A and Figure 3B The example given is the speaker using a remote control for reverse control. In reality, attendees can also use the remote control for reverse control, especially in split-screen display scenarios. Attendees can project content they want to interact with the speaker or other attendees onto the conference all-in-one machine and then interact with the speaker or other attendees.

[0104] From the above Figure 3A and Figure 3B As can be seen from the described scenarios, the data processing method for screen projection scenarios provided in this application can bring great convenience to users.

[0105] The data processing method provided in the embodiments of this application is described below with reference to the accompanying drawings.

[0106] like Figure 4 As shown, the data processing method provided in this application embodiment includes:

[0107] S401. The conference all-in-one machine displays the first data projected by the first projection device on the first page.

[0108] In this application, the first projection device can be a wired projection device or a wireless projection device. For an understanding of wired or wireless projection devices, please refer to the preceding description.

[0109] S402. The remote controller sends a remote control signal to the conference all-in-one device. Correspondingly, the conference all-in-one device receives the remote control signal from the remote controller.

[0110] In this application, the remote control may be referred to as a pointing remote control, and the remote control signal refers to the signal emitted by the user through operating the remote control.

[0111] In this application, the remote control signal is used to instruct the updating of the first page.

[0112] In this application, the first page can be data projected from the first projection device and displayed in full screen or split screen on the conference all-in-one machine. Full screen means the entire screen is occupied by the projection data from the first projection device, while split screen means the projection data from the first projection device only occupies a portion of the screen, with other areas displaying projection content not from the first projection device, such as content from a second projection device, or content already displayed on the conference all-in-one machine.

[0113] The S403 conference all-in-one machine performs reverse control processing on the remote control signal to obtain a reverse control signal.

[0114] The reverse control signal is used to update the first data on the first projection device.

[0115] In this application, "reverse" is relative to "forward." Forward refers to the direction of the data flow from the first projection device to the conference all-in-one machine. Reverse refers to the direction of the control signal flow from the conference all-in-one machine to the first projection device.

[0116] In this application, "reverse control signal" refers to a signal from the conference all-in-one machine to the first projection device, used to control data updates on the first projection device.

[0117] S404. The conference all-in-one machine outputs a reverse control signal to the first projection device. Correspondingly, the first projection device receives the reverse control signal from the conference all-in-one machine.

[0118] S405. The first projection device updates the projection data from the first data to the second data according to the reverse control signal.

[0119] S406. The first projection device sends update data to the conference all-in-one machine. Correspondingly, the conference all-in-one machine receives the update data.

[0120] In this application, the updated data may be the difference between the second data and the first data, or the display format change indication information, etc.

[0121] The S407 conference all-in-one machine displays the second data projected by the first projection device on a second page.

[0122] In this application, "updating" refers to adjusting the projection data on the first projection device. This can include adjusting the font, format, color, and display position of the first data, as well as adjusting the data content. Examples of possible changes include changing the page of the first data, scrolling up or down on the page, adding or deleting content on the page, etc. As long as the second data is not completely identical to the first data, it constitutes a data update. As the first data on the first projection device is updated to the second data, the page displayed on the conference all-in-one machine will also be updated from the first page to the second page, with the presentation of the second page corresponding to the update format of the first data.

[0123] As can be seen from the above data processing scheme, when the conference all-in-one machine is in projection mode, it can receive remote control signals from the remote control and perform reverse control processing on these signals to obtain a reverse control signal. This reverse control signal is then output to the first projection device, allowing for data updates on the first projection device. This eliminates the need for the user to be constantly near the first projection device to perform data updates, nor does it require the user to walk over from a distance to operate the device. This improves the convenience of operating the projection device in projection scenarios and enhances the user experience.

[0124] Optionally, the principle of S403 in this embodiment being able to perform reverse control processing on the remote control signal can be found in [reference needed]. Figure 5 To understand.

[0125] like Figure 5 As shown, after the first projection device is connected to the conference all-in-one machine, it sends the first data to the conference all-in-one machine, and the conference all-in-one machine displays the projection data in the form of the first page.

[0126] After the conference all-in-one machine displays the first page, it will perform the following steps:

[0127] S501. The conference all-in-one machine initiates a reverse control process based on the screen position information of the first page; wherein, the screen position information of the first page is used to determine whether the remote control signal is used to update the first page, and the reverse control process is used to instruct the remote control signal to be processed in reverse.

[0128] In this application, the screen position information of the first page can be used to determine whether the coordinates of the remote control signal are within the screen position information of the first page. If the coordinates of the remote control signal are within the screen position information of the first page, it means that the user wants to operate the first page. If the coordinates of the remote control signal are not within the screen position information of the first page, it means that the user wants to operate something other than the first page, which may be other content in the split-screen display scene. In this case, it is not necessary to generate a reverse control signal for the first page.

[0129] If the first screen projection device is a wired screen projection device, then execute S502 and S503; if the first screen projection device is a wireless screen projection device, then execute S504 and S505.

[0130] S502. If it is determined that the remote control signal points to the first page, the conference all-in-one machine converts the remote control signal into the first touch signal according to the reverse control process of the wired screen projection device.

[0131] S503. The conference all-in-one machine outputs a first touch signal to the wired projection device through a touch channel; wherein, the first touch signal is a reverse control signal.

[0132] In this application, "remote control signal pointing to the first page" means that the coordinates of the remote control signal are located within the screen position information of the first page, indicating that the user wants to update the first page, that is, update the first data on the first projection device. The remote control signal needs to go through the reverse control process, that is, the remote control signal needs to be processed in reverse control.

[0133] In this application, the reverse control process of the wired projection device refers to the process by which the remote control signal is converted into a reverse control signal and output to the wired projection device when the wired projection device projects the screen.

[0134] In this application, "touch channel" refers to the signal transmission channel between the conference all-in-one machine and the wired projection device formed by touch components and touch screen control principles.

[0135] The solution provided in this application embodiment, for the scenario of screen projection by a wired projection device, can convert the remote control signal into a first touch signal (reverse control signal) and output the reverse control signal to the wired projection device through the touch channel, thereby realizing the update of the first data on the wired projection device.

[0136] S504. If it is determined that the remote control signal points to the first page, the conference all-in-one machine converts the remote control signal into a second touch signal according to the reverse control process of the wireless screen projection device.

[0137] The S505 conference all-in-one machine outputs a second touch signal to the wireless projection device via a wireless channel; the wireless channel is also used to transmit projection data from the wireless projection device, and the second touch signal is a reverse control signal.

[0138] In this application, a wireless channel refers to a transmission channel formed through a wireless connection.

[0139] The solution provided in this application embodiment, for the scenario of screen projection by a wireless projection device, can convert the remote control signal into a second touch signal (reverse control signal) and output the reverse control signal to the wireless projection device through a wireless channel, thereby realizing the update of the first data on the wireless projection device.

[0140] To facilitate understanding of the reverse control working principle of the aforementioned conference all-in-one machine, the following will combine... Figure 6 First, let's introduce the architecture of the software and hardware layers related to screen projection in the conference all-in-one machine.

[0141] like Figure 6 As shown, the conference all-in-one machine communicates with wireless projection devices, remote controls, or wired projection devices through a hardware layer. The hardware and software layers of the conference all-in-one machine collaborate to complete data projection and reverse control processes. The hardware layer includes a projection interface, touch components, a remote control receiver, and a wireless communication module, which can be a Wireless Fidelity (Wi-Fi) module. The hardware layer is used for data interaction with other devices, enabling the input of projection data, the input of control signals, and the output of reverse control signals.

[0142] The screen projection interface is used to connect a wired screen projection device via a wired connection and transmit screen projection data via DP or HDMI.

[0143] The touch component is used to communicate with the wired projection device via a USB interface. It can send touch signals to the wired projection device. These touch signals can be touch signals emitted from the screen touch of the conference all-in-one machine or touch signals obtained by converting remote control signals.

[0144] The remote control receiver uses ultra-wideband (UWB) technology to locate the remote control's position and receives remote control signals via Bluetooth (BT) protocol. BT is a short-range communication protocol. After receiving the remote control signal, the receiver can report the signal to the software-level remote control driver via USB.

[0145] The wireless communication module is used to connect to the wireless projection device wirelessly, allowing projection data to be transmitted to the conference all-in-one machine via a wireless network or wireless channel. After receiving the projection data, the wireless communication module can report it to the wireless network driver (e.g., network driver and protocol stack) for processing via USB or the peripheral component interconnect express (PCI-E) serial computer extension bus.

[0146] The software layer includes the operating system display subsystem, the operating system input subsystem, the touch driver, the remote control driver, the wireless network driver, and the screen projection application; the software in the software layer is used to process the data reported by the hardware, and to realize the processing and distribution of data projection, control signals, and reverse control signals.

[0147] The operating system display subsystem is used for processing the screen projection images of wired and wireless screen projection.

[0148] The operating system input subsystem is used to input touch-related data or remote control-related data into the screen projection application.

[0149] The touch driver is used to process touch signals from the screen of the conference all-in-one machine or reverse touch signals from the remote control driver. Touch signals from the screen can be provided to the operating system input subsystem, which in turn provides them to the projection application. Reverse touch signals can be forwarded to the hardware-level touch component via USB, and then output by the touch component to the wired projection device.

[0150] The remote control driver is used to process and forward remote control signals. If the remote control signal is for controlling the local data of the conference all-in-one machine, the remote control driver can report the remote control signal to the operating system input subsystem to control the conference all-in-one machine. If the remote control driver determines that the remote control signal is issued for the first page corresponding to the screen projection data, it converts the remote control signal into a reverse control signal to achieve reverse control.

[0151] The wireless network driver is used to drive the wireless communication module, enabling it to receive screen projection data from the wireless communication module and transmit screen projection data to the screen projection application. In addition, the wireless network driver also receives reverse control signals from the screen projection application and sends reverse control signals to the wireless communication module.

[0152] Screen mirroring applications are used to control the display of screen mirroring data and generate reverse control signals when wirelessly mirroring.

[0153] The above Figure 6 The hardware and software involved involve various data or signal flows, which will be described separately below.

[0154] 1a represents the screen casting data provided by the operating system's display subsystem to the screen casting application.

[0155] 1b indicates the control data output by the screen mirroring application to the operating system's display subsystem, such as controlling the brightness and color of the operating system's display subsystem.

[0156] 2 indicates the touch signal reported by the operating system input subsystem to the screen projection application. This touch signal is the touch signal output by the user on the screen of the conference all-in-one machine. In order to distinguish it from the touch signal converted from the remote control signal, this touch signal can be called the local touch signal.

[0157] 3 indicates the remote control signal reported by the operating system input subsystem to the screen projection application. This remote control signal is used to control the local data of the conference all-in-one machine and can be called the local remote control signal.

[0158] 4 indicates the reverse control signal passed from the screen mirroring application to the wireless network driver (network driver and protocol stack).

[0159] 5 indicates the wireless projection data passed from the wireless network driver to the operating system's display subsystem.

[0160] 6 indicates the local touch signal reported by the touch driver to the operating system's input subsystem.

[0161] 7 indicates that the remote control driver reports the local remote control signal to the operating system input subsystem.

[0162] 8 indicates that the screen mirroring application settings enable the reverse control process in the touch driver.

[0163] 9 indicates the reverse control signal transmitted from the remote control driver to the touch driver when using wired screen mirroring.

[0164] 10 indicates that the screen mirroring application settings enable the reverse control process in the remote control driver.

[0165] 11 indicates that the screen mirroring interface transmits wired screen mirroring data to the operating system's display subsystem.

[0166] 12a represents the touch signal that the touch component transmits to the touch driver.

[0167] 12b represents the reverse control signal that the touch driver passes to the touch component.

[0168] 13 indicates the remote control signal transmitted from the remote control receiver to the remote control driver.

[0169] 14a represents the wireless projection data transmitted by the wireless communication module to the wireless network driver.

[0170] 14b represents the reverse control signal passed from the wireless network driver to the wireless communication module.

[0171] 15 indicates that the wired projection device sends the projection data to the projection interface via wired connection.

[0172] 16 indicates the reverse control signal sent by the touch component to the wired projection device.

[0173] 17 indicates the remote control signal sent by the remote control to the remote control receiver.

[0174] 18a represents the wireless projection data sent by the wireless projection device to the wireless communication module.

[0175] 18b represents the reverse control signal sent by the wireless communication module to the wireless projection device.

[0176] The above describes the hardware and software related to screen projection and reverse control in the conference all-in-one machine. The following, with reference to the accompanying drawings, explains the screen projection and reverse control process of the conference all-in-one machine with wired screen projection devices, as well as the screen projection and reverse control process of wireless screen projection devices.

[0177] like Figure 7 As shown, the principle of wired screen projection and the reverse control process provided in this application embodiment include:

[0178] The wired screen mirroring process includes: after the wired screen mirroring device is connected to the screen mirroring interface, it sends wired screen mirroring data 15 to the screen mirroring interface. Then, the screen mirroring interface sends screen mirroring data 11 to the operating system display subsystem. The operating system display subsystem then sends the screen mirroring data 1a to the screen mirroring application. The screen mirroring application displays the screen mirroring data on the screen in the form of a page.

[0179] The reverse control process includes: the screen casting application transmitting signal 8 to the touch driver to start the reverse control process, and the screen casting application transmitting signal 10 to the remote control driver to start the reverse control process. Signal 10 also includes the screen casting position information of the first page. The screen casting position information can be the length, width, and coordinate origin of the screen casting data page. Of course, signal 10 can also include all the coordinate information of the screen casting data page or part of the position information used to define the boundary.

[0180] The remote receiver receives the remote control signal 17 from the remote controller, and then transmits the remote control signal 13 to the remote control driver. The remote control driver can determine whether the remote control signal points to the page where the screen projection data is located based on information such as the length and width of the page and the position of the origin of the page's coordinates in the signal 10. If the remote control signal points to the first page where the screen projection data is located, the remote control driver converts the remote control signal into a first touch signal and transmits the first touch signal 9 to the touch driver. The touch driver transmits the first touch signal 12b to the touch component, and then the touch component sends the first touch signal 16 to the wired screen projection device. The wired screen projection device can then adjust the screen projection data based on the first touch signal, such as updating the screen projection data from the first data to the second data.

[0181] It should be noted that the signals with the same name mentioned above, such as the first touch signal, use different numbers in different stages. This is to facilitate the explanation of the signal association between different hardware and software programs or between different software programs. These signals can be the same, or the corresponding software programs or hardware in different stages can be adjusted accordingly, but this does not affect the function of the signal, such as the reverse control function of the first touch signal.

[0182] For more information on the wired screen mirroring process, please refer to [link / reference]. Figure 8 To understand, such as Figure 8 As shown, before the data processing of the wired screen projection process begins, the user prepares for projection, such as connecting the wired projection device to the conference all-in-one machine via a cable, for example, connecting it to the projection interface via DP or HDMI; and connecting it to the touch component via a USB interface to form a touch channel. Then, the user initiates the projection, which begins the data processing of the wired projection process. This process includes:

[0183] S801. The wired projection device sends the first data to the projection interface.

[0184] The S802 screen mirroring interface transmits the first data to the operating system's display subsystem.

[0185] S803. The operating system display subsystem transmits the first page corresponding to the first data to the screen mirroring application.

[0186] S804. The screen mirroring application displays the first page.

[0187] S805. Screen mirroring application enables the reverse control flow of the touch driver.

[0188] This process can be referred to in the previous section. Figure 7 Let's understand the function of signal 8 as described in the section.

[0189] S806. The screen mirroring application sends information about the screen mirroring area to the remote control driver, enabling the reverse control process of the remote control driver.

[0190] The information of the projection area is the screen position information of the first page, which may include the length and width of the projection data page, the position of the coordinate origin of the page, etc. Of course, the signal 10 may also include all the coordinate information of the projection data page or some of the position information used to define the boundary.

[0191] This process can be referred to in the previous section. Figure 7 Let's understand the function of signal 10 as described in the section.

[0192] S807. The user operates the remote control to send a remote control signal. Correspondingly, the remote control receiver receives the remote control signal.

[0193] The S808 remote control receiver transmits remote control signals to the remote control driver.

[0194] S809. The remote control driver determines whether the remote control signal is pointing to the first page based on the information of the projection area. If the remote control signal is pointing to the first page, the remote control signal is converted into the first touch signal.

[0195] The first touch signal is the reverse control signal.

[0196] The S810 remote control driver transmits the first touch signal to the touch driver.

[0197] S811. The touch driver transmits the first touch signal to the touch component.

[0198] S812. The touch component sends the first touch signal to the wired projection device through the touch channel.

[0199] S813. The wired projection device updates the projection data from the first data to the second data according to the first touch signal.

[0200] The second data can execute the above S801 to S804 processes to update the page on the screen of the conference all-in-one machine from the first page to the second page.

[0201] In the solution provided in this application embodiment, for scenarios involving wired screen projection, the remote control signal can be converted into a first touch signal (reverse control signal), and the reverse control signal can be output to the wired screen projection device through the touch channel, thereby updating the first data on the wired screen projection device. This eliminates the need for the user to walk over to operate the wired screen projection device from a distance, thus improving the convenience of operating the projection device in projection scenarios and enhancing the user experience.

[0202] like Figure 9 As shown, the principle of wireless screen projection and the reverse control process provided in this application embodiment include:

[0203] The wireless screen mirroring process includes: the wireless screen mirroring device connecting to the wireless communication module via a wireless channel; the wireless connection method can be found in the previous section. Figures 1B to 1D To understand this, refer to the explanation below. A wireless channel is a transmission channel formed through a wireless connection. This wireless channel can transmit screen projection data and reverse control signals from the wireless projection device.

[0204] After the user initiates screen mirroring, the wireless screen mirroring device sends screen mirroring data 18a to the wireless communication module via the wireless channel. The wireless communication module then transmits screen mirroring data 14a to the wireless network driver. The wireless network driver then transmits screen mirroring data 5 to the operating system's display subsystem. The operating system's display subsystem sends screen mirroring data 1a to the screen mirroring application. The screen mirroring application displays the screen mirroring data on the screen in a page-like format.

[0205] The reverse control process includes: the screen casting application transmitting a signal 10 to the remote control driver to start the reverse control process. The signal 10 also includes the screen casting position information of the first page. The screen casting position information can be the length, width, and coordinate origin of the screen casting data page. Of course, the signal 10 can also include all the coordinate information of the screen casting data page or some of the position information used to define the boundary.

[0206] The remote control receiver receives remote control signal 17 from the remote control, and then transmits remote control signal 13 to the remote control driver. The remote control driver can determine whether the remote control signal points to the page containing the screen projection data based on information such as the length, width, and coordinate origin of the page in signal 10. If the remote control signal points to the first page containing the screen projection data, the remote control driver converts the remote control signal into a touch signal 7 and transmits it to the operating system input subsystem. The operating system input subsystem transmits touch signal 3 to the screen projection application. The screen projection application, based on the screen position information of the first page, converts the touch signal into a touch signal for controlling the wireless screen projection device, and then transmits touch signal 4 to the wireless network driver. The wireless network driver transmits touch signal 14b to the wireless communication module, which then transmits touch signal 18b to the wireless screen projection device. In this way, the wireless screen projection device can adjust the screen projection data based on the touch signal, such as updating the screen projection data from the first data to the second data.

[0207] It should be noted that the signals with the same name, such as touch signals, use different numbers in different stages. This is to facilitate the explanation of the signal association between different hardware and software programs or between different software programs. These signals can be the same, or the corresponding software programs or hardware in different stages can be adjusted accordingly, but this does not affect the function of the signal, such as the reverse control function of the touch signal.

[0208] For more information on the wireless screen mirroring process, please refer to [link / reference]. Figure 10 To understand, such as Figure 10 As shown, before the data processing phase of the wireless screen sharing process begins, the user prepares for screen sharing by connecting the wireless screen sharing device and the conference all-in-one machine to the same router, or establishing a wireless connection between the two devices through other means, thus forming a wireless channel. Then, the user initiates screen sharing, which begins the data processing phase of the wireless screen sharing process. This process includes:

[0209] S1001. The wireless projection device sends the first data to the wireless communication module.

[0210] S1002. The wireless communication module transmits the first data to the wireless network driver.

[0211] S1003. Wireless Network Driver - First Data Transmission - Operating System - Display Subsystem.

[0212] S1004. The operating system display subsystem transmits the first page corresponding to the first data to the screen mirroring application.

[0213] S1005. The screen mirroring application displays the first page.

[0214] S1006. The screen mirroring application sends information about the screen mirroring area to the remote control driver, enabling the reverse control process of the remote control driver.

[0215] The information of the projection area is the screen position information of the first page, which may include the length and width of the projection data page, the position of the coordinate origin of the page, etc. Of course, the signal 10 may also include all the coordinate information of the projection data page or some of the position information used to define the boundary.

[0216] This process can be referred to in the previous section. Figure 7 Let's understand the function of signal 10 as described in the section.

[0217] S1007. The user operates the remote control to send a remote control signal. Correspondingly, the remote control receiver receives the remote control signal.

[0218] S1008. The remote control receiver transmits the remote control signal to the remote control driver.

[0219] S1009. The remote control driver determines whether the remote control signal is pointing to the first page based on the information of the projection area. If the remote control signal is pointing to the first page, the remote control signal is converted into a third touch signal.

[0220] S1010. The remote control driver transmits the third touch signal to the operating system input subsystem.

[0221] S1011. The operating system input subsystem transmits the third touch signal to the screen projection application.

[0222] S1012. The screen mirroring application converts the third touch signal into a second touch signal based on the screen mirroring position information of the first page.

[0223] The second touch signal is a reverse control signal, and the third touch signal is also a reverse control signal. However, after being processed by the screen mirroring application, the second touch signal is more accurate.

[0224] S1013. The screen mirroring application transmits the second touch signal to the wireless network driver.

[0225] S1014. The wireless network driver transmits the second touch signal to the wireless communication module.

[0226] S1015. The wireless communication module transmits the second touch signal to the wireless projection device.

[0227] S1016. The wireless projection device updates the projection data from the first data to the second data according to the second touch signal.

[0228] The second data can execute the above S1001 to S1004 processes to update the page on the screen of the conference all-in-one machine from the first page to the second page.

[0229] In the solution provided in this application embodiment, for scenarios involving wireless screen projection, the remote control signal can be converted into a reverse control signal and output to the wireless screen projection device via a wireless channel, thereby updating the first data on the wireless screen projection device. This eliminates the need for the user to walk over to operate the wireless screen projection device from a distance, thus improving the convenience of operating the device and enhancing the user experience.

[0230] The above describes the screen projection system, screen projection scenarios, and data processing methods during the screen projection process. The following describes the data processing device in the embodiments of this application with reference to the accompanying drawings. The data processing device can be any of the display devices that can perform screen projection, such as the conference all-in-one machine and video terminal described above.

[0231] like Figure 11A As shown, the data processing apparatus 1100 provided in this application embodiment includes:

[0232] The receiving unit 1101 is used to receive a remote control signal from the remote controller; wherein the remote control signal is used to instruct the updating of the first page, and the first page is the page after the first data is projected by the first projection device;

[0233] The processing unit 1102 is used to perform reverse control processing on the remote control signal to obtain a reverse control signal; wherein the reverse control signal is used to update the first data on the first projection device.

[0234] The sending unit 1103 is used to output a reverse control signal to the first projection device; wherein the reverse control signal is used by the first projection device to update the projection data from the first data to the second data.

[0235] The data processing device provided in this application embodiment, when in screen projection mode, can receive remote control signals from a remote control and perform reverse control processing on the remote control signals to obtain a reverse control signal. This reverse control signal is then output to the first screen projection device, allowing control of data updates on the first screen projection device. This eliminates the need for the user to be constantly near the first screen projection device to perform data updates, nor does it require the user to walk away from the device to perform updates. This improves the convenience of operating the screen projection device in projection scenarios and enhances the user experience.

[0236] Optionally, the processing unit 1102 is further configured to initiate a reverse control process based on the screen position information of the first page; wherein the screen position information of the first page is used to determine whether the remote control signal is used to update the first page, and the reverse control process is used to instruct the remote control signal to be processed in reverse.

[0237] Optionally, the first projection device is a wired projection device;

[0238] The processing unit 1102 is specifically used to convert the remote control signal into a first touch signal according to the reverse control process of the wired projection device if it is determined that the remote control signal points to the first page.

[0239] The sending unit 1103 is specifically used to output a first touch signal to the wired projection device through the touch channel; wherein, the first touch signal is a reverse control signal.

[0240] Optionally, the reverse control process of the wired projection device involves a remote control driver and a touch driver; wherein, the remote control driver is used to drive the remote control receiver, the remote control receiver is used to receive remote control signals, and the touch driver is used to drive the touch component.

[0241] The remote control driver is used to convert the remote control signal into a first touch signal after determining that the remote control signal is pointing to the first page, and to pass the first touch signal to the touch driver.

[0242] The touch driver is used to invoke the touch component and output the first touch signal through the touch channel.

[0243] Optionally, the processing unit 1102 is further configured to initiate the reverse control flow of the touch driver through a screen mirroring application before receiving the remote control signal from the remote controller. The reverse control flow of the touch driver is used to instruct the touch component to output a first touch signal.

[0244] Optionally, the first projection device is a wireless projection device;

[0245] The processing unit 1102 is specifically used to convert the remote control signal into a second touch signal according to the reverse control process of the wireless screen projection device if it is determined that the remote control signal points to the first page.

[0246] The transmitting unit 1103 is specifically used to output a second touch signal to the wireless projection device through a wireless channel; wherein, the wireless channel is also used to transmit projection data of the wireless projection device, and the second touch signal is a reverse control signal.

[0247] Optionally, the reverse control process of the wireless projection device involves a remote control driver, an operating system input subsystem, a projection application, and a wireless network driver; wherein, the remote control driver is used to drive the remote control receiver, the remote control receiver is used to receive remote control signals, and the wireless network driver is used to drive the wireless communication module.

[0248] The remote control driver is used to convert the remote control signal into a third touch signal after determining that the remote control signal is pointing to the first page, and to pass the third touch signal to the screen mirroring application through the operating system input subsystem;

[0249] The screen mirroring application converts the third touch signal into a second touch signal based on the screen position information of the first page, and transmits the second touch signal to the wireless network driver;

[0250] The wireless network driver is used to invoke the wireless communication module and output a second touch signal through the wireless channel.

[0251] Optionally, the processing unit 1102 is specifically used to transmit the screen position information of the first page to the remote control driver through the screen mirroring application, so as to start the reverse control process of the remote control driver.

[0252] In this embodiment, the functions of the receiving unit 1101, processing unit 1102, and sending unit 1103 can be understood by referring to the relevant content of the preceding data processing method, and will not be repeated here.

[0253] This application also provides another data processing apparatus, such as... Figure 11B As shown, for ease of explanation, only the parts related to the embodiments of this application are shown. For specific technical details not disclosed, please refer to the method section of the embodiments of this application. The data processing device can be any terminal device that can accept screen projection, including all-in-one conference machines, televisions, personal computers, laptops, etc. Taking an all-in-one conference machine as an example:

[0254] Figure 11B The diagram shown is a block diagram of a portion of the structure of the conference all-in-one machine provided in the embodiments of this application. (Reference) Figure 11B The conference all-in-one machine includes components such as a projection interface 1110, a memory 1120, an input unit 1130, a display unit 1140, a sensor 1150, an audio circuit 1160, a wireless fidelity (WiFi) module 1170, a processor 1180, and a power supply 1190. Those skilled in the art will understand that... Figure 11B The diagram of the conference all-in-one machine does not constitute a limitation on the conference all-in-one machine. It may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0255] The following is combined Figure 11B A detailed introduction to each component of the all-in-one conference system:

[0256] The projection interface 1110 can be used to connect a wired projection device. The projection interface can include multiple different types of interfaces, such as DP, HDMI, and USB interfaces. Among them, DP can be used for the transmission of high-definition digital content, HDMI can be used for the transmission of high-definition multimedia content, and USB interface can be used for the transmission of touch signals or reverse control signals.

[0257] The memory 1120 can be used to store software programs and modules. The processor 1180 executes various functional applications and data processing of the conference all-in-one machine by running the software programs and modules stored in the memory 1120. The memory 1120 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the conference all-in-one machine (such as audio data, video data, etc.). In addition, the memory 1120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0258] Input unit 1130 can be used to receive input digital or character information, and generate key signal inputs related to user settings and function control of the conference all-in-one machine. Specifically, input unit 1130 may include touch panel 1131 and other input devices 1132. Touch panel 1131, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near touch panel 1131), and drive corresponding connection devices according to a pre-set program. Optionally, touch panel 1131 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to processor 1180, and can also receive and execute commands sent by processor 1180. In addition, touch panel 1131 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1131, the input unit 1130 may also include other input devices 1132. Specifically, other input devices 1132 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc.

[0259] Display unit 1140 can be used to display projection data, data from the conference all-in-one machine itself, information input by the user or provided to the user, and various menus of the conference all-in-one machine. Display unit 1140 may include display panel 1141, optionally configured as a Liquid Crystal Display (LCD), Organic Light-Emitting Diode (OLED), or similar display panel. Furthermore, touch panel 1131 may cover display panel 1141. When touch panel 1131 detects a touch operation on or near it, it transmits the information to processor 1180 to determine the type of touch event. Subsequently, processor 1180 provides corresponding visual output on display panel 1141 based on the type of touch event. Although in Figure 11B In this embodiment, the touch panel 1131 and the display panel 1141 are two separate components to realize the input and output functions of the conference all-in-one machine. However, in some embodiments, the touch panel 1131 and the display panel 1141 can be integrated to realize the input and output functions of the conference all-in-one machine.

[0260] The conference all-in-one machine may also include at least one sensor 1150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 1141 according to the ambient light level, and the proximity sensor can turn off the display panel 1141 and / or backlight when the conference all-in-one machine is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity, and can be used for applications that identify the posture of the conference all-in-one machine (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. Other sensors that the conference all-in-one machine may be equipped with, such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0261] Audio circuit 1160, speaker 1161, and microphone 1162 provide an audio interface between the user and the conference all-in-one machine. Audio circuit 1160 converts received audio data into electrical signals and transmits them to speaker 1161, where speaker 1161 converts them into sound signals for output. On the other hand, microphone 1162 converts collected sound signals into electrical signals, which are received by audio circuit 1160, converted into audio data, and then processed by processor 1180 before being sent via RF circuit 1110 to, for example, another conference all-in-one machine, or the audio data can be output to memory 1120 for further processing.

[0262] WiFi is a short-range wireless transmission technology. The conference all-in-one machine uses the WiFi module 1170 to create a wireless channel for transmitting screen-projected data and transmitting reverse control signals, providing users with wireless broadband internet access. Although Figure 11B The WiFi module 1170 is shown, but it is understood that it is not a necessary component of the conference all-in-one machine and can be omitted as needed without changing the essence of the invention.

[0263] The processor 1180 is the control center of the all-in-one conference machine. It connects various parts of the machine via various interfaces and lines, and performs various functions and processes data by running or executing software programs and / or modules stored in the memory 1120, and by calling data stored in the memory 1120, thereby providing overall control of the all-in-one conference machine. Optionally, the processor 1180 may include one or more processing units; preferably, the processor 1180 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 1180.

[0264] The conference all-in-one machine also includes a power supply 1190 (such as a battery) to power various components. Preferably, the power supply can be logically connected to the processor 1180 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system.

[0265] Although not shown, the conference all-in-one machine may also include a camera, Bluetooth module, etc., which will not be described in detail here.

[0266] In this embodiment of the application, the processor 1180 included in the conference all-in-one machine also has the function of performing the above-mentioned... Figure 4 The specific steps performed by the conference all-in-one machine, such as S403, the functions of the 1180 processor, and the functions of other components, can be found in the previous sections. Figures 1A to 10 To understand the relevant content.

[0267] In another embodiment of this application, a computer-readable storage medium is also provided, which stores computer-executable instructions. When the processor of a computer device executes the computer-executable instructions, the computer device performs the aforementioned... Figures 1A to 10 The steps performed by the conference all-in-one machine.

[0268] In another embodiment of this application, a computer program product is also provided, which includes computer program code. When the computer program code is executed on a computer, the computer device performs the above-described... Figures 1A to 10The steps performed by the conference all-in-one machine.

[0269] In another embodiment of this application, a chip system is also provided, the chip system including one or more interface circuits and one or more processors; the interface circuits and processors are interconnected via lines; the interface circuits are used to receive signals from the memory of a computer device and send signals to the processors, the signals including computer instructions stored in the memory; when the processor executes the computer instructions, the computer device performs the aforementioned actions. Figures 1A to 10 The steps performed by the conference all-in-one machine.

[0270] In one possible design, the chip system may also include a memory for storing program instructions and data necessary for the source device or source end. The chip system may consist of chips or may include chips and other discrete components.

[0271] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, or indirect coupling or communication connection between apparatuses or units, and may be electrical, mechanical, or other forms.

[0272] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0273] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated units described above can be implemented wholly or partially through software, hardware, firmware, or any combination thereof.

[0274] When the integrated unit is implemented using software, it can be implemented in whole or in part as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

Claims

1. A data processing method, characterized in that, include: Receive a remote control signal from a remote controller; wherein the remote control signal is used to instruct the updating of a first page, the first page being the page after the first data is projected from the first projection device; The remote control signal is processed in reverse to obtain a reverse control signal; wherein the reverse control signal is used to update the first data on the first projection device. The reverse control signal is output to the first projection device; wherein the reverse control signal is used by the first projection device to update the projection data from the first data to the second data.

2. The method according to claim 1, characterized in that, Before receiving a remote control signal from a remote controller, the method further includes: The reverse control process is initiated based on the screen position information of the first page; wherein, the screen position information of the first page is used to determine whether the remote control signal is used to update the first page, and the reverse control process is used to instruct the remote control signal to be processed in reverse.

3. The method according to claim 2, characterized in that, If the first projection device is a wired projection device, then the step of performing reverse control processing on the remote control signal to obtain a reverse control signal includes: If it is determined that the remote control signal points to the first page, then according to the reverse control process of the wired projection device, the remote control signal is converted into a first touch signal; Correspondingly, outputting the reverse control signal to the first projection device includes: The first touch signal is output to the wired projection device through the touch channel; wherein, the first touch signal is the reverse control signal.

4. The method according to claim 3, characterized in that, The reverse control process of the wired projection device involves a remote control driver and a touch driver; wherein, the remote control driver is used to drive the remote control receiver, the remote control receiver is used to receive the remote control signal, and the touch driver is used to drive the touch component; The remote control driver is used to convert the remote control signal into the first touch signal after determining that the remote control signal is pointing to the first page, and to transmit the first touch signal to the touch driver. The touch driver is used to invoke the touch component and output the first touch signal through the touch channel.

5. The method according to claim 4, characterized in that, Before receiving a remote control signal from a remote controller, the method further includes: The reverse control flow of the touch driver is initiated through the screen mirroring application. The reverse control flow of the touch driver is used to instruct the touch component to output the first touch signal.

6. The method according to claim 2, characterized in that, If the first projection device is a wireless projection device, then the step of performing reverse control processing on the remote control signal to obtain a reverse control signal includes: If it is determined that the remote control signal is directed to the first page, then according to the reverse control process of the wireless screen projection device, the remote control signal is converted into a second touch signal; Correspondingly, outputting the reverse control signal to the first projection device includes: The second touch signal is output to the wireless projection device via a wireless channel; wherein, the wireless channel is also used to transmit projection data of the wireless projection device, and the second touch signal is the reverse control signal.

7. The method according to claim 6, characterized in that, The reverse control process of the wireless screen projection device involves a remote control driver, an operating system input subsystem, a screen projection application, and a wireless network driver; wherein, the remote control driver is used to drive the remote control receiver, the remote control receiver is used to receive the remote control signal, and the wireless network driver is used to drive the wireless communication module; The remote control driver is used to convert the remote control signal into a third touch signal after determining that the remote control signal is pointing to the first page, and to transmit the third touch signal to the screen casting application through the operating system input subsystem; The screen mirroring application converts the third touch signal into the second touch signal based on the screen position information of the first page, and transmits the second touch signal to the wireless network driver. The wireless network driver is used to invoke the wireless communication module to output the second touch signal through the wireless channel.

8. The method according to any one of claims 2-7, characterized in that, The step of initiating the reverse control process based on the screen position information of the first page includes: The screen position information of the first page is transmitted to the remote control driver through the screen mirroring application to initiate the reverse control process of the remote control driver.

9. A data processing apparatus, characterized in that, include: A receiving unit is configured to receive a remote control signal from a remote controller; wherein the remote control signal is configured to instruct the updating of a first page, the first page being the page after the first data projection from the first projection device; The processing unit is used to perform reverse control processing on the remote control signal to obtain a reverse control signal; wherein the reverse control signal is used to update the first data on the first projection device. The sending unit is used to output the reverse control signal to the first projection device; wherein the reverse control signal is used by the first projection device to update the projection data from the first data to the second data.

10. The apparatus according to claim 9, characterized in that, The processing unit is further configured to initiate a reverse control process based on the screen position information of the first page; wherein the screen position information of the first page is used to determine whether the remote control signal is used to update the first page, and the reverse control process is used to instruct the remote control signal to be processed in reverse.

11. The apparatus according to claim 10, characterized in that, The first projection device is a wired projection device; The processing unit is specifically used to convert the remote control signal into a first touch signal according to the reverse control process of the wired projection device if it is determined that the remote control signal points to the first page. The sending unit is specifically used to output the first touch signal to the wired projection device through the touch channel; wherein, the first touch signal is the reverse control signal.

12. The apparatus according to claim 11, characterized in that, The reverse control process of the wired projection device involves a remote control driver and a touch driver; wherein, the remote control driver is used to drive the remote control receiver, the remote control receiver is used to receive the remote control signal, and the touch driver is used to drive the touch component; The remote control driver is used to convert the remote control signal into the first touch signal after determining that the remote control signal is pointing to the first page, and to transmit the first touch signal to the touch driver. The touch driver is used to invoke the touch component and output the first touch signal through the touch channel.

13. The apparatus according to claim 12, characterized in that, The processing unit is further configured to initiate the reverse control process of the touch driver through a screen mirroring application before receiving the remote control signal from the remote controller. The reverse control process of the touch driver is used to instruct the touch component to output the first touch signal.

14. The apparatus according to claim 10, characterized in that, The first screen projection device is a wireless screen projection device; The processing unit is specifically configured to convert the remote control signal into a second touch signal according to the reverse control process of the wireless screen projection device if it is determined that the remote control signal points to the first page. The transmitting unit is specifically used to output the second touch signal to the wireless projection device through a wireless channel; wherein, the wireless channel is also used to transmit projection data of the wireless projection device, and the second touch signal is the reverse control signal.

15. The apparatus according to claim 14, characterized in that, The reverse control process of the wireless screen projection device involves a remote control driver, an operating system input subsystem, a screen projection application, and a wireless network driver; wherein, the remote control driver is used to drive the remote control receiver, the remote control receiver is used to receive the remote control signal, and the wireless network driver is used to drive the wireless communication module; The remote control driver is used to convert the remote control signal into a third touch signal after determining that the remote control signal is pointing to the first page, and to transmit the third touch signal to the screen casting application through the operating system input subsystem; The screen mirroring application converts the third touch signal into the second touch signal based on the screen position information of the first page, and transmits the second touch signal to the wireless network driver. The wireless network driver is used to invoke the wireless communication module to output the second touch signal through the wireless channel.

16. The apparatus according to any one of claims 10-15, characterized in that, The processing unit is specifically used to transmit the screen position information of the first page to the remote control driver through the screen mirroring application, so as to start the reverse control process of the remote control driver.

17. A data processing apparatus, characterized in that, Includes a processor and a computer-readable storage medium storing a computer program; The processor is coupled to the computer-readable storage medium, and the computer program, when executed by the processor, implements the method as described in any one of claims 1-8.

18. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-8.

19. A computer program product, characterized in that, The computer program product includes computer program code that, when run on a computer device, causes the computer device to perform the method as described in any one of claims 1-8.

Images