Touch return method, interactive tablet and storage medium

Abstract

Disclosed in the embodiments of the present application are a touch return method, an interactive tablet and a storage medium. The touch return method is applied to the interactive tablet. The interactive tablet comprises a touch screen, a central processing unit, a micro-control unit and an output interface, wherein the central processing unit comprises a first USB interface and a first SPI interface, is connected to the touch screen by means of the first USB interface, and is connected to the micro-control unit by means of the first SPI interface; and the micro-control unit comprises a second USB interface, and is connected to the output interface by means of the second USB interface. The touch return method comprises: after first touch data is received, when it is determined that a display channel is a local channel or when the display channel is an external channel and the first touch data meets a preset condition, performing a touch response by means of a central processing unit; and when the display channel is the external channel and it is determined that the first touch data does not meet the preset condition, performing a touch response by means of an external device. The problem in respect of touch data return for an interactive tablet is solved, and the cost of the interactive tablet is reduced.

Description

Touch feedback method, interactive tablet, storage medium Technical Field

[0001] The present application relates to the field of screen projection technology, and in particular to a touch feedback method, an interactive tablet, and a storage medium. Background Art

[0002] To meet people's daily needs, the functionality of various electronic products is becoming increasingly diverse. For example, touchscreen televisions not only offer movie and TV viewing capabilities but also respond to user actions such as tapping and touching the display. Currently, most electronic products utilize ARM-based processors to perform various tasks.

[0003] ARM architecture processors are characterized by low power consumption and low cost. They are commonly used with the Android system, but they rely heavily on secondary development and face difficulties in developing high-end applications. Installing both Android and Windows systems on interactive tablets requires additional hardware, which is costly.

[0004] Summary of the Invention

[0005] The embodiments of the present application provide a touch feedback method, an interactive tablet, and a storage medium, which solve the problem of touch data feedback for an interactive tablet and reduce the cost of the interactive tablet.

[0006] In a first aspect, an embodiment of the present application provides a touch feedback method, which is applied to an interactive tablet. The interactive tablet includes a touch screen, a central processing unit, a micro control unit, and an output interface. The central processing unit includes a first USB interface and a first SPI interface. The central processing unit is connected to the touch screen via the first USB interface. The central processing unit is connected to the micro control unit via the first SPI interface. The micro control unit includes a second USB interface. The micro control unit is connected to the output interface via the second USB interface. The touch feedback method includes:

[0007] receiving, through the first USB interface, first touch data in a USB format sent by the touch screen;

[0008] When the display channel is a local channel, performing a touch response on the first touch data through the central processing unit;

[0009] When the display channel is an external channel, continue to perform the following steps:

[0010] confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processing unit;

[0011] confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal by the central processing unit, and outputting the signal from the first SPI interface;

[0012] After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to the connected external device, and the external device performs a touch response.

[0013] In a second aspect, the present application further proposes a touch feedback method, which is applied to an interactive tablet, the interactive tablet including a touch screen, a central processing unit, a micro control unit, and an output interface, the central processing unit including a first USB interface and a first SPI interface, the central processing unit being connected to the touch screen via the first USB interface, the central processing unit being connected to the micro control unit via the first SPI interface, the micro control unit including a second USB interface, the micro control unit being connected to the output interface via the second USB interface, the touch feedback method comprising:

[0014] receiving, through the first USB interface, first touch data in a USB format sent by the touch screen;

[0015] When the service program is called to determine that the current display channel is the local channel, the first touch data is received through the driver, and the first touch data is distributed to the corresponding application for touch response according to the system distribution mechanism;

[0016] When the service program is called to determine that the current channel is an external channel, the first touch data is received through the service program;

[0017] If it is determined by the service program that the first touch data meets a preset condition, the first touch data is distributed to a corresponding application for touch response according to a system distribution mechanism;

[0018] If it is determined by the service program that the first touch data does not meet a preset condition, the first touch data is converted into an SPI signal and output from the first SPI interface;

[0019] After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to the connected external device, and the external device performs a touch response.

[0020] In a third aspect, the present application further provides an interactive tablet, comprising a touch screen, a central processing unit, a microcontroller unit, and a first external interface, wherein the first external interface comprises a touch output interface, the central processing unit comprises a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen via the first USB interface, the central processing unit is connected to the microcontroller unit via the first SPI interface, the microcontroller unit comprises a second USB interface, the microcontroller unit is connected to the touch output interface via the second USB interface, and the central processing unit is configured as follows:

[0021] receiving, through the first USB interface, first touch data in a USB format sent by the touch screen;

[0022] confirming a display channel of the interactive tablet, and performing a touch response to the first touch data when the display channel is a local channel;

[0023] When the display channel is an external channel, continue to perform the following steps;

[0024] confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data;

[0025] It is confirmed that the first touch data does not meet the preset conditions, and after converting the first touch data into an SPI signal, the first touch data is output from the first SPI interface; after the microcontroller converts the SPI signal into second touch data in a USB format, the second touch data is output from the touch output interface to the connected external device, and the external device performs a touch response.

[0026] In a fourth aspect, the present application further proposes a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of any of the methods described above are implemented.

[0027] In an embodiment of the present application, upon receiving first touch data from the touch screen and determining that the interactive tablet's display channel is a local channel, or upon determining that the display channel is an external channel and the first touch data meets preset conditions, the first touch data is sent to the central processing unit, which then performs a touch response. Alternatively, upon determining that the display channel is an external channel and the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device via an output interface, which then performs a touch response. This achieves an interactive tablet using a central processing unit as a core component, meeting the user's needs for installing complex and diverse Windows applications. Furthermore, when playing content displayed on an external device, touch data triggered by the displayed content can be sent to the external device, which then performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation and development costs, reducing the cost of interactive tablets based on a central processing unit platform. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0029] FIG1 is a schematic structural diagram of an interactive tablet provided in an embodiment of the present application;

[0030] FIG2 is a schematic diagram of a flow chart of a touch feedback method according to an embodiment of the present application;

[0031] FIG3 is a schematic diagram of a touch feedback method scenario proposed in an embodiment of the present application;

[0032] FIG4 is a schematic structural diagram of an interactive tablet provided in an embodiment of the present application;

[0033] FIG5 is a schematic diagram of a touch feedback method flow according to an embodiment of the present application;

[0034] FIG6 is a schematic diagram of a touch feedback method scenario provided by an embodiment of the present application;

[0035] FIG7 is a schematic diagram of a touch feedback method provided in an embodiment of the present application;

[0036] FIG8 is a schematic diagram of a touch feedback method scenario provided by an embodiment of the present application;

[0037] FIG9 is a schematic diagram of a touch feedback method according to an embodiment of the present application;

[0038] FIG10 is a schematic structural diagram of an interactive tablet provided in an embodiment of the present application;

[0039] FIG11 is a flow chart of a method for playing video and audio data according to an embodiment of the present application;

[0040] FIG12 is a schematic structural diagram of an interactive tablet provided in an embodiment of the present application;

[0041] FIG13 is a schematic structural diagram of an interactive tablet provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0043] In the description of this application, it should be understood that the terms "first", "second", etc. are used for descriptive purposes only and should not be understood to indicate or imply relative importance. In the description of this application, it should be noted that, unless otherwise expressly specified and limited, "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to the specific circumstances. In addition, in the description of this application, unless otherwise specified, "multiple" refers to two or more. "and / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0044] An interactive tablet is an integrated device that integrates display technology, touch technology, and audio and video display technology to achieve human-computer interaction. It has a large display screen and can achieve human-computer interaction through touch, providing a convenient human-computer interaction experience. It has been widely used in multi-person interaction scenarios such as teaching scenarios and conference scenarios.

[0045] In the related art, interactive tablets generally use ARM architecture-based processors as the main chip of the interactive tablet to complete various tasks. ARM architecture processors have the characteristics of low power consumption and low cost, and are usually used with the Android system. The Android system adopts an open source model, allowing developers to freely access, modify and customize the operating system. This has promoted technological innovation and development, making the Android system highly flexible and customizable, and can be personalized according to the needs of manufacturers and users. Therefore, it has been widely used in the field of interactive tablets. However, for the Android system, it is overly dependent on secondary development. In the process of developing the Android system for interactive tablets, it is necessary to invest a lot of manpower and material resources for secondary development, which requires a lot of development resources. In addition, for some more complex applications or functions, there are development difficulties and the solution has low compatibility. One solution is to connect an OPS (Open Pluggable Specification) module to the interactive tablet. The OPS module is installed with the Windows system, so that some more complex applications can be installed in the Windows system to meet the diverse usage needs of users. However, this solution not only requires the addition of additional OPS modules, which is costly, but also requires a lot of development work to achieve interactive communication between the Android system and the OPS module. It even requires the addition of MCU, routers and other chips to achieve communication between the two. Therefore, this solution requires the addition of more hardware and is costly.

[0046] In order to reduce costs, it is possible to consider directly using a central processing unit as the main chip of the interactive tablet, equipped with a Windows system to realize the display, touch response and other functions of the interactive tablet, so as to meet the needs of users to install complex and diverse Windows applications. For interactive tablets, they have been widely used in multi-person interaction scenarios such as teaching scenarios and conference scenarios. During the application process, they may face diverse display needs. In order to meet the multi-functional needs in these scenarios, the interactive tablet is also equipped with a signal source interface, allowing the connection of multiple signal sources, such as connecting to an external computer device, displaying the touch screen of the external computer device on the interactive tablet, and the user can operate the display screen of the external computer device on the touch screen. In this case, the interactive tablet needs to send touch data to the external computer to realize touch operation of the content displayed on the external computer. However, for the central processing unit equipped with a Windows system, it can only act as a host device during operation, so it is impossible to send touch data directly to the external computer device.

[0047] Therefore, how to realize touch feedback to external computer devices connected to the signal source while reducing the cost of interactive tablets is an urgent problem to be solved.

[0048] In response to the above problems, with reference to FIG1 , an embodiment of the present application provides an interactive tablet. As shown in FIG1 , the interactive tablet 10 includes: a touch screen 100, a central processing unit (CPU) 200, a microcontroller unit (MCU) 300, and an output interface 400. The CPU includes a first USB interface 201 and a first SPI interface 202. The CPU is connected to the touch screen 100 via the first USB 201 interface, and the CPU is connected to the microcontroller unit 300 via the first SPI interface 202. The microcontroller unit 300 includes a second USB interface 203, and the microcontroller unit is connected to the output interface 400 via the second USB 203 interface.

[0049] The interactive tablet receives first touch data in USB format sent by the touch screen 100 via the first USB interface 201. If the current display channel is determined to be the local channel, the central processing unit 200 performs a touch response to the first touch data. If the current display channel is determined to be the external channel, the first touch data is confirmed. If the first touch data meets a preset condition, the central processing unit 200 performs a touch response to the first touch data. If the first touch data does not meet the preset condition, the central processing unit 200 converts the first touch data into an SPI signal, which is then output from the first SPI interface 202 of the central processing unit to the microcontroller 300. The microcontroller 300 receives the SPI signal and converts it into second touch data in USB format. The SPI signal is then output from the second USB interface 203 to the output interface 400, which then transmits the converted second touch data in USB format to the external device 20 via the output interface 400. After receiving the second touch data, the external device 20 responds to the second touch data.

[0050] In an embodiment of the present application, upon receiving first touch data from the touch screen and determining that the interactive tablet's display channel is a local channel, or upon determining that the display channel is an external channel and the first touch data meets a preset condition, the first touch data is sent to the central processing unit, which then performs a touch response. If the display channel is an external channel and the first touch data does not meet the preset condition, the first touch data is converted and transmitted to the external device via an output interface, which then performs a touch response. This embodiment of the present application implements an interactive tablet using a central processing unit as a core component, meeting the user's needs for installing complex and diverse Windows applications. Furthermore, when playing content displayed on an external device, touch data triggered by the displayed content can be sent to the external device, which then performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation and development cost, reducing the cost of interactive tablets based on a central processing unit platform.

[0051] Based on the structural diagram shown in FIG1 , the touch feedback method provided by the embodiment of this specification will be described in detail below in combination with FIG2 to FIG10 .

[0052] Referring to Figure 2, which is a flow chart of the touch feedback method of the present application, the touch feedback method may include the following steps S101 to S106:

[0053] S101, receiving first touch data in a USB format sent by the touch screen through the first USB interface;

[0054] In the present application, the connection between the touch screen and the central processing unit is via a USB cable, whereby the interactive tablet receives the first touch data in USB format sent by the touch screen via the first USB interface.

[0055] The first touch data is data triggered by the user in the display interface of the touch screen, which may include data triggered by the user directly clicking the touch screen, dragging the touch screen with a finger, or clicking the touch screen with a wireless mouse.

[0056] It can be understood that in the embodiment of the present application, the interactive tablet can connect to external devices through audio and video interfaces such as the HDMI port and typeC port connected to the central processing unit, and display the display content of the current display interface of the external device on the touch screen of the interactive tablet.

[0057] Based on this, the user can click, drag and perform other operations on the touch screen displaying the current display interface of the external device, so that the display content of the current display interface of the external device can be operated directly through the touch screen of the interactive tablet.

[0058] It is understood that when the interactive device receives a user-triggered operation to generate first touch data via the touch screen, it can determine the user's click location by sensing changes in charge, changes in infrared light obstruction, etc., depending on whether the touch screen is a capacitive touch screen or an infrared touch screen, and thus generate the first touch data. The specific process is not described in detail in this embodiment.

[0059] S102, when the display channel is a local channel, performing a touch response on the first touch data by the central processing unit;

[0060] Optionally, in the embodiment of the present application, the central processing unit may be a processor of X86 architecture.

[0061] The interactive tablet can include local channels and external channels.

[0062] The local channel can be the channel when the display content currently displayed on the touch screen of the interactive tablet is the content played by the operating system of the interactive tablet. For example, in the embodiment of the present application, the interactive tablet is based on an X86 architecture processor and the Windows operating system is installed. The local channel can refer to the channel when the Windows operating system of the interactive tablet performs work display; the external channel can be the channel when the interactive tablet is connected to an external device and the display content currently displayed by the external device is played on the touch screen.

[0063] For example, when the display content currently displayed on the touch screen of the interactive tablet is the running interface of an application installed in the interactive tablet, the display channel of the interactive tablet is determined to be a local channel; when the interactive tablet is connected to an external device and the display content played on the touch screen of the interactive tablet is the display content currently played by the external device, the display channel of the interactive tablet is determined to be an external channel.

[0064] When the display channel of the interactive tablet is a local channel, it is determined that the first touch data triggered by the user based on the touch screen is a control of the interactive tablet, and the first touch data is sent to the central processor, and the central processor responds to the first touch data.

[0065] For example, the display content currently displayed on the touch screen is the interface of an application running on the central processing unit (for example, a whiteboard writing application interface). When the first touch data obtained by the user based on the click operation triggered by the touch screen is received, the central processing unit performs a touch response to the first touch data (for example, when the central processing unit determines that the first touch data is a sliding track on the whiteboard writing application interface, a touch response is performed to the first touch data. The response result is to generate a writing track based on the first touch data and display the generated writing track in the whiteboard writing application interface of the touch screen. Specifically, it can also be displayed according to the set writing track color and thickness).

[0066] S103: When the display channel is an external channel, continue to perform the following steps:

[0067] When the current display channel is an external channel, the response may be made by an external device connected to the external channel or by a central processing unit. Therefore, it is necessary to further determine the execution subject of the touch response to the first touch data.

[0068] S104, confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor;

[0069] The preset condition may be a preset condition requiring the central processing unit to perform a touch response to the first touch data when the current display channel is the external channel.

[0070] The preset condition can include at least one, for example, it can be a preset interactive action, a preset area, where the preset interactive action can be tapping the touch screen with two fingers at the same time, operation with five fingers together, multi-finger long press operation, sliding two fingers on the touch screen at the same time, or a preset gesture trajectory, etc.

[0071] In this embodiment, upon receiving the first touch data, it is determined that the first touch data is a user's multi-finger long press on the touch screen, then the first touch data is determined to meet the preset conditions, and the central processing unit responds to the first touch data, for example, it can be to open a quick operation menu, open a global menu, open an annotation application, open a screen recording application, or open a settings menu, etc. Alternatively, upon receiving the first touch data, it is determined that the first touch data falls within the range of a preset area, as shown in Figure 3, for example, if it falls within the preset area on the left side of the touch screen, then the central processing unit responds to the first touch data, thereby opening the screen projection code, the homepage annotation application, or performing a return operation, etc. In Figure 3, if it is detected that the first touch data falls within the homepage of the preset area, then the homepage is opened and the icons of the applications contained in the homepage are displayed (for example, icon 1, icon 2, icon 3 are displayed).

[0072] It can be understood that in this embodiment, when the central processing unit performs a touch response to the first touch data, the response mode of the central processing unit can be preset. For example, the first touch data can be preset as two fingers tapping the touch screen at the same time. When the central processing unit receives the first touch data, the touch response for the first touch data is: pause the playback of the currently displayed content. In the process of using the interactive tablet, when the first touch data is received, the central processing unit responds to the first touch data according to the preset touch response. For example, the user is currently using the interactive tablet to play music, and the current display content of the touch screen of the interactive tablet is the PPT currently playing on the external device. It is determined that the current display channel is an external channel. When the user taps the touch screen with two fingers at the same time, it is determined that the first touch data meets the preset conditions and the touch data is sent to the central processing unit. After receiving the first touch data, the central processing unit pauses the currently playing music according to the preset touch response.

[0073] In some embodiments, when it is determined that the first touch data matches the preset interaction action, a global application corresponding to the preset interaction action may be displayed.

[0074] Global applications include: sidebar applications, global menu applications, and annotation applications.

[0075] In this embodiment, opening a sidebar application to display a sidebar interface may include one or more of a split-screen application, a volume application, a camera application, a timer application, an annotation application, and a channel switching application.

[0076] The global menu application displays a global menu application interface that may include: one or more of a notification application, a do not disturb application, and a WiFi application.

[0077] Optionally, the global menu application interface may display the programs that the user has opened most times within a preset time period (eg, one week), the applications that the user is currently using or has used in the past, and the like.

[0078] In this embodiment, the corresponding global application can be opened according to the preset interaction action by associating the preset interaction action with the global application. Thus, when it is determined that the received first touch data satisfies the preset interaction action, a global application associated with it is determined as the corresponding global application, and the global application is started according to the first touch data.

[0079] For example, a preset interactive action, multi-finger long press on the touch screen, is associated with launching a global application, the global menu application, on the interactive screen. In the external channel, if the first touch data received is the preset interactive action, multi-finger long press on the touch screen, the global menu application is launched and its homepage is displayed on the touch screen display interface.

[0080] In this embodiment, the interactive tablet displays the global application corresponding to the preset action when determining that the first touch data matches the preset interactive action, thereby realizing rapid display of the global application corresponding to the preset action.

[0081] S105, confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal by the central processing unit, and outputting the signal from the first SPI interface;

[0082] The central processing unit is connected to the micro control unit via an SPI interface. If it is determined that the first touch data does not meet the preset conditions, the central processing unit converts the received first touch data in USB format into an SPI signal and sends it to the micro control unit via the SPI interface.

[0083] S106 , after converting the SPI signal into second touch data in USB format through the microcontroller, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

[0084] In the embodiment of the present application, the external device may be a desktop computer or a laptop computer.

[0085] In this embodiment, the central processing unit converts the first touch data into an SPI signal according to a proprietary protocol and outputs the SPI signal to the microcontroller via a first SPI interface. The microcontroller converts the SPI signal into second touch data in a USB format according to a pre-known proprietary protocol and the format of the touch data.

[0086] The micro control unit receives the SPI signal sent by the central processing unit, converts the SPI signal into second touch data in USB format, and outputs the second touch data to an external device through an output interface.

[0087] It is understandable that an interactive tablet equipped with an x86-based central processing unit acts as a host, and the external device is also an independently running host. However, in a traditional communication architecture, communication between the two hosts is impossible. Therefore, it is necessary to use a microcontroller unit as an intermediate medium, that is, the central processing unit acts as the master device and the microcontroller unit acts as the slave device, to transmit the first touch data of the interactive tablet equipped with the central processing unit to the external device, and the external device performs a touch response. In addition, in the embodiment of the present application, by converting the first touch data into an SPI signal, outputting the SPI signal to the MCU through the first SPI interface, and then converting the SPI signal into the second touch data in a USB format by the MCU, an MCU with only one USB interface can be selected, which greatly reduces the cost of the MCU.

[0088] In this embodiment, when the content displayed on the touch screen is the display content of an external device, and when it is determined that the first touch data triggered by the user does not meet the preset conditions, the interactive tablet determines that the first touch data currently triggered by the user based on the touch screen is data for controlling the currently played display content, and then sends the first touch data to the external device through the output interface, and the external device responds to the touch.

[0089] For example, the touch screen is currently playing audio and video data from an external device. After receiving the user's single-finger tapping the touch screen twice in a row, the first touch data is obtained. The interactive tablet obtains the first touch data of the touch screen, determines that the current display channel is an external channel, and further determines whether the first touch data meets the preset conditions. It can do so by searching for the preset conditions. If there is no single-finger tapping the touch screen twice in a row in the preset conditions, it is determined that the first touch data does not meet the preset conditions. The second touch data obtained after converting the first touch data is sent to the external device, and the external device performs a touch response. For example, after the external device receives the second touch data, it obtains the position where the user clicked based on the second touch data, and determines that the user needs to fast forward the audio and video data by 2 seconds. The external device fast forwards the audio and video data by 2 seconds to complete the touch response.

[0090] In some embodiments, referring to FIG. 4 , FIG. 4 is a schematic structural diagram of an interactive tablet of the present application.

[0091] The interactive tablet also includes a USB switching switch 500, and the output interface 400 also includes a data output interface 401. The first switching interface 501 of the USB switching switch 500 is connected to the central processor 200, and the second switching interface 502 of the USB switching switch 500 is connected to the data output interface 401. The USB switching switch 500 is also connected to the external storage device 30. When the display channel is a local channel, the USB switching switch 500 is controlled to connect to the first switching interface 501 to send the storage data of the external storage device 30 to the central processor 200. When the display channel is an external channel, the USB switching switch 500 is controlled to connect to the second switching interface 502 to send the storage data of the external storage device 30 to the external device 20 through the data output interface 401.

[0092] Optionally, a USB expansion interface may be used in the external interface of the USB switch 500 , thereby enabling the storage data of multiple external storage devices to be read through the USB switch.

[0093] For example, when the touch screen is playing content displayed on an external device, the USB switch sends the stored data of the external storage device to the external device 20 via the second switching interface. Since the interactive tablet is currently in the external channel, it can read the data of the external device. Therefore, the interactive tablet can read the stored data of the external storage device through the external device and display it on the touch screen. When the touch screen is running an internal application, the USB switch sends the stored data of the external storage device to the central processor via the first switching interface, and displays it on the touch screen.

[0094] In this embodiment, the switch is switched to enable the storage data of the external storage device to be sent to the external device or the central processing unit respectively when the interactive flat panel is in different display channels.

[0095] In some embodiments, referring to FIG. 4 , the interactive tablet further includes an infrared receiver module. The infrared receiver is connected to the microcontroller unit, receives infrared signals, and transmits the infrared signals to the microcontroller unit. The microcontroller unit determines the infrared code of the infrared signal, and then the microcontroller unit converts the infrared code into a character code recognizable by the central processing unit and transmits the character code to the central processing unit.

[0096] In this embodiment, the infrared signal can be sent by an infrared remote controller. After receiving the infrared signal, the micro control unit determines the infrared code of the infrared signal in the infrared remote controller according to the NEC protocol.

[0097] In this application, the microprocessor can store infrared codes and character codes in correspondence. For example, for the remote control key value "0", the infrared code stored in the microprocessor is "0x1B", and the character code stored corresponding to the infrared code is "0x30". After the microprocessor receives the infrared signal indicating that the user has pressed the key value "0" on the remote control, the microprocessor parses the infrared signal according to the NEC protocol to determine the key value "0" in the remote control. Then, based on the corresponding stored infrared code and character code, the microprocessor determines the character code for the key value "0" and sends the character code to the central processing unit in response to the key value.

[0098] In this embodiment, the received infrared signal is parsed by the microprocessor and a character code that can be recognized by the central processing unit is obtained, so that the central processing unit can respond to the character code, thereby realizing the control of the interactive tablet through infrared signals and solving the problem that the X86 architecture cannot receive remote control signals.

[0099] In some embodiments, please continue to refer to Figure 4. The interactive tablet also includes an external communication module, which is connected to the micro control unit. The external communication module receives control instructions sent by an external device and transmits the control instructions to the micro control unit. The micro control unit determines the response action corresponding to the control instruction and sends the response action to the central processing unit through the micro control unit.

[0100] The external device can be a mobile terminal such as a mobile phone. The mobile phone can establish a connection with the interactive tablet through the external communication module. Therefore, when the external communication module receives a control instruction sent by the mobile phone, it determines the response action corresponding to the control instruction and sends it to the central processing unit for execution.

[0101] In this embodiment, the external communication module is used to realize the use of an external device such as a mobile phone to control the central processing unit to execute a response action.

[0102] In an embodiment of the present application, upon receiving first touch data from the touch screen and determining that the interactive tablet's display channel is a local channel, or upon determining that the display channel is an external channel and the first touch data meets a preset condition, the first touch data is sent to the central processing unit, which then performs a touch response. If the display channel is an external channel and the first touch data does not meet the preset condition, the first touch data is converted and transmitted to the external device via an output interface, which then performs a touch response. This embodiment of the present application implements an interactive tablet using a central processing unit as a core component, meeting the user's needs for installing complex and diverse Windows applications. Furthermore, when playing content displayed on an external device, touch data triggered by the displayed content can be sent to the external device, which then performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation and development cost, reducing the cost of interactive tablets based on a central processing unit platform.

[0103] Referring to Figure 5, Figure 5 is a flow chart of the present application. Step S104 includes:

[0104] S1041: Confirm that the first touch data is within a preset area, perform a touch response according to the first touch data by the central processor, open a sidebar application, and display a sidebar interface.

[0105] In this embodiment, the preset condition includes being located in a preset area, as shown in FIG6 . Optionally, upon receiving a touch operation in the preset area, the interactive tablet opens the sidebar application and displays the sidebar interface. Referring to FIG7 , the preset area can be set at the top, bottom, left, or right end of the touch screen. When the sidebar application is opened, the sidebar interface is displayed in the display interface, and the sidebar interface can be displayed on the right side of the touch screen. In other embodiments, the sidebar interface can also be displayed in other areas of the touch screen.

[0106] It is understood that in this embodiment, the user can click the touch screen using a touch pen. When a click operation is detected on the touch screen, the touch screen generates first touch data. It is determined that the current display channel is an external channel and the first touch data is within a preset area. It is determined that the first touch data meets the preset conditions. The central processing unit performs a touch response based on the first touch data, opens the sidebar application, and displays the sidebar interface. The opening of the sidebar application and the display of the sidebar interface are shown in Figure 7.

[0107] In an embodiment of the present application, while playing the display content of the external device, the interactive tablet responds to the user's first touch data in a preset area to open the sidebar interface to provide convenient operation for the user.

[0108] In some embodiments, an annotation icon is also displayed in the sidebar interface. When the touch screen receives a click operation on the annotation icon, the annotation application is opened, and a screenshot of the display interface of the external channel is taken. The interface of the annotation application is superimposed on the screenshot. The interface of the annotation application is a transparent or semi-transparent interface. When a touch operation is performed on the interface of the annotation application, annotation handwriting can be generated, thereby achieving the purpose of annotating the display content of the interface below the interface of the annotation application. At this time, the interactive tablet sends the first touch data received based on the interface of the annotation application displayed on the touch screen to the annotation application, and the annotation application responds to the touch. That is to say, when the annotation application is opened in the external channel, the annotation application responds to the touch data directly, and no longer sends it to the MCU through the SPI interface, and thus no longer transmits it back to the external device.

[0109] For example, referring to Figure 8, if the touch screen receives a click operation on the annotation icon, the annotation application is opened and the sidebar display interface is closed. At the same time, a screenshot is taken of the display interface of the external channel currently played by the touch screen. The interface of the annotation application is superimposed on the screenshot, and here, the interface of the annotation application is a transparent interface. The touch screen receives the user's touch action based on the display interface of the annotation application, and generates the first touch data and sends it to the annotation application, which responds to the touch. For example, a circle is drawn at the corresponding position on the screenshot according to the received first touch data, and annotated on it. The effect after superimposed display is shown in Figure 9. It can be understood that when display content such as video data is displayed in the display interface currently played by the touch screen, after clicking the annotation, the sidebar interface can also be displayed in a transparent manner in this embodiment, thereby enabling the user to annotate the displayed content individually.

[0110] In this embodiment, by displaying an annotation icon in the sidebar interface and opening an annotation application when a click operation is detected on the annotation icon, the annotation application then responds to the first touch data received by the interface based on the annotation application. This enables the interactive tablet to respond to the first touch data received by the display interface based on the annotation application when an external display channel is connected.

[0111] The interactive tablet also includes a first signal conversion circuit, which includes a format conversion circuit and a signal output interface connected in sequence. The first signal conversion circuit is used to obtain input audio and video data from the external device, and convert the audio and video data into an audio and video signal in a preset format, and then output it from the signal output interface to the central processing unit for playback.

[0112] In this embodiment, the audio and video data received from the external device is converted into an audio and video signal in a preset format and output to the central processing unit for playback, thereby enabling the interactive tablet based on the central processing unit platform to play the audio and video data of the external device.

[0113] Referring to Figure 10, which is a schematic diagram of the structure of the first signal conversion circuit of the present application, the first signal conversion circuit 600 includes: a format conversion circuit 601, a signal output interface 602, a switch 603, and a signal input interface 604, wherein the signal input interface 604 includes: a first signal input interface 6041 and a second signal input interface 6042.

[0114] The first signal input interface and the second signal input interface are both connected to a switching switch, through which audio and video data from an external device is transmitted to the switching switch. The switching switch determines which signal input interface receives the audio and video data. Furthermore, the switching switch is connected to a format conversion circuit. After receiving the audio and video data, the switching switch transmits the audio and video data to the format conversion circuit, which then performs format conversion on the audio and video data. The format conversion circuit is also connected to the central processing unit. After the format conversion circuit completes the format conversion of the audio and video data, it sends the audio and video data to the central processing unit.

[0115] In this embodiment, by switching the switch, it is achieved that when there are multiple audio and video data, the audio and video data that the interactive tablet needs to play is selected.

[0116] In some embodiments, the signal output interface includes a first video signal output interface and a first audio signal output interface, the preset format signal includes a MIPI format video signal and a digital format audio signal, the MIPI format video signal is output from the first video signal output interface, and the digital format audio signal is output from the first audio signal output interface.

[0117] 10 , in this embodiment, the signal output interface includes a first video signal output interface 6021 and a first audio signal output interface 6022. After the format conversion circuit performs format conversion on the input audio and video data, the audio and video data is converted into two output signals, one of which is a video signal in MIPI format and the other is an audio signal in digital format. The video signal is output to the central processing unit (CPU) through the first video signal output interface 6021, and the audio signal is output to the central processing unit (CPU) through the first audio signal output interface 6022.

[0118] In this example, the converted audio and video data are transmitted to the central processing unit from different signal output interfaces, thereby playing the audio and video data of the external device on the interactive tablet based on the central processing unit platform.

[0119] The execution subject of this embodiment is a touch feedback system installed in the interactive tablet.

[0120] In this embodiment, when the interactive tablet is started, the service program in the touch return system is also started. The touch return system receives first touch data in USB format sent by the touch screen via a first USB interface. When the service program determines that the display channel is a local channel, it receives the first touch data via a driver, which can be a HID driver for the Windows operating system. The first touch data is then distributed to the corresponding application for touch response via the Windows system's system distribution mechanism. When the service program determines that the display channel is an external channel, it obtains the first touch data and determines whether the first touch data meets preset conditions. If so, it sends the first touch data to the corresponding application for touch response. If not, it converts the first touch data into an SPI signal and sends the SPI signal to the microprocessor via the SPI driver. After receiving the SPI signal, the microprocessor encapsulates the SPI signal in HID format to obtain second touch data in USB format. The MCU then outputs the SPI signal in HID format to the external device via an output interface, which then responds.

[0121] Among them, the service program registers the windows event callback function through RegisterClassEx, filters the WM_INPUT type events from the windows operating system through the callback function, and then obtains the touch data of the RAWINPUTHEADER structure through the GetRawInputData function to determine whether the touch data is within the preset area.

[0122] In some embodiments, when the service program determines that the first touch data conforms to the preset interaction action, the global application corresponding to the preset interaction action may be displayed.

[0123] Global applications include: sidebar applications, global menu applications, and annotation applications.

[0124] In this embodiment, the sidebar interface displayed when the sidebar application is opened may include one or more of a weather application, a volume application, a positioning application, a Bluetooth application, and an annotation application.

[0125] The global menu application interface displayed by the global menu application may include: one or more of: a notification application, a do not disturb application, a rotation application, and a WiFi application.

[0126] Optionally, the programs opened most frequently by the user within a preset time period (eg, one week) may be displayed in the global menu application.

[0127] In this embodiment, the corresponding global application can be opened according to the preset interactive action, and the preset interactive action can be associated with the global application. Thus, when the service program determines that the received first touch data meets the preset interactive action, the service program distributes the first touch data to the driver, and the driver distributes the first touch data to the corresponding application for touch response according to the system distribution mechanism.

[0128] For example, in the interactive platform, a preset interactive action—a multi-finger long press on the touch screen—is associated with launching a global application—a global menu application. In the case of an external channel, upon receiving first touch data that represents the preset interactive action—a multi-finger long press on the touch screen, the service program determines that the first touch data meets preset conditions and distributes the first touch data to the driver. The driver then distributes the first touch data to the corresponding application for touch response according to the system distribution mechanism. For example, the global menu application responds to the first touch data by displaying the homepage of the global menu application on the touch screen display interface, as shown in Figure 3.

[0129] In this embodiment, the service program displays the global application corresponding to the preset action when determining that the first touch data matches the preset interactive action, thereby realizing rapid display of the global application corresponding to the preset action.

[0130] In this embodiment, the preset condition includes being located in a preset area, as shown in FIG6 . Optionally, upon receiving a touch operation in the preset area, the interactive tablet opens the sidebar application and displays the sidebar interface. Referring to FIG7 , the preset area can be set at the top, bottom, left, or right end of the touch screen. When the sidebar application is opened, the sidebar interface is displayed in the display interface, and the sidebar interface can be displayed on the right side of the touch screen. In other embodiments, the sidebar interface can also be displayed in other areas of the touch screen.

[0131] It is understandable that in this embodiment, the user can click the touch screen using a touch pen. When a click operation is detected on the touch screen, the touch screen generates first touch data. It is determined that the current display channel is an external channel and the first touch data is within a preset area. It is determined that the first touch data meets the preset conditions, and the first touch data is distributed to the driver. The driver distributes the first touch data to the corresponding application according to the system distribution mechanism for touch response, for example, to the sidebar application. The sidebar application responds to the first touch data and displays the sidebar interface, as shown in Figure 7.

[0132] In an embodiment of the present application, while playing the display content of the external device, the interactive tablet responds to the user's first touch data in a preset area to open the sidebar interface to provide convenient operation for the user.

[0133] In some embodiments, an annotation icon is also displayed in the sidebar interface. When the service program receives a click operation on the annotation icon, the service program sends the first touch data to the driver. The driver then sends the first touch data to the annotation application according to the system distribution mechanism, takes a screenshot of the display interface of the external channel, and overlays the interface of the annotation application on the screenshot. Afterwards, the annotation application intercepts the touch data of the RAWINPUTHEADER structure. Before the annotation application is closed, the service program will not be able to obtain the touch data. Therefore, when the annotation application interface receives the first touch data, the annotation application will perform a touch response to the first touch data.

[0134] For example, referring to Figure 8, if the touch screen receives a click operation on the annotation icon, the annotation application is opened and the sidebar display interface is closed. At the same time, a screenshot is taken of the display interface of the external channel currently played by the touch screen. The interface of the annotation application is superimposed on the screenshot. Here, the interface of the annotation application is a transparent interface. The touch screen receives the user's touch action based on the display interface of the annotation application, and generates the first touch data and sends it to the annotation application, which responds to the touch. For example, a circle is drawn at the corresponding position on the screenshot according to the received first touch data, and annotated. Please refer to Figure 9 for the effect after superimposed display.

[0135] In this embodiment, by displaying an annotation icon in the sidebar interface and opening an annotation application when a click operation is detected on the annotation icon, the annotation application then responds to the first touch data received by the interface based on the annotation application. This enables the interactive tablet to respond to the first touch data received by the display interface based on the annotation application when an external display channel is connected.

[0136] In an embodiment of the present application, upon receiving first touch data from the touch screen and determining that the interactive tablet's display channel is a local channel, the first touch data is distributed to the corresponding application via the Windows system's system distribution mechanism for touch response. When the display channel is an external channel, the first touch data is received via a private service, and upon determining that the first touch data meets a preset condition, the first touch data is sent to the corresponding application for touch response. If the first touch data does not meet the preset condition, the first touch data is converted and transmitted to the external device via an output interface, and the external device performs the touch response. This achieves an interactive tablet using a central processing unit as a core component, meeting the user's needs for installing complex and diverse Windows applications. Furthermore, when playing content displayed on an external device, touch data triggered by the displayed content can be sent to the external device, and the external device performs the touch response. This solution has high compatibility, low hardware cost, and low adaptation and development cost, reducing the cost of interactive tablets based on a central processing unit platform.

[0137] 10 , the interactive tablet includes: a touch screen 100, a central processing unit (CPU) 200, a microcontroller unit (MCU) 300, an output interface 400, a first signal conversion circuit 600, and the first signal conversion circuit 600. It includes a format conversion circuit 601 and a signal output interface 602, wherein the signal output interface 602 includes a first video signal output interface 6021 and a first audio signal output interface 6022, the first signal conversion circuit 600 is connected to the external device 20, the first signal conversion circuit 600 is connected to the central processing unit 200 through the first video signal output interface 6021 and the first audio signal output interface 6022, the central processing unit 200 is connected to the touch screen 100, the central processing unit 200 includes a first USB interface 201 and a first SPI interface 202, the central processing unit 200 is connected to the touch screen 100 through the first USB interface 201, the central processing unit is connected to the micro control unit 300 through the first SPI interface 202, the micro control unit 300 includes a second USB interface 203, and the micro control unit is connected to the output interface 400 through the second USB interface 203.

[0138] The first signal conversion circuit 600 of the interactive tablet receives audio and video data, and converts the audio and video data into MIPI format video signals and digital format audio signals through the format conversion circuit 601, and outputs the audio signal to the central processing unit through the first audio signal output interface 6022; and outputs the video signal to the central processing unit through the first video signal output interface 6021.

[0139] Alternatively, in this embodiment, if there is only one signal input interface, the format conversion circuit 601 is directly connected to the signal input interface. That is, in this embodiment of the application, the switch 603 can be configured according to actual use requirements.

[0140] The central processing unit receives audio and video data, and plays the received audio and video data on the touch screen of the interactive flat panel when the display channel is an external channel.

[0141] While playing audio and video data, the interactive tablet receives first touch data in USB format sent by the touch screen 100 via the first USB interface 201. Upon confirming that the first touch data meets preset conditions, the central processing unit 200 performs a touch response to the first touch data. If the first touch data does not meet the preset conditions, the central processing unit 200 converts the first touch data into an SPI signal, which is then output from the first SPI interface 202 of the central processing unit to the microcontroller 300. The microcontroller 300 receives the SPI signal and converts it into second touch data in USB format. The signal is then output from the second USB interface 203 to the output interface 400, which then transmits the converted second touch data in USB format to the external device 20 via the output interface 400. After receiving the second touch data, the external device 20 responds to the second touch data.

[0142] In an embodiment of the present application, the interactive tablet receives audio and video data from an external device, and plays the received audio and video data when the display channel is an external channel. Based on the playback interface, if the first touch data of the touch screen is received, and it is determined that the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device through the output interface, and the external device performs a touch response. The embodiment of the present application realizes an interactive tablet using a central processing unit as a core component, which can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of an external device, the touch data triggered by the display content can be sent to the external device, and the external device performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of interactive tablets based on the central processing unit platform.

[0143] Based on the structural diagram shown in FIG10 , the audio and video data playback method provided in the embodiment of this specification will be described in detail in combination with FIG11 to FIG13 .

[0144] Referring to Figure 11, Figure 11 is a flow chart of the audio and video data playback method of the present application. The audio and video data playback method may include the following steps S201-S208:

[0145] S201, receiving audio and video data in HDMI format from the external device through the first signal conversion circuit;

[0146] The first signal conversion circuit can be used to receive HDMI format audio and video data from an external device (such as a TV, computer, etc.). HDMI (High-Definition Multimedia Interface) is a digital signal transmission standard that can transmit high-definition video and multi-channel audio signals through a single connection cable.

[0147] It can be understood that in the embodiment of the present application, the first signal conversion circuit of the interactive tablet can connect to external devices through audio and video interfaces such as HDMI port and typeC port to obtain audio and video data of the external devices.

[0148] S202, using the format conversion circuit to convert the video data of the audio and video data into a video signal in MIPI format, and to convert the audio data of the audio and video data into an audio signal in digital format;

[0149] In this embodiment, after obtaining audio and video data from the external device, the first signal conversion circuit uses the format conversion circuit to convert the audio data into a digital audio signal and convert the video data into a MIPI format video signal.

[0150] S203, sending the audio signal to the central processing unit through the first audio signal output interface, and sending the video signal to the central processing unit through the first video signal output interface;

[0151] After completing the conversion of the audio and video signals, the format conversion circuit sends the audio signal to the central processing unit through the first audio signal output interface, and sends the video signal to the central processing unit through the first video signal output interface.

[0152] S204, when the display channel is an external channel, running a playback program by the central processor to create a video playback window to output the video signal, and using a speaker to output the audio signal;

[0153] The interactive tablet can include local channels and external channels.

[0154] The local channel can be the channel when the display content currently displayed on the touch screen of the interactive tablet is the content played by the operating system of the interactive tablet. For example, in the embodiment of the present application, the interactive tablet is based on an X86 architecture processor and the Windows operating system is installed. The local channel can refer to the channel when the Windows operating system of the interactive tablet performs work display; the external channel can be the channel when the interactive tablet is connected to an external device and the display content currently displayed by the external device is played on the touch screen.

[0155] For example, when the display content currently displayed on the touch screen of the interactive tablet is the running interface of an application installed in the interactive tablet, the display channel of the interactive tablet is determined to be a local channel; when the interactive tablet is connected to an external device and the display content played on the touch screen of the interactive tablet is the display content currently played by the external device, the display channel of the interactive tablet is determined to be an external channel.

[0156] When the display channel is an external channel, after receiving the audio signal and video signal, the central processor creates a video playback window by running the playback program to output the video signal, and uses the speaker to output the audio signal, thereby realizing the playback of audio and video data of external devices on the interactive tablet.

[0157] Optionally, after receiving the video signal, the central processing unit renders the video signal before playing the video signal, and creates a video playing window by running a playing program on the central processing unit to output the rendered video signal.

[0158] The process can be as follows: The CPU receives the video signal, then uses tools such as a graphics library or geometric calculation engine to render the video signal, creating a video playback window to output the rendered video signal. Rendering the video signal before playback ensures a high-quality viewing experience for users.

[0159] When the central processing unit plays the video signal, the preset operation is intercepted.

[0160] The preset operation may be a preset behavior or action, such as sharing or downloading. For example, the user may be restricted from downloading or sharing the video signal to protect the played video signal.

[0161] S205, receiving first touch data in a USB format sent by the touch screen through the first USB interface;

[0162] When playing audio and video data sent by an external device, the central processing unit receives first touch data in USB format sent by the touch screen based on the display content of the current playback interface through the first USB interface. It is understood that step S205 of this embodiment can refer to step S101 of the embodiment shown in Figure 2, and will not be repeated here.

[0163] S206, confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor;

[0164] It is understandable that step S206 of this embodiment can refer to step S104 of the embodiment shown in FIG. 2 , and will not be described in detail here.

[0165] S207, confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal by the central processing unit, and outputting the signal from the first SPI interface;

[0166] It is understandable that step S207 of this embodiment can refer to step S105 of the embodiment shown in FIG. 2 , and will not be described in detail here.

[0167] S208 , after converting the SPI signal into second touch data in USB format through the microcontroller, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

[0168] It is understandable that step S208 of this embodiment can refer to step S106 of the embodiment shown in FIG. 2 , and will not be described in detail here.

[0169] In an embodiment of the present application, the interactive tablet receives audio and video data from an external device, and plays the received audio and video data when the display channel is an external channel. Based on the playback interface, if the first touch data of the touch screen is received, and it is determined that the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device through the output interface, and the external device performs a touch response. The embodiment of the present application realizes an interactive tablet using a central processing unit as a core component, which can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of an external device, the touch data triggered by the display content can be sent to the external device, and the external device performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of interactive tablets based on the central processing unit platform.

[0170] In this embodiment, if the display channel is a local channel, the central processing unit responds to the first touch data. This process is as described in the above embodiment and will not be further described here. This achieves that when the display channel is a local channel, the central processing unit responds to the first touch data.

[0171] In this embodiment, the first signal conversion circuit further includes a switch and a signal input interface, wherein the structure and connection relationship between the signal input interface and the switch are as described in the above embodiment and will not be repeated here.

[0172] Optionally, there may be multiple signal input interfaces.

[0173] When it is determined that multiple signal input interfaces are respectively connected to different external devices, before the first signal conversion circuit sends the audio and video data to the first signal conversion circuit, the central processor needs to display the selection information of the signal input interface on the touch screen.

[0174] For example, a first external device is connected to a first signal input interface, and a second external device is connected to a second signal input interface. The central processing unit displays the available signal input interfaces and corresponding external devices on the touch screen. The user can select the desired signal input interface through the touch screen interface and use it as the input channel for the audio and video data currently to be received. When the user selects a specific signal input interface on the touch screen, the central processing unit will receive the corresponding confirmation information. The pre-programmed switching program is called to send a control signal to the switch, requesting the switch to switch to the signal input interface corresponding to the confirmation information.

[0175] The switch will connect the corresponding signal input interface according to the control signal, making it the currently active signal input channel.

[0176] In this embodiment, the central processing unit can control the switching switch to switch to the required signal input interface based on the selection information and the user's confirmation information, thereby realizing that when multiple signal input interfaces are connected to multiple different external devices, the audio and video data of a certain external device can be selectively accessed, which can facilitate users to switch between different playback sources.

[0177] In this embodiment, when there are multiple signal input interfaces in the first signal conversion circuit, the signal input interface connected to the external device is used as the first signal input selection interface, and the identification information of the first Switch register of the first signal input selection interface is displayed on the touch screen, where there are multiple first signal input selection interfaces, multiple first Switch registers, and multiple identification information displayed on the touch screen.

[0178] As can be understood, the Switch register is used to record the connection status of the signal input interface, that is, to indicate whether a specific signal input interface is connected to an external device. By reading the detection bit information of the Switch register, the connection status of each signal input selection interface can be determined. When the detection bit information changes, it can be determined that the signal input interface has switched, and corresponding operations can be performed based on the switching status.

[0179] After receiving the confirmation information obtained by the user based on the selection trigger of the touch screen, the Switch register of the identification information selected by the user from the multiple identification information is determined to be the second Switch register, and the first signal input selection interface corresponding to the second Switch register is determined to be the second signal input selection interface.

[0180] For example, there are three signal input interfaces, namely, a first signal input interface, a second signal input interface, and a third signal input interface. Wherein, the first signal input interface and the third signal input interface are both connected to an external device, then the first signal input interface and the third signal input interface are determined to be first signal input selection interfaces, and the identification information of the first Switch register corresponding to the first signal input selection interface is obtained respectively, wherein the identification information of the first Switch register of the first signal input interface is A01, and the identification information of the first Switch register of the third signal input interface is A02. The selection information of A01 and A02 is displayed on the display screen. After receiving the identification information that the user selects A02, the first Switch register corresponding to the A02 identification information is determined to be the second Switch register, and the first signal input selection interface corresponding to the register is determined to be the second signal input selection interface.

[0181] In this embodiment, by displaying the identification information of the switch register on the touch screen interface, the user can accurately select the desired signal input interface through the identification information displayed on the touch screen.

[0182] Optionally, in this embodiment, after the second signal input selection interface is determined, a driver of the central processing unit is called to obtain the HDMI information and EDID list stored in the second signal input selection interface.

[0183] HDMI (High-Definition Multimedia Interface) information refers to some parameters and function support information related to the HDMI interface, including resolution, refresh rate, color space, audio format and other information.

[0184] The EDID list provides detailed information about the display device, such as manufacturer name, product model, resolution support, screen size, color capabilities, audio support, etc. By reading the EDID list, the external device can understand the display capabilities of the interactive flat panel and adaptively adjust the resolution of the output audio and video data.

[0185] Write the HDMI information obtained from the driver into the rx register, which is a hardware register used to store the HDMI information of the interactive panel.

[0186] Write the edid list obtained from the driver into the edid register. Similarly, the edid register is a hardware register used to store the EDID list of the interactive panel.

[0187] Furthermore, the target external device corresponding to the second signal input selection interface reads the HDMI information and the edid list through the rx register and sends the corresponding audio and video data.

[0188] By calling the driver to obtain the HDMI information and EDID list of the second signal input selection interface and writing the relevant information to the corresponding register, the external device corresponding to the second signal input selection interface can read the HDMI information and EDID list of the interactive flat panel through the rx register and send the corresponding audio and video data. This is conducive to the transmission of correct audio and video data after switching the signal input interface.

[0189] Optionally, in this embodiment, when it is detected that the second signal input selection interface is disconnected from the target external device, the rx register, the second switch register, and the edid register are reset to avoid residual information causing abnormality in the next connection.

[0190] Optionally, in this embodiment, when it is detected that the signal input interface is disconnected from the external device, the video playback window is closed and the cached video and audio signals are cleared to avoid residual data causing anomalies during the next connection.

[0191] Referring to Figure 12 , the interactive tablet further includes a digital signal processor 700, a second audio signal output interface 800, a power amplifier component 900, and a speaker interface 1000. The central processing unit 200 is connected to the digital signal processor 700 via the second audio signal output interface 800, and the digital signal processor 700 is connected to the speaker interface 1000 via the power amplifier component 900.

[0192] The first audio signal in digital format in the central processing unit 200 is transmitted to the digital signal processor 700 via the second audio signal output interface 800. The first audio signal is converted into a second audio signal in I2S format by the digital signal processor 700. The second audio signal is transmitted to the external speaker in sequence through the power amplifier component 900 and the speaker interface 1000.

[0193] In this embodiment, the signal format of the first audio signal is converted by the digital signal processor, thereby playing the audio and video data of the external device on the interactive tablet based on the central processing unit platform.

[0194] 12 , the interactive tablet further includes a camera interface 1100 and a microphone interface 1200 , wherein the camera interface 1100 is connected to the central processing unit 200 , and the microphone interface 1200 is connected to the digital signal processor 700 .

[0195] The video signal in MIPI format obtained by the camera device is transmitted to the central processing unit 200 through the camera interface 1100 .

[0196] The third audio signal in PDM format obtained by the microphone device is transmitted to the digital signal processor 700 via the microphone interface 1200. The digital signal processor 700 converts the third audio signal in PDM format into a fourth audio signal in digital format, improves the audio quality, and transmits it to the central processing unit 200 via the second audio signal output interface 800.

[0197] Optionally, after receiving the audio signal, the central processing unit determines that the current audio signal needs to be played, and transmits the audio signal to the signal processor 700 through the second audio signal output interface 800, converts it into a second audio signal in I2S format, and transmits the second audio signal to the external speaker via the power amplifier component 900 and the speaker interface 1000.

[0198] In this embodiment, the video signal collected by the camera device and the third audio signal collected by the microphone device are sent to the central processor through the camera interface and the microphone interface of the interactive tablet.

[0199] 13 , the interactive tablet further includes a screen display component 1300, which is connected to the central processing unit 200. The central processing unit converts the video signal into a screen display signal, and sends the screen display signal to the touch screen through the screen display component.

[0200] In this embodiment, the video signal is transmitted to the touch screen via the screen display component, thereby achieving video playback on the touch screen.

[0201] 13 , in this embodiment, the display assembly 1300 further includes a power supply circuit 1301, a backlight interface 1302, and a display interface 1303. The power supply circuit 1301 is connected to the CPU 200 and the backlight interface 1302, respectively, and the display interface 1303 is connected to the CPU 200.

[0202] The MIPI-formatted video signal is processed by the CPU 200 into an eDP signal, which is a video signal transmitted via the Embedded DisplayPort (eDP) interface. The eDP signal is transmitted via the display interface 1303 to the touch screen display, where the video signal transmitted by the CPU 200 is played.

[0203] The backlight adjustment signal associated with the video signal processed by the CPU 200 is converted into a control signal by the power supply circuit 1301. The control signal is transmitted to the backlight device of the touch screen via the backlight interface 1302. The brightness of the backlight device is adjusted according to the received control signal.

[0204] Backlight adjustment signals include BLON and PWM signals. Backlight devices are typically composed of LEDs (Light Emitting Diodes) or other backlight sources. The brightness of the backlight device can be controlled by adjusting the current or using pulse width modulation (PWM) technology.

[0205] The BLON signal controls the backlight's on / off state. When the BLON signal is received, the backlight turns on and provides a bright background. The PWM signal (Pulse Width Modulation) controls the backlight's brightness level. The power supply circuit determines the backlight's brightness based on the PWM signal's duty cycle.

[0206] In this embodiment, the backlight adjustment signal associated with the video signal is converted into a control signal by the power supply circuit, so that the backlight device controls the brightness and operation of the backlight lamp according to the control signal.

[0207] An embodiment of the present application further provides an interactive tablet, the interactive tablet comprising a touch screen, a central processing unit, a microcontroller unit, and a first external interface, wherein the first external interface comprises a touch output interface, the central processing unit comprises a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen via the first USB interface, the central processing unit is connected to the microcontroller unit via the first SPI interface, the microcontroller unit comprises a second USB interface, the microcontroller unit is connected to the touch output interface via the second USB interface, and the central processing unit is configured as follows:

[0208] receiving, through the first USB interface, first touch data in a USB format sent by the touch screen;

[0209] confirming a display channel of the interactive tablet, and performing a touch response to the first touch data when the display channel is a local channel;

[0210] When the display channel is an external channel, continue to perform the following steps;

[0211] confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data;

[0212] It is confirmed that the first touch data does not meet the preset conditions, and after converting the first touch data into an SPI signal, the first touch data is output from the first SPI interface; after the microcontroller converts the SPI signal into second touch data in a USB format, the second touch data is output from the touch output interface to the connected external device, and the external device performs a touch response.

[0213] In an embodiment of the present application, upon receiving first touch data from the touch screen and determining that the interactive tablet's display channel is a local channel, or upon determining that the display channel is an external channel and the first touch data meets preset conditions, the first touch data is sent to the central processing unit, which then performs a touch response. Alternatively, upon determining that the display channel is an external channel and the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device via an output interface, which then performs a touch response. This achieves an interactive tablet using a central processing unit as a core component, meeting the user's needs for installing complex and diverse Windows applications. Furthermore, when playing content displayed on an external device, touch data triggered by the displayed content can be sent to the external device, which then performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation and development costs, reducing the cost of interactive tablets based on a central processing unit platform.

[0214] An embodiment of the present application provides an interactive tablet, the interactive tablet including a touch screen, a central processing unit, a first signal conversion circuit, a micro control unit, and an output interface, the first signal conversion circuit including a format conversion circuit, a first video signal output interface, and a first audio signal output interface, the first signal conversion circuit is connected to an external device, the first signal conversion circuit is connected to the central processing unit via the first video signal output interface and the first audio signal output interface, the central processing unit is connected to the touch screen, the central processing unit further includes a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen via the first USB interface, the central processing unit is connected to the micro control unit via the first SPI interface, the micro control unit includes a second USB interface, the micro control unit is connected to the output interface via the second USB interface, and the central processing unit is configured to:

[0215] receiving audio and video data in HDMI format from the external device through the first signal conversion circuit;

[0216] Using the format conversion circuit to convert the video data of the audio and video data into a video signal in MIPI format, and to convert the audio data of the audio and video data into an audio signal in digital format;

[0217] Sending the audio signal to a central processing unit through the first audio signal output interface, and sending the video signal to the central processing unit through the first video signal output interface;

[0218] When the display channel is an external channel, the central processor runs a playback program to create a video playback window to output the video signal, and a speaker is used to output the audio signal;

[0219] receiving, through the first USB interface, first touch data in a USB format sent by the touch screen;

[0220] confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processing unit;

[0221] confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal by the central processing unit, and outputting the signal from the first SPI interface;

[0222] After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to the connected external device, and the external device performs a touch response.

[0223] In an embodiment of the present application, upon receiving first touch data from the touch screen and determining that the interactive tablet's display channel is a local channel, or upon determining that the display channel is an external channel and the first touch data meets preset conditions, the first touch data is sent to the central processing unit, which then performs a touch response. Alternatively, upon determining that the display channel is an external channel and the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device via an output interface, which then performs a touch response. This achieves an interactive tablet using a central processing unit as a core component, meeting the user's needs for installing complex and diverse Windows applications. Furthermore, when playing content displayed on an external device, touch data triggered by the displayed content can be sent to the external device, which then performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation and development costs, reducing the cost of interactive tablets based on a central processing unit platform.

[0224] An embodiment of the present application further provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the method described in any one of the above embodiments are implemented.

[0225] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing related hardware through a computer program. The program can be stored in a computer-readable storage medium, and when executed, the program can include the processes in the above-described method embodiments. The storage medium can be a magnetic disk, an optical disk, a read-only memory, or a random access memory.

[0226] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A touch feedback method, applied to an interactive tablet, characterized in that: The interactive tablet comprises a touch screen, a central processor, a micro control unit and an output interface, the central processor comprises a first USB interface and a first SPI interface, the central processor is connected to the touch screen via the first USB interface, the central processor is connected to the micro control unit via the first SPI interface, the micro control unit comprises a second USB interface, the micro control unit is connected to the output interface via the second USB interface, and the touch feedback method comprises: receiving, through the first USB interface, first touch data in a USB format sent by the touch screen; When the display channel is a local channel, performing a touch response to the first touch data through the central processor; When the display channel is an external channel, continue to perform the following steps: confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor; Confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal through the central processor, and outputting the signal from the first SPI interface; After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

2. The touch feedback method according to claim 1, characterized in that: The preset condition includes being located in a preset area, the interactive tablet displays a sidebar interface in the preset area, and confirming that the first touch data meets the preset condition, and performing a touch response according to the first touch data by the central processor, specifically: Confirm that the first touch data is within a preset area, perform a touch response according to the first touch data through the central processor, open the sidebar application, and display the sidebar interface.

3. The touch feedback method according to claim 2, characterized in that: An annotation icon is displayed in the sidebar interface, and the method further includes: receiving a click operation on the annotation icon, opening an annotation application, taking a screenshot of the display interface of the external channel, and overlaying the interface of the annotation application on the screenshot; After the central processor receives the first touch data, the first touch data is distributed to the annotation application for response.

4. The touch feedback method according to claim 1, characterized in that: The preset condition includes a preset interactive action, and the confirming that the first touch data meets the preset condition and performing a touch response according to the first touch data by the central processor are specifically: It is confirmed that the first touch data conforms to the preset interactive action, and the central processor performs a touch response according to the first touch data to open a global application corresponding to the preset interactive action.

5. The touch feedback method according to claim 1, characterized in that: The interactive tablet also includes a first signal conversion circuit, which includes a format conversion circuit and a signal output interface connected in sequence. The first signal conversion circuit is used to obtain audio and video data from the external device, and convert the audio and video data into a signal in a preset format, and then output it from the signal output interface to the central processor for playback.

6. The touch feedback method according to claim 5, characterized in that: The first signal conversion circuit also includes a switching switch, a first signal input interface and a second signal input interface, the first signal input interface and the second signal input interface are both connected to the switching switch, the switching switch is connected to the format conversion circuit, and the format conversion circuit is also connected to the central processing unit.

7. The touch feedback method according to claim 5, characterized in that: The signal output interface includes a first video signal output interface and a first audio signal output interface, the signal in the preset format includes a video signal in MIPI format and an audio signal in digital format, the video signal in MIPI format is output from the first video signal output interface, and the audio signal in digital format is output from the first audio signal output interface.

8. The touch feedback method according to claim 1, characterized in that: The interactive tablet further includes a USB switch, the output interface further includes a data output interface, the first switch interface of the USB switch is connected to the central processor, the second switch interface of the USB switch is connected to the data output interface, the USB switch is also connected to an external storage device, and the touch return method includes: When the display channel is a local channel, controlling the USB switch to connect to the first switching interface, and sending the storage data of the external storage device to the central processor; When the display channel is an external channel, the USB switch is controlled to connect to the second switching interface, and the storage data of the external storage device is sent to the external device through the data output interface.

9. The touch feedback method according to claim 1, characterized in that: The interactive tablet further includes an infrared receiving module, which is connected to the micro control unit. The touch feedback method further includes: Receiving an infrared signal through the infrared receiving module, transmitting the infrared signal to the micro control unit, and determining the infrared code of the infrared signal through the micro control unit; The infrared code is converted into character code by a micro control unit and sent to the central processing unit.

10. The touch feedback method according to claim 1, characterized in that: The interactive tablet further includes: an external communication module, the external communication module is connected to the micro control unit, and the touch feedback method further includes: Receiving a control instruction sent by an external device through the external communication module, transmitting the control instruction to the micro control unit, and determining a response action corresponding to the control instruction through the micro control unit; The response action is sent to the central processing unit through the micro control unit.

11. The touch feedback method according to claim 1, characterized in that: The central processing unit is configured as a master device, and the micro control unit is configured as a slave device.

12. A touch feedback method, applied to an interactive tablet, characterized in that: The interactive tablet comprises a touch screen, a central processor, a micro control unit and an output interface, the central processor comprises a first USB interface and a first SPI interface, the central processor is connected to the touch screen via the first USB interface, the central processor is connected to the micro control unit via the first SPI interface, the micro control unit comprises a second USB interface, the micro control unit is connected to the output interface via the second USB interface, and the touch feedback method comprises: receiving, through the first USB interface, first touch data in a USB format sent by the touch screen; When the service program is called to determine that the current display channel is a local channel, the first touch data is received through the driver, and the first touch data is distributed to the corresponding application for touch response according to the system distribution mechanism; When the service program is called to determine that the current channel is an external channel, the first touch data is received through the service program; If it is determined by the service program that the first touch data meets a preset condition, the first touch data is distributed to a corresponding application for touch response according to a system distribution mechanism; If it is determined through the service program that the first touch data does not meet a preset condition, the first touch data is converted into an SPI signal and then output from the first SPI interface; After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

13. The touch feedback method according to claim 12, characterized in that: The preset condition includes being located in a preset area, the interactive tablet displays a sidebar interface in the preset area, and the service program determines that the first touch data meets the preset condition, and then distributes the first touch data to the corresponding application for touch response according to the system distribution mechanism, specifically: Confirm that the first touch data is within a preset area, distribute the first touch data to the driver, distribute the first touch data to the corresponding application for touch response through the driver according to the system distribution mechanism, open the sidebar application, and display the sidebar interface.

14. The touch feedback method according to claim 13, characterized in that: An annotation icon is displayed in the sidebar interface, and the method further includes: receiving a click operation on the annotation icon, opening the annotation application, taking a screenshot of the display interface of the external channel, and overlaying the interface of the annotation application on the screenshot; After receiving the first touch data through the driver, the first touch data is distributed to the annotation application for response.

15. The touch feedback method according to claim 12, characterized in that: The preset condition includes a preset interactive action, and the confirming that the first touch data meets the preset condition and performing a touch response according to the first touch data through the driver are specifically: It is confirmed that the first touch data conforms to a preset interactive action, and a global application corresponding to the preset interactive action is opened by the driver program to perform a touch response according to the first touch data.

16. An interactive tablet, characterized in that: The interactive tablet comprises a touch screen, a central processing unit, a micro control unit and a first external interface, wherein the first external interface comprises a touch output interface, the central processing unit comprises a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen via the first USB interface, the central processing unit is connected to the micro control unit via the first SPI interface, the micro control unit comprises a second USB interface, the micro control unit is connected to the touch output interface via the second USB interface, and the central processing unit is configured as follows: receiving, through the first USB interface, first touch data in a USB format sent by the touch screen; confirming a display channel of the interactive tablet, and when the display channel is a local channel, performing a touch response to the first touch data; When the display channel is an external channel, continue to perform the following steps; confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data; confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal, and outputting the signal from the first SPI interface; After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the touch output interface to a connected external device, and the external device performs a touch response.

17. An interactive tablet, characterized in that: The interactive tablet comprises a touch screen, a central processing unit, a micro control unit and a first external interface, wherein the first external interface comprises a touch output interface, the central processing unit comprises a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen via the first USB interface, the central processing unit is connected to the micro control unit via the first SPI interface, the micro control unit comprises a second USB interface, the micro control unit is connected to the touch output interface via the second USB interface, and the central processing unit is configured as follows: receiving, through the first USB interface, first touch data in a USB format sent by the touch screen; When the service program is called to determine that the current display channel is a local channel, the first touch data is received through the driver, and the first touch data is distributed to the corresponding application for touch response according to the system distribution mechanism; When the service program is called to determine that the current channel is an external channel, the first touch data is received through the service program; If it is determined by the service program that the first touch data meets a preset condition, the first touch data is distributed to a corresponding application for touch response according to a system distribution mechanism; If it is determined through the service program that the first touch data does not meet a preset condition, the first touch data is converted into an SPI signal and then output from the first SPI interface; After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

18. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 15 are implemented.

Images