Audio and video data playing method and interactive panel

Abstract

The embodiment of the invention discloses an audio and video data playing method and an interactive tablet, the audio and video data playing method is applied to the interactive tablet, and the interactive tablet comprises a touch screen, a central processing unit, a first signal conversion circuit, a micro-control unit and an output interface, the first signal conversion circuit is connected with the central processing unit through a first video signal output interface and a first audio signal output interface, the central processing unit is connected with the touch screen, the central processing unit is connected with the touch screen through a first USB interface, and the central processing unit is connected with the micro-control unit through a first SPI interface. The micro-control unit is connected with the output interface through the second USB interface, and the method comprises the following steps: playing the audio and video data when receiving the audio and video data of the external equipment, and responding to the first touch data through the central processing unit or the external equipment when the first touch data is detected in the process of playing the audio and video data. The problem of touch data return of the interactive panel is solved, and the cost of the interactive panel is reduced.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to an audio and video data playback method and an interactive tablet. Background Art

[0002] In order to meet people's daily needs, the functions of various electronic products tend to be more diversified. For example, a touch-screen TV can not only provide movie and TV viewing functions, but also respond to user operations such as clicking and touching the display device; or receive audio and video data sent by external devices (such as laptops) through HDMI (High Definition Multimedia Interface), which is also called the HDMI input function.

[0003] At present, most electronic products use ARM architecture processors to complete various tasks. ARM architecture processors are usually implemented with Android systems, which are not as compatible as Windows systems. x86 architecture processors can run Windows systems, but they cannot implement HDMI input functions. Summary of the invention

[0004] The embodiment of the present application provides an audio and video data playback method and an interactive tablet, which solves the problem of touch data transmission of the interactive tablet and reduces the cost of the interactive tablet.

[0005] In a first aspect, an embodiment of the present application provides an audio and video data playback method, which is applied to an interactive tablet, wherein the interactive tablet includes a touch screen, a central processing unit, a first signal conversion circuit, a micro control unit, and an output interface, wherein the first signal conversion circuit includes a format conversion circuit, a first video signal output interface, and a first audio signal output interface, wherein the first signal conversion circuit is connected to an external device, and the first signal conversion circuit is connected to the central processing unit through the first video signal output interface and the first audio signal output interface, and the central processing unit is connected to the touch screen, and the central processing unit also includes a first USB interface and a first SPI interface, and the central processing unit is connected to the touch screen through the first USB interface, and the central processing unit is connected to the micro control unit through the first SPI interface, and the micro control unit includes a second USB interface, and the micro control unit is connected to the output interface through the second USB interface, and the method includes:

[0006] Receiving the audio and video data in HDMI format of the external device through the first signal conversion circuit;

[0007] Using the format conversion circuit to convert the video data of the audio and video data into a video signal in MIPI format, and to convert the audio data of the audio and video data into an audio signal in digital format;

[0008] Sending the audio signal to a central processing unit through the first audio signal output interface, and sending the video signal to the central processing unit through the first video signal output interface;

[0009] When the display channel is an external channel, the central processor runs a playback program to create a video playback window to output the video signal, and a speaker is used to output the audio signal;

[0010] receiving, through the first USB interface, first touch data in a USB format sent by the touch screen;

[0011] confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor;

[0012] Confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal through the central processor, and outputting the signal from the first SPI interface;

[0013] After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

[0014] In a second aspect, an embodiment of the present application provides an interactive tablet, the interactive tablet comprising a touch screen, a central processing unit, a first signal conversion circuit, a micro control unit and an output interface, the first signal conversion circuit comprising a format conversion circuit, a first video signal output interface and a first audio signal output interface, the first signal conversion circuit is connected to an external device, the first signal conversion circuit is connected to the central processing unit through the first video signal output interface and the first audio signal output interface, the central processing unit is connected to the touch screen, the central processing unit further comprises a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen through the first USB interface, the central processing unit is connected to the micro control unit through the first SPI interface, the micro control unit comprises a second USB interface, the micro control unit is connected to the output interface through the second USB interface, and the central processing unit is configured to:

[0015] Receiving the audio and video data in HDMI format of the external device through the first signal conversion circuit;

[0016] Using the format conversion circuit to convert the video data of the audio and video data into a video signal in MIPI format, and to convert the audio data of the audio and video data into an audio signal in digital format;

[0017] Sending the audio signal to a central processing unit through the first audio signal output interface, and sending the video signal to the central processing unit through the first video signal output interface;

[0018] When the display channel is an external channel, the central processor runs a playback program to create a video playback window to output the video signal, and a speaker is used to output the audio signal;

[0019] receiving, through the first USB interface, first touch data in a USB format sent by the touch screen;

[0020] confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor;

[0021] Confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal through the central processor, and outputting the signal from the first SPI interface;

[0022] After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

[0023] In an embodiment of the present application, the interactive tablet receives audio and video data from an external device, and upon receiving the first touch data of the touch screen, determines that the display channel of the interactive tablet is a local channel, or, when the display channel is an external channel and determines that the first touch data meets a preset condition, sends the first touch data to a central processing unit, and the central processing unit performs a touch response; when the display channel is an external channel and determines that the first touch data does not meet the preset condition, the first touch data is converted and transmitted to the external device through an output interface, and the external device performs a touch response. The embodiment of the present application realizes an interactive tablet using a central processing unit as a core component, which can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of an external device, the touch data triggered by the display content can be sent to the external device, and the external device performs a touch response. The scheme has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of interactive tablets based on a central processing unit platform. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0025] Figure 1 A schematic diagram of the structure of an interactive tablet is provided for an embodiment of the present application;

[0026] Figure 2 A schematic diagram of a touch feedback method is provided for an embodiment of the present application;

[0027] Figure 3 A schematic diagram of a touch feedback method scenario is proposed for an embodiment of the present application;

[0028] Figure 4 A schematic diagram of the structure of an interactive tablet is provided for an embodiment of the present application;

[0029] Figure 5 A schematic diagram of a touch feedback method flow is provided for an embodiment of the present application;

[0030] Figure 6 A schematic diagram of a touch feedback method scenario is provided for an embodiment of the present application;

[0031] Figure 7 A schematic diagram of a touch feedback method is provided for an embodiment of the present application;

[0032] Figure 8 A schematic diagram of a touch feedback method scenario is provided for an embodiment of the present application;

[0033] Fig. 9 A schematic diagram of a touch feedback method is provided for an embodiment of the present application;

[0034] Fig.10 A schematic diagram of the structure of an interactive tablet is provided for an embodiment of the present application;

[0035] Fig.11 A flowchart of a method for playing video and audio data is provided for an embodiment of the present application;

[0036] Fig.12 A schematic diagram of the structure of an interactive tablet is provided for an embodiment of the present application;

[0037] Fig.13 A structural schematic diagram of an interactive tablet is provided for an embodiment of the present application. DETAILED DESCRIPTION

[0038] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0039] In the description of the present application, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood in specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are an "or" relationship.

[0040] An interactive tablet is an integrated device that integrates display technology, touch technology, and audio and video display technology to achieve human-computer interaction. It has a large display screen and can achieve human-computer interaction through touch, providing a convenient human-computer interaction experience. It has been widely used in multi-person interaction scenarios such as teaching scenarios and conference scenarios.

[0041] In the related art, the interactive tablet generally uses a processor based on the ARM architecture as the main chip of the interactive tablet to complete various tasks. The processor of the ARM architecture has the characteristics of low power consumption and low cost, and it is usually used with the Android system. The Android system adopts an open source code model, allowing developers to freely access, modify and customize the operating system, which promotes the innovation and development of technology, making the Android system highly flexible and customizable, and can be customized according to the needs of manufacturers and users. Therefore, it has been widely used in the field of interactive tablets. However, for the Android system, it is overly dependent on secondary development. In the process of developing the Android system of the interactive tablet, it is necessary to invest more manpower and material resources for secondary development, and it is necessary to invest more development resources. In addition, for some more complex applications or functions, there are problems of development difficulties, and the compatibility of the solution is low. One solution is to connect an OPS (Open Pluggable Specification) module to the interactive tablet, and the OPS module is installed with a windows system, so that some more complex applications can be installed in the windows system to meet the diverse usage needs of users. However, this solution not only requires the addition of additional OPS modules, which is costly, but also requires a lot of development work to achieve interactive communication between the Android system and the OPS module. It even requires the addition of MCU, routers and other chips to achieve communication between the two. Therefore, this solution requires the addition of more hardware and is costly.

[0042] In order to reduce costs, it is possible to consider directly using the central processing unit as the main chip of the interactive tablet, and to carry the Windows system to realize the display, touch response and other functions of the interactive tablet, so as to meet the needs of users to install complex and diverse Windows applications. For interactive tablets, they have been widely used in multi-person interactive scenarios such as teaching scenarios and conference scenarios. During the application process, they may face diverse display requirements. In order to adapt to the multi-functional needs in these scenarios, the interactive tablet is also equipped with a signal source interface, allowing access to multiple signal sources, such as connecting to an external computer device, displaying the touch screen of the external computer device on the interactive tablet, and the user can operate the display screen of the external computer device on the touch screen. In this case, the interactive tablet needs to send the touch data to the external computer to realize the touch operation of the content displayed by the external computer. However, for the central processing unit equipped with the Windows system, it can only act as a host device during its working process, so it is impossible to send the touch data directly to the external computer device.

[0043] Therefore, how to realize touch feedback to external computer devices connected to the signal source while reducing the cost of interactive tablets is an urgent problem to be solved.

[0044] For the above problems, refer to Figure 1 , the present application embodiment provides an interactive tablet. Figure 1 As shown, the interactive tablet 10 includes: a touch screen 100, a central processing unit (CPU) 200, a microcontroller unit (MCU) 300 and an output interface 400, the central processing unit includes a first USB interface 201 and a first SPI interface 202, the central processing unit is connected to the touch screen 100 through the first USB201 interface, the central processing unit is connected to the microcontroller unit 300 through the first SPI interface 202, the microcontroller unit 300 includes a second USB interface 203, and the microcontroller unit is connected to the output interface 400 through the second USB203 interface.

[0045] The interactive tablet receives the first touch data in USB format sent by the touch screen 100 through the first USB interface 201. When it is determined that the current display channel is a local channel, the central processor 200 performs a touch response to the first touch data; when it is determined that the current display channel is an external channel, the first touch data needs to be confirmed. When it is confirmed that the first touch data meets the preset conditions, the central processor 200 performs a touch response to the first touch data; when it is confirmed that the first touch data does not meet the preset conditions, the central processor 200 converts the first touch data into an SPI signal, which is output from the first SPI interface 202 of the central processor to the micro control unit 300. The micro control unit 300 receives the SPI signal, converts the SPI signal into the second touch data in USB format, outputs it from the second USB interface 203 to the output interface 400, and transmits the second touch data converted into USB format to the external device 20 through the output interface 400. After receiving the second touch data, the external device 20 responds to the second touch data.

[0046] In the embodiment of the present application, when the first touch data of the touch screen is received and it is determined that the display channel of the interactive tablet is a local channel, or when the display channel is an external channel and it is determined that the first touch data meets the preset conditions, the first touch data is sent to the central processor, and the central processor performs a touch response; when the display channel is an external channel and it is determined that the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device through the output interface, and the external device performs a touch response. The embodiment of the present application realizes an interactive tablet using a central processor as a core component, which can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of the external device, the touch data triggered by the display content can be sent to the external device, and the external device performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of interactive tablets based on the central processor platform.

[0047] based on Figure 1 The structural diagram shown below will be combined with Figure 2-Figure 10 , the touch feedback method provided in the embodiments of this specification is introduced in detail.

[0048] Reference Figure 2 , Figure 2 This is a flow chart of the touch feedback method of the present application. The touch feedback method may include the following steps S101-S106:

[0049] S101, receiving first touch data in a USB format sent by the touch screen through the first USB interface;

[0050] In the present application, the connection between the touch screen and the central processing unit is via a USB cable, whereby the interactive tablet receives the first touch data in a USB format sent by the touch screen via the first USB interface.

[0051] The first touch data is data triggered by the user in the display interface of the touch screen, which may include data triggered by the user directly clicking the touch screen, dragging the touch screen with a finger, or clicking the touch screen with a wireless mouse.

[0052] It can be understood that in the embodiment of the present application, the interactive tablet can connect to external devices through audio and video interfaces such as the HDMI port and typeC port connected to the central processing unit, and display the display content of the current display interface of the external device on the touch screen of the interactive tablet.

[0053] Based on this, the user can click, drag and perform other operations on the touch screen displaying the current display interface of the external device, so that the display content of the current display interface of the external device can be operated directly through the touch screen of the interactive tablet.

[0054] It is understandable that when the interactive device receives the user's triggering operation to generate the first touch data through the touch screen, it can determine the position of the user's click by sensing the change in charge, the change in infrared light shielding, etc., depending on whether the touch screen is a capacitive touch screen or an infrared touch screen, and then generate the first touch data. The specific process will not be described in detail in this implementation.

[0055] S102, when the display channel is a local channel, performing a touch response to the first touch data through the central processor;

[0056] Optionally, in the embodiment of the present application, the central processing unit may be a processor of X86 architecture.

[0057] The interactive tablet can include local channels and external channels.

[0058] The local channel may be the channel through which the content currently displayed on the touch screen of the interactive tablet is the content played by the operating system of the interactive tablet. For example, in the embodiment of the present application, the interactive tablet is based on an X86 architecture processor and has a Windows operating system installed. The local channel may refer to the channel through which the Windows operating system of the interactive tablet performs work display. The external channel may be the channel through which the interactive tablet is connected to an external device and the content currently displayed by the external device is played on the touch screen.

[0059] For example, when the display content currently displayed on the touch screen of the interactive tablet is the running interface of an application installed in the interactive tablet, the display channel of the interactive tablet is determined to be a local channel; when the interactive tablet is connected to an external device and the display content played on the touch screen of the interactive tablet is the display content currently played by the external device, the display channel of the interactive tablet is determined to be an external channel.

[0060] When the display channel of the interactive tablet is a local channel, it is determined that the first touch data triggered by the user based on the touch screen is a control of the interactive tablet, and the first touch data is sent to the central processor, and the central processor responds to the first touch data.

[0061] For example, the content currently displayed on the touch screen is the interface of an application running on the central processing unit (for example, a whiteboard writing application interface). When the first touch data obtained by the user based on a click operation triggered by the touch screen is received, the central processing unit performs a touch response to the first touch data (for example, when the central processing unit determines that the first touch data is a sliding trajectory on the whiteboard writing application interface, a touch response is performed to the first touch data, and the response result is generating a writing trajectory based on the first touch data and displaying the generated writing trajectory in the whiteboard writing application interface of the touch screen. Specifically, it can also be displayed according to the set writing trajectory color and thickness).

[0062] S103, when the display channel is an external channel, continue to execute the following steps:

[0063] When the current display channel is an external channel, the response may be made by an external device connected to the external channel or by a central processor, so it is necessary to further determine the execution subject of the touch response to the first touch data.

[0064] S104, confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor;

[0065] The preset condition may be a preset condition requiring the central processor to perform a touch response to the first touch data when the current display channel is an external channel.

[0066] The preset condition may include at least one, for example, it may be a preset interactive action, a preset area, wherein the preset interactive action may be tapping the touch screen with two fingers at the same time, operation with five fingers together, multi-finger long press operation, sliding two fingers on the touch screen at the same time, or a preset gesture trajectory, etc.

[0067] In this embodiment, after receiving the first touch data, it is determined that the first touch data is a user's multi-finger long press on the touch screen, then it is determined that the first touch data meets the preset conditions, and the central processor responds to the first touch data, for example, it can be to open a quick operation menu, open a global menu, open an annotation application, open a screen recording application, or open a settings menu, etc. Alternatively, after receiving the first touch data, it is determined that the first touch data falls within the range of a preset area, such as Figure 3 As shown, for example, if the touch screen falls into the preset area on the left side of the touch screen, the central processor responds to the first touch data, thereby opening the screen projection code, the homepage annotation application, or performing a return operation, etc. Figure 3 If it is detected that the first touch data falls into a home page in a preset area, the home page is opened and icons of applications included in the home page are displayed (for example, icon 1, icon 2, and icon 3 are displayed).

[0068] It can be understood that, in this embodiment, when the central processor performs a touch response to the first touch data, the response mode of the central processor can be preset. For example, the first touch data can be preset as two fingers tapping the touch screen at the same time. When the central processor receives the first touch data, the touch response to the first touch data is: pause the current display content. In the process of using the interactive tablet, when the first touch data is received, the central processor responds to the first touch data according to the preset touch response. For example, the user is currently using the interactive tablet to play music, and the current display content of the touch screen of the interactive tablet is the PPT currently played by the external device. It is determined that the current display channel is an external channel. When the user taps the touch screen with two fingers at the same time, it is determined that the first touch data meets the preset conditions and the touch data is sent to the central processor. After receiving the first touch data, the central processor pauses the currently playing music according to the preset touch response.

[0069] In some embodiments, when it is determined that the first touch data matches the preset interaction action, a global application corresponding to the preset interaction action may be displayed.

[0070] Global applications include: sidebar applications, global menu applications, and annotation applications.

[0071] In this embodiment, opening the sidebar application to display the sidebar interface may include one or more of a split-screen application, a volume application, a camera application, a timer application, an annotation application, and a channel switching application.

[0072] The global menu application displays a global menu application interface that may include: one or more of a notification application, a do not disturb application, and a WiFi application.

[0073] Optionally, the global menu application interface may display the programs that the user has opened most times within a preset time period (eg, one week), the applications that the user is currently using or has used in the past, and the like.

[0074] In this embodiment, the corresponding global application can be opened according to the preset interaction action by associating the preset interaction action with the global application. Thus, when it is determined that the received first touch data satisfies the preset interaction action, a global application associated with it is determined to be the corresponding global application, and the global application is started according to the first touch data.

[0075] For example, a preset interactive action—multi-finger long press on the touch screen is set to be associated with launching a global application—a global menu application. In the case of an external channel, when the first touch data received is the preset interactive action—multi-finger long press on the touch screen, the global menu application is launched and its homepage is displayed on the display interface of the touch screen.

[0076] In this embodiment, the interactive tablet realizes fast display of the global application corresponding to the preset action by displaying the global application corresponding to the preset action when determining that the first touch data matches the preset interactive action.

[0077] S105, confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal through the central processor, and outputting the signal from the first SPI interface;

[0078] The central processor is connected to the micro control unit via an SPI interface. If it is determined that the first touch data does not meet the preset condition, the central processor converts the received first touch data in USB format into an SPI signal and sends it to the micro control unit via the SPI interface.

[0079] S106, after the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

[0080] In the embodiment of the present application, the external device may be a desktop computer or a laptop computer.

[0081] In this embodiment, the central processor converts the first touch data into an SPI signal according to a private protocol, and outputs the SPI signal to the microcontroller unit through a first SPI interface. The microcontroller unit converts the SPI signal into second touch data in USB format according to the pre-known private protocol and the data format of the touch data.

[0082] The micro control unit receives the SPI signal sent by the central processing unit, converts the SPI signal into second touch data in USB format, and outputs the second touch data to an external device from an output interface.

[0083] It is understandable that the interactive tablet with a central processor of the x86 architecture is installed as the host, and the external device is also an independently running host, and in the traditional communication architecture, the two hosts cannot complete communication. Therefore, it is necessary to use a microcontroller unit as an intermediate medium, that is, the central processor is used as the master device and the microcontroller unit is used as the slave device to send the first touch data of the interactive tablet with the central processor installed to the external device, and the external device performs a touch response. Moreover, in the embodiment of the present application, by converting the first touch data into an SPI signal, outputting the SPI signal to the MCU through the first SPI interface, and then converting the SPI signal into the second touch data in USB format by the MCU, an MCU with only one USB interface can be selected, which greatly reduces the cost of the MCU.

[0084] In this embodiment, when the content displayed on the touch screen is the display content of an external device, and when it is determined that the first touch data triggered by the user does not meet the preset conditions, the interactive tablet determines that the first touch data currently triggered by the user based on the touch screen is data for controlling the currently played display content, and then sends the first touch data to the external device through the output interface, and the external device responds to the touch.

[0085] For example, the touch screen is currently playing audio and video data from an external device. After receiving the user's single-finger tapping the touch screen twice in a row, the first touch data is obtained. The interactive tablet obtains the first touch data of the touch screen, determines that the current display channel is an external channel, and further determines whether the first touch data meets the preset conditions. It can find the pre-set preset conditions. If there is no single-finger tapping the touch screen twice in a row in the preset conditions, it is determined that the first touch data does not meet the preset conditions, and the second touch data obtained after converting the first touch data is sent to the external device, and the external device performs a touch response. For example, after the external device receives the second touch data, it obtains the position where the user clicked according to the second touch data, and determines that the user needs to fast forward the audio and video data by 2 seconds. The external device fast-forwards the audio and video data by 2 seconds to complete the touch response.

[0086] In some embodiments, reference Figure 4 , Figure 4 This is a structural schematic diagram of the interactive tablet of this application.

[0087] The interactive tablet also includes a USB switching switch 500, and the output interface 400 also includes a data output interface 401. The first switching interface 501 of the USB switching switch 500 is connected to the central processor 200, and the second switching interface 502 of the USB switching switch 500 is connected to the data output interface 401. The USB switching switch 500 is also connected to the external storage device 30. When the display channel is a local channel, the USB switching switch 500 is controlled to connect to the first switching interface 501 to send the storage data of the external storage device 30 to the central processor 200. When the display channel is an external channel, the USB switching switch 500 is controlled to connect to the second switching interface 502 to send the storage data of the external storage device 30 to the external device 20 through the data output interface 401.

[0088] Optionally, a USB expansion interface may be used in the external interface of the USB switch 500, thereby enabling storage data of multiple external storage devices to be read through the USB switch.

[0089] For example, when the touch screen is playing the display content of the external device, the USB switch sends the storage data of the external storage device to the external device 20 by connecting to the second switching interface. Since the interactive tablet is currently in the external channel, it can read the data of the external device. Therefore, the interactive tablet can read the storage data of the external storage device through the external device and display it on the touch screen. When the touch screen runs an internal application, the USB switch sends the storage data of the external storage device to the central processor by connecting to the first switching interface, and displays it on the touch screen.

[0090] In this embodiment, the switching switch is used to send the storage data of the external storage device to the external device or the central processor respectively when the interactive tablet is in different display channels.

[0091] In some embodiments, please refer to Figure 4 The interactive tablet also includes an infrared receiving module. The infrared receiver is connected to the micro control unit, receives infrared signals, and transmits the infrared signals to the micro control unit, and the infrared code of the infrared signal is determined by the micro control unit. After that, the micro control unit converts the infrared code into a character code that can be recognized by the central processing unit and sends it to the central processing unit.

[0092] In this embodiment, the infrared signal can be sent by an infrared remote controller. After receiving the infrared signal, the micro control unit determines the infrared code of the infrared signal in the infrared remote controller according to the NEC protocol.

[0093] In the present application, infrared codes and character codes can be stored in the microprocessor in correspondence. For example, for the remote control key value "0", the infrared code stored in the microprocessor is "0x1B", and the character code stored in correspondence with the infrared code is "0x30". After the microprocessor receives the infrared signal of the user pressing the key value "0" through the remote control, the microprocessor parses the key value "0" in the remote control from the infrared signal according to the NEC protocol, and then determines the character code of the key value "0" through the corresponding stored infrared code and character code, and sends the character code to the central processor to respond to the key value.

[0094] In this embodiment, the received infrared signal is parsed by the microprocessor and a character code recognizable by the central processing unit is obtained, so that the central processing unit can respond to the character code, thereby realizing the control of the interactive tablet by infrared signals and solving the problem that the X86 architecture cannot receive remote control signals.

[0095] In some embodiments, please refer to Figure 4 The interactive tablet also includes an external communication module, which is connected to the micro control unit, receives control instructions sent by an external device through the external communication module, transmits the control instructions to the micro control unit, determines the response action corresponding to the control instruction through the micro control unit, and sends the response action to the central processor through the micro control unit.

[0096] The external device may be a mobile terminal such as a mobile phone. The mobile phone may establish a connection with the interactive tablet through the external communication module. Thus, when the external communication module receives a control instruction sent by the mobile phone, it determines a response action corresponding to the control instruction and sends it to the central processor for execution.

[0097] In this embodiment, the external communication module is used to realize the use of external devices such as mobile phones to control the central processing unit to execute response actions.

[0098] In the embodiment of the present application, when the first touch data of the touch screen is received and it is determined that the display channel of the interactive tablet is a local channel, or when the display channel is an external channel and it is determined that the first touch data meets the preset conditions, the first touch data is sent to the central processor, and the central processor performs a touch response; when the display channel is an external channel and it is determined that the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device through the output interface, and the external device performs a touch response. The embodiment of the present application realizes an interactive tablet using a central processor as a core component, which can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of the external device, the touch data triggered by the display content can be sent to the external device, and the external device performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of interactive tablets based on the central processor platform.

[0099] Reference Figure 5 , Figure 5 This is a flow chart of the present application. Step S104 includes:

[0100] S1041: confirming that the first touch data is within a preset area, performing a touch response according to the first touch data by the central processor, opening a sidebar application, and displaying a sidebar interface.

[0101] In this embodiment, the preset condition includes being located in a preset area, such as Figure 6 As shown, optionally, after receiving a touch operation on a preset area, the interactive tablet opens the sidebar application and displays the sidebar interface. Figure 7 The preset area can be set at the top, bottom, left or right end of the touch screen. When the sidebar application is opened, the sidebar interface is displayed in the display interface, and the sidebar interface can be displayed on the right side of the touch screen. In some other embodiments, the sidebar interface can also be displayed in other areas of the touch screen.

[0102] It is understandable that in this embodiment, the user can click the touch screen using a touch pen. When a click operation is detected on the touch screen, the touch screen generates first touch data. It is determined that the current display channel is an external channel, and the first touch data is within a preset area, and it is determined that the first touch data meets the preset conditions. The central processor performs a touch response according to the first touch data, opens the sidebar application, and displays the sidebar interface, wherein the sidebar application is opened and the sidebar interface is displayed as shown in FIG. Figure 7 shown.

[0103] In the embodiment of the present application, while playing the display content of the external device, the interactive tablet responds to the user's first touch data in a preset area and opens the sidebar interface to provide convenient operation for the user.

[0104] In some embodiments, an annotation icon is also displayed in the sidebar interface. When the touch screen receives a click operation on the annotation icon, the annotation application is opened, and a screenshot of the display interface of the external channel is taken. The interface of the annotation application is superimposed on the screenshot. The interface of the annotation application is a transparent or semi-transparent interface. When a touch operation is performed on the interface of the annotation application, annotation handwriting can be generated, thereby achieving the purpose of annotating the display content of the interface below the interface of the annotation application. At this time, the interactive tablet sends the first touch data received based on the interface of the annotation application displayed on the touch screen to the annotation application, and the annotation application responds to the touch. That is to say, when the annotation application is opened in the external channel, the annotation application responds to the touch data directly, and no longer sends it to the MCU through the SPI interface, so it is no longer transmitted back to the external device.

[0105] For example, refer to Figure 8 If the touch screen receives a click operation on the annotation icon, the annotation application is opened and the sidebar display interface is closed. At the same time, a screenshot is taken of the display interface of the external channel currently played by the touch screen. The interface of the annotation application is superimposed on the screenshot. Here, the interface of the annotation application is a transparent interface. The touch screen receives the user's touch action based on the display interface of the annotation application, and generates the first touch data and sends it to the annotation application, which responds to the touch. For example, a circle is drawn at the corresponding position on the screenshot according to the received first touch data, and annotated. Please refer to the effect after superimposed display. Fig. 9 It is understandable that when the display content such as video data is displayed in the display interface currently played on the touch screen, after clicking on the annotation, the sidebar interface can also be displayed in a transparent manner in this embodiment, thereby enabling the user to annotate the displayed content separately.

[0106] In this embodiment, by displaying the annotation icon in the sidebar interface and opening the annotation application when a click operation is detected on the annotation icon, the annotation application responds to the first touch data received by the interface based on the annotation application. This enables the interactive tablet to respond to the first touch data received by the display interface based on the annotation application when an external display channel is connected.

[0107] The interactive tablet also includes a first signal conversion circuit, which includes a format conversion circuit and a signal output interface connected in sequence. The first signal conversion circuit is used to obtain input audio and video data from the external device, and convert the audio and video data into an audio and video signal in a preset format, and then output it from the signal output interface to the central processor for playback.

[0108] In this embodiment, the audio and video data received from the external device is converted into an audio and video signal of a preset format and output to the central processing unit for playback, thereby enabling the interactive tablet based on the central processing unit platform to play the audio and video data of the external device.

[0109] Reference Fig.10 , Fig.10 The first signal conversion circuit 600 includes: a format conversion circuit 601 , a signal output interface 602 , a switch 603 , and a signal input interface 604 , wherein the signal input interface 604 includes: a first signal input interface 6041 and a second signal input interface 6042 .

[0110] The first signal input interface and the second signal input interface are both connected to the switching switch, and the audio and video data of the external device are transmitted to the switching switch through the first signal input interface and the second signal input interface. The switching switch determines which signal input interface's audio and video data is received. In addition, the switching switch is connected to the format conversion circuit, and after receiving the audio and video data, the switching switch transmits the audio and video data to the format conversion circuit, and the format conversion circuit performs format conversion on the audio and video data. The format conversion circuit is also connected to the central processing unit, and after the format conversion circuit completes the format conversion of the audio and video data, the audio and video data is sent to the central processing unit.

[0111] In this embodiment, by switching the switch, it is achieved that when there are multiple audio and video data, the audio and video data that the interactive tablet needs to play is selected.

[0112] In some embodiments, the signal output interface includes a first video signal output interface and a first audio signal output interface, the preset format signal includes a video signal in MIPI format and an audio signal in digital format, the video signal in MIPI format is output from the first video signal output interface, and the audio signal in digital format is output from the first audio signal output interface.

[0113] Continue to refer to Fig.10In this embodiment, the signal output interface includes a first video signal output interface 6021 and a first audio signal output interface 6022. After the format conversion circuit performs format conversion on the input audio and video data, the audio and video data are converted into two output signals, one of which is a video signal in MIPI format and the other is an audio signal in digital format, and the video signal is output to the central processing unit (CPU) through the first video signal output interface 6021, and the audio signal is output to the central processing unit (CPU) from the first audio signal output interface 6022.

[0114] In this example, the audio and video data obtained after conversion are transmitted to the central processing unit from different signal output interfaces respectively, so that the audio and video data of the external device can be played on the interactive tablet based on the central processing unit platform.

[0115] The execution subject of this embodiment is a touch feedback system installed in the interactive tablet.

[0116] In this embodiment, when the interactive tablet is started, the service program in the touch return system is started at the same time. The touch return system receives the first touch data in USB format sent by the touch screen through the first USB interface. When the service program determines that the display channel is a local channel, the first touch data is received through the driver, wherein the driver can be a HID driver of the windows operating system. And the first touch data is distributed to the corresponding application for touch response through the system distribution mechanism of the Windows system. When the service program determines that the display channel is an external channel, the first touch data is obtained through the service program, and it is determined whether the first touch data meets the preset conditions. If it is determined that the first touch data meets the preset conditions, the first touch data is sent to the corresponding application for touch response; if it is determined that the first touch data does not meet the preset conditions, the first touch data is converted into an SPI signal, and the SPI signal is sent to the microprocessor through the SPI driver. After the microprocessor receives the SPI signal, the SPI signal is encapsulated in the HID format to obtain the second touch data in USB format, and the MCU outputs the SPI signal in the HID format to the external device through the output interface, and the external device responds.

[0117] The service program registers the windows event callback function through RegisterClassEx, filters the WM_INPUT type events from the windows operating system through the callback function, and then obtains the touch data of the RAWINPUTHEADER structure through the GetRawInputData function to determine whether the touch data is within the preset area.

[0118] In some embodiments, when the service program determines that the first touch data matches the preset interaction action, a global application corresponding to the preset interaction action may be displayed.

[0119] Global applications include: sidebar applications, global menu applications, and annotation applications.

[0120] In this embodiment, the sidebar interface displayed when the sidebar application is opened may include one or more of a weather application, a volume application, a positioning application, a Bluetooth application, and an annotation application.

[0121] The global menu application interface displayed by the global menu application may include: one or more of: a notification application, a do not disturb application, a rotation application, and a WiFi application.

[0122] Optionally, the programs that are opened most frequently by the user within a preset time period (eg, one week) may be displayed in the global menu application.

[0123] In this embodiment, the corresponding global application can be opened according to the preset interaction action by associating the preset interaction action with the global application. Thus, when the service program determines that the received first touch data satisfies the preset interaction action, the service program distributes the first touch data to the driver program, and the driver program distributes the first touch data to the corresponding application for touch response according to the system distribution mechanism.

[0124] For example, a preset interactive action—multi-finger long press on the touch screen—is associated with launching a global application—a global menu application—in the interactive platform. In the case of an external channel, the first touch data received is a preset interactive action—multi-finger long press on the touch screen. The service program determines that the first touch data meets the preset conditions and distributes the first touch data to the driver. The driver distributes the first touch data to the corresponding application for touch response according to the system distribution mechanism. For example, the global menu application responds to the first touch data and displays the homepage of the global menu application on the display interface of the touch screen, such as Figure 3 shown.

[0125] In this embodiment, the service program realizes fast display of the global application corresponding to the preset action by displaying the global application corresponding to the preset action when determining that the first touch data matches the preset interactive action.

[0126] In this embodiment, the preset condition includes being located in a preset area, such as Figure 6 As shown, optionally, after receiving a touch operation on a preset area, the interactive tablet opens the sidebar application and displays the sidebar interface. Figure 7As shown, the preset area can be set at the top, bottom, left or right end of the touch screen. When the sidebar application is opened, the sidebar interface is displayed in the display interface, and the sidebar interface can be displayed on the right side of the touch screen. In some other embodiments, the sidebar interface can also be displayed in other areas of the touch screen.

[0127] It is understandable that in this embodiment, the user can click the touch screen using a touch pen. When a click operation is detected on the touch screen, the touch screen generates first touch data. It is determined that the current display channel is an external channel, and the first touch data is within a preset area, and it is determined that the first touch data meets the preset conditions, and the first touch data is distributed to the driver. The driver distributes the first touch data to the corresponding application according to the system distribution mechanism for touch response, for example, to the sidebar application. The sidebar application responds to the first touch data and displays the sidebar interface, such as Figure 7 shown.

[0128] In the embodiment of the present application, while playing the display content of the external device, the interactive tablet responds to the user's first touch data in a preset area and opens the sidebar interface to provide convenient operation for the user.

[0129] In some embodiments, an annotation icon is also displayed in the sidebar interface. When the service program receives a click operation on the annotation icon, the service program sends the first touch data to the driver, and the driver sends the first touch data to the annotation application according to the system distribution mechanism, and takes a screenshot of the display interface of the external channel, and superimposes the interface of the annotation application on the screenshot. Afterwards, the annotation application will intercept the touch data of the RAWINPUTHEADER structure. Before the annotation application is closed, the service program will not be able to obtain the touch data. Therefore, when the first touch data is received on the interface of the annotation application, the annotation application will perform a touch response to the first touch data.

[0130] For example, refer to Figure 8 If the touch screen receives a click operation on the annotation icon, the annotation application is opened and the sidebar display interface is closed. At the same time, a screenshot is taken of the display interface of the external channel currently played by the touch screen. The interface of the annotation application is superimposed on the screenshot. Here, the interface of the annotation application is a transparent interface. The touch screen receives the user's touch action based on the display interface of the annotation application, and generates the first touch data and sends it to the annotation application, which responds to the touch. For example, a circle is drawn at the corresponding position on the screenshot according to the received first touch data, and annotated. For the effect after superimposed display, please refer to Fig. 9 .

[0131] In this embodiment, by displaying the annotation icon in the sidebar interface and opening the annotation application when a click operation is detected on the annotation icon, the annotation application responds to the first touch data received by the interface based on the annotation application. This enables the interactive tablet to respond to the first touch data received by the display interface based on the annotation application when an external display channel is connected.

[0132] In the embodiment of the present application, after receiving the first touch data of the touch screen and determining that the display channel of the interactive tablet is a local channel, the first touch data is distributed to the corresponding application for touch response through the system distribution mechanism of the Windows system; when the display channel is an external channel, the first touch data is received through a private service, and when it is determined that the first touch data meets the preset conditions, the first touch data is sent to the corresponding application for touch response, and when it is determined that the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device through the output interface, and the external device performs touch response. The interactive tablet using the central processing unit as the core component is realized, which can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of the external device, the touch data triggered by the display content can be sent to the external device, and the external device performs touch response. The scheme has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of the interactive tablet based on the central processing unit platform.

[0133] Reference Fig.10 The interactive tablet includes: a touch screen 100, a central processing unit (CPU) 200, a microcontroller Unit, MCU) 300, an output interface 400, and a first signal conversion circuit 600, wherein the first signal conversion circuit 600 includes a format conversion circuit 601 and a signal output interface 602, wherein the signal output interface 602 includes a first video signal output interface 6021 and a first audio signal output interface 6022, the first signal conversion circuit 600 is connected to the external device 20, the first signal conversion circuit 600 is connected to the central processing unit 200 through the first video signal output interface 6021 and the first audio signal output interface 6022, the central processing unit 200 is connected to the touch screen 100, the central processing unit 200 includes a first USB interface 201 and a first SPI interface 202, the central processing unit 200 is connected to the touch screen 100 through the first USB interface 201, the central processing unit is connected to the micro control unit 300 through the first SPI interface 202, the micro control unit 300 includes a second USB interface 203, and the micro control unit is connected to the output interface 400 through the second USB interface 203.

[0134] The first signal conversion circuit 600 of the interactive tablet receives audio and video data, and converts the audio and video data into a video signal in MIPI format and an audio signal in digital format through a format conversion circuit 601, and outputs the audio signal to the central processing unit through a first audio signal output interface 6022; and outputs the video signal to the central processing unit through a first video signal output interface 6021.

[0135] Optionally, in this embodiment, if there is only one signal input interface, the format conversion circuit 601 is directly connected to the signal input interface. That is, in this embodiment of the application, the switch 603 can be configured according to actual use requirements.

[0136] The central processor receives the audio and video data, and when the display channel is an external channel, plays the received audio and video data on the touch screen of the interactive tablet.

[0137] During the process of playing audio and video data, the interactive tablet receives the first touch data in USB format sent by the touch screen 100 through the first USB interface 201. When it is confirmed that the first touch data meets the preset conditions, the central processor 200 performs a touch response to the first touch data. When it is confirmed that the first touch data does not meet the preset conditions, the first touch data is converted into an SPI signal through the central processor 200, and output from the first SPI interface 202 of the central processor to the micro control unit 300. The micro control unit 300 receives the SPI signal, converts the SPI signal into second touch data in USB format, outputs it from the second USB interface 203 to the output interface 400, and transmits the second touch data converted into USB format to the external device 20 through the output interface 400. After receiving the second touch data, the external device 20 responds to the second touch data.

[0138] In an embodiment of the present application, the interactive tablet receives audio and video data from an external device, and plays the received audio and video data when the display channel is an external channel. Based on the playback interface, if the first touch data of the touch screen is received, and it is determined that the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device through the output interface, and the external device performs a touch response. The embodiment of the present application realizes an interactive tablet using a central processing unit as a core component, which can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of an external device, the touch data triggered by the display content can be sent to the external device, and the external device performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of interactive tablets based on central processing unit platforms.

[0139] based on Fig.10 The structural diagram shown below will be combined with Figure 11-13 , the audio and video data playback method provided in the embodiments of this specification is introduced in detail.

[0140] Reference Fig.11 , Fig.11 The flowchart of the audio and video data playing method of the present application is shown in FIG. The audio and video data playing method may include the following steps S201 to S208:

[0141] S201, receiving audio and video data in HDMI format from the external device through the first signal conversion circuit;

[0142] The first signal conversion circuit can be used to receive HDMI format audio and video data from an external device (such as a TV, a computer, etc.), wherein HDMI (High-Definition Multimedia Interface) is a digital signal transmission standard that can transmit high-definition video and multi-channel audio signals through a single connection line.

[0143] It can be understood that in the embodiment of the present application, the first signal conversion circuit of the interactive tablet can connect to the external device through the audio and video interface such as HDMI port and typeC port to obtain the audio and video data of the external device.

[0144] S202, using the format conversion circuit to convert the video data of the audio and video data into a video signal in MIPI format, and to convert the audio data of the audio and video data into an audio signal in digital format;

[0145] In this embodiment, after obtaining audio and video data from the external device, the first signal conversion circuit uses the format conversion circuit to convert the audio data into an audio signal in a digital format, and converts the video data into a video signal in a MIPI format.

[0146] S203, sending the audio signal to the central processor through the first audio signal output interface, and sending the video signal to the central processor through the first video signal output interface;

[0147] After the format conversion circuit completes the conversion of the audio and video signals, the audio signal is sent to the central processor through the first audio signal output interface, and the video signal is sent to the central processor through the first video signal output interface.

[0148] S204, when the display channel is an external channel, the central processor runs a playback program to create a video playback window to output the video signal, and a speaker is used to output the audio signal;

[0149] The interactive tablet can include local channels and external channels.

[0150] The local channel may be the channel through which the content currently displayed on the touch screen of the interactive tablet is the content played by the operating system of the interactive tablet. For example, in the embodiment of the present application, the interactive tablet is based on an X86 architecture processor and has a Windows operating system installed. The local channel may refer to the channel through which the Windows operating system of the interactive tablet performs work display. The external channel may be the channel through which the interactive tablet is connected to an external device and the content currently displayed by the external device is played on the touch screen.

[0151] For example, when the display content currently displayed on the touch screen of the interactive tablet is the running interface of an application installed in the interactive tablet, the display channel of the interactive tablet is determined to be a local channel; when the interactive tablet is connected to an external device and the display content played on the touch screen of the interactive tablet is the display content currently played by the external device, the display channel of the interactive tablet is determined to be an external channel.

[0152] When the display channel is an external channel, after receiving the audio signal and the video signal, the central processor creates a video playback window by running the playback program to output the video signal, and uses the speaker to output the audio signal, thereby realizing the playback of audio and video data of external devices on the interactive tablet.

[0153] Optionally, after receiving the video signal, the central processing unit renders the video signal before playing the video signal, and runs a playback program through the central processing unit to create a video playback window to output the rendered video signal.

[0154] The process can be as follows: the CPU receives the video signal, then renders the video signal using tools such as a graphics library or a geometric calculation engine, creates a video playback window and outputs the rendered video signal. Rendering the video signal before playing it provides users with a high-quality viewing experience.

[0155] When the CPU plays the video signal, the preset operation is intercepted.

[0156] The preset operation may be a preset behavior or action, which may be sharing or downloading. For example, the downloading or sharing operation of the video signal by the user is restricted to protect the played video signal.

[0157] S205, receiving first touch data in a USB format sent by the touch screen through the first USB interface;

[0158] When playing the audio and video data sent by the external device, the central processor receives the first touch data in USB format sent by the touch screen based on the display content of the current playback interface through the first USB interface. It can be understood that step S205 of this embodiment can refer to Figure 2Step S101 of the illustrated embodiment will not be described in detail here.

[0159] S206, confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor;

[0160] It is understandable that step S206 of this embodiment can refer to Figure 2 Step S104 of the illustrated embodiment will not be described in detail here.

[0161] S207, confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal through the central processor, and outputting the signal from the first SPI interface;

[0162] It is understandable that step S207 of this embodiment can refer to Figure 2 Step S105 of the illustrated embodiment will not be described in detail here.

[0163] S208, after the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

[0164] It is understandable that step S208 of this embodiment can refer to Figure 2 Step S106 of the illustrated embodiment will not be described in detail here.

[0165] In an embodiment of the present application, the interactive tablet receives audio and video data from an external device, and plays the received audio and video data when the display channel is an external channel. Based on the playback interface, if the first touch data of the touch screen is received, and it is determined that the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device through the output interface, and the external device performs a touch response. The embodiment of the present application realizes an interactive tablet using a central processing unit as a core component, which can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of an external device, the touch data triggered by the display content can be sent to the external device, and the external device performs a touch response. This solution has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of interactive tablets based on central processing unit platforms.

[0166] In this embodiment, if the display channel is a local channel, the central processor responds to the first touch data. The process is as shown in the above embodiment, and no further description is given here. It is achieved that when the display channel is a local channel, the central processor responds to the first touch data.

[0167] In this embodiment, the first signal conversion circuit further includes a switch and a signal input interface, wherein the structure and connection relationship between the signal input interface and the switch are as described in the above embodiment, and will not be described in detail here.

[0168] Optionally, there may be multiple signal input interfaces.

[0169] When it is determined that the multiple signal input interfaces are respectively connected to different external devices, before the first signal conversion circuit sends the audio and video data to the first signal conversion circuit, the central processor needs to display the selection information of the signal input interface on the touch screen.

[0170] For example, a first external device is connected to a first signal input interface, and a second external device is connected to a second signal input interface. The central processor displays the available signal input interfaces and the corresponding external devices on the touch screen. The user can select the desired signal input interface through the touch screen interface and use it as the input channel for the audio and video data currently to be received. When the user selects a specific signal input interface on the touch screen, the central processor will receive the corresponding confirmation information. The pre-written switching program is called to send a control signal to the switching switch, requiring the switching switch to switch to the signal input interface corresponding to the confirmation information.

[0171] The switching switch will connect the corresponding signal input interface according to the control signal, making it the currently active signal input channel.

[0172] In this embodiment, the central processing unit can control the switching switch to switch to the required signal input interface based on the selection information and the user's confirmation information, thereby realizing that when multiple signal input interfaces are connected to multiple different external devices, the audio and video data of a certain external device can be selectively accessed, which can facilitate users to switch different playback sources.

[0173] In this embodiment, when there are multiple signal input interfaces in the first signal conversion circuit, the signal input interface connected to the external device is used as the first signal input selection interface, and the identification information of the first Switch register of the first signal input selection interface is displayed on the touch screen, wherein there are multiple first signal input selection interfaces, there are multiple first Switch registers, and there are also multiple identification information displayed on the touch screen.

[0174] It can be understood that the Switch register is used to record the connection status of the signal input interface, that is, to indicate whether a specific signal input interface is connected to an external device. By reading the detection bit information of the Switch register, the connection status of each signal input selection interface can be determined. When the detection bit information changes, it can be determined that the switching of the signal input interface has occurred, and corresponding operations are performed according to the state after the switching.

[0175] After receiving confirmation information triggered by the user's selection on the touch screen, the Switch register of the identification information selected by the user from the multiple identification information is determined to be the second Switch register, and the first signal input selection interface corresponding to the second Switch register is determined to be the second signal input selection interface.

[0176] For example, there are three signal input interfaces, namely, the first signal input interface, the second signal input interface, and the third signal input interface. Wherein, the first signal input interface and the third signal input interface are both connected to external devices, then the first signal input interface and the third signal input interface are determined to be the first signal input selection interface, and the identification information of the first Switch register corresponding to the first signal input selection interface is obtained respectively, wherein the identification information of the first Switch register of the first signal input interface is A01, and the identification information of the first Switch register of the third signal input interface is A02. The selection information of A01 and A02 is displayed on the display screen, and after receiving the identification information of the user selecting A02, the first Switch register corresponding to the A02 identification information is determined to be the second Switch register, and the first signal input selection interface corresponding to the register is determined to be the second signal input selection interface.

[0177] In this embodiment, by displaying the identification information of the switch register on the touch screen interface, the user can accurately select the desired signal input interface through the identification information displayed on the touch screen.

[0178] Optionally, in this embodiment, after the second signal input selection interface is determined, a driver of the central processing unit is called to obtain HDMI information and edid list stored in the second signal input selection interface.

[0179] Among them, HDMI (High-Definition Multimedia Interface) information refers to some parameters and function support information related to the HDMI interface, including resolution, refresh rate, color space, audio format and other information.

[0180] The EDID list provides detailed information about the display device, such as manufacturer name, product model, resolution support, screen size, color capability, audio support, etc. By reading the EDID list, the external device can understand the display capability of the interactive flat panel and adaptively adjust the resolution of the output audio and video data.

[0181] Write the HDMI information obtained from the driver into the rx register, which is a hardware register used to store the HDMI information of the interactive panel.

[0182] Write the edid list obtained from the driver to the edid register. Similarly, the edid register is a hardware register used to store the EDID list of the interactive panel.

[0183] Furthermore, the target external device corresponding to the second signal input selection interface reads the HDMI information and the edid list through the rx register and then sends the corresponding audio and video data.

[0184] By calling the driver to obtain the HDMI information and edid list of the second signal input selection interface, and writing the relevant information into the corresponding register, the external device corresponding to the second signal input selection interface can read the HDMI information and edid list of the interactive flat panel through the rx register and send the corresponding audio and video data. This is conducive to transmitting the correct audio and video data after switching the signal input interface.

[0185] Optionally, in this embodiment, when it is detected that the second signal input selection interface is disconnected from the target external device, the rx register, the second switch register, and the edid register are reset to avoid residual information causing abnormality in the next connection.

[0186] Optionally, in this embodiment, when it is detected that the signal input interface is disconnected from the external device, the video playback window is closed and the cached video signal and audio signal are cleared, so as to avoid residual data causing anomalies during the next connection.

[0187] Please refer to Fig.12 The interactive tablet further includes a digital signal processor 700, a second audio signal output interface 800, a power amplifier component 900 and a speaker interface 1000. The central processor 200 is connected to the digital signal processor 700 via the second audio signal output interface 800, and the digital signal processor 700 is connected to the speaker interface 1000 via the power amplifier component 900;

[0188] The first audio signal in digital format in the central processing unit 200 is transmitted to the digital signal processor 700 via the second audio signal output interface 800. The first audio signal is converted into a second audio signal in I2S format by the digital signal processor 700. The second audio signal is transmitted to the external speaker via the power amplifier component 900 and the speaker interface 1000 in turn.

[0189] In this embodiment, the signal format of the first audio signal is converted by a digital signal processor, so that the audio and video data of the external device can be played on the interactive tablet based on the central processing unit platform.

[0190] Please continue to refer to Fig.12The interactive tablet also includes a camera interface 1100 and a microphone interface 1200 , wherein the camera interface 1100 is connected to the central processor 200 , and the microphone interface 1200 is connected to the digital signal processor 700 .

[0191] The video signal in MIPI format obtained by the camera device is transmitted to the central processor 200 through the camera interface 1100 .

[0192] The third audio signal in PDM format obtained by the microphone device is transmitted to the digital signal processor 700 via the microphone interface 1200. The digital signal processor 700 converts the third audio signal in PDM format into a fourth audio signal in digital format, improves the audio quality, and transmits it to the central processor 200 via the second audio signal output interface 800.

[0193] Optionally, after receiving the audio signal, the central processor determines that the current audio signal needs to be played, and transmits the audio signal to the signal processor 700 through the second audio signal output interface 800, converts it into a second audio signal in I2S format, and transmits the second audio signal to the external speaker via the power amplifier component 900 and the speaker interface 1000.

[0194] In this embodiment, the video signal collected by the camera device and the third audio signal collected by the microphone device are sent to the central processor through the camera interface and the microphone interface of the interactive tablet.

[0195] Please refer to Fig.13 The interactive tablet also includes a screen display component 1300, which is connected to the central processor 200. The central processor converts the video signal into a screen display signal, and sends the screen display signal to the touch screen through the screen display component.

[0196] In this embodiment, the video signal is transmitted to the touch screen through the screen display component, so that the video is played on the touch screen.

[0197] Please continue to refer to Fig.13 In this embodiment, the display component 1300 further includes a power supply circuit 1301, a backlight interface 1302 and a display interface 1303. The power supply circuit 1301 is connected to the central processor 200 and the backlight interface 1302 respectively, and the display interface 1303 is connected to the central processor 200.

[0198] The video signal in MIPI format is processed into an eDP signal by the CPU 200. The eDP signal refers to a video signal transmitted through an Embedded DisplayPort (eDP) interface. The eDP signal is transmitted to the display screen of the touch screen via the display interface 1303, and the video signal transmitted by the CPU 200 is played on the display screen.

[0199] The backlight adjustment signal associated with the video signal processed by the CPU 200 is converted into a control signal via the power supply circuit 1301, and the control signal is transmitted to the backlight device of the touch screen via the backlight interface 1302. The brightness of the backlight device is adjusted according to the received control signal.

[0200] The backlight adjustment signal includes a BLON signal and a PWM signal. The backlight device is usually composed of an LED (Light Emitting Diode) or other backlight source. The brightness of the backlight device can be controlled by adjusting the current or using pulse width modulation (PWM) technology.

[0201] Among them, the BLON signal is used to control the on / off state of the backlight. When the BLON signal is received, the backlight device will turn on and provide a bright background. The PWM signal (Pulse Width Modulation) is used to control the brightness level of the backlight. The power supply circuit can determine the brightness of the backlight device based on the duty cycle of the PWM signal.

[0202] In this embodiment, the backlight adjustment signal associated with the video signal is converted into a control signal by the power supply circuit, so that the backlight device controls the brightness and operation of the backlight lamp according to the control signal.

[0203] The embodiment of the present application further provides an interactive tablet, the interactive tablet comprising a touch screen, a central processing unit, a micro control unit and a first external interface, the first external interface comprising a touch output interface, the central processing unit comprising a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen via the first USB interface, the central processing unit is connected to the micro control unit via the first SPI interface, the micro control unit comprises a second USB interface, the micro control unit is connected to the touch output interface via the second USB interface, and the central processing unit is configured as follows:

[0204] receiving, through the first USB interface, first touch data in a USB format sent by the touch screen;

[0205] confirming a display channel of the interactive tablet, and when the display channel is a local channel, performing a touch response to the first touch data;

[0206] When the display channel is an external channel, continue to perform the following steps;

[0207] confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data;

[0208] Confirming that the first touch data does not meet the preset conditions, converting the first touch data into an SPI signal and outputting it from the first SPI interface; allowing the microcontroller unit to convert the SPI signal into second touch data in a USB format, and then outputting the second touch data from the touch output interface to a connected external device, so that the external device performs a touch response.

[0209] In the embodiment of the present application, when the first touch data of the touch screen is received and it is determined that the display channel of the interactive tablet is a local channel, or when the display channel is an external channel and it is determined that the first touch data meets the preset conditions, the first touch data is sent to the central processor, and the central processor performs a touch response; when the display channel is an external channel and it is determined that the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device through the output interface, and the external device performs a touch response. The interactive tablet using the central processor as the core component can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of the external device, the touch data triggered by the display content can be sent to the external device, and the external device performs a touch response. The scheme has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of the interactive tablet based on the central processor platform.

[0210] The embodiment of the present application provides an interactive tablet, the interactive tablet includes a touch screen, a central processing unit, a first signal conversion circuit, a micro control unit and an output interface, the first signal conversion circuit includes a format conversion circuit, a first video signal output interface and a first audio signal output interface, the first signal conversion circuit is connected to an external device, the first signal conversion circuit is connected to the central processing unit through the first video signal output interface and the first audio signal output interface, the central processing unit is connected to the touch screen, the central processing unit also includes a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen through the first USB interface, the central processing unit is connected to the micro control unit through the first SPI interface, the micro control unit includes a second USB interface, the micro control unit is connected to the output interface through the second USB interface, and the central processing unit is configured to:

[0211] Receiving the audio and video data in HDMI format of the external device through the first signal conversion circuit;

[0212] Using the format conversion circuit to convert the video data of the audio and video data into a video signal in MIPI format, and to convert the audio data of the audio and video data into an audio signal in digital format;

[0213] Sending the audio signal to a central processing unit through the first audio signal output interface, and sending the video signal to the central processing unit through the first video signal output interface;

[0214] When the display channel is an external channel, the central processor runs a playback program to create a video playback window to output the video signal, and a speaker is used to output the audio signal;

[0215] receiving, through the first USB interface, first touch data in a USB format sent by the touch screen;

[0216] confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor;

[0217] Confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal through the central processor, and outputting the signal from the first SPI interface;

[0218] After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

[0219] In the embodiment of the present application, when the first touch data of the touch screen is received and it is determined that the display channel of the interactive tablet is a local channel, or when the display channel is an external channel and it is determined that the first touch data meets the preset conditions, the first touch data is sent to the central processor, and the central processor performs a touch response; when the display channel is an external channel and it is determined that the first touch data does not meet the preset conditions, the first touch data is converted and transmitted to the external device through the output interface, and the external device performs a touch response. The interactive tablet using the central processor as the core component can meet the needs of users to install complex and diverse Windows applications, and also realizes that when playing the display content of the external device, the touch data triggered by the display content can be sent to the external device, and the external device performs a touch response. The scheme has high compatibility, low hardware cost, and low adaptation development cost, which reduces the cost of the interactive tablet based on the central processor platform.

[0220] An embodiment of the present application further provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the method described in any one of the above embodiments are implemented.

[0221] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0222] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A method for playing audio and video data, characterized in that: The invention is applied to an interactive tablet, the interactive tablet comprises a touch screen, a central processing unit, a first signal conversion circuit, a micro control unit and an output interface, the first signal conversion circuit comprises a format conversion circuit, a first video signal output interface and a first audio signal output interface, the first signal conversion circuit is connected to an external device, the first signal conversion circuit is connected to the central processing unit through the first video signal output interface and the first audio signal output interface, the central processing unit is connected to the touch screen, the central processing unit further comprises a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen through the first USB interface, the central processing unit is connected to the micro control unit through the first SPI interface, the micro control unit comprises a second USB interface, and the micro control unit is connected to the output interface through the second USB interface, and the method comprises: Receiving the audio and video data in HDMI format of the external device through the first signal conversion circuit; Using the format conversion circuit to convert the video data of the audio and video data into a video signal in MIPI format, and to convert the audio data of the audio and video data into an audio signal in digital format; Sending the audio signal to a central processing unit through the first audio signal output interface, and sending the video signal to the central processing unit through the first video signal output interface; When the display channel is an external channel, the central processor runs a playback program to create a video playback window to output the video signal, and a speaker is used to output the audio signal; receiving, through the first USB interface, first touch data in a USB format sent by the touch screen; confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor; Confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal through the central processor, and outputting the signal from the first SPI interface; After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

2. The method according to claim 1, characterized in that After receiving the first touch data in USB format sent by the touch screen through the first USB interface, the method further includes: When the display channel is a local channel, the central processor performs a touch response to the first touch data.

3. The method according to claim 1, characterized in that The first signal conversion circuit also includes a switching switch and a signal input interface. The signal input interface is connected to the switching switch, and the signal input interface is also connected to the external device. The switching switch is connected to the format conversion circuit, and the format conversion circuit is also connected to the central processing unit. There are one or more signal input interfaces.

4. The method according to claim 3, characterized in that The step of receiving the audio and video data in HDMI format of the external device through the first signal conversion circuit and sending the audio and video data to the first signal conversion circuit further includes: Determine that the plurality of signal input interfaces are respectively connected to different external devices, and display selection information of the signal input interfaces on the touch screen through the central processor; Receiving, by the central processor, confirmation information triggered by the user based on the selection information, and calling the central processor to run a switching program according to the confirmation information; The switching program controls the switching switch to connect to the signal input interface corresponding to the determination information.

5. The method according to claim 4, characterized in that The determining that the plurality of signal input interfaces are respectively connected to different external devices, and displaying selection information of the signal input interfaces on the touch screen by the central processor, includes: Calling a driver of a central processing unit to access switch registers corresponding to the plurality of signal input interfaces respectively, and obtaining detection bit information of the switch registers; Acquire a first switch register whose detection bit information changes, and determine that an external device is connected to a first signal input selection interface corresponding to the first switch register, wherein the first switch register is one or more; Acquire identification information of the first switch register, and display selection information of the identification information on the touch screen; The controlling the signal switching switch to connect to the signal input interface corresponding to the determination information through the switching program includes: The selected second switch register is acquired based on the determination information, and the signal switching switch is controlled by the switching program to connect to the second signal input selection interface corresponding to the second switch register.

6. The method according to claim 5, characterized in that After the signal switching switch is controlled by the switching program to connect to the signal input interface corresponding to the determination information, the method further includes: Calling a driver of the central processing unit to obtain HDMI information and edid list of the second signal input selection interface, and writing the HDMI information into the rx register; The edid list is written into the edid register, and the address of the edid register is written into the rx register, so that the target external device corresponding to the second signal input selection interface reads the HDMI information and the edid list through the rx register and then sends the corresponding audio and video data.

7. The method according to claim 6, characterized in that After the central processor runs a playback program to create a video playback window to output the video signal, and a speaker is used to output the audio signal, the method further includes: When it is detected that the second signal input selection interface is disconnected from the target external device, the rx register, the second switch register, and the edid register are reset.

8. The method according to claim 3, characterized in that After the central processor runs a playback program to create a video playback window to play the video signal and sends the audio signal to a speaker for playback, the method further includes: When it is detected that the signal input interface is disconnected from the external device, the video play window is closed, and the cached video signal and audio signal are cleared.

9. The method according to claim 1, characterized in that: The step of running a playback program through the central processor to create a video playback window to output the video data includes: The video signal is rendered, and a video playback window is created by running a playback program through the central processor to output the rendered video signal.

10. The method according to claim 1, characterized in that The method further comprises: When playing the video signal, the preset operation is intercepted.

11. The method according to claim 1, characterized in that: The preset condition includes being located in a preset area, the interactive tablet displays a sidebar interface in the preset area, and confirming that the first touch data meets the preset condition, and performing a touch response according to the first touch data by the central processor, specifically: Confirm that the first touch data is within a preset area, perform a touch response according to the first touch data through the central processor, open the sidebar application, and display the sidebar interface.

12. The method according to claim 1, characterized in that The preset condition includes a preset interactive action, and the confirming that the first touch data meets the preset condition and performing a touch response according to the first touch data by the central processor are specifically: It is confirmed that the first touch data conforms to the preset interactive action, and the central processor performs a touch response according to the first touch data to open a global application corresponding to the preset interactive action.

13. The method according to claim 1, characterized in that The interactive tablet further includes a USB switch, the output interface further includes a data output interface, the first switch interface of the USB switch is connected to the central processor, the second switch interface of the USB switch is connected to the data output interface, the USB switch is also connected to an external USB device, and the touch feedback method includes: When the display channel is a local channel, controlling the USB switch to connect to the first switching interface, and sending the storage data of the external USB device to the central processor; When the display channel is an external channel, the USB switch is controlled to connect to the second switching interface, and the storage data of the external USB device is sent to the external device through the data output interface.

14. The method according to claim 1, characterized in that The central processing unit is configured as a master device, and the micro control unit is configured as a slave device.

15. An interactive tablet, characterized in that: The interactive tablet comprises a touch screen, a central processing unit, a first signal conversion circuit, a micro control unit and an output interface, wherein the first signal conversion circuit comprises a format conversion circuit, a first video signal output interface and a first audio signal output interface, the first signal conversion circuit is connected to an external device, the first signal conversion circuit is connected to the central processing unit through the first video signal output interface and the first audio signal output interface, the central processing unit is connected to the touch screen, the central processing unit further comprises a first USB interface and a first SPI interface, the central processing unit is connected to the touch screen through the first USB interface, the central processing unit is connected to the micro control unit through the first SPI interface, the micro control unit comprises a second USB interface, the micro control unit is connected to the output interface through the second USB interface, and the central processing unit is configured to: Receiving the audio and video data in HDMI format of the external device through the first signal conversion circuit; Using the format conversion circuit to convert the video data of the audio and video data into a video signal in MIPI format, and to convert the audio data of the audio and video data into an audio signal in digital format; Sending the audio signal to a central processing unit through the first audio signal output interface, and sending the video signal to the central processing unit through the first video signal output interface; When the display channel is an external channel, the central processor runs a playback program to create a video playback window to output the video signal, and a speaker is used to output the audio signal; receiving, through the first USB interface, first touch data in a USB format sent by the touch screen; confirming that the first touch data meets a preset condition, and performing a touch response according to the first touch data by the central processor; Confirming that the first touch data does not meet a preset condition, converting the first touch data into an SPI signal through the central processor, and outputting the signal from the first SPI interface; After the microcontroller converts the SPI signal into second touch data in USB format, the second touch data is output from the output interface to a connected external device, and the external device performs a touch response.

Images