Interaction peripheral, interaction method and device, interaction panel and storage medium

Abstract

The embodiment of the invention discloses an interaction peripheral, an interaction method, an interaction device, an interaction panel and a storage medium. A touch module and a physical control are arranged in a shell of the interactive peripheral, a wireless communication module, a position sensor and a controller are arranged in the shell, and signals detected by the touch module, the physical control and the position sensor are processed into operation data by the controller and then sent to an interactive panel through the wireless communication module. The interactive panel displays a control window on the basis of the current display content or updates an undetermined selection state in the control window according to the current display content and the matching relationship between the operation data and the current display content, so that the presentation file is displayed in the process of displaying the presentation file by using the interactive panel; and complex control on the presentation file is accurately and quickly realized.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of software interaction technology, and in particular to interactive peripherals, interactive methods, devices, interactive tablets, and storage media. Background Art

[0002] With the continuous development and popularization of information technology, various types of terminal devices continue to emerge, and the communication methods between terminal devices are becoming increasingly diverse. The rich and diverse communication methods and terminal devices provide strong technical support for various types of communication between people. For example, in an electronic conference room built based on information technology, a variety of peripheral devices such as microphones, speakers, mice, keyboards, and screen transmitters are configured around an interactive tablet. During multi-person communication activities based on the electronic conference room, the peripheral devices are connected to the interactive tablet and cooperate with the interactive tablet to realize the collection, transmission, and presentation of information during the multi-person communication process. In multi-person communication conducted with the interactive tablet as the hardware center to display presentations, convenient and flexible control of the presentation is an important support for multi-person communication. Existing interactive peripherals such as air mice and remote control pens are often based on the mouse's interactive logic or define the function trigger of a single button to achieve basic interactive control of the presentation while maintaining a spatial distance from the interactive tablet.

[0003] When the inventor used the existing method to interactively control the presentation, he found that the operation accuracy of the interactive control based on the air mouse was low, and the function triggering of a single button could only realize simple functions such as turning pages. The existing method could not accurately and quickly realize complex control of the presentation on the interactive tablet. Summary of the Invention

[0004] The present invention provides an interactive peripheral, an interactive method, an interactive device, an interactive tablet and a storage medium to solve the technical problem that the existing method cannot accurately and quickly realize complex control of presentations on the interactive tablet.

[0005] In a first aspect, an embodiment of the present application provides an interactive peripheral device, which includes a housing, a touch module, physical controls, a wireless communication module, a posture sensor device, and a controller;

[0006] The touch module and physical controls are arranged in the housing, and the wireless communication module, posture sensor device and controller are arranged inside the housing;

[0007] The signal output ends of the touch module, physical controls and position sensor devices are all connected to the signal input ends of the controller; the data output end of the controller is connected to the internal interface of the wireless communication module, which is used to generate operation data based on the signals received from the touch module, physical controls and position sensor devices, and send the operation data outward through the wireless communication module.

[0008] As described above, the interactive peripheral is provided with a touch module and physical controls in the shell, and a wireless communication module, a posture sensor device and a controller are provided inside the shell. The signals detected by the touch module, physical controls and position sensor are processed by the controller into operation data and then sent to the interactive flat panel through the wireless communication module. When the interactive peripheral is used to control the presentation displayed on the interactive flat panel, the interactive flat panel displays the control window according to the matching relationship between the current display content and the operation data and the current display content, and on the basis of the current display content, according to the operation data, or updates the pending selection status in the control window, thereby realizing accurate and fast complex control of the presentation.

[0009] In a second aspect, an embodiment of the present application provides an interaction method, which is used for an interactive tablet configured with the interactive peripheral device of the first aspect; the interaction method includes:

[0010] displaying the presentation and receiving first operation data sent by the interactive peripheral device via a wireless communication link;

[0011] In the case where the first operation data is first-category operation data, a control window corresponding to the first operation data is displayed, and second operation data sent by the interactive peripheral device is received; the first-category operation data is operation data that triggers a state selection control, and the control window is used to display an alternative state corresponding to the state selection control;

[0012] In the case where the second operation data is second type operation data, updating the pending selection state in the control window according to the second operation data, the second type operation data being operation data for controlling state switching of the control window;

[0013] When it is determined that a status confirmation event exists, the display content of the presentation is updated according to the pending selection status.

[0014] As mentioned above, the interactive peripheral is provided with a touch module and physical controls in the shell, and a wireless communication module, a posture sensor device and a controller are provided inside the shell. When the interactive peripheral is used in conjunction with the interactive tablet, the signals detected by the touch module, physical controls and position sensor are processed by the controller into operation data and then sent to the interactive tablet through the wireless communication module. On the basis of displaying the presentation, the interactive tablet displays a control window based on the current display content or updates the pending selection status in the control window according to the matching relationship between the current display content and the operation data and the current display content, thereby realizing accurate and fast complex control of the presentation in the process of using the interactive tablet to display the presentation.

[0015] Wherein, when the first operation data is first-category operation data, displaying a control window corresponding to the first operation data and receiving second operation data sent by the interactive peripheral device include:

[0016] In a case where the first operation data is the preset first touch operation data, a title navigation window of the presentation is displayed, and second operation data sent by the interactive peripheral is received, the title navigation window is used to display the titles of all pages corresponding to the presentation, and the title of the currently displayed presentation page is highlighted in the title navigation window;

[0017] Accordingly, when the second operation data is the second type of operation data, updating the pending selection state according to the second operation data in the control window includes:

[0018] In a case where the second operation data is operation data of a posture sensor device or a physical scroll wheel, switching the highlighted title in the title navigation window according to the second operation data;

[0019] Accordingly, when it is determined that a status confirmation event exists, the display content of the presentation is updated according to the pending selection state, including:

[0020] When it is confirmed that the preset second touch operation data has been received or no operation data has been received within the first preset time period, the title navigation window is closed and the presentation page corresponding to the highlighted title is displayed.

[0021] As described above, when the preset first touch operation data is received in the normal display state, the title navigation window is displayed, and the highlighted title is updated according to the operation data of the posture sensor device or physical roller received subsequently, until the navigation is exited or the displayed page is confirmed, thereby realizing rapid jump switching of the presentation page.

[0022] Wherein, when the first operation data is first-category operation data, displaying a control window corresponding to the first operation data and receiving second operation data sent by the interactive peripheral device include:

[0023] In the case where the first operation data is preset annotation triggering operation data, the annotation window is displayed on top, and the second operation data sent by the interactive peripheral device is received;

[0024] Accordingly, when the second operation data is the second type of operation data, updating the pending selection state according to the second operation data in the control window includes:

[0025] In a case where the second operation data is operation data of the posture sensor device and a preset annotation holding operation, updating the annotation handwriting in the annotation window according to the operation data of the posture sensor device;

[0026] Accordingly, when it is determined that a status confirmation event exists, the display content of the presentation is updated according to the pending selection state, including:

[0027] When it is confirmed that the annotation holding operation is completed, the updating of the annotation handwriting is completed, and the annotation handwriting is kept displayed in the annotation window.

[0028] As described above, when the preset annotation trigger operation data is received in the normal presentation display state, the annotation window is displayed on top, and the annotation handwriting in the annotation window is updated according to the subsequent received posture sensor device and annotation hold operation data, thereby realizing rapid annotation in the presentation.

[0029] Wherein, when the first operation data is first-category operation data, displaying a control window corresponding to the first operation data and receiving second operation data sent by the interactive peripheral device include:

[0030] In the case where the first operation data is preset annotation triggering operation data, the annotation window is displayed on top, and the second operation data sent by the interactive peripheral device is received;

[0031] Accordingly, when the second operation data is the second type of operation data, updating the pending selection state according to the second operation data in the control window includes:

[0032] In a case where the second operation data is operation data of the posture sensor device and a preset annotation holding operation, updating the annotation handwriting in the annotation window according to the operation data of the posture sensor device;

[0033] Accordingly, when it is determined that a status confirmation event exists, the display content of the presentation is updated according to the pending selection state, including:

[0034] When it is confirmed based on the operation data of the posture sensor device that the interactive peripheral stops moving and the annotation hold operation continues, the update of the annotation handwriting is terminated, the annotation handwriting that matches the preset standard graphic is converted into the corresponding standard graphic and displayed in the annotation window, and the annotation handwriting that does not match the preset standard graphic remains displayed in the annotation window.

[0035] As mentioned above, when the preset annotation trigger operation data is received in the normal presentation display state, the annotation window is displayed on top, and the annotation handwriting in the annotation window is updated according to the subsequent received posture sensor device and annotation hold operation data. At the end of the annotation, different annotations are displayed according to the annotation handwriting, thereby realizing fast annotation in the presentation and fast drawing of specific graphics.

[0036] Wherein, when the first operation data is first-category operation data, displaying a control window corresponding to the first operation data and receiving second operation data sent by the interactive peripheral device include:

[0037] In the case where the first operation data is the operation data of the physical scroll wheel, a cursor selection window is displayed on top, and second operation data sent by the interactive peripheral is received, the cursor selection window displays selectable cursor modes, and the currently used cursor mode is highlighted in the cursor selection window;

[0038] Accordingly, when the second operation data is the second type of operation data, updating the pending selection state according to the second operation data in the control window includes:

[0039] In a case where the second operation data is operation data of a physical wheel, switching a highlighted cursor mode in the cursor selection window according to the operation data of the physical wheel;

[0040] Accordingly, when it is determined that a status confirmation event exists, the display content of the presentation is updated according to the pending selection state, including:

[0041] When it is confirmed that no operation data of the physical wheel is received within the second preset time period, the cursor selection window is closed, and the highlighted cursor mode is configured as a subsequent presentation mode of the cursor.

[0042] As mentioned above, when the operation data of the physical scroll wheel is received in the normal presentation display state, the cursor selection window is displayed on the top, and the cursor selection window presents multiple cursor modes. When the operation data of the physical scroll wheel continues to be received, the cursor mode to be selected is updated, and the corresponding configuration is performed when the cursor mode to be selected is confirmed, thereby accurately and conveniently realizing the switching of the cursor mode, and quickly meeting the different cursor usage needs of users.

[0043] The cursor switches synchronously with the cursor mode highlighted in the cursor selection window.

[0044] As described above, the cursor effect is synchronously presented during the cursor selection process to realize interactive effect reminders and interactive guidance.

[0045] The cursor mode includes a focus mode, in which the cursor is displayed as a hollow circle;

[0046] Correspondingly, the interaction method also includes:

[0047] When the current mode of the cursor is the focus mode and the first operation data is preset zoom operation data, adjusting the diameter of the hollow circle according to the zoom operation data;

[0048] In case of receiving the preset viewing operation data, the image of the area of ​​the presentation corresponding to the hollow circle is magnified and displayed;

[0049] When the preset cancel operation data is received, the enlarged display area image is canceled.

[0050] As described above, through the focus mode of the cursor, it is possible to accurately and quickly control partial zooming in to view page information, thereby improving the pertinence of information presentation.

[0051] In a third aspect, an embodiment of the present application further provides an interactive device for an interactive tablet, wherein the interactive tablet is configured with the interactive peripheral device of the first aspect; the interactive device includes:

[0052] A presentation display unit, configured to display the presentation and receive first operation data sent by the interactive peripheral device via a wireless communication link;

[0053] a control window display unit, configured to display a control window corresponding to the first operation data and receive second operation data sent by the interactive peripheral device when the first operation data is first-category operation data; the first-category operation data is operation data that triggers a state selection control, and the control window is configured to display an alternative state corresponding to the state selection control;

[0054] a selection state updating unit configured to update the pending selection state in the control window according to the second operation data when the second operation data is second type operation data, the second type operation data being operation data for controlling state switching of the control window;

[0055] The display content updating unit is used to update the display content of the presentation according to the pending selection state when it is determined that there is a state confirmation event.

[0056] As mentioned above, the interactive peripheral is provided with a touch module and physical controls in the shell, and a wireless communication module, a posture sensor device and a controller are provided inside the shell. When the interactive peripheral is used in conjunction with the interactive tablet, the signals detected by the touch module, physical controls and position sensor are processed by the controller into operation data and then sent to the interactive tablet through the wireless communication module. On the basis of displaying the presentation, the interactive tablet displays a control window based on the current display content or updates the pending selection status in the control window according to the matching relationship between the current display content and the operation data and the current display content, thereby realizing accurate and fast complex control of the presentation in the process of using the interactive tablet to display the presentation.

[0057] The control window display unit includes:

[0058] a first window display module, configured to display a title navigation window of the presentation when the first operation data is the preset first touch operation data, and receive second operation data sent by the interactive peripheral device, wherein the title navigation window is configured to display titles of all pages corresponding to the presentation, with the title of the currently displayed presentation page being highlighted in the title navigation window;

[0059] Accordingly, select the status update unit, including:

[0060] A first state updating module is configured to switch the highlighted title in the title navigation window according to the second operation data when the second operation data is operation data of a posture sensor device or a physical scroll wheel;

[0061] Correspondingly, the display content updating unit includes:

[0062] The display page update module is used to close the title navigation window and display the presentation page corresponding to the highlighted title when it is confirmed that the preset second touch operation data has been received or no operation data has been received within the first preset time period.

[0063] As described above, when the preset first touch operation data is received in the normal display state, the title navigation window is displayed, and the highlighted title is updated according to the operation data of the posture sensor device or physical roller received subsequently, until the navigation is exited or the displayed page is confirmed, thereby realizing rapid jump switching of the presentation page.

[0064] The control window display unit includes:

[0065] A second window display module is configured to, when the first operation data is preset annotation triggering operation data, display the annotation window on top and receive second operation data sent by the interactive peripheral device;

[0066] Accordingly, select the status update unit, including:

[0067] A second state updating module is configured to update the annotation handwriting in the annotation window according to the operation data of the posture sensor device when the second operation data is the operation data of the posture sensor device and a preset annotation holding operation;

[0068] Correspondingly, the display content updating unit includes:

[0069] The annotation handwriting updating module is used to end the updating of the annotation handwriting and keep displaying the annotation handwriting in the annotation window when confirming that the annotation holding operation is ended.

[0070] As described above, when the preset annotation trigger operation data is received in the normal presentation display state, the annotation window is displayed on top, and the annotation handwriting in the annotation window is updated according to the subsequent received posture sensor device and annotation hold operation data, thereby realizing rapid annotation in the presentation.

[0071] The control window display unit includes:

[0072] A second window display module is configured to, when the first operation data is preset annotation triggering operation data, display the annotation window on top and receive second operation data sent by the interactive peripheral device;

[0073] Accordingly, select the status update unit, including:

[0074] A second state updating module is configured to update the annotation handwriting in the annotation window according to the operation data of the posture sensor device when the second operation data is the operation data of the posture sensor device and a preset annotation holding operation;

[0075] Correspondingly, the display content updating unit includes:

[0076] The handwriting classification update module is used to end the update of the annotation handwriting when it is confirmed based on the operation data of the posture sensor device that the interactive peripheral has stopped moving and the annotation hold operation continues, convert the annotation handwriting that matches the preset standard graphic into the corresponding standard graphic and display it in the annotation window, and keep the annotation handwriting that does not match the preset standard graphic displayed in the annotation window.

[0077] As mentioned above, when the preset annotation trigger operation data is received in the normal presentation display state, the annotation window is displayed on top, and the annotation handwriting in the annotation window is updated according to the subsequent received posture sensor device and annotation hold operation data. At the end of the annotation, different annotations are displayed according to the annotation handwriting, thereby realizing fast annotation in the presentation and fast drawing of specific graphics.

[0078] The control window display unit includes:

[0079] a third window display module, configured to, when the first operation data is operation data of a physical scroll wheel, display a cursor selection window on top and receive second operation data sent by the interactive peripheral, wherein the cursor selection window displays selectable cursor modes, and the currently used cursor mode is highlighted in the cursor selection window;

[0080] Accordingly, select the status update unit, including:

[0081] a third state updating module, configured to, when the second operation data is operation data of a physical wheel, switch a highlighted cursor mode in the cursor selection window according to the operation data of the physical wheel;

[0082] Correspondingly, the display content updating unit includes:

[0083] The cursor type updating module is used to close the cursor selection window and configure the highlighted cursor mode as the subsequent presentation mode of the cursor when confirming that no operation data of the physical scroll wheel is received within a second preset time period.

[0084] As mentioned above, when the operation data of the physical scroll wheel is received in the normal presentation display state, the cursor selection window is displayed on the top, and the cursor selection window presents multiple cursor modes. When the operation data of the physical scroll wheel continues to be received, the cursor mode to be selected is updated, and the corresponding configuration is performed when the cursor mode to be selected is confirmed, thereby accurately and conveniently realizing the switching of the cursor mode, and quickly meeting the different cursor usage needs of users.

[0085] The cursor switches synchronously with the cursor mode highlighted in the cursor selection window.

[0086] As described above, the cursor effect is synchronously presented during the cursor selection process to realize interactive effect reminders and interactive guidance.

[0087] The cursor mode includes a focus mode, in which the cursor is displayed as a hollow circle;

[0088] Correspondingly, the interactive device further includes:

[0089] a cursor diameter adjustment unit, configured to adjust the diameter of the hollow circle according to the zoom operation data when the current mode of the cursor is the focus mode and the first operation data is the preset zoom operation data;

[0090] A region enlargement display unit, configured to enlarge and display a region image corresponding to the hollow circle of the presentation document upon receiving preset viewing operation data;

[0091] The area enlargement cancelling unit is configured to cancel the enlarged display area image when receiving preset cancelling operation data.

[0092] As described above, through the focus mode of the cursor, it is possible to accurately and quickly control partial zooming in to view page information, thereby improving the pertinence of information presentation.

[0093] In a fourth aspect, the present application also provides an interactive tablet, including:

[0094] one or more processors;

[0095] a memory for storing one or more computer programs;

[0096] When one or more computer programs are executed by one or more processors, the interactive tablet implements any interactive method as described in the second aspect.

[0097] In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, it implements any interactive method as described in the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0098] Figure 1A flowchart of an interactive method provided in an embodiment of the present application.

[0099] Figure 2 Schematic diagram of the desktop of an interactive tablet in related art.

[0100] Figure 3 This is a structural diagram of the interactive peripherals in an embodiment of the present application.

[0101] Figure 4 This is a schematic diagram of the usage status of the interactive peripherals in the embodiment of the present application.

[0102] Figure 5 A diagram showing the interface of a presentation on an interactive tablet.

[0103] Figure 6 A schematic diagram of an interface for displaying a title navigation window in the interactive method provided in an embodiment of the present application.

[0104] Figure 7 A schematic diagram of the process of switching highlighted titles in the interactive method provided in an embodiment of the present application.

[0105] Figure 8 A schematic diagram of the interface after switching presentation pages in the interactive method provided in an embodiment of the present application.

[0106] Figure 9 A schematic diagram of an interface for displaying annotation handwriting in the interactive method provided in an embodiment of the present application.

[0107] Figure 10 A schematic diagram of an interface displaying standard graphics in the interactive method provided in an embodiment of the present application.

[0108] Figure 11 A schematic diagram of the interface of the cursor in normal mode in the interaction method provided in an embodiment of the present application.

[0109] Figure 12 A schematic diagram of the interface of the cursor in the afterimage mode in the interaction method provided in an embodiment of the present application.

[0110] Figure 13 A schematic diagram of the interface of the cursor in focus mode in the interactive method provided in an embodiment of the present application.

[0111] Figure 14 This is a schematic diagram of the interface of the first cursor selection window in the interactive method provided in an embodiment of the present application.

[0112] Figure 15 This is a schematic diagram of the interface of the second cursor selection window in the interactive method provided in an embodiment of the present application.

[0113] Figure 16A schematic diagram of the interface of the cursor in zoom focus mode in the interactive method provided in an embodiment of the present application.

[0114] Figure 17 A schematic diagram of an interface for enlarging a display area image in the interactive method provided in an embodiment of the present application.

[0115] Figure 18 A schematic diagram of the structure of the interactive device provided in an embodiment of the present application.

[0116] Figure 19 A schematic diagram of the structure of the interactive tablet provided in an embodiment of the present application. DETAILED DESCRIPTION

[0117] The present invention will be further described in detail below with reference to the accompanying drawings and examples. It will be understood that the specific embodiments described herein are intended to explain the present invention, not to limit the present invention. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions relevant to the present invention, not all structures.

[0118] It should be noted that due to space limitations, this application specification does not enumerate all optional implementation methods. After reading this application specification, those skilled in the art should be able to understand that as long as the technical features do not contradict each other, any combination of technical features can constitute an optional implementation method.

[0119] The following describes in detail the embodiments of the present invention.

[0120] For the existing terminal devices of various product forms, their data processing capabilities are usually sufficient to support multi-person communication. Terminal devices of various product forms can usually also support the needs of multi-person communication in one or more occasions. For example, mobile terminal devices such as mobile phones and tablets, personal computers such as laptops and desktops, and large-size tablet terminals designed for conference and education scenarios (hereinafter referred to as interactive tablets) are usually installed with various applications that support multi-person communication, such as conference applications, whiteboard applications, presentation applications, etc. Among them, the presentation application supports multi-person communication in two main stages. The first stage is before the multi-person communication begins, the user uses the presentation application to design and edit the presentation according to the content of the multi-person communication, the communication ideas, the characteristics of the participants, etc. The second stage is to display the edited presentation in full screen page by page. During the full-screen display process, the speaker combines his or her own expression to achieve comprehensive information output during the multi-person communication process.

[0121] In the process of multi-person communication based on a full-screen presentation displayed on a page-by-page basis, the display content of the presentation needs to change accordingly to adapt to the progress of the multi-person communication process, such as page switching, page annotation, key display, etc. In the relevant technology, an optical mouse-based operation is usually used to implement the corresponding operation. In the process of multi-person communication based on an interactive tablet, the speaker's range of movement is usually relatively flexible. In order to adapt to the characteristics of the speaker's activities in the multi-person communication scenario, an air mouse based on posture detection or a remote control pen is usually configured for the speaker to control the presentation. However, the air mouse does not have a highly static plane to constrain the operation process. Compared with operating an optical mouse in a two-dimensional plane, when operating an air mouse in the air in three-dimensional space, the user's control of the visual interactive mark (hereinafter exemplified as a cursor) is more erratic, and accordingly, it cannot provide the same precise operation experience as an optical mouse, and the interaction efficiency is low. The remote control pen can usually only provide relatively simple single function control, such as turning pages forward and backward. Overall, the existing methods cannot accurately and quickly achieve complex control of presentations on interactive tablets.

[0122] In response to the above technical problems, the embodiments of the present application propose to set a touch module and physical controls in the shell of the interactive peripheral device, and set a wireless communication module, posture sensor device and controller inside the shell. The signals detected by the touch module, physical controls and position sensor are processed by the controller into operation data and then sent to the interactive tablet through the wireless communication module. The interactive tablet displays a control window based on the current display content or updates the pending selection status in the control window according to the matching relationship between the current display content and the operation data and the current display content, thereby realizing accurate and fast complex control of the presentation when using the interactive tablet to display the presentation.

[0123] Figure 1 This is a flowchart of an interactive method provided in an embodiment of the present application, which is applied to an interactive tablet. In another embodiment of the present application, an interactive peripheral device is provided, which can be used in conjunction with an interactive tablet. In this embodiment of the present application, the interactive peripheral device is used to display a presentation on an interactive tablet.

[0124] Please refer to Figure 2 The interactive tablet 10 used in this solution can be an all-in-one device that uses touch technology to control content displayed on a display screen and implement human-computer interaction. It can integrate one or more functions such as a projector, electronic whiteboard, screen, audio, television, and video conferencing terminal. Of course, the interactive tablet 10 does not include any restrictions on the surface characteristics of the display surface. For example, the surface characteristics of the interactive tablet 10 can be flat, curved, or a combination of multiple flat surfaces. Figure 2The example shows the interface state of the interactive tablet 10 when displaying the whiteboard application, which contains multiple functional controls for implementing the whiteboard writing function. When the interactive tablet 10 displays the presentation page in full screen, you can use the annotation function of the presentation application to add annotations, or you can use the annotation application installed on the interactive tablet 10 to add writing on the upper layer of the presentation page. The annotation application can also have Figure 2 Similar functional controls as shown.

[0125] Typically, an interactive tablet is installed with at least one operating system, including but not limited to Android, Linux, Windows, and Huawei's Hongmeng OS. This operating system is used to control and coordinate the interactive tablet and peripheral devices, allowing the various independent hardware components of the interactive tablet to work together as a stable whole. The interactive tablet includes at least one display screen. For example, the interactive tablet is equipped with a touch-enabled display screen, i.e., a touch-sensitive display screen. This touch-sensitive display screen can be an infrared display screen, a capacitive display screen, a resistive display screen, an electromagnetic display screen, or a pressure-sensitive display screen. On a touch-enabled display screen, a user can perform touch operations by touching the display screen with a finger or a stylus. The interactive tablet detects the touch location and responds accordingly to implement the touch function. Different touch sensor modules are used on touch-enabled displays, and the original touch signals collected by the touch sensor modules are different, and the converted touch signals are also not identical. In interactive tablets, to quickly access commonly used functions without exiting the current page, sidebars are usually provided on both sides of the display screen. The sidebars display multiple functional controls, such as a camera control for launching the camera and a writing control for quickly starting writing.

[0126] For infrared displays, the touch sensor module is an infrared touch frame. The touch signal it collects may include a signal indicating that infrared rays are blocked. The converted touch signal may include a position touch signal, which may include the X and Y coordinates of the touch location. For capacitive displays, the touch sensor module is a capacitive touch pad. The touch signal it collects may include the current flowing through the electrodes of the touch screen. The converted touch signal may include a position touch signal, which may include the X and Y coordinates of the touch location. For resistive displays, the touch sensor module is a resistive touch pad. The touch signal it collects may include the voltage at the touch location. The converted touch signal may include a position touch signal, which may include the X and Y coordinates of the touch location. For electromagnetic displays, the touch sensor module is an electromagnetic pad. The touch signal it collects may include the change in magnetic flux and the frequency of the received electromagnetic signal. The converted touch signal may include a position touch signal corresponding to the change in magnetic flux and a pressure signal corresponding to the frequency. The position touch signal may include the X and Y coordinates of the touch location; the pressure signal may include a pressure value. For a pressure-sensitive display, the touch sensor module is a pressure sensor. The tactile signals it collects may include pressure signals, and the converted touch signals may include position touch signals. The position touch signals may include the X and Y coordinates of the touch location. In the embodiments of this application, the user's operation of the interactive tablet using an interactive peripheral device is described as an example. However, the user can also use related technologies based on the touch-sensitive display to directly interact with the interactive tablet.

[0127] like Figure 1 As shown, the interaction method includes but is not limited to steps S110 to S140:

[0128] Step S110: display the presentation, and receive first operation data sent by the interactive peripheral device via a wireless communication link.

[0129] A presentation is primarily used to convey information from a speaker to an audience in a multi-person communication setting. It can flexibly combine text, images, sound, video, animation, and other methods to achieve the best possible information delivery. The presentation itself is compiled and edited by the speaker. The content within the presentation is organized into pages, and during a formal presentation, one presentation page is typically displayed at a time. Displaying a presentation in this embodiment refers to the formal display of a single presentation page.

[0130] For an interactive tablet, various information can be received from the currently connected object through a wireless communication link. In the embodiment of the present application, what is received from the interactive peripheral is mainly various operation data, specifically the data generated by various components in the interactive peripheral that can be used for human-computer interaction due to user operations, such as the data of the pressing operation generated by the signal generated by the user pressing a button.

[0131] Please refer to Figure 3 , which is the basic structure of the interactive peripheral 20 in the embodiment of the present application, the interactive peripheral includes a shell, a touch module 21, physical controls, a wireless communication module, a posture sensor device and a controller; the touch module 21 and the physical controls are arranged in the shell, and the wireless communication module, the posture sensor device and the controller are arranged inside the shell; the signal output ends of the touch module 21, the physical controls and the posture sensor device are all connected to the signal input end of the controller; the data output end of the controller is connected to the internal interface of the wireless communication module, which is used to generate operation data based on the signals received from the touch module 21, the physical controls and the position sensor device, and send the operation data to the outside through the wireless communication module. The touch module 21 and the physical controls are arranged in the shell, specifically, they can be arranged on the surface of the shell, or they can be partially embedded in the shell after a hole is opened in the shell. For example, the touch module 21 is arranged on the surface of the shell or partially embedded in the shell, and is connected to the controller inside the shell through a corresponding connecting line; for another example, the physical controls are arranged on the surface of the shell or partially embedded in the shell, and are connected to the controller inside the shell through a corresponding connecting line. The specific arrangement of the touch module 21 and the physical controls in the housing is not limited, as long as the surfaces of the touch module 21 and the physical controls that are used for user operation are kept exposed as a whole.

[0132] As described above, the interactive peripheral is provided with a touch module and physical controls in the shell, and a wireless communication module, a posture sensor device and a controller are provided inside the shell. The signals detected by the touch module, physical controls and position sensor are processed by the controller into operation data and then sent to the interactive flat panel through the wireless communication module. When the interactive peripheral is used to control the presentation displayed on the interactive flat panel, the interactive flat panel displays the control window according to the matching relationship between the current display content and the operation data and the current display content, and on the basis of the current display content, according to the operation data, or updates the pending selection status in the control window, thereby realizing accurate and fast complex control of the presentation.

[0133] In a specific implementation process, the physical control includes one or more of a physical button, a physical scroll wheel, and a physical press scroll wheel. Figure 3The physical button 221 and the physical scroll wheel 222 are exemplarily presented in the figure. In addition, the posture sensor device includes a gyroscope and an accelerometer, so as to achieve accurate detection of the posture of the interactive peripheral 20. The wireless communication module is an infrared communication module or a Bluetooth communication module, so that the interactive peripheral 20 can send operation data to the interactive tablet. The interactive peripheral 20 can be configured with multiple wireless communication modules, but one of them is selected when actually sending operation data. The interactive peripheral 20 is used by the user in hand, and the handheld state is exemplified as follows: Figure 4 As shown, during use, the user can touch the touch module 21, click or long press the physical button 221, turn and rotate the physical wheel 222, move or rotate the interactive peripheral 20 as a whole, etc. For each operation, the corresponding component will detect the signal and send the signal to the controller to process it into operation data, and then send it out through the wireless communication module. From the overall product implementation, on the basis of the existing hardware of the air mouse, it is possible to add hardware that the air mouse does not originally have, such as the touch module 21 and physical controls, and reuse the hardware that the air mouse originally has, such as the processor and wireless communication module, to comprehensively realize the functions of the air mouse and the interactive peripheral 20 in this application. It is also possible to further add a mouse wheel, etc. on the basis of the interactive peripheral 20 in the embodiment of the present application, so that the interactive peripheral 20 has the function of an air mouse.

[0134] For an interactive tablet, as long as a wireless communication link has been established with an interactive peripheral device, the interactive peripheral device can receive the operation data through the wireless communication link after generating the operation data due to the user's operation. For an interactive tablet, different display contents have different response results corresponding to the same operation data. In the embodiment of the present application, a specific interaction process is designed for a scenario with a presentation as the display content. In this scenario, a combination of multiple strictly associated operation data is required to achieve complete functionality. For multiple strictly associated operation data, in a scenario with a presentation as the core display content, the operation data received corresponding to different display content stages are further divided into first operation data and second operation data, wherein the first operation data is the operation data received from the interactive peripheral device when only the presentation is displayed. That is, the first operation data and the second operation data may be the same in terms of data content, and the two are distinguished only by the different display stages at the time of reception.

[0135] Step S120: When the first operation data is the first type of operation data, the control window corresponding to the first operation data is displayed, and the second operation data sent by the interactive peripheral is received; the first type of operation data is the operation data for triggering the state selection control, and the control window is used to display the alternative state corresponding to the state selection control.

[0136] When displaying a presentation, it is not necessary to respond to all operation data, that is, not all first operation data will cause a change in the displayed content. In an embodiment of the present application, only the first type of operation data will cause a change in the displayed content, where the first type of operation data specifically refers to preset operation data that can trigger a certain state selection control. When such operation data is received, it is equivalent to the user needing to select one from multiple options as the final result. The corresponding response result to the first type of operation data is to display the corresponding control window. The control window is used to display the alternative state corresponding to the state selection control, that is, to display multiple options, of which one option is a pending selection state.

[0137] Step S130: when the second operation data is second type operation data, updating the pending selection state in the control window according to the second operation data, the second type operation data being operation data for controlling state switching of the control window.

[0138] In an embodiment of the present application, different control windows may have different control operations. The operation data corresponding to the control window is defined as second-category operation data according to the corresponding control operation. The specific data content of the second operation data may be multiple, but only the corresponding second-category operation data can affect the control window, that is, the first-category operation data and the second-category operation data have a high correspondence. When the second operation data does not correspond to the first-category operation data, it will not cause further display changes to the control window, but directly return to the state of displaying only the presentation. Only when the second operation data is the second-category operation data corresponding to the currently displayed control window, will the control window be controlled in response to the second-category operation data. Changes related to the control, that is, the pending selection state is updated.

[0139] Step S140: When it is determined that a status confirmation event exists, the display content of the presentation is updated according to the pending selection status.

[0140] A status confirmation event refers to the time when the current pending option is determined as the final selection. This can be a clear operation or a default without any operation. The specific updating of the presentation display content based on the pending selection status is generally the same as the interactive logic of related interactive technologies that adjust the display based on the options selected by the user, and will not be explained in detail here.

[0141] As mentioned above, the interactive peripheral is provided with a touch module and physical controls in the shell, and a wireless communication module, a posture sensor device and a controller are provided inside the shell. When the interactive peripheral is used in conjunction with the interactive tablet, the signals detected by the touch module, physical controls and position sensor are processed by the controller into operation data and then sent to the interactive tablet through the wireless communication module. On the basis of displaying the presentation, the interactive tablet displays a control window based on the current display content or updates the pending selection status in the control window according to the matching relationship between the current display content and the operation data and the current display content, thereby realizing accurate and fast complex control of the presentation in the process of using the interactive tablet to display the presentation.

[0142] The following are several exemplary interaction implementations provided based on the overall design concept in steps S120 to S140.

[0143] The first interactive implementation is an interactive implementation for quickly switching presentation pages. When the first operation data is the preset first touch operation data, the title navigation window of the presentation is displayed, and the second operation data sent by the interactive peripheral is received. The title navigation window is used to display the titles of all pages corresponding to the presentation, and the title of the currently displayed presentation page is highlighted in the title navigation window. When the second operation data is the operation data of the posture sensor device or the physical scroll wheel, the highlighted title in the title navigation window is switched according to the second operation data. When the preset second touch operation data is confirmed to be received or no operation data is received within the first preset time period, the title navigation window is closed and the presentation page corresponding to the highlighted title is displayed.

[0144] From the user interaction level, when the user needs to jump from the currently displayed presentation page to another presentation page, they can slide back and forth on the touch module multiple times. The touch module detects the operation signal, and the processor generates operation data based on the operation signal. For the interactive tablet, only the presentation page is displayed at this time. The operation data corresponds to the first operation data, and the operation data corresponds to the preset first touch operation data. The corresponding response is to display the title navigation window of the presentation. The title navigation window is now a control window with strictly corresponding second-type operation data, that is, the operation data of the posture sensor device or the physical scroll wheel. When the corresponding second-type operation data is received, the highlighted title is switched in the title navigation window according to the second-type operation data (that is, the most recently received second operation data). When the status confirmation event continues to be received (such as the preset second touch operation data or no operation data is received within the first preset time period), the title navigation window is closed and the presentation page corresponding to the highlighted title is switched.

[0145] The interface changes implemented by the first interaction can be referred to Figure 5 、 Figure 6 、 Figure 7 and Figure 8 ,exist Figure 5 Only one presentation page 11 is displayed in Figure 5 When receiving the preset first touch operation data based on Figure 6 As shown, a title navigation window 112 is displayed, which not only displays the title of each presentation page, but also displays possible quick jump pages. A title is highlighted in the title navigation window 112, and a cursor 111 is displayed on the presentation page 11. When the operation data of the posture sensor device or the physical scroll wheel is received, the display position of the cursor 111 is adjusted. When the cursor 111 can confirm a new title, as shown in FIG. Figure 7 The new title is highlighted until you confirm the jump or exit the title navigation window 112 directly. Figure 7 After confirming the jump, Figure 8 As shown, a new presentation page 11 is displayed, and the title navigation window 112 is ended.

[0146] When the preset first touch operation data is received in the normal display state, the title navigation window is displayed, and the highlighted title is updated according to the operation data of the posture sensor device or physical roller received subsequently until the navigation is exited or the displayed page is confirmed, thereby realizing fast jump switching of the presentation page.

[0147] The differences between the subsequent interaction implementations and the first interaction implementation lie primarily in the specific interactions and responses. The overall process of receiving operational data remains largely the same, so the specific data generation and transmission will not be detailed here. The description of the first interaction implementation is sufficient. The following sections will focus on the changes in the interaction responses.

[0148] The second interactive implementation is for quickly inputting annotation handwriting. If the first operation data is the preset annotation trigger operation data, the annotation window is displayed on top and the second operation data sent by the interactive peripheral is received. If the second operation data is the operation data of the posture sensor device and the preset annotation hold operation, the annotation handwriting is updated in the annotation window based on the posture sensor device operation data. If the annotation hold operation is confirmed to be complete, the annotation handwriting update ends and the annotation handwriting remains displayed in the annotation window.

[0149] The interface changes for the second interaction can be referred to Figure 8 and Figure 9 ,exist Figure 8Based on the received annotation trigger operation data, the annotation window is displayed on top, that is, the annotation window is also a kind of control window, and the annotation window is transparent and invisible. When the user presses the physical button for a long time (corresponding to the annotation hold operation) and moves the interactive peripheral (corresponding to the operation data of the posture sensor device), gestures the corresponding graphics, and updates the handwriting in the annotation window synchronously. Release the physical button (that is, the annotation hold operation ends), the handwriting update ends, and the final generated handwriting is as follows Figure 9 As shown, for example, a marking line 113 is used to highlight the mark.

[0150] When the preset annotation trigger operation data is received in the normal presentation display state, the annotation window is displayed on top, and the annotation handwriting in the annotation window is updated according to the subsequent received posture sensor device and annotation hold operation data, thereby realizing fast annotation in the presentation.

[0151] The third interactive implementation is an interactive implementation for quickly inputting annotation classifications. When the first operation data is the preset annotation trigger operation data, the annotation window is displayed on top and the second operation data sent by the interactive peripheral is received. When the second operation data is the operation data of the posture sensor device and the preset annotation hold operation, the annotation handwriting is updated in the annotation window according to the operation data of the posture sensor device. When it is confirmed based on the operation data of the posture sensor device that the interactive peripheral device has stopped moving and the annotation hold operation continues, the update of the annotation handwriting ends, the annotation handwriting that matches the preset standard graphic is converted to the corresponding standard graphic and displayed in the annotation window, and the annotation handwriting that does not match the preset standard graphic remains displayed in the annotation window.

[0152] The interface changes for the third interaction can be referred to Figure 8 、 Figure 9 and Figure 10 , which can be regarded as a further variation or parallel solution of the second interactive implementation. In the specific annotation process, for irregular handwriting, such as handwritten text, it can be directly displayed according to the input handwriting. If the user needs to input a standardized graphic, another ending method can be used. The interactive peripheral will correspondingly generate another operation data representing the status confirmation event, such as stopping the movement of the interactive peripheral and keeping the long press state for n seconds. The annotation handwriting will be converted into a standard graphic (including but not limited to a straight line, circle, ellipse, square), for example Figure 10 Lieutenant General Figure 9 The marker line 113 with fluctuations is updated and displayed as a marker line 113 in the form of a line segment.

[0153] When the preset annotation trigger operation data is received in the normal presentation display state, the annotation window is displayed on top, and the annotation handwriting in the annotation window is updated according to the subsequent received posture sensor device and annotation hold operation data. At the end of the annotation, different annotations are displayed according to the annotation handwriting, thereby realizing fast annotation in the presentation and fast drawing of specific graphics.

[0154] The fourth interactive implementation is an interactive implementation for switching cursor modes. When the first operation data is the operation data of a physical wheel, a cursor selection window is displayed at the top, and second operation data sent by the interactive peripheral is received. The cursor selection window displays selectable cursor modes, with the currently used cursor mode highlighted in the cursor selection window. When the second operation data is the operation data of the physical wheel, the highlighted cursor mode is switched in the cursor selection window according to the operation data of the physical wheel. When it is confirmed that no operation data of the physical wheel has been received within a second preset time period, the cursor selection window is closed, and the highlighted cursor mode is configured as the subsequent cursor presentation mode. That is, the cursor can have different presentation modes, and each presentation mode corresponds to a different cursor mode in the cursor selection window when it is set. When a new highlighted cursor mode is displayed, the cursor in the electronic device controlled by the interactive peripheral is subsequently presented in the presentation mode corresponding to the new highlighted cursor mode until the new highlighted cursor mode is confirmed by the operation data of the physical wheel. In other words, after the cursor selection window is closed by default due to the user confirming that the switching target stop operation has been completed, the cursor remains closed while being displayed in the presentation mode corresponding to the highlighted cursor mode. In a specific implementation process, the cursor and the cursor mode highlighted in the cursor selection window may be switched synchronously, or may be switched each time the cursor selection window is closed.

[0155] In addition to the interactive tablet Figure 11 In addition to the normal mode cursor 111a shown, a variety of guiding cursors can be set to focus the attention of participants on a certain content in a multi-person communication scenario, such as Figure 12 The cursor 111b in the afterimage mode shown, Figure 13 The cursor 111c of the focus mode shown in the figure can always be switched by a physical control, that is, by a physical scroll wheel. In the normal presentation display state, when the operation data generated by the scrolling of the physical scroll wheel is received, the display is as follows: Figure 14 The cursor selection window 114a shown, in which the current pending selection state is identified by a triangle pointer and a mode description ("afterimage mode"), that is, the current pending state is the afterimage mode. If the operation of the physical scroll wheel is completed, it can be regarded as the user confirming the current cursor mode, and the corresponding use can be made. Figure 15The cursor selection window 114b in the embodiment is also an optional implementation method. The specific presentation method of each mode and the highlighting method are not affected by the above. Figure 14 and Figure 15 Limitations, such as lists, full-screen switching, side pull bars, pop-ups, cursor-centered circular or menu lists, page numbers and other styles, can be provided for users to select and confirm the target mode.

[0156] When receiving physical wheel operation data during normal presentation display, the cursor selection window is displayed at the top, showing multiple cursor modes. As physical wheel operation data continues to be received, the cursor mode to be selected is updated, and the corresponding configuration is made when the selected cursor mode is confirmed. This allows for precise and convenient switching of cursor modes, quickly meeting the user's different cursor usage needs. The cursor effects are displayed synchronously during the cursor selection process, providing interactive effect reminders and interactive guidance.

[0157] Based on the fourth interaction implementation, a derivative interaction can be implemented based on the focus mode cursor. The focus mode cursor is displayed as a hollow circle. When the current cursor mode is focus mode and the first operation data is preset zoom operation data, the diameter of the hollow circle is adjusted according to the zoom operation data. When the preset view operation data is received, the image of the area of ​​the presentation corresponding to the hollow circle is magnified. When the preset cancel operation data is received, the magnified display of the area image is canceled. In the specific implementation process, the view operation data and the cancel operation data are the same.

[0158] After switching to focus mode, you can control the size of the hollow circle by sliding up and down on the touch module, or pressing the physical scroll wheel and sliding up and down. Among them, the finger slides down / up on the touch module and remains on the air mouse, and the hollow circle continues to enlarge / reduce until the finger leaves the touch module or reaches the limit of the hollow circle zoom. The magnification limit of the hollow circle is limited to the boundary of the presentation interface. You can enlarge and display the content in the hollow circle by double-clicking the touch module or double-clicking the physical scroll wheel. After zooming in on the content, perform the same action again to cancel the zoom. The zoomed content can be only the area image of the hollow circle frame selection range, or the area image of the circumscribed square range of the hollow circle. For the specific zoom process, please refer to Figure 16 , the display effect after enlargement can be referred to Figure 17 Through the focus mode of the cursor, you can accurately and quickly control the partial zoom to view page information, improving the pertinence of information presentation.

[0159] Figure 18 This is a schematic diagram of the structure of an interactive device provided in an embodiment of the present application. The interactive device is used for an interactive tablet, and the interactive tablet is configured with any of the interactive peripherals described above; Figure 18As shown, the interactive device includes a presentation display unit 310 , a control window display unit 320 , a selection state updating unit 330 and a display content updating unit 340 .

[0160] Among them, the presentation display unit 310 is used to display the presentation and receive the first operation data sent by the interactive peripheral through a wireless communication link; the control window display unit 320 is used to display the control window corresponding to the first operation data when the first operation data is the first type of operation data, and receive the second operation data sent by the interactive peripheral; the first type of operation data is the operation data for triggering the state selection control, and the control window is used to display the alternative state corresponding to the state selection control; the selection state update unit 330 is used to update the pending selection state in the control window according to the second operation data when the second operation data is the second type of operation data, and the second type of operation data is the operation data for state switching control of the control window; the display content update unit 340 is used to update the display content of the presentation according to the pending selection state when it is determined that there is a state confirmation event.

[0161] Based on the above embodiment, the control window display unit 320 includes:

[0162] a first window display module, configured to display a title navigation window of the presentation when the first operation data is the preset first touch operation data, and receive second operation data sent by the interactive peripheral device, wherein the title navigation window is configured to display titles of all pages corresponding to the presentation, with the title of the currently displayed presentation page being highlighted in the title navigation window;

[0163] Accordingly, the selection state updating unit 330 includes:

[0164] A first state updating module is configured to switch the highlighted title in the title navigation window according to the second operation data when the second operation data is operation data of a posture sensor device or a physical scroll wheel;

[0165] Accordingly, the display content updating unit 340 includes:

[0166] The display page update module is used to close the title navigation window and display the presentation page corresponding to the highlighted title when it is confirmed that the preset second touch operation data has been received or no operation data has been received within the first preset time period.

[0167] Based on the above embodiment, the control window display unit 320 includes:

[0168] A second window display module is configured to, when the first operation data is preset annotation triggering operation data, display the annotation window on top and receive second operation data sent by the interactive peripheral device;

[0169] Accordingly, the selection state updating unit 330 includes:

[0170] A second state updating module is configured to update the annotation handwriting in the annotation window according to the operation data of the posture sensor device when the second operation data is the operation data of the posture sensor device and a preset annotation holding operation;

[0171] Accordingly, the display content updating unit 340 includes:

[0172] The annotation handwriting updating module is used to end the updating of the annotation handwriting and keep displaying the annotation handwriting in the annotation window when confirming that the annotation holding operation is ended.

[0173] Based on the above embodiment, the control window display unit 320 includes:

[0174] A second window display module is configured to, when the first operation data is preset annotation triggering operation data, display the annotation window on top and receive second operation data sent by the interactive peripheral device;

[0175] Accordingly, the selection state updating unit 330 includes:

[0176] A second state updating module is configured to update the annotation handwriting in the annotation window according to the operation data of the posture sensor device when the second operation data is the operation data of the posture sensor device and a preset annotation holding operation;

[0177] Accordingly, the display content updating unit 340 includes:

[0178] The handwriting classification update module is used to end the update of the annotation handwriting when it is confirmed based on the operation data of the posture sensor device that the interactive peripheral has stopped moving and the annotation hold operation continues, convert the annotation handwriting that matches the preset standard graphic into the corresponding standard graphic and display it in the annotation window, and keep the annotation handwriting that does not match the preset standard graphic displayed in the annotation window.

[0179] Based on the above embodiment, the control window display unit 320 includes:

[0180] a third window display module, configured to, when the first operation data is operation data of a physical scroll wheel, display a cursor selection window on top and receive second operation data sent by the interactive peripheral, wherein the cursor selection window displays selectable cursor modes, and the currently used cursor mode is highlighted in the cursor selection window;

[0181] Accordingly, the selection state updating unit 330 includes:

[0182] a third state updating module, configured to, when the second operation data is operation data of a physical wheel, switch a highlighted cursor mode in the cursor selection window according to the operation data of the physical wheel;

[0183] Accordingly, the display content updating unit 340 includes:

[0184] The cursor type updating module is used to close the cursor selection window and configure the highlighted cursor mode as the subsequent presentation mode of the cursor when confirming that no operation data of the physical scroll wheel is received within a second preset time period.

[0185] Based on the above embodiment, the cursor is switched synchronously with the cursor mode highlighted in the cursor selection window.

[0186] Based on the above embodiment, the cursor mode includes a focus mode, and the cursor in the focus mode is displayed as a hollow circle;

[0187] Correspondingly, the interactive device further includes:

[0188] a cursor diameter adjustment unit, configured to adjust the diameter of the hollow circle according to the zoom operation data when the current mode of the cursor is the focus mode and the first operation data is the preset zoom operation data;

[0189] A region enlargement display unit, configured to enlarge and display a region image corresponding to the hollow circle of the presentation document upon receiving preset viewing operation data;

[0190] The area enlargement cancelling unit is configured to cancel the enlarged display area image when receiving preset cancelling operation data.

[0191] The interactive device provided in the embodiment of the present application is included in an interactive tablet and can be used to execute the corresponding interactive method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0192] It is worth noting that in the embodiment of the above-mentioned interactive device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0193] Figure 19 This is a schematic diagram of the structure of an interactive tablet provided in an embodiment of the present application. Figure 19 As shown, the interactive tablet includes a processor 410 and a memory 420, and may also include an input device 430, an output device 440 and a communication device 450; the number of processors 410 in the interactive tablet may be one or more, Figure 19In the figure, a processor 410 is used as an example; the processor 410, memory 420, input device 430, output device 440 and communication device 450 in the interactive tablet can be connected via a bus or other means. Figure 19 The bus connection is taken as an example.

[0194] Memory 420, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the interactive method in the embodiments of the present application. Processor 410 executes the software programs, instructions, and modules stored in memory 420 to execute various functional applications and data processing of the interactive tablet, thereby implementing the aforementioned interactive method.

[0195] Memory 420 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function; the data storage area may store data created based on the use of the interactive tablet, etc. In addition, memory 420 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, memory 420 may further include memory remotely located relative to processor 410, and these remote memories may be connected to the interactive tablet via a network. Examples of the aforementioned networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0196] The input device 430 may be used to receive input digital or character information and generate signal input related to user settings and function control of the interactive tablet. The output device 440 may include a display device such as a display screen.

[0197] The above-mentioned interactive tablet includes an interactive device, which can be used to execute any interactive method and has corresponding functions and beneficial effects.

[0198] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, it is used to perform relevant operations in the interactive method provided in any embodiment of the present application and has corresponding functions and beneficial effects.

[0199] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0200] Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including the instruction device, which implements the function specified in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0201] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. Memory may include non-permanent storage in a computer-readable medium, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0202] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory media such as modulated data signals and carrier waves.

[0203] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0204] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments herein, and that various obvious changes, readjustments, and substitutions are possible for those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the scope of the present invention. The scope of the present invention is determined by the scope of the appended claims.

Claims

1. Interactive peripherals, characterized in that, Includes housing, touch module, physical controls, wireless communication module, posture sensor and controller; The touch module and physical controls are arranged in the housing, and the wireless communication module, posture sensor and controller are arranged inside the housing; The signal output ends of the touch module, physical controls and position sensor devices are all connected to the signal input ends of the controller; the data output end of the controller is connected to the internal interface of the wireless communication module, and is used to generate operation data based on the signals received from the touch module, physical controls and position sensor devices, and send the operation data outward through the wireless communication module.

2. The interactive peripheral device according to claim 1, characterized in that: The physical controls include one or more of a physical button, a physical scroll wheel, and a physical press scroll wheel.

3. The interactive peripheral device according to claim 1, characterized in that: The posture sensor device includes a gyroscope and an accelerometer.

4. The interactive peripheral device according to claim 1, characterized in that: The wireless communication module is an infrared communication module or a Bluetooth communication module.

5. Interaction method, for interactive tablet, characterized in that, The interactive tablet is configured with the interactive peripheral device according to any one of claims 1 to 4; The interaction method comprises: displaying the presentation, and receiving first operation data sent by the interactive peripheral device via a wireless communication link; In the case where the first operation data is first-category operation data, a control window corresponding to the first operation data is displayed, and second operation data sent by the interactive peripheral device is received; if the first-category operation data is operation data that triggers a state selection control, the control window is used to display an alternative state corresponding to the state selection control; In a case where the second operation data is second-type operation data, updating the pending selection state in the control window according to the second operation data, the second-type operation data being operation data for controlling state switching of the control window; When it is determined that a status confirmation event exists, the display content of the presentation is updated according to the pending selection status.

6. The interactive method according to claim 5, characterized in that: The method of displaying a control window corresponding to the first operation data and receiving second operation data sent by the interactive peripheral device when the first operation data is the first type of operation data includes: In a case where the first operation data is the preset first touch operation data, a title navigation window of the presentation is displayed, and second operation data sent by the interactive peripheral is received, the title navigation window being used to display titles of all pages corresponding to the presentation, with the title of the currently displayed presentation page being highlighted in the title navigation window; Accordingly, when the second operation data is second-category operation data, updating the pending selection state according to the second operation data in the control window includes: In a case where the second operation data is operation data of a posture sensor device or a physical scroll wheel, switching the highlighted title in the title navigation window according to the second operation data; Accordingly, in the case of determining that a status confirmation event exists, updating the display content of the presentation according to the pending selection state includes: When it is confirmed that the preset second touch operation data has been received or no operation data has been received within the first preset time period, the title navigation window is closed and the presentation page corresponding to the highlighted title is displayed.

7. The interactive method according to claim 5, characterized in that: The method of displaying a control window corresponding to the first operation data and receiving second operation data sent by the interactive peripheral device when the first operation data is the first type of operation data includes: In the case where the first operation data is preset annotation triggering operation data, the annotation window is displayed on top, and the second operation data sent by the interactive peripheral device is received; Accordingly, when the second operation data is second-category operation data, updating the pending selection state according to the second operation data in the control window includes: In a case where the second operation data is operation data of a posture sensor device and a preset annotation holding operation, updating the annotation handwriting in the annotation window according to the operation data of the posture sensor device; Accordingly, in the case of determining that a status confirmation event exists, updating the display content of the presentation according to the pending selection state includes: When it is confirmed that the annotation holding operation is completed, the updating of the annotation handwriting is completed, and the annotation handwriting is kept displayed in the annotation window.

8. The interactive method according to claim 5, characterized in that: The method of displaying a control window corresponding to the first operation data and receiving second operation data sent by the interactive peripheral device when the first operation data is the first type of operation data includes: In the case where the first operation data is preset annotation triggering operation data, the annotation window is displayed on top, and the second operation data sent by the interactive peripheral device is received; Accordingly, when the second operation data is second-category operation data, updating the pending selection state according to the second operation data in the control window includes: In a case where the second operation data is operation data of a posture sensor device and a preset annotation holding operation, updating the annotation handwriting in the annotation window according to the operation data of the posture sensor device; Accordingly, in the case of determining that a status confirmation event exists, updating the display content of the presentation according to the pending selection state includes: When it is confirmed based on the operation data of the posture sensor device that the interactive peripheral stops moving and the annotation holding operation continues, the update of the annotation handwriting is terminated, the annotation handwriting that matches the preset standard graphic is converted into the corresponding standard graphic and displayed in the annotation window, and the annotation handwriting that does not match the preset standard graphic remains displayed in the annotation window.

9. The interactive method according to claim 5, characterized in that: The method of displaying a control window corresponding to the first operation data and receiving second operation data sent by the interactive peripheral device when the first operation data is the first type of operation data includes: In a case where the first operation data is operation data of a physical scroll wheel, a cursor selection window is displayed on top, and second operation data sent by the interactive peripheral is received, wherein the cursor selection window displays selectable cursor modes, and a currently used cursor mode is highlighted in the cursor selection window; Accordingly, when the second operation data is second-category operation data, updating the pending selection state according to the second operation data in the control window includes: In a case where the second operation data is operation data of a physical wheel, switching a highlighted cursor mode in the cursor selection window according to the operation data of the physical wheel; Accordingly, in the case of determining that a status confirmation event exists, updating the display content of the presentation according to the pending selection state includes: When it is confirmed that no operation data of the physical wheel is received within the second preset time period, the cursor selection window is closed, and the highlighted cursor mode is configured as a subsequent presentation mode of the cursor.

10. The interactive method according to claim 9, characterized in that: The cursor switches synchronously with the cursor mode highlighted in the cursor selection window.

11. The interactive method according to claim 9, characterized in that: The cursor mode includes a focus mode, and the cursor in the focus mode is displayed as a hollow circle; Accordingly, the interaction method further includes: When the current mode of the cursor is a focus mode and the first operation data is preset zoom operation data, adjusting the diameter of the hollow circle according to the zoom operation data; In case of receiving the preset viewing operation data, enlarging and displaying the image of the area of ​​the presentation corresponding to the hollow circle; In the case of receiving the preset cancel operation data, the enlarged display of the regional image is canceled.

12. The interactive method according to claim 11, characterized in that: The viewing operation data and the canceling operation data are the same.

13. Interactive device for interactive tablet, characterized in that The interactive tablet is configured with the interactive peripheral device according to any one of claims 1 to 4; The interactive device comprises: a presentation display unit, configured to display the presentation and receive first operation data sent by the interactive peripheral device via a wireless communication link; a control window display unit, configured to display a control window corresponding to the first operation data and receive second operation data sent by the interactive peripheral device when the first operation data is first type of operation data; and wherein the first type of operation data is operation data for triggering a state selection control, and the control window is configured to display an alternative state corresponding to the state selection control; a selection state updating unit, configured to update the pending selection state in the control window according to the second operation data when the second operation data is second type operation data, the second type operation data being operation data for controlling state switching of the control window; A display content updating unit is configured to update the display content of the presentation according to the pending selection state when it is determined that a state confirmation event exists.

14. Interactive tablet, characterized in that, include: one or more processors; a memory for storing one or more computer programs; When the one or more computer programs are executed by the one or more processors, the interactive tablet implements the interactive method according to any one of claims 5 to 12.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the interactive method according to any one of claims 5 to 12 is implemented.

Images