Interactive control method and device of smart blackboard, smart blackboard and storage medium

Abstract

The embodiment of the present application discloses an interactive control method, device, smart blackboard and storage medium of a smart blackboard, which relates to the field of smart blackboards, and includes: the smart blackboard includes a touch module, at least one first blackboard area and at least one second blackboard area, a display screen is installed in the first blackboard area, and the touch module is used to detect touch operations on the first blackboard area and the second blackboard area. The method includes: receiving a first touch operation on the second blackboard area; when the first touch operation is a writing operation, displaying a touch track corresponding to the writing operation on the display screen; when the first touch operation is a non-writing operation, responding according to a response strategy of the non-writing operation, and displaying a display screen corresponding to the non-writing operation on the display screen. The above method can solve the technical problem that data interaction cannot be performed between the traditional blackboard and the electronic device in the prior art smart blackboard.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of smart blackboards, and in particular to an interactive control method and device for a smart blackboard, a smart blackboard, and a storage medium. Background Art

[0002] Smart blackboards, also known as interactive blackboards in smart classrooms, can use touch technology to combine traditional handwritten blackboards with multimedia devices, and easily switch between chalk writing and multimedia applications. Generally speaking, smart blackboards are composed of traditional blackboards and large-screen electronic devices with touch functions. Users can write on traditional blackboards with tools such as chalk, and at the same time, they can also use touch control on electronic devices to realize functions such as electronic whiteboards and courseware playback.

[0003] In the process of realizing the present invention, the inventors found that the prior art has the following defects: since the traditional blackboard is a non-intelligent device and does not have any data receiving, processing and transmission functions, data interaction cannot be achieved between the traditional blackboard and the electronic equipment in the existing intelligent blackboard. Summary of the invention

[0004] The embodiments of the present application provide an interactive control method and device for a smart blackboard, a smart blackboard and a storage medium to solve the technical problem in the prior art that data cannot be interacted between traditional blackboards and electronic devices.

[0005] In a first aspect, an embodiment of the present application provides an interactive control method of a smart blackboard, wherein the smart blackboard includes a touch module, at least one first blackboard area, and at least one second blackboard area, wherein a display screen is installed in the first blackboard area, and the touch module is used to detect touch operations on the first blackboard area and the second blackboard area, and the interactive control method includes:

[0006] receiving a first touch operation on the second blackboard area;

[0007] When the first touch operation is a writing operation, a touch track corresponding to the writing operation is displayed on the display screen;

[0008] When the first touch operation is a non-writing operation, a response is performed according to a response strategy of the non-writing operation, and a display screen corresponding to the non-writing operation is displayed on the display screen.

[0009] Further, displaying the touch track corresponding to the writing operation on the display screen includes:

[0010] Calling out a trajectory display interface on the display screen;

[0011] The touch track corresponding to the writing operation is displayed in the track display interface.

[0012] Furthermore, after displaying the touch track corresponding to the writing operation in the track display interface, the method further includes:

[0013] When it is confirmed that the writing operation is completed, exit the track display interface.

[0014] Furthermore, it also includes:

[0015] Receive black screen command;

[0016] In response to a black screen instruction, controlling the display screen to be in a black screen state;

[0017] receiving a second touch operation applied to the display screen;

[0018] If the second touch operation is a writing operation, the touch coordinates of the second touch operation in the first blackboard area are recorded.

[0019] Furthermore, after displaying the touch track corresponding to the writing operation on the display screen, the method further includes:

[0020] receiving a third touch operation acting on the touch track, wherein the third touch operation is used to edit the touch track;

[0021] In response to the third touch operation, a corresponding touch track editing result is displayed on the display screen.

[0022] Furthermore, the non-writing operation is at least one of an erasing operation, a shortcut function triggering operation, a teaching aid use operation, and a gesture control operation.

[0023] Furthermore, the non-writing operation is an erasing operation.

[0024] The responding according to the response strategy of the non-writing operation and displaying a display screen corresponding to the non-writing operation on the display screen includes:

[0025] According to the touch coordinates of the erasing operation in the second blackboard area, the corresponding touch track in the display screen is erased.

[0026] Furthermore, the non-writing operation is a gesture control operation.

[0027] The responding according to the response strategy of the non-writing operation and displaying a display screen corresponding to the non-writing operation on the display screen includes:

[0028] Determining a corresponding control instruction according to the touch coordinates of the gesture control operation in the second blackboard area;

[0029] In response to the control instruction, a corresponding control result is displayed on the display screen.

[0030] Furthermore, the control instruction includes: reducing the touch track in the display screen, enlarging the touch track in the display screen, exiting the display of the touch track, or controlling the display screen to a black screen state.

[0031] Furthermore, the non-writing operation is a teaching aid use operation.

[0032] The responding according to the response strategy of the non-writing operation and displaying a display screen corresponding to the non-writing operation on the display screen includes:

[0033] The touch coordinates of the teaching aid usage operation in the second blackboard area are shielded, and the current display screen of the display screen is maintained.

[0034] Furthermore, the non-writing operation is a shortcut function triggering operation.

[0035] The responding according to the response strategy of the non-writing operation and displaying a display screen corresponding to the non-writing operation on the display screen includes:

[0036] Confirming the shortcut function corresponding to the coordinate range within which the touch coordinates of the shortcut function triggering operation fall, where different shortcut functions correspond to different coordinate ranges;

[0037] Execute the shortcut function and display the corresponding function execution result on the display screen.

[0038] Furthermore, the non-writing operation includes a gesture control operation, and after receiving the first touch operation on the second blackboard area, the step further includes:

[0039] identifying the number of touch points corresponding to the first touch operation;

[0040] If the number of contact points is equal to the set number of contact points, determining that the first touch operation is a writing operation;

[0041] If the number of contact points is not equal to the set number of contact points, the first touch operation is determined to be a gesture control operation.

[0042] Furthermore, the non-writing operation also includes a shortcut function triggering operation, and determining that the first touch operation is a writing operation includes:

[0043] If the touch coordinates of the first touch operation in the second blackboard area fall within the coordinate range of the shortcut key, determining that the first touch operation is a shortcut function triggering operation;

[0044] If the touch coordinates do not fall within the coordinate range of the shortcut key, it is determined that the first touch operation is a writing operation.

[0045] Further, determining that the first touch operation is a writing operation includes:

[0046] Obtaining a track width of the first touch operation;

[0047] If the track width is smaller than a first width threshold, the first touch operation is determined to be a writing operation.

[0048] Furthermore, if the track width is less than a first width threshold, determining that the first touch operation is a writing operation includes:

[0049] If the track width is less than a first width threshold, determining whether the touch coordinates of the first touch operation in the second blackboard area change continuously;

[0050] If the touch coordinates change continuously, it is determined that the first touch operation is a writing operation.

[0051] Furthermore, it also includes:

[0052] If the touch coordinates do not change continuously, acquiring the touch duration of the first touch operation;

[0053] If the touch duration reaches a first duration threshold, determining that the first touch operation is a writing operation;

[0054] If the touch duration does not reach the first duration threshold, the first touch operation is abandoned.

[0055] Furthermore, the non-writing operation also includes an erasing operation and a teaching aid use operation, and the method also includes:

[0056] If the track width is greater than or equal to the first width threshold, determining whether the track width is greater than a second width threshold, and the second width threshold is greater than the first width threshold;

[0057] If the track width is greater than the second width threshold, determining whether the touch coordinates of the first touch operation in the second blackboard area change continuously;

[0058] If the touch coordinates change continuously, determining that the first touch operation is an erasing operation;

[0059] If the touch coordinates do not change continuously, it is determined that the first touch operation is a teaching aid use operation.

[0060] Furthermore, it also includes:

[0061] If the track width is less than or equal to the second width threshold, the first touch operation is determined to be the gesture control operation.

[0062] Further, if the track width is greater than the second width threshold, determining whether the touch coordinates of the first touch operation in the second blackboard area change continuously includes:

[0063] If the track width is greater than the second width threshold, determining whether the duration of the initial touch coordinates reaches the second duration threshold, the initial touch coordinates being the coordinates with the earliest acquisition time among the touch coordinates;

[0064] If the duration of the initial touch coordinates reaches a second duration threshold, it is determined whether the touch coordinates change continuously.

[0065] Further, determining that the first touch operation is a gesture control operation includes:

[0066] If the change directions of the touch coordinates of the first touch operation in the second blackboard area at adjacent moments are the same, determining that the first touch operation is an erasing operation;

[0067] If the change directions of the touch coordinates at adjacent moments are different, it is determined that the first touch operation is a gesture control operation.

[0068] Furthermore, when displaying the touch track corresponding to the writing operation on the display screen, the method further includes:

[0069] The touch coordinates of the first touch operation in the second blackboard area are recorded.

[0070] Furthermore, it also includes:

[0071] Acquire the size data and arrangement relationship of the first blackboard area and the second blackboard area;

[0072] Determine a first touch coordinate range of the first blackboard area and a second touch coordinate range of the second blackboard area according to the size data, the arrangement relationship and the detection area of ​​the touch module;

[0073] The receiving a first touch operation on the second blackboard area includes:

[0074] receiving a first touch operation;

[0075] When the first touch operation falls within the second touch coordinate range, it is determined that the first touch operation is directed to the second blackboard area.

[0076] Furthermore, after recording the touch coordinates of the first touch operation on the second blackboard area, the method further includes:

[0077] receiving a fourth touch operation applied to the display screen, wherein the fourth touch operation is used to edit the recorded touch coordinates;

[0078] In response to the fourth touch operation, the recorded touch coordinates are edited.

[0079] In a second aspect, an embodiment of the present application further provides an interactive control device for a smart blackboard, wherein the smart blackboard includes a touch module, at least one first blackboard area and at least one second blackboard area, wherein a display screen is installed in the first blackboard area, and the touch module is used to detect touch operations on the first blackboard area and the second blackboard area, and the interactive control device includes:

[0080] A first receiving module, used for receiving a first touch operation on the second blackboard area;

[0081] a first processing module, configured to display a touch track corresponding to the writing operation on the display screen when the first touch operation is a writing operation;

[0082] The second processing module is used for responding according to the response strategy of the non-writing operation when the first touch operation is a non-writing operation, and displaying a display screen corresponding to the non-writing operation on the display screen.

[0083] In a third aspect, an embodiment of the present application further provides a smart blackboard, the smart blackboard comprising a touch module, at least one first blackboard area and at least one second blackboard area, an electronic device configured with a display screen is installed in the first blackboard area, the first blackboard area and the second blackboard area are arranged side by side, the touch module surrounds the first blackboard area and the second blackboard area, the touch module is used to detect touch operations on the first blackboard area and the second blackboard area, and the electronic device also includes:

[0084] one or more processors;

[0085] A memory for storing one or more programs;

[0086] When the one or more programs are executed by the one or more processors, the one or more processors implement the interactive control method of the smart blackboard as described in the first aspect.

[0087] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the interactive control method of the smart blackboard as described in the first aspect is implemented.

[0088] The interactive control method, device, intelligent blackboard and storage medium of the above-mentioned intelligent blackboard, by receiving the first touch operation for the second blackboard area, and when the first touch operation is a writing operation, the touch track corresponding to the first touch operation is displayed in the display screen installed in the first blackboard area, when the first touch operation is a non-writing operation, the response is performed according to the response strategy of the non-writing operation, and the technical means of displaying the corresponding display screen in the display screen, solves the technical problem that the traditional blackboard and the electronic device in the intelligent blackboard of the prior art cannot realize data interaction, and the touch function of the first blackboard area and the second blackboard area can be realized by setting a touch module for detecting the first blackboard area and the second blackboard area. Afterwards, when the user operates in the second blackboard area, the touch module can detect the corresponding touch operation, and then the intelligent blackboard responds according to the detected touch operation, thereby realizing the data interaction between the second blackboard area and the first blackboard area. Further, when the user writes in the second blackboard area, the touch track corresponding to the writing is displayed in the display screen, at this time, other users can view the writing content through the display screen, so that the user can avoid the situation that the writing content is blocked during the writing process so that other users cannot view the writing content in time. Furthermore, the user can also perform non-writing operations in the second blackboard area. At this time, the smart tablet can respond according to the non-writing operations and display the corresponding display screen on the display screen, thereby realizing the control of the electronic device through the traditional blackboard.

[0089] Furthermore, when the user writes in the second blackboard area, the smart blackboard can record the touch coordinates in the background, and the user can edit the recorded touch coordinates, which not only realizes the writing record, but also makes the record file more in line with the user's actual needs.

[0090] Furthermore, by setting the number of contacts, the writing operation and the non-writing operation can be accurately distinguished, thereby facilitating the accurate implementation of the subsequent process. At the same time, by setting the gesture control operation, the electronic device can be controlled on the traditional blackboard.

[0091] Furthermore, by presetting shortcut keys and corresponding coordinate ranges, it is possible to trigger shortcut functions in a traditional blackboard. At the same time, by comparing the touch coordinates of the first touch operation and the coordinate range of the shortcut key, the writing operation and the shortcut key triggering operation can be accurately distinguished.

[0092] By setting corresponding judgment rules based on the first width threshold, the second width threshold, the first duration threshold, the second duration threshold and the continuous change pattern of the touch coordinates, it is possible to accurately identify writing operations, erasing operations and teaching aid use operations, and then respond to writing operations, erasing operations and teaching aid use operations respectively, enriching the interactive content of the first blackboard area and the second blackboard area, and improving the functionality of the smart blackboard. BRIEF DESCRIPTION OF THE DRAWINGS

[0093] Figure 1 A schematic diagram of the structure of a smart blackboard provided in an embodiment of the present application;

[0094] Figure 2 A schematic diagram of the composition structure of another smart blackboard provided in an embodiment of the present application;

[0095] Figure 3 A flowchart of an interactive control method of a smart blackboard provided by an embodiment of the present application;

[0096] Figure 4 A flowchart of an interactive control method of a smart blackboard provided in another embodiment of the present application;

[0097] Figure 5 A first display screenshot of the smart blackboard provided in an embodiment of the present application;

[0098] Figure 6 A second display screenshot of the smart blackboard provided in an embodiment of the present application;

[0099] Figure 7 The third display screenshot of the smart blackboard provided in the embodiment of the present application;

[0100] Figure 8 The fourth display screenshot of the smart blackboard provided in the embodiment of the present application;

[0101] Fig. 9 The fifth display screenshot of the smart blackboard provided in the embodiment of the present application;

[0102] Fig.10 The sixth display screenshot of the smart blackboard provided in the embodiment of the present application;

[0103] Fig.11 A flowchart of an interactive control method of a smart blackboard provided in yet another embodiment of the present application;

[0104] Fig.12 A schematic diagram of the structure of an interactive control device for a smart blackboard provided in one embodiment of the present application;

[0105] Fig.13 A schematic diagram of the structure of an electronic device provided in accordance with an embodiment of the present application. DETAILED DESCRIPTION

[0106] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only the parts related to the present application, rather than all structures, are shown in the accompanying drawings.

[0107] It should be noted that, in this article, relational terms such as first and second are only used to distinguish one entity or operation or object from another entity or operation or object, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations or objects. For example, the "first" and "second" of the first touch operation and the second touch operation are used to distinguish two different touch operations.

[0108] The interactive control method of the smart blackboard provided in an embodiment of the present application can be executed by the smart blackboard, which includes a touch module, at least one first blackboard area and at least one second blackboard area, wherein a display screen is installed in the first blackboard area, and the touch module is used to detect touch operations on the first blackboard area and the second blackboard area.

[0109] In the embodiment, the first blackboard area is the area where the electronic device is located, and the electronic device is equipped with a display screen. The second blackboard area is the area where the traditional blackboard is located. It can be understood that in actual applications, the second blackboard area can also be the area where an ordinary whiteboard is located, or the area where other writing boards with the same functions as the traditional blackboard are located. Further, the number and arrangement of the first blackboard area and the second blackboard area can be set according to actual conditions. For example, Figure 1 A schematic diagram of the structure of a smart blackboard provided in an embodiment of the present application. Figure 1 , the second blackboard area 11 is located on the left side of the first blackboard area 12. Figure 2 This is a schematic diagram of the composition structure of another smart blackboard provided in an embodiment of the present application. Figure 2 There are two second blackboard areas 11 in total, and the two second blackboard areas 11 are respectively located on the left and right sides of the first blackboard area 12.

[0110] Furthermore, both the first blackboard area and the second blackboard area have a touch function. The touch function can be realized by a touch module, that is, the touch module is responsible for touch detection. Among them, according to the working principle of the touch module, the touch module can be divided into a resistive touch module, a capacitive induction touch module, an electromagnetic induction touch module and an infrared induction touch module. The electromagnetic induction touch module detects touch operations by the changes in the magnetic field generated by the electromagnetic pen during operation and the sensor located under the touch area. The infrared induction touch module can identify touch operations by blocking infrared light during the touch process; the capacitive induction touch module can identify touch operations by changes in capacitance caused by user contact; and the voltage touch module can identify touch operations by the voltage generated by user contact.

[0111] In the embodiment, considering that users usually use writing pens such as chalk to write in the second blackboard area, and the second blackboard area and the writing pen are not electronic, in order to realize the touch function of the second blackboard area, in the embodiment, the smart blackboard is installed with an infrared sensing touch module as an example for description. Further, the infrared sensing touch module is set as an infrared touch frame, which has the function of data collection and processing. The infrared touch frame is set around the smart blackboard to perform touch detection on the first blackboard area and the second blackboard area surrounded by it.

[0112] Furthermore, the installation method of the infrared touch frame is related to the arrangement relationship between the first blackboard area and the second blackboard area. Figure 1 As shown in the structural diagram, the infrared touch frame includes a main screen upper touch frame 121 above the first blackboard area 12, a main screen lower touch frame 122 below the first blackboard area 12, a main screen right touch frame 123 on the right side of the first blackboard area 12, a sub-screen upper touch frame 111 above the second blackboard area 11, a sub-screen lower touch frame 112 below the second blackboard area 11, and a sub-screen left touch frame 113 on the left side of the second blackboard area 11. Figure 2 As shown in the structural diagram, the infrared touch frame includes a main screen upper touch frame 124 above the first blackboard area 12, a main screen lower touch frame 125 below the first blackboard area 12, a sub-screen upper touch frame 114 above the second blackboard area 11 on the left, a sub-screen lower touch frame 115 below the second blackboard area 11, and a sub-screen left touch frame 116 to the left of the second blackboard area 11, a sub-screen upper touch frame 117 above the second blackboard area 11 on the right, a sub-screen lower touch frame 118 below the second blackboard area 11, and a sub-screen left touch frame 119 to the right of the second blackboard area 11. For each adjacent touch frame of the first blackboard area 12 (such as Figure 1For the upper touch frame 121 of the main screen and the right touch frame 123 of the main screen, they can be connected by means of adapter wires, gold pins, etc., and preferably connected by snap-fit ​​during installation to prevent adjacent touch frames from being separated from each other. Figure 2 For the touch frame 114 on the middle sub-screen and the touch frame 116 on the left of the sub-screen), they can be connected by means of adapter wires or gold pin plug-ins, and are preferably connected by snap-on means during installation to prevent adjacent touch frames from detaching from each other. Furthermore, the touch PCBA inside each touch frame is composed of one or more PCBAs, wherein the entire process of loading components on a blank printed circuit board (PCB) through surface mounting technology or through dual in-line packaging technology plug-ins can be considered as PCBA. In an embodiment, the PCBA inside the touch frame refers to a printed circuit board that has passed through PCBA, and the touch PCBA is used to realize touch detection. Furthermore, an LED for emitting infrared light and an LED for receiving infrared light are installed in the PCBA. Among them, due to the touch frames on the left and right sides of the smart blackboard (such as Figure 1 The distance between the right touch frame 123 of the main screen and the left touch frame 113 of the secondary screen is large, so a high-power LED can be used in the corresponding PCBA to increase the recognition distance of the PCBA. Figure 2 The distance between the touch frame 114 on the secondary screen and the touch frame 115 on the secondary screen is small, so a low-power SMD LED can be used. In one embodiment, for the adjacent touch frames (such as Figure 1For the touch frame 121 on the main screen and the touch frame 111 on the secondary screen, they are connected by means of adapter wires, gold pins or pogo pins, and are preferably connected by snap-fit ​​during installation to prevent adjacent touch frames from being separated from each other. After being connected, each touch frame forms a complete touch frame. At this time, the smart blackboard can be covered with infrared light that is crisscrossed horizontally and vertically by each PCBA set, and each touch frame can determine which positions of the infrared light on the smart blackboard are blocked according to the reception of the infrared light, and then determine that the user is touching the smart blackboard and can determine the corresponding touch position. Further, any of the PCBAs is also provided with a signal processing unit, which can be a single-chip microcomputer or a microprocessor, etc., and the signal processing unit is responsible for determining the touch position. Specifically, the signal processing unit records the receiving LED and the transmitting LED corresponding to each touch position, and the touch position is clearly determined by obtaining the infrared light emission data and the infrared light receiving data of the LED on each PCBA, and the touch position is reported to the operating system of the electronic device for subsequent processing, wherein the touch position can be expressed as a touch coordinate. It can be understood that the signal processing unit is connected to the main chip or MCU chip of the electronic device through a connecting line to realize reporting of the touch position. Optionally, the signal processing unit is set in the touch frame on the main screen or the touch frame under the main screen to reduce the wiring complexity. In another embodiment, for the adjacent touch frames between the first blackboard area 12 and the second blackboard area 11 (such as Figure 1 In this case, one or more signal processing units may be set in any PCBA corresponding to each second blackboard area 11 to perform independent touch detection on the second blackboard area 11, and one or more signal processing units may be set in any PCBA corresponding to each first blackboard area 12 to perform independent touch detection on each first blackboard area 12, for example, Figure 2 The structural diagram shown includes two second blackboard areas 11, and one or more signal processing units are set in any PCBA corresponding to each second blackboard area 11 to realize independent touch detection of each second blackboard area. The working mode of the signal processing unit is the same as the working mode of the above-mentioned signal processing unit. Optionally, during detection, in order to improve the accuracy of touch detection, for the second blackboard area 11, the touch frame on its side (such as Figure 2The left touch frame 116 of the middle sub-screen and the right touch frame 119 of the sub-screen can improve the accuracy through the oblique scanning algorithm. Furthermore, in order to reduce the interference of infrared light between the first blackboard area and the second blackboard area under independent touch detection, infrared light with different transmitting and receiving frequencies can be used for the first blackboard area and the second blackboard area to distinguish them, and infrared light with the same transmitting and receiving frequencies can be used for the first blackboard area and the second blackboard area and time division multiplexing can be used to avoid interference, wherein the time division multiplexing method is that at any time point, only the touch frame corresponding to only one blackboard area performs infrared light transmission and reception work, that is, at this time point, only the touch operation of its own blackboard area is detected. Optionally, because the touch frame has a touch blind area (i.e., an area where the edge cannot detect touch operations), in order to improve the accuracy of touch detection, for the adjacent touch frames between the first blackboard area 12 and the second blackboard area 11, cross-arranged LEDs can be added to their PCBA (i.e., one LED is added between two original LEDs), and the newly added LEDs are independent of the original LEDs, and the circuit of the newly added LEDs is connected to the PCBA of the adjacent touch frame to extend the PCBA of the adjacent touch frame. Optionally, if the electronic device in the first blackboard area is at a certain distance from the edge of the first blackboard area, the touch blind area of ​​the touch frame in the first blackboard area is located in the area corresponding to the distance, so there is no need to add LEDs in the second blackboard area.

[0113] It should be noted that the above are only optional implementation methods of the infrared touch frame and touch detection. In actual applications, the touch module can also adopt other touch structures and touch detection methods. The embodiment does not limit this. It only needs the touch module to be able to perform touch detection on the first blackboard area and the second blackboard area.

[0114] Further, in the embodiment, the electronic device installed in the first blackboard area may be an interactive smart tablet. The interactive smart tablet may be an integrated device that controls the content displayed on the display tablet and realizes human-computer interaction through touch technology, which integrates one or more functions such as a projector, an electronic whiteboard, a screen, an audio system, a television, and a video conferencing terminal. Optionally, in addition to realizing the touch function through an infrared sensing touch module, the interactive smart tablet may also integrate at least one other touch mode, such as integrating an electromagnetic induction touch module to realize electromagnetic touch or integrating a capacitive sensing touch module to realize capacitive touch. Further, the interactive smart tablet is installed with at least one type of operating system, wherein the operating system includes but is not limited to an Android system, a Linux system, and a Windows system. The operating system may receive the touch coordinates detected by the touch module and perform subsequent operations. Further, the interactive smart tablet may install at least one application based on the operating system. The types and functional embodiments of the application are not limited. For example, an electronic whiteboard application, a courseware display application, a multimedia player, etc. are installed in the interactive smart tablet to realize the electronic whiteboard function, the courseware display function, and the multimedia player function. In an embodiment, taking the interactive smart tablet as an example in which at least an interactive application is installed, when a user touches the second blackboard area, the infrared touch frame reports the touch coordinates to the interactive smart tablet. After that, the operating system of the interactive smart tablet sends the touch coordinates to the interactive application. The interactive application determines the corresponding response method according to the touch coordinates and responds.

[0115] Specifically, Figure 3 A flowchart of an interactive control method of a smart blackboard provided by an embodiment of the present application. Figure 3 , the interactive control method comprises the following steps:

[0116] Step 101: Receive a first touch operation on a second blackboard area.

[0117] Specifically, the first touch operation refers to the touch operation currently issued by the user, and preferably, the first touch operation refers to the touch operation issued by the user in the second blackboard area. The first touch operation is detected by the touch module. Optionally, the touch module pre-stores a touch coordinate range corresponding to the second blackboard area, wherein the touch coordinate range refers to the numerical range corresponding to the coordinate point covering the second blackboard area in the touch coordinate system corresponding to the touch module. In the embodiment, when the user performs a touch operation, the coordinate point where the touch operation is detected by the touch module is recorded as the touch coordinate. When the touch module detects the touch operation, it is determined whether the corresponding touch coordinate falls into the touch coordinate range corresponding to the second blackboard area. If so, it is determined that the first touch operation is received, and the corresponding touch coordinate is reported to the electronic device for subsequent response. Also optionally, the electronic device pre-stores a touch coordinate range corresponding to the second blackboard area, and when the touch module detects the touch operation, the corresponding touch coordinate is reported, and the electronic device determines whether the touch coordinate falls into the touch coordinate range corresponding to the second blackboard area. If so, it is determined that the first touch operation is received. It can be understood that during the operation of the first touch operation, the electronic device can receive the touch coordinates corresponding to the first touch operation in real time. It should be noted that receiving the first touch operation can also be understood as receiving the touch coordinates corresponding to the first touch operation. Optionally, if the touch coordinates corresponding to the touch operation do not fall within the touch coordinate range corresponding to the second blackboard area, it is determined that the touch operation is directed to the first blackboard area, that is, directed to the electronic device. At this time, the touch operation can be responded to according to the response strategy set in the electronic device.

[0118] Step 102: When the first touch operation is a writing operation, a touch track corresponding to the writing operation is displayed on the display screen.

[0119] In an embodiment, the first touch operation may be a writing operation or a non-writing operation, wherein the writing operation refers to an operation in which the user writes in the second blackboard area, and the non-writing operation refers to an operation other than the writing operation that requires an electronic device to respond. In an embodiment, the non-writing operation is at least one of an erasing operation, a quick function triggering operation, a teaching aid use operation, and a gesture control operation. Among them, the erasing operation refers to an operation of erasing the written content in the second blackboard area. The gesture control operation refers to an operation of controlling the display screen (such as exiting, zooming, turning off the screen, etc.) using a set gesture action in the second blackboard area. The quick function triggering operation refers to an operation of triggering a key displayed in the second blackboard area for triggering a quick function (such as previewing touch coordinates, displaying touch tracks in the first blackboard area, calling a certain application, etc.). The teaching aid use operation refers to the operation of placing teaching aids in the second blackboard area, wherein teaching aids refer to props used to explain and explain during the teaching process, for example, the teaching aids are set squares. Optionally, the teaching aids can be placed on the second blackboard area by means of magnets, adhesives, etc.

[0120] Typically, the judgment rule for writing operation is pre-set, and when the first touch operation is received, it is determined whether the first touch operation satisfies the judgment rule. If the judgment rule is satisfied, the first touch operation is determined to be a writing operation. Among them, the judgment rule may be a limitation on the touch coordinates. For example, the touch coordinates detected by the touch module when the user is writing are usually continuously changing. Therefore, the judgment rule may be that the touch coordinates change continuously. For another example, the user usually uses a writing pen such as chalk to write, and the contact area between the writing pen and the second blackboard area is relatively small. Therefore, the judgment rule may be that the touch area of ​​the contact point obtained based on the touch coordinates is less than the set area threshold, wherein the set area threshold may be set according to the actual situation. For another example, the user usually uses a writing pen to write. During the writing process, only the pen tip contacts the second blackboard area, that is, there is only one contact point (also recorded as a contact point). Therefore, the judgment rule may be that there is only one contact point based on the received touch coordinates. It should be noted that the above judgment rules are only exemplary, and other judgment rules may be used in actual applications, or the above multiple judgment rules may be combined. Further, when the first touch operation is received, it is determined whether the touch coordinates of the first touch operation meet the judgment rule for writing operation. If the determination rule is satisfied, the first touch operation is determined to be a writing operation, and a response is performed according to the writing operation.

[0121] In an embodiment, the response strategy of the writing operation is to synchronously display the touch track identical to the first touch operation in the display screen of the first blackboard area. Wherein, the touch track can be understood as a writing track. Optionally, a display area for displaying the touch track is set in advance in the display screen, and the display area can be set by the smart blackboard itself, or by the user through the smart blackboard. Specifically, the corresponding touch track can be drawn according to the touch coordinates of the first touch operation, and then the touch track is displayed in the display screen. Optionally, the track parameters of the touch track displayed in the display screen can be set according to actual conditions. Wherein, the track parameters include but are not limited to track thickness, track color, scaling ratio, etc. The scaling ratio refers to the size ratio between the touch track and the track written by the first touch operation in the second blackboard area. The track parameters can be set by the smart blackboard itself, or by the user in the smart blackboard. Optionally, when displaying the touch track, the initial display coordinates of the touch track in the display screen can be automatically selected by the smart blackboard, or manually selected by the user, wherein the initial display coordinates correspond to the first touch coordinates detected in the first touch operation. After selecting the initial display coordinates, the touch track can be drawn in the display screen according to the track parameters. It can be understood that a display coordinate system is established in the display screen. In the embodiment, the setting of the display coordinate system is related to the resolution of the display screen, that is, the coordinate points in the display coordinate system correspond to the pixel points in the display screen one by one. The origin of the display coordinate system can be set according to the actual situation. In the embodiment, the coordinate points in the display coordinate system are recorded as display coordinates. At this time, the corresponding relationship between the touch coordinate range of the first blackboard area and the display coordinate range of the display coordinate system is stored in the smart blackboard. When a touch operation on the first blackboard area is detected, the display content corresponding to the touch operation in the display screen can be determined according to the corresponding relationship, and then the response strategy of the touch operation can be determined according to the display content and then responded.

[0122] Optionally, the user can edit the touch track in the display screen. At this time, after the touch track corresponding to the writing operation is displayed in the display screen, it is also set to: receive a third touch operation acting on the touch track, the third touch operation is used to edit the touch track; in response to the third touch operation, the corresponding touch track editing result is displayed in the display screen. Among them, the third touch operation refers to the operation of editing the touch track. The triggering method of the third touch operation is not limited in the embodiment. Typically, when the user issues the third touch operation in the display screen, the touch module reports the corresponding touch coordinates, and then the electronic device determines the third touch operation according to the touch coordinates, and then determines the corresponding editing method according to the third touch operation, wherein different third touch operations correspond to different editing methods. Afterwards, the touch track in the display screen is edited according to the editing method. Among them, the editing method includes but is not limited to: deleting and / or scaling the touch track. It should be noted that when editing, the editing method corresponds to a plurality of third touch operations. For example, for scaling the touch track, it can be composed of two third touch operations, the first third touch operation is used to select the scaled touch track, and the second third touch operation is used to scale the selected touch track.

[0123] In addition, during the process of displaying the touch track, the user can exit the display of the touch track at any time according to his / her own needs.

[0124] In one embodiment, when the touch track corresponding to the writing operation is set to be displayed on the display screen, it also includes: recording the touch coordinates of the first touch operation in the second blackboard area. Specifically, after receiving the touch coordinates of the first touch operation, in addition to displaying the corresponding touch track, the touch coordinates can also be recorded. Among them, recording the touch coordinates means recording the touch coordinates detected in sequence according to the detection timing of the touch coordinates, and obtaining a file recording the touch coordinates. Among them, when recording the touch coordinates, data representing the touch coordinates can be generated according to the set encoding protocol, and the data is recorded. Afterwards, after the first touch operation ends, the file recording the touch coordinates can be saved, wherein the file format and the saving path embodiment are not limited. After saving the file recording the touch coordinates, the user can call out the file in the electronic device according to actual needs to review the first touch operation. Optionally, before saving the file, a prompt box can be popped up to prompt the user whether to save the currently recorded touch coordinates, and when the user chooses to save, the recorded touch coordinates are saved, and when the user chooses not to save, the recorded touch coordinates are discarded. Optionally, after saving the touch coordinates, the touch track displayed on the display screen can be deleted. Afterwards, if a new first touch operation for writing is detected, the touch track is displayed on the display screen again and the corresponding touch coordinates are recorded.

[0125] Optionally, since a single writing operation generates one track during the writing operation by the user, and the writing content is composed of multiple tracks, if each track corresponds to a file, the data processing volume will increase. Therefore, in the embodiment, it is set that the touch tracks corresponding to all the writing operations received during a single writing process are simultaneously displayed on the display screen, and the touch coordinates corresponding to all the writing operations are recorded in one file. Among them, the user can indicate a single writing process. For example, a corresponding shortcut key is set in the display screen or the second blackboard area. When it is detected that the shortcut key is triggered, it is determined that the writing process has entered. When it is detected that the shortcut key is triggered again, it is determined that the current writing process has ended. It can also be recognized by the smart blackboard itself. For example, when it is detected that a single writing operation is completed and no writing operation is received within a certain time length (the specific value is set according to the actual situation), it can be determined that the current writing process has ended.

[0126] Optionally, during the writing process, a single writing process may require multiple writing operations. For example, when writing the Chinese character "中" during the writing process, 4 writing operations are required. If the judgment of the writing operation is performed each time, the data processing volume will increase. Therefore, in one embodiment, the minimum time interval of the writing operation can be set, and the minimum time interval can be set according to the actual situation. When the first touch operations are continuously received and the time interval between the continuously received first touch operations is less than the minimum time interval, if the first first touch operation is recognized as a writing operation, the continuously received first touch operations can also be considered as writing operations. Or, if the first first touch operation is recognized as a writing operation and the continuously received first touch operations correspond to one contact point, the continuously received first touch operations are also recognized as writing operations.

[0127] In one embodiment, after recording the touch coordinates of the first touch operation in the second blackboard area, it further includes: receiving a fourth touch operation acting on the display screen, where the fourth touch operation is used to edit the recorded touch coordinates; and in response to the fourth touch operation, editing the recorded touch coordinates.

[0128] In an embodiment, a user can edit the recorded touch coordinates, and record the touch operation issued when editing the touch coordinates as a fourth touch operation. Specifically, editing the recorded touch coordinates may be editing the touch coordinates themselves, or editing the file recording the touch coordinates. Exemplarily, when editing the touch operation itself, the fourth touch operation may include a preview operation and an edit operation, wherein the preview operation is used to preview the recorded touch coordinates. The triggering mode of the preview operation may be set according to actual conditions, for example, a preview button is displayed on the display screen, and when it is detected that the preview button receives a click operation, the touch coordinates of the preview record are determined. Among them, the preview mode is: rendering the corresponding trajectory according to the recorded touch coordinates, and then previewing the rendered trajectory on the display screen. When it is detected that the preview button receives a click operation again, it is determined to exit the preview interface. The edit operation is used to edit the touch coordinates, wherein the edit content may be set according to actual conditions, such as the edit content includes deleting the touch coordinates, modifying the touch coordinates and / or cutting part of the touch coordinates. When editing, the user may edit the previewed trajectory, thereby deleting the corresponding touch coordinates, modifying the corresponding touch coordinates and / or cutting the corresponding touch coordinates. The triggering mode of the edit operation may be set according to actual conditions, and different edit operations correspond to different triggering modes. Typically, after previewing the track corresponding to the touch coordinates on the display screen, if an editing operation for the preview interface is received, the corresponding editing content can be determined according to the triggering method of the editing operation, and then the corresponding track can be edited according to the editing content, and the touch coordinates corresponding to the edited track can be modified, and then the modification can be saved. It should be noted that in actual applications, the touch coordinates can also be previewed directly before saving the file recording the touch coordinates. At this time, the user only needs to perform the editing operation without the preview operation, that is, the fourth touch operation is only an editing operation. It can be understood that after the editing is completed, the edited file is saved.

[0129] Exemplarily, when editing a file recording touch coordinates, the editing content may include: inserting an attachment, creating a new file, saving as an association, and saving as an attachment. Among them, inserting an attachment means inserting the file as an attachment into the application specified by the user (it can be inserted into the application in the form of a picture or editable text), or inserting the touch coordinates recorded in the file into the picture or text dialog box in the form of a touch track. Creating a new file means using a new blank document to save the currently recorded touch coordinates when saving a file. Saving as an association means storing a document recording touch coordinates in other files as a link or other form. Inserting an attachment means inserting other content into a file. It should be noted that when different editing contents are used, the triggering method of the fourth touch operation is different, and its specific content can be set according to actual conditions. The embodiment does not limit this. For example, a related virtual button is set in the display screen or the operation form corresponding to different editing contents is set (such as long pressing, drawing a set track or shape, etc.). After that, if it is detected that the fourth touch operation is for a virtual button or a set operation form, the corresponding editing operation is performed. Optionally, after the file is edited, it is saved according to the edited file.

[0130] It should be noted that when the user writes in the second blackboard area, the user can perform the fourth touch operation on the display screen at any time according to actual needs to edit the recorded touch coordinates. Alternatively, when the writing operation ends, that is, when the first touch operation is no longer detected, the user is prompted on the display screen whether to edit, and when the user chooses to edit, the fourth touch operation is detected and responded to, so as to edit the recorded touch coordinates.

[0131] Step 103: When the first touch operation is a non-writing operation, respond according to the response strategy of the non-writing operation, and display a display screen corresponding to the non-writing operation on the display screen.

[0132] Exemplarily, different non-writing operations correspond to different judgment rules, and the judgment rule can also be a limitation on the touch coordinates. For example, when the non-writing operation is a gesture control operation, the corresponding judgment rule is that the number of touch points at the same time is at least two, that is, the gesture control operation is a multi-touch operation (such as the user uses two fingers to touch at the same time). After receiving the touch coordinates of the first touch operation, when the first touch operation is detected as a multi-touch operation based on the touch coordinates, it is determined that the first touch operation meets the judgment rule of the gesture control operation, that is, the first touch operation is a gesture control operation. For another example, when the non-writing operation is an erasing operation, when the user uses a tool such as an eraser or a rag to erase the written content in the second blackboard area, the eraser or the rag has a certain contact area when it contacts the second blackboard area, and the contact area is usually larger than the contact area when writing with chalk. At the same time, the user needs to move the eraser or the rag during the erasing process to erase the written content. Therefore, the judgment rule of the erasing operation can be that the touch area of ​​the contact point obtained based on the touch coordinates is within the set area range and the touch coordinates change continuously. For example, the non-writing operation is the operation of using teaching aids. When the user places the teaching aids, the teaching aids have a certain contact area with the second blackboard area, and the contact area is larger than the contact area when writing with chalk. At the same time, the teaching aids are generally not moved after being placed in the second blackboard area, that is, the touch module will continue to detect the same touch coordinates. Therefore, the judgment rule for the teaching aid operation can be that the touch area of ​​the contact point obtained based on the touch coordinates is within the set area range and the touch coordinates do not change continuously. For another example, the non-writing operation is a shortcut function trigger operation. When the user touches the button displayed in the second blackboard area, it can be confirmed that the user wants to start the shortcut function corresponding to the button. Therefore, the judgment rule for the shortcut function trigger operation is to confirm that the touch coordinates fall into the touch coordinate range corresponding to the button. It should be noted that the above judgment rules are only exemplary. In actual applications, different judgment rules can also be set for each non-writing operation, and the embodiment does not limit this.

[0133] Furthermore, when it is determined that the first touch operation is a non-writing operation, the first touch operation is responded to according to the response strategy of the non-writing operation. Among them, different non-writing operations correspond to different response strategies. For example, when the non-writing operation is a gesture control operation, different gestures correspond to different control instructions. For example, when it is determined according to the touch coordinates that the gesture issued by the user is two contacts moving in opposite directions, the corresponding control instruction is to enlarge the touch track displayed on the display screen. Therefore, the response strategy is to enlarge the touch track and display a display screen of the enlarged touch track on the display screen. For another example, when it is determined according to the touch coordinates that the gesture issued by the user is two contacts moving toward each other, the corresponding control instruction is to reduce the touch track displayed on the display screen. Therefore, the response strategy is to reduce the touch track and display a display screen of the reduced touch track on the display screen. It should be noted that when the gesture control operation is continuously received, the touch track can be continuously enlarged or reduced according to the gesture control operation. When it is detected that the gesture touch operation stops (that is, the touch coordinates corresponding to the gesture touch operation are not received), the enlargement or reduction of the touch track stops. For example, according to the touch coordinates, it is determined that the gesture issued by the user is five contacts moving toward each other at the same time (that is, the five contacts are gathering together), and the corresponding control instruction is to turn off the display screen. Therefore, the response strategy is to control the display screen to enter the off state. In the off state, the display screen does not display any content. It should be noted that the above is only an exemplary description of gesture control operations and response strategies. In actual applications, other gestures and other response strategies can also be set. Furthermore, when the non-writing operation is an erasing operation, the response strategy is to erase the touch track corresponding to the erasing operation on the display screen, and display the display screen of the erased touch track. Optionally, if the touch coordinates corresponding to the writing content in the second blackboard area are recorded in the background, the touch coordinates corresponding to the erasing operation are deleted synchronously. Furthermore, when the non-writing operation is a teaching aid use operation, the response strategy is to record the touch coordinates of the teaching aid use operation in the background and shield the position of the touch coordinates, that is, not respond to the touch operation received at the touch coordinates, and accordingly, the display screen retains the display screen before receiving the teaching aid use operation, or the display screen determines the shape of the teaching aid according to the touch coordinates, and draws a graphic of the same shape on the display screen, wherein when drawing the graphic, the color and line thickness of the graphic may be different from the color and line thickness of the touch track, and the scaling ratio of the graphic is the same as the scaling ratio of the touch track.

[0134] In the above, by receiving the first touch operation for the second blackboard area, and when the first touch operation is a writing operation, the touch track corresponding to the first touch operation is displayed in the display screen installed in the first blackboard area, and when the first touch operation is a non-writing operation, the response is performed according to the response strategy of the non-writing operation, and the technical means of displaying the corresponding display screen in the display screen solves the technical problem that the traditional blackboard and the electronic device in the smart blackboard of the prior art cannot realize data interaction, and the touch function of the first blackboard area and the second blackboard area can be realized by setting a touch module for detecting the first blackboard area and the second blackboard area. Afterwards, when the user operates in the second blackboard area, the touch module can detect the corresponding touch operation, and then the smart blackboard responds according to the detected touch operation, thereby realizing the data interaction between the second blackboard area and the first blackboard area. Further, when the user writes in the second blackboard area, the touch track corresponding to the writing is displayed in the display screen, and at this time, other users can view the writing content through the display screen, so as to avoid the situation that the user blocks the writing content during the writing process so that other users cannot view the writing content in time. Furthermore, when the user writes in the second blackboard area, the smart blackboard can record the touch coordinates in the background, and the user can edit the recorded touch coordinates, which not only realizes the writing record, but also makes the record file more in line with the actual needs of the user. Furthermore, the user can also perform non-writing operations in the second blackboard area. At this time, the smart tablet can respond according to the non-writing operation and display the corresponding display screen on the display screen, thereby realizing the control of the electronic device through the traditional blackboard.

[0135] Based on the above embodiment, the interactive control method further includes:

[0136] Step 104: Receive a black screen instruction.

[0137] Exemplarily, the black screen instruction is used to instruct the display screen to enter the black screen state, wherein the black screen state refers to the display screen being black, which can be achieved by controlling the display screen to turn off the screen, or controlling the current display screen of the display screen to be black. The black screen instruction can be generated by triggering a black screen button, wherein the black screen button can be a virtual button set in the display screen, or a silk screen button set in the second blackboard area, wherein the silk screen button refers to an icon printed in the second blackboard area by silk screen printing, and the silk screen button cannot perform data communication. When the touch module receives a touch operation, a touch coordinate is generated, and then the smart blackboard determines whether the touch coordinate is located at the position where the silk screen button is located or at the position where the virtual button is located. If so, it is determined that the black screen instruction is received. In addition, the black screen instruction can also be implemented by a set touch operation, for example, when the user is set to issue a double-contact click operation in the second blackboard area, the smart blackboard determines that the black screen instruction is received, and for another example, when the user is set to issue a double-contact long press operation in the first blackboard area, the smart blackboard determines that the black screen instruction is received.

[0138] Step 105: In response to the black screen instruction, control the display screen to a black screen state.

[0139] After receiving the black screen instruction, respond to the black screen instruction, that is, control the display screen to enter the black screen state. The way to control the display screen to enter the black screen state is: stop powering the display screen to make the display screen enter the off screen state, or call a pre-stored black picture for the display screen to display, or use other strategies to make the display screen enter the black screen state.

[0140] Optionally, after entering the black screen state, when a black screen instruction is received again, the black screen state of the display screen is canceled.

[0141] Step 106: Receive a second touch operation on the display screen.

[0142] The second touch operation refers to a touch operation detected by the touch module in the touch coordinate range corresponding to the display screen when the display screen is in a black screen state, that is, the second touch operation is a touch operation performed by the user in the first blackboard area.

[0143] Step 107: If the second touch operation is a writing operation, record the touch coordinates of the second touch operation in the first blackboard area.

[0144] Exemplarily, when the display screen enters a black screen state, the first blackboard area and the second blackboard area can be defaulted to a whole traditional blackboard area. At this time, after detecting the second touch operation, there is no need to determine whether the second touch operation acts on the first blackboard area or the second blackboard area, and directly identify the second touch operation as a writing operation or a non-writing operation, wherein the identification method is the same as the identification method for identifying the first touch operation as a writing operation or a non-writing operation, which is not repeated here. Further, if the second touch operation is a writing operation, the background records the touch coordinates corresponding to the second touch operation. At this time, the range of the touch coordinates recorded in the background is equal to the coordinate range of the touch module. Among them, the touch coordinates of the second touch operation are recorded in the same way as the touch coordinates of the first touch operation when the first touch operation is a writing operation, which is not repeated here. If the second touch operation is a non-writing operation, it is responded to according to the response strategy of the non-writing operation, but the corresponding display screen will not be displayed in the display screen when responding. Among them, the response strategy can refer to the response strategy when the first touch operation is a non-writing operation.

[0145] As mentioned above, by setting the black screen state, the first blackboard area can also assume the function of a traditional blackboard, expanding the area of ​​the traditional blackboard. At the same time, when the user is writing, the smart blackboard can record the touch coordinates corresponding to the writing in the background, which is convenient for the user to use the recorded touch coordinates later.

[0146] Figure 4 A flowchart of an interactive control method of a smart blackboard provided in another embodiment of the present application. Figure 4 The interactive control method shown is a specific implementation based on the above embodiment. In this embodiment, the non-writing operation includes a gesture control operation.

[0147] refer to Figure 4 , the interactive control method specifically includes:

[0148] Step 201: Obtain the size data and arrangement relationship of the first blackboard area and the second blackboard area.

[0149] Exemplarily, the first blackboard area and the second blackboard area are both rectangular areas. The size data can be reflected by the length of two adjacent sides. For example, Figure 2In the smart blackboard shown, the size data of the second blackboard area on the left is a×d, wherein a is the length of the horizontal side, and d is the length of the vertical side adjacent to the horizontal side. The size data of the second blackboard area on the right is c×d, wherein c is the length of the horizontal side, and d is the length of the vertical side adjacent to the horizontal side. The size data of the first blackboard area in the middle is b×d, wherein b is the length of the horizontal side, and d is the length of the vertical side adjacent to the horizontal side. It should be noted that the embodiment does not limit the length unit used in the size data. Typically, the size data can be input by the user, that is, the user can input the size data of the first blackboard area and the second blackboard area respectively through the display screen, or the developer can store it in the electronic device corresponding to the second blackboard area before the smart blackboard leaves the factory.

[0150] The arrangement relationship refers to the positional relationship between the first blackboard area and the second blackboard area. When the first blackboard area and the second blackboard area are installed, the arrangement relationship can be obtained. Optionally, the arrangement relationship is a fixed relationship, for example, Figure 1 The arrangement relationship is that the first blackboard area is located on the right side of the second blackboard area. Figure 2 The arrangement relationship is that the two second blackboard areas are respectively located on the left and right sides of the first blackboard area. Typically, after the first blackboard area and the second blackboard area are installed or before installation, the arrangement relationship can be input by the user through the display screen.

[0151] Step 202: Determine a first touch coordinate range of the first blackboard area and a second touch coordinate range of the second blackboard area according to the size data, the arrangement relationship, and the detection area of ​​the touch module.

[0152] Exemplarily, the touch coordinate range corresponding to the first blackboard area and the touch coordinate range corresponding to the second blackboard area can be determined according to the size data and the arrangement relationship. Among them, the touch coordinate range corresponding to the first blackboard area is recorded as the first touch coordinate range. When the user touches the first blackboard area, the touch operation falls into the first touch coordinate range and can be detected by the touch module. Similarly, the touch coordinate range corresponding to the second blackboard area is recorded as the second touch coordinate range. When the user touches the second blackboard area, the touch operation falls into the second touch coordinate range and can be detected by the touch module. Specifically, after obtaining the size data and the arrangement relationship, the smart blackboard sends the size data and the arrangement relationship to the touch module, so that the touch module determines the first touch coordinate range and the second touch coordinate range in combination with the coordinate range of its own touch coordinate system, and sends the first touch coordinate range and the second touch coordinate range to the smart blackboard. Or, the smart blackboard obtains the coordinate range of the touch coordinate system from the touch module, and then determines the first touch coordinate range and the second touch coordinate range according to the coordinate range, the arrangement relationship and the size data. Among them, the coordinate range of the touch coordinate system can be understood as the detection area of ​​the touch module.

[0153] The method for calculating the first touch coordinate range and the second touch coordinate range can be set according to actual conditions, and the embodiment does not limit this. Figure 2 Taking the smart blackboard shown as an example, in the touch coordinate system established by the touch module, the lower left corner is the (0,0) coordinate point, and the upper right corner is the (x, y) coordinate point, that is, the coordinate range detected by the touch module is (0,0) to (x, y), the size data of the second blackboard area on the left is a×d, the size data of the second blackboard area on the right is c×d, and the size data of the first blackboard area in the middle is b×d. At this time, for the second blackboard area on the left, the corresponding second touch coordinate range is (0,0) to (x*a / (a+b+c), y), for the first blackboard area in the middle, the corresponding first touch coordinate range is (x*a / (a+b+c), 0) to (x*(a+b) / (a+b+c), y), and for the second blackboard area on the right, the corresponding second touch coordinate range is (x*(a+b) / (a+b+c), 0) to (x, y).

[0154] Step 203: Receive a first touch operation.

[0155] Specifically, when the user performs the first touch operation, the touch module detects the first touch operation and sends the corresponding touch coordinates to the smart blackboard. It can be understood that the process of the smart blackboard receiving the touch coordinates can be understood as receiving the first touch coordinates.

[0156] Step 204: Determine whether the first touch operation falls within the second touch coordinate range. If the first touch operation falls within the second touch coordinate range, determine that the first touch operation is directed to the second blackboard area, and execute step 206. Otherwise, determine that the first touch operation is directed to the first blackboard area, and execute step 205.

[0157] Specifically, after receiving the first touch operation, first determine whether the first touch operation acts on the second blackboard area. Among them, it can be determined whether the first touch operation acts on the second blackboard area by determining whether the touch coordinates of the first touch operation fall into the second touch coordinate range. It can also be determined whether the first touch operation acts on the second blackboard area by determining whether the touch coordinates of the first touch operation fall into the first touch coordinate range. Further, when the touch coordinates of the first touch operation fall into the second touch coordinate range (which can also be understood as not falling into the first touch coordinate range), it is determined that the first touch operation is directed to the second blackboard area, and step 206 is executed. When the touch coordinates of the first touch operation do not fall into the second touch coordinate range (which can also be understood as falling into the first touch coordinate range), it is determined that the first touch operation is directed to the first blackboard area, and step 205 is executed.

[0158] Step 205: respond to the first touch operation.

[0159] Specifically, when the first touch operation is directed to the first blackboard area, if the display screen is in a display state, it can be considered that the first touch operation is a touch operation directed to the electronic device. At this time, the response is performed according to the response strategy of the electronic device. Among them, the specific content of the response strategy is to determine the touch position of the first touch operation in the display screen according to the touch coordinates of the first touch operation, and then confirm the display content at the touch position, and then respond according to the display content. For example, when the display content is a virtual button of a certain function, the response strategy is to execute the function and display the response result of the function on the display screen. For another example, when the display content is a writing area, the response strategy is to display the writing track at the touch position. If the display screen is in a black screen state, it is processed in the manner of the second touch operation.

[0160] Step 206: Identify the number of touch points corresponding to the first touch operation.

[0161] Specifically, when the first touch operation is directed to the second blackboard area, the number of touch points of the first touch operation is identified, wherein the number of touch points is determined by the touch coordinates at the same time. A touch point can also be understood as a contact point. For a touch point, it can occupy one touch coordinate or multiple touch coordinates. When it occupies multiple touch coordinates, the multiple touch coordinates are continuous. Therefore, after obtaining the touch coordinates at the same time, the continuous touch coordinates are identified as one touch point. After traversing all the touch coordinates at the current time in this way, the number of touch points can be obtained.

[0162] Step 207, determine whether the number of contacts is equal to the set number of contacts. If the number of contacts is equal to the set number of contacts, execute step 208. If the number of contacts is not equal to the set number of contacts, execute step 210.

[0163] The number of contact points can be set according to actual conditions. In the embodiment, the number of contact points is used to indicate the number of contact points when the user writes in the second blackboard area. Generally speaking, when the user uses a writing pen to write in the second blackboard area, there is only one contact point, so the number of contact points is set to 1.

[0164] Further, it is determined whether the number of touch points of the first touch operation is equal to the set number of touch points, that is, whether the number of touch points is 1. If so, it is determined that the first touch operation is a writing operation, that is, step 208 is executed. If not, it means that the first touch operation is a multi-point touch, that is, the first touch operation is determined to be a gesture control operation, that is, step 210 is executed.

[0165] Optionally, in actual applications, there are multiple users writing in the second blackboard area at the same time, and there may be multiple touch points. In order to accurately identify the writing operation in the above situation, partition detection can be set. Specifically, when multiple users are writing, there will be a certain distance between each user, so that there is a certain distance between the touch points corresponding to each user. Therefore, with each touch point as the center, it is determined whether there are other touch points within the set distance range. If there are no other touch points, it can be determined that the first touch operation corresponding to the touch point is a single-point touch, and then the first touch operation is determined to be a writing operation. Conversely, if there are other touch points, it can be determined that the first touch operation corresponding to the touch point is a multi-point touch, and then the first touch operation is determined to be a non-writing operation. Among them, the specific value of the set distance range can be set according to actual conditions, and the embodiment does not limit this.

[0166] Step 208: Determine that the first touch operation is a writing operation.

[0167] Step 209: Displaying the touch track corresponding to the writing operation on the display screen.

[0168] Specifically, the touch track can be displayed in the setting interface. In this case, the setting step 209 includes steps 2091 and 2092:

[0169] Step 2091, calling out a trajectory display interface on the display screen.

[0170] The track display interface refers to a display interface for displaying the track written in the second blackboard area, wherein the display style of the track display interface can be set according to the actual situation, and the embodiment does not limit this. Specifically, when it is determined that the first touch operation is a writing operation, the track display interface is called out on the display screen. Optionally, the specific method of calling out the track display interface can be: popping up the track display interface in the form of a pop-up box, or pulling out the track display interface from the edge of the display screen in the form of a curtain.

[0171] Step 2092: Display the touch trajectory corresponding to the writing operation in the trajectory display interface.

[0172] After calling up the track display interface, the writing track is determined according to the touch coordinates of the writing operation, and the corresponding touch track is synchronously displayed on the track display interface. For example, Figure 5 This is a screenshot of the first display of the smart blackboard provided in the embodiment of the present application. Figure 5 The first blackboard area 21 displays a track display interface 23, and the current user writes content in the second blackboard area 22 such as Figure 5As shown, correspondingly, the touch track corresponding to the written content is synchronously displayed in the track display interface 23, and the touch track is in equal proportion to the written content. Optionally, the user can also perform writing operations in the track display interface.

[0173] Optionally, in addition to displaying the touch track, the smart blackboard background generates a file and synchronously records the touch coordinates of the writing operation.

[0174] Optionally, after the touch track is displayed, the user can edit the touch track at any time, such as enlarging the touch track, reducing the touch track, deleting the touch track, etc. In addition, the user can also exit the track display interface at any time according to actual needs. The above can be achieved through gesture control operations.

[0175] In one embodiment, after the touch track corresponding to the writing operation is displayed in the track display interface, it also includes: when confirming that the writing operation is over, exiting the track display interface. Specifically, when the touch module cannot detect the first touch operation, it stops sending the touch coordinates to the smart blackboard. At this time, the smart blackboard interrupts receiving the touch coordinates and determines that the first touch operation is over. After that, exit the track display interface. Among them, the way to exit the track display interface can be to minimize the track display interface, or to retract the track display interface displayed in a curtain-pulling manner. Optionally, before exiting the track display interface, a prompt box pops up to prompt the user whether to save the touch track displayed in the track display interface, and when the user chooses to save, the touch track is saved. Among them, the touch track is saved in the form of a file or a picture. Also optionally, if the touch coordinates are recorded in the background, the user can be prompted whether to edit the touch coordinates before exiting the track display interface to edit the touch coordinates recorded in the background.

[0176] Step 210: Determine that the first touch operation is a gesture control operation.

[0177] Specifically, when it is determined that the first touch operation is a multi-touch operation, the first touch operation is determined to be a gesture touch operation, and step 211 is executed.

[0178] Specifically, non-writing operations also include erasing operations. In actual applications, there are situations where users use their fingers to erase written content. At this time, multiple fingers may be used to erase together. In this case, although it is detected as multi-touch, its essence is an erasing operation. Therefore, in order to prevent the above situation, in the embodiment, when determining that the first touch operation is a gesture touch operation, it specifically includes: if the change direction of the touch coordinates of the first touch operation in the second blackboard area at adjacent moments is the same, then the first touch operation is determined to be an erasing operation; if the change direction of the touch coordinates at adjacent moments is different, then the first touch operation is determined to be a gesture control operation.

[0179] Generally speaking, when the user performs an erasing operation in the second blackboard area, at the same time, the contact points corresponding to the erasing operation move as a whole in the same direction, that is, the change direction between the touch coordinates of each contact point at the current moment and the touch coordinates at the previous moment is the same. For example, a certain erasing operation includes two contacts, which are recorded as contact 1 and contact 2. At the previous moment, the touch coordinates corresponding to contact 1 are (x1, y1), and the touch coordinates corresponding to contact 2 are (x2, y2). At the current moment, the touch coordinates corresponding to contact 1 are (x3, y3), and the touch coordinates corresponding to contact 2 are (x4, y4). If (x3, y3) is located on the left side of (x1, y1), then (x4, y4) is also located on the left side of (x2, y2). That is, the change direction of the touch coordinates of contact 1 and contact 2 at adjacent moments is both to the right. Based on this, it can be determined whether the first touch operation is an erasing operation by judging whether the change direction of the touch coordinates of the first touch operation at adjacent moments is the same. If the change directions of the touch coordinates of the first touch operation at adjacent moments are the same, it means that the first touch operation is an erase operation. At this time, a response is performed according to the response strategy of the erase operation, that is, step 214-step 215 is executed. If the change directions of the touch coordinates of the first touch operation at adjacent moments are different, it means that the user is performing other operations, and then the first touch operation is determined to be a gesture control operation, and then step 211 is executed.

[0180] Step 211: respond according to the response strategy of the non-writing operation, and display a display screen corresponding to the non-writing operation on the display screen.

[0181] Specifically, a response strategy for gesture control operations is pre-set, and responses are performed according to the response strategy for gesture control operations. When there are multiple gesture control operations, different gesture control operations correspond to different control instructions, and different control instructions correspond to different response strategies. At this time, setting step 211 includes steps 2111-2112:

[0182] Step 2111: determine a corresponding control instruction according to the touch coordinates of the gesture control operation in the second blackboard area.

[0183] Typically, the operation trajectory corresponding to each control instruction is preset, and different control instructions correspond to different operation trajectories. In an embodiment, in order to distinguish the preset operation trajectory from the operation trajectory of the currently detected gesture control operation, the preset operation trajectory is recorded as a reference operation trajectory. Afterwards, the touch coordinates of the gesture control operation are received, and the touch coordinates are connected in order according to the receiving time sequence to draw the operation trajectory corresponding to the gesture control operation. Afterwards, the operation trajectory of the gesture control operation is compared with each reference operation trajectory to find a reference operation trajectory that matches the operation trajectory. Afterwards, the control instruction corresponding to the matched reference operation trajectory is determined, and the control instruction is used as the control instruction indicated by the gesture control operation. Among them, the comparison method of the operation trajectory can be: calculating the similarity between the operation trajectory of the gesture control operation and each reference operation trajectory, and then selecting the reference operation trajectory with the highest similarity as the matching result, or determining whether the highest similarity exceeds the similarity threshold. If it exceeds the similarity threshold, the reference operation trajectory with the highest similarity is used as the matching result. If it does not exceed the similarity threshold, it is determined that the corresponding reference operation trajectory is not matched. At this time, no response is made to the gesture control operation, or the user is prompted to re-enter the gesture control operation. The comparison method of the operation trajectory can also be: obtaining the operation parameters of the operation trajectory, wherein the operation parameters include at least one item such as the number of contacts, the trajectory movement direction, the trajectory movement length, and the trajectory movement speed; then, comparing the operation parameters with the operation parameters of the reference operation trajectory; if the operation parameters are the same, it is determined that the corresponding reference operation trajectory is matched.

[0184] Step 2112, respond to the control instruction, and display the corresponding control result on the display screen.

[0185] Specifically, respond to the control instruction, and in the response process, determine whether it is necessary to display the corresponding control result on the display screen, and if so, display the corresponding control result on the display screen. Otherwise, keep the current display screen of the display screen. The control instruction includes: reducing the touch track on the display screen, enlarging the touch track on the display screen, exiting the display of the touch track, or controlling the display screen to a black screen state.

[0186] For example, Figure 6 This is a second display screenshot of the smart blackboard provided in the embodiment of the present application. Among them, the control instruction is to enlarge the touch track in the display screen, and the operating parameters of the reference operation track are: two touch points and the two touch points move back to back at the same time. Figure 6As shown, after receiving the gesture control operation, when drawing the operation trajectory, the operation parameters are determined as: two touch points, and the two touch points move in opposite directions at the same time. At this time, the corresponding reference operation trajectory can be matched according to the operation parameters, and then the control instruction is determined to enlarge the touch trajectory in the display screen, and the enlarged touch trajectory is displayed on the right display screen. For another example, Figure 7 This is a third display screenshot of the smart blackboard provided in the embodiment of the present application. The control instruction is to reduce the touch track in the display screen, and the operating parameters of the reference operation track are: two touch points and the two touch points move towards each other at the same time. Figure 7 After receiving the gesture control operation, when drawing the operation trajectory, the operation parameters are determined to be: two contact points, and the two contact points move toward each other at the same time. At this time, the corresponding reference operation trajectory can be matched according to the operation parameters, and then the control instruction is determined to reduce the touch trajectory in the display screen, and the reduced touch trajectory is displayed on the right display screen. It should be noted that there may be multiple groups of touch tracks in the display screen (such as touch tracks written in different time periods). At this time, when the touch track is enlarged or reduced according to the gesture control operation, all touch tracks in the display screen are specifically enlarged or reduced. For example, Figure 8 This is the fourth display screenshot of the smart blackboard provided by the embodiment of the present application. The control command is to exit the track display interface, and the reference operation track is the track when the five contacts gather and move. Figure 8 After receiving the gesture control operation, the operation trajectory is drawn: the five contact points move together. At this time, the corresponding reference operation trajectory can be matched according to the operation trajectory, and then the control instruction is determined to exit the trajectory display interface (that is, exit the display of the touch trajectory), and exit the trajectory display interface on the right display screen.

[0187] As mentioned above, by calculating the first touch coordinate range and the second touch coordinate range through the size data and the arrangement relationship, the smart blackboard can clearly understand the touch detection range corresponding to the traditional blackboard and the electronic device, thereby accurately identifying the touch operations received by the traditional blackboard and the electronic device. In addition, when the first touch operation is directed to the first blackboard area, the response is performed according to the response strategy corresponding to the first blackboard area. When the first touch operation is directed to the second blackboard area, the response is performed according to the response strategy corresponding to the second blackboard area, thereby accurately responding to the touch operation. Furthermore, by setting the number of contacts, the writing operation and the non-writing operation can be accurately distinguished, thereby facilitating the accurate implementation of the subsequent process. At the same time, by setting the gesture control operation, the electronic device can be controlled on the traditional blackboard.

[0188] On the basis of the above embodiment, the non-writing operation also includes a shortcut function triggering operation. At this time, at least one silk screen button is displayed in the second blackboard area, and each silk screen button corresponds to a different button function, such as a silk screen button corresponding to a button function for triggering a black screen instruction, and another silk screen button corresponding to a button function for exiting the track display interface. When the user clicks the silk screen button, the number of its contacts is equal to the set number of contacts, so the click action may be identified as a writing operation. In order to avoid the above situation, when a silk screen button is displayed in the second blackboard area, the specific determination logic for determining that the first touch operation is a writing operation in step 208 includes: determining whether the touch coordinates of the first touch operation in the second blackboard area fall into the coordinate range of the shortcut key. If the touch coordinates of the first touch operation in the second blackboard area fall into the coordinate range of the shortcut key, the first touch operation is determined to be a shortcut function triggering operation. Afterwards, a response is performed according to the response strategy of the non-writing operation, and the display screen corresponding to the non-writing operation is displayed on the display screen. If the touch coordinates do not fall into the coordinate area of ​​the shortcut key, the first touch operation is determined to be a writing operation.

[0189] In the embodiment, the silk screen key is recorded as a shortcut key, and the key function corresponding to the silk screen key is recorded as a shortcut function. Specifically, the coordinate range of the touch coordinates occupied by each shortcut key in the second blackboard area, as well as the correspondence between the coordinate range and the key function, are recorded in advance. When the touch coordinates of the first touch operation are obtained, it is determined whether the touch coordinates fall into the coordinate range of a shortcut key. Optionally, when there are multiple touch coordinates, as long as any one of the touch coordinates falls into the coordinate range of the shortcut key, it can be considered that all the touch coordinates fall into the coordinate range of the shortcut key. Further, when it is determined that the touch coordinates fall into the coordinate range of the shortcut key, it can be confirmed that the first touch operation is used to trigger the shortcut function corresponding to the shortcut key. Therefore, the first touch operation is identified as a shortcut function triggering operation. It can be understood that the shortcut function triggering operation is a kind of non-writing operation. Afterwards, respond according to the response strategy of the shortcut function triggering operation, that is, respond according to the response strategy of the non-writing operation, and display the display screen corresponding to the non-writing operation in the display screen. When the touch coordinates do not fall within the coordinate range of the shortcut key, it can be determined that the first touch operation is a writing operation. Afterwards, a response is performed according to the response strategy of the writing operation, that is, step 209 is executed.

[0190] Typically, when the non-writing operation is a quick function triggering operation, responding according to the response strategy of the non-writing operation and displaying a display screen corresponding to the non-writing operation on the display screen may include steps 212 and 213.

[0191] Step 212: confirm the shortcut function corresponding to the coordinate range within which the touch coordinates of the shortcut function triggering operation fall, and different shortcut functions correspond to different coordinate ranges.

[0192] Since the correspondence between the coordinate range and the shortcut function is pre-recorded, when the non-writing operation is a shortcut function triggering operation, the shortcut function corresponding to the coordinate range within which the touch coordinates of the shortcut function triggering operation fall is determined.

[0193] Step 213: execute the shortcut function and display the corresponding function execution result on the display screen.

[0194] For example, when the shortcut function is to trigger a black screen command, after executing the shortcut function, the function execution result is to set the display screen to a black screen state. For another example, when the shortcut function is to exit the track display interface, after executing the shortcut function, the function execution result is to exit the track display interface on the display screen and restore the display screen to the screen before the track display interface was displayed.

[0195] As described above, by presetting shortcut keys and corresponding coordinate ranges, it is possible to trigger shortcut functions in a traditional blackboard. At the same time, by comparing the touch coordinates of the first touch operation and the coordinate range of the shortcut key, the writing operation and the shortcut key triggering operation can be accurately distinguished.

[0196] On the basis of the above embodiment, non-writing operations also include erasing operations and teaching aid use operations. Considering that when the user uses the eraser to perform an erasing operation, the number of contacts corresponding to the contact coordinates detected by the touch module is one, that is, the number of contacts is equal to the set number of contacts. Alternatively, when the user places teaching aids in the second blackboard area, the number of contacts between the teaching aids and the second blackboard area may also be one, that is, the number of contacts is equal to the set number. At this time, in order to prevent misjudgment of the first touch operation, the specific determination logic when determining that the first touch operation is a writing operation is set in the embodiment as follows: obtaining the track width of the first touch operation, if the track width is less than the first width threshold, then determining that the first touch operation is a writing operation.

[0197] It can be understood that when the user is writing, the contact area between the writing pen and the second blackboard area is small, and when the teaching aids or the eraser are placed for erasing, the contact area between the teaching aids or the eraser and the second blackboard area is large. Therefore, the writing operation and other operations can be zoned by the contact area. Further, in order to simplify the complexity of data processing, in the embodiment, the contact area is reflected by the track width. Generally speaking, the larger the track width, the larger the corresponding contact area, and the smaller the track width, the smaller the corresponding contact area. Optionally, the track width can be understood as the width of the contact point. After obtaining the touch coordinates, the distance between any two touch coordinates in the contact point is calculated, and then the maximum distance is selected as the track width corresponding to the contact point. Since the first touch operation includes multiple moments, at this time, the track width obtained at any moment can be used as the track width of the first touch operation, or the track width obtained at a set moment (such as the first moment) can be used as the track width of the first touch operation.

[0198] Afterwards, it is determined whether the track width is less than the first width threshold. If the track width is less than the first width threshold, the first touch operation is determined to be a writing operation. The first width threshold can be set according to actual conditions. For example, the first width threshold is set to 2 cm, which is less than the width of two fingers of the user and greater than the width of the writing pen used by the user. If the track width is less than the first width threshold, it means that the contact area is small, so the first touch operation can be determined to be a writing operation.

[0199] Furthermore, considering that the user will use a finger or a pointer to indicate the written content when explaining the written content in the second blackboard area, at this time, there is a situation where the finger or the pointer contacts the second blackboard area. Since the contact area of ​​the finger or the pointer is small, and the contact area is usually less than the first width threshold, it is easy to misidentify the operation of the user indicating the written content as a writing operation. Therefore, in the embodiment, setting the determination that the first touch operation is a writing operation if the track width is less than the first width threshold includes: if the track width is less than the first width threshold, determining whether the touch coordinates of the first touch operation in the second blackboard area change continuously; if the touch coordinates change continuously, determining that the first touch operation is a writing operation.

[0200] Specifically, considering that when the user is writing, the detected touch operation should be continuously moving. At this time, the corresponding touch coordinates should change continuously. Therefore, after the track width is less than the first width threshold, it is determined whether the touch coordinates change continuously. If they change continuously, it means that the user is writing, that is, the first touch operation is a writing operation.

[0201] Furthermore, the embodiment also includes: if the touch coordinates do not change continuously, obtaining the touch duration of the first touch operation; if the touch duration reaches a first duration threshold, determining that the first touch operation is a writing operation; if the touch duration does not reach the first duration threshold, giving up responding to the first touch operation.

[0202] If the touch coordinates do not change continuously, it means that the user may be indicating the written content, or the user is thinking about the written content. Generally speaking, when the user indicates the written content, he usually indicates the written content by clicking. At this time, the contact time between the indicating operation and the second blackboard area is short, and when the user is writing, he usually has a certain contact time. Therefore, it is possible to identify whether the first touch operation is a writing operation by the contact time of the first touch operation. Specifically, if the touch coordinates do not change continuously, the touch time of the first touch operation is obtained. Among them, the touch time can also be understood as the contact time, which can be determined by the reception time of the touch coordinates. During the operation of the first touch operation, the touch coordinates are continuously received. At this time, the continuous reception time of the touch coordinates is counted and used as the touch time of the first touch operation. Further, after obtaining the touch time, it is determined whether the touch time reaches the first time threshold. If the touch time reaches the first time threshold, it can be determined that the first touch operation is a writing operation, that is, step 208 is executed; if the touch time does not reach the first time threshold, it means that the user is not writing, but indicating the display content. At this time, it can be processed according to the indication event, that is, the response to the first touch operation is abandoned. It can be understood that the first time threshold mentioned above can also be considered as the minimum time for the user to write, and its specific value can be set according to actual conditions.

[0203] It should be noted that if there is a shortcut key in the second blackboard area, it is possible to first identify whether the touch coordinates of the first touch operation fall within the coordinate range corresponding to the shortcut key, and if not, obtain the track width and compare the track width with the first width threshold.

[0204] Furthermore, if the track width is greater than or equal to the first width threshold, it means that the contact area is large, and the first touch operation may be an erasing operation or a teaching aid use operation, so further confirmation is required. At this time, non-writing operations also include erasing operations and teaching aid use operations. After setting the judgment of whether the track width is less than the first width threshold, it also includes: if the track width is greater than or equal to the first width threshold, then judging whether the track width is greater than the second width threshold, and the second width threshold is greater than the first width threshold; if the track width is greater than the second width threshold, then judging whether the touch coordinates of the first touch operation in the second blackboard area change continuously; if the touch coordinates change continuously, then determining that the first touch operation is an erasing operation; if the touch coordinates do not change continuously, then determining that the first touch operation is a teaching aid use operation.

[0205] The second width threshold can be understood as the minimum track width of the user in contact with the second blackboard area when performing an erasing operation or a teaching aid use operation. The second width threshold is greater than the first width threshold, and its specific value is set according to actual conditions. For example, the second width threshold is set equal to or slightly less than the width of the palm. Specifically, it is determined whether the track width is greater than the second width threshold. If the track width is greater than the second width threshold, it means that the first touch operation may be an erasing operation or a teaching aid use operation, and therefore, further identification is required.

[0206] Exemplary, taking the case where a user uses an eraser to perform an erasing operation as an example, at this time, the user needs to move the eraser to erase the written content. Accordingly, the touch coordinates detected by the touch module change continuously with the movement of the eraser. Similarly, after the user places a teaching aid in the second blackboard area, the teaching aid is usually fixed in the second blackboard area. At this time, the touch coordinates detected by the touch module are fixed. Therefore, the erasing operation or the teaching aid use operation can be identified by judging whether the touch coordinates change continuously. Further, when the touch coordinates change continuously, it is determined that the first touch operation is an erasing operation, and then, a response strategy according to the non-writing operation is executed to respond, and a display screen corresponding to the non-writing operation is displayed in the display screen. When the touch operation does not change continuously, it is determined that the first touch operation is a teaching aid use operation, and then, a response strategy according to the non-writing operation is executed to respond, and a display screen corresponding to the non-writing operation is displayed in the display screen.

[0207] Optionally, considering that in actual applications, users may use other tools with a width greater than the second track width to indicate written content. Therefore, in order to more accurately identify erasing operations and teaching aid use operations, it is set in the embodiment that if the track width is greater than the second width threshold, then judging whether the touch coordinates of the first touch operation in the second blackboard area change continuously includes: if the track width is greater than the second width threshold, then judging whether the duration of the initial touch coordinates reaches the second duration threshold, and the initial touch coordinates are the coordinates with the earliest collection time among the touch coordinates; if the duration of the initial touch coordinates reaches the second duration threshold, then judging whether the touch coordinates change continuously.

[0208] Among them, the coordinates with the earliest collection time in the touch coordinates can also be understood as the touch coordinates collected when the first touch coordinates are just detected, that is, the first touch coordinates received. In the embodiment, the touch coordinates are marked as initial touch coordinates. Specifically, it is determined whether the duration of the initial touch coordinates reaches the second duration threshold, wherein the second duration threshold refers to the short duration of the eraser or teaching aids when they just touch the second blackboard area under the erasing operation or the teaching aid use operation. The specific value can be set according to the actual situation, and the judgment of the erasing operation and the teaching aid use operation is started by setting the second duration threshold. The duration of the initial touch coordinates refers to the duration of continuously receiving the fixed initial touch coordinates. For example, the currently detected initial touch coordinates are (x5, y5). At this time, the duration of the initial touch coordinates refers to the duration of continuously receiving (x5, y5). Afterwards, it is determined whether the duration of the initial touch coordinates reaches the second duration threshold. If the second duration threshold is reached, the erasing operation or the teaching aid use operation is judged, that is, whether the touch coordinates change continuously is judged. It should be noted that when judging whether the touch coordinates change continuously, it can be judged whether the touch coordinates other than the initial touch coordinates change continuously. If the second duration threshold is not reached, the first touch operation is confirmed as an indication operation performed by the user, and at this time, the response to the first touch operation is abandoned. It can be understood that the second duration threshold and the first duration threshold can be the same or different, and the embodiment does not limit it.

[0209] Furthermore, if the track width is less than or equal to the second width threshold, it means that the user is not currently performing an erasing operation or a teaching aid use operation. At this time, the first touch operation can be identified as a gesture control operation, that is, if the track width is less than or equal to the second width threshold, the first touch operation is determined to be the gesture control operation (that is, executing step 210). Thereafter, a response is performed based on the response strategy of the gesture control operation. It can be understood that if the corresponding control instruction is not matched when responding to the gesture control operation, the response to the first touch operation will be abandoned.

[0210] As described above, by setting corresponding determination rules based on the first width threshold, the second width threshold, the first duration threshold, the second duration threshold and the continuous change rule of the touch coordinates, accurate recognition of writing operations, erasing operations and teaching aid use operations can be achieved.

[0211] In one embodiment, after determining that the first touch operation is an erasing operation, a response according to the response strategy of the non-writing operation can be executed, and a display screen corresponding to the non-writing operation can be displayed on the display screen. In an embodiment, when the non-writing operation is set as an erasing operation, responding according to the response strategy of the non-writing operation and displaying the display screen corresponding to the non-writing operation on the display screen specifically includes: erasing the corresponding touch track on the display screen according to the touch coordinates of the erasing operation in the second blackboard area.

[0212] Specifically, taking the touch track displayed on the track display interface as an example, when the touch track of the writing operation is displayed on the display screen, there is a coordinate mapping relationship between the track display interface and the second blackboard area, and the coordinate mapping relationship can be determined according to the second touch coordinate range of the second blackboard area and the display coordinate range of the track display interface, and the coordinate mapping relationship can be determined when determining the track display interface. Further, when an erase operation is received, the touch coordinates of the erase operation in the second blackboard area are obtained, and then the display coordinates corresponding to the touch coordinates in the display screen are determined according to the coordinate mapping relationship.

[0213] After finding the display coordinates on the display screen, the display content on the display coordinates is erased, that is, the pixel value of the pixel point on the display coordinates is modified to the pixel value corresponding to the background color in the track display interface. At this time, the user's intuitive feedback from the display screen is that the touch track displayed on the display coordinates has been erased.

[0214] For example, Fig. 9 This is a fifth display screenshot of the smart blackboard provided in the embodiment of the present application. Fig. 9 The user uses the eraser 24 to perform an erasing operation in the second blackboard area. At this time, after the smart blackboard detects the erasing operation, it erases the corresponding display content in the display screen of the first blackboard area according to the coordinate mapping relationship, that is, erases the corresponding touch track.

[0215] As described above, by setting the coordinate mapping relationship, the second blackboard area and the display screen can be erased synchronously, which enriches the interactive content between the first blackboard area and the second blackboard area and improves the functionality of the smart blackboard.

[0216] In one embodiment, after determining that the first touch operation is a teaching aid use operation, a response according to the response strategy of the non-writing operation can be executed, and a display screen corresponding to the non-writing operation is displayed on the display screen. In an embodiment, when setting a non-writing operation as a teaching aid use operation, responding according to the response strategy of the non-writing operation, and displaying a display screen corresponding to the non-writing operation on the display screen specifically includes: shielding the touch coordinates of the teaching aid use operation in the second blackboard area, and maintaining the current display screen of the display screen.

[0217] Specifically, shielding the touch coordinates of the teaching aid use operation means that the background records that a teaching aid is placed at the touch coordinates, and does not display the corresponding touch track on the display screen. At this time, the touch operation corresponding to the touch coordinates is abandoned. Optionally, if the touch coordinates of the writing operation are recorded in the background, and the touch coordinates of the teaching aid use operation are repeated with the touch coordinates of the writing operation, then when shielding the touch coordinates of the teaching aid use operation, the record of the touch coordinates of the teaching aid use operation can also be deleted from the recorded touch coordinates of the writing operation. Also optionally, if the writing content has been displayed at the touch coordinates of the teaching aid use operation, the touch track at the corresponding position is retained on the display screen. For example, Fig.10 This is a sixth display screenshot of the smart blackboard provided in the embodiment of the present application. Fig.10 , the user places the teaching aid 25 in the second blackboard area, and there is already writing content at the placement position of the teaching aid 25, then the touch track at the corresponding position is retained in the display screen of the first blackboard area.

[0218] As described above, the method of shielding the touch coordinates realizes the response to the operation of using the teaching aids, enriches the interactive content between the first blackboard area and the second blackboard area, and improves the functionality of the smart blackboard.

[0219] Fig.11 A flowchart of an interactive control method of a smart blackboard provided for another embodiment of the present application. This embodiment is an exemplary description based on the above embodiment. In this embodiment, the first touch coordinate range of the first blackboard area and the second touch coordinate range of the second blackboard area have been determined according to the installation positions of the first blackboard area and the second blackboard area. Specifically, refer to Fig.11 The interactive control method provided in this embodiment specifically includes:

[0220] Step 301: Receive a first touch operation.

[0221] Step 302, determine whether the first touch operation falls within the second touch coordinate range. If so, determine that the first touch operation is directed to the second blackboard area, and execute step 304. Otherwise, determine that the first touch operation is directed to the first blackboard area, and execute step 303.

[0222] Step 303: respond to the first touch operation according to the response strategy of the first blackboard area, and display the response result on the display screen.

[0223] Step 304: Identify the number of touch points corresponding to the first touch operation.

[0224] Step 305, determine whether the number of contacts is equal to the set number of contacts. If the number of contacts is equal to the set number of contacts, execute step 306. If the number of contacts is not equal to the set number of contacts, execute step 325.

[0225] Step 306: Determine whether the touch coordinates of the first touch operation in the second blackboard area fall within the coordinate range of the shortcut key. If the touch coordinates fall within the coordinate range of the shortcut key, determine that the first touch operation is a shortcut function triggering operation, and execute step 307. If the touch coordinates do not fall within the coordinate range of the shortcut key, execute step 309.

[0226] Step 307: confirm the shortcut function corresponding to the coordinate area where the touch coordinates of the shortcut function triggering operation fall.

[0227] Among them, different shortcut functions correspond to different coordinate areas.

[0228] Step 308: execute the shortcut function and display the corresponding function execution result on the display screen.

[0229] Step 309: Obtain the track width of the first touch operation.

[0230] Step 310: Determine whether the track width is less than a first width threshold. If the track width is less than the first width threshold, execute step 311. If the track width is greater than or equal to the first width threshold, execute step 319.

[0231] Step 311, determine whether the touch coordinates change continuously. If the touch coordinates change continuously, determine that the first touch operation is a writing operation, and execute step 315. If the touch coordinates do not change continuously, execute step 312.

[0232] Step 312: Obtain the touch duration of the first touch operation.

[0233] Step 313: Determine whether the touch duration reaches a first duration threshold. If it reaches the first duration threshold, determine that the first touch operation is a writing operation, and execute step 315. If it does not reach the first duration threshold, execute step 314.

[0234] Step 314: Give up responding to the first touch operation.

[0235] Step 315: Call out the trajectory display interface on the display screen.

[0236] Step 316: Display the touch track corresponding to the writing operation in the track display interface, and record the touch coordinates of the first touch operation in the second blackboard area.

[0237] Step 317: Determine whether the writing operation is finished. If it is confirmed that the writing operation is finished, execute step 318. Otherwise, return to execute step 316.

[0238] Step 318: exit the trajectory display interface.

[0239] Step 319: Determine whether the track width is greater than the second width threshold. If the track width is greater than the second width threshold, execute step 320. If the track width is less than or equal to the second width threshold, execute step 325.

[0240] Step 320: Determine whether the duration of the initial touch coordinates reaches the second duration threshold. If it is determined that the duration of the initial touch coordinates reaches the second duration threshold, execute step 321. If it is determined that the duration of the initial touch coordinates does not reach the second duration threshold, execute step 314.

[0241] Step 321, determine whether the touch coordinates change continuously. If the touch coordinates change continuously, determine that the first touch operation is an erase operation, and execute step 322. If the touch coordinates do not change continuously, determine that the first touch operation is a teaching aid use operation, and execute step 324.

[0242] Step 322: According to the touch coordinates of the erase operation, search for corresponding touch coordinates in the display screen.

[0243] Step 323: Erase the touch track displayed on the found touch coordinates.

[0244] Step 324: shield the touch coordinates of the teaching aid usage operation and keep the current display screen.

[0245] Step 325: Determine whether the change directions of the touch coordinates of the first touch operations at adjacent moments are the same. If the change directions of the touch coordinates of the first touch operations at adjacent moments are the same, determine that the first touch operation is an erase operation, and execute step 322. If the change directions of the touch coordinates of the first touch operations at adjacent moments are different, determine that the first touch operation is a gesture control operation, and execute step 326.

[0246] Step 326: Determine the operation trajectory of the gesture control operation according to the touch coordinates of the gesture control operation.

[0247] Step 327: Match the corresponding control instruction according to the operation trajectory.

[0248] Step 328: respond to the control instruction and display the corresponding control result on the display screen.

[0249] As described above, data interaction between the traditional blackboard and the electronic device is realized, and the electronic device can respond to the writing operation, shortcut key trigger operation, erasing operation, gesture control operation and teaching aid use operation on the traditional blackboard respectively, enriching the functionality of the smart blackboard.

[0250] Fig.12 A schematic diagram of the structure of an interactive control device for a smart blackboard provided in one embodiment of the present application. The smart blackboard includes a touch module, at least one first blackboard area and at least one second blackboard area, wherein a display screen is installed in the first blackboard area, and the touch module is used to detect touch operations on the first blackboard area and the second blackboard area. Fig.12 The interactive control device includes: a first receiving module 401, a first processing module 402, and a second processing module 403.

[0251] Among them, the first receiving module 401 is used to receive a first touch operation for the second blackboard area; the first processing module 402 is used to display the touch track corresponding to the writing operation on the display screen when the first touch operation is a writing operation; the second processing module 403 is used to respond according to the response strategy of the non-writing operation when the first touch operation is a non-writing operation, and display the display screen corresponding to the non-writing operation on the display screen.

[0252] In the above, by receiving the first touch operation for the second blackboard area, and when the first touch operation is a writing operation, the touch track corresponding to the first touch operation is displayed in the display screen installed in the first blackboard area, and when the first touch operation is a non-writing operation, the response is performed according to the response strategy of the non-writing operation, and the technical means of displaying the corresponding display screen in the display screen solves the technical problem that the traditional blackboard and the electronic device in the smart blackboard of the prior art cannot realize data interaction, and the touch function of the first blackboard area and the second blackboard area can be realized by setting a touch module for detecting the first blackboard area and the second blackboard area. Afterwards, when the user operates in the second blackboard area, the touch module can detect the corresponding touch operation, and then the smart blackboard responds according to the detected touch operation, thereby realizing the data interaction between the second blackboard area and the first blackboard area. Further, when the user writes in the second blackboard area, the touch track corresponding to the writing is displayed in the display screen, and at this time, other users can view the writing content through the display screen, so as to avoid the situation that the user blocks the writing content during the writing process so that other users cannot view the writing content in time. Furthermore, the user can also perform non-writing operations in the second blackboard area. At this time, the smart tablet can respond according to the non-writing operations and display the corresponding display screen on the display screen, thereby realizing the control of the electronic device through the traditional blackboard.

[0253] Based on the above embodiment, the first processing module 402 includes: an interface wake-up unit, which is used to call out a trajectory display interface in the display screen when the first touch operation is a writing operation; and a trajectory display unit, which is used to display a touch trajectory corresponding to the writing operation in the trajectory display interface.

[0254] On the basis of the above embodiment, it further includes: an interface exit module, which is used to exit the track display interface after displaying the touch track corresponding to the writing operation in the track display interface and confirming that the writing operation is completed.

[0255] On the basis of the above embodiment, it also includes: a first instruction receiving module, used to receive a black screen instruction; a black screen module, used to control the display screen to a black screen state in response to the black screen instruction; a second receiving module, used to receive a second touch operation acting on the display screen; and a recording module, used to record the touch coordinates of the second touch operation in the first blackboard area if the second touch operation is a writing operation.

[0256] On the basis of the above embodiment, it also includes: a third receiving module, which is used to receive a third touch operation acting on the touch trajectory after displaying the touch trajectory corresponding to the writing operation on the display screen, and the third touch operation is used to edit the touch trajectory; a trajectory editing module, which is used to display the corresponding touch trajectory editing result on the display screen in response to the third touch operation.

[0257] Based on the above embodiment, the non-writing operation is at least one of an erasing operation, a shortcut function triggering operation, a teaching aid use operation, and a gesture control operation.

[0258] On the basis of the above embodiment, the non-writing operation is an erasing operation, and the second processing module 403 is specifically used to: erase the corresponding touch track in the display screen according to the touch coordinates of the erasing operation in the second blackboard area.

[0259] Based on the above embodiment, the non-writing operation is a gesture control operation, and the second processing module 403 includes: an instruction determination unit, which is used to determine the corresponding control instruction according to the touch coordinates of the gesture control operation in the second blackboard area when the first touch operation is a non-writing operation; an instruction response unit, which is used to respond to the control instruction and display the corresponding control result on the display screen.

[0260] Based on the above embodiment, the control instruction includes: reducing the touch track in the display screen, enlarging the touch track in the display screen, exiting displaying the touch track, or controlling the display screen to a black screen state.

[0261] Based on the above embodiment, the non-writing operation is a teaching aid operation, and the second processing module 403 is specifically used for: when the first touch operation is a non-writing operation, shielding the touch coordinates of the teaching aid operation in the second blackboard area and maintaining the current display screen of the display screen.

[0262] Based on the above embodiment, the non-writing operation is a shortcut function triggering operation, and the second processing module 403 includes: a function determination unit, which is used to confirm the shortcut function corresponding to the coordinate range within which the touch coordinates of the shortcut function triggering operation fall when the first touch operation is a non-writing operation, and different shortcut functions correspond to different coordinate ranges; a function execution unit, which is used to execute the shortcut function and display the corresponding function execution result on the display screen.

[0263] On the basis of the above embodiment, the non-writing operation includes a gesture control operation, and the interactive control device also includes: a contact recognition module, which is used to identify the number of contacts corresponding to the first touch operation after receiving the first touch operation on the second blackboard area; a first writing determination module, which is used to determine that the first touch operation is a writing operation if the number of contacts is equal to the set number of contacts; and a first gesture determination module, which is used to determine that the first touch operation is a gesture control operation if the number of contacts is not equal to the set number of contacts.

[0264] On the basis of the above embodiment, the non-writing operation also includes a shortcut function trigger operation, and the first writing judgment module includes: a shortcut function judgment unit, which is used to determine that the number of contacts is equal to the set number of contacts, and if the touch coordinates of the first touch operation in the second blackboard area fall within the coordinate range of the shortcut key, the first touch operation is determined to be a shortcut function trigger operation; a writing judgment unit, which is used to determine that the first touch operation is a writing operation if the touch coordinates do not fall within the coordinate range of the shortcut key.

[0265] On the basis of the above embodiment, the first writing determination module is specifically used for: if the number of contact points is equal to the set number of contact points, then obtaining the track width of the first touch operation; if the track width is less than the first width threshold, then determining that the first touch operation is a writing operation. Alternatively, the writing determination unit is specifically used for: if the touch coordinates do not fall within the coordinate range of the shortcut key, then obtaining the track width of the first touch operation; if the track width is less than the first width threshold, then determining that the first touch operation is a writing operation.

[0266] Based on the above embodiment, if the track width is less than the first width threshold, the first touch operation is determined to be a writing operation. Specifically, if the track width is less than the first width threshold, it is determined whether the touch coordinates of the first touch operation in the second blackboard area change continuously; if the touch coordinates change continuously, the first touch operation is determined to be a writing operation.

[0267] On the basis of the above embodiment, it also includes: a duration acquisition module, which is used to obtain the touch duration of the first touch operation if the touch coordinates do not change continuously; a second writing determination module, which is used to determine that the first touch operation is a writing operation if the touch duration reaches a first duration threshold; and a response abandonment module, which is used to abandon responding to the first touch operation if the touch duration does not reach the first duration threshold.

[0268] On the basis of the above embodiment, the non-writing operation also includes an erasing operation and a teaching aid use operation, and the interactive control device also includes: a width comparison module, which is used to determine whether the track width is greater than a second width threshold if the track width is greater than or equal to the first width threshold, and the second width threshold is greater than the first width threshold; a coordinate judgment module, which is used to determine whether the touch coordinates of the first touch operation in the second blackboard area change continuously if the track width is greater than the second width threshold; an erasing judgment module, which is used to determine that the first touch operation is an erasing operation if the touch coordinates change continuously; and a teaching aid judgment module, which is used to determine that the first touch operation is a teaching aid use operation if the touch coordinates do not change continuously.

[0269] On the basis of the above embodiment, it further includes: a second gesture determination module, configured to determine that the first touch operation is the gesture control operation if the track width is less than or equal to the second width threshold.

[0270] On the basis of the above embodiment, the coordinate judgment module includes: a duration judgment unit, which is used to judge whether the duration of the initial touch coordinates reaches the second duration threshold if the track width is greater than the second width threshold, and the initial touch coordinates are the coordinates with the earliest collection time among the touch coordinates; a coordinate continuity judgment unit, which is used to judge whether the touch coordinates change continuously if the duration of the initial touch coordinates reaches the second duration threshold.

[0271] Based on the above embodiment, the first gesture determination module or the second gesture determination module also includes: an erasing determination unit, which is used to determine that the first touch operation is an erasing operation if the change directions of the touch coordinates of the first touch operation in the second blackboard area at adjacent moments are the same; a gesture determination unit, which is used to determine that the first touch operation is a gesture control operation if the change directions of the touch coordinates at adjacent moments are different.

[0272] On the basis of the above embodiment, the first processing module 402 is further configured to: record the touch coordinates of the first touch operation in the second blackboard area.

[0273] On the basis of the above embodiment, it further includes: a relationship acquisition module, used to acquire the size data and arrangement relationship of the first blackboard area and the second blackboard area; an area determination module, used to determine the first touch coordinate range of the first blackboard area and the second touch coordinate range of the second blackboard area according to the size data, the arrangement relationship and the detection area of ​​the touch module. Correspondingly, the first receiving module 401 includes: an operation receiving unit, used to receive the first touch operation; an operation determination unit, used to determine that the first touch operation is for the second blackboard area when the first touch operation falls into the second touch coordinate range.

[0274] On the basis of the above embodiment, it also includes: a fourth receiving module, which is used to receive a fourth touch operation acting on the display screen after recording the touch coordinates of the first touch operation in the second blackboard area, and the fourth touch operation is used to edit the recorded touch coordinates; an editing module, which is used to edit the recorded touch coordinates in response to the fourth touch operation.

[0275] The interactive control device of the smart blackboard provided above can be used to execute the interactive control method of the smart blackboard provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0276] It is worth noting that in the embodiment of the interactive control device of the above-mentioned smart blackboard, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0277] The embodiment of the present application also provides a smart blackboard, which includes a touch module, at least one first blackboard area and at least one second blackboard area, wherein an electronic device with a display screen is installed in the first blackboard area, the first blackboard area and the second blackboard area are arranged side by side, the touch module surrounds the first blackboard area and the second blackboard area, and the touch module is used to detect touch operations on the first blackboard area and the second blackboard area. The touch module can communicate data with the electronic device to report the detected touch coordinates. Furthermore, the touch module is an infrared touch frame.

[0278] Furthermore, Fig.13 This is a schematic diagram of the structure of an electronic device provided by one embodiment of the present application. Fig.13 As shown, the electronic device 50 includes at least one processor 51 , at least one network interface 52 , a user interface 53 , a memory 54 , and at least one communication bus 55 .

[0279] The communication bus 55 is used to realize the connection and communication between these components.

[0280] The user interface 52 may include a display screen and a camera, and the optional user interface 53 may also include a standard wired interface and a wireless interface.

[0281] The network interface 52 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface).

[0282] Among them, the processor 51 may include one or more processing cores. The processor 51 uses various interfaces and lines to connect various parts of the entire electronic device 50, and executes various functions and processes data of the electronic device 50 by running or executing instructions, programs, code sets or instruction sets stored in the processor 51, and calling data stored in the memory 54. Optionally, the processor 51 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic arrays (Programmable logicarrays, PLA). The processor 51 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 51, and can be implemented separately through a chip.

[0283] The memory 54 may include a random access memory (RAM) or a read-only memory (Read-Only Memory). Optionally, the memory 54 includes a non-transitory computer-readable storage medium. The memory 54 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 54 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned method embodiments, etc.; the data storage area may store data involved in the above-mentioned method embodiments, etc. The memory 44 may optionally be at least one storage device located away from the aforementioned processor 51. As Fig.13 As shown, the memory 54 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an operating application of the interactive smart tablet.

[0284] exist Fig.13 In the electronic device 50 shown, the user interface 53 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 51 can be used to call the operating application of the electronic device stored in the memory 54, and specifically execute the relevant operations in the interactive control method of the smart blackboard in the above-mentioned embodiment.

[0285] The above-mentioned smart blackboard can be used to execute the interactive control method of any smart blackboard, and has corresponding functions and beneficial effects.

[0286] It should be noted that in the embodiment, the first blackboard area is provided with an electronic device as an example. In actual application, the first blackboard area may also be provided with only a display screen, in which case other components of the electronic device may be installed behind the first blackboard area and / or the second blackboard area, rather than being integrated into one electronic device.

[0287] In addition, an embodiment of the present invention also provides a storage medium containing computer executable instructions, which, when executed by a computer processor, are used to perform relevant operations in the interactive control method of the smart blackboard provided in any embodiment of the present application, and have corresponding functions and beneficial effects.

[0288] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0289] Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the functions in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0290] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory. The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0291] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0292] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0293] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. An interactive control method for a smart blackboard, characterized in that: The smart blackboard includes a touch module, at least one first blackboard area and at least one second blackboard area, wherein a display screen is installed in the first blackboard area, and the second blackboard area is a traditional blackboard area. The touch module is used to detect touch operations on the first blackboard area and the second blackboard area. The interactive control method includes: receiving a first touch operation on the second blackboard area; When the first touch operation is a writing operation, a touch track corresponding to the writing operation is displayed on the display screen; When the first touch operation is a non-writing operation, responding according to the response strategy of the non-writing operation, and displaying a display screen corresponding to the non-writing operation on the display screen, the non-writing operation is at least one of an erasing operation, a shortcut function triggering operation, a teaching aid use operation, and a gesture control operation; After receiving the first touch operation on the second blackboard area, the method further includes: identifying the number of touch points corresponding to the first touch operation; if the number of touch points is equal to the set number of touch points, determining that the first touch operation is a writing operation; Wherein, determining that the first touch operation is a writing operation includes: acquiring a track width of the first touch operation; if the track width is less than a first width threshold, determining that the first touch operation is a writing operation; The method further includes: if the track width is greater than or equal to the first width threshold, determining whether the track width is greater than a second width threshold, and the second width threshold is greater than the first width threshold; if the track width is greater than the second width threshold, determining whether the touch coordinates of the first touch operation in the second blackboard area change continuously; if the touch coordinates change continuously, determining that the first touch operation is an erase operation; if the touch coordinates do not change continuously, determining that the first touch operation is a teaching aid use operation; if the track width is less than or equal to the second width threshold, determining that the first touch operation is the gesture control operation; Among them, if the track width is greater than the second width threshold, then judging whether the touch coordinates of the first touch operation in the second blackboard area change continuously includes: if the track width is greater than the second width threshold, then judging whether the duration of the initial touch coordinates reaches the second duration threshold, and the initial touch coordinates are the coordinates with the earliest collection time among the touch coordinates; if the duration of the initial touch coordinates reaches the second duration threshold, then judging whether the touch coordinates change continuously.

2. The interactive control method according to claim 1, characterized in that: The displaying of the touch track corresponding to the writing operation on the display screen comprises: Calling out a trajectory display interface on the display screen; The touch track corresponding to the writing operation is displayed in the track display interface.

3. The interactive control method according to claim 2, characterized in that: After the touch track corresponding to the writing operation is displayed in the track display interface, the method further includes: When it is confirmed that the writing operation is completed, exit the track display interface.

4. The interactive control method according to claim 1, characterized in that: Also includes: Receive black screen command; In response to the black screen instruction, controlling the display screen to be in a black screen state; receiving a second touch operation applied to the display screen; If the second touch operation is a writing operation, the touch coordinates of the second touch operation in the first blackboard area are recorded.

5. The interactive control method according to claim 1, characterized in that: After the touch track corresponding to the writing operation is displayed on the display screen, the method further includes: receiving a third touch operation acting on the touch track, wherein the third touch operation is used to edit the touch track; In response to the third touch operation, a corresponding touch track editing result is displayed on the display screen.

6. The interactive control method according to claim 1, characterized in that: The non-writing operation is an erase operation, The responding according to the response strategy of the non-writing operation and displaying a display screen corresponding to the non-writing operation on the display screen includes: According to the touch coordinates of the erasing operation in the second blackboard area, the corresponding touch track in the display screen is erased.

7. The interactive control method according to claim 1, characterized in that: The non-writing operation is a gesture control operation, The responding according to the response strategy of the non-writing operation and displaying a display screen corresponding to the non-writing operation on the display screen includes: Determining a corresponding control instruction according to the touch coordinates of the gesture control operation in the second blackboard area; In response to the control instruction, a corresponding control result is displayed on the display screen.

8. The interactive control method according to claim 7, characterized in that: The control instruction includes: reducing the touch track in the display screen, enlarging the touch track in the display screen, exiting displaying the touch track, or controlling the display screen to a black screen state.

9. The interactive control method according to claim 1, characterized in that: The non-writing operation is the operation of using teaching aids. The responding according to the response strategy of the non-writing operation and displaying a display screen corresponding to the non-writing operation on the display screen includes: The touch coordinates of the teaching aid usage operation in the second blackboard area are shielded, and the current display screen of the display screen is maintained.

10. The interactive control method according to claim 1, characterized in that: The non-writing operation is a quick function triggering operation. The responding according to the response strategy of the non-writing operation and displaying a display screen corresponding to the non-writing operation on the display screen includes: Confirming the shortcut function corresponding to the coordinate range within which the touch coordinates of the shortcut function triggering operation fall, where different shortcut functions correspond to different coordinate ranges; Execute the shortcut function and display the corresponding function execution result on the display screen.

11. The interactive control method according to claim 1, characterized in that: The non-writing operation includes a gesture control operation, and further includes: If the number of contact points is not equal to the set number of contact points, the first touch operation is determined to be a gesture control operation.

12. The interactive control method according to claim 11, characterized in that: The non-writing operation also includes a shortcut function triggering operation. The determining that the first touch operation is a writing operation includes: If the touch coordinates of the first touch operation in the second blackboard area fall within the coordinate range of the shortcut key, determining that the first touch operation is a shortcut function triggering operation; If the touch coordinates do not fall within the coordinate range of the shortcut key, it is determined that the first touch operation is a writing operation.

13. The interactive control method according to claim 1, characterized in that: If the track width is less than a first width threshold, determining that the first touch operation is a writing operation includes: If the track width is less than a first width threshold, determining whether the touch coordinates of the first touch operation in the second blackboard area change continuously; If the touch coordinates change continuously, it is determined that the first touch operation is a writing operation.

14. The interactive control method according to claim 13, characterized in that: Also includes: If the touch coordinates do not change continuously, acquiring the touch duration of the first touch operation; If the touch duration reaches a first duration threshold, determining that the first touch operation is a writing operation; If the touch duration does not reach the first duration threshold, the first touch operation is abandoned.

15. The interactive control method according to claim 1, characterized in that: The determining that the first touch operation is a gesture control operation includes: If the change directions of the touch coordinates of the first touch operation in the second blackboard area at adjacent moments are the same, determining that the first touch operation is an erasing operation; If the change directions of the touch coordinates at adjacent moments are different, it is determined that the first touch operation is a gesture control operation.

16. The interactive control method according to claim 1, characterized in that: When the touch track corresponding to the writing operation is displayed on the display screen, the method further includes: The touch coordinates of the first touch operation in the second blackboard area are recorded.

17. The interactive control method according to claim 1, characterized in that: Also includes: Acquire the size data and arrangement relationship of the first blackboard area and the second blackboard area; Determine a first touch coordinate range of the first blackboard area and a second touch coordinate range of the second blackboard area according to the size data, the arrangement relationship and the detection area of ​​the touch module; The receiving a first touch operation on the second blackboard area includes: receiving a first touch operation; When the first touch operation falls within the second touch coordinate range, it is determined that the first touch operation is directed to the second blackboard area.

18. The interactive control method according to claim 16, characterized in that: After recording the touch coordinates of the first touch operation on the second blackboard area, the method further includes: receiving a fourth touch operation applied to the display screen, wherein the fourth touch operation is used to edit the recorded touch coordinates; In response to the fourth touch operation, the recorded touch coordinates are edited.

19. An interactive control device for a smart blackboard, characterized in that: The smart blackboard includes a touch module, at least one first blackboard area and at least one second blackboard area, wherein a display screen is installed in the first blackboard area, and the second blackboard area is a traditional blackboard area. The touch module is used to detect touch operations on the first blackboard area and the second blackboard area. The interactive control device includes: A first receiving module, used for receiving a first touch operation on the second blackboard area; a first processing module, configured to display a touch track corresponding to the writing operation on the display screen when the first touch operation is a writing operation; a second processing module, for responding according to a response strategy for the non-writing operation when the first touch operation is a non-writing operation, and displaying a display screen corresponding to the non-writing operation on the display screen, wherein the non-writing operation is at least one of an erasing operation, a shortcut function triggering operation, a teaching aid use operation, and a gesture control operation; The interactive control device further includes: a contact point recognition module, configured to, after receiving a first touch operation on the second blackboard area, identify the number of contacts corresponding to the first touch operation; a first writing determination module, configured to determine that the first touch operation is a writing operation if the number of contacts is equal to a set number of contacts; The first writing determination module is specifically configured to: if the number of contact points is equal to the set number of contact points, obtain the track width of the first touch operation; if the track width is less than a first width threshold, determine that the first touch operation is a writing operation; The interactive control device further includes: a width comparison module, for judging whether the track width is greater than a second width threshold if the track width is greater than or equal to the first width threshold, and the second width threshold is greater than the first width threshold; a coordinate judgment module, for judging whether the touch coordinates of the first touch operation in the second blackboard area change continuously if the track width is greater than the second width threshold; an erasure judgment module, for determining that the first touch operation is an erase operation if the touch coordinates change continuously; a teaching aid judgment module, for determining that the first touch operation is a teaching aid use operation if the touch coordinates do not change continuously; a second gesture judgment module, for determining that the first touch operation is the gesture control operation if the track width is less than or equal to the second width threshold; The coordinate judgment module includes: a duration judgment unit, used to judge whether the duration of the initial touch coordinates reaches the second duration threshold if the track width is greater than the second width threshold, and the initial touch coordinates are the coordinates with the earliest collection time among the touch coordinates; and a coordinate continuity judgment unit, used to judge whether the touch coordinates change continuously if the duration of the initial touch coordinates reaches the second duration threshold.

20. A smart blackboard, characterized in that: The electronic device comprises a touch module, at least one first blackboard area and at least one second blackboard area, wherein an electronic device equipped with a display screen is installed in the first blackboard area, the first blackboard area and the second blackboard area are arranged side by side, the touch module surrounds the first blackboard area and the second blackboard area, and the touch module is used to detect touch operations on the first blackboard area and the second blackboard area. The electronic device also comprises: One or more processors A memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the interactive control method of the smart blackboard as described in any one of claims 1-18.

21. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, an interactive control method of the smart blackboard as described in any one of claims 1-18 is implemented.

Images