Method, device, equipment and storage medium for binding display elements of electronic whiteboard

Abstract

The present application discloses a method for binding display elements of an electronic whiteboard, comprising: when a first whiteboard detects that a display element is generated, detecting whether the position of the display element is located in a target area; if not, creating a target area associated with the display element, and sending the area information of the display element and the target area to a second whiteboard, so that the second whiteboard can create a target area based on the area information, and display the display element associated with the area information in the target area; if so, binding the display element with other display elements in the target area, and sending the display element associated with the area information of the target area to the second whiteboard, so that the display element is bound to other display elements in the target area corresponding to the area information on the second whiteboard and displaying them. The present application also discloses a display element binding device, a computer device, and a computer-readable storage medium for an electronic whiteboard. The present application implements soft binding of display elements of a synchronously displayed electronic whiteboard.

Description

Technical Field

[0001] The present application relates to the technical field of electronic equipment, and in particular to a method for binding display elements of an electronic whiteboard, a device for binding display elements of an electronic whiteboard, a computer device, and a computer-readable storage medium. Background Art

[0002] With the continuous advancement of science and technology, many electronic devices with handwriting input systems have begun to enter the market, such as mobile phones, e-books, tablet computers, etc. The electronic whiteboard application (referred to as whiteboard software) that has emerged can maintain the handwriting mode of the original handwriting and can display the input text or pictures according to the user's own handwriting, providing users with a good experience.

[0003] In order to help users select related written content more quickly, whiteboard software provides a soft binding function, that is, elements written within a certain time and distance can be selected by users as a whole. However, the existing technical solution is only applicable to local whiteboard software. When multiple parties perform collaborative operations through whiteboard software, the display elements of the whiteboard software cannot form a soft binding function between the display elements due to delays in the transmission process.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present application is to provide a display element binding method of an electronic whiteboard, a display element binding device of an electronic whiteboard, a computer device and a computer-readable storage medium, aiming to solve the problem of how to soft-bind the display elements of a synchronously displayed electronic whiteboard during online interaction.

[0006] To achieve the above object, the present application provides a method for binding display elements of an electronic whiteboard, comprising the following steps:

[0007] When the first whiteboard detects that a display element is generated, detecting whether the position of the display element is located in the target area;

[0008] If not, create a target area associated with the display element, and send the area information of the display element and the target area associated with the display element to the second whiteboard, so that the second whiteboard can create the target area based on the area information and display the display element associated with the area information in the target area;

[0009] If so, the display element is bound to other display elements in the target area, and the display element is associated with the area information of the target area and sent to the second whiteboard, so that the display element is bound to other display elements in the target area corresponding to the area information and displayed on the second whiteboard.

[0010] Furthermore, the display element binding method of the electronic whiteboard also includes:

[0011] When it is detected that the position of the display element is located in the target area, detecting whether the target area is a preset area, wherein the preset area includes the current target area;

[0012] If not, executing the step of creating the target area associated with the display element, and sending the area information of the display element and the target area associated with the display element to the second whiteboard;

[0013] The created target area is updated as the current target area.

[0014] Furthermore, the region information is first region information, and when the position of the display element is detected to be located in the target region, before the step of detecting whether the target region is a preset region, the method further includes:

[0015] When receiving the second area information sent by the second whiteboard and the display element associated with the second area information, detecting whether there is the first area information matching the second area information;

[0016] If so, binding and displaying the display element associated with the second area information and the display element associated with the target area corresponding to the first area information;

[0017] If not, creating a target area corresponding to the second area information, and displaying a display element associated with the second area information in the target area corresponding to the second area information;

[0018] Wherein, the preset area also includes a target area corresponding to the second area information.

[0019] Furthermore, after the step of detecting whether the target area is a preset area, the method further includes:

[0020] If so, determining the interval between the generation time point of the display element and the generation time point of the display element most recently associated with the target area;

[0021] When it is detected that the interval duration is greater than a preset duration, executing the step of creating the target area associated with the display element, and sending the area information of the display element and the target area associated with the display element to the second whiteboard;

[0022] When it is detected that the interval duration is less than or equal to the preset duration, the step of binding the display element with other display elements in the target area and associating the display element with the area information of the target area and sending them to the second whiteboard is performed.

[0023] Furthermore, after the step of detecting whether the target area is a preset area, the method further includes:

[0024] If so, determining the distance between the display element and other display elements in the target area;

[0025] When it is detected that the distance is greater than a preset distance threshold, the step of creating a target area associated with the display element and sending area information of the display element and the target area associated with the display element to a second whiteboard is executed;

[0026] When it is detected that the distance is less than or equal to the preset distance threshold, the step of binding the display element with other display elements in the target area and associating the display element with the area information of the target area and sending the same to the second whiteboard is performed.

[0027] Furthermore, the step of associating the display element with the area information of the target area and sending the same to the second whiteboard includes:

[0028] updating the area range of the target area based on the position of the display element;

[0029] updating the area information of the target area based on the area range;

[0030] The display element is associated with the updated region information and sent to the second whiteboard.

[0031] Furthermore, the step of creating the target area associated with the display element includes:

[0032] Determine a minimum circumscribed rectangle of the display element according to the display area of ​​the display element;

[0033] A target area is created according to the minimum bounding rectangle, and area information corresponding to the target area is generated according to the area range.

[0034] To achieve the above-mentioned purpose, the present application further provides a display element binding device for an electronic whiteboard, the display element binding device for an electronic whiteboard comprising:

[0035] A detection module, configured to detect whether the position of a display element is located in a target area when the first whiteboard detects that a display element is generated;

[0036] A first processing module, configured to, if not, create a target area associated with the display element, and send area information of the display element and the target area associated with the display element to a second whiteboard, so that the second whiteboard can create the target area based on the area information, and display the display element associated with the area information in the target area;

[0037] The second processing module is used to bind the display element with other display elements in the target area, and associate the display element with the area information of the target area and send it to the second whiteboard, so as to bind and display the display element with other display elements in the target area corresponding to the area information on the second whiteboard.

[0038] To achieve the above object, the present application also provides a computer device, the computer device comprising:

[0039] The computer device includes a memory, a processor, and an electronic whiteboard display element binding program stored in the memory and executable on the processor. When the electronic whiteboard display element binding program is executed by the processor, the steps of the electronic whiteboard display element binding method described above are implemented.

[0040] To achieve the above objectives, the present application also provides a computer-readable storage medium, on which a display element binding program for an electronic whiteboard is stored. When the display element binding program for an electronic whiteboard is executed by a processor, the steps of the display element binding method for an electronic whiteboard as described above are implemented.

[0041] The display element binding method of an electronic whiteboard, the display element binding device of an electronic whiteboard, the computer device and the computer-readable storage medium provided by the present application softly bind the display elements within the area based on the target area, and when the first whiteboard sends the display element to the second whiteboard, it also sends the associated area information, so that the second whiteboard can search for the target area corresponding to the received display element based on the associated area information, and softly bind the display element with other display elements in the target area. In this way, in the process of online interaction of whiteboard devices, not only the synchronous display of the display elements can be guaranteed, but also the soft binding of the display elements of the synchronously displayed electronic whiteboard can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 This is a schematic diagram of the steps of a method for binding display elements of an electronic whiteboard in one embodiment of the present application;

[0043] Figure 2 This is a schematic block diagram of a display element binding device of an electronic whiteboard in one embodiment of the present application;

[0044] Figure 3 A schematic block diagram of the structure of a computer device according to an embodiment of the present application.

[0045] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0047] Reference Figure 1 In one embodiment, the method for binding display elements of the electronic whiteboard includes:

[0048] Step S10: When the first whiteboard detects that a display element is generated, detecting whether the position of the display element is located in the target area;

[0049] Step S20: If not, create a target area associated with the display element, and send the display element and the area information of the target area associated with the display element to the second whiteboard, so that the second whiteboard can create the target area based on the area information and display the display element associated with the area information in the target area;

[0050] Step S30: If yes, bind the display element with other display elements in the target area, and associate the display element with the area information of the target area and send it to the second whiteboard, so as to bind and display the display element with other display elements in the target area corresponding to the area information on the second whiteboard.

[0051] In this embodiment, the terminal of the embodiment may be a computer device, such as an electronic whiteboard device (abbreviated as electronic whiteboard or whiteboard device), or may be a display element binding device of an electronic whiteboard.

[0052] The electronic whiteboard may be an interactive smart tablet, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a wearable device, a smart motorcycle, a driverless car, a smart home device, or a combination of any of these devices. The electronic whiteboard may be installed with various applications required by the user, such as writing applications, document presentation applications, instant messaging applications, image editing applications, social applications, e-commerce applications, search applications, browser applications, etc. Among them, writing applications include electronic whiteboards and electronic blackboards, document presentation applications include wireless projection applications, and instant messaging applications include video conferencing applications.

[0053] In some application environments, when multiple electronic whiteboards are in the same local area network, the electronic whiteboard can also communicate directly with other electronic whiteboards, and one of the multiple electronic whiteboards can act as a server; in this type of application environment, there is no need to set up a dedicated server.

[0054] In the specific description of the following embodiments, the electronic whiteboard is described by taking an interactive smart tablet as an example, wherein the interactive smart tablet can be an integrated device that controls the content displayed on the display tablet and realizes human-computer interaction through touch technology, which integrates one or more functions such as whiteboard function, projector, screen, audio, television and video conferencing terminal. The interactive smart tablet display screen is a touch screen, which may include: a capacitive screen, an electromagnetic screen or an infrared screen. Generally speaking, the touch screen can receive touch operations input by a user through a finger or an input device. The input device includes but is not limited to: a capacitive pen, an electromagnetic pen and / or an infrared pen. The interactive smart tablet can establish a data connection with at least one other interactive smart tablet through a network. The communication method of the data connection is not limited in the embodiment, and can be connected by USB, the Internet, a local area network, Bluetooth, Wi-Fi or ZigBee protocol (ZigBee) and other communication methods. The whiteboard application installed in each interactive smart tablet is used to implement the relevant functions of the whiteboard in the interactive smart tablet, and the whiteboard related functions include but are not limited to writing, drawing, erasing, moving and other human-computer interaction operations.

[0055] As described in step S10: the electronic whiteboard as the execution subject of the embodiment is defined as the first whiteboard, and other electronic whiteboards that interact with the first whiteboard are defined as the second whiteboard. It should be understood that in a shared conference formed after multiple electronic whiteboards establish a communication connection, any electronic whiteboard can be used as the first whiteboard, and other electronic whiteboards except the first whiteboard in the shared conference are the second whiteboards relative to the first whiteboard, and the electronic whiteboards in the shared conference can share the whiteboard content with each other.

[0056] Optionally, the page of the first whiteboard may include a writing area and a toolbar, wherein the toolbar includes whiteboard related controls, such as one or more controls such as a writing pen, an eraser, a font, a color, and adding / subtracting pages. The user may write in the writing area with a finger or a writing pen, and accordingly, the handwriting of the user or the added image will be displayed in the writing area.

[0057] It should be noted that the writing area of ​​the interactive smart tablet in whiteboard mode can be understood as a whiteboard page, and the handwriting displayed in the writing area can be understood as a display element, wherein the handwriting can be text handwriting, or it can be a symbol or any other handwriting. Display elements can also be understood as page elements displayed by the interactive smart tablet in whiteboard mode. When no touch event is detected in all interactive smart tablets and the display content remains unchanged, the display elements in the first whiteboard and the second whiteboard are actually the same. In this solution, for the convenience of description, the display elements in the first whiteboard and the second whiteboard are defined as the first display element and the second display element, respectively.

[0058] Optionally, the terminal can detect in real time or periodically whether a display element is generated on the whiteboard page of the first whiteboard. When the terminal detects a pen-falling point on the whiteboard page, the coordinates of the pen-falling point are recorded, and when the terminal further identifies a pen-starting point, the coordinates of the pen-starting point are recorded, and the handwriting between the pen-falling point coordinates and the pen-starting point coordinates is used as a display element.

[0059] Optionally, the terminal may first determine the first distance between all handwritings written within a preset interval time, and use the handwritings whose first distances are less than the first distance threshold as the same display element. The preset interval time, the first distance threshold, etc. may be pre-set by engineers according to actual needs, such as setting the preset interval time to 2 seconds (i.e., the time points of the two previous and subsequent strokes are generated no more than 2 seconds), and the first distance threshold to 0.5 cm, etc.

[0060] Optionally, when the terminal detects that a display element is generated on the whiteboard page of the first whiteboard, the position and generation time of the display element are recorded. The position of the display element may be the coordinates of the pen drop point corresponding to the display element.

[0061] At the same time, the terminal detects whether the target area already exists on the whiteboard page of the first whiteboard. If not, the terminal directly executes step S20; if so, the terminal further determines whether the position of the currently generated display element (i.e., the current display element) is within the target area. Among them, the target area is characterized as an area within a certain area range on the whiteboard page. The target area can be an area generated according to a preset area range, or it can be generated in the manner of step S20. The preset area range can be set according to actual needs, such as setting 2 cm*2 cm.

[0062] It should be noted that the area range of the target area is smaller than the display range of the whiteboard page; and in order not to affect the user's experience of using the whiteboard, the target area does not need to be displayed on the whiteboard in the form of a solid line.

[0063] As described in step S20: when the terminal detects that the position of the currently generated display element is not in the target area, a new target area is created on the first whiteboard, and the area range of the new target area can cover the position of the currently generated display element, and the new target area is associated with the current display element.

[0064] Furthermore, the terminal assigns a unique identification value to the newly created target area, and generates area information of the target area according to the area range and identification value of the target area. The area information may further include the display area position of the display element in the target area. It should be understood that the display area of ​​the display element is composed of all the handwriting points in the display element.

[0065] Further, the terminal sends the display element and the area information of the target area associated with the display element to the second whiteboard. It should be understood that the first whiteboard has established a communication connection with at least one second whiteboard.

[0066] Optionally, the identification value corresponding to the target area on the first whiteboard is recorded as the first identification value, and the identification value corresponding to the target area on the second whiteboard is recorded as the second identification value. When the second whiteboard receives the display element and area information sent by the first whiteboard, it retrieves the area information corresponding to the target area on the second whiteboard according to the first identification value in the area information, whether there is a second identification value that is the same as the first identification value. If not, it means that the first whiteboard is sending the target area corresponding to the first identification value to the second whiteboard for the first time. At this time, the second whiteboard can create the target area corresponding to the first identification value on the second whiteboard according to the area range in the area information corresponding to the first identification value, and display the display element associated with the area information corresponding to the first identification value in the newly created target area. If so, it means that the first whiteboard is not sending the target area corresponding to the first identification value to the second whiteboard for the first time. Then the second whiteboard obtains the display element associated with the area information corresponding to the first identification value, and displays the display element on the target area corresponding to the second identification value that is the same as the first identification value.

[0067] Of course, based on the execution of step S20, the first whiteboard is sending the target area corresponding to the first identification value to the second whiteboard for the first time.

[0068] Optionally, after executing step S20, the terminal returns to execute step S10, and when it is detected that the position of the currently generated display element is in the target area, step S30 is executed. Based on the execution of step S30, it belongs to the scenario where the first whiteboard sends the target area corresponding to the first identification value to the second whiteboard non-for the first time; of course, if after step S10, it is detected that the position of the currently generated display element is not in the target area, step S20 is executed again.

[0069] As described in step S30: when the terminal detects that the position of the currently generated display element is in the target area, it determines other display elements that have been pre-displayed in the target area, binds the current display element generated in the target area with other display elements (i.e., performs soft binding of the display elements), and associates the current display element with the area information of the target area. At this time, all the mutually bound display elements in the target area can be used as a whole element for the user of the first whiteboard to select.

[0070] Furthermore, after associating the current display element with the area information of the target area, the terminal sends the current display element and the area information associated with it to the second whiteboard. When the second whiteboard receives the display element and area information sent by the first whiteboard, it searches the area information corresponding to the target area on the second whiteboard according to the first identification value in the area information to see whether there is a second identification value that is the same as the first identification value. Since the execution of step S30 should be a scenario in which the first whiteboard does not send the target area corresponding to the first identification value to the second whiteboard for the first time, the second whiteboard can detect the second identification value that is the same as the first identification value, and display the currently received display element in the target area corresponding to the second identification value, and bind the current display element to other display elements in the target area corresponding to the second identification value, so that all mutually bound display elements in the target area can be used as an element as a whole for the user of the second whiteboard to select.

[0071] For example, when the terminal detects that the user first writes the word "you" on the first whiteboard, by executing step S20, target areas are created on both the first whiteboard and the second whiteboard, and the word "you" is displayed in the target areas of the first whiteboard and the second whiteboard. When the terminal further detects that the user writes the word "good" in the target area of ​​the first whiteboard, by executing step S30, while "hello" is displayed in the target area of ​​the first whiteboard, the two display elements "you" and "good" can be soft-bound, and "hello" can also be displayed in the target area of ​​the second whiteboard, and the two display elements "you" and "good" are soft-bound, so that the user of the first whiteboard and the user of the second whiteboard can perform an overall operation on the "hello" displayed in the target area, that is, when the user moves the cursor to the display area of ​​"hello", the two words "you" and "good" are selected at the same time.

[0072] Optionally, if the terminal detects that the position of the display element is located in multiple target areas, the target area with the latest generation time is obtained, and the obtained target area is detected to execute step S30.

[0073] Optionally, after executing step S30, the terminal returns to execute step S10; when it is detected that the position of the currently generated display element is in the target area, step S30 is executed again; or, when it is detected that the position of the currently generated display element is not in the target area, step S20 is executed.

[0074] In one embodiment, by soft-binding the display elements within the area based on the target area, and sending the associated area information when the first whiteboard sends the display element to the second whiteboard, the second whiteboard can search for the target area corresponding to the received display element based on the associated area information, and soft-bind the display element with other display elements in the target area. In this way, in the process of online interaction of whiteboard devices, not only the synchronous display of the display elements can be guaranteed, but also the soft binding of the display elements of the synchronously displayed electronic whiteboard can be achieved.

[0075] In one embodiment, based on the above embodiment, the display element binding method of the electronic whiteboard further includes:

[0076] Step S40: when it is detected that the position of the display element is located in the target area, detecting whether the target area is a preset area, wherein the preset area includes the current target area;

[0077] Step S41: if not, executing the step of creating the target area associated with the display element, and sending the area information of the display element and the target area associated with the display element to the second whiteboard;

[0078] Step S42: Update the created target area to the current target area.

[0079] In this embodiment, when creating a target area, the terminal may record the generation time of the target area, and determine the most recently generated target area as the current target area according to the generation time. At the same time, the current target area is defined as belonging to a preset area.

[0080] Optionally, when the terminal detects that the position of the currently generated display element is in the target area, it further detects whether the target area where the current display element is located belongs to the preset area. If the terminal detects that the position of the display element is located in multiple target areas, the target area with the latest generation time is obtained, and the obtained target area is detected to determine whether it belongs to the preset area, so as to determine whether the current display element is in the preset area.

[0081] When the terminal detects that the target area where the current display element is located belongs to the preset area, the step of binding the display element with other display elements in the target area and associating the display element with the area information of the target area and sending them to the second whiteboard is performed, so as to bind and display the display element with other display elements in the target area corresponding to the area information on the second whiteboard (i.e., execute step S30).

[0082] When the terminal detects that the target area where the current display element is located does not belong to the preset area, the step of creating the target area associated with the display element is executed, and the area information of the display element and the target area associated with the display element is sent to the second whiteboard, so that the second whiteboard can create the target area based on the area information, and display the display element associated with the area information in the target area (i.e., execute step S20).

[0083] Furthermore, after executing step S20, the terminal may also update the target area created based on step S20 as the current target area.

[0084] In this way, when the terminal detects that a display element is generated in the current target area, it will soft-bind the display elements in the current target area and realize soft binding synchronization of display elements of other whiteboard devices, so as to avoid binding the currently generated display elements to some target areas that have existed for a long time or other irrelevant target areas, thereby avoiding confusion in the binding of display elements.

[0085] In one embodiment, based on the above embodiment, when the position of the display element is detected to be located in the target area, before the step of detecting whether the target area is a preset area, the method further includes:

[0086] Step S50: upon receiving the second region information sent by the second whiteboard and the display element associated with the second region information, detecting whether there is the first region information matching the second region information;

[0087] Step S51: If yes, update the target area corresponding to the first area information based on the second area information, and bind and display the display element associated with the second area information and the display element associated with the target area corresponding to the first area information;

[0088] Step S52: if not, create a target area corresponding to the second area information, and display a display element associated with the second area information in the target area corresponding to the second area information;

[0089] In this embodiment, the region information corresponding to the target region on the first whiteboard is recorded as the first region information, and the region information corresponding to the target region on the second whiteboard is recorded as the second region information.

[0090] Optionally, in addition to sending the first region information and the display elements associated with the first region information to the second whiteboard, the first whiteboard may also receive the second region information and the display elements associated with the second region information sent to it by the second whiteboard.

[0091] Among them, when the second whiteboard detects that a display element is generated, it detects whether the position of the display element is located in the target area on the second whiteboard; if not, creates a target area associated with the display element, and sends the display element and the second area information of the target area associated with the display element to the first whiteboard, so that the first whiteboard can create the target area based on the second area information, and display the display element associated with the second area information in the target area; if so, bind the display element with other display elements in the target area, associate the display element with the second area information of the target area, and send the display element and the second area information to the first whiteboard, so that the display element and other display elements in the target area corresponding to the second area information are bound and displayed on the first whiteboard.

[0092] Optionally, when the first whiteboard receives the second area information sent by the second whiteboard and the display element associated with the second area information, it is detected whether there is the first area information matching the second area information on the first whiteboard. Specifically, it is mainly detected whether there is a first identification value in the first area information of the first whiteboard that is the same as the second identification value in the second area information.

[0093] Optionally, when the terminal detects the existence of a first identification value that is the same as the second identification value, it determines that the first area information corresponding to the first identification value matches the second area information, and indicates that a target area matching the second area information already exists on the first whiteboard (the target area is constructed by the first whiteboard based on the second area information previously received). At this time, the terminal displays the display element associated with the second area information in the target area matching the second area information, and binds other display elements in the target area to the display elements associated with the second area information.

[0094] Optionally, when the terminal detects that there is no first identification value identical to the second identification value, it indicates that there is no target area matching the second area information on the first whiteboard, and the terminal can create a target area corresponding to the second area information on the first whiteboard according to the area range in the first area information, and use the second identification value as the identification value corresponding to the target area. Then, the display element associated with the second area information is displayed in the target area corresponding to the second area information, and then the second area information can be updated to the first area information.

[0095] In this way, the target area corresponding to the second area information is the remote synchronization area first generated on the second whiteboard and sent to the first whiteboard.

[0096] Optionally, the terminal may also update the target area corresponding to the second area information to a preset area, and based on this, perform the step of detecting whether the target area is a preset area when detecting that the position of the display element is located in the target area (ie, step S40).

[0097] In this way, not only can the display elements soft-bound on the current whiteboard device be synchronized to other whiteboard devices, but also the display elements soft-bound on other whiteboard devices can be synchronized to the current whiteboard device, and the newly generated display elements on the current whiteboard device can also be re-bound with the display elements soft-bound on other whiteboard devices, perfectly realizing the soft binding synchronization of display elements between whiteboard devices.

[0098] In one embodiment, based on the above embodiment, after the step of detecting whether the target area is a preset area, the method further includes:

[0099] Step S60: If yes, determine the interval between the generation time point of the display element and the generation time point of the display element most recently associated with the target area;

[0100] Step S61, when it is detected that the interval duration is greater than a preset duration, executing the step of creating the target area associated with the display element, and sending the area information of the display element and the target area associated with the display element to the second whiteboard;

[0101] Step S62: When it is detected that the interval duration is less than or equal to the preset duration, the step of binding the display element with other display elements in the target area and associating the display element with the area information of the target area and sending the same to the second whiteboard is executed.

[0102] In this embodiment, when the terminal detects that the position of the currently generated display element is in the target area, it further detects whether the target area where the current display element is located belongs to the preset area. When the terminal detects that the target area where the current display element is located belongs to the preset area, it further obtains the generation time point of the current display element (recorded as the first time point) and the generation time point of the most recently associated display element in the target area (i.e., the preset area) (recorded as the second time point), and then determines the interval between the first time point and the second time point.

[0103] The terminal may first determine the generation time points corresponding to all associated display elements in the target area, and then use the display element whose generation time point is closest to the current time point (ie, the latest) as the latest associated display element of the target area.

[0104] Furthermore, the terminal detects whether the obtained interval duration is greater than a preset duration, wherein the preset duration can be set according to actual needs, such as 2 seconds, 3 seconds, 5 seconds, etc.

[0105] Optionally, when the terminal detects that the interval duration is greater than the preset duration, it means that the target area is out of date. The terminal can execute the step of creating the target area associated with the display element, and sending the display element and the area information of the target area associated with the display element to the second whiteboard, so that the second whiteboard can create the target area based on the area information, and display the display element associated with the area information in the target area (ie, step S20), thereby creating a new target area to accommodate the generated display element.

[0106] Optionally, when the terminal detects that the interval duration is less than or equal to the preset duration, it means that the target area is not outdated. The terminal can execute the step of binding the display element with other display elements in the target area, and associating the display element with the area information of the target area and sending it to the second whiteboard, so as to bind and display the display element with other display elements in the target area corresponding to the area information on the second whiteboard (ie, step S30), thereby realizing soft binding synchronization of the display elements between the first whiteboard and the second whiteboard.

[0107] In this way, by setting the generation time interval between the currently generated display elements and the previous display elements to be smaller, these display elements are soft-bound and synchronized to other whiteboard devices to avoid unnecessary binding of the currently generated display elements with some display elements that have existed for a longer time, thereby avoiding confusion in the binding of display elements.

[0108] In one embodiment, based on the above embodiment, after the step of detecting whether the target area is a preset area, the method further includes:

[0109] Step S70: If yes, determine the distance between the display element and other display elements in the target area;

[0110] Step S71, when it is detected that the distance is greater than a preset distance threshold, executing the step of creating a target area associated with the display element, and sending the area information of the display element and the target area associated with the display element to a second whiteboard;

[0111] Step S72: when it is detected that the distance is less than or equal to the preset distance threshold, executing the step of binding the display element with other display elements in the target area, and associating the display element with the area information of the target area and sending it to the second whiteboard.

[0112] In this embodiment, when the terminal detects that the position of the currently generated display element is in the target area, it further detects whether the target area where the current display element is located belongs to the preset area. When the terminal detects that the target area where the current display element is located belongs to the preset area, it further obtains the position of the current display element and the positions of other display elements associated with the target area (i.e., the preset area), and then determines the distance between the position of the current display element and the positions of the other display elements (recorded as the second distance).

[0113] Furthermore, the terminal detects whether the obtained second distance is greater than a preset distance threshold. The preset distance threshold may be a second distance threshold, which may be set according to actual needs, and may be set to be greater than the first distance threshold; when there are multiple other display elements, after the terminal determines the second distance between the position of the current display element and the positions of the other display elements, it obtains the smallest second distance from the multiple second distances for comparison and judgment with the preset distance threshold.

[0114] Optionally, when the terminal detects that the second distance is greater than a preset distance threshold, it means that the current display element is too far away from other display elements in the target area. The terminal can execute the step of creating a target area associated with the display element, and sending the area information of the display element and the target area associated with the display element to the second whiteboard, so that the second whiteboard can create the target area based on the area information, and display the display element associated with the area information in the target area (ie, step S20), thereby creating a new target area to accommodate the current display element.

[0115] Optionally, when the terminal detects that the second distance is less than or equal to a preset distance threshold, it means that the current display element is relatively close to other display elements in the target area. The terminal can execute the step of binding the display element with other display elements in the target area, and associating the display element with the area information of the target area and sending it to the second whiteboard, so as to bind and display the display element with other display elements in the target area corresponding to the area information on the second whiteboard (i.e., step S30), thereby realizing soft binding synchronization of the display elements between the first whiteboard and the second whiteboard.

[0116] In this way, by setting the distance between the currently generated display element and the previous display element to be smaller, these display elements are soft-bound and synchronized to other whiteboard devices to avoid unnecessary binding of some display elements that are relatively remote from each other, thereby avoiding confusion in the binding of display elements.

[0117] In one embodiment, based on the above embodiment, the step of associating the display element with the area information of the target area and sending the same to the second whiteboard includes:

[0118] Step S80: updating the area range of the target area based on the position of the display element;

[0119] Step S81, updating the area information of the target area based on the area range;

[0120] Step S82: associate the display element with the updated area information and send the result to the second whiteboard.

[0121] In this embodiment, after the terminal binds the currently generated display element to other display elements in the target area where the display element is located, the area range of the target area where the display element is located may be further updated based on the position of the current display element.

[0122] Optionally, the terminal may determine the minimum bounding rectangle required to display the combination based on the combination of the handwriting display positions of all display elements after updating and binding the display elements in the target area. It should be noted that the minimum bounding rectangle refers to the maximum range of several two-dimensional shapes (such as points, lines, polygons) represented by two-dimensional coordinates, that is, a rectangle whose lower boundary is defined by the maximum horizontal coordinate, minimum horizontal coordinate, maximum vertical coordinate, and minimum vertical coordinate of each vertex of a given two-dimensional shape. Such a rectangle contains a given two-dimensional shape, and its sides are parallel to the coordinate axes. The minimum bounding rectangle is a two-dimensional form of the minimum bounding box.

[0123] Furthermore, after the terminal expands the length and width of the minimum bounding rectangle by a preset size, the expanded minimum bounding rectangle is updated as the area range of the target area. The preset size may be 10Px (pixel unit length).

[0124] Alternatively, the terminal may also construct a first area with the center position of the current display element as the center point of the preset area range, use the original area range of the target area as the second area, then determine the union of the first area and the second area, and update the area union between the two areas as the new area range of the target area.

[0125] Optionally, after obtaining the updated area range of the target area, the terminal updates the area range recorded in the area information of the target area according to the updated area range, and then associates the current display element with the updated area information.

[0126] Furthermore, after associating the current display element with the updated area information, the terminal sends the current display element and the updated area information (i.e., the first area information) to the second whiteboard. When the second whiteboard receives the display element and the updated first area information sent by the first whiteboard, it searches the second area information corresponding to the target area on the second whiteboard according to the first identification value in the first area information to see whether there is a second identification value identical to the first identification value. When the second whiteboard detects the second identification value identical to the first identification value, it displays the currently received display element in the target area corresponding to the second identification value, and binds the current display element to other display elements in the target area corresponding to the second identification value. If the second whiteboard detects that the area range of the target area has been updated according to the area range in the area information corresponding to the first identification value, it updates the area range of the target area corresponding to the second identification value identical to the first identification value according to the area range in the area information corresponding to the first identification value.

[0127] In this way, when the target area is associated with a new display element, the area range of the target area is automatically updated, and by adapting to the user's binding requirements for display elements, the target area can accommodate more bindable display elements, thereby improving the user experience.

[0128] In one embodiment, based on the above embodiment, the step of creating the target area associated with the display element includes:

[0129] Step S90, determining the minimum circumscribed rectangle of the display element according to the display area of ​​the display element;

[0130] Step S91: Create a target area according to the minimum bounding rectangle, and generate area information corresponding to the target area according to the area range.

[0131] In this embodiment, when the terminal detects that the position of the currently generated display element is not in the target area, a new target area is created on the first whiteboard, and the area range of the new target area can cover the position of the currently generated display element, and the new target area is associated with the current display element.

[0132] Among them, the terminal can determine the minimum enclosing rectangle of the current display element based on the display position of all handwritings of the current display element, and use the area range of the minimum enclosing rectangle of the current display element as the area range of the target area, that is, the area range of the newly created target area coincides with the minimum enclosing rectangle of the current display element.

[0133] Alternatively, after determining the minimum bounding rectangle of the current display element, the terminal enlarges the length and width of the area range of the minimum bounding rectangle by a preset size, and then creates the area range of the target area according to the enlarged area range.

[0134] Furthermore, when creating the target area, the terminal also allocates a unique identification value to the newly created target area, and generates area information of the target area according to the area range and the identification value of the target area.

[0135] In this way, it is possible to automatically create a target area according to the position of the currently generated display element.

[0136] Reference Figure 2 In an embodiment of the present application, a display element binding device 10 for an electronic whiteboard is also provided, comprising:

[0137] A detection module 11, configured to detect whether the position of a display element is located in a target area when the first whiteboard detects that a display element is generated;

[0138] A first processing module 12 is used for, if not, creating a target area associated with the display element, and sending area information of the display element and the target area associated with the display element to a second whiteboard, so that the second whiteboard can create the target area based on the area information, and display the display element associated with the area information in the target area;

[0139] The second processing module 13 is used to bind the display element with other display elements in the target area, and associate the display element with the area information of the target area and send it to the second whiteboard, so as to bind and display the display element with other display elements in the target area corresponding to the area information on the second whiteboard.

[0140] Reference Figure 3 In an embodiment of the present application, a computer device is also provided. The computer device may be a server, and its internal structure may be as follows: Figure 3 As shown. The computer device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used for the display element binding program of the electronic whiteboard. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a display element binding method of an electronic whiteboard is implemented.

[0141] Those skilled in the art will understand that Figure 3 The structure shown in is merely a block diagram of a portion of the structure related to the present application solution and does not constitute a limitation on the computer device to which the present application solution is applied.

[0142] In addition, the present application also proposes a computer-readable storage medium, the computer-readable storage medium includes a display element binding program of an electronic whiteboard, and when the display element binding program of the electronic whiteboard is executed by a processor, the steps of the display element binding method of the electronic whiteboard described in the above embodiment are implemented. It can be understood that the computer-readable storage medium in this embodiment can be a volatile readable storage medium or a non-volatile readable storage medium.

[0143] In summary, the display element binding method of an electronic whiteboard, the display element binding device of an electronic whiteboard, the computer device and the storage medium provided in the embodiments of the present application softly bind the display elements within the area based on the target area, and when the first whiteboard sends the display element to the second whiteboard, it also sends the associated area information, so that the second whiteboard can search for the target area corresponding to the received display element based on the associated area information, and softly bind the display element with other display elements in the target area. In this way, in the process of online interaction of whiteboard devices, not only the synchronous display of the display elements can be guaranteed, but also the soft binding of the display elements of the synchronously displayed electronic whiteboard can be achieved.

[0144] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media provided in this application and used in the embodiments may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (SSRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0145] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, device, article or method including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, device, article or method. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the presence of other identical elements in the process, device, article or method including the element.

[0146] The above description is only a preferred embodiment of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for binding display elements of an electronic whiteboard, characterized in that: include: When the first whiteboard detects that a display element is generated, detecting whether the position of the display element is located in the target area; If not, create a target area associated with the display element, and send the area information of the display element and the target area associated with the display element to the second whiteboard, so that the second whiteboard can create the target area based on the area information and display the display element associated with the area information in the target area; wherein the first whiteboard has established a communication connection with at least one of the second whiteboards; If so, the display element is bound to other display elements in the target area, and the display element is associated with the area information of the target area and sent to the second whiteboard, so that the display element is bound to other display elements in the target area corresponding to the area information and displayed on the second whiteboard; wherein the mutually bound display elements are provided as a whole element for selection by the user of the second whiteboard.

2. The method for binding display elements of an electronic whiteboard as claimed in claim 1, characterized in that: The display element binding method of the electronic whiteboard also includes: When it is detected that the position of the display element is located in the target area, detecting whether the target area is a preset area, wherein the preset area includes the current target area; If not, executing the step of creating the target area associated with the display element, and sending the area information of the display element and the target area associated with the display element to the second whiteboard; The created target area is updated as the current target area.

3. The method for binding display elements of an electronic whiteboard as claimed in claim 2, characterized in that: The region information is first region information, and when the position of the display element is detected to be located in the target region, before the step of detecting whether the target region is a preset region, the step further includes: When receiving the second area information sent by the second whiteboard and the display element associated with the second area information, detecting whether there is the first area information matching the second area information; If so, binding and displaying the display element associated with the second area information and the display element associated with the target area corresponding to the first area information; If not, creating a target area corresponding to the second area information, and displaying a display element associated with the second area information in the target area corresponding to the second area information; Wherein, the preset area also includes a target area corresponding to the second area information.

4. The method for binding display elements of an electronic whiteboard as claimed in claim 2 or 3, characterized in that: After the step of detecting whether the target area is a preset area, the method further includes: If so, determining the interval between the generation time point of the display element and the generation time point of the display element most recently associated with the target area; When it is detected that the interval duration is greater than a preset duration, executing the step of creating the target area associated with the display element, and sending the area information of the display element and the target area associated with the display element to the second whiteboard; When it is detected that the interval duration is less than or equal to the preset duration, the step of binding the display element with other display elements in the target area and associating the display element with the area information of the target area and sending them to the second whiteboard is performed.

5. The method for binding display elements of an electronic whiteboard as claimed in claim 2 or 3, characterized in that: After the step of detecting whether the target area is a preset area, the method further includes: If so, determining the distance between the display element and other display elements in the target area; When it is detected that the distance is greater than a preset distance threshold, executing the step of creating a target area associated with the display element, and sending the area information of the display element and the target area associated with the display element to the second whiteboard; When it is detected that the distance is less than or equal to a preset distance threshold, the step of binding the display element with other display elements in the target area and associating the display element with the area information of the target area and sending the same to the second whiteboard is performed.

6. The method for binding display elements of an electronic whiteboard as claimed in claim 1, characterized in that: The step of associating the display element with the area information of the target area and sending the information to the second whiteboard comprises: updating the area range of the target area based on the position of the display element; updating the area information of the target area based on the area range; The display element is associated with the updated region information and sent to the second whiteboard.

7. The method for binding display elements of an electronic whiteboard as claimed in claim 6, characterized in that: The step of creating the target area associated with the display element comprises: Determine a minimum circumscribed rectangle of the display element according to the display area of ​​the display element; A target area is created according to the minimum bounding rectangle, and area information corresponding to the target area is generated according to the area range.

8. A display element binding device for an electronic whiteboard, characterized in that: include: A detection module, configured to detect whether the position of a display element is located in a target area when the first whiteboard detects that a display element is generated; a first processing module, configured to, if not, create a target area associated with the display element, and send area information of the display element and the target area associated with the display element to a second whiteboard, so that the second whiteboard can create the target area based on the area information, and display the display element associated with the area information in the target area; wherein the first whiteboard has established a communication connection with at least one of the second whiteboards; The second processing module is used to bind the display element with other display elements in the target area, and associate the display element with the area information of the target area and send it to the second whiteboard, so as to bind and display the display element with other display elements in the target area corresponding to the area information on the second whiteboard; wherein the mutually bound display elements are provided as a whole element for selection by the user of the second whiteboard.

9. A computer device, characterized in that: The computer device includes a memory, a processor, and an electronic whiteboard display element binding program stored in the memory and executable on the processor. When the electronic whiteboard display element binding program is executed by the processor, the steps of the electronic whiteboard display element binding method as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a display element binding program for an electronic whiteboard, and when the display element binding program for an electronic whiteboard is executed by a processor, the steps of the display element binding method for an electronic whiteboard as claimed in any one of claims 1 to 7 are implemented.

Images