Multi-terminal screen display method, device and equipment for electronic whiteboard

Through adaptive typesetting technology, the screen occupation and distribution problem when multiple terminals are connected to electronic whiteboards is solved, and the unified display of local operations of multiple terminals is realized, which improves the efficiency of electronic whiteboards and user experience.

CN112711389BActive Publication Date: 2024-11-15ANHUI IFLYREC TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011627591.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-31
Publication Date
2024-11-15
Estimated Expiration
2040-12-31

AI Technical Summary

Technical Problem

The existing electronic whiteboards have failed to effectively expand their functions in multi-terminal interaction scenarios, especially the interaction method between large-screen whiteboards and multiple client terminals is single, which has failed to effectively solve the problem of screen occupation and allocation during multi-terminal screen operation.

Method used

By presetting the display parameters of the electronic whiteboard and the display parameters of the access terminal, the size information of the display area is calculated, and the adaptive layout method is used to adapt and draw the local operation content of each terminal on the whiteboard, according to the priority and whiteboard dynamically adjust the layout of the display situation.

Benefits of technology

The local operation content of multiple terminals connected to electronic whiteboards is realized, which fully releases the space for electronic whiteboards and improves the efficiency and user experience of electronic whiteboards.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112711389B_ABST
    Figure CN112711389B_ABST
Patent Text Reader

Abstract

The present invention discloses a multi-terminal screen-on-screen method, device and equipment applied to an electronic whiteboard. The present invention combines the display properties of an electronic whiteboard with the display properties of each of multiple client terminals, and proposes a solution for the multi-terminal local operation screen-on-screen scenario. Specifically, according to the display properties of the access terminal and the electronic whiteboard, the size of the display area corresponding to the client terminal is calculated in real time, and according to the size of the display area and the real-time display of the whiteboard, the adaptive typesetting layout of the current display area is realized, so that the local operation content of each access terminal is synchronously adapted to the corresponding display area on the electronic whiteboard, thereby solving the need for multiple terminals to access the electronic whiteboard for local operation screen-on-screen. The present invention fully releases the application space of the electronic whiteboard, effectively expands the functional mode of the electronic whiteboard and multiple client terminals, so that the use efficiency of the electronic whiteboard can be significantly improved, and thus improves the user experience of the electronic whiteboard.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent interactive products, and in particular to a multi-terminal screen display method, device and equipment applied to an electronic whiteboard. Background Art

[0002] People have an increasing demand for screen-based electronic devices, especially in daily work communications. Not only can they communicate through traditional methods such as telephone, social platform applications, and email, but they also need to use writing to assist in communication. For example, in office meetings, education and teaching, skills training and other scenarios, screen-based electronic products with writing functions can intuitively display the ideas, speeches, topics, explanations, etc. of each user in these scenarios, which can not only assist the understanding of the participants, but also facilitate the formation of electronic format files for recording and archiving, without the need to use mobile phones, cameras, etc. to take pictures of traditional handwritten blackboards. Therefore, electronic writing tools used in the above scenarios are playing an increasingly important role in the field of smart interactive products.

[0003] At present, there are electronic whiteboard products on the market that can replace the traditional whiteboard written with a marker. It should be pointed out here that the whiteboard mentioned in the present invention is not limited to a white board surface. It is just that according to the usual naming habits in the industry, such hardware products that can be written and displayed are uniformly referred to as electronic whiteboards. For example, in a certain meeting scene, a large-screen intelligent interactive all-in-one machine is arranged in front of the meeting room, which can be considered as the whiteboard described in the present invention. In addition, based on the hardware electronic whiteboard products, some manufacturers have also developed virtual whiteboards that are conceptually related to the hardware electronic whiteboard, that is, whiteboard applications that can be loaded on terminal devices, such as but not limited to software products such as whiteboard APP, and from the perspective of actual operation, any electronic terminal that can be loaded with a whiteboard APP can be regarded as an electronic whiteboard. For example, the intelligent interactive all-in-one machine itself has multiple functions. When using the intelligent interactive all-in-one machine for a meeting, the built-in whiteboard APP program can be started to turn the intelligent interactive all-in-one machine into an electronic whiteboard.

[0004] Based on the above, the present invention pays attention to the fact that in a real application environment, the interaction function between an electronic whiteboard with a larger screen size (referred to as a large-screen whiteboard in the present invention) and a client terminal is relatively simple. Because the large-screen whiteboard has a relatively ample display space, it has the ability to connect to multiple client terminals and display the operation content of each terminal. However, the existing use of electronic whiteboards has not deeply explored the synchronous application mode of the large-screen whiteboard and the client terminal. It is still based on the relatively independent relationship between the two, and uses a stereotyped and fixed traditional interaction idea to perform simple screen mapping on each access terminal, such as projecting the terminal interface according to a solidified split-screen template.

[0005] Therefore, the present invention has analyzed and believed that the existing technology has not effectively expanded the functions of the electronic whiteboard, especially the richer interaction mode between the large-screen whiteboard and multiple client terminals, such as the upper screen function, and therefore has not solved the related problems such as the allocation of the whiteboard screen occupancy when multiple terminals are operated on the upper screen. It should be noted here that the upper screen operation that the present invention mainly focuses on is different from the aforementioned screen projection. The existing whiteboard projection technology directly displays the content displayed on the current screen of each computing terminal on the electronic whiteboard, such as displaying the desktop of the PC in a fixed area on the whiteboard. This is the same as the existing technology of directly projecting the film and television videos displayed on the mobile phone to the TV screen. The terminal upper screen that the present invention focuses on is for the specific use of the electronic whiteboard. As mentioned above, the emergence of the electronic whiteboard is mainly used as a writing tool for assisting language expression in scenes such as meetings and teaching. Therefore, the upper screen operation here refers to the process of synchronous transmission and display of the writing operations performed locally by each access terminal on the electronic whiteboard. This requires consideration of how to display the layout and draw local operations on the electronic whiteboard when multiple client terminals are connected. Summary of the invention

[0006] In view of the above, the present invention aims to provide a multi-terminal screen method, device and equipment applied to an electronic whiteboard, and correspondingly provides a computer-readable storage medium and a computer program product, which mainly solves the problem of how to layout and draw after multiple terminals connected to the electronic whiteboard upload their local operations to the electronic whiteboard screen.

[0007] The technical solution adopted by the present invention is as follows:

[0008] In a first aspect, the present invention provides a multi-terminal screen display method applied to an electronic whiteboard, comprising:

[0009] Presetting the first display parameter of the electronic whiteboard;

[0010] Acquire a second display parameter of a current client terminal connected to the electronic whiteboard;

[0011] Based on the first display parameter and the second display parameter, obtaining size information of a current display area of ​​the current client terminal on the electronic whiteboard;

[0012] According to a preset priority, and by using the first display parameter, the size information, and information of a number of display areas displayed by the electronic whiteboard, the current display area is adaptively typed on the electronic whiteboard; wherein the display areas correspond one to one with client terminals connected to the electronic whiteboard;

[0013] The local operation content of the current client terminal is acquired, and after the local operation content is adapted, it is drawn in the current display area.

[0014] In at least one possible implementation, obtaining the size information of the current display area of ​​the current client terminal on the electronic whiteboard based on the first display parameter and the second display parameter includes:

[0015] According to the area reference width value or the area reference height value in the first display parameter and the display attribute parameter of the current client terminal in the second display parameter, obtaining a current display area height value corresponding to the area reference width value or a current display area width value corresponding to the area reference height value;

[0016] The size information of the current display area is determined based on the area reference width value and the current display area height value, or based on the area reference height value and the current display area width value.

[0017] In at least one possible implementation manner, the priority level is divided into: dividing the priority level according to the timestamp when each client terminal accesses the electronic whiteboard, or dividing the priority level according to the preset authority of the user corresponding to each client terminal.

[0018] In at least one possible implementation, the using the first display parameter, the size information, and the information of the plurality of display areas displayed by the electronic whiteboard to adaptively layout the current display area on the electronic whiteboard includes:

[0019] Calculate the to-be-determined horizontal coordinate of the current display area according to the horizontal spacing value in the first display parameter, the number of display areas displayed in the current row of the whiteboard, and the total width of the displayed display areas;

[0020] Determine the preliminary layout position of the current display area and obtain the target horizontal coordinate of the current display area according to the undetermined horizontal coordinate, the area width information in the size information, and the maximum visible width of the whiteboard in the first display parameter;

[0021] Calculate the target vertical coordinate of the current display area according to the area height information in the size information, the vertical spacing value in the first display parameter, and the preliminary layout position;

[0022] The target horizontal coordinate and the target vertical coordinate are used to determine the target layout position of the current display area, and based on the target layout position and the size information, the current display area is drawn on the electronic whiteboard.

[0023] In at least one possible implementation, the method further includes:

[0024] When the electronic whiteboard adopts a non-scrolling fixed visual mode, a decision is made in real time whether to continue drawing the current display area on the electronic whiteboard based on the target vertical coordinate, the area height information in the size information, and the maximum value of the whiteboard visible height in the first display parameter.

[0025] In at least one possible implementation, the method further includes:

[0026] Monitor in real time whether the client terminal corresponding to the displayed display area is offline;

[0027] According to the size information of the display area of ​​the client terminal that is offline, the subsequent display areas are dynamically arranged to decide whether the subsequent display areas should be moved forward.

[0028] In a second aspect, the present invention provides a multi-terminal screen-on-screen device applied to an electronic whiteboard, comprising:

[0029] A whiteboard display parameter preset module, used to preset a first display parameter of the electronic whiteboard;

[0030] A terminal display parameter acquisition module, used to acquire a second display parameter of a current client terminal connected to the electronic whiteboard;

[0031] A display area size calculation module, used for obtaining size information of a current display area of ​​the current client terminal on the electronic whiteboard based on the first display parameter and the second display parameter;

[0032] A display area layout module, configured to adaptively layout the current display area on the electronic whiteboard according to a preset priority and by using the first display parameter, the size information, and information of a number of display areas displayed on the electronic whiteboard; wherein the display areas correspond one to one with client terminals connected to the electronic whiteboard;

[0033] The local operation upper screen module is used to obtain the local operation content of the current client terminal, and after adapting the local operation content, draw it in the current display area.

[0034] In at least one possible implementation manner, the display area size calculation module includes:

[0035] a size parameter calculation unit, configured to obtain, based on the area reference width value or the area reference height value in the first display parameter and the display attribute parameter of the current client terminal in the second display parameter, a current display area height value corresponding to the area reference width value or a current display area width value corresponding to the area reference height value;

[0036] The size information determining unit is used to determine the size information of the current display area based on the area reference width value and the current display area height value, or based on the area reference height value and the current display area width value.

[0037] In at least one possible implementation, the display area layout module includes a priority division unit, which is used to divide priorities according to the timestamp when each client terminal accesses the electronic whiteboard, or to divide priorities according to the preset permissions of the users corresponding to each client terminal.

[0038] In at least one possible implementation manner, the display area layout module further includes:

[0039] a pending horizontal coordinate calculation unit, used to calculate the pending horizontal coordinate of the current display area according to the horizontal spacing value in the first display parameter, the number of display areas displayed in the current row of the whiteboard, and the total width of the displayed display areas;

[0040] a target horizontal coordinate calculation unit, configured to determine a preliminary layout position of the current display area and obtain a target horizontal coordinate of the current display area according to the pending horizontal coordinate, the area width information in the size information, and the maximum visible width of the whiteboard in the first display parameter;

[0041] a target vertical coordinate calculation unit, configured to calculate a target vertical coordinate of the current display area according to the area height information in the size information, the vertical spacing value in the first display parameter, and the preliminary layout position;

[0042] The display area layout unit is used to determine the target layout position of the current display area by using the target horizontal coordinate and the target vertical coordinate, and draw the current display area on the electronic whiteboard based on the target layout position and the size information.

[0043] In at least one possible implementation manner, the display area layout unit is further used for:

[0044] When the electronic whiteboard adopts a non-scrolling fixed visual mode, a decision is made in real time whether to continue drawing the current display area on the electronic whiteboard based on the target vertical coordinate, the area height information in the size information, and the maximum value of the whiteboard visible height in the first display parameter.

[0045] In at least one possible implementation manner, the apparatus further includes a layout adjustment module, and the layout adjustment module includes:

[0046] An offline monitoring unit, used to monitor in real time whether the client terminal corresponding to the displayed display area is offline;

[0047] The dynamic layout unit is used to dynamically layout the subsequent display areas according to the size information of the display area of ​​the client terminal that is offline, so as to decide whether the subsequent display areas should be moved forward.

[0048] In a third aspect, the present invention provides a multi-terminal screen device, comprising:

[0049] One or more processors, a memory, and one or more computer programs, wherein the memory may adopt a non-volatile storage medium, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the device, the device executes the method as described in the first aspect or any possible implementation manner of the first aspect.

[0050] In a fourth aspect, the present invention provides a computer-readable storage medium, which stores a computer program, which, when executed on a computer, enables the computer to at least execute the method as described in the first aspect or any possible implementation of the first aspect.

[0051] In a fifth aspect, the present invention further provides a computer program product, which, when executed by a computer, is used to at least execute the method in the first aspect or any possible implementation manner of the first aspect.

[0052] In at least one possible implementation of the fifth aspect, the relevant programs involved in the product can be stored in whole or in part on a memory packaged with the processor, or can be stored in whole or in part on a storage medium not packaged with the processor.

[0053] The present invention combines the display properties of an electronic whiteboard with the display properties of each of multiple client terminals, and proposes a solution for the scenario of local operation on the screen of multiple terminals. Specifically, according to the display properties of the access terminal and the electronic whiteboard, the size information of the display area corresponding to the access terminal is calculated in real time, and according to the size information of the display area and the real-time display of the whiteboard, the adaptive typesetting layout of the current display area is realized, so that the local operation content of each access terminal is synchronously adapted to the corresponding display area on the electronic whiteboard according to a unified standard, thereby solving the need for multiple terminals to access the electronic whiteboard to perform their local operations on the screen. The proposal of the present invention fully releases the use space of the electronic whiteboard, effectively expands the functional mode of the electronic whiteboard and multiple client terminals, thereby significantly improving the use efficiency of the electronic whiteboard, and thereby improving the user experience of the electronic whiteboard. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described below with reference to the accompanying drawings, in which:

[0055] Figure 1 A flowchart of an embodiment of a multi-terminal screen display method applied to an electronic whiteboard provided by the present invention;

[0056] Figure 2 A flowchart of an embodiment of the adaptive typesetting method provided by the present invention;

[0057] Figure 3 A schematic diagram of an embodiment of a multi-terminal screen-on-screen device applied to an electronic whiteboard provided by the present invention;

[0058] Figure 4 A schematic diagram of an embodiment of a multi-terminal screen device provided by the present invention. DETAILED DESCRIPTION

[0059] Embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be interpreted as limiting the present invention.

[0060] The present invention provides at least one embodiment of a multi-terminal screen display method for an electronic whiteboard, referring to Figure 1 As shown, it may specifically include:

[0061] Step S1, presetting the first display parameter of the electronic whiteboard.

[0062] Display attribute parameters related to the display effect of the electronic whiteboard can be pre-configured. The display attribute parameters here can be directly related to the electronic whiteboard itself, or can be related to the display area that needs to be drawn on the electronic whiteboard and corresponds to the client terminal connected to the electronic whiteboard. The following text will provide several specific display parameters for reference in conjunction with specific implementation examples.

[0063] Step S2: Acquire a second display parameter of the current client terminal connected to the electronic whiteboard.

[0064] The connection between the client terminal and the electronic whiteboard mentioned here refers to the electrical signal connection method related to data transmission, such as but not limited to Bluetooth, WiFi (local area network or wide area network, etc.), radio frequency transceiver, etc., for which mature electrical signal connection solutions can be used as reference, and the present invention does not limit this. Furthermore, there can also be a variety of options for the client terminals supported by the electronic whiteboard, such as but not limited to mobile phones, tablets, handwriting boards, etc., and the present invention does not limit this. It should be noted that the second display parameter refers to information related to the display attributes of each client terminal, such as but not limited to screen resolution, local operation interface width and height values ​​or their ratios, etc., and the width and height parameters are preferably in pixels, but it is not excluded that in other embodiments, inches, centimeters, etc. are used as units.

[0065] In addition, there are multiple options for obtaining the second display parameters. For example, when the current client terminal is connected, the access terminal not only provides its ID and other information, but also provides width and height parameters related to its display resolution, which can be recorded as mobileWidth and mobileHeight, respectively representing the width and height values ​​of the operating interface of the client terminal; or the display parameters of several specific client terminal objects can be configured in the electronic whiteboard in advance, so that after the client terminal is connected, its ID can be used to match the pre-stored corresponding second display parameters.

[0066] Step S3: based on the first display parameter and the second display parameter, obtain the size information of the current display area of ​​the current client terminal on the electronic whiteboard.

[0067] The purpose of this step is to combine the display properties of the electronic whiteboard and the access terminal, and calculate the size of the corresponding display area of ​​the current client terminal on the electronic whiteboard according to the established scaling strategy. The specific size calculation method depends on the shape of the client terminal display interface. For example, if the client terminal is a circular operating interface (such as a certain model of smart watch), then it is necessary to calculate the corresponding display area size in the electronic whiteboard in actual operation, such as calculating the diameter and circumference of the corresponding display area of ​​the operating interface of the smart watch in the electronic whiteboard. The ultimate goal is to scale the operating interface of the client terminal proportionally on the electronic whiteboard to adapt to the upper screen display of subsequent local writing and other operations.

[0068] For ease of understanding, a relatively common implementation method for calculating the size of the display area of ​​a rectangular operating interface is used here to provide a schematic introduction: In actual operation, the current display area height value corresponding to the area benchmark width value or the current display area width value corresponding to the area benchmark height value can be calculated based on the area benchmark width value or the area benchmark height value in the first display parameter and the display attribute parameters of the current client terminal in the second display parameter.

[0069] Specifically, a constant parameter viewHeight can be preset in the first display parameter of the electronic whiteboard, which represents the area reference height value of the display area displayed on the electronic whiteboard (the method of setting the area reference width value is similar to this and will not be repeated here), then the current display area width value viewWidth to be calculated can be obtained according to the following formula:

[0070]

[0071] In this example, the size information of the current display area for the current access terminal can be determined by the preset area reference height value and the calculated current display area width value. The method of determining the size information of the current display area based on the area reference width value and the current display area height value is similar to this, and is not described in detail.

[0072] Step S4: Adaptively layout the current display area on the electronic whiteboard according to a preset priority and by using the first display parameter, the size information, and information about a number of display areas displayed on the electronic whiteboard.

[0073] Since the present invention is facing a one-to-many usage scenario, after obtaining the size of the display area of ​​the access terminal, before positioning and drawing, it is necessary to clarify the layout method. Here, the present invention proposes that it is necessary to consider which client terminal's display area should be arranged first in the electronic whiteboard visual interface, so it can be determined by dividing priorities. There are multiple options for the priority division method described here, such as dividing priorities according to the preset permissions of the users corresponding to each client terminal, that is, the permission level can be configured in advance for users of a certain number of client terminals, such as the client terminals of users with higher job levels have higher priorities, and the ID of the access terminal is used to match permissions in actual operations; of course, more preferably, the priority can be divided according to the timestamp of each client terminal accessing the electronic whiteboard, that is, when multiple terminals access the electronic whiteboard, the access order of each client terminal can be obtained, and the display area of ​​the client terminal that accesses first can be laid out in the electronic whiteboard first.

[0074] In addition, in the actual layout operation, the display area of ​​each access terminal can be laid out according to certain preset rules, such as in a general order from top to bottom and from left to right. Of course, the present invention does not exclude other layout strategies. For ease of understanding, the following will be introduced based on the rules from top to bottom and from left to right.

[0075] In some specific embodiments of the present invention, the adaptive typesetting method can refer to Figure 2 As shown, it specifically includes the following steps:

[0076] Step S41, calculating the to-be-determined horizontal coordinate of the current display area according to the horizontal spacing value in the first display parameter, the number of display areas displayed in the current row of the whiteboard, and the total width of the displayed display areas;

[0077] Step S42, determining the preliminary layout position of the current display area and obtaining the target horizontal coordinate of the current display area according to the undetermined horizontal coordinate, the area width information in the size information and the maximum visible width of the whiteboard in the first display parameter;

[0078] Step S43, calculating the target vertical coordinate of the current display area according to the area height information in the size information, the vertical spacing value in the first display parameter, and the preliminary layout position;

[0079] Step S44: Determine the target layout position of the current display area using the target horizontal coordinate and the target vertical coordinate, and draw the current display area on the electronic whiteboard based on the target layout position and the size information.

[0080] For example, the first display parameter may include the maximum visible width of the whiteboard screenWidth, the maximum visible height of the whiteboard screenHeight, the left margin leftMargin (an example of the horizontal spacing value), the top margin topMargin (an example of the vertical spacing value), the to-be-determined horizontal coordinate viewX', the target horizontal coordinate viewX, the target vertical coordinate viewY, and the number of display areas displayed in the current row of the whiteboard viewN. According to the above process, there may be:

[0081] viewX′=viewN×leftMargin+(View1Width+…+View n Width

[0082] Among them, (View1Width+…+View n Width) represents the total width of the displayed display area. Then the following conditions are determined:

[0083] viewX′+viewWidth<screenWidth?

[0084] Thus, the preliminary layout position can be determined. In this example, if the calculated horizontal position (current row) of the current display area is within the visible width of the whiteboard, it means that the current display area can be arranged in the current row. Otherwise, the determination result is the number of rows + 1, that is, the current display area is arranged in another row. If it is arranged in the current row, then there can be:

[0085] viewX=viewX′=viewN×leftMargin+(View1Width+…+View n Width

[0086] If you start a new row to lay out the current display area from the left, you can have:

[0087] viewX=leftMargin

[0088] Then, we can have:

[0089] viewY=(viewHeight+topMargin)×rowNum-viewHeight

[0090] The rowNum here represents the row number of the current display area, which is related to the aforementioned preliminary typesetting position.

[0091] Finally, viewX and viewY can be used to lock the target layout position of the current display area, and then the display area can be drawn on the electronic whiteboard according to the viewWidth and viewHeight of the current display area. As can be seen from the above example, this embodiment only represents the shape of the display area in the form of a rectangular frame. Then, those skilled in the art can understand that the aforementioned viewX and viewY can refer to the horizontal and vertical coordinate values ​​of a vertex of the rectangular frame in the whiteboard coordinate system (according to the above example, and the general screen coordinate system, it can specifically represent the coordinates of the upper left vertex of the rectangular display area, but it does not exclude the use of other vertices or the midpoint of an edge in other examples. This is based on the actual layout rules used, and the present invention does not limit it). Of course, in the display area examples of other shapes, the corresponding coordinate calculations can be performed according to the specific shape, which will not be elaborated in the present invention.

[0092] It can be supplemented that before actually drawing the display area, the visual mode of the electronic whiteboard can be further combined. For example, a certain electronic whiteboard can be configured with a scrolling visual effect (taking up and down scrolling as an example), that is, the number of access terminals can be ignored, and the display area of ​​the client terminal that is connected in real time can be continuously drawn according to the priority layout; for example, when a certain electronic whiteboard is configured as a non-scrolling fixed visual mode, it can be decided in real time whether to continue drawing the current display area on the electronic whiteboard based on the aforementioned target vertical coordinate, the area height information in the aforementioned size information, and the maximum value of the whiteboard visual height in the aforementioned first display parameter. Specifically, it can be judged based on the following conditions:

[0093] viewY+viewHeight>screenHeight?

[0094] In this example, if the calculated vertical position of the current display area exceeds the visible height of the whiteboard, the current display area will not be drawn, or the access of the current client terminal will be directly rejected, or the current client terminal can be allowed to access, but a prompt is required to wait, which is not limited by the present invention. It should be pointed out that the above examples are all based on the layout rules from top to bottom and from left to right. Under different layout rules, the concepts provided by the above examples can be referred to for adaptive expansion.

[0095] Step S5: Acquire the local operation content of the current client terminal, and after adapting the local operation content, draw it in the current display area.

[0096] After completing the layout of the display area, the local operation content of the current client terminal can be obtained for adaptive drawing. The adaptation here can refer to adapting the drawing ratio of the user's local operations on each client terminal (combined with the common uses of electronic whiteboards, i.e. writing text, lines and other similar operations) according to the ratio of the currently displayed display area. Of course, it can also refer to beautifying the local operations of each client terminal by using the operation content beautification strategy, so as to uniformly adapt the local operations of multiple terminals on the same electronic whiteboard.

[0097] In addition, the present invention is further designed in combination with certain situations that may occur in practical applications, that is, in some preferred embodiments of the present invention, it is also possible to monitor in real time whether the client terminal corresponding to each displayed display area is offline midway, such as passive disconnection, communication failure, or active disconnection by a high-authority user, etc. At this time, according to the size information of the display area of ​​the client terminal that is offline midway, its subsequent display areas can be dynamically typeset to decide whether the subsequent display areas are moved forward, that is, when the display area of ​​the client terminal that is offline midway is free in the whiteboard visual interface, it is necessary to adaptively typeset according to its own size and the size of its subsequent display area. If the size of the subsequent display area is smaller than the former, it can be moved forward, and so on. If the size of the subsequent display area is larger than the former, it can be considered to keep the current typesetting style. Of course, it can be further pointed out that for the aforementioned electronic whiteboard with a fixed visual mode, when the subsequent display area fills the vacant position, it can be combined with the size of the waiting current display area and processed again according to the aforementioned typesetting layout strategy to decide whether to draw the waiting current display area in the electronic whiteboard.

[0098] Finally, it can be explained that, in actual applications, the function expansion of the electronic whiteboard can be further provided. For example, after drawing the local content of each access terminal in each display area, one or more or all of the content in the display area can be selected and saved separately or in combination, and the saving format includes but is not limited to pictures, PDF, custom formats, etc., which are not limited by the present invention.

[0099] In summary, the present invention combines the display properties of the electronic whiteboard with the display properties of each of the multiple client terminals, and proposes a solution for the scenario of local operation on the screen of multiple terminals. Specifically, according to the display properties of the access terminal and the electronic whiteboard, the size information of the display area corresponding to the access terminal is calculated in real time, and according to the size information of the display area and the real-time display of the whiteboard, the adaptive typesetting layout of the current display area is realized, so that the local operation content of each access terminal is synchronously adapted to the corresponding display area on the electronic whiteboard according to a unified standard, thereby solving the need for multiple terminals to access the electronic whiteboard to perform their local operations on the screen. The proposal of the present invention fully releases the use space of the electronic whiteboard, effectively expands the functional mode of the electronic whiteboard and the multiple client terminals, so that the use efficiency of the electronic whiteboard can be significantly improved, and thus improves the user experience of the electronic whiteboard.

[0100] Corresponding to the above-mentioned embodiments and preferred solutions, the present invention also provides an embodiment of a multi-terminal screen device applied to an electronic whiteboard, such as Figure 3 As shown, it may specifically include the following components:

[0101] A whiteboard display parameter preset module 1, used to preset a first display parameter of the electronic whiteboard;

[0102] Terminal display parameter acquisition module 2, used to acquire the second display parameter of the current client terminal connected to the electronic whiteboard;

[0103] A display area size calculation module 3, used for obtaining size information of a current display area of ​​the current client terminal on the electronic whiteboard based on the first display parameter and the second display parameter;

[0104] The display area layout module 4 is used to adaptively layout the current display area on the electronic whiteboard according to a preset priority and by using the first display parameter, the size information and information of a number of display areas displayed on the electronic whiteboard; wherein the display areas correspond one to one with client terminals connected to the electronic whiteboard;

[0105] The local operation upper screen module 5 is used to obtain the local operation content of the current client terminal, and after adapting the local operation content, draw it in the current display area.

[0106] In at least one possible implementation manner, the display area size calculation module includes:

[0107] a size parameter calculation unit, configured to obtain, based on the area reference width value or the area reference height value in the first display parameter and the display attribute parameter of the current client terminal in the second display parameter, a current display area height value corresponding to the area reference width value or a current display area width value corresponding to the area reference height value;

[0108] The size information determining unit is used to determine the size information of the current display area based on the area reference width value and the current display area height value, or based on the area reference height value and the current display area width value.

[0109] In at least one possible implementation, the display area layout module includes a priority division unit, which is used to divide priorities according to the timestamp when each client terminal accesses the electronic whiteboard, or to divide priorities according to the preset permissions of the users corresponding to each client terminal.

[0110] In at least one possible implementation manner, the display area layout module further includes:

[0111] a pending horizontal coordinate calculation unit, used to calculate the pending horizontal coordinate of the current display area according to the horizontal spacing value in the first display parameter, the number of display areas displayed in the current row of the whiteboard, and the total width of the displayed display areas;

[0112] a target horizontal coordinate calculation unit, configured to determine a preliminary layout position of the current display area and obtain a target horizontal coordinate of the current display area according to the pending horizontal coordinate, the area width information in the size information, and the maximum visible width of the whiteboard in the first display parameter;

[0113] a target vertical coordinate calculation unit, configured to calculate a target vertical coordinate of the current display area according to the area height information in the size information, the vertical spacing value in the first display parameter, and the preliminary layout position;

[0114] The display area layout unit is used to determine the target layout position of the current display area by using the target horizontal coordinate and the target vertical coordinate, and draw the current display area on the electronic whiteboard based on the target layout position and the size information.

[0115] In at least one possible implementation manner, the display area layout unit is further used for:

[0116] When the electronic whiteboard adopts a non-scrolling fixed visual mode, a decision is made in real time whether to continue drawing the current display area on the electronic whiteboard based on the target vertical coordinate, the area height information in the size information, and the maximum value of the whiteboard visible height in the first display parameter.

[0117] In at least one possible implementation manner, the apparatus further includes a layout adjustment module, and the layout adjustment module includes:

[0118] An offline monitoring unit, used to monitor in real time whether the client terminal corresponding to the displayed display area is offline;

[0119] The dynamic layout unit is used to dynamically layout the subsequent display areas according to the size information of the display area of ​​the client terminal that is offline, so as to decide whether the subsequent display areas should be moved forward.

[0120] It should be understood that the above Figure 3 The division of the various components in the multi-terminal upper screen device applied to the electronic whiteboard shown is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these components can all be implemented in the form of software calling through processing elements; they can also be all implemented in the form of hardware; some components can also be implemented in the form of software calling through processing elements, and some components can be implemented in the form of hardware. For example, one of the above modules can be a separately established processing element, or it can be integrated in a chip of an electronic device. The implementation of other components is similar. In addition, all or part of these components can be integrated together, or they can be implemented independently. In the implementation process, each step of the above method or the above components can be completed by an integrated logic circuit of hardware in the processor element or instructions in software form.

[0121] For example, the above components may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more microprocessors (DSP), or one or more field programmable gate arrays (FPGA). For another example, these components may be integrated together to be implemented in the form of a system-on-a-chip (SOC).

[0122] Based on the above embodiments and their preferred solutions, those skilled in the art can understand that, in actual operation, the technical concept involved in the present invention can be applied to a variety of implementations. The present invention uses the following carrier as a schematic illustration:

[0123] (1) A multi-terminal screen device. The device may specifically include: one or more processors, a memory, and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the device, the device performs the steps / functions of the aforementioned embodiment or an equivalent implementation.

[0124] Figure 4 This is a structural schematic diagram of an embodiment of a multi-terminal screen device provided by the present invention, wherein the device can be an intelligent electronic whiteboard, or an interactive screen equivalent to an electronic whiteboard, an intelligent all-in-one machine, or other display device with a larger screen size.

[0125] Specific as Figure 4 As shown, the multi-terminal screen device 900 includes a processor 910 and a memory 930. The processor 910 and the memory 930 can communicate with each other through an internal connection path to transmit control and / or data signals. The memory 930 is used to store computer programs, and the processor 910 is used to call and run the computer program from the memory 930. The processor 910 and the memory 930 can be combined into a processing device, and more commonly, they are independent components. The processor 910 is used to execute the program code stored in the memory 930 to implement the above functions. In specific implementation, the memory 930 can also be integrated in the processor 910, or independent of the processor 910.

[0126] In addition, in order to make the function of the multi-terminal screen device 900 more complete, the device 900 may also include one or more of an input unit 960, a display unit 970, an audio circuit 980, a camera 990, and a sensor 901, and the audio circuit may also include a speaker 982, a microphone 984, etc. Among them, the display unit 970 may include a display screen.

[0127] Furthermore, the device 900 may also include a power supply 950 for providing electrical energy to various devices or circuits in the device 900 .

[0128] It should be understood that the operation and / or function of each component in the device 900 can be specifically referred to the description of the method, system and other embodiments in the previous text. To avoid repetition, the detailed description is appropriately omitted here.

[0129] It should be understood that Figure 4The processor 910 in the multi-terminal screen device 900 shown can be a system on chip SOC, which can include a central processing unit (Central Processing Unit; hereinafter referred to as: CPU), and can further include other types of processors, such as: image processor (Graphics Processing Unit; hereinafter referred to as: GPU), etc., which will be specifically introduced below.

[0130] In summary, the various processors or processing units within the processor 910 can work together to implement the previous method flow, and the corresponding software programs of the various processors or processing units can be stored in the memory 930.

[0131] (2) A readable storage medium having a computer program or the above-mentioned device stored thereon, which, when executed, enables a computer to execute the steps / functions of the aforementioned embodiment or an equivalent implementation.

[0132] In several embodiments provided by the present invention, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, some technical solutions of the present invention are essentially or part of the technical solution that contributes to the prior art or part of the technical solution can be embodied in the form of the software product described below.

[0133] (3) A computer program product (which may include the above-mentioned device), which, when running on a computer device, enables the computer device to execute the multi-terminal screen-on-screen method applied to an electronic whiteboard in the above-mentioned embodiment or an equivalent implementation. Specifically, the computer program product may refer to a whiteboard APP, or other software programs with similar functions.

[0134] It can be seen from the description of the above implementation methods that those skilled in the art can clearly understand that all or part of the steps in the above implementation method can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the above computer program product may include but is not limited to APP; continuing from the above, the above device / terminal may be a computer device, and the hardware structure of the computer device may also specifically include: at least one processor, at least one communication interface, at least one memory and at least one communication bus; the processor, communication interface, and memory can all communicate with each other through the communication bus. Among them, the processor may be a central processing unit CPU, DSP, microcontroller or digital signal processor, and may also include GPU, embedded neural network processor (Neural-network Process Units; hereinafter referred to as: NPU) and image signal processor (Image Signal Processing; hereinafter referred to as: ISP). The processor may also include a specific integrated circuit ASIC, or one or more integrated circuits configured to implement the embodiments of the present invention, etc. In addition, the processor may have the function of operating one or more software programs, and the software programs may be stored in a storage medium such as a memory; and the aforementioned memory / storage medium may include: non-volatile memory (non-volatile memory), such as a non-removable disk, U disk, mobile hard disk, optical disk, etc., as well as read-only memory (Read-Only Memory; hereinafter referred to as: ROM), random access memory (Random Access Memory; hereinafter referred to as: RAM), etc.

[0135] In the embodiments of the present invention, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. A and B may be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c may represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, c may be single or multiple.

[0136] Those skilled in the art will appreciate that the various modules, units, and method steps described in the embodiments disclosed in this specification can be implemented by a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0137] In addition, each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other. In particular, for embodiments such as devices and equipment, since they are basically similar to method embodiments, the relevant parts can refer to the partial description of the method embodiments. The embodiments of the devices and equipment described above are merely schematic, wherein the modules, units, etc. described as separate components may or may not be physically separated, that is, they may be located in one place, or they may be distributed in multiple places, such as nodes of a system network. Specifically, some or all of the modules and units may be selected according to actual needs to achieve the purpose of the above-mentioned embodiment scheme. Those skilled in the art can understand and implement it without paying creative labor.

[0138] The above describes in detail the structure, features and effects of the present invention based on the embodiments shown in the drawings, but the above is only a preferred embodiment of the present invention. It should be noted that the technical features involved in the above embodiments and their preferred methods can be reasonably combined and matched into a variety of equivalent schemes by those skilled in the art without departing from or changing the design ideas and technical effects of the present invention; therefore, the present invention is not limited to the scope of implementation shown in the drawings, and all changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments with equivalent changes, which still do not exceed the spirit covered by the specification and drawings, should be within the protection scope of the present invention.

Claims

1. A multi-terminal screen display method applied to an electronic whiteboard, characterized in that: include: Presetting the first display parameter of the electronic whiteboard; Acquire a second display parameter of a current client terminal connected to the electronic whiteboard; Based on the first display parameter and the second display parameter, obtaining size information of a current display area of ​​the current client terminal on the electronic whiteboard; According to a preset priority, and by using the first display parameter, the size information, and information of a number of display areas displayed on the electronic whiteboard, adaptively layout the current display area on the electronic whiteboard; The display area corresponds one-to-one to the client terminal connected to the electronic whiteboard; The adaptive layout includes: calculating the pending horizontal coordinate of the current display area according to the horizontal spacing value, the number of display areas displayed in the current row of the whiteboard, and the total width; determining the preliminary layout position of the current display area and obtaining the corresponding target horizontal coordinate by using the area width information and the maximum visible width of the whiteboard; calculating the target vertical coordinate according to the vertical spacing value of the area height information and the preliminary layout position; determining the target layout position of the current display area by using the target horizontal coordinate and the target vertical coordinate; and, when drawing the current display area on the electronic whiteboard, if the electronic whiteboard adopts a non-scrolling fixed visual mode, deciding whether to continue drawing the current display area on the electronic whiteboard in real time according to the target vertical coordinate, the area height information, and the maximum visible height of the whiteboard; The local operation content of the current client terminal is acquired, and after the local operation content is adapted, it is drawn in the current display area.

2. The multi-terminal screen display method applied to an electronic whiteboard according to claim 1, characterized in that: The obtaining, based on the first display parameter and the second display parameter, size information of the current display area of ​​the current client terminal on the electronic whiteboard comprises: According to the area reference width value or the area reference height value in the first display parameter and the display attribute parameter of the current client terminal in the second display parameter, obtaining a current display area height value corresponding to the area reference width value or a current display area width value corresponding to the area reference height value; The size information of the current display area is determined based on the area reference width value and the current display area height value, or based on the area reference height value and the current display area width value.

3. The multi-terminal screen display method applied to an electronic whiteboard according to claim 1, characterized in that: The priority level may be divided according to the timestamp of each client terminal accessing the electronic whiteboard, or according to the preset authority of the user corresponding to each client terminal.

4. The multi-terminal screen display method applied to an electronic whiteboard according to any one of claims 1 to 3, characterized in that: The method further comprises: Monitor in real time whether the client terminal corresponding to the displayed display area is offline; According to the size information of the display area of ​​the client terminal that is offline, the subsequent display areas are dynamically arranged to decide whether the subsequent display areas should be moved forward.

5. A multi-terminal screen device applied to an electronic whiteboard, characterized in that: include: A whiteboard display parameter preset module, used to preset a first display parameter of the electronic whiteboard; A terminal display parameter acquisition module, used to acquire a second display parameter of a current client terminal connected to the electronic whiteboard; A display area size calculation module, used for obtaining size information of a current display area of ​​the current client terminal on the electronic whiteboard based on the first display parameter and the second display parameter; A display area layout module, configured to adaptively layout the current display area on the electronic whiteboard according to a preset priority and by using the first display parameter, the size information, and information of a number of display areas displayed on the electronic whiteboard; The display area corresponds to the client terminal connected to the electronic whiteboard one by one; the adaptive layout includes: calculating the pending horizontal coordinate of the current display area according to the horizontal spacing value, the number of display areas displayed in the current row of the whiteboard and the total width; determining the preliminary layout position of the current display area and obtaining the corresponding target horizontal coordinate according to the area width information and the maximum visible width of the whiteboard; calculating the target vertical coordinate according to the vertical spacing value of the area height information and the preliminary layout position; and determining the target layout position of the current display area according to the target horizontal coordinate and the target vertical coordinate, and when drawing the current display area on the electronic whiteboard, if the electronic whiteboard adopts a non-scrolling fixed visual mode, deciding whether to continue drawing the current display area on the electronic whiteboard in real time according to the target vertical coordinate, the area height information and the maximum visible height of the whiteboard; The local operation upper screen module is used to obtain the local operation content of the current client terminal, and after adapting the local operation content, draw it in the current display area.

6. A multi-terminal screen device, characterized in that: include: One or more processors, a memory and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the device, the device executes the multi-terminal screen method applied to an electronic whiteboard as described in any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed on a computer, the computer executes the multi-terminal screen display method applied to an electronic whiteboard according to any one of claims 1 to 4.

8. A computer program product, characterized in that When the computer program product is executed by a computer, it is used to execute the multi-terminal screen display method applied to an electronic whiteboard as claimed in any one of claims 1 to 4.