Content recording method, content playing method, device, electronic device, computer readable storage medium and computer program product
By displaying recording controls in an online whiteboard to automatically record content, the problem of needing to manually set the acquisition angle in existing technologies is solved, achieving efficient content recording and playback.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- TENCENT TECHNOLOGY (SHENZHEN) CO LTD
- Filing Date
- 2024-11-29
- Publication Date
- 2026-05-29
AI Technical Summary
In existing technologies, when capturing content on an online whiteboard using image acquisition devices, the acquisition angle needs to be manually set, which makes the content recording process cumbersome, inefficient, and reduces user experience.
A content recording method is provided, which automatically starts the content recording function in response to the trigger operation by displaying a recording control in an online whiteboard, and generates a file of the operation and content.
It simplifies the content recording process, improves recording efficiency, avoids recording non-whiteboard content, and enhances user experience.
Smart Images

Figure CN122120523A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of data processing technology, and in particular to a content recording method, content playback method, apparatus, electronic device, computer-readable storage medium, and computer program product. Background Technology
[0002] In related technologies, multiple users can simultaneously access an online whiteboard for real-time collaboration and communication. To facilitate other users who are not accessing the online whiteboard to learn about the collaborative and communicative content, an image capture device can be used to capture the content, resulting in a video recording of the collaboration and communication. Other users can then learn about the collaboration and communication by watching the video. However, capturing content through an image capture device requires manually setting the capture angle, making the recording process cumbersome, inefficient, and detrimental to the user experience. Summary of the Invention
[0003] This application provides a content recording method, a content playback method, an apparatus, an electronic device, a computer-readable storage medium, and a computer program product, which can record operations and corresponding content on an online whiteboard.
[0004] The technical solution of this application embodiment is implemented as follows:
[0005] This application provides a content recording method, the method including:
[0006] The interface for displaying the online whiteboard includes recording controls for the online whiteboard.
[0007] The online whiteboard is used to allow at least two user objects to collaboratively perform visual operations on the online whiteboard.
[0008] In response to a trigger operation on the recording control, the content recording function for the online whiteboard is enabled;
[0009] Based on the content recording function, the operations performed on the online whiteboard are recorded;
[0010] In response to a command to close the content recording function, a file is generated that records the operation and the corresponding content.
[0011] This application provides a content playback method, the method including:
[0012] The interface displays an online whiteboard, which includes a file generated from recording the content of the online whiteboard.
[0013] The online whiteboard is used to allow at least two user objects to collaboratively perform visual operations on the online whiteboard. The file records the operations performed on the online whiteboard and the corresponding content of the operations.
[0014] In response to a triggered operation on the file, a content playback page is displayed, and the operation performed in the online whiteboard and the corresponding content are played on the content playback page.
[0015] This application provides a content recording device, the device comprising:
[0016] The first display module is used to display the interface of the online whiteboard, the interface including recording controls for the online whiteboard;
[0017] The online whiteboard is used to allow at least two user objects to collaboratively perform visual operations on the online whiteboard.
[0018] The response module is used to respond to a trigger operation on the recording control and enable the content recording function for the online whiteboard;
[0019] The recording module is used to record the operations performed on the online whiteboard based on the content recording function.
[0020] The response module is also configured to generate a file containing the operation and the corresponding content in response to a command to close the content recording function.
[0021] In the above scheme, the first display module is further configured to, in response to a trigger operation on the recording control, before enabling the content recording function for the online whiteboard, display an object setting control corresponding to the content recording function, the object setting control being used to set the user object corresponding to the recording operation; and receive the target user object set based on the object setting control;
[0022] The recording module is also used to record the operations performed by the target user object in the online whiteboard based on the content recording function.
[0023] In the above scheme, the first display module is further configured to respond to a trigger operation of setting a control for the object, display multiple object groups, each object group including at least one user object; and upon receiving a selection operation for a target object group among the multiple object groups, determine the user object in the selected target object group as the target user object.
[0024] In the above scheme, the first display module is further configured to, in response to a trigger operation on the recording control, before enabling the content recording function for the online whiteboard, display a tool setting control corresponding to the content recording function, wherein the tool setting control is used to set the operation tool corresponding to the recording operation; and receive the target operation tool set based on the tool setting control;
[0025] The recording module is also used to record operations performed on the online whiteboard using the target operation tool, based on the content recording function.
[0026] In the above scheme, the target operation tool includes a target drawing tool; the recording module is further used to record the target drawing operation performed by the target drawing tool in the online whiteboard based on the content recording function, and to identify the target drawing operation with a target color; wherein, the target color is used to indicate that the target drawing operation and the content drawn by the target drawing operation are being recorded.
[0027] In the above scheme, the response module is further configured to display recording prompt information in response to a trigger operation on the recording control. The recording prompt information is used to prompt the user object to confirm whether to record the operation performed on the online whiteboard. In response to a confirmation command triggered based on the recording prompt information, the content recording function for the online whiteboard is enabled.
[0028] In the above scheme, the response module is further configured to respond to a confirmation instruction triggered based on the recorded prompt information. If there are other user objects among the at least two user objects that have not triggered the confirmation instruction, a waiting prompt information is displayed. The waiting prompt information is used to indicate that the other user object is waiting to trigger the confirmation instruction.
[0029] In the above scheme, the first display module is further configured to, in response to a trigger operation on the recording control, display a region setting control corresponding to the content recording function before enabling the content recording function for the online whiteboard, the region setting control being used to set the recording region; and receive the target region of the online whiteboard set based on the region setting control;
[0030] The recording module is also used to record operations performed in the target area of the online whiteboard based on the content recording function.
[0031] In the above scheme, the recording module is further configured to, based on the content recording function, in response to a first drawing operation performed on the online whiteboard, display the content corresponding to the first drawing operation; in response to the display ratio of the content corresponding to the first drawing operation being greater than a preset ratio threshold, determine that the first drawing operation belongs to an operation performed in the target area, and record the first drawing operation and the content corresponding to the first drawing operation; wherein, the display ratio is the ratio of the area of the content corresponding to the first drawing operation in the target area to the area of the content corresponding to the first drawing operation.
[0032] In the above scheme, the first display module is also used to display the interface of an online document, the interface of which includes a startup control for an online whiteboard; in response to a trigger operation on the startup control, the interface of the online whiteboard is displayed, and the transparency of the online whiteboard is greater than that of the online document.
[0033] In the above scheme, the response module is further configured to, in response to a trigger operation on the recording control, display recording confirmation information for the content of the online document; and, in response to a recording confirmation instruction triggered by the recording confirmation information, enable the recording function for the content of the online whiteboard and the content of the online document.
[0034] In the above scheme, the number of operations performed in the online whiteboard is multiple. The response module is further configured to generate a file recording the operations and their corresponding content, and then, in response to a modification instruction for the file, display an editing interface for the file. The editing interface displays multiple operation identifiers sorted in chronological order, and each operation identifier corresponds one-to-one with an operation performed in the online whiteboard. In response to a deletion instruction for a first operation identifier among the multiple operation identifiers, the first operation identifier is deleted. In response to a file generation instruction, a file is generated recording operations with a second operation identifier and their corresponding content, wherein the second operation identifier is an operation identifier other than the first operation identifier among the multiple operation identifiers.
[0035] In the above scheme, the response module is further configured to, in response to a pause command for the content recording function, display the operation area corresponding to the operation in a first display style during the recording of the operation performed on the online whiteboard. The first display style is used to indicate that the operation area is in an inoperable state.
[0036] In the above scheme, the response module is further configured to, in response to a closing command for the content recording function, convert the recorded content of the online whiteboard into an operation identifier and operation parameters, and generate a file recording the operation and the corresponding content based on the operation identifier and the operation parameters; after generating the file recording the operation and the corresponding content, in response to a sharing command for the file, share the file recording the operation and the corresponding content to other user objects among the at least two user objects.
[0037] In the above scheme, the response module is further configured to respond to a first operation performed on the online whiteboard, and if the first operation has been performed on the online whiteboard within a first time interval from the current time point, then keep the content of the online whiteboard unchanged and display a first reason information for not performing the first operation; or, in response to a second operation performed on the online whiteboard, if a third operation conflicting with the second operation has been performed on the online whiteboard within a second time interval from the current time point, then keep the content of the online whiteboard unchanged and display a second reason information for not performing the second operation.
[0038] This application provides a content playback device, the device comprising:
[0039] The second display module is used to display the interface of the online whiteboard, the interface including a file generated by recording the content of the online whiteboard;
[0040] The online whiteboard is used to allow at least two user objects to collaboratively perform visual operations on the online whiteboard. The file records the operations performed on the online whiteboard and the corresponding content of the operations.
[0041] The playback module is configured to respond to a trigger operation on the file, display a content playback page, and play the operation performed in the online whiteboard and the corresponding content on the content playback page.
[0042] In the above scheme, there are multiple operations, each operation has an associated display time, and the multiple operations include a fourth operation; the playback module is also used to play the fourth operation performed in the online whiteboard and the content corresponding to the fourth operation in the content playback page in response to the time reaching the display time of the fourth operation.
[0043] In the above scheme, during the playback of the fourth operation, the content corresponding to the fourth operation is displayed using the second display style. The multiple operations also include a fifth operation. The display time of the fifth operation is after the display time of the fourth operation, and the display time of the fifth operation is adjacent to the display time of the fourth operation.
[0044] The playback module is further configured to play the fourth operation performed in the online whiteboard and the content corresponding to the fourth operation, and then, in response to the time reaching the display time of the fifth operation, cancel the display of the content corresponding to the fourth operation using the second display style, and play the fifth operation performed in the online whiteboard and the content corresponding to the fifth operation, and display the content corresponding to the fifth operation using the second display style.
[0045] In the above scheme, the file contains multiple user objects performing operations on the online whiteboard and the corresponding content of the operations. The content playback page displays a switching control for switching user objects on the online whiteboard. The playback module is also used to play the sixth operation performed by the first user object on the online whiteboard and the corresponding content of the sixth operation on the content playback page.
[0046] In response to a switching command triggered by the switching control, the content playback page plays the seventh operation performed by the second user object corresponding to the switching command on the online whiteboard, as well as the content corresponding to the seventh operation.
[0047] This application provides an electronic device, the electronic device comprising:
[0048] Memory is used to store executable instructions or computer programs.
[0049] When a processor executes computer-executable instructions or computer programs stored in the memory, it implements the content recording method provided in the embodiments of this application, or implements the content playback method provided in the embodiments of this application.
[0050] This application provides a computer-readable storage medium storing a computer program or computer-executable instructions, which, when executed by a processor, implements the content recording method or the content playback method provided in this application.
[0051] This application provides a computer program product, including a computer program or computer executable instructions. When the computer program or computer executable instructions are executed by a processor, they implement the content recording method or the content playback method provided in this application.
[0052] The embodiments of this application have the following beneficial effects:
[0053] The content recording method provided in this application embodiment can display the interface of an online whiteboard, which includes a recording control for the online whiteboard. The online whiteboard is used for at least two user objects to collaboratively perform visual operations. In response to a trigger operation on the recording control, the content recording function for the online whiteboard is enabled. Based on the content recording function, the operations performed on the online whiteboard are recorded. In response to a closing command for the content recording function, a file containing the operations and their corresponding content is generated.
[0054] This application includes a recording control for an online whiteboard. In response to a trigger operation on the recording control, the content of the online whiteboard can be recorded. Compared to using an image acquisition device to capture the content of the online whiteboard, there is no need to set the acquisition angle, enabling recording of operations and corresponding content on the online whiteboard. This simplifies the content recording process and improves recording efficiency. Furthermore, the online whiteboard content recording function can generate a file recording the operations performed on the online whiteboard and their corresponding content. Compared to using an image acquisition device, this avoids recording content other than the online whiteboard itself, further improving recording efficiency. Attached Figure Description
[0055] Figure 1 This is a schematic diagram of the content recording and playback system provided in the embodiments of this application;
[0056] Figure 2A This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Figure 1 ;
[0057] Figure 2B This is a second schematic diagram of the structure of the electronic device provided in the embodiments of this application;
[0058] Figure 3 This is a flowchart illustrating the content recording method provided in the embodiments of this application. Figure 1 ;
[0059] Figure 4 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 1 ;
[0060] Figure 5 This is a schematic diagram of the interface of the online whiteboard provided in this application embodiment;
[0061] Figure 6 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 3 ;
[0062] Figure 7 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 4 ;
[0063] Figure 8 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 5 ;
[0064] Figure 9 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 6 ;
[0065] Figure 10 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 7 ;
[0066] Figure 11 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 8 ;
[0067] Figure 12 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 9 ;
[0068] Figure 13 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 ;
[0069] Figure 14 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 one;
[0070] Figure 15 This is a second flowchart illustrating the content recording method provided in this application embodiment;
[0071] Figure 16 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 two;
[0072] Figure 17 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 three;
[0073] Figure 18 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 Four;
[0074] Figure 19 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 five;
[0075] Figure 20 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 six;
[0076] Figure 21 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 seven;
[0077] Figure 22 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 eight;
[0078] Figure 23 This is a flowchart illustrating the content recording method provided in the embodiments of this application. Figure 3 ;
[0079] Figure 24 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 Nine;
[0080] Figure 25 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 20 ;
[0081] Figure 26 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 20 one;
[0082] Figure 27 This is a flowchart illustrating the content recording method provided in the embodiments of this application. Figure 4 ;
[0083] Figure 28 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 20 two;
[0084] Figure 29 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 20 three;
[0085] Figure 30 This is a flowchart illustrating the content playback method provided in an embodiment of this application;
[0086] Figure 31 This is a schematic diagram of the content playback page provided in the embodiments of this application. Figure 1 ;
[0087] Figure 32 This is a second schematic diagram of the content playback page provided in the embodiments of this application;
[0088] Figure 33 This is a schematic diagram of the content playback page provided in the embodiments of this application. Figure 3 ;
[0089] Figure 34 This is a schematic diagram of the content playback page provided in the embodiments of this application. Figure 4 ;
[0090] Figure 35 This is a schematic diagram of the content playback page provided in the embodiments of this application. Figure 5 ;
[0091] Figure 36 This is a flowchart illustrating the content recording method and content playback method provided in the embodiments of this application. Detailed Implementation
[0092] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0093] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0094] In the following description, the terms "first, second, third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.
[0095] In this application embodiment, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.
[0096] Unless otherwise defined, all technical and scientific terms used in the embodiments of this application have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the embodiments of this application is for the purpose of describing the embodiments of this application only and is not intended to limit this application.
[0097] In the implementation of this application, the collection and processing of relevant data should strictly comply with the requirements of relevant laws and regulations, obtain the informed consent or separate consent of the personal information subject, and carry out subsequent data use and processing within the scope of laws and regulations and the authorization of the personal information subject.
[0098] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.
[0099] 1) Responding to: used to indicate the conditions or states on which the operation is performed depends. When the conditions or states on which it depends are met, one or more operations can be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.
[0100] 2) Human-computer interaction interface (HCI): This refers to the interface used to provide human-computer interaction functions, and also to the interface used to display online whiteboards. Examples include graphical user interfaces (GUIs), augmented reality (AR) interfaces, virtual reality (VR) interfaces, voice user interfaces (VUIs), interactive projection interfaces (using projection technology to display information on a flat surface), eye-tracking interfaces (interfaces controlled by detecting the user's gaze), holographic interfaces (three-dimensional holograms formed by projecting images using holographic projection technology, allowing viewing of stereoscopic images without special glasses), multimodal interfaces (interfaces combining multiple interaction methods, such as tactile, visual, and auditory interaction), and brain-machine interfaces (BMIs).
[0101] 3) Client, also known as user terminal, refers to the program that provides local services to users in contrast to the server. Except for some applications that can only run locally, it is generally installed on ordinary client machines and needs to cooperate with the server to run. That is, there needs to be a corresponding server and service program in the network to provide the corresponding services. Thus, a specific communication connection needs to be established between the client and the server to ensure the normal operation of the application, such as an online whiteboard client.
[0102] 4) Online whiteboards, also known as electronic whiteboards, are tools for online collaboration. They simulate the functionality of a physical whiteboard, allowing users to doodle, draw, write, add images, and annotate in a virtual space. Multiple users can access the same online whiteboard simultaneously for real-time collaboration and communication. Key features of online whiteboard software include real-time multi-user collaboration, interactive functions, various creation tools, multi-media support, customizable settings, and cloud storage. Online whiteboards can be used in various scenarios such as online education, online meetings, and team collaboration.
[0103] 5) Online documents are documents accessed and edited via the internet, and possess certain editable formats. For example, online documents can be text-based documents such as Word documents or TXT documents, presentation documents such as PowerPoint presentations, and portable document formats (PDF). Online documents allow users to store, share, and collaborate on documents in the cloud. They offer features such as real-time collaboration, multi-user editing, automatic saving, and version control.
[0104] During the research process, the inventors discovered the following technical problems in the relevant technology:
[0105] Technical Issue 1: In related technologies, multiple users can simultaneously access an online whiteboard for real-time collaboration and communication. To facilitate other users not accessing the online whiteboard to learn about the collaborative and communicative content, an image capture device can be used to capture the content, resulting in a video recording of the collaboration and communication. However, capturing content via an image capture device requires manually setting the capture angle, making the recording process cumbersome, inefficient, and detrimental to the user experience.
[0106] This application provides a content recording method, a content playback method, a content recording device, a content playback device, an electronic device, a computer-readable storage medium, and a computer program product, which can simplify the content recording process and improve the efficiency of content recording.
[0107] See Figure 1 , Figure 1 This is a schematic diagram of the structure of the content recording and playback system provided in the embodiments of this application. Figure 1 The content recording and playback system 100 shown is designed to support a content recording and playback system application. Terminals 400-1, 400-2, and 400-3 are all connected to server 200 via network 300. Network 300 can be a wide area network, a local area network, or a combination of both.
[0108] The online whiteboard interface is displayed on the graphical interface 410-1 of terminal 400-1 and on the graphical interface 410-2 of terminal 400-2. The online whiteboard interface includes recording controls for the online whiteboard. The online whiteboard is used to allow at least two user objects (including the user object corresponding to terminal 400-1 and the user object corresponding to terminal 400-2) to collaboratively perform visual operations on the online whiteboard.
[0109] In some embodiments, in response to the recording control displayed on the graphical interface 410-1 of the terminal 400-1, the content recording function for the online whiteboard is enabled. Based on the content recording function, the operations performed on the online whiteboard are recorded. In response to the command to close the content recording function, a file containing the operations and the corresponding content is generated.
[0110] In some embodiments, in response to the recording control displayed on the graphical interface 410-2 of the terminal 400-2, the content recording function for the online whiteboard is enabled. Based on the content recording function, the operations performed on the online whiteboard are recorded. In response to the command to close the content recording function, a file containing the operations and the corresponding content is generated.
[0111] In other words, the terminal corresponding to any one of at least two user objects (two or more) can respond to the trigger operation of the recording control, enable the content recording function for the online whiteboard, record the operations performed in the online whiteboard based on the content recording function, and generate a file containing the operations and their corresponding content in response to the closing command of the content recording function.
[0112] The content recording method provided in this application can record the content of an online whiteboard in response to a trigger operation on a recording control. Compared to using an image acquisition device to capture content, it eliminates the need to set a capture angle, simplifying the content recording process and improving efficiency. Furthermore, the online whiteboard content recording function can generate a file recording the operations performed on the online whiteboard and their corresponding content. Compared to using an image acquisition device, this avoids recording content other than the online whiteboard itself, further improving recording efficiency.
[0113] In some embodiments, since the user object corresponding to terminal 400-3 does not collaboratively perform the visualization operation in the online whiteboard, the user object corresponding to terminal 400-3 cannot know the content of the online whiteboard. In order to facilitate the user corresponding to terminal 400-3 to know the content of the online whiteboard, the interface of the online whiteboard can be displayed in the graphical interface 410-3 of terminal 400-3, and the interface includes the file generated by recording the content of the online whiteboard.
[0114] The online whiteboard allows at least two user objects to collaboratively perform visual operations. A file records the operations performed on the online whiteboard and their corresponding content. Furthermore, in response to a trigger operation on the file, a content playback page can be displayed on the graphical interface 410-3 of terminal 400-3, playing the operations performed on the online whiteboard and their corresponding content.
[0115] In some embodiments, the files recording operations performed on the online whiteboard and their corresponding content can be repeatedly viewed by users. These files may contain classroom content relevant to online education, allowing students or other teachers to learn based on the files. The files may also contain meeting content, enabling users who did not attend the meeting or need to view certain content to learn about the meeting's content. Furthermore, since playing the file is a reproduction of the file, users can more clearly understand the complete process of the online classroom or meeting, reducing communication costs.
[0116] The content playback method provided in this application embodiment can reproduce the content of the online whiteboard, that is, reproduce the operations performed on the online whiteboard and the corresponding content. Since no content other than the online whiteboard is recorded during the recording process, it can improve the efficiency of users obtaining the content of the online whiteboard, thereby improving the user experience.
[0117] The following describes exemplary applications of the electronic devices provided in the embodiments of this application. The electronic devices implementing the content recording method and content playback method provided in the embodiments of this application can be terminals, servers, or a combination of both. The electronic devices implementing the content recording method and the electronic devices implementing the content playback method can be the same or different, and can be configured according to actual usage requirements.
[0118] In some embodiments, the electronic devices provided in this application can be implemented as various types of terminals such as laptops, tablets, desktop computers, set-top boxes, smartphones, smart speakers, smartwatches, smart TVs, and vehicle terminals.
[0119] In some embodiments, the server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The terminal and server can be connected directly or indirectly via wired or wireless communication, which is not limited in this embodiment.
[0120] See Figure 2A and Figure 2B , Figure 2A This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Figure 1 , Figure 2B This is a second schematic diagram of the structure of the electronic device provided in the embodiments of this application. Figure 2A and Figure 2B The illustrated electronic device includes at least one processor 410, a memory 450, at least one network interface 420, and a user interface 430. The various components of the electronic device are coupled together via a bus system 440. It is understood that the bus system 440 is used to implement communication between these components. In addition to a data bus, the bus system 440 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in… Figure 2A and Figure 2B The general labeled all buses as Bus System 440.
[0121] The processor 410 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.
[0122] User interface 430 includes one or more output devices 431 that enable the presentation of media content, including one or more speakers and / or one or more visual displays. User interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.
[0123] The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state storage, hard disk drives, optical disk drives, etc. The memory 450 may optionally include one or more storage devices physically located away from the processor 410.
[0124] The memory 450 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 450 described in this application embodiment is intended to include any suitable type of memory.
[0125] In some embodiments, memory 450 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.
[0126] Operating system 451 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks;
[0127] The network communication module 452 is used to reach other electronic devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc.
[0128] Presentation module 453 is configured to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 431 (e.g., a display screen, a speaker, etc.) associated with user interface 430;
[0129] The input processing module 454 is used to detect and translate one or more user inputs or interactions from one or more input devices 432.
[0130] In some embodiments, the content recording device provided in this application can be implemented in software. Figure 2A A content recording device 455 stored in memory 450 is shown. This device can be software in the form of programs and plugins, and includes the following software modules: a first display module 4551, a response module 4552, and a recording module 4553. These modules are logically linked and can therefore be arbitrarily combined or further separated according to the functions they implement. The functions of each module will be described below.
[0131] In some embodiments, the content playback device provided in this application can be implemented in software. Figure 2BA content playback device 456 stored in memory 450 is shown. This device may be software in the form of programs and plugins, and includes the following software modules: a second display module 4561 and a playback module 4562. These modules are logically linked and can therefore be arbitrarily combined or further separated according to their implemented functions. The functions of each module will be described below.
[0132] In other embodiments, the content recording device and content playback device provided in this application can be implemented in hardware. As an example, the content recording device and content playback device provided in this application can be a processor in the form of a hardware decoding processor, which is programmed to execute the content recording method and content playback method provided in this application. For example, the processor in the form of a hardware decoding processor can be one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.
[0133] In some embodiments, the terminal or server can implement the content recording method or content playback method provided in this application by running various computer-executable instructions or computer programs. For example, computer-executable instructions can be microprogram-level commands, machine instructions, or software instructions. Computer programs can be native programs or software modules in an operating system; they can be native applications (APPs), i.e., programs that need to be installed in the operating system to run, such as online document applications and online whiteboard applications; or they can be applets that can be embedded in any APP, i.e., programs that only need to be downloaded to a browser environment to run. In summary, the aforementioned computer-executable instructions can be any form of instruction, and the aforementioned computer programs can be any form of application, module, or plugin.
[0134] The content recording method provided in the embodiments of this application will be described below. As mentioned above, the electronic device that implements the content recording method provided in the embodiments of this application can be a terminal, a server, or a combination of the two.
[0135] See Figure 3 , Figure 3This is a flowchart illustrating the content recording method provided in the embodiments of this application. Figure 1 The following is combined with Figure 3 The steps are shown, and the content recording method provided in this application embodiment is described using a terminal as the execution subject as an example.
[0136] In step 101, the interface of the online whiteboard is displayed.
[0137] In practical applications, the terminal can be equipped with an application that supports online whiteboards. When a user needs to use an online whiteboard, in response to a trigger operation for the application that supports online whiteboards, a creation control for creating an online whiteboard can be displayed. In response to a trigger operation for the creation control, an online whiteboard can be created and its interface can be displayed.
[0138] To facilitate use of the online whiteboard by other users, users can share the online whiteboard link with other users via their terminals, or other users can display the online whiteboard interface on their corresponding terminals using a pre-set password. The content recording method provided in this application embodiment can be applied to various scenarios such as online education, online meetings, and team collaboration. Specific settings can be configured according to actual usage requirements.
[0139] In some embodiments, other user objects can share a link to the online whiteboard to the user object's terminal, and the online whiteboard interface can be displayed in response to a triggering operation for the link. In some embodiments, the online whiteboard interface can be displayed in response to a password input operation. Specific settings can be configured according to actual usage requirements and are not specifically limited here.
[0140] In this context, the user object refers to the user object using the online whiteboard. The online whiteboard is used to allow at least two (two or more) user objects to collaboratively perform visual operations. In some embodiments, the visual operations may include content drawing operations, content clearing operations, text insertion operations, image insertion operations, graphic addition operations, zooming operations, element editing operations, commenting operations, saving operations, locking operations, unlocking operations, undoing operations, restoring operations, voting operations, timing operations, etc.
[0141] Content drawing operations can include drawing, doodling, drawing, and content annotation. Content drawing operations can include one or more content drawing sub-operations, which can include drawing points, drawing lines, drawing shapes, etc.
[0142] The content clearing operation can be used to clear content drawn by the content drawing operation, as well as other content displayed on the online whiteboard. The clearing area can be points, lines, or surfaces, and can be set according to actual usage needs.
[0143] The text insertion operation is used to add text to the online whiteboard. This can be done through text boxes or by handwriting using user objects. The image insertion operation is used to add images to the online whiteboard. Images can be stored on the terminal or imagined images.
[0144] The graphic addition operation is used to add pre-defined shapes and / or icons to the online whiteboard. The zoom operation can be used to zoom the online whiteboard interface, and also to zoom the elements in the online whiteboard. Elements can be one or more of the content drawn by the content drawing operation, text insertion operation, image insertion operation, and graphic addition operation. That is, elements can be one or more of the following: drawn graphics, inserted text, inserted images, and inserted graphics.
[0145] Element editing operations are used to edit elements in the online whiteboard. For example, element marking operations can change the element's color, change the element's line style, whether to fill it with color, change the element's position, and change the element's display priority. Among these, if the element's display priority is higher than that of other elements, then the element can cover other elements, meaning that the user can intuitively see the element.
[0146] The comment function is used to comment on elements in the online whiteboard. When displaying online documents, the comment function can also be used to comment on the content of the online documents. The specific settings can be configured according to actual usage needs.
[0147] The save operation can be used to save elements in the online whiteboard, and can also save the current content of the online whiteboard as a template. The lock operation is used to prevent all or some user objects from editing the online whiteboard. The unlock operation is used to allow all or some user objects to edit the online whiteboard.
[0148] The undo operation cancels all operations performed on the online whiteboard within a preset time period, as well as the corresponding content. The restore operation restores the content corresponding to the undo operation, and can also be used to restore the content cleared by the content clearing operation within a preset time period.
[0149] The voting operation allows multiple users to vote on the online whiteboard. The timing operation records the time spent using the online whiteboard. The timing operation can also be used for countdowns. For example, in an online meeting scenario, a 5-minute countdown can be set for discussing item A. After the countdown ends, item B can proceed, thus enabling users to improve the efficiency of online meetings through the online whiteboard.
[0150] In some embodiments, the interface displaying the online whiteboard includes a recording control for the online whiteboard, which is used to record the content of the online whiteboard. For example, see... Figure 4 , Figure 4 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 1 The interface 401 for displaying the online whiteboard includes a recording control 402 for the online whiteboard.
[0151] In some embodiments, the interface displayed on the online whiteboard also includes settings controls, which may include object settings controls, tool settings controls, region settings controls, etc. In response to a trigger operation on the settings controls, a settings page can be displayed, which may display object settings controls, tool settings controls, region settings controls, etc.
[0152] The settings page may also include other settings controls for configuring the online whiteboard, such as controls for setting the color of the online whiteboard, controls for setting the file storage location, and controls for setting the number of user objects to perform visual operations.
[0153] Object settings controls, tool settings controls, and region settings controls can also be displayed on the online whiteboard interface, for example, see [link to example]. Figure 4 The online whiteboard interface 401 also includes object setting control 403, tool setting control 404, and region setting control 405.
[0154] The object settings control is used to configure the user object corresponding to the recording operation. The tool settings control is used to configure the operation tool corresponding to the recording operation. The region settings control is used to configure the recording region.
[0155] See also Figure 3 In step 102, in response to a trigger operation on the recording control, the content recording function for the online whiteboard is enabled.
[0156] In step 103, the operations performed on the online whiteboard are recorded using the content recording function.
[0157] The content recording function records the visual operations performed by two or more user objects on the online whiteboard, along with the corresponding content. The recording control can record all content on the online whiteboard, or only a portion of it. Users can configure this according to their needs; in other words, the scope of the recorded content can be set. The following explains how to set the scope of the recorded content.
[0158] In the first setup, two or more user objects collaboratively perform visual operations on the online whiteboard. The online whiteboard can display the content corresponding to the executed operations. For easy distinction, the content corresponding to the executed operations on the online whiteboard is called the first content. Based on the display of the first content on the online whiteboard, step 102 can be executed.
[0159] In other words, based on the initial content displayed on the online whiteboard, the recording function for the online whiteboard content can be enabled in response to the trigger operation of the recording control. Based on the content recording function, the visual operations performed collaboratively by two or more user objects on the online whiteboard after the initial content, as well as the corresponding content of the operations, can be recorded.
[0160] For the first setup method, users can choose when to record the content of the online whiteboard according to their actual needs, thereby recording all or part of the content on the online whiteboard, which can improve the user experience.
[0161] The second setting method is... Figure 3 Before step 102 shown, an object setting control corresponding to the content recording function can be displayed. The object setting control can be displayed on the online whiteboard interface, or on the settings interface corresponding to the online whiteboard. It can also respond to a first display instruction for the object setting control, thereby displaying the object setting control on the online whiteboard interface. The first display instruction is an instruction for displaying the object setting control. For example, the first display instruction can be double-clicking the whiteboard.
[0162] In some embodiments, in response to a trigger operation that sets a control for an object, a pop-up window or a floating layer can be used to display the user object corresponding to the online whiteboard and the first selection control corresponding to the user object. Specifically, one or more of the following can be displayed: the name of the user object corresponding to the online whiteboard, the avatar of the user object, and the account of the user object. The specific settings can be configured according to actual usage requirements.
[0163] In response to a selection operation of a target user object in the user object corresponding to the online whiteboard, the first selection control corresponding to the target user object can be controlled to be in a selected state. In response to a selection completion instruction for the target user object, the target user object set based on the object setting control can be received.
[0164] For example, see Figure 5 , Figure 5 This is a schematic diagram of the interface of the online whiteboard provided in this embodiment of the application, which is a continuation of the previous one. Figure 4 In response to the triggered operation of setting control 403 for an object, it can display Figure 5 The pop-up window 501 shown displays user objects 1-6, and the first selection controls corresponding to user objects 1-6. Figure 5 Only the first selection control 503 of user object 1 and the first selection control 504 of user object 6 are shown in the image.
[0165] See Figure 6 , Figure 6 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 3 In response to a trigger operation on the first selection control 503 of user object 1, the first selection control 503 can be controlled to be in a selected state. In response to a first selection control of user object 2, the first selection control of user object 2 can be controlled to be in a selected state.
[0166] In response to the trigger operation of the completion control 505, a selection completion instruction for the target user objects (i.e., user object 1 and user object 2) can be received. In response to the selection completion instruction, the target user object set based on the object setting control can be received. In this way, users can select the target user object to record the operation to be performed on the online whiteboard according to their actual usage needs.
[0167] After receiving the target user object set based on the object setting control, the operation performed by the target user object in the online whiteboard is recorded using the content recording function. In this way, only the operation performed by the target user object in the online whiteboard can be recorded, thereby recording only part of the online whiteboard content. This avoids recording content that the user does not want to be recorded, increases the selectivity of content recording, and improves the security of the online whiteboard and the efficiency of content recording.
[0168] In some embodiments, to further facilitate setting the target user object, a search control for the user object corresponding to the online whiteboard can be displayed when the user object corresponding to the online whiteboard is displayed. In response to a search command triggered by the search control, the user object corresponding to the search command can be set as the target user object. In response to a selection command for the user object corresponding to the search command, the user object corresponding to the search command can be set as the target user object.
[0169] For example, see Figure 5 , Figure 5 A search control 502 is shown for a user object corresponding to the online whiteboard, responding to a search command from user object 15 triggered by the search control 502. See [link to relevant documentation]. Figure 7 , Figure 7 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 4 The search results for user object 15 can be displayed in pop-up window 501. In response to the triggering operation of the first selection control 701 for user object 15, the first selection control 701 of user object 15 can be controlled to be in the selected state. Figure 7 (Not shown in the image).
[0170] Furthermore, in response to a selection completion command triggered by user object 15, the system can receive the target user object (i.e., user object 15) set based on the object setting control. Using the content recording function, it can record the operations performed by the target user object in the online whiteboard. This approach further improves the efficiency of setting and recording the target user object's operations in the online whiteboard, allowing for the recording of only a portion of the online whiteboard content. It avoids recording content the user doesn't want to record, increases the selectivity of content recording, enhances the security of the online whiteboard, and improves the efficiency of recording, thereby further improving the user experience.
[0171] In some embodiments, in response to a triggering operation on an object setting control, multiple object groups can be displayed in the form of a pop-up or a floating layer. Each object group includes one or more user objects (i.e., at least one user object), meaning that two or more user objects exist in an object group.
[0172] In some embodiments, the name of a user object includes a group identifier and a user name, and the object group can be divided according to the group identifier. For example, the name of a user object is "Group 1 - User 1", where "Group 1" is the group identifier and "User 1" is the user name. Thus, the object group can be divided into user objects belonging to "Group 1" and user objects not belonging to "Group 1". In this way, it is easy to distinguish user objects in different groups.
[0173] Object grouping can also be based on the frequency of user actions recorded on the online whiteboard within a first time interval. For example, within a week (i.e., the first time interval), user actions recorded on the online whiteboard more than a first frequency threshold constitute one object group, while user actions recorded on the online whiteboard less than or equal to the first frequency threshold constitute another object group. Of course, user objects can also be grouped according to gender, pre-set weights, registration duration, etc., and the specific settings can be configured according to actual usage needs.
[0174] In some embodiments, in response to a selection instruction for a target object group among multiple object groups, a selection operation for a target object group among multiple object groups is received, and the user object in the selected target object group is determined as the target user object. The method of displaying the multiple object groups and the method of selecting the target object group can be configured to... Figures 5-7 It is reasonable to perform equivalent substitutions and, correspondingly, to use search controls to group search objects.
[0175] In some embodiments, different object groups can be displayed in different display areas, and the selection area corresponds one-to-one with the object group. In response to the selection instruction for the target display area in multiple display areas, the selection operation for the target object group (i.e. the object group corresponding to the target display area) in multiple object groups can be received, and the user object in the object group corresponding to the target display area can be determined as the target user object.
[0176] For example, see Figure 8 , Figure 8 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 5 Object group 1 contains two user objects, which can be displayed in display area 801, specifically showing the avatars of the two user objects in object group 1. Object group 2 contains one user object, which can be displayed in display area 802, specifically showing the name of the one user object in object group 2. Object group 3 contains two user objects, which can be displayed in display area 803, specifically showing the account of one user object and the name of the other user object in object group 3.
[0177] Each display area has a corresponding second selection control. Figure 8 In the display area 801, there is a corresponding second selection control 804; in the display area 802, there is a corresponding second selection control 805; and in the display area 803, there is a corresponding second selection control 806.
[0178] In response to a selection instruction for a target display area 801 among multiple display areas, that is, in response to a trigger operation on the second selection control 804, see [link to relevant documentation]. Figure 9 , Figure 9 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 6 It can control the second selection control 804 to be in a selected state, can receive selection operations for the target object group (i.e., object group 1), and can determine the user object in the object group (i.e., object group 1) corresponding to the target display area (i.e., display area 801) as the target user object. In this way, the process of setting the target user object can be simplified.
[0179] In some embodiments, to further adjust the target user object, the user objects in the target object group have a third selection control. In response to a selection instruction for a target display area in multiple display areas, the user object corresponding to the target display area can be controlled to be in a selected state. For example, see [link to relevant documentation]. Figure 9 In response to a trigger operation on the second selection control 804, the second selection control 804 can be controlled to be in a selected state, and the user objects corresponding to the display area 801 can be controlled to be in a selected state.
[0180] Furthermore, in response to a trigger operation on the third selection control, the user object corresponding to the target display area can be controlled to be in a deselected or selected state, thereby enabling adjustments to the target user object. This method allows for precise settings of the target user object.
[0181] After identifying the target user object, the operations performed by the target user object in the online whiteboard can be recorded using the content recording function. In some embodiments, if the user object corresponding to the terminal is the target user object, the operations performed in the online whiteboard can be recorded in response to the operations performed in the online whiteboard. If the user object corresponding to the terminal is not the target user object, the operations performed in the online whiteboard may not be recorded in response to the operations performed in the online whiteboard.
[0182] In some embodiments, to allow users to intuitively understand whether recording is in progress or not, a recording indicator can be displayed while the target user is performing an operation on the online whiteboard. This indicator serves to indicate that recording is in progress. The recording indicator may not be displayed while other user objects (i.e., non-target user objects) are performing operations on the online whiteboard.
[0183] In some embodiments, multiple user objects can perform operations simultaneously on the online whiteboard, and object prompts can be displayed for the user objects performing operations on the online whiteboard, for example, see [link to relevant documentation]. Figure 10, Figure 10 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 7 , undertake Figure 4 Multiple user objects can perform operations simultaneously on the online whiteboard. Figure 10 In the process, object prompt information 406 and object prompt information 407 can be displayed. Object prompt information 406 means "User object 1 is operating", and user object 1 is the target user object. The recording identifier 408 for user object 1 can be displayed accordingly. Object prompt information 407 means "User object 5 is operating", and user object 5 is not the target user object.
[0184] To allow users to intuitively understand whether recording is enabled or disabled, a recording indicator can be displayed in the associated area of the object prompt information 406 corresponding to user object 1 (i.e., the target user object), while the recording indicator is not displayed in the associated area of the object prompt information 406 corresponding to user object 5. The associated area is defined as the region where the distance from the object prompt information is less than a preset distance threshold. Depending on the user's actual needs, the recording indicator can also be displayed in associated areas such as the target user object's avatar, account, or name. In this way, users can intuitively understand whether recording is enabled or disabled.
[0185] In some embodiments, a third display style may be used to display the content corresponding to the operation that needs to be recorded, and a fourth display style may be used to display the content corresponding to the operation that does not need to be recorded. The third display style and the fourth display style are different.
[0186] The display styles include display color, lines, transparency, shadows, animation effects, and display indicators. The display indicators can be pre-defined graphics that indicate whether recording is required. The third and fourth display styles can differ in display color; for example, operations requiring recording are displayed in red, while operations not requiring recording are displayed in green.
[0187] The third and fourth display styles can also differ in the type of lines used. For example, content corresponding to operations requiring recording is displayed with solid lines, while content corresponding to operations not requiring recording is displayed with dashed lines. Differences between the third and fourth display styles can also include differences in transparency, the presence of shadows, animation effects, or display icons—one or more of these will not be elaborated upon here.
[0188] The second setup method further improves the efficiency of recording operations performed on the online whiteboard by targeting specific user groups. It allows for recording only a portion of the online whiteboard content, avoiding the recording of unwanted information, increasing the selectivity of recorded content, enhancing the security of the online whiteboard, and improving recording efficiency. This ultimately enhances the user experience.
[0189] The third setting method is... Figure 3 Before step 102, the tool settings control corresponding to the content recording function can be displayed. This tool settings control can be displayed on the online whiteboard interface, or on the settings interface corresponding to the online whiteboard. It can also be displayed on the online whiteboard interface in response to a second display instruction for the tool settings control. The second display instruction is an instruction used to display the tool settings control. The second display instruction can be different from the first display instruction.
[0190] In some embodiments, in response to a trigger operation on the tool settings control, the corresponding operation tools of the online whiteboard can be displayed in the form of a pop-up window or a floating layer. The operation tools may include content drawing tools, content clearing tools, text insertion tools, image insertion tools, graphic addition tools, zoom tools, element editing tools, comment tools, save tools, lock tools, unlock tools, undo tools, restore tools, voting tools, timers, etc. The above operation tools are used to perform corresponding operations. For details, please refer to the description of the visual operation, which will not be elaborated here.
[0191] In some embodiments, each operating tool has a corresponding first recording control. In response to a recording instruction triggered by the first recording control, the operating tool can be set as a target operating tool, that is, the target operating tool set based on the tool setting control is received.
[0192] For example, see Figure 11 , Figure 11 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 8 , undertake Figure 4 In response to the trigger operation of the tool setting control 404, a pop-up window 1101 can be displayed. The pop-up window 1101 displays operation tool 1 to operation tool 4. Each operation tool has a corresponding first recording control. The first recording control of operation tool 1 displays "Yes", that is, the operation performed by operation tool 1 in the online whiteboard is recorded.
[0193] The first recording control for operation tool 2 displays "No," meaning that operations performed using operation tool 2 on the online whiteboard will not be recorded. The first recording control for operation tool 3 displays "No," meaning that operations performed using operation tool 3 on the online whiteboard will not be recorded. The first recording control for operation tool 4 displays "Yes," meaning that operations performed using operation tool 4 on the online whiteboard will be recorded. In other words, the target operation tools are operation tool 1 and operation tool 2.
[0194] See also Figure 11 In response to a trigger operation on the first recording control of the operation tool 1, the first recording control of the operation tool 1 can display "No" (in... Figure 11 (Not shown in the image), similarly for operation tools 2-4, in this way, the target operation tool can be set according to the user's actual needs, thereby improving the user experience.
[0195] In some embodiments, the operation tool may have multiple operation sub-tools. For example, the content drawing tool may include operation sub-tools corresponding to different brushes (i.e., content drawing sub-tools), and the graphic adding tool may include operation sub-tools for adding different graphics (i.e., graphic adding sub-tools).
[0196] Each sub-tool has a corresponding second recording control. In response to a recording command triggered by the second recording control, the sub-tool can be set as the target tool, that is, the target tool is received based on the tool setting control.
[0197] For example, see Figure 12 , Figure 12 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 9 , Figure 12 The display shows different drawing tools corresponding to different brushes, including pencil 1201, brush 1202 and crayon 1203. Pencil 1201, brush 1202 and crayon 1203 are all content drawing tools, and pencil 1201, brush 1202 and crayon 1203 are all selectable. That is, the control of pencil 1201, brush 1202 and crayon 1203 are the second recording control.
[0198] In response to the selection operation of pencil 1201, which is equivalent to responding to the recording command triggered by the second recording control, pencil 1201 can be controlled to be in an optional state. The recording identifier 1204 is used to indicate that pencil 1201 is in an optional state, and pencil 1201 can be set as the target operation tool.
[0199] For example, see Figure 13 , Figure 13 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 , Figure 13 The interface displays sub-tools for adding different graphics, specifically including sub-tools for adding graphics 1301, 1302, 1304, 1305, and 1306.
[0200] Figure 13 The sub-tools for adding different graphics shown are all selectable. Specifically, the sub-tools for adding graphics 1301, 1302, 1304, 1305, and 1306 are the second recording controls.
[0201] In response to the selection operation of the sub-tool for adding graphics 1302, which is equivalent to responding to the recording command triggered by the second recording control, the sub-tool for adding graphics 1302 can be controlled to be in an optional state. The recording identifier 1303 indicates that the sub-tool for adding graphics 1302 is in an optional state, and the sub-tool for adding graphics 1302 can be set as the target operation tool.
[0202] After identifying the target tool, the operations performed using that tool on the online whiteboard are recorded using the content recording function. In some embodiments, when the target tool is a target drawing tool (i.e., a content drawing tool or a content drawing sub-tool), the target drawing operations performed on the online whiteboard using the target drawing tool are recorded, and a target color is used to identify the target drawing operations. The target color indicates that the target drawing operation and the content drawn by the target drawing operation are being recorded. In this way, users can intuitively understand the operation being recorded.
[0203] In some embodiments, when using a target drawing tool, the color set by the user for the target drawing tool is the target color. In other embodiments, the color set by the user for the target drawing tool is not the target color; instead, a target color different from the user-set target drawing tool color can be used to surround the content drawn by the target drawing operation, so that the user can intuitively understand the recording operation.
[0204] In some embodiments, when the target operation tool is a target drawing tool, the drawing operation performed by the target drawing tool in the online whiteboard is recorded based on the content recording function, and the target drawing operation is identified by a target line type. The target line type is used to indicate that the target drawing operation and the content drawn by the target drawing operation are being recorded.
[0205] For example, see Figure 14 , Figure 14 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 First, the drawing operation performed on the online whiteboard using the target drawing tool is recorded, and the target drawing operation is displayed in the interface 1401 of the online whiteboard, which is a straight line filled with a diagonal line.
[0206] In some embodiments, when the target operating tool is another operating tool, a recording identifier can be displayed in the associated area corresponding to the target operating tool. The associated area is the region where the distance to the target operating tool is less than a preset distance threshold. In this way, users can intuitively know that a recording operation is being performed.
[0207] For content drawing tools that are not the target operation tools, a color different from the target color can be used to identify the third drawing operation. The color different from the target color is used to indicate the third drawing operation and that the content drawn by the third drawing operation has not been recorded.
[0208] For drawing tools that are not the target operation tool, a line type different from the target line type can be used to identify the third drawing operation. A color different from the target color is used to indicate the third drawing operation and that the content drawn by the third drawing operation was not recorded. For example, see... Figure 14 In the interface 1401 that displays the online whiteboard, the third drawing operation is identified by a line type 1402 that is different from the target line type 1403. The line type 1402 that is different from the target line type 1403 is an unfilled diagonal line.
[0209] For other operation tools that are not the target operation tool, the recording indicator may not be displayed, or the corresponding operation tool and its corresponding content may be displayed. In this way, users can intuitively understand which operations will not be recorded.
[0210] The third setting method further improves the efficiency of recording operations performed on the online whiteboard by targeting specific user groups. It allows for recording only a portion of the online whiteboard content, avoiding recording unwanted content, increasing the selectivity of recording, enhancing online whiteboard security, and improving recording efficiency. This ultimately enhances the user experience.
[0211] For the fourth setup method, please refer to [link / reference]. Figure 15 , Figure 15 This is a flowchart illustrating the content recording method provided in this application embodiment, shown below. Figure 15 The steps shown are for Figure 3Step 102 shown will be explained, that is, the fourth setting method will be explained.
[0212] In step 1021, in response to a trigger operation on the recording control, a recording prompt message is displayed.
[0213] In some embodiments, in response to a triggering operation on the recording control, a recording prompt message can be displayed in the form of a pop-up window or a floating layer. The recording prompt message is used to prompt the user to confirm whether to record the operation performed in the online whiteboard.
[0214] In some embodiments, the recording prompt information includes recording prompt text, a first confirmation control, and a first rejection control. The recording prompt text indicates that the user object is being prompted to confirm whether to record the operation performed on the online whiteboard. The first confirmation control confirms the recording of the online whiteboard content, that is, the operation performed by the user object on the online whiteboard and the corresponding content. The first rejection control rejects the recording of the online whiteboard content, that is, it does not record the operation performed by the user object on the online whiteboard and the corresponding content.
[0215] For example, see Figure 16 , Figure 16 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 Second, accepting Figure 4 In response to a trigger operation on the recording control 402, a recording prompt message 1601 can be displayed. The recording prompt message 1601 includes a text prompt message, a first confirmation control 1602, and a first rejection control 1603. The text prompt message can be "Do you want to record the operation performed in the online whiteboard?", the first confirmation control 1602 is "Yes", and the first rejection control 1603 is "No".
[0216] In step 1022, in response to a confirmation command triggered based on the recording prompt information, the content recording function for the online whiteboard is enabled.
[0217] In some embodiments, in response to a confirmation command triggered based on a recording prompt message, the content recording function for the online whiteboard is enabled. When a first confirmation control is displayed, in response to a triggering operation on the first confirmation control, a confirmation command triggered based on the recording prompt message can be received, thereby enabling the content recording function for the online whiteboard. Then, step 103 can be executed, recording the operations performed by the user object that triggered the confirmation command for the recording prompt message on the online whiteboard based on the content recording function.
[0218] In some embodiments, in response to a rejection command triggered by a recording prompt, the user object triggering the rejection command for the recording prompt can choose not to enable the online whiteboard content recording function. In the case of displaying a first rejection control, in response to a triggering operation on the first rejection control, a rejection command triggered by a recording prompt can be received, and the user object triggering the rejection command for the recording prompt can choose not to enable the online whiteboard content recording function. That is, the operations performed by the user object triggering the rejection command for the recording prompt in the online whiteboard can be left unrecorded. This approach allows for confirmation of whether to record the online whiteboard content based on the user's actual needs, improving the security of the online whiteboard and increasing the efficiency of recording. This further enhances the user experience.
[0219] In some embodiments, there are multiple user objects corresponding to the online whiteboard, and the terminals of multiple user objects can display recording prompts. In order to further improve the security of recording online whiteboard content, the terminals of multiple user objects can display recording prompts. Each user object needs to trigger an instruction in response to the recording prompt. If each user object triggers a rejection instruction in response to the recording prompt, the recording function for online whiteboard content will not be enabled.
[0220] If one or more user objects trigger a confirmation command for the recording prompt, then the online whiteboard recording function will be enabled for the user object that triggered the confirmation command. In other words, the operation of the user object that triggered the confirmation command in the online whiteboard will be recorded.
[0221] In some embodiments, in response to a confirmation command triggered based on the recording prompt information, it can be determined whether any other user object among at least two user objects has triggered a confirmation command for the recording prompt information. If any other user object among at least two user objects has not triggered a confirmation command for the recording prompt information, a waiting prompt information is displayed. This waiting prompt information indicates that the system is waiting for another user object to trigger a confirmation command for the recording prompt information. The waiting prompt information may display waiting prompt text, the number of user objects corresponding to the online whiteboard, and the number of user objects that have triggered a confirmation command for the recording prompt information.
[0222] For example, see Figure 17 , Figure 17 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 Third, accepting Figure 16 In response to a trigger operation on the first confirmation control 1602, the following can be displayed: Figure 17The waiting prompt message 1701 shown can display the waiting prompt text, the number of user objects corresponding to the online whiteboard, and the number of user objects that have triggered the confirmation command for the recording prompt message. The waiting prompt text is "Waiting for confirmation from other user objects (20 / 50)", where the number of user objects corresponding to the online whiteboard is 50, and the number of user objects that have triggered the confirmation command for the recording prompt message is 20. In this way, users can know in real time whether other user objects have triggered the confirmation command for the recording prompt message, which can improve the user experience.
[0223] In some embodiments, in response to a confirmation instruction triggered based on a recording prompt message, it can be determined whether other user objects among at least two user objects have triggered a confirmation instruction or a rejection instruction for the recording prompt message. If other user objects among at least two user objects have not triggered a confirmation instruction or a rejection instruction for the recording prompt message, a waiting prompt message is displayed.
[0224] The waiting prompt message indicates that the system is waiting for other user objects to trigger instructions (including confirmation or rejection instructions). The waiting prompt message can display the waiting text, the number of user objects corresponding to the online whiteboard, and the number of user objects that have already triggered instructions. In this way, user objects corresponding to the online whiteboard can trigger a confirmation instruction for the recording prompt message, which is equivalent to agreeing to record the operation performed on the online whiteboard. They can also trigger a rejection instruction for the recording prompt message, which is equivalent to refusing to record the operation performed on the online whiteboard. Users can set whether to record operations performed on the online whiteboard according to their actual needs, which can improve the user experience.
[0225] In some embodiments, in response to the confirmation instruction for the recording prompt message being triggered by other user objects among at least two user objects, that is, the user objects of the online whiteboard all agree to record the operations performed in the online whiteboard, the operations performed in the online whiteboard can be recorded based on the content recording function.
[0226] In some embodiments, in response to the presence of a user object triggering a confirmation instruction for the recording prompt, that is, if there is a user object among the user objects in the online whiteboard who agrees to record the operations performed in the online whiteboard, the operations performed in the online whiteboard can be recorded based on the content recording function.
[0227] To allow users to intuitively distinguish between recording and non-recording operations, a third display style can be used to show the content corresponding to operations requiring recording, and a fourth display style can be used to show the content corresponding to operations not requiring recording. The third and fourth display styles are different. For details, please refer to the content corresponding to the second setting method, which will not be elaborated here.
[0228] The fourth setting allows users to configure whether to record content on the online whiteboard based on their actual needs. This increases the selectivity of content recording, improves the security of the online whiteboard, and enhances the efficiency of recording, thereby further improving the user experience.
[0229] The fifth setting method is... Figure 3 Before step 102, a region setting control can be set in the area corresponding to the content recording function. This region setting control can be displayed on the online whiteboard interface, on the online whiteboard's corresponding settings interface, or in response to a third display instruction for the tool setting control, thereby displaying the region setting control on the online whiteboard interface. The third display instruction is an instruction used to display the region setting control. The third display instruction is different from both the first and second display instructions.
[0230] In some embodiments, in response to a trigger operation on the region setting control, a pre-divided region can be displayed on the interface displaying the online whiteboard. The pre-divided region can be multiple regions that divide the online whiteboard according to a preset division method, or it can be the region corresponding to the content of the online whiteboard recorded last time, or it can be the intersection or union of regions with a recording frequency greater than a preset frequency threshold. The specific settings can be made according to actual usage requirements.
[0231] For example, see Figure 18 , Figure 18 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 Fourth, accepting Figure 4 In response to a trigger operation on the area setting control 405, pre-defined areas can be displayed in the interface 401 that displays the online whiteboard. The pre-defined areas include area 1801, area 1802, area 1803, and area 1804.
[0232] For example, see Figure 19 , Figure 19 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 Fifth, undertaking Figure 4In response to a trigger operation on the area setting control 405, a pre-defined area can be displayed in the interface 401 that displays the online whiteboard. The pre-defined area includes area 1901, which is the area corresponding to the content of the previously recorded online whiteboard.
[0233] The number of pre-divided regions can be one or more. When there is only one pre-divided region, a region prompt message can be displayed in the form of a pop-up window or a floating layer, either when the display time of the pre-divided region reaches the preset time or in response to a click operation on the pre-divided region. The region prompt message is used to prompt the user whether to use the pre-divided region as the target region.
[0234] In some embodiments, the region prompt information includes region prompt text, a second confirmation control, and a second rejection control. The region prompt text indicates that the user is being prompted to confirm whether a pre-defined region is being used as the target region. The second confirmation control confirms that the pre-defined region is being used as the target region. The second rejection control rejects the use of the pre-defined region as the target region.
[0235] For example, to undertake Figure 19 If the duration of display area 1901 reaches the preset duration, see [link / reference]. Figure 20 , Figure 20 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 6. Display area prompt information 2001. Area prompt information 2001 includes area prompt information, second confirmation control 2002 and second rejection control 2003. The area prompt information can be "whether to use area 1901 as the target area", the first confirmation control 1602 is "yes" and the first rejection control 1603 is "no".
[0236] Responding to a trigger operation on the second confirmation control is equivalent to responding to a confirmation instruction for the area prompt information. A pre-defined area can be used as the target area, thus allowing the reception of the target area of the online whiteboard based on the area setting control. Responding to a trigger operation on the second rejection control is equivalent to responding to a rejection instruction for the area prompt information, allowing the pre-defined area not to be used as the target area.
[0237] When there are multiple pre-divided regions, in response to a selection operation targeting at least one (or more) of the pre-divided regions, the selected region can be used as the target region. For example, see [link to relevant documentation]. Figure 18 In response to a selection operation targeting region 1801, region 1801 can be selected as the target region. For example, see [link to example]. Figure 18In response to the selection operation for region 1801 and region 1802, both region 1801 and region 1802 can be used as target regions.
[0238] In some embodiments, adjustments can be made to a pre-defined area. In response to an adjustment command for the pre-defined area, the adjusted area can be used as the target area, thereby receiving the target area of the online whiteboard set based on the area setting control. In some embodiments, adjustment controls for the pre-defined area can be displayed. In response to an adjustment command triggered by the adjustment controls, the adjusted area can be used as the target area, thereby receiving the target area of the online whiteboard set based on the area setting control.
[0239] In some embodiments, in response to a trigger operation on the area setting control, the online whiteboard can be made available and an area drawing control can be displayed. The area drawing control can be a line drawing control or a drawing control for drawing pre-defined graphics. The specific settings can be configured according to actual usage requirements.
[0240] In response to a second drawing operation on the online whiteboard using the region drawing control, the region defined by the second drawing operation can be used as the target region, thus enabling the reception of the target region of the online whiteboard set based on the region setting control.
[0241] In some embodiments, the second drawing operation draws a closed shape, so the area corresponding to the closed shape can be used as the target area. In some embodiments, the second drawing operation draws an open shape, then the target area can be the open shape and the area extending infinitely along the open edge; that is, the size of the target area can be finite or infinite.
[0242] After the target area is determined, the operation performed in the target area of the online whiteboard is recorded based on the content recording function. In some embodiments, in order to make it easier for users to intuitively know the operation that is being recorded and the operation that is not being recorded, the target area can be displayed in a first color, and the area of the online whiteboard other than the target area (i.e., other areas) can be displayed in a second color. The first color and the second color are different.
[0243] Operations performed within the target area are those that need to be recorded, while operations performed outside the target area are those that do not need to be recorded. The third display style can be used to display the content corresponding to operations that need to be recorded; that is, the content within the target area is displayed using the third display style, and the content corresponding to operations that do not need to be recorded is displayed using the fourth display style. All areas of the online whiteboard other than the target area (i.e., other areas) are displayed using the fourth display style. The third and fourth display styles are different. For details, please refer to the content corresponding to the second setting method; it will not be elaborated upon here.
[0244] During the process of a user object drawing in the target area, the content may be drawn in other areas. In order to improve the accuracy of the recorded content, based on the content recording function, in response to the first drawing operation performed in the online whiteboard, the content corresponding to the first drawing operation is displayed.
[0245] For example, see Figure 21 , Figure 21 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 7. In response to the first drawing operation performed in the online whiteboard, the content 2103 corresponding to the first drawing operation can be displayed, wherein the content 2103 corresponding to the first drawing operation is displayed in the target area 2101 and other areas 2102.
[0246] If the display ratio of the content corresponding to the first drawing operation is greater than a preset ratio threshold, it is determined that the first drawing operation is performed in the target area, and the first drawing operation is recorded. The preset ratio threshold can be set according to actual usage needs; for example, the preset ratio threshold can be 3 / 4.
[0247] For example, see Figure 21 In response to the display ratio of the content 2103 corresponding to the first drawing operation being greater than a preset ratio threshold, it is determined that the first drawing operation is an operation performed in the target area 2101, and the first drawing operation and the content 2103 corresponding to the first drawing operation are recorded. Here, the display ratio is the proportion of the area of the content 2103 corresponding to the drawing operation in the target area 2101. This method avoids inaccurate content recording due to drawing errors and improves the accuracy of the recorded content.
[0248] The fifth setting allows users to configure the target area for recording content on the online whiteboard according to their actual needs. This increases the selectivity of content recording, improves the security of the online whiteboard, and enhances the efficiency of recording, thereby further improving the user experience.
[0249] In some embodiments, this application can record the content of an online document using one or more of the first to fifth setting methods described above. For example, before performing step 102, settings can be made using one or more of an object setting control, a tool setting control, and a region setting control. This allows the recording function for the online whiteboard content to be enabled at any time while using the online whiteboard, in response to a trigger operation on the recording control, and at least one of the following steps to be performed:
[0250] Record actions performed by the target user on the online whiteboard. Record actions performed using the target tool on the online whiteboard. Record actions performed by the user who triggers a confirmation command for the recording prompt on the online whiteboard. Record actions performed in the target area of the online whiteboard. Specific settings can be customized according to actual usage needs. This approach improves the security of the online whiteboard and the efficiency of recording, thereby further enhancing the user experience.
[0251] In some embodiments, based on the content recording function, in response to an operation performed in the online whiteboard, the content corresponding to the operation can be displayed. In some embodiments, based on the content recording function, operations performed by other user objects among at least two user objects in the online whiteboard, and the content corresponding to the operations, can be displayed.
[0252] When the operation is a content drawing operation, the content corresponding to the content drawing operation can be displayed. When the operation is a content clearing operation, the corresponding content that has been cleared can be displayed. When the operation is a text insertion operation, the inserted text or a text box displaying the text to be inserted can be displayed.
[0253] When the operation is an image insertion operation, the inserted image can be displayed. When the operation is a graphic addition operation, the added graphic can be displayed. When the operation is a zoom operation, the zoomed-in online whiteboard can be displayed; for example, when zooming in on the online whiteboard, the content of the online whiteboard can be enlarged for display.
[0254] When the operation is an element editing operation, the edited element can be displayed. When the operation is a comment operation, the comment content can be displayed, and the comment content can be any one of at least two user objects. When the operation is a save operation, a save prompt message can be displayed to the user indicating the save result, with the message being either "Saving" or "Save successful".
[0255] When the operation is a lock operation, a lock icon and lock prompt message can be displayed. When the operation is an unlock operation, an unlock prompt message can be displayed. When the operation is an undo operation, the element corresponding to the undo operation can be hidden.
[0256] When the operation is a restore operation, the element corresponding to the restore operation can be redisplayed. When the operation is a vote operation, animated elements used for voting can be displayed on the online whiteboard. When the operation is a timer operation, time information or timer image elements can be displayed.
[0257] This application can record the operations performed on the online whiteboard and the corresponding content. This method allows for the recording of operations and their corresponding content, enabling the generation of files later and improving the efficiency of recording.
[0258] In some embodiments, during the recording of operations performed on the online whiteboard, in response to a pause command for the content recording function, the operation area corresponding to the operation is displayed using a first display style. The first display style is used to indicate that the operation area is in an inoperable state. The first display style differs from the third and fourth display styles; however, equivalent substitutions can be made for the descriptions of the third and fourth display styles, which will not be elaborated upon here.
[0259] In some embodiments, the operation area corresponding to the operation can be a target area, and the first display style can be to display the target area using a third color. The third color is different from both the first and second colors. In some embodiments, the operation area corresponding to the operation is the display area of the content corresponding to the recorded operation.
[0260] The first display style can also display a lock icon and lock prompt information, for example, see Figure 22 , Figure 22 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 8. In response to the pause command for the content recording function, the operation area corresponding to the operation is displayed in the interface 2201 of the online whiteboard using a first display style. The first display style is a lock icon and a lock prompt message. The lock icon includes lock icon 2205 and lock icon 2203, and the lock prompt message is "locked".
[0261] The operation area corresponding to the operation is the display area of the content corresponding to the operation. This display area can be the display area of graphic 2202 corresponding to the drawing operation, or the display area of graphic 2204 corresponding to the drawing operation. In other words, graphic 2202 and graphic 2204 cannot be operated on. In this way, recording can be paused according to the user's actual needs, and during the pause, the operation area corresponding to the operation is in an inoperable state, thus ensuring the accuracy of the recorded content.
[0262] In some embodiments, in order to ensure the uniqueness of the operation and thus the accuracy of the recorded content, in some embodiments, in response to the first operation performed in the online whiteboard, if the first operation is not performed in the online whiteboard within a first time interval from the current time point, it indicates that the first operation is not a repeated operation, that is, the instruction to perform the first operation has not been repeatedly responded to. Therefore, the content corresponding to the first operation can be displayed in the online whiteboard.
[0263] If the first operation has already been executed on the online whiteboard within a first time interval from the current point in time, it indicates that the first operation is a repeated operation. To avoid repeated responses to the instruction to execute the first operation, the content of the online whiteboard can remain unchanged, and the first reason information for not executing the first operation can be displayed. The first operation already executed on the online whiteboard can be an operation performed by the user object corresponding to the terminal, or it can be an operation performed by other user objects among multiple user objects.
[0264] The first operation can be any of the visualization operations mentioned above; please refer to the descriptions of the visualization operations for details, which will not be repeated here. The first duration can be set according to actual usage needs. The first reason information is used to indicate the reason why the first operation was not executed. The first reason information can also include the execution result; for example, the first reason information can be "Operation duplicated, execution failed".
[0265] In some embodiments, to ensure the accuracy of the operation and thus the accuracy of the recorded content, in some implementations, in response to the second operation performed on the online whiteboard, if there is no third operation that conflicts with the second operation within a second time interval from the current time point, that is, if no third operation that conflicts with the second operation is performed on the online whiteboard within a second time interval from the current time point, it indicates that the second operation is not an erroneous operation, nor is it an operation that rewrites the content corresponding to the third operation. Therefore, the content corresponding to the second operation can be displayed on the online whiteboard.
[0266] In this application, operation conflict refers to various situations such as multiple operations not being able to be executed together, multiple operations not being able to be executed in the same order, and one operation not being able to be executed while another operation is being executed. The specific settings can be configured according to actual usage requirements.
[0267] If a third operation conflicting with the second operation already exists within the second time interval from the current time point, that is, a third operation conflicting with the second operation has already been executed in the online whiteboard within the second time interval from the current time point, it indicates that the second operation may be an incorrect operation or an operation that rewrites the content corresponding to the third operation. Therefore, the content of the online whiteboard can remain unchanged, and the second reason information for not executing the second operation can be displayed.
[0268] The second and third operations can be any of the visualization operations described above; please refer to the description of the visualization operations for details, which will not be repeated here. The second duration can be set according to actual usage needs; the first duration can be the same as the second duration, or the second duration can be longer than the first duration. The second reason information is used to indicate the reason why the second operation was not executed. The second reason information can also include the execution result; for example, the second reason information can be "Operation error or conflict with already executed operation, execution failed".
[0269] By displaying first and second reason information, users can be guided to perform more accurate operations on the online whiteboard, thereby improving the accuracy of content recording and enhancing the user experience.
[0270] In step 104, in response to the command to close the content recording function, a file is generated that records the operation and the corresponding content.
[0271] In some embodiments, step 104 can be implemented by, in response to a command to close the content recording function, converting each operation of the recorded online whiteboard content (i.e., each operation performed and the content corresponding to the operation) into an operation identifier and operation parameters, and generating a file that records the operation and the content corresponding to the operation based on the operation identifier and operation parameters.
[0272] In some embodiments, operations can be identified using an operation identifier (i.e., an operation code). The operation identifier is an identifier that identifies the operation performed by the user object in the online whiteboard. The operation identifier can be a pre-set code or name. For example, if the operation performed by the user object in the online whiteboard is a content drawing operation, the operation code for the content drawing operation can be "DRAW".
[0273] When a user performs an operation on the online whiteboard, the operation identifier has associated operation parameters. These parameters are the specific data for the operation, and can be numerical values, color codes, position coordinates, dimensions, etc. For example, the operation code for content drawing can be "DRAW". The parameters for the "DRAW" operation code can include start coordinates, end coordinates, the thickness of the content drawing tool, color code, etc. Here, the operation identifier and operation parameters are associated with the content corresponding to the operation.
[0274] When two or more user objects use the online whiteboard, the operation identifier, operation parameters, and user information can be stored accordingly. The operation identifier has a corresponding time, which can be the start time of the operation corresponding to the operation code.
[0275] In some embodiments, the operation identifiers and parameters of each operation are arranged in chronological order from earliest to latest (though it can also be set from latest to earliest depending on actual usage needs), which can generate a file containing the operations and their corresponding content. That is, in the file recording the operations and their corresponding content, each operation can be arranged in chronological order from earliest to latest. Operations can also be divided according to user objects; for any given user object, multiple operations corresponding to that user object are arranged in chronological order from earliest to latest. The specific arrangement can be customized according to actual usage needs.
[0276] This application includes a recording control for an online whiteboard. In response to a trigger operation on the recording control, the content of the online whiteboard can be recorded. Compared to using an image acquisition device to capture the content of the online whiteboard, there is no need to set the acquisition angle, simplifying the content recording process and improving recording efficiency. Furthermore, the online whiteboard content recording function can generate a file recording the operations performed on the online whiteboard and their corresponding content. Compared to using an image acquisition device, this avoids recording content other than the online whiteboard, further improving recording efficiency and solving the aforementioned technical problem 1.
[0277] The file recording operations and their corresponding content is not a video file, but only stores the operation identifiers and operation parameters arranged in chronological order. Compared to video files, the file with operations and their corresponding content generated by this application occupies less memory. When transmitting the file with operations and their corresponding content, less network resources are consumed, saving memory space and reducing network resource consumption, thereby improving the user experience.
[0278] In some embodiments, Figure 3Following step 104, in response to a file sharing instruction, the file containing the recorded operations and their corresponding content is shared with other user objects among at least two user objects. That is, the file containing the recorded operations and their corresponding content can be shared with the user object corresponding to the online whiteboard. In this way, the user object can access the file containing the recorded operations and their corresponding content so that the user object can review the corresponding content on the online whiteboard.
[0279] In some embodiments, a file recording the operation and its corresponding content can also be shared with users who do not use the online whiteboard. This can be configured according to actual usage needs. In this way, users who do not use the online whiteboard can easily learn about the content of the online whiteboard, thereby reducing the information gap between different users and improving the user experience.
[0280] In some embodiments, Figure 3 Following step 104, to further simplify the file containing the operations and their corresponding content—that is, to further simplify the recorded content of the online whiteboard—see [link to relevant documentation]. Figure 23 , Figure 23 This is a flowchart illustrating the content recording method provided in the embodiments of this application. Figure 3 The following is combined with Figure 23 The steps are shown below for explanation.
[0281] In step 2301, in response to a modification command for the file, an editing interface for the file is displayed.
[0282] Regarding step 2301, in some embodiments, after the file is generated, a modification control for the file can be displayed. In response to the triggering operation of the modification control, a modification instruction for the file can be obtained, thereby displaying an editing interface for the file in response to the modification instruction for the file.
[0283] The editing interface displays multiple operation icons arranged in chronological order. Each operation icon corresponds one-to-one with the operation performed in the online whiteboard. For example, see... Figure 24 , Figure 24 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 10 9. The editing interface 2405 displays multiple operation identifiers arranged in chronological order, specifically operation identifier 2401, operation identifier 2402, operation identifier 2403 and operation identifier 2404. Each operation identifier corresponds to an operation performed in the online whiteboard.
[0284] Among them, the time of operation identifier 2401 is earlier than the time of operation identifier 2402, the time of operation identifier 2402 is earlier than the time of operation identifier 2403, and the time of operation identifier 2403 is earlier than the time of operation identifier 2404.
[0285] In some embodiments, in response to a selection operation on an operation identifier in the editing interface, the operation identifier can be controlled to be in a selected state, and the content corresponding to the operation identifier before the time corresponding to the selected operation identifier can be displayed, as well as the content corresponding to the selected operation identifier.
[0286] exist Figure 24 In response to the selection operation on operation identifier 2401, operation identifier 2401 is in the selected state, therefore Figure 24 The content 2406 corresponding to operation identifier 2401 is displayed, that is, the content 2406 corresponding to the operation indicated by operation identifier 2401. In this way, multiple operation identifiers ordered in chronological order can be displayed.
[0287] For example, see Figure 25 , Figure 25 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 20 In response to the selection operation for operation identifier 2402, the operation corresponding to operation identifier 2402 is to zoom in on the content 2406 corresponding to operation identifier 2401. Since the time of operation identifier 2401 is earlier than the time of operation identifier 2402, the zoomed-in content 2406 corresponding to operation identifier 2401 can be displayed in the editing interface 2405. Combined with... Figures 24-25 As can be seen, users can view the content corresponding to different operation icons according to their actual usage needs, thereby improving the user experience.
[0288] In step 2302, in response to a deletion instruction for a first operation identifier among a plurality of operation identifiers, the first operation identifier is deleted.
[0289] In some embodiments, in response to a deletion instruction for a first operation identifier among a plurality of operation identifiers, the first operation identifier can be deleted. To further improve the user experience, the deleted first operation identifier and the content corresponding to the first operation identifier can be undisplayed in the editing interface.
[0290] For example, to undertake Figure 25 In response to a delete command for operation identifier 2402 (i.e., the first operation identifier), operation identifier 2402 can be deleted. See [link to documentation]. Figure 26 , Figure 26 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 20First, in the editing interface 2405, the display of operation indicator 2402 can be disabled, and the zoomed-in display of the content 2406 corresponding to operation indicator 2401 can be disabled. This way, the deletion operation indicator can be removed, thereby improving the user experience.
[0291] In step 2303, in response to the file generation instruction, a file is generated that records the operation with the second operation identifier and the content corresponding to the operation with the second operation identifier.
[0292] In some embodiments, after the user deletes the operation identifier according to actual usage needs, a file is generated in response to a file generation instruction, recording the operation with the second operation identifier and the corresponding content of the operation with the second operation identifier. The second operation identifier is an operation identifier other than the first operation identifier among a plurality of operation identifiers. In this way, the file can be simplified according to the user's actual usage needs, further reducing the memory occupied by the file and further reducing network resource consumption during file transmission, thereby improving the user experience.
[0293] In some embodiments, the editing interface may also display an acceleration control. In response to an acceleration command triggered by the acceleration control, the corresponding content can be set to be displayed at an accelerated speed. In this way, the file length can be reduced so that viewing time can be saved during subsequent playback.
[0294] In some embodiments, the editing interface can also include interactive prompts for a specific operation identifier. These prompts encourage interaction with the content corresponding to the operation identifier. For example, in an online education scenario, the content corresponding to the operation identifier could be a formula, and the interactive prompt could be something like, "Think about whether there's an easier way?" This guides students' thinking and improves the user experience. Of course, the editing interface can be customized according to actual usage needs.
[0295] In some embodiments, online whiteboards can be used in conjunction with online documents. The following provides a detailed explanation of how online whiteboards can be used in conjunction with online documents. (See also...) Figure 27 , Figure 27 This is a flowchart illustrating the content recording method provided in the embodiments of this application. Figure 4 The following is combined with Figure 27 The steps shown are for Figure 3 Step 101 shown will be explained.
[0296] In step 1011, the interface for the online document is displayed.
[0297] The online document interface includes a launch control for the online whiteboard and the content of the online document. The online document can be a text-based document, such as a Word document or a TXT document, or a presentation document, such as a PowerPoint presentation or a portable document format (PDF). The specific settings can be configured according to actual usage requirements.
[0298] In step 1012, in response to a trigger operation on the launch control, the interface of the online whiteboard is displayed.
[0299] In some embodiments, in response to a triggering operation on the launch control, the interface of the online whiteboard can be displayed, and the interfaces of the online whiteboard and the online document can be displayed side by side or side-by-side. The area of the online whiteboard interface can be larger than, smaller than, or equal to the area of the online document interface; all of these are reasonable.
[0300] For example, see Figure 28 , Figure 28 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 20 Second, online documents can be online tables, which include numerical values. Figure 28 Only the value 2803 is shown.
[0301] exist Figure 28 In this system, the online whiteboard interface 2802 and the online document interface 2801 can be displayed side by side, with the online document interface 2801 having a larger area than the online whiteboard interface 2802. Users can intuitively understand the content of the online document, and in response to operations performed on the online whiteboard interface 2802, corresponding content can be displayed on the online whiteboard interface 2802. The content displayed on the online whiteboard interface 2802 can be associated with the content of the online document, thereby assisting users in using the online document and improving the user experience.
[0302] In some embodiments, in response to a triggering operation on the launch control, the interface of the online whiteboard can be displayed, and the interface of the online whiteboard and the interface of the online document can be displayed overlapping. In order to highlight the online document, the transparency of the online whiteboard can be greater than that of the online document.
[0303] For example, see Figure 29 , Figure 29 This is a schematic diagram of the interface of the online whiteboard provided in the embodiments of this application. Figure 20Third, the online document is a text document. The online whiteboard interface 2902 and the online document interface 2901 can overlap. The area of the online whiteboard interface 2902 is smaller than the area of the online document interface 2901, and the transparency of the online whiteboard interface 2902 is greater than that of the online document interface 2901. Therefore, the content corresponding to the online document interface 2901, i.e., "text," can be displayed in the overlapping area of the online whiteboard interface 2902 and the online document interface 2901. Figure 29 Online whiteboards can help users annotate content in online documents, thereby improving the user experience.
[0304] against Figure 3 In step 102 shown, when both the online document and the online whiteboard are displayed simultaneously, in response to a trigger operation on the recording control, recording confirmation information for the content of the online document is displayed, wherein the recording confirmation information is used to prompt the user to confirm whether to record the content in the online document.
[0305] In some embodiments, the recording confirmation information may include recording confirmation text, a third confirmation control, and a third rejection control. The recording confirmation text prompts the user to confirm whether to record the content in the online document. The third confirmation control confirms recording of the content in the online document, meaning that the user's actions on the online whiteboard, the corresponding content of those actions, and the content in the online document are all recorded simultaneously. The third rejection control rejects recording of the content in the online document, meaning that only the user's actions on the online whiteboard and the corresponding content of those actions are recorded.
[0306] In some embodiments, in response to a recording rejection command triggered by a recording confirmation message, the recording function for the content of the online whiteboard is enabled. For details, please refer to [the documentation / reference needed]. Figure 3 The explanation of step 102 is shown below. This method improves the efficiency of recording content for the online whiteboard, thereby enhancing the user experience.
[0307] In some embodiments, in response to a recording confirmation command triggered by a recording confirmation message, recording functionality for the content of the online whiteboard and the online document is enabled. Based on this content recording function, operations performed on the online whiteboard and operations performed on the online document are recorded. In response to a command to disable the content recording function, a file is generated that records the operations performed on the online whiteboard, the corresponding content of those operations, the operations performed on the online document, and the content displayed by those operations. This approach allows for simultaneous recording of both online document and online whiteboard content when online documents and online whiteboards are combined, thereby improving the user experience.
[0308] In some embodiments, during the recording of operations performed in an online document, the content corresponding to the first to fifth setting methods described above can also be used to record the operations performed in the online document. Specifically, the first to fifth setting methods can be replaced with equivalent ones, which will not be elaborated here.
[0309] The target users for the online whiteboard and the online document can be the same or different. Similarly, the target area for the online whiteboard and the target area for the online document can be the same or different. These settings can be customized according to actual usage needs. This approach allows for customized recording of both the online whiteboard and the online document, thereby improving the user experience.
[0310] The content playback method provided in the embodiments of this application will be described below. As mentioned above, the electronic device that implements the content playback method provided in the embodiments of this application can be a terminal, a server, or a combination of the two.
[0311] See Figure 30 , Figure 30 This is a flowchart illustrating the content playback method provided in the embodiments of this application. The following is a summary of the process. Figure 30 The steps are shown, and the content playback method provided in this application embodiment is described using a terminal as an example.
[0312] In step 3001, the interface of the online whiteboard is displayed.
[0313] In practical applications, the terminal can be equipped with an application that supports online whiteboards. This application stores files generated from recordings of the online whiteboard content. When a user needs to play the file generated from the recordings of the online whiteboard content, in response to a trigger operation on the application that supports online whiteboards, the online whiteboard interface can be accessed, and the file generated from the recordings of the online whiteboard content can be displayed on the interface.
[0314] In some embodiments, the file generated by recording the content of the online whiteboard can be shared with other user objects. The file generated by recording the content of the online whiteboard can be displayed in the session interface. In response to the triggering operation of recording the file generated by the online whiteboard, the user can jump to an application that supports online whiteboards, display the online whiteboard interface, and display the file generated by recording the content of the online whiteboard in the interface.
[0315] In step 3002, in response to a trigger operation on a file, a content playback page is displayed, and the operation performed in the online whiteboard and the corresponding content are played on the content playback page.
[0316] In some embodiments, step 3002 can be implemented by displaying a content playback page in response to a trigger operation on a file, and then playing the operation performed in the online whiteboard and the corresponding content on the content playback page.
[0317] In some embodiments, the file provided in this application does not reproduce the operation in one online whiteboard in another online whiteboard, but converts the content in the online whiteboard into operation identifiers and operation parameters, thereby generating a file including operation identifiers and operation parameters, that is, generating a file that records the operation and the corresponding content.
[0318] During playback, by loading operation identifiers and their corresponding parameters, the operations performed on the online whiteboard and their corresponding content can be played back. The file can be played in response to user actions triggered at any time, meaning users can repeatedly view the file, and thus repeatedly view the operations performed on the online whiteboard and their corresponding content.
[0319] The following explanation uses an online education scenario as an example. The file contains the content corresponding to a 45-minute class lesson. When students are doing homework or need to review, in response to a trigger operation on the file, a content playback page can be displayed. This page can then play the operations performed on the online whiteboard and their corresponding content. Students can watch the complete 45-minute class lesson content according to their actual needs, or they can watch only a specific segment of the content. This approach improves the user experience for both students and teachers, thereby enhancing the quality of online education.
[0320] For example, in response to a file-based triggering operation, see [link to relevant documentation]. Figure 31 , Figure 31 This is a schematic diagram of the content playback page provided in the embodiments of this application. Figure 1The content playback page 3101 is displayed, which shows operations 3102, 3103, 3104, 3105, 3106, 3107, 3108, and 3109. Figure 31 This is for illustrative purposes only. The number of operations can be set according to actual usage needs. Different operations can have different content and different display states corresponding to the content.
[0321] On the content playback page 3101, the drawing operation performed in the online whiteboard (i.e., operation 3102) can be played, and the content 3110 corresponding to the drawing operation (i.e., operation 3102) can be displayed. Figure 31 The dynamic execution process of drawing operations is not shown in the figure. Figure 31 This is only the content playback page 3101 corresponding to time point 1.
[0322] See Figure 32 , Figure 32 This is a schematic diagram of the content playback page provided in the embodiments of this application, which is the second one. Figure 31 , Figure 32 For time point 2, the content playback page 3101 can play the drawing operation (i.e., operation 3102) performed in the online whiteboard, and display the content 3110 and the content 3111 corresponding to the drawing operation (i.e., operation 3102).
[0323] Combination Figures 31-32 As can be seen, as time changes, the content corresponding to the content drawing operations can be displayed sequentially according to the order of the content drawing operations. For users, during playback, the recorded content of the online whiteboard can be reproduced in chronological order. That is, the content playback method provided in this application embodiment is a content reproduction method.
[0324] In some embodiments, there are multiple operations, each with an associated display time, and the multiple operations include a fourth operation. On the content playback page, in response to the time elapsed for the display time of the fourth operation, the fourth operation performed in the online whiteboard, along with the corresponding content, is played. For example, see... Figure 31 The fourth operation can be operation 3102. In response to the time of operation 3102 (i.e., the fourth operation), the display time can be displayed, and the fourth operation performed in the online whiteboard can be played, as well as displayed sequentially. Figure 31 The operation 3102 shown corresponds to the content 3110 and Figure 32The content 3111 corresponding to operation 3102 shown can be used to reproduce the fourth operation, so that the user can know the content of the fourth operation and improve the user experience.
[0325] In some embodiments, during the playback of the fourth operation, the content corresponding to the fourth operation is displayed using a second display style. The second display style may be the same as or different from the first display style, the second display style and the third display style. For details, please refer to the description of the third display style, which will not be repeated here.
[0326] For example, see Figure 32 During the playback of operation 3102 (i.e., the fourth operation), operation 3102 can be displayed in bold, and the content 3110 and 3111 corresponding to operation 3102 can be displayed as dashed lines, without the option to bold these dashed lines. In this way, users can clearly see the currently playing operation and its corresponding content, thereby improving the user experience.
[0327] In some embodiments, the plurality of operations further includes a fifth operation, the display time of which is after the display time of the first operation and adjacent to the display time of the first operation. In response to the time reaching the display time of the fifth operation, the display of the content corresponding to the fourth operation using the second display style is cancelled, and the fifth operation performed in the online whiteboard, along with its corresponding content, is played, displaying the content corresponding to the fifth operation using the second display style.
[0328] For example, see Figure 33 , Figure 33 This is a schematic diagram of the content playback page provided in the embodiments of this application. Figure 3 , undertake Figure 32 The display time of operation 3103 is after the display time of operation 3102, and the display time of operation 3103 is adjacent to the display time of operation 3102.
[0329] In response to the display time reaching the fifth operation (i.e., operation 3103), the dotted line is removed and the dotted line is made bolder. The content 3110 and content 3111 corresponding to operation 3102 are displayed, and the fifth operation (i.e., operation 3103) performed in the online whiteboard can be played back. Figure 33 The operation 3103 and its corresponding content 3112 are displayed in bold in the middle, and the content 3112 corresponding to the operation 3103 is displayed in bold in the dashed line.
[0330] The fourth and fifth operations can be found in the explanation of the visual operations, which will not be repeated here. In this way, users can know the operation being reproduced and the content corresponding to the operation being reproduced, thereby improving the user experience.
[0331] In some embodiments, the file contains multiple user objects performing operations on the online whiteboard and the corresponding content of the operations, and the content playback page displays a switching control for switching user objects on the online whiteboard.
[0332] In some embodiments, a user object can correspond to a switching control. The user object with a switching control is the user object whose operation is recorded in the online whiteboard. That is, the user object with a switching control can be the target user object, the user object with a switching control can be the user object that performs an operation in the online document using the target operation tool, the user object with a switching control can be the user object that performs an operation in the target area, or the user object that triggers the confirmation instruction for the recording prompt information.
[0333] For example, see Figure 34 , Figure 34 This is a schematic diagram of the content playback page provided in the embodiments of this application. Figure 4 The file contains four user objects performing operations on the online whiteboard and the corresponding content of those operations. Therefore, four switching controls can be displayed. These switching controls can include switching control 3401, switching control 3402, switching control 3403, and switching control 3404, each corresponding to a different user object.
[0334] On the content playback page, the sixth action performed by the first user object on the online whiteboard, along with the corresponding content, is played. For example, see... Figure 34 On the content playback page, the sixth operation performed by the first user object (i.e., the user object corresponding to the switching control 3401) in the online whiteboard, as well as the content 3405 corresponding to the sixth operation, can be played.
[0335] To help users easily understand the operation corresponding to the currently displayed user object and the corresponding content, a sixth display style can be used to display the content corresponding to the sixth operation. For example, see... Figure 34 The switching control 3401 can be displayed in bold, and the content 3405 corresponding to the sixth operation can be displayed in bold using a dashed line. In this way, users can know the operation that is currently being reproduced and the content corresponding to the operation, thereby improving the user experience.
[0336] To further enhance the user experience, users can select the user object for content playback based on their actual needs. In response to the switching command triggered by the switching control, the content playback page will play the seventh operation performed by the second user object corresponding to the switching command in the online whiteboard, as well as the content corresponding to the seventh operation.
[0337] For example, to undertake Figure 34 When a user wants to play the operation performed by the user object corresponding to the switching control 3402 on the online whiteboard, in response to the trigger operation on the switching control 3402, see [link to relevant documentation]. Figure 35 , Figure 35 This is a schematic diagram of the content playback page provided in the embodiments of this application. Figure 5 The content 3405 corresponding to the sixth operation can be canceled from being displayed. Instead, the seventh operation performed by the second user object (the user object corresponding to the switching control 3402) in the online whiteboard, and the content corresponding to the seventh operation can be played on the content playback page. The switching control 3402 can be displayed in bold, and the content 3406 corresponding to the seventh operation can be displayed in the form of a dashed line with bolding. The content 3406 corresponding to the seventh operation is a formula.
[0338] By switching user objects, different user objects can be displayed along with their corresponding operations and content. This provides users with different ways to view content during playback, and allows them to see the currently being reproduced operation and its corresponding content, thereby improving the user experience.
[0339] In some embodiments, multiple user objects correspond to a toggle control. In response to a trigger operation on the toggle control, a list of user objects can be displayed. Specifically, this can be done using a method similar to... Figure 5 The system displays user objects in a chronological format. Responding to selection commands for one or more user objects from a list, it can play the actions of one or more user objects, along with their corresponding content, in chronological order. This allows for the display of actions and their corresponding content for different user objects, providing users with different ways to view the content during playback. Furthermore, users can see the currently executing action and its corresponding content, thus improving the user experience.
[0340] In some embodiments, the content playback page includes a pause control. In response to a triggering operation on the pause control, the content playback page pauses the reproduction (i.e., playback) of the operation performed on the online whiteboard, as well as the content corresponding to the operation.
[0341] When pausing the playback of an action performed on the online whiteboard, the content playback page can be zoomed in or out. In response to zooming out, the zoomed-out content playback page is displayed, showing the content corresponding to other actions that have been performed. This allows users to observe all the performed content based on the current playback progress, providing a more intuitive understanding of the actions already performed.
[0342] In response to zooming in on the content playback page, the zoomed-in content playback page can be displayed, showing the content corresponding to the zoomed-in operation. In this way, users can view the details of the content corresponding to the operation, thereby improving the user experience.
[0343] In some embodiments, during playback and the corresponding content manipulation, the user viewing the playback cannot edit the file. In response to editing instructions on the content playback page, an editing prompt is displayed, indicating that editing of the content playback page has failed. This approach ensures file integrity, thereby improving the user experience.
[0344] To facilitate understanding of the content recording and playback methods provided in the embodiments of this application, the following examples illustrate the content recording and playback methods provided in the embodiments of this application. (See also...) Figure 36 , Figure 36 This is a flowchart illustrating the content recording method and content playback method provided in the embodiments of this application.
[0345] In step 3601, the interface of the online whiteboard is displayed.
[0346] For step 3601, the interface may include recording controls, object setting controls, tool setting controls, and region setting controls for the online whiteboard. In some embodiments, the online whiteboard may also be displayed alongside an online document, or the online whiteboard may overlap with the online document.
[0347] In step 3602, in response to a trigger operation on the recording control, the content recording function for the online whiteboard is enabled, and the operations performed on the online whiteboard are recorded.
[0348] Regarding step 3602, the operations performed by each user object on the online whiteboard can be captured in real time. In other words, real-time operation capture allows for the automatic recording of every click, drag, zoom, and other action performed by a user object on the online whiteboard. For details, please refer to the explanation of visual operations; it will not be elaborated upon here.
[0349] During recording, every action a user takes on the online collaborative whiteboard (i.e., online whiteboard) can be captured and recorded in real time. Specifically, event monitoring technology and data processing algorithms can be used to ensure the accuracy and completeness of the recorded actions.
[0350] In some embodiments, an interface can be set up to integrate with the online whiteboard, monitoring various user operations through the interface. These operations can include mouse clicks, drags, zooms, etc. Once captured, the operations are immediately converted into operation data in a unified format, including operation type, occurrence time, coordinate location, etc.
[0351] After obtaining the operational data, it can be processed to remove redundant information and noise interference, ensuring the purity and usability of the data, so that the operational data can be converted into operational identifiers and operational parameters in the future.
[0352] During the recording of operations performed on the online whiteboard, it is possible to prevent the duplication or rewriting of user objects' operations on the online whiteboard, ensuring the uniqueness of the operations. Requests for duplication or rewriting can be rejected, thereby maintaining the clarity and accuracy of the operations.
[0353] In some embodiments, to ensure the uniqueness and accuracy of operations and prevent interference from duplicate requests, rewrite requests, or other requests, an efficient and accurate request filtering system can be constructed. Responding to user input, natural language processing techniques and pattern recognition algorithms are used to accurately identify the semantics and intent of the user input, thereby filtering out operations that meet the requirements. Furthermore, deduplication algorithms can be employed to compare and verify the received content in real time with the operation identifiers and parameters already stored for this content recording. By calculating the hash value or feature fingerprint of the content, it can be determined whether the content is duplicated with the operation identifiers and parameters already stored for this content recording; if duplicates are found, the content is blocked.
[0354] In step 3603, in response to the command to close the content recording function, a file is generated that records the operation and the corresponding content.
[0355] For step 3603, the captured operation can be converted into a unified format of operation code (i.e., operation identifier) and parameters (i.e., operation parameters), so that the file including the operation code and parameters can be stored. In some embodiments, a distributed database can be used to store the file.
[0356] In some embodiments, a distributed database can be used to store files containing multiple operations and their corresponding content. These files include operation traces arranged chronologically from the operations. Distributed databases offer high availability, scalability, and fault tolerance, supporting concurrent read and write operations on large-scale data. Files can be split into subfiles and distributed across different physical nodes of the distributed database, increasing storage capacity and reducing the risk of single-node failures.
[0357] In step 3604, the file generated by recording the content of the online whiteboard is displayed. In response to the trigger operation on the file, a content playback page is displayed, and the operation performed on the online whiteboard and the corresponding content are played on the content playback page.
[0358] Regarding step 3604, in order to improve the content playback effect, the operation intention can be predicted by a pre-trained operation prediction model, so as to display the content corresponding to a single operation more naturally and achieve a natural transition between two adjacent operations.
[0359] The file includes operation identifiers and operation parameters. Based on the operation identifiers and operation parameters, dynamic data elements can be used to play the file, that is, to play the operation performed in the online whiteboard and the corresponding content.
[0360] During file playback, the operation identifiers can be accurately restored in sequence according to the time corresponding to the operation identifiers, providing users with an intuitive and consistent operating experience.
[0361] In some embodiments, during file playback, users can freely control the presentation progress by dragging, zooming, or other methods. Furthermore, users can zoom in on the displayed content within the file to view details, enhancing the presentation's flexibility and comprehensibility.
[0362] In some embodiments, data parsing technology, graphics rendering technology, and user interaction design can be combined to ensure the accuracy and smoothness of the presentation. Graphics rendering technology, in particular, can map the parsed operational data onto the canvas in real time, generating realistic visual effects to meet the presentation needs of different scenarios.
[0363] The embodiments of this application have the following technical effects:
[0364] This application includes a recording control for online whiteboards. Responding to a trigger operation on the recording control, the content of the online whiteboard can be recorded. Compared to using an image acquisition device to capture the content of the online whiteboard, there is no need to set the acquisition angle, simplifying the content recording process and improving recording efficiency. Furthermore, the online whiteboard content recording function can generate a file recording the operations performed on the online whiteboard and their corresponding content. Compared to using an image acquisition device, this avoids recording content other than the online whiteboard itself, further improving recording efficiency and solving the aforementioned technical problems.
[0365] By accurately recording operations and their corresponding content, and reproducing these operations and their corresponding content in real time, this solution significantly improves collaboration efficiency and transparency among users (including team members, teachers, and students). Each user can view the operational steps and thought processes of others in real time, thereby reducing communication costs and misunderstandings. This transparent collaboration method helps to quickly resolve problems, accelerate project progress, and ensure that all users are working on the same schedule. By reproducing the files, new users (i.e., those who have not used the online whiteboard before) can quickly familiarize themselves with the content of the online whiteboard, which can include workflows, work standards, classroom content, etc.
[0366] The following description continues to illustrate the exemplary structure of the content recording device 455 provided in the embodiments of this application as a software module. In some embodiments, such as Figure 2A As shown, the software module stored in the content recording device 455 of the memory 450 may include:
[0367] The first display module 4551 is used to display the interface of the online whiteboard, the interface including recording controls for the online whiteboard; wherein, the online whiteboard is used for at least two user objects to collaboratively perform visual operations on the online whiteboard;
[0368] The response module 4552 is used to respond to a trigger operation on the recording control and enable the content recording function for the online whiteboard;
[0369] Recording module 4553 is used to record the operations performed on the online whiteboard based on the content recording function;
[0370] The response module 4552 is further configured to generate a file containing the operation and the corresponding content in response to a closing command for the content recording function.
[0371] In some embodiments, the first display module 4551 is further configured to, in response to a trigger operation on the recording control, before enabling the content recording function for the online whiteboard, display an object setting control corresponding to the content recording function, wherein the object setting control is used to set the user object corresponding to the recording operation; and receive the target user object set based on the object setting control;
[0372] The recording module 4553 is also used to record the operations performed by the target user object in the online whiteboard based on the content recording function.
[0373] In some embodiments, the first display module 4551 is further configured to, in response to a trigger operation of setting a control for the object, display a plurality of object groups, each object group including at least one of the user objects; and upon receiving a selection operation for a target object group among the plurality of object groups, determine the user object in the selected target object group as the target user object.
[0374] The recording module 4553 is also used to record the operations performed by the target user object in the online whiteboard based on the content recording function.
[0375] In some embodiments, the first display module 4551 is further configured to, in response to a trigger operation of setting a control for the object, display a plurality of object groups, each object group including at least one of the user objects; and upon receiving a selection operation for a target object group among the plurality of object groups, determine the user object in the selected target object group as the target user object.
[0376] In some embodiments, the first display module 4551 is further configured to, in response to a trigger operation on the recording control, before enabling the content recording function for the online whiteboard, display a tool setting control corresponding to the content recording function, wherein the tool setting control is used to set the operation tool corresponding to the recording operation; and receive the target operation tool set based on the tool setting control;
[0377] The recording module 4553 is also used to record, based on the content recording function, operations performed on the online whiteboard using the target operation tool.
[0378] In some embodiments, the target operation tool includes a target drawing tool; the recording module 4553 is further configured to record the target drawing operation performed on the online whiteboard using the target drawing tool based on the content recording function, and to identify the target drawing operation using a target color; wherein, the target color is used to indicate that the target drawing operation and the content drawn by the target drawing operation are being recorded.
[0379] In some embodiments, the response module 4552 is further configured to display recording prompt information in response to a trigger operation on the recording control, the recording prompt information being used to prompt the user object to confirm whether to record the operation performed on the online whiteboard; and to enable the content recording function for the online whiteboard in response to a confirmation instruction triggered based on the recording prompt information.
[0380] In some embodiments, the response module 4552 is further configured to respond to a confirmation instruction triggered based on the recorded prompt information, and if there is another user object among the at least two user objects that has not triggered the confirmation instruction, display a waiting prompt information; wherein the waiting prompt information is used to prompt that the other user object is waiting to trigger the confirmation instruction.
[0381] In some embodiments, the first display module 4551 is further configured to, in response to a trigger operation on the recording control, before enabling the content recording function for the online whiteboard, display a region setting control corresponding to the content recording function, the region setting control being used to set the recording region; and receive the target region of the online whiteboard set based on the region setting control;
[0382] The recording module 4553 is also used to record the operations performed in the target area of the online whiteboard based on the content recording function.
[0383] In some embodiments, the recording module 4553 is further configured to, based on the content recording function, in response to a first drawing operation performed on the online whiteboard, display the content corresponding to the first drawing operation; in response to the display ratio of the content corresponding to the first drawing operation being greater than a preset ratio threshold, determine that the first drawing operation belongs to an operation performed in the target area, and record the first drawing operation and the content corresponding to the first drawing operation; wherein, the display ratio is the ratio of the area of the content corresponding to the first drawing operation in the target area to the area of the content corresponding to the first drawing operation.
[0384] In some embodiments, the first display module 4551 is further configured to display an interface of an online document, the interface of which includes a launch control for an online whiteboard; in response to a trigger operation on the launch control, the interface of the online whiteboard is displayed, the transparency of the online whiteboard being greater than that of the online document.
[0385] In some embodiments, the response module 4552 is further configured to, in response to a trigger operation on the recording control, display recording confirmation information for the content of the online document; and, in response to a recording confirmation instruction triggered by the recording confirmation information, enable the recording function for the content of the online whiteboard and the content of the online document.
[0386] In some embodiments, the number of operations performed in the online whiteboard is multiple. The response module 4552 is further configured to, after generating a file recording the operations and the corresponding content, display an editing interface for the file in response to a modification instruction for the file. The editing interface displays multiple operation identifiers sorted in chronological order, and each operation identifier corresponds one-to-one with an operation performed in the online whiteboard. In response to a deletion instruction for a first operation identifier among the multiple operation identifiers, the first operation identifier is deleted. In response to a file generation instruction, a file is generated recording operations with a second operation identifier and the corresponding content of the second operation identifier, wherein the second operation identifier is an operation identifier other than the first operation identifier among the multiple operation identifiers.
[0387] In some embodiments, the response module 4552 is further configured to, during the recording of operations performed on the online whiteboard, respond to a pause command for the content recording function and display the operation area corresponding to the operation using a first display style, wherein the first display style is used to indicate that the operation area is in an inoperable state.
[0388] In some embodiments, the response module 4552 is further configured to, in response to a closing instruction for the content recording function, convert the recorded content of the online whiteboard into an operation identifier and operation parameters, and generate a file recording the operation and the corresponding content based on the operation identifier and the operation parameters; after generating the file recording the operation and the corresponding content, in response to a sharing instruction for the file, share the file recording the operation and the corresponding content to other user objects among the at least two user objects.
[0389] In some embodiments, the response module 4552 is further configured to respond to a first operation performed on the online whiteboard, if the first operation has been performed on the online whiteboard within a first time interval from the current time point, then keep the content of the online whiteboard unchanged and display a first reason information for not performing the first operation; or, in response to a second operation performed on the online whiteboard, if a third operation conflicting with the second operation has been performed on the online whiteboard within a second time interval from the current time point, then keep the content of the online whiteboard unchanged and display a second reason information for not performing the second operation.
[0390] The following description continues to illustrate the exemplary structure of the content playback device 456 provided in the embodiments of this application as a software module. In some embodiments, such as Figure 2B As shown, the software module stored in the content recording device 456 of the memory 450 may include:
[0391] The second display module 4561 is used to display the interface of the online whiteboard, the interface including a file generated by recording the content of the online whiteboard; wherein, the online whiteboard is used for at least two user objects to collaboratively perform visual operations on the online whiteboard, and the file records the operations performed on the online whiteboard and the content corresponding to the operations;
[0392] The playback module 4562 is configured to respond to a trigger operation on the file, display a content playback page, and play the operation performed on the online whiteboard and the corresponding content on the content playback page.
[0393] In some embodiments, the number of operations is multiple, each operation has an associated display time, and the multiple operations include a fourth operation; the playback module 4562 is further configured to, in the content playback page, in response to the time reaching the display time of the fourth operation, play the fourth operation performed in the online whiteboard, and the content corresponding to the fourth operation.
[0394] In some embodiments, during the playback of the fourth operation, the content corresponding to the fourth operation is displayed using a second display style. The plurality of operations also include a fifth operation, the display time of the fifth operation is after the display time of the fourth operation, and the display time of the fifth operation is adjacent to the display time of the fourth operation.
[0395] The playback module 4562 is further configured to play the fourth operation performed in the online whiteboard and the content corresponding to the fourth operation, and in response to the time reaching the display time of the fifth operation, cancel the display of the content corresponding to the fourth operation using the second display style, and play the fifth operation performed in the online whiteboard and the content corresponding to the fifth operation, and display the content corresponding to the fifth operation using the second display style.
[0396] In some embodiments, the file contains multiple user objects performing operations on the online whiteboard and the corresponding content of the operations. The content playback page displays a switching control for switching user objects on the online whiteboard. The playback module 4562 is also used to play a sixth operation performed by the first user object on the online whiteboard and the corresponding content of the sixth operation on the content playback page.
[0397] In response to a switching command triggered by the switching control, the content playback page plays the seventh operation performed by the second user object corresponding to the switching command on the online whiteboard, as well as the content corresponding to the seventh operation.
[0398] This application provides a computer program product, which includes a computer program or computer-executable instructions stored in a computer-readable storage medium. The processor of an electronic device reads the computer-executable instructions from the computer-readable storage medium and executes the computer-executable instructions, causing the electronic device to perform the content recording method or content playback method described in this application.
[0399] This application provides a computer-readable storage medium storing computer-executable instructions or a computer program. When the computer-executable instructions or the computer program are executed by a processor, the processor will execute the content recording method provided in this application. For example, ... Figure 3 The content recording method shown may cause the processor to execute the content playback method provided in the embodiments of this application, for example, such as... Figure 30 The method for playing the content shown is as follows.
[0400] In some embodiments, the computer-readable storage medium may be a memory such as RAM, ROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.
[0401] In some embodiments, computer-executable instructions may take the form of programs, software, software modules, scripts, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as stand-alone programs or as modules, components, subroutines, or other units suitable for use in a computing environment.
[0402] As an example, computer-executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple co-located files (e.g., files that store one or more modules, subroutines, or code sections).
[0403] As an example, computer-executable instructions can be deployed to execute on a single electronic device, or on multiple electronic devices located at one location, or on multiple electronic devices distributed across multiple locations and interconnected via a communication network.
[0404] This application includes a recording control for online whiteboards. Responding to a trigger operation on the recording control, the content of the online whiteboard can be recorded. Compared to using an image acquisition device to capture the content of the online whiteboard, there is no need to set the acquisition angle, simplifying the content recording process and improving recording efficiency. Furthermore, the online whiteboard content recording function can generate a file recording the operations performed on the online whiteboard and their corresponding content. Compared to using an image acquisition device, this avoids recording content other than the online whiteboard itself, further improving recording efficiency.
[0405] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.
Claims
1. A content recording method, characterized in that, The method includes: The interface for displaying the online whiteboard includes recording controls for the online whiteboard. The online whiteboard is used to allow at least two user objects to collaboratively perform visual operations on the online whiteboard. In response to a trigger operation on the recording control, the content recording function for the online whiteboard is enabled; Based on the content recording function, the operations performed on the online whiteboard are recorded; In response to a command to close the content recording function, a file is generated that records the operation and the corresponding content.
2. The method according to claim 1, characterized in that, Before activating the content recording function for the online whiteboard in response to a trigger operation on the recording control, the method further includes: Displays the object setting control corresponding to the content recording function. The object setting control is used to set the user object corresponding to the recording operation. Receive the target user object based on the settings of the object settings control; The recording of operations performed on the online whiteboard based on the content recording function includes: Based on the content recording function, the operations performed by the target user object in the online whiteboard are recorded.
3. The method according to claim 2, characterized in that, The receiving of the target user object based on the object setting control includes: In response to a triggered operation that sets a control for the object, multiple object groups are displayed, each object group including at least one of the user objects; Upon receiving a selection operation for a target object group among the multiple object groups, the user object in the selected target object group is determined as the target user object.
4. The method according to claim 1, characterized in that, Before activating the content recording function for the online whiteboard in response to a trigger operation on the recording control, the method further includes: Displays the tool settings control corresponding to the content recording function. The tool settings control is used to set the operation tools corresponding to the recording operation. Receive the target operation tool based on the settings of the tool settings control; The recording of operations performed on the online whiteboard based on the content recording function includes: Based on the content recording function, the operations performed using the target operation tool on the online whiteboard are recorded.
5. The method according to claim 4, characterized in that, The target manipulation tools include target drawing tools; The recording of operations performed on the online whiteboard using the target operation tool, based on the content recording function, includes: Based on the content recording function, the target drawing operation performed on the online whiteboard using the target drawing tool is recorded, and the target drawing operation is identified by the target color; The target color is used to indicate that the target drawing operation and the content drawn by the target drawing operation are being recorded.
6. The method according to claim 1, characterized in that, The step of activating the content recording function for the online whiteboard in response to a trigger operation on the recording control includes: In response to a trigger operation on the recording control, a recording prompt message is displayed, which prompts the user to confirm whether to record the operation performed on the online whiteboard. In response to a confirmation command triggered based on the recording prompt information, the content recording function for the online whiteboard is started.
7. The method according to claim 6, characterized in that, The method further includes: In response to a confirmation command triggered based on the recording prompt information, if there are other user objects among the at least two user objects that have not triggered the confirmation command, a waiting prompt information is displayed; The waiting prompt information is used to indicate that the user is waiting for another user to trigger the confirmation command.
8. The method according to claim 1, characterized in that, Before activating the content recording function for the online whiteboard in response to a trigger operation on the recording control, the method further includes: Displays a region setting control corresponding to the content recording function, which is used to set the recording region; Receive the target area of the online whiteboard based on the area setting control; The recording of operations performed on the online whiteboard based on the content recording function includes: Based on the content recording function, the operations performed in the target area of the online whiteboard are recorded.
9. The method according to claim 8, characterized in that, The recording of operations performed in the target area of the online whiteboard based on the content recording function includes: Based on the content recording function, in response to the first drawing operation performed in the online whiteboard, the content corresponding to the first drawing operation is displayed; In response to the fact that the display ratio of the content corresponding to the first drawing operation is greater than a preset ratio threshold, it is determined that the first drawing operation belongs to the operation performed in the target area, and the first drawing operation and the content corresponding to the first drawing operation are recorded; Wherein, the display ratio is the proportion of the area of the content corresponding to the first drawing operation in the target area to the area of the content corresponding to the first drawing operation.
10. The method according to claim 1, characterized in that, The interface for displaying the online whiteboard includes: The interface for displaying online documents includes a startup control for an online whiteboard. In response to a trigger operation on the launch control, the interface of the online whiteboard is displayed, the transparency of the online whiteboard being greater than the transparency of the online document.
11. The method according to claim 10, characterized in that, The step of activating the content recording function for the online whiteboard in response to a trigger operation on the recording control includes: In response to a trigger operation on the recording control, a recording confirmation message for the content of the online document is displayed; In response to a recording confirmation command triggered by the recording confirmation information, the recording function for the content of the online whiteboard and the content of the online document is started.
12. The method according to claim 1, characterized in that, The number of operations performed in the online whiteboard is multiple. After generating a file recording the operations and their corresponding content, the method further includes: In response to a modification command for the file, an editing interface for the file is displayed. The editing interface displays multiple operation identifiers arranged in chronological order, and each operation identifier corresponds to an operation performed in the online whiteboard. In response to a deletion instruction for a first operation identifier among the plurality of operation identifiers, the first operation identifier is deleted; In response to a file generation instruction, a file is generated that records an operation with a second operation identifier and the content corresponding to the operation with the second operation identifier. The second operation identifier is an operation identifier other than the first operation identifier among the plurality of operation identifiers.
13. The method according to claim 1, characterized in that, The method further includes: During the recording of operations performed on the online whiteboard, in response to a pause command for the content recording function, the operation area corresponding to the operation is displayed using a first display style, which indicates that the operation area is in an inoperable state.
14. The method according to claim 1, characterized in that, The step of generating a file containing the operation and the corresponding content in response to a command to close the content recording function includes: In response to the command to close the content recording function, the recorded content of the online whiteboard is converted into an operation identifier and operation parameters, and a file containing the operation and the corresponding content is generated based on the operation identifier and the operation parameters. After generating a file that records the operation and the corresponding content, the method further includes: In response to a sharing instruction for the file, the file containing the operation and the corresponding content is shared to the other user object among the at least two user objects.
15. The method according to claim 1, characterized in that, The method further includes: In response to a first operation performed on the online whiteboard, if the first operation has already been performed on the online whiteboard within a first time interval from the current time point, then the content of the online whiteboard remains unchanged, and a first reason information for not performing the first operation is displayed; or, In response to the second operation performed on the online whiteboard, if a third operation conflicting with the second operation has been performed on the online whiteboard within a second time interval from the current time point, the content of the online whiteboard remains unchanged, and a second reason information for not performing the second operation is displayed.
16. A content playback method, characterized in that, The method includes: The interface displays an online whiteboard, which includes a file generated from recording the content of the online whiteboard. The online whiteboard is used to allow at least two user objects to collaboratively perform visual operations on the online whiteboard. The file records the operations performed on the online whiteboard and the corresponding content of the operations. In response to a triggered operation on the file, a content playback page is displayed, and the operation performed in the online whiteboard and the corresponding content are played on the content playback page.
17. The method according to claim 16, characterized in that, The number of operations is multiple, each operation has an associated display time, and the multiple operations include a fourth operation; The playback of the operation performed on the online whiteboard and the corresponding content on the content playback page includes: On the content playback page, in response to the time reaching the display time of the fourth operation, the fourth operation performed on the online whiteboard, as well as the content corresponding to the fourth operation, is played.
18. The method according to claim 17, characterized in that, During the playback of the fourth operation, the content corresponding to the fourth operation is displayed using the second display style. The multiple operations also include a fifth operation. The display time of the fifth operation is after the display time of the fourth operation, and the display time of the fifth operation is adjacent to the display time of the fourth operation. After playing the fourth operation performed on the online whiteboard and the content corresponding to the fourth operation, the method further includes: In response to the time elapsed for the display of the fifth operation, the display of the content corresponding to the fourth operation using the second display style is cancelled, and the fifth operation performed in the online whiteboard, along with the content corresponding to the fifth operation, is played back, and the content corresponding to the fifth operation is displayed using the second display style.
19. The method according to claim 16, characterized in that, The file contains multiple user objects performing operations on the online whiteboard and the corresponding content of the operations. The content playback page displays a switching control for switching user objects on the online whiteboard. The playback of the operation performed on the online whiteboard and the corresponding content on the content playback page includes: On the content playback page, the sixth operation performed by the first user object on the online whiteboard, and the content corresponding to the sixth operation, are played. In response to a switching command triggered by the switching control, the content playback page plays the seventh operation performed by the second user object corresponding to the switching command on the online whiteboard, as well as the content corresponding to the seventh operation.
20. A content recording device, characterized in that, The device includes: The first display module is used to display the interface of the online whiteboard, the interface including recording controls for the online whiteboard; The online whiteboard is used to allow at least two user objects to collaboratively perform visual operations on the online whiteboard. The response module is used to respond to a trigger operation on the recording control and enable the content recording function for the online whiteboard; The recording module is used to record the operations performed on the online whiteboard based on the content recording function. The response module is also configured to generate a file containing the operation and the corresponding content in response to a command to close the content recording function.
21. A content playback device, characterized in that, The device includes: The second display module is used to display the interface of the online whiteboard, the interface including a file generated by recording the content of the online whiteboard; The online whiteboard is used to allow at least two user objects to collaboratively perform visual operations on the online whiteboard. The file records the operations performed on the online whiteboard and the corresponding content of the operations. The playback module is configured to respond to a trigger operation on the file, display a content playback page, and play the operation performed in the online whiteboard and the corresponding content on the content playback page.
22. An electronic device, characterized in that, The electronic device includes: Memory is used to store executable instructions or computer programs. The processor, when executing computer-executable instructions or computer programs stored in the memory, implements the content recording method according to any one of claims 1 to 15, or implements the content playback method according to any one of claims 16 to 19.
23. A computer-readable storage medium storing computer-executable instructions or a computer program, characterized in that, When the computer-executable instructions or computer program are executed by a processor, they implement the content recording method according to any one of claims 1 to 15, or the content playback method according to any one of claims 16 to 19.
24. A computer program product comprising computer-executable instructions or a computer program, characterized in that, When the computer-executable instructions or computer program are executed by a processor, they implement the content recording method according to any one of claims 1 to 15, or the content playback method according to any one of claims 16 to 19.