Electronic whiteboard stroke dynamic adjustment method and device, equipment and storage medium
By dynamically adjusting the stroke size by determining the environmental depth information in the electronic whiteboard system, the problem of different brush stroke clarity caused by different participants' positions is solved, and the meeting efficiency and user experience are improved.
Patent Information
- Application Number
- CN202510322628.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2025-03-04
- Filing Date
- 2025-03-19
- Publication Date
- 2025-06-20
AI Technical Summary
When multiple people participate in the meeting, the existing electronic whiteboard system has different clarity of the brush stroke trajectory due to the different positions of participants. It is necessary to frequently manually adjust the brush stroke options, which affects convenience and meeting efficiency.
By determining the depth information of the environment in which the electronic whiteboard is located, dynamically adjusting the drawing size of the strokes, ensuring that participants can get a good viewing experience regardless of their position.
Automatically adjust the stroke size, reducing the number of times users manually adjust, and improving the fluency and efficiency in meetings or teaching scenarios.
Smart Images
Figure CN120182986A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of image data processing, and particularly to a method, device, equipment and storage medium for dynamically adjusting the strokes of an electronic whiteboard. Background Art
[0002] Existing electronic whiteboard systems usually provide a variety of color and stroke thickness options, which can be manually selected or adjusted by users according to the meeting needs.
[0003] When participants view the screen at different positions in the same meeting room, they often have different viewing experiences regarding the clarity of the stroke trajectory. For example, when a participant views the screen from a relatively far position, if the stroke is relatively thin, it is often difficult to clearly see the stroke lines and contours, which affects the viewing experience of the participant and is likely to cause visual fatigue. On the contrary, when a participant views the screen from a relatively close position, if the stroke is relatively thick, the participant is also likely to feel uncomfortable visually. To ensure the viewing clarity of the participants, the user needs to manually adjust the stroke options or the viewing position multiple times during the meeting, resulting in low convenience and meeting efficiency when using the electronic whiteboard. Summary of the Invention
[0004] To solve the technical problem of low convenience and meeting efficiency caused by manually adjusting the strokes when using an electronic whiteboard, the purpose of this application is to provide a method, device, equipment and storage medium for dynamically adjusting the strokes of an electronic whiteboard. The specific technical solutions adopted are as follows: This application provides a method for dynamically adjusting the strokes of an electronic whiteboard, the method comprising: Determining the depth information of the environment where the electronic whiteboard is located; Adjusting the drawing size of the strokes using the depth information.
[0005] Preferably, the depth information includes at least one of spatial structure information and the user's viewing distance.
[0006] Preferably, the spatial structure information includes indoor area parameters.
[0007] Preferably, determining the indoor area parameters of the environment where the electronic whiteboard is located includes: Obtaining the image data of the environment where the electronic whiteboard is located; Calculating the indoor area parameters using the image data.
[0008] Preferably, determining the indoor area parameters of the environment where the electronic whiteboard is located includes: Obtaining the point cloud data of the environment where the electronic whiteboard is located; Determining the indoor area parameters using the point cloud data.
[0009] Preferably, determining the user viewing distance of the environment where the electronic whiteboard is located includes: Determining the viewing users in the environment where the electronic whiteboard is located; Determining the user viewing distance of each viewing user.
[0010] Preferably, determining the viewing users in the environment where the electronic whiteboard is located includes: Obtaining the image data of the environment where the electronic whiteboard is located; Determining the viewing users by using the image data.
[0011] Preferably, the determining the viewing users by using the image data includes: Determining the face information or human body skeleton information in the image data; Determining the viewing users by using the face information or human body skeleton information.
[0012] Preferably, the determining the user viewing distance of each viewing user includes: Determining the user viewing distance of each viewing user by using the user depth data of the viewing users.
[0013] Preferably, the depth information includes the average viewing distance of the viewing users; the adjusting the drawing size of the stroke by using the depth information includes: Determining the target drawing size of the stroke by using the average viewing distance; wherein, the average viewing distance is positively correlated with the target drawing size.
[0014] Preferably, the depth information includes the indoor area parameter; the adjusting the drawing size of the stroke by using the depth information includes: Determining the target drawing size of the stroke by using the indoor area parameter; wherein, the indoor area parameter is positively correlated with the target drawing size.
[0015] Preferably, the adjusting the drawing size of the stroke by using the depth information includes: Adjusting the drawing size of the stroke by using the depth information and the display size of the electronic whiteboard.
[0016] Preferably, the adjusting the drawing size of the stroke by using the depth information and the display size of the electronic whiteboard includes: Determining the depth weight corresponding to the depth information and the display weight corresponding to the display size; Calculating the target drawing size of the stroke by using the depth information, the depth weight, the display size and the display weight.
[0017] Preferably, the adjusting the drawing size of the stroke by using the depth information and the display size of the electronic whiteboard includes: Determining the physical size and resolution of the screen of the electronic whiteboard; Determine the physical size of a single pixel of the electronic whiteboard using the physical size and resolution of the screen; Use the depth information and the physical size of a single pixel to determine the target drawing size of the stroke.
[0018] Preferably, after determining the depth information of the environment where the electronic whiteboard is located, it further includes: Determine the background color of the electronic whiteboard; Adjust the drawing color of the stroke using the depth information and the background color.
[0019] Preferably, the adjusting the drawing color of the stroke using the depth information and the background color includes: Determine the brightness value of the background color; Use the depth information and the brightness value to determine the target contrast between the drawing color of the stroke and the background color; Determine the target drawing color of the stroke corresponding to the target contrast.
[0020] This application also provides an electronic whiteboard stroke dynamic adjustment device, which is used to implement the electronic whiteboard stroke dynamic adjustment method described in any one of the above; the device includes: An information acquisition module, which is used to determine the depth information of the environment where the electronic whiteboard is located; A stroke control module, which is used to adjust the drawing size of the stroke using the depth information.
[0021] This application also provides an electronic whiteboard stroke dynamic adjustment device, which includes a processor, a memory, and a computer program stored on the memory and executable by the processor. When the computer program is executed by the processor, the steps of the electronic whiteboard stroke dynamic adjustment method described in any one of the above are implemented.
[0022] This application also provides a computer-readable storage medium, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the electronic whiteboard stroke dynamic adjustment method described in any one of the above are implemented.
[0023] This application also provides a computer program product, which when running on a computer causes the computer to execute the electronic whiteboard stroke dynamic adjustment method described in any one of the above.
[0024] This application has the following beneficial effects: Based on the depth information of the environment where the electronic whiteboard is located, this application can dynamically and adaptively adjust the drawing size of the stroke, enabling users to obtain a good viewing experience and clear stroke content, improving viewing comfort, and significantly reducing the number of times users manually adjust the stroke options, thereby improving the fluency and efficiency in usage scenarios such as meetings or teaching. Description of the Drawings
[0025] To more clearly illustrate the technical solutions and advantages in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.
[0026] Figure 1 The flowchart of a method for dynamically adjusting the pen stroke of an electronic whiteboard shown in an exemplary embodiment of the present application Figure 1 ; Figure 2 The flowchart of a method for dynamically adjusting the pen stroke of an electronic whiteboard shown in another exemplary embodiment of the present application Figure 2 ; Figure 3 The flowchart of a method for dynamically adjusting the pen stroke of an electronic whiteboard shown in another exemplary embodiment of the present application Figure 3 ; Figure 4 The flowchart of a method for dynamically adjusting the pen stroke of an electronic whiteboard shown in another exemplary embodiment of the present application Figure 4 ; Figure 5 The flowchart of a method for dynamically adjusting the pen stroke of an electronic whiteboard shown in another exemplary embodiment of the present application Figure 5 ; Figure 6 The structural schematic diagram of the hardware operating environment of the electronic whiteboard pen stroke dynamic adjustment device involved in the embodiment solution of the present application; Figure 7 The framework structural schematic diagram of the electronic whiteboard pen stroke dynamic adjustment device involved in the embodiment solution of the present application. Detailed implementation manners
[0027] In order to further elaborate on the technical means and effects adopted by the present application to achieve the intended application purpose, the following, in combination with the drawings and preferred embodiments, details the specific implementation manners, structures, features, and effects of a method for dynamically adjusting the pen stroke of an electronic whiteboard proposed according to the present application. In the following description, different "one embodiment" or "another embodiment" do not necessarily refer to the same embodiment. In addition, the specific features, structures, or characteristics in one or more embodiments can be combined in any suitable form.
[0028] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which the present application belongs.
[0029] The following specifically describes the specific solution of an electronic whiteboard stroke dynamic adjustment method provided by the present application in combination with the accompanying drawings and various embodiments.
[0030] Figure 1 The flowchart of an electronic whiteboard stroke dynamic adjustment method shown in an exemplary embodiment of the present application Figure 1 . The electronic whiteboard stroke dynamic adjustment method can be used for an electronic whiteboard. As Figure 1 shown, the method may include: S101, determining the depth information of the environment where the electronic whiteboard is located; S102, adjusting the drawing size of the stroke using the depth information.
[0031] In this embodiment, the environment where the electronic whiteboard is located generally refers to the spatial environment in the room where the electronic whiteboard is located. In some special cases, it may also include the spatial environment around the outdoor electronic whiteboard.
[0032] For the depth information of the environment where the electronic whiteboard is located, it refers to the spatial information in front of the electronic whiteboard, mainly the distance between the front space information of the display screen of the electronic whiteboard and the front objects, etc. Specifically, the depth information mentioned in this embodiment may include at least one of spatial structure information and user viewing distance or a combination of the two.
[0033] The depth information of the environment where the electronic whiteboard is located can be obtained by means of an internal or external image or depth acquisition module on the electronic whiteboard. For example, the depth information can be obtained by an internal or external camera, lidar, infrared detector, etc. Among them, the camera can be a monocular, binocular or trinocular camera, or a depth camera.
[0034] For a monocular camera, it is necessary to first obtain image data. The initial image data does not have depth information yet. Known objects (such as desks, chairs, the frame of the electronic whiteboard or other indoor objects) can be used as a proportional reference, and a deep learning model (such as YOLO or Faster R-CNN, etc.) can be used to identify the reference objects (desks, chairs or whiteboards), and the scene geometric ratio can be calculated based on the object size. Then, the Canny edge detection algorithm can be used to identify the room boundary, or the Hough-Transform can be applied to detect straight lines to calculate the room geometry. Finally, the indoor area of the meeting room or classroom can be calculated according to the geometric ratio of the boundaries in the image, and SfM (Structure from Motion) can be applied to generate depth information.
[0035] For a binocular camera, a depth image can be generated through a stereo matching algorithm, such as SGBM (Semi-Global Block Matching), to calculate the binocular disparity to generate a three-dimensional point cloud, construct a three-dimensional space model, and determine various depth information within the space.
[0036] For a triple camera, it is usually composed of a wide-angle lens and two short-focus lenses. The wide-angle lens can provide a wide field of view, while the short-focus lenses mainly enhance the detection ability at a long distance. Thus, the spatial and depth information of the environment where the electronic whiteboard is located can be obtained.
[0037] For a lidar or an infrared detector, high-density point cloud data of various structures in the space and objects can be obtained to accurately draw the spatial structure, thereby obtaining the corresponding depth information.
[0038] In addition, the depth information of the spatial environment where the electronic whiteboard is located can also be obtained through other existing technologies for determining depth information, such as ranging and space construction, which will not be elaborated here.
[0039] After determining the depth information of the environment where the electronic whiteboard is located, the drawing size of the stroke can be reduced or enlarged to different degrees according to different depth information. For example, if the indoor space is large or the user is relatively far from the electronic whiteboard, the drawing width of the stroke line can be enlarged accordingly; if the indoor space is small or the viewer is relatively close to the display screen, the drawing width of the stroke line can be reduced accordingly to adapt to the size of the indoor space and the viewing distance of the user. It should be noted that the farther or closer here can be determined by comparing the preset corresponding depth threshold with the actually obtained depth information.
[0040] More specifically, the spatial structure information may include indoor area parameters, and the indoor area parameters cover the depth data of the indoor space.
[0041] In a specific embodiment, determining the indoor area parameters of the environment where the electronic whiteboard is located includes: Obtaining image data of the environment where the electronic whiteboard is located; Calculating the indoor area parameters using the image data.
[0042] Similarly, the indoor area parameters can also be obtained through cameras that do not have a direct depth data acquisition function, such as a monocular camera or a binocular camera. That is, first, the indoor space environment in front of the electronic whiteboard screen is photographed to obtain image data, and then the length, width, and height of the indoor area are obtained using the corresponding ranging algorithm, and then the indoor area parameters are calculated.
[0043] In another specific embodiment, determining the indoor area parameters of the environment where the electronic whiteboard is located includes: Obtain the point cloud data of the environment where the electronic whiteboard is located; Use the point cloud data to determine the indoor area parameter.
[0044] The indoor area parameter can also be directly measured and obtained by using lidar or infrared detection to obtain the corresponding spatial structure point cloud data. The length, width, and height of the indoor space structure are determined by lidar, and then the indoor area parameter is calculated.
[0045] More specifically, for the user viewing distance of the viewing user, in one embodiment, determining the user viewing distance of the environment where the electronic whiteboard is located includes: Determine the viewing users in the environment where the electronic whiteboard is located; Determine the user viewing distance of each viewing user.
[0046] In this embodiment, the viewing users in the spatial environment where the electronic whiteboard is located can be determined by image acquisition. It is possible to determine how many users are viewing the display screen of the electronic whiteboard, and the relative positions of the viewing users can be determined. Then, through the above-described implementation method of obtaining depth information, the user viewing distance of each viewing user relative to the electronic whiteboard can be obtained for different viewing users.
[0047] Among them, determining the viewing users in the environment where the electronic whiteboard is located specifically includes: Obtain the image data of the environment where the electronic whiteboard is located; Use the image data to determine the viewing users.
[0048] As described above, the image data of the spatial environment can be obtained through a monocular, binocular, or trinocular camera. Then, the image data including the viewing users can be analyzed, and each viewing user in front of the electronic whiteboard can be identified and determined through existing human recognition technologies.
[0049] In one specific embodiment, the using the image data to determine the viewing users includes: Determine the face information or human skeleton information in the image data; Use the face information or human skeleton information to determine the viewing users.
[0050] Regarding how to identify the viewing users in front of the electronic whiteboard, different viewing users can be distinguished and located by identifying the face information or human skeleton information in the image data.
[0051] For face recognition, a CNN (Convolutional Neural Networks) model can be used to detect and recognize face information from image data. The steps may include: first, performing image preprocessing, including grayscale conversion and noise reduction, and then using a Haar cascade classifier or a DNN (Deep Neural Networks) model, or a deep learning model such as RetinaFace, to locate the face information of different viewing users and extract their coordinates and distances. Here, the existing method combining the face size and the camera focal length can be used to calculate the distance.
[0052] For skeleton detection, Pose Estimation techniques such as OpenPose and BlazePose can be used: extract and capture the key points of the human body (head, shoulders, arms, etc.) through OpenPose or MediaPipe, and then calculate the center point and distribution range of the audience based on the positions of the key points of the shoulders and the head, so as to determine each viewing user using the human skeleton information.
[0053] In one embodiment, the determining of the user viewing distances of each viewing user includes: Determining the user viewing distances of each viewing user by using the user depth data of the viewing users.
[0054] The user depth data can be calculated from the image data obtained by the camera. The image data includes the face information or human skeleton information of the viewing users. The calculated depth data includes the distances between the faces of each viewing user and the electronic whiteboard, and the distances between the human skeletons and the electronic whiteboard. The shortest distance from the center point of the face or the center point of the human skeleton to the plane of the electronic whiteboard can be used as the user viewing distance. Preferably, the distance between the center point of the face and the display screen of the electronic whiteboard is used as the user viewing distance of each viewing user.
[0055] In addition, the point cloud data of each viewing user in front of the electronic whiteboard can also be obtained by a lidar or an infrared detector, so as to determine the user viewing distances of each viewing user based on the user point cloud data. This is already a relatively mature technology and will not be elaborated here.
[0056] Based on the depth information of the environment where the electronic whiteboard is located, this application can dynamically and adaptively adjust the drawing size of the pen stroke, enabling users to obtain a good viewing experience and clear pen stroke content, improving the viewing comfort, and significantly reducing the number of times users manually adjust the pen stroke options, thereby improving the fluency and efficiency in usage scenarios such as meetings or teaching.
[0057] For a method for dynamically adjusting the electronic whiteboard stroke provided by this application, in one embodiment, please refer to Figure 2 , Figure 2 which is the flow of a method for dynamically adjusting the electronic whiteboard stroke shown in another exemplary embodiment of this application Figure 2 .
[0058] In this embodiment, the depth information includes the average viewing distance of the viewing user; the method includes: Step S201, determining the depth information of the environment where the electronic whiteboard is located; Step S202, using the average viewing distance to determine the target drawing size of the stroke; wherein, the average viewing distance is positively correlated with the target drawing size.
[0059] In this embodiment, referring to the previous embodiment, the depth information of the environment where the electronic whiteboard is located can be determined. The depth information can include the user viewing distance of the viewing user. After obtaining the viewing distances of each user, the average viewing distance of all viewing users can be obtained. Using this average viewing distance, according to the rule of smaller for nearer and larger for farther, the target drawing size of the stroke can be reduced or enlarged in a linearly proportional manner. Specifically, after determining the average viewing distance, or after determining the viewing distance range to which the average viewing distance belongs, the target drawing size corresponding to the average viewing distance can be determined by calculating a linear function or reading a linear chart, and the actual drawing size of the stroke can be enlarged or reduced according to this target drawing size. Thus, when the viewing users are generally far from the display screen of the electronic whiteboard, the drawing size of the stroke is enlarged according to the corresponding target drawing size, and when the viewing users are generally close to the display screen of the electronic whiteboard, the drawing size of the stroke is reduced according to the corresponding target drawing size, so as to ensure the viewing experience and comfort of most users. It should also be noted that adjusting the drawing size of the stroke using the average viewing distance is dynamic. If some viewers change their original positions, the average viewing distance may change, and the corresponding stroke drawing size will generally also change. However, if some viewers only change their positions slightly, the stroke drawing size may not change, so as to avoid unnecessary troubles for users caused by the continuous change of the stroke drawing size when some viewers only adjust their postures or move slightly.
[0060] In another embodiment, the depth information includes the indoor area parameter; the method includes: Determining the depth information of the environment where the electronic whiteboard is located; Using the indoor area parameter to determine the target drawing size of the stroke; wherein, the indoor area parameter is positively correlated with the target drawing size.
[0061] In this embodiment, referring to the previous embodiments, the depth information of the environment where the electronic whiteboard is located can be determined, and the depth information may include indoor area parameters. It is relatively easy to understand that if the indoor area is larger, the positions of the audience are usually farther away from the display screen of the electronic whiteboard, and correspondingly, the stroke drawing size can be enlarged to the target drawing size. On the contrary, if the indoor area is smaller, the positions of the audience are usually closer to the display screen of the electronic whiteboard, and correspondingly, the stroke drawing size can be reduced to the target drawing size. For the determination of the target drawing size, the embodiment where the depth information includes the average viewing distance can be referred to, that is, it can be determined by calculating a linear function or reading a linear chart, which will not be elaborated here.
[0062] The indoor area parameter here can also be replaced by the indoor depth parameter. The indoor depth parameter refers to the distance parameter from the electronic whiteboard to the front wall it faces, which can be considered as the length parameter of the indoor floor. The product of it and the width is the indoor area parameter.
[0063] For the implementation method of determining the target drawing size of the stroke through the indoor depth parameter, the target drawing size can also be determined by reading the mapping table of the indoor depth parameter and the target drawing size. For example: Small meeting room (depth distance of 1 - 2 meters): Fine stroke, width between 2 - 3 millimeters.
[0064] Medium - sized meeting room (depth distance of 2 - 5 meters): Medium stroke, width between 4 - 6 millimeters.
[0065] Large meeting room (depth distance above 5 meters): Thicker stroke, width between 7 - 10 millimeters.
[0066] When taking the indoor area parameter or the indoor depth parameter as the depth information of the space environment where the electronic whiteboard is located, the stroke drawing size can be scaled to the appropriate pen - drawing line width before the audience is seated, showing the pen - drawing size that better matches the actual demonstration scene with higher efficiency, further improving the visual perception of the audience users when using and viewing the electronic whiteboard, enhancing the efficiency of meetings or other application scenarios, and reducing the usage cost of users.
[0067] In addition, in another embodiment, the indoor area parameter and the average viewing distance can be combined and used as the depth information of the environment where the electronic whiteboard is located. For the case of considering these two depth parameters, different weights can be assigned to the two depth parameters. For example, the weight of the indoor area parameter is 0.4, and the weight of the average viewing distance is 0.6. After multiplying the two depth parameters by their respective weights and then adding them together, a combined depth parameter is obtained. Taking this combined depth parameter as the depth information of the environment where the electronic whiteboard is located, and then scaling the corresponding stroke drawing size according to this combined depth parameter.
[0068] For a method for dynamically adjusting the strokes of an electronic whiteboard provided in this application, in one embodiment, please refer to Figure 3 , Figure 3 which is a flowchart of a method for dynamically adjusting the strokes of an electronic whiteboard shown in another exemplary embodiment of this application Figure 3 .
[0069] In this embodiment, the method includes: Step S301, determining the depth information of the environment where the electronic whiteboard is located; Step S302, adjusting the drawing size of the strokes by using the depth information and the display size of the electronic whiteboard.
[0070] In this embodiment, referring to the previous embodiment, the depth information of the environment where the electronic whiteboard is located can be determined. Furthermore, the display size of the electronic whiteboard can also be determined. Here, the display size can be the physical size of the screen, such as 65 inches, 70 inches, 80 inches, etc. The display size of the electronic whiteboard can also be positively correlated with the stroke drawing size, that is, the larger the display size, the larger the corresponding target drawing size can be.
[0071] Specifically, step S302 includes: Determining the depth weight corresponding to the depth information and the display weight corresponding to the display size; Calculating the target drawing size of the strokes by using the depth information, the depth weight, the display size, and the display weight.
[0072] Here, certain weight coefficients can be preset for the depth information and the display size respectively. The depth information and the display size can be normalized to unify their units. Then, after multiplying the respective weight coefficients by the corresponding normalized depth information and display size respectively and adding them together, a fused reference data is obtained. Furthermore, the target drawing size of the strokes is determined by reading the corresponding mapping table by using the fused reference data.
[0073] In this embodiment, it is further considered that the same pen drawing size parameter has different display effects in different screen physical sizes. By combining the depth information and the display size, a pen drawing size that is more in line with the actual perception of the user is obtained, further improving the convenience of the user using the electronic whiteboard, the viewing comfort, and the meeting efficiency.
[0074] For a method for dynamically adjusting the strokes of an electronic whiteboard provided in this application, in one embodiment, please refer to Figure 4 , Figure 4 which is a flowchart of a method for dynamically adjusting the strokes of an electronic whiteboard shown in another exemplary embodiment of this application Figure 4 .
[0075] In this embodiment, the method includes: Step S401, determine the depth information of the environment where the electronic whiteboard is located; Step S402, determine the physical size and resolution of the electronic whiteboard screen; Step S403, use the physical size and resolution of the screen to determine the physical size of a single pixel of the electronic whiteboard; Step S404, use the depth information and the physical size of a single pixel to determine the target drawing size of the pen stroke.
[0076] After or simultaneously with determining the depth information of the environment where the electronic whiteboard is located, it is also possible to obtain the physical size and resolution of the display screen of the electronic whiteboard. The physical size of the screen is generally 65 inches, 75 inches, 80 inches, 100 inches, etc. The resolution is generally 1080P, 2K, 4K, 8K, etc. Combining the physical size and resolution of the display screen, the concept of relative display size is proposed here. Simply put, even for the same physical size of the screen, if there are differences in their resolutions, the same display content (here referring to the pen stroke line) will present visually different display sizes. For example, for two 65-inch display screens, one with a resolution of 1080P and the other with a resolution of 2K, the pen stroke drawing size displayed on the 1080P display screen is generally larger than that on the 2K display screen. Therefore, in this case, simply adjusting the pen stroke parameters in the same way to scale the pen stroke line will result in different viewing experiences for the audience, and the actual pen stroke lines will also have different physical sizes. Therefore, in this embodiment, based on the physical size and resolution of the screen, combined with the depth information, for the same pen stroke adjustment parameters, it is possible to achieve the same or similar physical pen stroke drawing sizes on display screens with different physical sizes and resolutions. In this way, regardless of the resolution and physical size of the display screen, the audience can experience the same or similar pen stroke drawing sizes and visual effects, reducing or avoiding relatively cumbersome manual adjustment of pen stroke parameters, greatly improving the convenience of using the electronic whiteboard, and improving the efficiency of application scenarios such as meetings and teaching.
[0077] In this specific embodiment, for the problem of how to present the same or approximate physical stroke drawing size or visually similar stroke drawing size effect when drawing stroke lines on electronic whiteboard display screens with different screen physical sizes and different resolutions, we can first use the physical size and resolution of the display screen, divide the two to calculate the physical size of a single pixel of different display screens, that is, the single-pixel physical size, and the unit can be expressed as mm / pixel, which is used to characterize the relative display size. Then, use the depth information to determine the corresponding physical stroke drawing size, and take this physical stroke drawing size as the target drawing size. This physical stroke drawing size can be a specific value, a numerical range, or different physical stroke drawing sizes can be set according to different screen physical sizes, so it can also be a data set. After both the physical stroke drawing size and the single-pixel physical size are determined, we can calculate the number of pixels corresponding to the stroke line output of different display screens using the physical stroke drawing size and the single-pixel physical size, so as to ensure that display screens of different specifications (display size and resolution) output the same or approximate physical stroke drawing size or visually similar stroke display size effect.
[0078] To facilitate the understanding of the above process, please refer to Table 1 below for an example. For the same parameter stroke drawing size at the software level, when the viewing distance is 1.5m, when performing stroke drawing display on an 85-inch and 1080P display screen, the number of pixels occupied by the stroke line (the smallest unit of the line, which can be considered a point that makes up the line) is 3. When performing stroke drawing display on a 100-inch and 1080P display screen, the number of pixels occupied by the stroke line is 2. The principle is that for display screens with the same resolution but different screen sizes, the larger the screen size, the larger the corresponding single-pixel physical size. Therefore, in order to achieve an approximate physical stroke drawing size or stroke display effect for the two, the corresponding number of pixels will be less.
[0079] Continuing to refer to Table 1 below, for another example, for the same parameter stroke drawing size at the software level, when the viewing distance is 3.5m, when performing stroke drawing display on an 85-inch and 1080P display screen, the number of pixels occupied by the stroke line is 5. When performing stroke drawing display on an 85-inch and 2K display screen, the number of pixels occupied by the stroke line is 7. The principle is that for display screens with the same screen size but different resolutions, the higher the resolution, the smaller the corresponding single-pixel physical size. Therefore, in order to achieve an approximate physical stroke drawing size or stroke display effect for the two, the corresponding number of pixels will be more.
[0080] It should be noted that for how other display screens with different display sizes and resolutions output the number of pixels corresponding to the target drawing size, reference can also be made to Table 1 below. This Table 1 can also be preset as part of a mapping table in the operating system or other firmware of the electronic whiteboard. After determining the user's viewing distance, the physical size, and the resolution of the screen, the number of pixels corresponding to the target drawing size can be determined and output by reading this mapping table.
[0081]
[0082] Through the above-mentioned implementation manners of the present application, the physical drawing size of the brushstroke is dynamically adjusted. Considering the actual viewing experience of the audience, by determining the physical size of a single pixel of different display screens, the brushstroke lines displayed on different display screens are scaled to the same or nearly the same actual physical size, excluding the problem of inconsistent adjustment of the physical drawing size of the brushstroke lines due to different screen sizes and resolutions, ensuring that for any display screen of any specification, it can bring as consistent a viewing experience and visual size of the brushstroke to the audience as possible, further improving the comfort and convenience of the user's use of the electronic whiteboard, enhancing the application efficiency in scenarios such as meetings or teaching, and reducing unnecessary manual adjustments.
[0083] In another implementation manner, the target drawing size can also be calculated through a function related to weights. The function formula can be expressed as:
[0084] S: The target drawing size of the brushstroke A: The indoor area D: The average viewing distance Sr: The physical size of a single pixel W: Respectively represent the weight coefficients of the above various parameters; Sub-function:
[0085] Where k a , k d , k s are the corresponding proportionality coefficients. Their role is to adjust various variables (indoor area A, average viewing distance D, physical size of a single pixel Sr) that affect the brushstroke drawing size to an appropriate influence range to ensure the balance of different factors when calculating the brushstroke drawing size. The meanings of the proportionality coefficients are as follows: 1. k a (Indoor area proportionality coefficient) Influence factor: Indoor area A Influence mechanism: When the meeting room area is large, thicker brushstroke lines are required to meet the viewing needs at a distance. The logarithmic function log(A) is used to represent the characteristic that the growth trend of the brushstroke thickness slows down after the indoor area increases.
[0086] The typical value range can be: [0.05, 0.2].
[0087] 2. k d (Average viewing distance ratio coefficient) Influence factor: Average viewing distance D Influence mechanism: The farther the participants are, the thicker the brushstrokes should be to ensure readability at a distance. It forms a linear function when multiplied by D because there is a linear proportional relationship between the average viewing distance and the brushstroke thickness.
[0088] The typical value range can be: [0.03, 0.1].
[0089] 3. k s (Screen relative size ratio coefficient) Influence factor: Single-pixel physical size Sr Influence mechanism: For the same resolution, the larger the screen, the relatively thinner the brushstrokes should be (here it refers to the fewer pixels occupied by the brushstroke lines) to prevent overly thick strokes from affecting the fineness. It forms a linear function when multiplied by Sr.
[0090] • The typical value range is: [0.01, 0.05].
[0091] Through the above implementation manners of the present application, a higher-precision target drawing size is achieved, further improving the comfort and convenience of the user's use of the electronic whiteboard, enhancing the application efficiency in scenarios such as meetings or teaching, and significantly reducing unnecessary manual adjustment of the brushstrokes.
[0092] For an electronic whiteboard brushstroke dynamic adjustment method provided by the present application, in one embodiment, please refer to Figure 5 , Figure 5 which is the flow of an electronic whiteboard brushstroke dynamic adjustment method shown in another exemplary embodiment of the present application Figure 5 .
[0093] In this embodiment, the method includes: Step S501, determining the depth information of the environment where the electronic whiteboard is located; Step S502, determining the background color of the electronic whiteboard; Step S503, adjusting the drawing color of the brushstroke by using the depth information and the background color.
[0094] Specifically, the step S503 includes: Determining the brightness value of the background color; Determine the target contrast between the stroke drawing color and the background color using depth information and luminance values; Determine the target drawing color of the stroke corresponding to the target contrast.
[0095] In this embodiment, since there may also be a certain visual conflict between the stroke drawing color and the background color displayed on the electronic whiteboard, that is, different stroke drawing colors will have different display effects when presented on the same background color. Especially when the stroke drawing color is the same as the background color, the stroke drawing line will be covered up and the stroke line cannot be seen by the user. Or when the stroke drawing color is visually close to the background color, it is also very likely to affect the display effect of the stroke line.
[0096] For the above phenomenon, this embodiment determines the optimal stroke drawing color by comparing the contrast between different colors. Specifically, it is necessary to first obtain the background color displayed on the electronic whiteboard and the luminance value of the background color. An initial stroke drawing color can be determined through the luminance value of the background color, and the contrast between this stroke drawing color and the background color reaches a preset initial contrast. Then, consider the influence of depth information on the final target contrast. Generally speaking, the larger the indoor area or the farther the average viewing distance, the greater the required target contrast, and the more prominent the stroke drawing color is relative to the background color. Therefore, the initial contrast can be corrected using depth information to obtain the target contrast, and then the corresponding target drawing color can be determined using the target contrast.
[0097] For example, if the background of the electronic whiteboard is bright (such as white or off-white), one of the four stroke drawing colors of red, black, blue, and green can be selected. According to the long-distance viewing requirement, red and blue with higher luminance are recommended as the pen color choices for long distances to ensure clarity under different color backgrounds. If the background of the electronic whiteboard is dark (such as black or dark green), one of the four colors of red, white, pink, and yellow can be selected. According to the long-distance viewing requirement, yellow and white with higher luminance are recommended as the pen color choices for long distances.
[0098] By determining the target drawing color of the stroke in this embodiment, the visual display effect of the stroke line is highlighted, the clarity of the user's viewing of the stroke line is enhanced, the process of manually adjusting the stroke color is reduced, and the meeting efficiency and the convenience of using the electronic whiteboard are improved.
[0099] In addition, the embodiment of the present application can also provide an option for manual fine-tuning. If the user believes that the automatic adjustment of the stroke drawing size and drawing color does not meet their expectations, they can also perform manual fine-tuning on the basis of the automatic adjustment to meet the diverse needs of the user.
[0100] Preferably, the embodiment of the present application can also provide semi-automatic stroke adjustment. That is, based on parameters such as depth information and background color, when the system of the electronic whiteboard determines that the original stroke drawing size and color are inappropriate, it can feedback the corresponding prompt information to the user, and let the user choose whether to turn on automatic adjustment with one key, or choose manual adjustment, or not make any adjustment.
[0101] The embodiment of the present application also proposes an electronic whiteboard stroke dynamic adjustment device. The electronic whiteboard stroke dynamic adjustment device can be a touch display device such as an electronic whiteboard, a conference tablet, a smart TV, a professional display, etc.
[0102] As Figure 6 shown, Figure 6 is a schematic structural diagram of the hardware operating environment of the electronic whiteboard stroke dynamic adjustment device involved in the embodiment of the present application.
[0103] As Figure 6 shown, the electronic whiteboard stroke dynamic adjustment device can include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002, and a camera 1006. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 can include a display (Display) and an input unit such as a control panel. Optionally, the user interface 1003 can also include a standard wired interface and a wireless interface. The network interface 1004 can optionally include a standard wired interface and a wireless interface (such as a Wi-Fi interface). The memory 1005 can be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. Optionally, the memory 1005 can also be a storage device independent of the aforementioned processor 1001. As a computer storage medium, the memory 1005 can include an electronic whiteboard stroke dynamic adjustment program. Among them, the camera 1006 can be an RGB (red, green, blue) camera, or an RGBD (red, green, blue, depth) camera, and the number of cameras of the camera 1006 can include one, two, three or more.
[0104] Those skilled in the art can understand that Figure 6 the hardware structure shown in
[0105] Continue to refer to Figure 6 Figure 6 the memory 1005 as a computer-readable storage medium in
[0106] In Figure 6 it, the network communication module is mainly used to connect to the server and can communicate with the server for data; while the processor 1001 can call the electronic whiteboard stroke dynamic adjustment program stored in the memory 1005 and execute the steps in each of the above embodiments.
[0107] Based on the above hardware structure of the electronic whiteboard stroke dynamic adjustment device, each embodiment for implementing the electronic whiteboard stroke dynamic adjustment method of the present application is realized.
[0108] In addition, the present application also provides an electronic whiteboard stroke dynamic adjustment device. Please refer to Figure 7 wherein the electronic whiteboard stroke dynamic adjustment device includes: An information acquisition module A10, configured to determine the depth information of the environment where the electronic whiteboard is located; A stroke control module A20, configured to adjust the drawing size of the stroke by using the depth information.
[0109] Further, the information acquisition module A10 is further configured to: Obtain image data of the environment where the electronic whiteboard is located; Calculate the indoor area parameter by using the image data.
[0110] Further, the information acquisition module A10 is further configured to: Obtain point cloud data of the environment where the electronic whiteboard is located; Determine the indoor area parameter by using the point cloud data.
[0111] Further, the information acquisition module A10 is further configured to: Determine the viewing users in the environment where the electronic whiteboard is located; Determine the user viewing distance of each viewing user.
[0112] Further, the information acquisition module A10 is further configured to: Obtain image data of the environment where the electronic whiteboard is located; Determine the viewing users by using the image data.
[0113] Further, the information acquisition module A10 is further configured to: Determine the face information or human skeleton information in the image data; Determine the viewing users by using the face information or human skeleton information.
[0114] Further, the information acquisition module A10 is further configured to: Determine the user viewing distance of each viewing user by using the user depth data of the viewing users.
[0115] Determine the target drawing size of the stroke using the average viewing distance; wherein, the average viewing distance is positively correlated with the target drawing size.
[0116] Further, the stroke control module A20 is further configured to: Determine the target drawing size of the stroke using the indoor area parameter; wherein, the indoor area parameter is positively correlated with the target drawing size.
[0117] Further, the stroke control module A20 is further configured to: Adjust the drawing size of the stroke using the depth information and the display size of the electronic whiteboard.
[0118] Further, the stroke control module A20 is further configured to: Determine the depth weight corresponding to the depth information and the display weight corresponding to the display size; Calculate the target drawing size of the stroke using the depth information, the depth weight, the display size, and the display weight.
[0119] Further, the stroke control module A20 is further configured to: Determine the screen physical size and resolution of the electronic whiteboard; Determine the physical size of a single pixel of the electronic whiteboard using the screen physical size and resolution; Determine the target drawing size of the stroke using the depth information and the physical size of a single pixel.
[0120] Further, the stroke control module A20 is further configured to: Determine the background color of the electronic whiteboard; Adjust the drawing color of the stroke using the depth information and the background color.
[0121] Further, the stroke control module A20 is further configured to: Determine the brightness value of the background color; Determine the target contrast between the drawing color of the stroke and the background color using the depth information and the brightness value; Determine the target drawing color of the stroke corresponding to the target contrast.
[0122] The specific implementation manner of the electronic whiteboard stroke dynamic adjustment device in this application is basically the same as each embodiment of the above electronic whiteboard stroke dynamic adjustment method, and will not be elaborated here.
[0123] In addition, the present application also provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium of the present application, and the computer program can be an electronic whiteboard stroke dynamic adjustment program. When the electronic whiteboard stroke dynamic adjustment program is executed by a processor, the steps of the electronic whiteboard stroke dynamic adjustment method as described above are implemented.
[0124] Among them, the method implemented when the electronic whiteboard stroke dynamic adjustment program is executed can refer to the various embodiments of the electronic whiteboard stroke dynamic adjustment method of the present application, and will not be elaborated here.
[0125] In addition, the present application also provides a computer program product. The computer program product includes computer program code. When the computer program code runs on an electronic whiteboard, the electronic whiteboard is caused to execute the electronic whiteboard stroke dynamic adjustment method in the above various embodiments.
[0126] It should be noted that: the above sequence of embodiments of the present application is only for description and does not represent the superiority or inferiority of the embodiments. The processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0127] Each embodiment in this specification is described in a progressive manner. The same or similar parts among the embodiments can be referred to each other, and the key point of each embodiment is to illustrate the differences from other embodiments.
[0128] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a device, or a computer program product. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0129] The above are only the preferred embodiments of the present application, and do not limit the protection scope of the present application accordingly. Any equivalent structural / method transformation made by using the specification and drawings of the present application under the application concept of the present application, or direct / indirect application in other related technical fields, is included in the protection scope of the present application.
Claims
1. A method for dynamically adjusting pen strokes on an electronic whiteboard, characterized in that: Applied to an electronic whiteboard, the method comprises: Determine the depth information of the environment where the electronic whiteboard is located; Use depth information to adjust the drawing size of the brush stroke.
2. The electronic whiteboard pen stroke dynamic adjustment method according to claim 1, characterized in that: The depth information includes at least one of spatial structure information and a user viewing distance.
3. The electronic whiteboard pen stroke dynamic adjustment method according to claim 2, characterized in that: The spatial structure information includes indoor area parameters.
4. The electronic whiteboard pen stroke dynamic adjustment method according to claim 3, characterized in that: Determine the indoor area parameters of the electronic whiteboard environment, including: Acquire image data of the environment where the electronic whiteboard is located; The indoor area parameters are calculated using image data.
5. The electronic whiteboard pen stroke dynamic adjustment method according to claim 3, characterized in that: Determine the indoor area parameters of the electronic whiteboard environment, including: Obtain point cloud data of the environment where the electronic whiteboard is located; Determine indoor area parameters using point cloud data.
6. The electronic whiteboard pen stroke dynamic adjustment method according to claim 2, characterized in that: Determine the user viewing distance of the electronic whiteboard environment, including: Determine the viewing users in the environment where the electronic whiteboard is located; A user viewing distance of each viewing user is determined.
7. The electronic whiteboard pen stroke dynamic adjustment method according to claim 6, characterized in that: Determine the viewing users of the electronic whiteboard environment, including: Acquire image data of the environment where the electronic whiteboard is located; The viewing user is determined using the image data.
8. The electronic whiteboard pen stroke dynamic adjustment method according to claim 7, characterized in that: The method of determining the viewing user by using the image data includes: Determine facial information or human skeleton information in image data; The viewing user is determined by using facial information or human skeleton information.
9. The electronic whiteboard pen stroke dynamic adjustment method according to claim 6, characterized in that: The determining the viewing distance of each viewing user includes: The user viewing distance of each viewing user is determined by using the user depth data of the viewing users.
10. The electronic whiteboard pen stroke dynamic adjustment method according to claim 1, characterized in that: The depth information includes an average viewing distance of viewing users; and adjusting the drawing size of the brush stroke using the depth information includes: The target drawing size of the brush stroke is determined by using the average viewing distance, wherein the average viewing distance is positively correlated with the target drawing size.
11. The electronic whiteboard pen stroke dynamic adjustment method according to claim 1, characterized in that: The depth information includes indoor area parameters; and adjusting the drawing size of the brush stroke using the depth information includes: The indoor area parameter is used to determine the target drawing size of the brush stroke; wherein the indoor area parameter is positively correlated with the target drawing size.
12. The electronic whiteboard pen stroke dynamic adjustment method according to claim 1, characterized in that: The step of adjusting the drawing size of the brush stroke by using the depth information includes: The drawing size of the pen stroke is adjusted using the depth information and the display size of the electronic whiteboard.
13. The electronic whiteboard pen stroke dynamic adjustment method according to claim 12, characterized in that: The method of adjusting the drawing size of the brush stroke by using the depth information and the display size of the electronic whiteboard includes: Determine a depth weight corresponding to the depth information and a display weight corresponding to the display size; The target drawing size of the brush stroke is calculated using the depth information and the depth weight as well as the display size and the display weight.
14. The electronic whiteboard pen stroke dynamic adjustment method according to claim 12, characterized in that: The method of adjusting the drawing size of the brush stroke by using the depth information and the display size of the electronic whiteboard includes: Determine the physical screen size and resolution of the electronic whiteboard; The physical size of a single pixel of the electronic whiteboard is determined by using the physical size and resolution of the screen; Using depth information and the physical size of a single pixel, the target drawing size of the stroke is determined.
15. The electronic whiteboard pen stroke dynamic adjustment method according to claim 1, characterized in that: The step of determining the depth information of the environment where the electronic whiteboard is located further includes: Determine the background color of the electronic whiteboard; Uses depth information and background color to adjust the paint color of the brush stroke.
16. The electronic whiteboard pen stroke dynamic adjustment method according to claim 15, characterized in that: The step of adjusting the drawing color of the brush stroke by using the depth information and the background color includes: Determine the brightness value of the background color; Determine the target contrast between the stroke color and the background color using depth information and brightness values; Determines the target contrast ratio relative to the target paint color of the stroke.
17. An electronic whiteboard pen stroke dynamic adjustment device, characterized in that: include: An information collection module is used to determine the depth information of the environment where the electronic whiteboard is located; The brush stroke control module is used to adjust the drawing size of the brush stroke using the depth information.
18. An electronic whiteboard pen stroke dynamic adjustment device, characterized in that: The electronic whiteboard pen stroke dynamic adjustment device includes a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the electronic whiteboard pen stroke dynamic adjustment method as described in any one of claims 1 to 16 are implemented.
19. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the electronic whiteboard pen stroke dynamic adjustment method as described in any one of claims 1 to 16 are implemented.
20. A computer program product, characterized in that When it is run on a computer, the computer is enabled to execute the electronic whiteboard pen stroke dynamic adjustment method as claimed in any one of claims 1 to 16.