An electronic whiteboard display method, system, device and medium for automatically adapting to a scene

Abstract

The application discloses an electronic whiteboard display method, system, device and medium capable of automatically adapting to a scene, and the method comprises the following steps: activating a camera of an electronic whiteboard after the electronic whiteboard is connected to power; collecting a scene image opposite to the electronic whiteboard based on the camera; analyzing the scene image to obtain image features; calculating a use scene of the electronic whiteboard when a user currently uses the electronic whiteboard based on the image features; switching a use mode of the electronic whiteboard according to the use scene; and pushing a corresponding function guide prompt based on the use mode. The application can improve the adaptability of the electronic whiteboard in different scenes and improve the user experience.

Description

Technical Field

[0001] This invention relates to the field of intelligent device control, and in particular to an electronic whiteboard display method, system, device, and storage medium that automatically adapts to different scenarios. Background Technology

[0002] Paperless office practices are increasingly being adopted across various industries as their demands for office models continue to rise, and against the backdrop of accelerated modernization and informatization, paperless office solutions are being applied to numerous scenarios. Electronic whiteboards allow users to write directly with a pen, just like on a regular whiteboard or blackboard, and then present the information using hardware and software. Users can even launch different applications on the electronic whiteboard via touch, meeting the needs of office or educational settings.

[0003] Because users have different needs for electronic whiteboards in different application scenarios, existing electronic whiteboards require users to operate them completely to use the functions they need. In fact, the presentation of the electronic whiteboard is the same in different environments, and users need to switch modes to use it in the current scenario. This lack of scenario adaptation function results in a poor user experience. Summary of the Invention

[0004] In order to overcome the shortcomings of the prior art, the purpose of this invention is to provide an electronic whiteboard display method, system, device and storage medium that automatically adapts to different scenarios, which can improve the adaptability of electronic whiteboards in different scenarios and improve the user experience.

[0005] The objective of this invention is achieved through the following technical solution:

[0006] An electronic whiteboard display method that automatically adapts to different scenarios includes:

[0007] When the electronic whiteboard is powered on, its camera is activated. The camera captures an image of the scene facing the electronic whiteboard and analyzes the image to obtain image features.

[0008] Based on the image features, the user's current usage scenario when using the electronic whiteboard is calculated, the usage mode of the electronic whiteboard is switched according to the usage scenario, and corresponding function guide prompts are pushed based on the usage mode.

[0009] Furthermore, the scene image contains depth data, and the method for analyzing the scene image includes:

[0010] The depth data corresponding to the specified key points in the scene image is extracted. Based on the depth data of different key points, it is determined whether there is a person in front of the electronic whiteboard. The human body and the background in the image are separated by grayscale analysis to obtain the human body image and the background image.

[0011] Furthermore, the image features include identity information and environmental information; the method for obtaining the image features includes:

[0012] The facial features of the person's image are extracted, and the facial features are compared with the personnel features pre-stored in the database to identify the identity information corresponding to the face;

[0013] The environmental features of the background image are extracted, and the environment in which the user is located is identified based on the environmental features to obtain the environmental information.

[0014] Furthermore, the electronic whiteboard can be used in various scenarios, including indoor, outdoor, teaching, and meeting settings.

[0015] Furthermore, the method for inferring the user's current usage scenario when using the electronic whiteboard based on the image features is as follows:

[0016] Based on the identity information, the job title matched to the user located directly in front of the electronic whiteboard is determined, and the usage scenario is directly determined to be a teaching scenario or a meeting scenario based on the user's job title; and / or,

[0017] The user's environment is determined to be indoors or outdoors based on the environmental information, and the usage scenario is determined to be an indoor scenario or an outdoor scenario directly based on the indoor and outdoor environment.

[0018] Furthermore, the different usage modes of the electronic whiteboard are pre-configured with corresponding brightness and binding software; when the usage mode of the electronic whiteboard is switched according to the usage scenario, the electronic whiteboard automatically adjusts its brightness and / or the corresponding binding software is pre-loaded in the background.

[0019] Furthermore, the method for pushing the aforementioned function wizard prompts is as follows:

[0020] Pre-generate corresponding wizard prompts for each bound software configured in the usage mode;

[0021] In response to touch commands, the system identifies the currently launched software and determines whether it is a pre-configured bundled software. If so, it retrieves and displays the wizard prompts corresponding to the currently launched software.

[0022] Furthermore, an electronic whiteboard display system that automatically adapts to different scenarios is also provided, performing the electronic whiteboard display method that automatically adapts to different scenarios as described above; the system includes:

[0023] The image acquisition module is used to activate the camera of the electronic whiteboard when the electronic whiteboard is powered on, and to acquire the scene image facing the electronic whiteboard based on the camera.

[0024] An image analysis module is used to analyze the scene image to obtain image features;

[0025] The scene switching module calculates the current usage scenario of the user when using the electronic whiteboard based on the image features, and switches the usage mode of the electronic whiteboard according to the usage scenario.

[0026] The wizard prompt module pushes corresponding function wizard prompts based on the usage mode.

[0027] Furthermore, an electronic device is also provided, which includes a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the electronic whiteboard display method that automatically adapts to the scenario as described above.

[0028] Furthermore, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed, implements the above-described method for automatically adapting to different scenarios in electronic whiteboard display.

[0029] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0030] This invention analyzes scene images captured by a camera to identify the user's identity and the surrounding environment when using the electronic whiteboard. The electronic whiteboard automatically switches to a matching usage mode based on the features in the image, reducing the steps required for users to switch manually. This allows users to immediately switch to the appropriate mode and use the appropriate software after the electronic whiteboard is started, improving the user experience. Attached Figure Description

[0031] Figure 1 This is a flowchart illustrating the electronic whiteboard display method for automatically adapting to different scenarios according to the present invention.

[0032] Figure 2 This is a schematic diagram of the electronic whiteboard display system that automatically adapts to different scenarios according to the present invention. Detailed Implementation

[0033] The present invention will now be further described in conjunction with the accompanying drawings and specific embodiments. It should be noted that, without conflict, the various embodiments or technical features described below can be arbitrarily combined to form new embodiments.

[0034] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0035] It should be noted that the use of terms such as "first" and "second" in this application is for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of those features. Furthermore, the technical solutions of the various embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. If the combination of technical solutions is contradictory or impossible to implement, such a combination of technical solutions should be considered non-existent and not within the scope of protection claimed in this application.

[0036] Example 1

[0037] This embodiment provides an electronic whiteboard display method that automatically adapts to different scenarios. The electronic whiteboard can be set on a mobile stand, and users can move the electronic whiteboard to indoor or outdoor environments according to actual needs. The electronic whiteboard can also be applied to classrooms or offices to meet the usage needs of different scenarios.

[0038] like Figure 1 As shown, the electronic whiteboard display method that automatically adapts to the scene specifically includes the following steps:

[0039] Step S1: After the electronic whiteboard is powered on, the camera of the electronic whiteboard is activated, the scene image facing the electronic whiteboard is captured by the camera, and the scene image is analyzed to obtain image features;

[0040] Step S2: Based on the image features, calculate the user's current usage scenario when using the electronic whiteboard, switch the usage mode of the electronic whiteboard according to the usage scenario, and push corresponding function wizard prompts based on the usage mode.

[0041] The interactive whiteboard starts up after being powered on, simultaneously activating the camera on it. The camera can then immediately capture the image in front of the whiteboard. The user can stand directly in front of the whiteboard, facing the camera; in this case, the camera will capture the user and the environment behind them as a background image. Alternatively, the user can stand away from the whiteboard; in this case, the camera will only capture the scene in front of the whiteboard, creating a scene image.

[0042] To facilitate subsequent image analysis, the camera can be configured as a depth camera, capturing not only planar images but also depth information of the subject. Based on this depth information, the scene image can be analyzed to accurately separate the person and the background behind them. Specifically, the scene image contains depth data. Depth data corresponding to specified key points in the scene image is extracted. The positions of these key points can be pre-defined, such as around the edges and at the center of the image. The depth data corresponding to each key point is used to determine whether there is a person in front of the background. If the depth data of each key point is inconsistent and the difference exceeds the error range, it means there is an object in front of the background. If the depth data of each key point is within a certain error range or the depth data is consistent, it means there is no object in front of the background.

[0043] Subsequently, the scene image is processed in grayscale to distinguish between the background and the object and to outline the object's contour. Based on the object's contour, it is determined whether the object in front of the background is a human body. If a human body is present, grayscale analysis is used to separate the human body from the background in the image to obtain the human body image and the background image.

[0044] If a person image is present in the scene image, the facial features of the person image are extracted, and the facial features are compared with the personnel features pre-stored in the database to identify the identity information corresponding to the face. The identity information includes information such as the person's name, age, and occupation.

[0045] In addition, the background image can be directly analyzed to extract its environmental features. Based on these features, the user's environment can be identified to obtain environmental information, including ambient brightness, background object types, etc. Combining ambient brightness and background object types, it can be determined whether the electronic whiteboard is currently in an indoor or outdoor environment. Furthermore, it can be determined whether the user is currently in a classroom or office environment based on the background object types.

[0046] Based on the above analysis of the scene image, identity information and / or environmental information can be obtained from the content of the scene image. This information records image features, and based on the image features, the user's current usage scenario when using the electronic whiteboard can be deduced, thereby switching the usage mode of the electronic whiteboard according to the usage scenario.

[0047] The method for inferring the user's current usage scenario when using the electronic whiteboard based on the aforementioned image features is as follows:

[0048] Based on the identity information, the job title matched to the user located directly in front of the electronic whiteboard is determined, and the usage scenario is directly determined to be a teaching scenario or a meeting scenario based on the user's job title; and / or,

[0049] The user's environment is determined to be indoors or outdoors based on the environmental information, and the usage scenario is determined to be an indoor scenario or an outdoor scenario directly based on the indoor and outdoor environment.

[0050] For example, if a person's job title is determined based on their identity information, and their job title is "teacher," then it can be inferred that the usage scenario is a teaching scenario; if a person's job title is determined based on their identity information, then it can be inferred that the usage scenario is a meeting scenario.

[0051] Alternatively, by combining the features of the background image, we can determine whether the environment in which the electronic whiteboard is located is indoors or outdoors. If we identify the presence of a blackboard or desks and chairs in the background image, we can infer that the usage scenario is an indoor teaching scenario; if we identify the presence of outdoor objects such as trees in the background, we can infer that the usage scenario is an outdoor scenario.

[0052] The electronic whiteboard is used in various scenarios, including indoor, outdoor, teaching, and meeting environments. Different usage modes are pre-configured with corresponding brightness parameters, and each mode is also pre-bound with corresponding software programs. When the electronic whiteboard switches to the corresponding usage mode based on the scenario, it automatically adjusts the screen brightness according to the pre-configured brightness parameters and / or pre-loads the pre-bound software programs in the background, allowing users to directly access the software interface after opening the software on the electronic whiteboard, thus shortening the software loading time.

[0053] Users can also modify the parameters of the automatically predicted usage scenarios to meet their actual usage needs.

[0054] Furthermore, if a user is using the electronic whiteboard for the first time, or is using a particular software for the first time, the user can be guided through the function wizard prompts. Specifically, corresponding wizard prompts are generated in advance for each bound software configured in the usage mode, or corresponding wizard prompts are generated in advance for the first startup of the electronic whiteboard. When the electronic whiteboard receives a touch command and recognizes the software currently launched by the user, it determines whether the currently launched software is a pre-configured bound software. If so, the wizard prompts corresponding to the currently launched software are retrieved and displayed. Alternatively, when the electronic whiteboard is powered on for the first time and enters the system's main page, the wizard prompts corresponding to the first startup of the system can also be automatically retrieved and displayed, allowing the user to quickly become familiar with the electronic whiteboard's functions.

[0055] Example 2

[0056] This embodiment provides an electronic whiteboard display system that automatically adapts to different scenarios, executing the electronic whiteboard display method for automatically adapting to different scenarios as described in Embodiment 1; Figure 2 As shown, the system includes:

[0057] The image acquisition module is used to activate the camera of the electronic whiteboard when the electronic whiteboard is powered on, and to acquire the scene image facing the electronic whiteboard based on the camera.

[0058] An image analysis module is used to analyze the scene image to obtain image features;

[0059] The scene switching module calculates the current usage scenario of the user when using the electronic whiteboard based on the image features, and switches the usage mode of the electronic whiteboard according to the usage scenario.

[0060] The wizard prompt module pushes corresponding function wizard prompts based on the usage mode.

[0061] This invention analyzes scene images captured by a camera to identify the user's identity and the surrounding environment when using the electronic whiteboard. The electronic whiteboard automatically switches to a matching usage mode based on the features in the image, reducing the steps required for users to switch manually. This allows users to immediately switch to the appropriate mode and use the appropriate software after the electronic whiteboard is started, improving the user experience.

[0062] In some embodiments, an electronic device is also provided, which includes a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the electronic whiteboard display method for automatically adapting to the scene in Embodiment 1.

[0063] In addition, a storage medium is provided on which a computer program is stored, which, when executed, implements the above-described method for automatically adapting to different scenarios in electronic whiteboard display.

[0064] The systems, devices, and storage media described above are based on multiple aspects of the same inventive concept as the methods in the foregoing embodiments. The implementation process of the methods has been described in detail above, so those skilled in the art can clearly understand the structure and implementation process of the systems, devices, and storage media in this embodiment based on the foregoing description. For the sake of brevity, they will not be described again here.

[0065] The above embodiments are merely preferred embodiments of the present invention and should not be construed as limiting the scope of protection of the present invention. Any non-substantial changes and substitutions made by those skilled in the art based on the present invention shall fall within the scope of protection claimed by the present invention.

Claims

1. A method for displaying an electronic whiteboard that automatically adapts to different scenarios, characterized in that, include: When the interactive whiteboard is powered on, its camera is activated. The camera captures an image of the scene directly in front of the whiteboard, and the image is analyzed to obtain image features. This includes: extracting depth data corresponding to specified key points in the scene image; determining whether there is a person directly in front of the whiteboard based on the depth data of different key points; separating the human body from the background in the image through grayscale analysis to obtain a person image and a background image; extracting facial features from the person image; comparing the facial features with pre-stored personnel features in a database to identify the identity information corresponding to the face; and extracting environmental features from the background image to identify the user's environment based on these environmental features to obtain environmental information. Based on the image features, the usage scenario of the user when using the electronic whiteboard is inferred, including: determining the job position matched by the user located directly in front of the electronic whiteboard according to the identity information, and directly determining the usage scenario as a teaching scenario or a meeting scenario based on the user's job position; and / or, determining whether the user's environment is indoors or outdoors according to the environmental information, and directly determining the usage scenario as an indoor scenario or an outdoor scenario based on the indoor or outdoor environment. The usage mode of the electronic whiteboard is switched according to the usage scenario, and corresponding function wizard prompts are pushed based on the usage mode.

2. The electronic whiteboard display method for automatically adapting to different scenarios according to claim 1, characterized in that, The electronic whiteboard can be used in indoor, outdoor, teaching, and meeting settings.

3. The electronic whiteboard display method for automatically adapting to different scenarios according to claim 1, characterized in that, The different usage modes of the electronic whiteboard are pre-configured with corresponding brightness and binding software; when the usage mode of the electronic whiteboard is switched according to the usage scenario, the electronic whiteboard automatically adjusts its brightness and / or the corresponding binding software is pre-loaded in the background.

4. The electronic whiteboard display method for automatically adapting to different scenarios according to claim 3, characterized in that, The method for pushing the aforementioned function wizard prompts is as follows: Pre-generate corresponding wizard prompts for each bound software configured in the usage mode; In response to touch commands, the system identifies the currently launched software and determines whether it is a pre-configured bundled software. If so, it retrieves and displays the wizard prompts corresponding to the currently launched software.

5. An electronic whiteboard display system that automatically adapts to different scenarios, characterized in that, The system implements the electronic whiteboard display method for automatically adapting to the scene as described in any one of claims 1 to 4; the system includes: The image acquisition module is used to activate the camera of the electronic whiteboard when the electronic whiteboard is powered on, and to acquire the scene image facing the electronic whiteboard based on the camera. An image analysis module is used to analyze the scene image to obtain image features; The scene switching module calculates the current usage scenario of the user when using the electronic whiteboard based on the image features, and switches the usage mode of the electronic whiteboard according to the usage scenario. The wizard prompt module pushes corresponding function wizard prompts based on the usage mode.

6. An electronic device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the electronic whiteboard display method for automatically adapting to the scene as described in any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that, It stores a computer program, which, when executed, implements the electronic whiteboard display method for automatically adapting to any one of claims 1 to 4.

Images