Display device and display method for drawing patterns in electronic whiteboard

Abstract

The invention provides a display device and a method for displaying a drawn pattern in an electronic whiteboard. The method comprises the following steps: acquiring a screen boundary of the rotated electronic whiteboard and a drawn pattern boundary corresponding to the drawn pattern in the electronic whiteboard; comparing the pattern width of the drawn pattern boundary with the screen width of the screen boundary and comparing the pattern height of the drawn pattern boundary with the screen height of the screen boundary under the condition that the drawn pattern part falls outside the screen boundary range; when the pattern width is smaller than or equal to the screen width and the pattern height is smaller than or equal to the screen height, executing translation processing on the drawn pattern; and when the pattern width is greater than the screen width and / or the pattern height is greater than the screen height, performing zooming processing on the drawn pattern, and performing translation processing on the drawn pattern after zooming processing. According to the method, all the drawn patterns after the electronic whiteboard is rotated fall into the screen range, and the problem that the drawn patterns are not completely displayed after the electronic whiteboard is rotated is solved.

Description

Technical Field

[0001] This application relates to the technical field of display devices, and in particular, to a display device and a method for displaying a drawn pattern in an electronic whiteboard. Background Art

[0002] In addition to playing media such as audio and video, display devices can also be applied to scenarios such as meetings, teaching, and remote collaboration. For example, a mobile smart screen is an intelligent display device integrating multiple functions and can be applied to various meeting and exhibition scenarios. The mobile smart screen can be equipped with an electronic whiteboard (Meeting Board), and the electronic whiteboard function allows users to write, draw, and display content on the screen, enabling it to replace traditional physical whiteboards. The electronic whiteboard can act as a meeting board, a drawing board, a recording board, and other roles, providing users with a convenient display method.

[0003] The electronic whiteboard function in a display device has the ability to rotate the screen, that is, users can switch the screen from landscape mode to portrait mode or from portrait mode to landscape mode according to actual needs to meet the requirements of different usage scenarios. During the screen rotation, the content of the electronic whiteboard will undergo coordinate conversion to ensure that the drawn pattern drawn by the user always remains upright, thus providing users with a more intuitive visual experience.

[0004] However, there are certain limitations during the rotation of the electronic whiteboard. For example, taking the rotation from landscape mode to portrait mode as an example, only the content of the left half of the original landscape screen is displayed within the screen range, and the content that could originally be displayed on the right half of the landscape screen will become invisible after rotating to portrait. Similarly, when the electronic whiteboard rotates from portrait mode to landscape mode, a similar problem will occur, that is, only the content of the upper half of the portrait screen before rotation is displayed on the rotated screen, and the content of the lower half will become invisible after rotation. Therefore, there is a problem that the drawn pattern is not completely displayed after the rotation of the electronic whiteboard in the display device, and users need to manually adjust to make the drawn pattern completely displayed on the screen, which affects the user experience. Summary of the Invention

[0005] Some embodiments of this application provide a display device and a method for displaying a drawn pattern in an electronic whiteboard to solve the problem that the drawn pattern is not completely displayed after the rotation of the electronic whiteboard in the display device.

[0006] In a first aspect, some embodiments of this application provide a display device, including:

[0007] A display configured to display a user interface;

[0008] A controller configured to:

[0009] Obtain the screen boundary of the rotated electronic whiteboard and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard; the drawing pattern boundary is the boundary formed by the minimum circumscribed rectangle of the drawing pattern;

[0010] When a part of the drawing pattern falls outside the range of the screen boundary, compare the pattern width of the drawing pattern boundary with the screen width of the screen boundary, and compare the pattern height of the drawing pattern boundary with the screen height of the screen boundary;

[0011] When the pattern width is less than or equal to the screen width and the pattern height is less than or equal to the screen height, perform a translation process on the drawing pattern so that the translated drawing pattern completely falls within the range of the screen boundary;

[0012] When the pattern width is greater than the screen width and / or the pattern height is greater than the screen height, perform a scaling process on the drawing pattern, and perform a translation process on the scaled drawing pattern so that the scaled and translated drawing pattern completely falls within the range of the screen boundary.

[0013] The above technical solution has the following advantages or beneficial effects: By detecting the screen boundary after rotation and the boundary of the drawing pattern, the display device, according to the relative size relationship between the drawing pattern and the screen boundary, when a part of the drawing pattern falls outside the range of the screen boundary, adopts the method of translation and / or scaling to adjust the drawing pattern to the visible range of the screen, thereby ensuring the complete display of the drawing pattern within the screen range and solving the problem that the drawing pattern is not completely displayed after the electronic whiteboard in the display device is rotated.

[0014] In some embodiments, the controller performs a translation process on the drawing pattern, and is specifically configured to:

[0015] Perform a subtraction operation on the abscissa of the first pixel point of the drawing pattern and the screen width value corresponding to the screen width, and / or perform a subtraction operation on the ordinate of the second pixel point of the drawing pattern and the screen height value corresponding to the screen height to obtain the relative translation value of the drawing pattern; the abscissa of the first pixel point is the maximum abscissa of the drawing pattern; the ordinate of the second pixel point is the maximum ordinate of the drawing pattern;

[0016] Obtain the coordinate values of the drawing pattern in the rotated electronic whiteboard;

[0017] Perform a subtraction operation on the coordinate values of the drawing pattern and the relative translation value to obtain the translated coordinate values of the drawing pattern;

[0018] Control the display to output the drawn pattern in the rotated electronic whiteboard according to the translated coordinate values.

[0019] The above technical solution has the following advantages or beneficial effects: Based on the calculated relative translation value and the coordinate values of the drawn pattern, the display device can perform a translation process on the drawn pattern to ensure that the drawn pattern after the translation process completely falls within the screen range. In this way, no matter how the electronic whiteboard rotates, the display device can ensure that the drawn pattern is always within the visible area and there will be no misalignment or occlusion.

[0020] In some embodiments, the controller performs a scaling process on the drawn pattern and, moreover, performs a translation process on the drawn pattern after the scaling process, and is specifically configured to:

[0021] Perform a division operation on the screen width and the pattern width, and / or perform a division operation on the screen height and the pattern height to obtain the scaling ratio of the drawn pattern;

[0022] Obtain the coordinate values of the drawn pattern in the rotated electronic whiteboard;

[0023] Perform a multiplication operation on the coordinate values and the scaling ratio to obtain the scaled coordinates of the drawn pattern after the scaling;

[0024] Calculate the relative translation value of the drawn pattern based on the scaled coordinates;

[0025] Perform a subtraction operation on the scaled coordinates and the relative translation value to obtain the translated coordinate values of the drawn pattern;

[0026] Control the display to output the drawn pattern in the rotated electronic whiteboard according to the translated coordinate values.

[0027] The above technical solution has the following advantages or beneficial effects: In the case where the size of the drawn pattern exceeds the screen size, by performing a scaling and translation process on the drawn pattern, the final drawn pattern can completely fall within the screen range, solving the problem that the drawn pattern is not completely displayed after the electronic whiteboard in the display device rotates. By performing a subtraction operation on the scaled coordinates and the relative translation value, the final coordinates for the output of the drawn pattern can be obtained. When the size of the drawn pattern is larger than the screen size, through the scaling and translation processes, the drawn pattern can be effectively adjusted to the visible area of the screen, ensuring the integrity and visibility of the drawn pattern.

[0028] In some embodiments, before the step of the controller obtaining the screen boundary of the rotated electronic whiteboard and the drawn pattern boundary corresponding to the drawn pattern in the electronic whiteboard, it is further configured to:

[0029] In response to the startup instruction of the electronic whiteboard, monitor the angular change of the gyroscope;

[0030] When it is detected that the angle has changed, identify the first pixel point, the second pixel point, the third pixel point, and the fourth pixel point of the drawing pattern in the electronic whiteboard; the drawing pattern is a pattern drawn in response to a drawing instruction of a user on the electronic whiteboard; the abscissa of the first pixel point is the maximum abscissa of the drawing pattern; the ordinate of the second pixel point is the maximum ordinate of the drawing pattern; the abscissa of the third pixel point is the minimum abscissa of the drawing pattern; the ordinate of the fourth pixel point is the minimum ordinate of the drawing pattern;

[0031] When it is detected that the angle stops changing, identify the rotated coordinate system of the electronic whiteboard;

[0032] Control the display to display the drawing pattern in the rotated coordinate system; in the rotated coordinate system, the screen width of the electronic whiteboard is equal to the screen height of the electronic whiteboard before rotation, and the screen height of the electronic whiteboard is equal to the screen width of the electronic whiteboard before rotation.

[0033] The above technical solution has the following advantages or beneficial effects: By monitoring the angular change of the gyroscope, the display device can enable the drawing pattern to be correctly displayed on the screen. No matter how the electronic whiteboard rotates, the electronic whiteboard always presents a positive drawing pattern to the user, ensuring that the drawing pattern will not be distorted or misaligned.

[0034] In some embodiments, the controller obtains the screen boundary of the rotated electronic whiteboard and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard, and is specifically configured as:

[0035] Identify the rotated coordinate system corresponding to the rotation of the electronic whiteboard;

[0036] Based on the rotated coordinate system, identify the screen boundary of the electronic whiteboard;

[0037] Generate the minimum bounding rectangle of the drawing pattern based on the first pixel point, the second pixel point, the third pixel point, and the fourth pixel point;

[0038] Obtain the drawing pattern boundary corresponding to the drawing pattern according to the minimum bounding rectangle.

[0039] The above technical solution has the following advantages or beneficial effects: By obtaining the screen boundary of the rotated electronic whiteboard and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard, the display device can provide a data basis for subsequent judgment of the drawing pattern and the screen range, and execute different strategies for the drawing pattern according to different situations.

[0040] In some embodiments, before the step of the controller listening for the angular change of the gyroscope, the controller is further configured to:

[0041] In response to the start instruction, based on the initial coordinate system corresponding to the electronic whiteboard before rotation, identify the initial coordinate list of the drawing pattern drawn by the user; the initial coordinate list is a coordinate list formed by the point coordinates of multiple points included in the drawing pattern;

[0042] Mark the point with the largest abscissa in the initial coordinate list as the first pixel point;

[0043] Mark the point with the largest ordinate in the initial coordinate list as the second pixel point;

[0044] Mark the point with the smallest abscissa in the initial coordinate list as the third pixel point;

[0045] Mark the point with the smallest ordinate in the initial coordinate list as the fourth pixel point.

[0046] The above technical solution has the following advantages or beneficial effects: By determining the pixel points before rotation, it is possible to avoid recalculating the boundaries of the entire drawing pattern after rotation, thereby simplifying the processing process. By accurately marking the four pixel points, the drawing pattern can be correctly displayed and aligned after rotation, improving the accuracy of the drawing pattern display.

[0047] In some embodiments, before the step of the controller obtaining the screen boundary of the electronic whiteboard after rotation and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard, the controller is further configured to:

[0048] In the case where the value of the abscissa of the first pixel point is less than or equal to the screen width and the value of the ordinate of the second pixel point is less than or equal to the screen height, determine that the entire drawing pattern falls within the screen boundary range;

[0049] In the case where the value of the abscissa of the first pixel point is greater than the screen width and / or the value of the ordinate of the second pixel point is greater than the screen height, determine that part of the drawing pattern falls outside the screen boundary range.

[0050] The above technical solution has the following advantages or beneficial effects: By comparing the pixel point coordinates of the drawing pattern with the screen size, the display device can quickly determine whether the drawing pattern fits the current screen, so as to take corresponding measures, such as whether scaling, translation or other adjustments are needed to ensure the best display effect.

[0051] In some embodiments, after the step of the controller determining that the entire drawing pattern falls within the screen boundary range, the controller is further configured to:

[0052] Control the coordinate list of the drawn pattern after rotating the electronic whiteboard to be equal to the initial coordinate list of the drawn pattern before the rotation of the electronic whiteboard;

[0053] Control the display to output the drawn pattern in the rotated electronic whiteboard according to the initial coordinate list.

[0054] The above technical solution has the following advantages or beneficial effects: The display device will control the display to output the drawn pattern in the rotated electronic whiteboard according to the initial coordinate list, ensuring that the drawn pattern is correctly output on the rotated screen without misalignment or deformation. At the same time, since the coordinates of the drawn pattern remain unchanged, the display device does not need to perform complex coordinate conversion or recalculation, thereby reducing the consumption of computing resources.

[0055] In some embodiments, before the step of comparing the pattern width of the drawn pattern boundary with the screen width of the screen boundary and comparing the pattern height of the drawn pattern boundary with the screen height of the screen boundary, the controller is further configured to:

[0056] Perform a subtraction operation on the abscissa of the first pixel point and the abscissa of the third pixel point to obtain the pattern width of the drawn pattern boundary;

[0057] Perform a subtraction operation on the ordinate of the second pixel point and the ordinate of the fourth pixel point to obtain the pattern height of the drawn pattern boundary.

[0058] The above technical solution has the following advantages or beneficial effects: The display device can determine the spatial size occupied by the drawn pattern on the electronic whiteboard by calculating the pattern width and pattern height of the drawn pattern boundary, providing a data basis for the subsequent display and adjustment of the drawn pattern.

[0059] In a second aspect, some embodiments of the present application provide a method for displaying a drawn pattern in an electronic whiteboard, which can be applied to the display device in the first aspect. The display device includes a display and a controller. The method includes:

[0060] Obtain the screen boundary of the rotated electronic whiteboard and the drawn pattern boundary corresponding to the drawn pattern in the electronic whiteboard; the drawn pattern boundary is the boundary formed by the minimum circumscribed rectangle of the drawn pattern;

[0061] In the case where a part of the drawn pattern falls outside the screen boundary range, compare the pattern width of the drawn pattern boundary with the screen width of the screen boundary and compare the pattern height of the drawn pattern boundary with the screen height of the screen boundary;

[0062] When the width of the pattern is less than or equal to the width of the screen and the height of the pattern is less than or equal to the height of the screen, perform a translation process on the drawn pattern so that the drawn pattern after the translation process completely falls within the screen boundary range;

[0063] When the width of the pattern is greater than the width of the screen and / or the height of the pattern is greater than the height of the screen, perform a scaling process on the drawn pattern, and perform a translation process on the drawn pattern after the scaling process so that the drawn pattern after the scaling and translation processes completely falls within the screen boundary range.

[0064] The above technical solution has the following advantages or beneficial effects: By detecting the screen boundary after rotation and the boundary of the drawn pattern, according to the relative size relationship between the drawn pattern and the screen boundary, when part of the drawn pattern falls outside the screen boundary range, adopt translation and / or scaling methods to adjust the drawn pattern to the visible range of the screen, so as to ensure the complete display of the drawn pattern within the screen range, and solve the problem that the drawn pattern is not completely displayed after the electronic whiteboard in the display device rotates.

[0065] As can be seen from the above technical solution, some embodiments of the present application provide a display device and a method for displaying a drawn pattern in an electronic whiteboard. The method includes: obtaining the screen boundary of the electronic whiteboard after rotation and the drawn pattern boundary corresponding to the drawn pattern in the electronic whiteboard; the drawn pattern boundary is the boundary formed by the minimum circumscribed rectangle of the drawn pattern; when part of the drawn pattern falls outside the screen boundary range, compare the pattern width of the drawn pattern boundary with the screen width of the screen boundary, and compare the pattern height of the drawn pattern boundary with the screen height of the screen boundary; when the pattern width is less than or equal to the screen width and the pattern height is less than or equal to the screen height, perform a translation process on the drawn pattern so that the drawn pattern after the translation process completely falls within the screen boundary range; when the pattern width is greater than the screen width and / or the pattern height is greater than the screen height, perform a scaling process on the drawn pattern, and perform a translation process on the drawn pattern after the scaling process so that the drawn pattern after the scaling and translation processes completely falls within the screen boundary range. The method comprehensively considers the display method of the drawn pattern after rotation from multiple dimensions such as the position where the user draws in the electronic whiteboard, the size of the drawn pattern, and the screen size, so that after the electronic whiteboard rotates, the drawn pattern can completely fall within the screen boundary range, and solves the problem that the drawn pattern is not completely displayed after the electronic whiteboard in the display device rotates. Description of the Drawings

[0066] To more clearly illustrate the technical solutions in some embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0067] Figure 1 Schematic diagram of an operation scenario between a display device and a control device provided for some embodiments of the present application;

[0068] Figure 2 Schematic diagram of the hardware configuration of a display device provided for some embodiments of the present application;

[0069] Figure 3 Schematic diagram of the software configuration of a display device provided for some embodiments of the present application;

[0070] Figure 4 Schematic diagram of the rotation scenario of an electronic whiteboard shown in the present application;

[0071] Figure 5 Schematic diagram of the scenario where the electronic whiteboard shown in the present application rotates from the landscape mode to the portrait mode;

[0072] Figure 6 Schematic diagram of the scenario where the electronic whiteboard shown in the present application rotates from the portrait mode to the landscape mode;

[0073] Figure 7 Schematic diagram of the flow of the display method for drawing patterns on the electronic whiteboard executed by a display device provided for some embodiments of the present application;

[0074] Figure 8 Schematic diagram of the scenario between the screen boundary and the drawing pattern boundary of an electronic whiteboard provided for some embodiments of the present application;

[0075] Figure 9 Schematic diagram of the scenario of four pixel points of a drawn pattern provided for some embodiments of the present application;

[0076] Figure 10 Schematic diagram of the positional relationship scenario between a drawn pattern and the screen boundary provided for some embodiments of the present application;

[0077] Figure 11 Schematic diagram of a scenario where a display device performs translation on a drawn pattern provided for some embodiments of the present application;

[0078] Figure 12 Schematic diagram of another scenario where a display device performs translation on a drawn pattern provided for some embodiments of the present application;

[0079] Figure 13Another schematic diagram of the translation of a drawn pattern by a display device provided in some embodiments of the present application;

[0080] Figure 14 A schematic diagram of a scenario where a display device provided in some embodiments of the present application scales a drawn pattern;

[0081] Figure 15 Another schematic diagram of a scenario where a display device provided in some embodiments of the present application scales a drawn pattern;

[0082] Figure 16 Another schematic diagram of a scenario where a display device provided in some embodiments of the present application scales a drawn pattern;

[0083] Figure 17 A timing schematic diagram of a display method for a drawn pattern in an electronic whiteboard executed by a display device provided in some embodiments of the present application. Detailed implementation manners

[0084] The embodiments will be described in detail below, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0085] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the following described implementation manners, rather than intending to limit the implementation manners of the present application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.

[0086] The terms "first", "second", "third", etc. in the specification, claims and the above drawings of the present application are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0087] The terms "comprising" and "having" and any variations thereof are intended to cover but not exclude inclusion. For example, a product or device comprising a series of components does not necessarily have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0088] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code that can perform functions related to the element.

[0089] In the embodiments of the present application, the display device 200 generally refers to a device with the capabilities of screen display and data processing. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0090] Figure 1 It is a schematic diagram of the operation scenario between the display device and the control device provided by some embodiments of the present application. As Figure 1 shown, the user can operate the display device 200 through touch operations, the mobile terminal 300, and the control device 100. Among them, the control device 100 is used to receive the operation instructions input by the user and convert the operation instructions into control instructions that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0091] The mobile terminal 300 can be used as a control device to perform the human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device to establish a communication connection with the display device 200 for data interaction. In some embodiments, software applications can be installed on the mobile terminal 300 and the display device 200, and they can be connected and communicate through network communication protocols to achieve the purpose of one-to-one control operations and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0092] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running the application program for controlling the display device 200.

[0093] As Figure 1 also shown, the display device 200 also communicates with the server 400 for data communication through various communication methods. The display device 200 is allowed to establish a communication connection through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0094] The display device 200 can provide a broadcast receiving TV function, and can also additionally provide a smart network TV function with computer support functions, including but not limited to, network TV, smart TV, Internet Protocol TV (IPTV), etc.

[0095] Figure 2 Provided by some embodiments of the present application Figure 1 is the hardware configuration block diagram of the display device 200 in

[0096] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0097] In some embodiments, the detector 230 is configured to collect signals of an external environment or for external interaction. For example, the detector 230 includes a light receiver, which is a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect an external environment scene, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0098] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is configured to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.

[0099] In some embodiments, the communication device 220 is a component for communicating with an external device or a server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0100] The communication device 220 can enable the display device 200 to communicate with an external device or a server 400 in a wireless or wired connection manner. Among them, the wired connection can connect the display device 200 with an external device through components such as a data cable and an interface. The wireless connection can connect the display device 200 with an external device through a wireless signal or a wireless network. The display device 200 can directly establish a connection relationship with an external device or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0101] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and first to n interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0102] In some embodiments, the controller 250 and the tuner demodulator 210 may be located in different split devices, that is, the tuner demodulator 210 may also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0103] In some embodiments, the user may input a user command in the graphical user interface (GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).

[0104] In some embodiments, the audio output device 270 may be the built-in speaker of the display device 200, or may be an external audio output device connected to the display device 200. Among them, for the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0105] In some embodiments, the user input interface 280 can be used to receive instructions from the user input.

[0106] To perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0107] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0108] The operating system can be divided into different modules or levels according to the functions implemented. For example, as Figure 3 shown, in some embodiments, the system is divided into four layers, from top to bottom are the application layer (abbreviation "application layer"), the application framework layer (abbreviation "framework layer"), the system library layer, and the kernel layer.

[0109] In some embodiments, the application layer is used to provide services and interfaces for applications, so that the display device 200 can run the applications and interact with users based on the applications. At least one application can run in the application layer. These applications can be window programs, system setting programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0110] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions of the applications in the application layer. Through the API interface, applications can access the resources in the system and obtain the services of the system during execution.

[0111] As Figure 3 shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc. Among them, the view system can design and implement the interfaces and interactions of applications. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The activity manager is used to interact with all the activities running in the system; the location manager is used to provide access to the system location service for system services or applications; the package manager is used to retrieve various information related to the application packages currently installed on the device; the notification manager is used to control the display and clearing of notification messages; the window manager is used to manage the icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0112] In some embodiments, the activity manager is used to manage the life cycles of various applications and the general navigation back function, such as controlling the exit, opening, and backward movement of applications. The window manager is used to manage all window programs, such as obtaining the size of the display screen, determining whether there is a status bar, locking the screen, taking screenshots, and controlling the changes of the display window. For example, shrinking the display window, jittering the display, and distorting the display.

[0113] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library included in the system runtime library layer, such as the C / C++ instruction library, to implement the functions that the framework layer is intended to achieve.

[0114] In some embodiments, the kernel layer is a functional level between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 3 shown, hardware drivers can be configured in the kernel layer, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0115] It should be noted that the above examples are only a simple division of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. Depending on factors such as the functions of the display device and the type of the operating system, the number of levels included in the operating system and the specific level types can be in other forms.

[0116] In some embodiments, in addition to playing media resources such as audio and video, the display device 200 can also be applied to scenarios such as meetings, teaching, and remote collaboration. Exemplarily, the mobile smart screen is an intelligent display device integrating multiple functions and can be applied to various meeting and exhibition scenarios. The mobile smart screen can be equipped with an electronic whiteboard (MeetingBoard), and the electronic whiteboard function allows users to write, draw, and display content on the screen, so that it can replace the traditional physical whiteboard. For example, the electronic whiteboard can act as multiple roles such as a meeting board, a drawing board, and a recording board, providing a convenient display method for users.

[0117] In some embodiments, the electronic whiteboard function in the display device 200 has the ability to rotate the screen, that is, the user can switch the screen from the landscape mode to the portrait mode, or from the portrait mode to the landscape mode according to actual needs to meet the requirements of different usage scenarios. During the screen rotation process, the content of the electronic whiteboard will perform coordinate conversion accordingly to ensure that the drawn patterns by the user always maintain a positive display, thus providing a more intuitive visual experience for the user.

[0118] However, there are certain limitations during the rotation of the electronic whiteboard. Figure 4 For the schematic diagram of the rotation scenario of the electronic whiteboard shown in this application, as Figure 4As shown, in some embodiments, when the electronic whiteboard rotates from the landscape mode to the portrait mode, or from the portrait mode to the landscape mode (not shown), the existing processing program simply performs coordinate conversion with the upper left corner as the origin, which results in only a part of the pattern drawn by the user being displayed within the rotated electronic whiteboard screen range. For example, taking the rotation from the landscape mode to the portrait mode as an example, only the left half of the original landscape screen is displayed within the screen range, and the content that could originally be displayed in the right half of the landscape becomes invisible after rotation to the portrait mode.

[0119] Exemplarily, Figure 5 FIG. is a schematic diagram of the scenario where the electronic whiteboard shown in the present application rotates from the landscape mode to the portrait mode. As Figure 5 shown, when the electronic whiteboard is in the landscape mode, the drawn pattern displayed within the screen range is 123456. When rotated to the portrait mode, only 1234 is displayed, and the originally visible 56 in the landscape becomes invisible, that is, the content in the right half of the landscape becomes invisible after rotation to the portrait mode.

[0120] Similarly, when the electronic whiteboard rotates from the portrait mode to the landscape mode, a similar problem will occur, that is, only the upper half of the original portrait screen is displayed on the rotated screen, and the content in the lower half becomes invisible after rotation.

[0121] Exemplarily, Figure 6 FIG. is a schematic diagram of the scenario where the electronic whiteboard shown in the present application rotates from the portrait mode to the landscape mode. As Figure 6 shown, when the electronic whiteboard is in the portrait mode, the drawn pattern displayed within the screen range is 123456. When rotated to the landscape mode, only 1234 is displayed, and the originally visible 56 in the portrait becomes invisible, that is, the content in the lower half becomes invisible after rotation.

[0122] Therefore, there will be a problem that the drawn pattern is not completely displayed after the electronic whiteboard in the display device 200 rotates. This incompleteness of content display forces the user to manually adjust the view after the screen rotates to ensure that the required content can be completely displayed on the screen, affecting the user experience.

[0123] To solve the problem that the drawn pattern is incompletely displayed after the electronic whiteboard in the display device 200 is rotated, some embodiments of the present application provide a display device 200, where the display device 200 includes a display 260 and a controller 250. Among them, the display 260 is configured to display a user interface, and the controller 250 runs an application program to enable the display device 200 to execute a method for displaying a drawn pattern in the electronic whiteboard. After the user rotates the electronic whiteboard, the display device 200 can comprehensively consider the display method of the drawn pattern after rotation in multiple dimensions such as the position drawn by the user in the electronic whiteboard, the area size of the drawn pattern, and the screen size, so that after the electronic whiteboard is rotated, the drawn pattern can all fall within the screen boundary range, that is, the size and position of the drawn pattern in the electronic whiteboard after rotation are adaptively displayed, without the need for the user to manually adjust, improving the user experience.

[0124] To facilitate the understanding of the technical solutions in some embodiments of the present application, the following will describe each step in detail with reference to some specific embodiments and drawings. Figure 7 It is a schematic flowchart of a method for displaying a drawn pattern in an electronic whiteboard executed by a display device provided in some embodiments of the present application. As Figure 7 shown, in some embodiments, when the display device 200 executes the method for displaying a drawn pattern in the electronic whiteboard, it may include the following steps, and the specific content is as follows:

[0125] Step S1: The display device 200 obtains the screen boundary of the rotated electronic whiteboard and the drawn pattern boundary corresponding to the drawn pattern in the electronic whiteboard.

[0126] Figure 8 It is a schematic diagram of the scene of the screen boundary and the drawn pattern boundary of the electronic whiteboard provided in some embodiments of the present application. As Figure 8 shown, in some embodiments, Figure 8 The solid line part in can be understood as the screen boundary of the electronic whiteboard, and the range enclosed by the solid line is the screen range, where the user can draw the content they want to draw within this screen range. The dotted line part is the drawn pattern boundary, and the drawn pattern boundary is the boundary formed by the minimum circumscribed rectangle of the drawn pattern (relevant content will be introduced in detail later).

[0127] In some embodiments, before obtaining the screen boundary of the rotated electronic whiteboard and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard, in response to the startup instruction of the electronic whiteboard, the display device 200 may monitor the angular change of the gyroscope; upon detecting an angular change, the display device 200 may identify the first pixel point, the second pixel point, the third pixel point, and the fourth pixel point of the drawing pattern in the electronic whiteboard, where the drawing pattern is a pattern drawn in response to a drawing instruction of a user in the electronic whiteboard; the abscissa of the first pixel point is the maximum abscissa of the drawing pattern; the ordinate of the second pixel point is the maximum ordinate of the drawing pattern; the abscissa of the third pixel point is the minimum abscissa of the drawing pattern; the ordinate of the fourth pixel point is the minimum ordinate of the drawing pattern; wherein, the number of the first pixel point, the second pixel point, the third pixel point, and the fourth pixel point may be multiple. Upon detecting that the angular change stops, the display device 200 may identify the rotated coordinate system of the electronic whiteboard and control the display 260 to display the drawing pattern in the rotated coordinate system. In the rotated coordinate system, the screen width of the electronic whiteboard is equal to the screen height of the electronic whiteboard before rotation, and the screen height of the electronic whiteboard is equal to the screen width of the electronic whiteboard before rotation.

[0128] Exemplarily, when the user starts the electronic whiteboard application, the display device 200 may start monitoring the angular change of the gyroscope. Through the gyroscope, the display device 200 may detect its own rotation and tilt angles. When detecting an angular change, the display device 200 may identify four key pixel points of the drawing pattern on the electronic whiteboard. In response to the user opening the electronic whiteboard, the display device 200 may obtain the screen boundary of the current touch screen area. For example, the display device 200 may call the DisplayMetrics class to obtain the screen width (ScreenWidth) and the screen height (ScreenHeight), and initialize the coordinate system with the upper left corner as the origin. In response to the user drawing a pattern in the electronic whiteboard, the display device 200 may obtain a coordinate list corresponding to the drawing pattern, such as P0(X0, Y0), P1(X1, Y1)...P(Xn, Yn), etc., where n is a positive integer.

[0129] Meanwhile, the display device 200 may monitor the broadcast of the gyroscope change and detect the range of the drawing pattern on the current screen when detecting an angular change. Figure 9 The scene schematic diagram of the four pixel points of the drawing pattern provided by some embodiments of the present application is as Figure 9 shown. In some embodiments, the first pixel point A may be the point with the maximum abscissa, the second pixel point B may be the point with the maximum ordinate, the third pixel point C may be the point with the minimum abscissa, and the fourth pixel point D may be the point with the minimum ordinate. The display device 200 may perform a full-screen scan of the electronic whiteboard to obtain the coordinate of the rightmost point A corresponding to the current drawing pattern, such as (Xmax , Y), and the coordinates of the bottom - most point B are like (X, Y max ), and the coordinates of the left - most point C are like (X min , Y) and the coordinates of the top - most point D are like (X, Y min ). When the electronic whiteboard stops rotating, the display device 200 can recognize the rotated coordinate system corresponding to the electronic whiteboard, that is, the coordinate system rebuilt with the top - left corner of the rotated screen as the origin, and re - obtain the screen width and screen height. As can be seen from Figure 9 , before and after rotation, its origin remains unchanged, the position of the drawn pattern does not change, only the direction changes. For example, before and after rotation, the screen height and screen width are actually swapped, that is, the screen width of the electronic whiteboard after rotation will be equal to the screen height of the electronic whiteboard before rotation, and the screen height of the electronic whiteboard after rotation will be equal to the screen width of the electronic whiteboard before rotation. In this way, by listening to the angular change of the gyroscope, the drawn pattern can be correctly displayed on the screen. No matter how the electronic whiteboard rotates, the electronic whiteboard always presents the drawn pattern in the correct orientation for the user, and the drawn pattern will not be distorted or misaligned.

[0130] In some embodiments, the display device 200 can obtain the screen boundary of the rotated electronic whiteboard and the drawn - pattern boundary corresponding to the drawn pattern in the electronic whiteboard in the following way: The display device 200 can recognize the rotated coordinate system corresponding to the rotated electronic whiteboard, and based on the rotated coordinate system, recognize the screen boundary of the electronic whiteboard; then generate the minimum - enclosing rectangle of the drawn pattern based on the first pixel point, the second pixel point, the third pixel point, and the fourth pixel point, and obtain the drawn - pattern boundary corresponding to the drawn pattern according to the minimum - enclosing rectangle.

[0131] Exemplarily, when the electronic whiteboard rotates, the display device 200 can use a gyroscope or other sensors to detect the rotation angle, and when it stops rotating, recognize the new coordinate system, which can reflect the direction of the rotated electronic whiteboard. In the new coordinate system, the display device 200 can calculate the screen boundary of the electronic whiteboard according to the direction and position of the electronic whiteboard. At the same time, using the above four pixel points A, B, C, and D, the minimum - enclosing rectangle of the drawn pattern can be determined. This rectangle is the smallest rectangle frame that contains the entire drawn pattern, and the boundary of the minimum - enclosing rectangle is the drawn - pattern boundary. By obtaining the screen boundary of the rotated electronic whiteboard and the drawn - pattern boundary corresponding to the drawn pattern in the electronic whiteboard, it can provide a data basis for subsequent judgment of the drawn pattern and the screen range, and execute different strategies for the drawn pattern according to different situations.

[0132] In order to accurately mark the four pixel points of the drawn pattern, in some embodiments, before the display device 200 monitors the angular change of the gyroscope, it can identify the initial coordinate list of the drawn pattern drawn by the user based on the initial coordinate system corresponding to before the electronic whiteboard rotates, where the initial coordinate list is a coordinate list formed by the point coordinates of multiple points included in the drawn pattern; then mark the point with the largest abscissa in the initial coordinate list as the first pixel point; mark the point with the largest ordinate in the initial coordinate list as the second pixel point; mark the point with the smallest abscissa in the initial coordinate list as the third pixel point; mark the point with the smallest ordinate in the initial coordinate list as the fourth pixel point.

[0133] Exemplarily, the initial coordinate list contains the coordinates of all points in the drawn pattern before rotating the electronic whiteboard. Then, the point with the largest abscissa can be found from the initial coordinate list and marked as the first pixel point, the point with the largest ordinate can be found and marked as the second pixel point, the point with the smallest abscissa can be found and marked as the third pixel point, and the point with the smallest ordinate can be found and marked as the fourth pixel point. By determining the pixel points before rotation, it is possible to avoid recalculating the boundary of the entire drawn pattern after rotation, thereby simplifying the processing process. By accurately marking the four pixel points, the drawn pattern can be correctly displayed and aligned after rotation, improving the accuracy of the drawn pattern display. After step S1 is completed, the following step S2 can be included.

[0134] Step S2: When a part of the drawn pattern falls outside the screen boundary range, the display device 200 compares the pattern width of the drawn pattern boundary with the screen width of the screen boundary, and compares the pattern height of the drawn pattern boundary with the screen height of the screen boundary.

[0135] In some embodiments, after the display device 200 obtains the drawn pattern boundary and the screen boundary, it can first determine the positional relationship between the drawn pattern and the screen boundary. The display device 200 can make the following determination. When the value of the abscissa of the first pixel point is less than or equal to the screen width and the value of the ordinate of the second pixel point is less than or equal to the screen height, it is determined that the entire drawn pattern falls within the screen boundary range; when the value of the abscissa of the first pixel point is greater than the screen width and / or the value of the ordinate of the second pixel point is greater than the screen height, it is determined that a part of the drawn pattern falls outside the screen boundary range.

[0136] Exemplarily, Figure 10 is a schematic diagram of the positional relationship scenario between the drawn pattern and the screen boundary provided by some embodiments of the present application. As Figure 10 shown, after the electronic whiteboard rotation is completed, if the abscissa X of the first pixel point A max is less than or equal to ScreenWidth, and the ordinate Y of the second pixel point B maxWhen it is less than or equal to ScreenHeight, it can be determined that the drawn pattern completely falls within the screen boundary range. As Figure 10 (a) shows, this means that all parts of the drawn pattern are visible and do not exceed the screen boundary. If the abscissa X of the first pixel point A max is greater than ScreenWidth, and / or the ordinate Y of the second pixel point B max is greater than ScreenHeight, it can be determined that part of the drawn pattern falls outside the screen boundary range, as Figure 10 (b) shows. Since part of it exceeds the visible range of the screen, some parts of the drawn pattern may be invisible. By comparing the pixel coordinates of the drawn pattern with the screen size, the display device 200 can quickly determine whether the drawn pattern is suitable for the current screen, so as to take corresponding measures, such as whether scaling, translation or other adjustments are needed to ensure the best display effect.

[0137] In some embodiments, after the display device 200 determines that the drawn pattern completely falls within the screen boundary range, it can control the coordinate list of the drawn pattern after rotating the electronic whiteboard to be equal to the initial coordinate list of the drawn pattern before the electronic whiteboard is rotated, and control the display to output the drawn pattern in the rotated electronic whiteboard according to the initial coordinate list.

[0138] Exemplarily, when the display device 200 determines that the drawn pattern completely falls within the screen boundary range, it can control the coordinates of the drawn pattern after rotating the electronic whiteboard to be equal to the initial coordinate list of the drawn pattern before the electronic whiteboard is rotated. For example, if X max ≤ScreenWidth and Y max ≤ScreenHeight, it means that the drawn pattern after rotation is completely displayed in the visible area of the screen, as Figure 10 (a) shows, then the coordinates of the new drawn pattern are the same as the coordinate values before rotation, that is, (X new , Y new )=(X, Y), where X, Y can be used to represent the coordinate group corresponding to the drawn pattern before the electronic whiteboard is rotated, X new , Y newIt can be used to represent the coordinate group corresponding to the pattern drawn after the electronic whiteboard is rotated. That is to say, for the pattern drawn on the rotated electronic whiteboard, when it can be fully displayed within the screen range after rotation, the display device 200 can directly perform horizontal and vertical conversions and draw the pattern on the rotated screen. In this way, although the electronic whiteboard is rotated, the position of the drawn pattern in the coordinate system remains unchanged, and the display device 200 will still control the display 260 to output the drawn pattern according to the initial coordinate list in the rotated electronic whiteboard to ensure that the drawn pattern is correctly output on the rotated screen without misalignment or deformation. At the same time, since the coordinates of the drawn pattern do not change, the display device 200 does not need to perform complex coordinate conversions or recalculations, thus reducing the consumption of computing resources.

[0139] In some embodiments, when a part of the drawn pattern falls outside the screen boundary range, the display device 200 needs to compare the pattern width of the drawn pattern boundary with the screen width of the screen boundary, and compare the pattern height of the drawn pattern boundary with the screen height of the screen boundary. In this way, by comparing the size of the drawn pattern boundary with the screen boundary size, the display device 200 can determine whether it is necessary to adjust the drawn pattern, providing a clear direction for subsequent pattern processing operations to make the drawn pattern adapt to the screen size and avoid the problem of incomplete display of the drawn pattern.

[0140] In some implementation examples, before comparing the size of the drawn pattern boundary with the screen boundary size, the display device 200 can perform a subtraction operation on the abscissa of the first pixel point and the abscissa of the third pixel point to obtain the pattern width of the drawn pattern boundary, and perform a subtraction operation on the ordinate of the second pixel point and the ordinate of the fourth pixel point to obtain the pattern height of the drawn pattern boundary.

[0141] Exemplarily, the pattern width of the drawn pattern boundary can be expressed as x = |X max -X min |, and the pattern width can determine the size of the drawn pattern in the horizontal direction; the pattern height of the drawn pattern boundary can be expressed as y = |Y max -Y min |, and the pattern height can determine the size of the drawn pattern in the vertical direction. By calculating the pattern width and pattern height of the drawn pattern boundary, the display device 200 can determine the space size occupied by the drawn pattern on the electronic whiteboard, providing a data basis for the subsequent display and adjustment of the drawn pattern. After step S2 is executed, the following step S3 can be included.

[0142] Step S3: When the pattern width is less than or equal to the screen width and the pattern height is less than or equal to the screen height, the display device 200 performs a translation process on the drawn pattern so that the translated drawn pattern completely falls within the screen boundary range.

[0143] In some embodiments, when a part of the drawn pattern falls outside the screen boundary range, if the pattern width is less than or equal to the screen width and the pattern height is less than or equal to the screen height, the display device 200 needs to perform a translation process on the drawn pattern so that the translated drawn pattern can completely fall within the screen boundary range. That is to say, when the electronic whiteboard rotates and the rotated drawn pattern cannot be fully displayed on the screen and the size of the drawn pattern is smaller than the screen size, the display device 200 needs to translate the rotated drawn pattern to ensure that the rotated drawn pattern can be displayed within the screen range.

[0144] Exemplarily, after the electronic whiteboard completes rotation, if the width x of the drawn pattern ≤ ScreenWidth and the height y of the drawn pattern ≤ ScreenHeight, that is, when both are less, the display device 200 does not need to perform scaling on the drawn pattern. The display device 200 can keep the current ratio unchanged and translate the drawn pattern to the visible area of the screen. Then the display device 200 needs to calculate the relative translation value for performing translation on the drawn pattern.

[0145] In some embodiments, the display device 200 can perform a translation process on the drawn pattern in the following manner: The display device 200 can perform a subtraction operation on the abscissa of the first pixel point of the drawn pattern and the screen width value corresponding to the screen width, and / or perform a subtraction operation on the ordinate of the second pixel point of the drawn pattern and the screen height value corresponding to the screen height to obtain the relative translation value of the drawn pattern. Here, the first pixel point is the point with the largest abscissa in the drawn pattern, and the second pixel point is the point with the largest ordinate in the drawn pattern. Then, obtain the coordinate value of the drawn pattern in the rotated electronic whiteboard, and perform a subtraction operation on the coordinate value of the drawn pattern and the relative translation value to obtain the translated coordinate value of the drawn pattern, and control the display 260 to output the drawn pattern in the rotated electronic whiteboard according to the translated coordinate value.

[0146] Exemplarily, the above content can be divided into the following situations:

[0147] Scenario 1 Figure 11 is a schematic diagram of a scenario where the display device provided by some embodiments of the present application performs translation on the drawn pattern. As Figure 11 shown, when X max > ScreenWidth and Y max ≤ ScreenHeight, it indicates that the abscissa direction, i.e., the horizontal direction, of the drawn pattern exceeds the right boundary of the screen, and the ordinate does not exceed the screen range. Then the display device 200 needs to calculate the relative translation value in the horizontal direction. Then the translation distance X of the abscissa d = X max- ScreenWidth, the translation distance Y of the vertical coordinate d = 0;

[0148] Scenario 2, Figure 12 is another schematic diagram of the translation of the drawn pattern by the display device provided in some embodiments of the present application. As Figure 12 shown, when X max ≤ ScreenWidth and Y max > ScreenHeight, it indicates that the vertical coordinate direction of the drawn pattern, i.e., the vertical direction, exceeds the lower boundary of the screen, and the horizontal coordinate does not exceed the screen boundary. Then the display device 200 needs to calculate the relative translation value in the vertical direction. Then the translation distance X of the horizontal coordinate d = 0, and the translation distance Y of the vertical coordinate d = Y max – ScreenHeight;

[0149] Scenario 3, Figure 13 is yet another schematic diagram of the translation of the drawn pattern by the display device provided in some embodiments of the present application. As Figure 13 shown, when X max > ScreenWidth and Y max > ScreenHeight, it indicates that both the horizontal coordinate direction and the vertical coordinate direction of the drawn pattern exceed the screen range. Then the display device 200 needs to calculate the relative translation values in the horizontal and vertical directions. Then the translation distance X of the horizontal coordinate d = X max - ScreenWidth, and the translation distance Y of the vertical coordinate d = Y max – ScreenHeight.

[0150] Based on the relative translation values calculated above and the coordinate values of the drawn pattern, the display device 200 can perform a translation process on the drawn pattern, that is, move the drawn pattern horizontally or vertically by a distance of X d and / or Y d to ensure that the drawn pattern after the translation process entirely falls within the screen range. In this way, no matter how the electronic whiteboard rotates, the display device 200 can ensure that the drawn pattern is always within the visible area and there will be no misalignment or occlusion.

[0151] Exemplarily, since the coordinate positions of the drawn pattern do not change before and after the rotation of the electronic whiteboard, only the horizontal and vertical directions change. Therefore, the values of the coordinate group of the drawn pattern remain unchanged. Taking the value of the coordinate group of the drawn pattern as (X, Y) as an example, its relative translation values are X d and Y dIn this case, the translated coordinate values of the drawn pattern (i.e., the coordinate values after the electronic whiteboard rotates and undergoes translation processing) (X new , Y new ) = (X - X d , Y - Y d ). By performing a subtraction operation on the coordinate values of the drawn pattern and the relative translation values, the translation processing of the drawn pattern is completed, so that the drawn pattern after translation processing entirely falls within the screen range. After step S3 is completed, the following step S4 can be executed.

[0152] Step S4: When the width of the pattern is greater than the screen width and / or the height of the pattern is greater than the screen height, the display device 200 performs a scaling process on the drawn pattern, and further performs a translation process on the scaled drawn pattern, so that the drawn pattern after scaling and translation entirely falls within the screen boundary range.

[0153] In some embodiments, the electronic whiteboard does not limit the canvas area, that is, the canvas range can be infinitely expanded, and drawing can be performed on the entire visible area. In this way, when the user draws within the screen range of the electronic whiteboard, the size of the drawn pattern is not limited to the screen range and can also exceed the screen range. For example, during the drawing process, when the drawn pattern reaches the right boundary of the screen, the canvas can still be expanded to support the user to continue drawing to the right. Therefore, a situation where the size of the drawn pattern is greater than the screen size may occur.

[0154] In some embodiments, when a part of the drawn pattern falls outside the screen boundary range, if the width of the pattern is greater than the screen width and / or the height of the pattern is greater than the screen height, that is, when the size of the drawn pattern exceeds the screen size, the display device 200 can first calculate an appropriate scaling ratio so that the scaled drawn pattern can fully fit the screen. This scaling ratio can be comprehensively considered based on the width and height ratios of the drawn pattern and the screen. Then, the calculated scaling ratio is applied to scale the drawn pattern. After scaling, if the drawn pattern still does not entirely fall within the screen range, a translation process can be performed on the scaled drawn pattern so that the drawn pattern after scaling and translation entirely falls within the screen boundary range, that is, the adaptive effect between the rotated electronic whiteboard and the screen is achieved. That is to say, when the electronic whiteboard rotates and the rotated drawn pattern cannot be fully displayed on the screen and the size of the drawn pattern is greater than the screen size, the display device 200 needs to first scale and then translate the rotated drawn pattern to ensure that the rotated drawn pattern can be displayed within the screen range.

[0155] Exemplarily, after the electronic whiteboard completes rotation, if the width x of the drawn pattern > ScreenWidth, and / or the height y of the drawn pattern > ScreenHeight, indicating that the size of the drawn pattern is greater than the visible area of the screen, the display device 200 needs to perform scaling on the drawn pattern, and then determine whether the scaled drawn pattern completely falls within the screen range after scaling. If there is still a part that does not fall within the screen range, continue to perform translation processing on it until the drawn pattern completely falls within the screen range. In this way, through the combined processing of scaling and translation, the display device 200 can process drawn patterns of various sizes to ensure clear and complete display on any screen size.

[0156] In some embodiments, the display device 200 can perform scaling processing on the drawn pattern and perform translation processing on the scaled drawn pattern in the following manner. The display device 200 can first perform a division operation on the screen width and the pattern width, and / or perform a division operation on the screen height and the pattern height to obtain the scaling ratio of the drawn pattern. Then, obtain the coordinate values of the drawn pattern in the rotated electronic whiteboard, perform a multiplication operation on the coordinate values and the scaling ratio to obtain the scaled coordinates after the drawn pattern is scaled, then calculate the relative translation value of the drawn pattern based on the scaled coordinates, perform a subtraction operation on the scaled coordinates and the relative translation value to obtain the translated coordinate values of the drawn pattern. After that, control the display 260 to output the drawn pattern in the rotated electronic whiteboard according to the translated coordinate values.

[0157] Exemplarily, the above content can be divided into the following situations:

[0158] Scenario 1, Figure 14 This is a schematic diagram of a scenario where the display device provided by some embodiments of the present application performs scaling on the drawn pattern. As Figure 14 shown, when the pattern width x of the drawn pattern > ScreenWidth and the pattern height y of the drawn pattern ≤ ScreenHeight, it indicates that the size of the drawn pattern in the horizontal direction of the abscissa exceeds the size of the screen in the horizontal direction, and the size in the vertical direction of the ordinate does not exceed the size of the screen in the vertical direction. Then, the display device 200 needs to calculate the scaling value in the horizontal direction based on the screen width and the pattern width of the drawn pattern. The scaling ratio of the drawn pattern is:

[0159]

[0160] Scenario 2, Figure 15 This is another schematic diagram of a scenario where the display device provided by some embodiments of the present application performs scaling on the drawn pattern. As Figure 15As shown, when the pattern width x of the drawn pattern ≤ ScreenWidth and the pattern height y of the drawn pattern > ScreenHeight, it indicates that the abscissa direction (i.e., the horizontal direction) of the drawn pattern does not exceed the screen width, and the ordinate direction (i.e., the vertical direction) of the drawn pattern exceeds the screen height. Then, the display device 200 needs to calculate the scaling value in the vertical direction based on the screen height and the pattern height. The scaling ratio of the drawn pattern is as follows:

[0161]

[0162] Scenario 3 Figure 16 is a schematic diagram of another scenario for a display device provided by some embodiments of the present application to perform scaling on a drawn pattern. As Figure 16 shown, when the pattern width x of the drawn pattern > ScreenWidth and the pattern height y of the drawn pattern > ScreenHeight, it indicates that both the pattern width and the pattern height of the drawn pattern exceed the screen boundaries (i.e., the screen width and the screen height). Then, the display device 200 needs to calculate the scaling value in the vertical direction based on the screen height and the pattern height, and calculate the scaling value in the horizontal direction based on the screen width and the pattern width of the drawn pattern. The final scaling value takes the smaller value of the two.

[0163] Then the reduction ratio k takes and the smaller value of.

[0164] By performing a division operation on the screen width and the pattern width, and / or performing a division operation on the screen height and the pattern height, the scaling ratio of the drawn pattern can be obtained, and the scaling ratio of the drawn pattern on the electronic whiteboard can be determined to adapt it to the size of the screen. After calculating the scaling ratio, the coordinate values (X, Y) of the drawn pattern and the scaling ratio k can be multiplied to obtain the scaled coordinates after the drawn pattern is scaled, that is, the scaled coordinates (X k , Y k ) = (k * X, k * Y). After obtaining the scaled coordinates of the drawn pattern, the display device 200 can determine whether translation is required based on the scaled coordinates. If translation is required, the relative translation value is calculated (the method of calculating the relative translation value has been described in detail above and will not be repeated here), and then the scaled coordinates and the relative translation value are subtracted to obtain the translated coordinate value of the drawn pattern. After that, the display 260 is controlled to output the drawn pattern in the rotated electronic whiteboard according to the translated coordinate value. In this way, in the case where the size of the drawn pattern exceeds the screen size, by performing scaling and translation processing on the drawn pattern, the final drawn pattern can be completely within the screen range, solving the problem that the drawn pattern is not completely displayed after the electronic whiteboard in the display device 200 is rotated.

[0165] Exemplarily, the display device 200 may perform a boundary scan on the scaled drawing pattern, and determine again whether the scaled drawing pattern entirely falls within the screen boundary range. If it does not entirely fall within, the distance to be translated is calculated based on the boundary of the scaled pattern and the screen boundary. If it entirely falls within, no translation is required. For example, assume that after scaling, the drawing pattern entirely falls within the screen range, then no translation needs to be performed on the scaled drawing pattern, and X d and Y d are both 0. In combination with Figures 14 - 16 , for the drawing patterns in the three scenarios, after scaling, part of them falls outside the screen range, and further translation processing is required. After calculating the relative translation value based on the scaled coordinates, the final rotated coordinates are obtained. For example, the rotated coordinates (X new , Y new ) = (X k - X d , Y k - Y d ). Finally, the display device 200 may output the drawing pattern according to the rotated coordinates (X new , Y new ). In this way, by performing a subtraction operation on the scaled coordinates and the relative translation value, the final coordinates for outputting the drawing pattern can be obtained. When the size of the drawing pattern is larger than the screen size, through scaling and translation processing, the drawing pattern can be effectively adjusted into the visible area of the screen, ensuring the integrity and visibility of the drawing pattern.

[0166] In some embodiments, after the electronic whiteboard rotates, the display device 200 may simultaneously adjust the background grid and the canvas size to ensure that after the electronic whiteboard rotates, the background grid and the canvas size can adapt to the new angle and ratio, ensuring that users can write and view content normally, and the visible area can be written on normally. At the same time, after the drawing pattern undergoes scaling or translation processing, the display device 200 may redraw the entire drawing board background and fill the background grid throughout the display area to ensure that the background grid covers the entire display area.

[0167] Figure 17 This is a timing schematic diagram of the display method for the drawing pattern in the electronic whiteboard executed by the display device provided in some embodiments of the present application, as Figure 17As shown, in some embodiments, in combination with the above, in response to the startup of the electronic whiteboard, the controller in the display device 200 can first initialize the coordinate system of the electronic whiteboard and present it on the display. Then, it can monitor the changes of the gyroscope. When the gyroscope angle changes, it can obtain the initial list of drawn patterns, and then calculate the four pixel points and the minimum circumscribed rectangle corresponding to the drawn pattern, etc. When the gyroscope stops changing, it can obtain the boundary of the drawn pattern and the screen boundary, and re-establish the coordinate system. After that, it can determine whether the drawn pattern entirely falls within the screen boundary range (to determine whether processing of the drawn pattern is required, such as no processing is needed if it all falls within, and if part is outside the screen range, translation and / or scaling are required), compare the pattern width of the drawn pattern boundary with the screen width of the screen boundary, and compare the pattern height of the drawn pattern boundary with the screen height of the screen boundary (to determine the specific processing strategy, such as only translation, or scaling first and then translation). Finally, the pattern can be drawn based on the finally obtained rotated coordinates.

[0168] It should be noted that during the entire process of translating or scaling the drawn pattern, the display device 200 comprehensively considers the display method of the rotated drawn pattern based on multiple dimensions such as the position where the user draws on the electronic whiteboard, the size of the drawn pattern, and the screen size. After the electronic whiteboard rotates, the drawn pattern can entirely fall within the screen boundary range, that is, it realizes the adaptive display of the size and position of the drawn pattern within the screen range after the rotation of the electronic whiteboard, without the need for the user to manually operate on the drawn pattern, solving the problem that the drawn pattern is not completely displayed after the rotation of the electronic whiteboard in the display device, and improving the user experience.

[0169] As can be seen from the above technical solutions, the above embodiment provides a display device 200. The display device 200 can obtain the screen boundary of the rotated electronic whiteboard and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard; the drawing pattern boundary is the boundary formed by the minimum circumscribed rectangle of the drawing pattern; when a part of the drawing pattern falls outside the screen boundary range, compare the pattern width of the drawing pattern boundary with the screen width of the screen boundary, and compare the pattern height of the drawing pattern boundary with the screen height of the screen boundary; when the pattern width is less than or equal to the screen width and the pattern height is less than or equal to the screen height, perform a translation process on the drawing pattern so that the translated drawing pattern completely falls within the screen boundary range; when the pattern width is greater than the screen width and / or the pattern height is greater than the screen height, perform a scaling process on the drawing pattern, and perform a translation process on the scaled drawing pattern so that the scaled and translated drawing pattern completely falls within the screen boundary range. The display device 200 comprehensively considers the display method of the rotated drawing pattern based on multiple dimensions such as the drawing position of the user in the electronic whiteboard, the size of the drawing pattern, and the screen size, so that after the electronic whiteboard is rotated, the drawing pattern can completely fall within the screen boundary range, solving the problem that the drawing pattern is incompletely displayed after the electronic whiteboard in the display device 200 is rotated.

[0170] Based on the above display device 200, some embodiments of the present application further provide a method for displaying a drawing pattern in an electronic whiteboard. The method can be applied to the display device 200 in the above embodiment. In some embodiments, the method may include the following content:

[0171] Obtain the screen boundary of the rotated electronic whiteboard and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard; the drawing pattern boundary is the boundary formed by the minimum circumscribed rectangle of the drawing pattern;

[0172] When a part of the drawing pattern falls outside the screen boundary range, compare the pattern width of the drawing pattern boundary with the screen width of the screen boundary, and compare the pattern height of the drawing pattern boundary with the screen height of the screen boundary;

[0173] When the pattern width is less than or equal to the screen width and the pattern height is less than or equal to the screen height, perform a translation process on the drawing pattern so that the translated drawing pattern completely falls within the screen boundary range;

[0174] When the pattern width is greater than the screen width and / or the pattern height is greater than the screen height, perform a scaling process on the drawing pattern, and perform a translation process on the scaled drawing pattern so that the scaled and translated drawing pattern completely falls within the screen boundary range.

[0175] As can be seen from the above technical solutions, the above embodiments provide a method for displaying a drawn pattern in an electronic whiteboard. The method comprehensively considers the display method of the rotated drawn pattern in multiple dimensions such as the position where the user draws on the electronic whiteboard, the size of the drawn pattern, and the screen size, so that after the electronic whiteboard is rotated, the drawn pattern can all fall within the screen boundary range, solving the problem that the drawn pattern is incompletely displayed after the electronic whiteboard in the display device 200 is rotated.

[0176] For the same and similar parts among the various embodiments in this specification, reference can be made to each other, and details will not be repeated here.

[0177] Those skilled in the art can clearly understand that the technologies in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solutions in the embodiments of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disc, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of the various embodiments or some parts of the embodiments of the present invention.

[0178] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the various embodiments of the present application.

[0179] For the sake of convenience of explanation, the above description has been made in combination with specific implementation manners. However, the above exemplary discussion is not intended to be exhaustive or to limit the implementation manners to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above implementation manners are for the purpose of better explaining the principles and actual applications, so that those skilled in the art can better use the implementation manners and various different variations of the implementation manners suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: a display configured to display a user interface; The controller is configured as: Acquire the screen boundary of the electronic whiteboard after rotation and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard; the drawing pattern boundary is the boundary formed by the minimum circumscribed rectangle of the drawing pattern; In the case where the drawing pattern portion falls outside the screen boundary range, comparing the pattern width of the drawing pattern boundary with the screen width of the screen boundary, and comparing the pattern height of the drawing pattern boundary with the screen height of the screen boundary; When the pattern width is less than or equal to the screen width, and the pattern height is less than or equal to the screen height, performing translation processing on the drawing pattern so that the drawing pattern after the translation processing falls entirely within the screen boundary range; When the pattern width is greater than the screen width and / or the pattern height is greater than the screen height, scaling is performed on the drawing pattern, and translation is performed on the scaled drawing pattern, so that the scaled and translated drawing patterns all fall within the screen boundary.

2. The display device according to claim 1, characterized in that The controller performs translation processing on the drawing pattern, and is specifically configured as follows: Subtracting the horizontal coordinate of a first pixel point of the drawing pattern from the screen width value corresponding to the screen width, and / or subtracting the vertical coordinate of a second pixel point of the drawing pattern from the screen height value corresponding to the screen height, to obtain a relative translation value of the drawing pattern; the horizontal coordinate of the first pixel point is the maximum horizontal coordinate of the drawing pattern; the vertical coordinate of the second pixel point is the maximum vertical coordinate of the drawing pattern; Obtaining coordinate values ​​of the drawn pattern in the rotated electronic whiteboard; Subtracting the coordinate value of the drawing pattern from the relative translation value to obtain the translated coordinate value of the drawing pattern; The display is controlled to output the drawing pattern in the rotated electronic whiteboard according to the translated coordinate values.

3. The display device according to claim 1, characterized in that The controller performs scaling processing on the drawing pattern, and performs translation processing on the scaling drawing pattern, and is specifically configured as follows: Performing a division operation on the screen width and the pattern width, and / or performing a division operation on the screen height and the pattern height to obtain a scaling ratio of the drawn pattern; Obtaining coordinate values ​​of the drawn pattern in the rotated electronic whiteboard; Performing a product operation on the coordinate value and the scaling ratio to obtain scaled coordinates of the drawing pattern after scaling is performed; Calculating a relative translation value of the drawing pattern based on the scaled coordinates; Subtracting the scaled coordinates from the relative translation value to obtain the translated coordinate value of the drawing pattern; The display is controlled to output the drawing pattern in the rotated electronic whiteboard according to the translated coordinate values.

4. The display device according to claim 1, characterized in that Before the step of acquiring the screen boundary of the electronic whiteboard after rotation and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard, the controller is further configured to: In response to the start-up instruction of the electronic whiteboard, monitoring the angle change of the gyroscope; When the angle changes, a first pixel point, a second pixel point, a third pixel point, and a fourth pixel point of a drawing pattern in the electronic whiteboard are identified; the drawing pattern is a pattern drawn in response to a drawing instruction of a user in the electronic whiteboard; the abscissa of the first pixel point is the maximum abscissa of the drawing pattern; the ordinate of the second pixel point is the maximum ordinate of the drawing pattern; the abscissa of the third pixel point is the minimum abscissa of the drawing pattern; and the ordinate of the fourth pixel point is the minimum ordinate of the drawing pattern; Detecting that the angle stops changing, identifying the coordinate system of the electronic whiteboard after rotation; The display is controlled to display the drawing pattern in the rotated coordinate system; in the rotated coordinate system, the screen width of the electronic whiteboard is equal to the screen height of the electronic whiteboard before rotation, and the screen height of the electronic whiteboard is equal to the screen width of the electronic whiteboard before rotation.

5. The display device according to claim 4, characterized in that The controller obtains the screen boundary of the electronic whiteboard after rotation and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard, and is specifically configured as follows: Identify the rotated coordinate system corresponding to the electronic whiteboard after rotation; Based on the rotated coordinate system, identifying the screen boundary of the electronic whiteboard; Generate a minimum circumscribed rectangle of the drawing pattern based on the first pixel point, the second pixel point, the third pixel point and the fourth pixel point; A drawing pattern boundary corresponding to the drawing pattern is obtained according to the minimum circumscribed rectangle.

6. The display device according to claim 4, characterized in that Before the step of monitoring the angle change of the gyroscope, the controller is further configured as follows: In response to the start instruction, based on the initial coordinate system corresponding to the electronic whiteboard before rotation, an initial coordinate list of a drawing pattern drawn by the user is identified; the initial coordinate list is a coordinate list formed by the point coordinates of a plurality of points included in the drawing pattern; Mark the point with the largest horizontal coordinate in the initial coordinate list as the first pixel point; Mark the point with the largest ordinate in the initial coordinate list as the second pixel point; Marking the point with the smallest horizontal coordinate in the initial coordinate list as the third pixel point; The point with the smallest ordinate in the initial coordinate list is marked as the fourth pixel point.

7. The display device according to claim 2, characterized in that Before the step of acquiring the screen boundary of the electronic whiteboard after rotation and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard, the controller is further configured to: When the value of the horizontal coordinate of the first pixel point is less than or equal to the screen width, and the value of the vertical coordinate of the second pixel point is less than or equal to the screen height, determining that the drawing pattern is entirely within the screen boundary; When the value of the horizontal coordinate of the first pixel point is greater than the screen width, and / or the value of the vertical coordinate of the second pixel point is greater than the screen height, it is determined that the drawing pattern portion falls outside the screen boundary range.

8. The display device according to claim 7, characterized in that After the step of determining that all the drawing patterns fall within the boundary range of the screen, the controller is further configured to: Controlling the coordinate list of the pattern drawn after the electronic whiteboard is rotated to be equal to the initial coordinate list of the pattern drawn before the electronic whiteboard is rotated; The display is controlled to output the drawing pattern according to the initial coordinate list in the rotated electronic whiteboard.

9. The display device according to claim 4, characterized in that: Before the steps of comparing the pattern width of the drawing pattern boundary with the screen width of the screen boundary, and comparing the pattern height of the drawing pattern boundary with the screen height of the screen boundary, the controller is further configured to: Subtracting the horizontal coordinate of the first pixel point from the horizontal coordinate of the third pixel point to obtain a pattern width of the drawing pattern boundary; A subtraction operation is performed on the longitudinal coordinate of the second pixel point and the longitudinal coordinate of the fourth pixel point to obtain a pattern height of the drawing pattern boundary.

10. A method for displaying a pattern drawn in an electronic whiteboard, applied to a display device according to any one of claims 1 to 9, wherein the display device comprises a display and a controller, wherein: The method comprises: Acquire the screen boundary of the electronic whiteboard after rotation and the drawing pattern boundary corresponding to the drawing pattern in the electronic whiteboard; the drawing pattern boundary is the boundary formed by the minimum circumscribed rectangle of the drawing pattern; In the case where the drawing pattern portion falls outside the screen boundary range, comparing the pattern width of the drawing pattern boundary with the screen width of the screen boundary, and comparing the pattern height of the drawing pattern boundary with the screen height of the screen boundary; When the pattern width is less than or equal to the screen width, and the pattern height is less than or equal to the screen height, performing translation processing on the drawing pattern so that the drawing pattern after the translation processing falls entirely within the screen boundary range; When the pattern width is greater than the screen width and / or the pattern height is greater than the screen height, scaling is performed on the drawing pattern, and translation is performed on the scaled drawing pattern, so that the scaled and translated drawing patterns all fall within the screen boundary.

Images