Screen rotation adaptive signal source content display method for electronic whiteboard all-in-one machine

Abstract

The invention relates to an electronic whiteboard all-in-one machine screen rotation adaptive signal source content display method, and belongs to the technical field of image processing. The method comprises the steps that the screen direction is obtained, and the screen change direction is obtained through change judgment according to the screen direction; collecting signal source content through a system interface, and obtaining a signal source content analysis result through a content analysis model according to the signal source content and the screen change direction; obtaining complete rotation signal source content through an image processing model according to the signal source content analysis result; and obtaining a correct signal source display image through a content adjustment model according to the complete rotation signal source content. The signal source content can be self-adaptive to the rotation of the electronic whiteboard all-in-one machine screen, and the clarity and integrity of the rotated signal source content are ensured.

Description

Technical Field

[0001] The invention belongs to the technical field of image processing, and in particular relates to a method for displaying content of a signal source adaptively by screen rotation of an electronic whiteboard all-in-one machine. Background Art

[0002] With the widespread use of smart devices and multi-functional display devices, all-in-one electronic whiteboards have become an important tool in modern conferences, education, design and other fields. In order to adapt to different usage scenarios, existing all-in-one electronic whiteboards usually support horizontal and vertical screen switching, but the display of signal source content often cannot automatically adapt to the rotation of the screen, resulting in incorrect or distorted content display in vertical mode, affecting the user experience.

[0003] Currently, the signal source content is often manually adjusted to match the screen direction, which is time-consuming and complicated, and is not convenient for scenes that require quick switching and display of content. When processing complex content, the existing technology cannot perform fine-grained optimization of the display after the screen is rotated. This causes dynamic content to be incompatible, freeze in the screen, or incompletely displayed after the screen is switched, affecting the use effect. Therefore, the above technology still has shortcomings in processing the adaptive screen rotation of the signal source content display while ensuring the correctness, comprehensiveness, and non-distortion of the displayed content. Summary of the invention

[0004] In order to solve the above problems existing in the prior art, the present invention provides a method for displaying content of an electronic whiteboard integrated machine by rotating the screen and adaptively displaying signal sources.

[0005] The purpose of the present invention can be achieved through the following technical solutions:

[0006] A method for displaying content of a signal source with screen rotation self-adaptation of an electronic whiteboard integrated machine, comprising:

[0007] Obtaining a screen direction, wherein the screen direction includes a landscape mode and a portrait mode, and obtaining a screen change direction by changing the screen direction;

[0008] Collecting signal source content through the system interface, and obtaining a signal source content analysis result through a content analysis model according to the signal source content and the screen change direction;

[0009] Obtaining the complete rotation signal source content through an image processing model according to the signal source content analysis result;

[0010] A correct signal source display image is obtained through a content adjustment model according to the complete rotation signal source content.

[0011] Preferably, the change judgment includes judging whether the screen orientation is in the horizontal screen mode, and if so, monitoring the screen orientation change through an event listener until the screen orientation is in the vertical screen mode;

[0012] If not, the screen change direction is obtained and subsequent steps are performed.

[0013] Preferably, obtaining a signal source content analysis result through a content analysis model according to the signal source content includes:

[0014] Obtaining content layout according to the signal source content through a format recognition model;

[0015] The signal source content analysis result is obtained by direction matching judgment according to the content layout and the screen change direction.

[0016] Preferably, obtaining the content layout according to the signal source content through a format recognition model comprises:

[0017] Obtaining a whiteboard grayscale image through grayscale image calculation according to the signal source content;

[0018] Extracting edges from the whiteboard grayscale image using the Canny algorithm to obtain a whiteboard edge grayscale image;

[0019] According to the grayscale image of the whiteboard edge, the image straight line feature is obtained by Hough transformation, and the image straight line feature includes the image straight line position and the image straight line direction. The image straight line direction includes horizontal and vertical directions;

[0020] The content layout is obtained by judging the straight line direction according to the straight line direction of the image, and the content layout includes a horizontal content layout and a vertical content layout.

[0021] Preferably, the Hough transform specifically includes:

[0022] Preset a parameter space, obtain edge points of the image data, and obtain a straight line distance and a straight line angle by mapping the edge points to the parameter space;

[0023] Obtaining an edge point curve by using a Hough line expression according to the straight line distance and the straight line angle;

[0024] An accumulator matrix is ​​preset, each unit position of the accumulator matrix corresponds to a set of straight line parameters, the straight line parameters include the straight line distance and the straight line angle, and the parameter space curve accumulation value is obtained by accumulating the edge point curve through the accumulator matrix;

[0025] A curve accumulation threshold is preset, and the image straight line feature is obtained through threshold judgment according to the parameter space curve accumulation value and the curve accumulation threshold.

[0026] Preferably, the accumulator matrix accumulation specifically includes adding 1 to the corresponding unit position value of the accumulator to obtain the parameter space curve accumulation value when mapping the edge point to the parameter space. If the parameter space curve accumulation value exceeds the curve accumulation threshold, it means that there is a straight line at this unit position.

[0027] Preferably, the threshold judgment includes judging whether the parameter space curve accumulation value is less than the curve accumulation threshold value, and if so, continuing the accumulator matrix accumulation;

[0028] If not, the image straight line feature is obtained.

[0029] Preferably, the straight line direction determination includes determining whether the straight line direction of the image is horizontal, and if so, obtaining the horizontal content layout;

[0030] If not, the vertical content layout is obtained.

[0031] Preferably, the direction matching judgment includes judging whether the content layout and the screen change direction are the same, and if yes, no step is performed;

[0032] If not, the signal source content analysis result is obtained and subsequent steps are performed.

[0033] Preferably, obtaining the complete rotation signal source content through an image processing model according to the signal source content analysis result includes:

[0034] According to the signal source content analysis result, a signal source content rotation angle is obtained by calculating a rotation matrix;

[0035] Obtaining rotated signal source content by rotating the signal source content according to the rotation angle of the signal source content;

[0036] The complete rotation signal source content is obtained through a bilinear interpolation model according to the rotation signal source content.

[0037] Preferably, obtaining the complete rotation signal source content through a bilinear interpolation model according to the rotation signal source content includes:

[0038] Preset the rotation signal source content coordinate system, obtain interpolation coordinates, and obtain neighboring point coordinates according to the interpolation coordinates, wherein the neighboring point coordinates include neighboring point coordinates with the same horizontal coordinate and neighboring point coordinates with the same vertical coordinate;

[0039] The interpolation coordinates and the neighboring point coordinates are expressed as:

[0040] P(x,y),Q 11 (x 1 ,y 1 ), Q 12 (x1 ,y 2 ), Q 21 (x 2 ,y 1 ), Q 22 (x 2 ,y 2 ),

[0041] Wherein, P(x, y) is the interpolation coordinate, Q 11 (x 1 ,y 1 ) are the coordinates of the adjacent points with the same horizontal coordinate, Q 12 (x 1 ,y 2 ) The coordinates of the adjacent points with the same ordinate, Q 21 (x 2 ,y 1 ) The coordinates of the adjacent points with the same horizontal coordinate, Q 22 (x 2 ,y 2 ) The vertical coordinates are the same as the adjacent point coordinates, x is the horizontal coordinate of the coordinates of point P, y is the vertical coordinate of the coordinates of point P, x 1 Q 11 and Q 12 The horizontal axis, y 1 Q 11 and Q 21 The vertical coordinate, x 2 Q 21 and Q 22 The horizontal axis, y 2 Q 12 and Q 22 The vertical coordinate of

[0042] Obtaining grayscale values ​​of neighboring point coordinates, wherein the grayscale values ​​of neighboring point coordinates include grayscale values ​​of neighboring point coordinates with the same horizontal coordinate and grayscale values ​​of neighboring point coordinates with the same vertical coordinate;

[0043] The grayscale value of the point with the same horizontal coordinate is obtained by performing an X-direction interpolation calculation based on the grayscale value of the coordinates of the adjacent points with the same horizontal coordinate;

[0044] The grayscale value of the same point on the ordinate is obtained by performing a secondary X-direction interpolation calculation based on the grayscale value of the coordinates of the neighboring points on the ordinate;

[0045] The grayscale value of the complete rotation signal source content is obtained by interpolating the grayscale value of the same point on the horizontal coordinate and the grayscale value of the same point on the vertical coordinate through Y direction;

[0046] The complete rotation signal source content is obtained by filling the complete rotation signal source content grayscale value into the rotation signal source content.

[0047] Preferably, the step of obtaining a correct signal source display image through a content adjustment model according to the complete rotation signal source content includes:

[0048] S401: Acquire the size of the complete rotation signal source content and the rotation screen size, and obtain the adjusted signal source content through matching judgment according to the size of the complete rotation signal source content and the rotation screen size;

[0049] The matching judgment includes judging whether the size of the complete rotating signal source content is the same as the size of the rotating screen. If yes, uploading the complete rotating signal source content to the electronic whiteboard integrated machine screen to obtain a rotating content screen;

[0050] If not, execute step S402;

[0051] S402: Obtaining the correct signal source display image by scaling the model according to the adjusted signal source content;

[0052] S403: Obtaining a rotating content screen by uploading the correct signal source display image to the electronic whiteboard integrated machine screen, wherein the rotating content screen carries a display abnormality label;

[0053] S404: obtaining a correctly rotated content screen through display judgment according to the display abnormality label;

[0054] The display judgment includes judging whether the display abnormality tag is 1, and if so, obtaining the correctly rotated content screen;

[0055] If not, re-spin.

[0056] An electronic whiteboard integrated machine screen rotation adaptive signal source content display system and a method for displaying content of an electronic whiteboard integrated machine screen rotation adaptive signal source include a screen change module, a data acquisition and analysis module, an image processing module, and a content adjustment module, including:

[0057] The screen change module is used to obtain the screen direction, which includes a horizontal screen mode and a vertical screen mode, and obtain the screen change direction by changing the screen direction;

[0058] The data acquisition and analysis module is used to acquire signal source content through the system interface, and obtain signal source content analysis results through a content analysis model according to the signal source content and the screen change direction;

[0059] The image processing module is used to obtain the complete rotation signal source content through the image processing model according to the signal source content analysis result;

[0060] The content adjustment module is used to obtain a correct signal source display image according to the complete rotation signal source content through a content adjustment model.

[0061] An electronic device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard integrated machine when executing the program.

[0062] A storage medium containing computer executable instructions, wherein the computer executable instructions are used to execute the above-mentioned electronic whiteboard integrated machine screen rotation adaptive signal source content display method when executed by a computer processor.

[0063] The beneficial effects of the present invention are:

[0064] (1) Through change judgment, direction matching judgment, straight line direction matching judgment, threshold judgment, matching judgment, and display judgment, each step of the entire process of the electronic whiteboard integrated machine screen rotating adaptive signal source content is judged, which can timely discover problems and improve the accuracy and efficiency of the method.

[0065] (2) The straight line features of the image are obtained by processing the grayscale image of the whiteboard edge through Hough transformation. The content layout is judged based on the straight line features of the image, which reduces the amount of calculation, improves the detection efficiency, and provides a data basis for subsequent content adjustment.

[0066] (3) Linear interpolation is performed in two directions through a bilinear interpolation model, so that the transition of the interpolation result in the image or data grid is smoother. By filling in the missing values ​​of the rotation signal source content, the rotation signal source content is made more complete and can cope with the enlargement and reduction of the image.

[0067] (4) By scaling the model, the signal source content is adjusted to fit the rotated electronic whiteboard integrated machine screen, thereby increasing the clarity of the image, making the image display complete, and the content display clear. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] In order to facilitate understanding by those skilled in the art, the present invention is further described below with reference to the accompanying drawings.

[0069] Figure 1 The invention discloses a method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard integrated machine. DETAILED DESCRIPTION

[0070] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the specific implementation methods, structures, features and effects of the present invention are described in detail below in conjunction with the accompanying drawings and preferred embodiments.

[0071] See also Figure 1 , a method for displaying content of a signal source with screen rotation self-adaptation of an electronic whiteboard integrated machine, comprising:

[0072] S1: Acquire a screen direction, where the screen direction includes a horizontal screen mode and a vertical screen mode, and obtain a screen change direction by changing the screen direction;

[0073] S2: collecting signal source content through the system interface, and obtaining a signal source content analysis result through a content analysis model according to the signal source content and the screen change direction;

[0074] S3: Obtaining the complete rotation signal source content through an image processing model according to the signal source content analysis result;

[0075] S4: Obtaining a correct signal source display image through a content adjustment model according to the complete rotation signal source content.

[0076] In step S1, the change judgment includes judging whether the screen orientation is in the horizontal mode, and if so, monitoring the screen orientation change through an event listener until the screen orientation is in the vertical mode;

[0077] If not, the screen change direction is obtained and step S2 is executed.

[0078] In step S2, obtaining a signal source content analysis result through a content analysis model according to the signal source content includes:

[0079] S201: Obtaining content layout according to the signal source content through a format recognition model;

[0080] S202: Obtain the signal source content analysis result through direction matching judgment according to the content layout and the screen change direction.

[0081] Specifically, the format recognition model includes:

[0082] S201-1: Obtaining a whiteboard grayscale image by grayscale image calculation according to the signal source content;

[0083] The grayscale image calculation expression is:

[0084] Gray=0.299*R+0.587*G+0.114*B,

[0085] Wherein, Gray represents the grayscale image of the whiteboard, R represents red among the three primary colors, G represents green among the three primary colors, and B represents blue among the three primary colors;

[0086] S201-2: extracting edges from the whiteboard grayscale image by using the Canny algorithm to obtain a whiteboard edge grayscale image;

[0087] S201-3: Obtain image straight line features through Hough transformation according to the grayscale image of the whiteboard edge, wherein the image straight line features include image straight line position and image straight line direction. The image straight line direction includes horizontal and vertical directions;

[0088] S201-4: Obtaining the content layout by judging the straight line direction according to the straight line direction of the image, wherein the content layout includes a horizontal content layout and a vertical content layout;

[0089] The straight line direction determination includes determining whether the straight line direction of the image is horizontal, and if so, obtaining the horizontal content layout;

[0090] If not, the vertical content layout is obtained.

[0091] Specifically, the Hough transform includes presetting a parameter space, obtaining edge points of the image data, and obtaining a straight line distance and a straight line angle by mapping the edge points to the parameter space; obtaining an edge point curve through a Hough line expression according to the straight line distance and the straight line angle; presetting an accumulator matrix, each unit position of the accumulator matrix corresponds to a set of straight line parameters, the straight line parameters include the straight line distance and the straight line angle, and obtaining a parameter space curve accumulation value by accumulating the edge point curve through the accumulator matrix; presetting a curve accumulation threshold, and obtaining the image straight line feature through threshold judgment according to the parameter space curve accumulation value and the curve accumulation threshold.

[0092] Specifically, the Hough line expression is:

[0093] ρ=xcosθ+ysinθ,

[0094] Among them, ρ represents the straight line distance, θ represents the straight line angle, x represents the horizontal coordinate of the edge point, y represents the vertical coordinate of the edge point, cos represents the cosine function, and sin represents the sine function.

[0095] Specifically, the accumulator matrix accumulation specifically includes that when the edge point is mapped to the parameter space, the corresponding unit position value of the accumulator is added by 1 to obtain the parameter space curve accumulation value. If the parameter space curve accumulation value exceeds the curve accumulation threshold, it means that there is a straight line at this unit position.

[0096] Specifically, the threshold judgment includes judging whether the parameter space curve accumulation value is less than the curve accumulation threshold value, and if so, continuing the accumulator matrix accumulation;

[0097] If not, the image straight line feature is obtained.

[0098] In step S202, the direction matching judgment includes judging whether the content layout and the screen change direction are the same, and if yes, no step is performed;

[0099] If not, the signal source content analysis result is obtained and step S3 is executed.

[0100] In step S3, the image processing model includes:

[0101] S301: Obtaining a signal source content rotation angle by calculating a rotation matrix according to the signal source content analysis result;

[0102] The rotation matrix calculation expression is:

[0103]

[0104] Wherein, R is a rotation matrix, θ′ is the rotation angle of the signal source content, sin(θ′) represents the sine value of the rotation angle of the signal source content, and cos(θ′) represents the cosine value of the rotation angle of the signal source content;

[0105] S302: Obtaining rotated signal source content by rotating the signal source content according to the rotation angle of the signal source content;

[0106] S303: Obtain complete rotation signal source content through a bilinear interpolation model according to the rotation signal source content.

[0107] In step S303, the bilinear interpolation model includes:

[0108] S303-1: Preset a rotation signal source content coordinate system, wherein the rotation signal source content coordinate system takes the center of the rotation signal source content as the origin, obtains interpolation coordinates, and obtains neighboring point coordinates according to the interpolation coordinates, wherein the neighboring point coordinates include neighboring point coordinates with the same horizontal coordinate and neighboring point coordinates with the same vertical coordinate;

[0109] P(x,y),Q 11 (x 1 ,y 1 ), Q 12 (x 1 ,y 2 ), Q 21 (x 2 ,y 1 ), Q 22 (x 2 ,y 2 ),

[0110] Wherein, P(x, y) is the interpolation coordinate, Q 11 (x 1 ,y 1) are the coordinates of the adjacent points with the same horizontal coordinate, Q 12 (x 1 ,y 2 ) The coordinates of the adjacent points with the same ordinate, Q 21 (x 2 ,y 1 ) The coordinates of the adjacent points with the same horizontal coordinate, Q 22 (x 2 ,y 2 ) The vertical coordinates are the same as the adjacent point coordinates, x is the horizontal coordinate of the coordinates of point P, y is the vertical coordinate of the coordinates of point P, x 1 Q 11 and Q 12 The horizontal axis, y 1 Q 11 and Q 21 The vertical coordinate, x 2 Q 21 and Q 22 The horizontal axis, y 2 Q 12 and Q 22 The vertical coordinate of

[0111] S303-2: Obtaining grayscale values ​​of neighboring point coordinates, wherein the grayscale values ​​of neighboring point coordinates include grayscale values ​​of neighboring point coordinates with the same horizontal coordinate and grayscale values ​​of neighboring point coordinates with the same vertical coordinate, and obtaining grayscale values ​​of points with the same horizontal coordinate by performing an X-direction interpolation calculation based on the grayscale values ​​of neighboring point coordinates with the same horizontal coordinate;

[0112] The X-direction interpolation calculation expression is:

[0113] d(x,y 1 )=d(x 1 ,y 1 )+p×[d(x 2 ,y 1 )-d(x 1 ,y 1 )],

[0114] p=x-[x],

[0115] Among them, d(x, y 1 ) is the gray value of the same point on the horizontal coordinate, d(x 1 ,y 1 ) is the coordinate Q of the adjacent point with the same horizontal coordinate 11 Gray value, d(x 2 ,y 1 ) is the coordinate Q of the adjacent point with the same horizontal coordinate 21 Gray value, p is the coefficient, x is the abscissa of the interpolation coordinate, [x] represents the maximum integer not exceeding x;

[0116] S303-3: Obtain the grayscale value of the point with the same vertical coordinate by performing secondary X-direction interpolation calculation based on the grayscale value of the neighboring points with the same vertical coordinate;

[0117] The secondary X-direction interpolation calculation expression is:

[0118] d(x,y 2 )=d(x 1 ,y 2 )+p×[d(x 2 ,y 2 )-d(x 1 ,y 2 )],

[0119] p=x-[x],

[0120] Among them, d(x,y 2 ) is the gray value of the same point on the ordinate, d(x 1 ,y 2 ) is the coordinate Q of the adjacent point with the same ordinate 12 Gray value, d(x 2 ,y 2 ) is the coordinate Q of the adjacent point with the same ordinate 22 Gray value, p is the coefficient, x is the abscissa of the interpolation coordinate, [x] represents the maximum integer not exceeding x;

[0121] S303-4: Obtaining the grayscale value of the complete rotation signal source content by interpolation calculation in the Y direction according to the grayscale value of the same point on the horizontal coordinate and the grayscale value of the same point on the vertical coordinate;

[0122] The Y-direction interpolation calculation expression is:

[0123] d(x,y)=d(x,y 1 )+q×[d(x,y 2 )-d(x,y 1 )],

[0124] q=y-[y],

[0125] Wherein, d(x,y) is the grayscale value of the complete rotation signal source content, d(x,y 1 ) is the gray value of the same point on the horizontal coordinate, d(x,y 2 ) is the gray value of the same point on the ordinate, q is the coefficient, y is the ordinate of the interpolation coordinate, and [y] represents the maximum integer not exceeding y;

[0126] S303-5: Obtain the complete rotation signal source content by filling the complete rotation signal source content grayscale value into the rotation signal source content.

[0127] In step S4, the content adjustment model includes:

[0128] S401: Acquire the size of the complete rotation signal source content and the rotation screen size, and obtain the adjusted signal source content through matching judgment according to the size of the complete rotation signal source content and the rotation screen size;

[0129] The matching judgment includes judging whether the size of the complete rotating signal source content is the same as the size of the rotating screen. If yes, uploading the complete rotating signal source content to the electronic whiteboard integrated machine screen to obtain a rotating content screen;

[0130] If not, execute step S402.

[0131] S402: Obtaining the correct signal source display image by scaling the model according to the adjusted signal source content;

[0132] The scaling model expression is:

[0133]

[0134] Among them, x 0 Indicates the horizontal coordinate of the pixel point in the adjusted signal source content, x′ 0 Indicates the horizontal coordinate of the pixel point in the image displayed by the correct signal source, y 0 Indicates the vertical coordinate of the pixel point in the adjusted signal source content, y′ 0 Indicates the vertical coordinate of the pixel in the image displayed by the correct signal source, f x represents the horizontal scaling factor, f y Vertical scaling factor;

[0135] S403: Obtaining a rotating content screen by uploading the correct signal source display image to the electronic whiteboard integrated machine screen, wherein the rotating content screen carries a display abnormality label;

[0136] S404: obtaining a correctly rotated content screen through display judgment according to the display abnormality label;

[0137] The display judgment includes judging whether the display abnormality tag is 1, and if so, obtaining the correctly rotated content screen;

[0138] If not, re-spin.

[0139] In this embodiment, the smart terminal selects the screen orientation through system settings, and the screen orientation includes horizontal and vertical orientations. The correct signal source display image is obtained according to the screen orientation through the content analysis model, the image processing model and the content adjustment model. The correct signal source display image is uploaded to the screen of the electronic whiteboard all-in-one machine for viewing by the smart terminal.

[0140] An electronic whiteboard integrated machine screen rotation adaptive signal source content display system and a method for displaying content of an electronic whiteboard integrated machine screen rotation adaptive signal source include a screen change module, a data acquisition and analysis module, an image processing module, and a content adjustment module, including:

[0141] The screen change module is used to obtain the screen direction, which includes a horizontal screen mode and a vertical screen mode, and obtain the screen change direction by changing the screen direction;

[0142] The data acquisition and analysis module is used to acquire signal source content through the system interface, and obtain signal source content analysis results through a content analysis model according to the signal source content and the screen change direction;

[0143] The image processing module is used to obtain the complete rotation signal source content through the image processing model according to the signal source content analysis result;

[0144] The content adjustment module is used to obtain a correct signal source display image according to the complete rotation signal source content through a content adjustment model.

[0145] The computer storage medium of the embodiment of the present invention may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device.

[0146] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0147] The program code included on the computer readable medium can be transmitted with any appropriate medium, including but not limited to wireless, electric wire, optical cable, RF, etc., or any suitable combination of the above. The computer program code for performing the operation of the present invention can be written in one or more programming languages ​​or their combinations, and the programming language includes object-oriented programming languages-such as Java, Smalltalk, C++, and also includes conventional procedural programming languages-such as "C" language or similar programming languages. The program code can be executed completely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on the remote computer, or completely on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0148] The above description is only a preferred embodiment of the present invention and does not limit the present invention in any form. Although the present invention has been disclosed as a preferred embodiment as above, it is not used to limit the present invention. Any technical personnel in this field can make some changes or modify the technical contents disclosed above into equivalent embodiments without departing from the scope of the technical solution of the present invention. However, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present invention without departing from the content of the technical solution of the present invention still fall within the scope of the technical solution of the present invention.

Claims

1. A method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard integrated machine, characterized in that: The following steps are involved: Obtaining a screen direction, wherein the screen direction includes a landscape mode and a portrait mode, and obtaining a screen change direction by changing the screen direction; Collecting signal source content through the system interface, and obtaining a signal source content analysis result through a content analysis model according to the signal source content and the screen change direction; Obtaining the complete rotation signal source content through an image processing model according to the signal source content analysis result; A correct signal source display image is obtained through a content adjustment model according to the complete rotation signal source content.

2. The method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard according to claim 1, characterized in that: The change judgment includes judging whether the screen direction is in the horizontal screen mode, and if so, monitoring the screen direction change through an event listener until the screen direction is in the vertical screen mode; If not, the screen change direction is obtained and subsequent steps are performed.

3. The method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard according to claim 1, characterized in that: The obtaining of a signal source content analysis result by using a content analysis model according to the signal source content comprises: Obtaining content layout according to the signal source content through a format recognition model; The signal source content analysis result is obtained by direction matching judgment according to the content layout and the screen change direction.

4. The method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard according to claim 3, characterized in that: The obtaining of content layout according to the signal source content through a format recognition model comprises: Obtaining a whiteboard grayscale image through grayscale image calculation according to the signal source content; Extracting edges from the whiteboard grayscale image using the Canny algorithm to obtain a whiteboard edge grayscale image; According to the grayscale image of the whiteboard edge, the image straight line feature is obtained by Hough transformation, and the image straight line feature includes the image straight line position and the image straight line direction. The image straight line direction includes horizontal and vertical directions; The content layout is obtained by judging the straight line direction according to the straight line direction of the image, and the content layout includes a horizontal content layout and a vertical content layout.

5. The method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard according to claim 4, characterized in that: The Hough transform specifically includes: Preset a parameter space, obtain edge points of the image data, and obtain a straight line distance and a straight line angle by mapping the edge points to the parameter space; Obtaining an edge point curve by using a Hough line expression according to the straight line distance and the straight line angle; An accumulator matrix is ​​preset, each unit position of the accumulator matrix corresponds to a set of straight line parameters, the straight line parameters include the straight line distance and the straight line angle, and the parameter space curve accumulation value is obtained by accumulating the edge point curve through the accumulator matrix; A curve accumulation threshold is preset, and the image straight line feature is obtained through threshold judgment according to the parameter space curve accumulation value and the curve accumulation threshold.

6. The method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard integrated machine according to claim 5, characterized in that: The accumulator matrix accumulation specifically includes, when mapping the edge point to the parameter space, adding 1 to the corresponding unit position value of the accumulator to obtain the parameter space curve accumulation value. If the parameter space curve accumulation value exceeds the curve accumulation threshold, it means that there is a straight line at this unit position.

7. The method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard according to claim 5, characterized in that: The threshold judgment includes judging whether the parameter space curve accumulation value is less than the curve accumulation threshold value, and if so, continuing the accumulator matrix accumulation; If not, the image straight line feature is obtained.

8. The method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard according to claim 4, characterized in that: The straight line direction determination includes determining whether the straight line direction of the image is horizontal, and if so, obtaining the horizontal content layout; If not, the vertical content layout is obtained.

9. The method for displaying content of a signal source by adaptively rotating the screen of an electronic whiteboard integrated machine according to claim 3, characterized in that: The direction matching judgment includes judging whether the content layout and the screen change direction are the same, and if yes, no step is performed; If not, the signal source content analysis result is obtained and subsequent steps are performed.

10. The method for displaying content of a signal source with screen rotation self-adaptation of an electronic whiteboard integrated machine according to claim 1, characterized in that: The obtaining of the complete rotation signal source content through the image processing model according to the signal source content analysis result comprises: According to the signal source content analysis result, a signal source content rotation angle is obtained by calculating a rotation matrix; Obtaining rotated signal source content by rotating the signal source content according to the rotation angle of the signal source content; The complete rotation signal source content is obtained through a bilinear interpolation model according to the rotation signal source content.

11. The method for displaying content of a signal source with screen rotation self-adaptation of an electronic whiteboard integrated machine according to claim 10, characterized in that: The step of obtaining the complete rotation signal source content through a bilinear interpolation model according to the rotation signal source content comprises: Preset the rotation signal source content coordinate system, obtain interpolation coordinates, and obtain neighboring point coordinates according to the interpolation coordinates, wherein the neighboring point coordinates include neighboring point coordinates with the same horizontal coordinate and neighboring point coordinates with the same vertical coordinate; The interpolation coordinates and the neighboring point coordinates are expressed as: P(x,y),Q 11 (x1,y1),Q 12 (x1,y2),Q 21 (x2,y1),Q 22 (x2,y2), Wherein, P(x, y) is the interpolation coordinate, Q 11 (x1, y1) are the coordinates of the adjacent points with the same horizontal coordinate, Q 12 (x1, y2) the coordinates of the neighboring points with the same ordinate, Q 21 (x2, y1) The coordinates of the neighboring points with the same horizontal coordinates, Q 22 (x2, y2) The ordinates are the same as the coordinates of the neighboring point, x is the abscissa of the coordinates of point P, y is the ordinate of the coordinates of point P, x1 is Q 11 and Q 12 The horizontal coordinate of y1 is Q 11 and Q 21 The vertical coordinate of x2 is Q 21 and Q 22 The horizontal coordinate of y2 is Q 12 and Q 22 The vertical coordinate of Obtaining grayscale values ​​of neighboring point coordinates, wherein the grayscale values ​​of neighboring point coordinates include grayscale values ​​of neighboring point coordinates with the same horizontal coordinate and grayscale values ​​of neighboring point coordinates with the same vertical coordinate; The grayscale value of the point with the same horizontal coordinate is obtained by performing an X-direction interpolation calculation based on the grayscale value of the coordinates of the adjacent points with the same horizontal coordinate; The grayscale value of the same point on the ordinate is obtained by performing a secondary X-direction interpolation calculation based on the grayscale value of the coordinates of the neighboring points on the ordinate; The grayscale value of the complete rotation signal source content is obtained by interpolating the grayscale value of the same point on the horizontal coordinate and the grayscale value of the same point on the vertical coordinate through Y direction; The complete rotation signal source content is obtained by filling the complete rotation signal source content grayscale value into the rotation signal source content.

12. The method for displaying content of a signal source with screen rotation self-adaptation of an electronic whiteboard integrated machine according to claim 1, characterized in that: The method of obtaining a correct signal source display image by adjusting the content model according to the complete rotation signal source content includes: S401: Acquire the size of the complete rotation signal source content and the rotation screen size, and obtain the adjusted signal source content through matching judgment according to the size of the complete rotation signal source content and the rotation screen size; The matching judgment includes judging whether the size of the complete rotating signal source content is the same as the size of the rotating screen. If yes, uploading the complete rotating signal source content to the electronic whiteboard integrated machine screen to obtain a rotating content screen; If no, then execute step S402; S402: Obtaining the correct signal source display image by scaling the model according to the adjusted signal source content; S403: Obtaining a rotating content screen by uploading the correct signal source display image to the electronic whiteboard integrated machine screen, wherein the rotating content screen carries a display abnormality label; S404: obtaining a correctly rotated content screen through display judgment according to the display abnormality label; The display judgment includes judging whether the display abnormality tag is 1, and if so, obtaining the correctly rotated content screen; If not, re-spin.

13. An electronic whiteboard integrated machine screen rotation adaptive signal source content display system using the electronic whiteboard integrated machine screen rotation adaptive signal source content display method according to claim 1, comprising a screen change module, a data acquisition and analysis module, an image processing module, and a content adjustment module, characterized in that: include: The screen change module is used to obtain the screen direction, which includes a horizontal screen mode and a vertical screen mode, and obtain the screen change direction by changing the screen direction; The data acquisition and analysis module is used to acquire signal source content through the system interface, and obtain signal source content analysis results through a content analysis model according to the signal source content and the screen change direction; The image processing module is used to obtain the complete rotation signal source content through the image processing model according to the signal source content analysis result; The content adjustment module is used to obtain a correct signal source display image according to the complete rotation signal source content through a content adjustment model.

14. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method for displaying content of an electronic whiteboard integrated machine with screen rotation and adaptive signal source as described in any one of claims 1 to 12 is implemented.

15. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions are used to execute the screen rotation adaptive signal source content display method of the electronic whiteboard integrated machine as described in any one of claims 1-12 when executed by a computer processor.

Images