Dynamic display method and system for display screen of mobile communication equipment

Abstract

The invention discloses a dynamic display method and system for a display screen of mobile communication equipment, and relates to the technical field of the mobile communication equipment, and the method comprises the steps: determining a current use system of a plurality of sub display screens based on a use scene, a current contact position of the display screen of the mobile communication equipment and the use preference of a user relative to the display screen; the accuracy of the current use system of the plurality of sub-display screens is ensured, and accurate management and control of the plurality of sub-display screens are realized. Furthermore, in the current use system of the plurality of sub display screens, the current use coefficients of the plurality of sub display screens are marked, and the presentation angles of the display interfaces corresponding to the plurality of sub display screens are determined according to the current use coefficients of the plurality of sub display screens, the current posture of the user and the content displayed by the plurality of sub display screens. The dynamic adaptation of the display interfaces corresponding to the plurality of sub-display screens relative to the user is ensured, and meanwhile, the directional display of the display interfaces corresponding to the plurality of sub-display screens is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of mobile communication equipment, and in particular to a dynamic display method and system for a display screen of a mobile communication equipment. Background Art

[0002] With the development of science and technology, mobile communication devices are gradually applied to people's lives. Smartphones are a type of mobile communication devices, including foldable phones. At this time, the mobile communication device contains multiple sub-display screens, each of which is independent of each other and distributed at different positions of the mobile communication device. In the prior art, the display interface corresponding to the multiple sub-display screens only has horizontal display or vertical display, and does not fully consider the user's current posture and the content displayed by the multiple sub-display screens, and cannot determine the presentation angle of the display interface corresponding to the multiple sub-display screens. Summary of the invention

[0003] The purpose of the present invention is to overcome the deficiencies of the prior art. The present invention provides a dynamic display method and system for a display screen of a mobile communication device.

[0004] An embodiment of the present invention provides a method for dynamic display of a display screen of a mobile communication device, comprising: when the display screen of the mobile communication device contains multiple sub-display screens, collecting the spatial positions of the multiple sub-display screens; determining the opening form of the display screen of the mobile communication device based on the spatial positions of the multiple sub-display screens; determining the usage scenario of the display screen of the mobile communication device according to the opening form of the display screen of the mobile communication device, the contents displayed by the multiple sub-display screens, and the priority of the multiple sub-display screens; determining the current usage system of the multiple sub-display screens based on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference relative to the display screen; in the current usage system of the multiple sub-display screens, marking the current usage coefficients of the multiple sub-display screens, and determining the presentation angles of the display interfaces corresponding to the multiple sub-display screens according to the current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed by the multiple sub-display screens; determining the dynamic display mode of the display screen of the mobile communication device according to the presentation angles of the display interfaces corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and triggering the directional presentation of the display interfaces corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command.

[0005] An embodiment of the present invention provides a dynamic display system for a display screen of a mobile communication device, wherein the dynamic display system for a display screen of a mobile communication device is applied to the dynamic display method for a display screen of a mobile communication device described above, and the dynamic display system for a display screen of a mobile communication device comprises:

[0006] A collection module, used for collecting the spatial positions of the multiple sub-display screens when the display screen of the mobile communication device contains multiple sub-display screens;

[0007] A shape module, used to determine the opening shape of the display screen of the mobile communication device based on the spatial positions of the multiple sub-display screens;

[0008] A scenario module, used to determine a usage scenario of the display screen of the mobile communication device according to the opening state of the display screen of the mobile communication device, the contents displayed by the multiple sub-display screens, and the priorities of the multiple sub-display screens;

[0009] A usage system module for determining a current usage system of the plurality of sub-display screens based on the usage scenario, a current contact position of the display screen of the mobile communication device, and a user's usage preference with respect to the display screen;

[0010] An angle module, used to mark the current usage coefficients of the multiple sub-display screens in the current usage system of the multiple sub-display screens, and determine the presentation angles of the display interfaces corresponding to the multiple sub-display screens according to the current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed by the multiple sub-display screens;

[0011] The directional module is used to determine the dynamic display mode of the display screen of the mobile communication device according to the presentation angles of the display interfaces corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and trigger the directional presentation of the display interfaces corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command.

[0012] In an embodiment of the present invention, through the method in the embodiment of the present invention, when the display screen of a mobile communication device contains multiple sub-display screens, the spatial positions of the multiple sub-display screens are collected; the opening state of the display screen of the mobile communication device is determined based on the spatial positions of the multiple sub-display screens; the usage scenario of the display screen of the mobile communication device is determined according to the opening state of the display screen of the mobile communication device, the content displayed by the multiple sub-display screens, and the priority of the multiple sub-display screens; based on the usage scenario, the current contact position of the display screen of the mobile communication device and the user's usage preference relative to the display screen, the current usage system of the multiple sub-display screens is determined, which is compatible with the overall consideration of the usage scenario, the current contact position of the display screen of the mobile communication device and the user's usage preference relative to the display screen, ensures the accuracy of the current usage system of the multiple sub-display screens, and realizes precise control of the multiple sub-display screens.

[0013] Furthermore, in the current usage system of multiple sub-display screens, current usage coefficients of the multiple sub-display screens are marked, and presentation angles of the display interfaces corresponding to the multiple sub-display screens are determined based on the current usage coefficients of the multiple sub-display screens, the current postures of the users, and the contents displayed on the multiple sub-display screens, thereby achieving control of the presentation angles of the display interfaces corresponding to the multiple sub-display screens and ensuring dynamic adaptation of the display interfaces corresponding to the multiple sub-display screens relative to the users.

[0014] Therefore, the dynamic display mode of the display screen of the mobile communication device is determined according to the presentation angles of the display interfaces corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and the directional presentation of the display interfaces corresponding to the multiple sub-display screens is triggered based on the dynamic display mode and the user's voice commands, thereby realizing the directional presentation of the display interfaces corresponding to the multiple sub-display screens and ensuring the directional display of the display interfaces corresponding to the multiple sub-display screens. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A schematic diagram of an application scenario of a dynamic display method of a display screen of a mobile communication device in one embodiment;

[0016] Figure 2 is a schematic flow chart of a dynamic display method of a display screen of a mobile communication device in an embodiment of the present invention;

[0017] Figure 3 is a schematic diagram of the structural composition of a dynamic display system of a display screen of a mobile communication device in an embodiment of the present invention;

[0018] Figure 4 The figure is a hardware diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0019] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0020] Embodiment 1

[0021] The dynamic display method of the display screen of the mobile communication device provided in the present application can be applied to Figure 1 In the application environment shown, the computer 102 communicates with the server 104 through the network. The terminal 102 can be, but is not limited to, various personal computers, servers, and mobile communication devices, and the server 104 can be implemented as an independent server or a server cluster composed of multiple servers.

[0022] Embodiment 2

[0023] See also Figures 1 to 4, a dynamic display method for a display screen of a mobile communication device, applied to a dynamic display scene of a display screen of a mobile communication device; the dynamic display method for a display screen of a mobile communication device comprises:

[0024] Step S11: when the display screen of the mobile communication device includes multiple sub-display screens, collecting the spatial positions of the multiple sub-display screens;

[0025] Step S12: determining the opening state of the display screen of the mobile communication device based on the spatial positions of the plurality of sub-display screens;

[0026] Step S13: determining a usage scenario of the display screen of the mobile communication device according to the opening state of the display screen of the mobile communication device, the contents displayed on the multiple sub-display screens, and the priorities of the multiple sub-display screens;

[0027] Step S14: determining a current usage system of the plurality of sub-display screens based on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference with respect to the display screen;

[0028] Step S15: marking the current usage coefficients of the multiple sub-display screens in the current usage system of the multiple sub-display screens, and determining the presentation angles of the display interfaces corresponding to the multiple sub-display screens according to the current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed by the multiple sub-display screens;

[0029] Step S16: Determine the dynamic display mode of the display screen of the mobile communication device according to the presentation angles of the display interfaces corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and trigger the directional presentation of the display interfaces corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command.

[0030] In step S11, when the display screen of the mobile communication device includes multiple sub-display screens, the spatial positions of the multiple sub-display screens are collected;

[0031] In the specific implementation process of the present invention, the specific steps are:

[0032] S111: determining a plurality of screen signals based on screen detection of a display screen of a mobile communication device;

[0033] S112: determining a plurality of sub-display screens according to the analysis of the plurality of screen signals, wherein the display screen of the mobile communication device includes a plurality of sub-display screens;

[0034] S113: constructing a spatial coordinate system based on the display screen of the mobile communication device, and marking corresponding coordinates of the plurality of sub-display screens;

[0035] S114: Determine the spatial positions of the multiple sub-display screens according to the coordinates of the multiple sub-display screens.

[0036] In an embodiment of the present application, multiple screen signals are determined based on screen detection of the display screen of the mobile communication device; multiple sub-display screens are determined based on the analysis of the multiple screen signals. At this time, the display screen of the mobile communication device contains multiple sub-display screens, which is compatible with the scenario where the display screen of the mobile communication device has multiple sub-display screens, so as to facilitate the management and control of the multi-fold screens and realize the subsequent management and control of the multiple sub-display screens.

[0037] Specifically, screen detection is performed on the display screen of the mobile communication device to realize screen detection of the display screen of the mobile communication device. Optionally, when the mobile communication device (such as a smart phone, tablet computer, etc.) is turned on or enters a specific mode, a screen detection system is started inside the mobile communication device. The screen detection system detects various parts of the display screen by sending and receiving electrical signals and outputs multiple screen signals.

[0038] Multiple screen signals are introduced and analyzed. By analyzing the signals, the mobile communication device can identify which signal combinations represent corresponding sub-display screens, thereby introducing the management and control of multiple sub-display screens. At the same time, for each identified sub-display screen, the device will further determine its properties, such as resolution, color depth, refresh rate, etc. Optionally, the display screen of the mobile communication device contains multiple sub-display screens.

[0039] An optional embodiment is a smart phone whose display screen is designed to be foldable and includes two sub-display screens: a main screen and an external screen. When the phone is turned on, the screen detection system starts to work and sends electrical signals to the entire display screen area. These signals are received and responses are generated on the main screen and the external screen. The response signals are collected and identified as coming from two independent sub-display screens. These signals are parsed in one step to determine the location, size, resolution and other properties of the main screen and the external screen. For example, the main screen may be located on the inside of the phone, with a higher resolution and larger size, and is used to display the main content and applications; while the external screen is located on the outside of the phone, with a smaller size, and is used to display basic information such as time and notifications.

[0040] Furthermore, a spatial coordinate system is constructed based on the display screen of the mobile communication device, and corresponding coordinates of multiple sub-display screens are marked; the spatial positions of the multiple sub-display screens are determined according to the coordinates of the multiple sub-display screens, which is compatible with the overall consideration of the coordinates of the multiple sub-display screens, realizes the comparison of the coordinates of the multiple sub-display screens, and ensures the accuracy of the spatial positions of the multiple sub-display screens.

[0041] Specifically, coordinate control is performed on the display screen of the mobile communication device. At this time, the spatial coordinate system of the display screen of the mobile communication device is introduced. Optionally, a suitable spatial coordinate system type is selected according to the display screen form of the mobile communication device (such as flat, curved, folded, etc.). For most flat display screens, a two-dimensional rectangular coordinate system is usually used; for more complex or three-dimensional display screens, a three-dimensional coordinate system may be required.

[0042] Optionally, a fixed point is selected on the display screen as the origin of the coordinate system. This point can be the upper left corner, lower right corner or other easily identifiable position of the display screen to determine the direction of the coordinate axis. In a two-dimensional coordinate system, the horizontal direction is usually selected as the X axis and the vertical direction is selected as the Y axis; in a three-dimensional coordinate system, a Z axis is added to represent the depth or height. Based on the origin, the direction of the coordinate axis and the size of the display screen, a spatial coordinate system of the display screen of the mobile communication device is established.

[0043] In the spatial coordinate system of the display screen of the mobile communication device, the display screen of the mobile communication device is introduced, and the boundary of each sub-display screen on the entire display screen is identified through screen detection or preset boundary information. For each sub-display screen, the coordinates of its four vertices or center points in the coordinate system are marked. These coordinate points can uniquely determine the position of the sub-display screen on the display screen, and the marked coordinate information is recorded inside the mobile communication device for subsequent use.

[0044] At the same time, the coordinate information of the markers is used to compare the positional relationship of different sub-displays in the coordinate system. This helps to understand the relative layout of the sub-displays and the shape of the overall display screen, and based on the coordinate comparison results, the precise position of each sub-display on the overall display screen is determined. This information is crucial for subsequent display content adjustment, user interface optimization, etc.

[0045] In an optional embodiment, a user is making a video call using a foldable screen mobile phone. During the call, the user wants the main screen to display the other party's video image, while the external screen displays call controls and related information. At this time, the main screen and the external screen are identified by the screen detection system, and a two-dimensional rectangular coordinate system is established. The coordinates of the main screen and the external screen in the coordinate system are marked and recorded inside the device. Based on these coordinate information, the device determines the precise positions of the main screen and the external screen on the display screen. In the video call application, the device displays the other party's video image on the main screen and the call controls and related information on the external screen according to the user's selection and preference. Since the device already accurately knows the position and size of the main screen and the external screen, it can ensure the correct layout of the displayed content and the best user experience.

[0046] In step S12, the opening state of the display screen of the mobile communication device is determined based on the spatial positions of the plurality of sub-display screens;

[0047] In the specific implementation process of the present invention, the specific steps are:

[0048] S121: Acquire the spatial positions of multiple sub-display screens;

[0049] S122: predicting the relative angle of each sub-display screen according to the spatial positions of the multiple sub-display screens;

[0050] S123: Collecting the outlines of multiple sub-display screens;

[0051] S124: if the outer contours of the plurality of sub-display screens are inconsistent, determining the spatial layout of the display screens of the mobile communication device according to the outer contours of the plurality of sub-display screens and the spatial positions of the plurality of sub-display screens;

[0052] S125: Determine the opening state of the display screen of the mobile communication device according to the spatial layout of the display screen of the mobile communication device and the relative angles of each sub-display screen.

[0053] In an embodiment of the present application, the spatial positions of multiple sub-display screens are obtained; the relative angles of each sub-display screen are predicted based on the spatial positions of the multiple sub-display screens, and the prediction of the relative angles of each sub-display screen is introduced to ensure the accuracy of the relative angles of each sub-display screen.

[0054] Among them, the spatial positions of multiple sub-display screens are obtained and the spatial positions of multiple sub-display screens are introduced to facilitate subsequent control of the spatial positions of the multiple sub-display screens.

[0055] At the same time, the spatial positions of multiple sub-display screens are predicted in angles, and the relative angles between the sub-display screens are calculated based on the position information of the sub-display screens using the principles of geometry and trigonometry. Optionally, the position of each sub-display screen is determined in the spatial coordinate system of the display screen of the mobile communication device. This is usually represented by coordinate values ​​obtained by measurement or detection, and the position of each sub-display screen is regarded as a vector. If the device is two-dimensional (such as a flat folding screen), these vectors can be two-dimensional vectors; if the device is three-dimensional (such as a foldable stereo display), these vectors can be three-dimensional vectors, and the formula for the vector angle is used to calculate the relative angle between the two sub-display screens. Optionally, in some complex cases, an angle algorithm can be used to predict the relative angle. This angle algorithm can learn from a large amount of position data and extract the features required to predict the relative angle.

[0056] In an optional embodiment, a folding screen mobile phone with two sub-display screens is taken as an example. When the mobile phone is in a folded state, the two sub-display screens are located on both sides of the mobile phone. The precise position information of the two sub-display screens can be obtained through the sensor or position detection system inside the mobile phone. According to the position information of the sub-display screens, the relative angle between them is calculated using geometric principles. For example, when the mobile phone is fully folded, the relative angle between the two sub-display screens is 0 degrees; when the mobile phone is unfolded to a certain angle, the relative angle between them can be calculated to be a certain value. This relative angle information can be used to adjust the user interface layout of the mobile phone to ensure that the content can be displayed and interacted correctly on the two sub-display screens. Optionally, assume that the user is watching a video on the mobile phone. When the mobile phone is unfolded from the folded state, the system automatically adjusts the size and position of the video window according to the relative angle of the sub-display screens to ensure that the video can be fully displayed on both sub-display screens without deformation.

[0057] Furthermore, the outer contours of the multiple sub-display screens are collected; if there are inconsistencies in the outer contours of the multiple sub-display screens, the spatial layout of the display screen of the mobile communication device is determined based on the outer contours of the multiple sub-display screens and the spatial positions of the multiple sub-display screens, thereby achieving overall control of the outer contours of the multiple sub-display screens and the spatial positions of the multiple sub-display screens, and ensuring the accuracy of the spatial layout of the display screen of the mobile communication device.

[0058] Specifically, the outer contours of multiple sub-display screens are introduced and controlled. At this time, an acquisition device is used to scan or photograph each sub-display screen to obtain the original data of its outer contour, and the original data is pre-processed, such as denoising and smoothing, to improve the accuracy and reliability of the data. The processed outer contours are recorded in digital form and stored in the device's memory or external storage medium.

[0059] At the same time, the display screen of the mobile communication device has multiple sub-display screens, and the outlines of the multiple sub-display screens are introduced. The collected outlines of the multiple sub-display screens are compared to check whether they are different. The similarity measure between the outlines of each sub-display screen is calculated by shape matching of the outlines of the multiple sub-display screens. According to the similarity measure value, it is determined whether the outlines of the sub-display screens are consistent. If the similarity measure value is lower than a certain threshold, it is considered that there are differences in the outlines of the two sub-display screens. According to the type and degree of the difference, it is determined whether further processing or adjustment is required.

[0060] For further control of the state of "if the outer contours of multiple sub-displays are inconsistent", the outer contours of multiple sub-displays and the spatial positions of multiple sub-displays are introduced. The spatial positions of multiple sub-displays are calibrated and transformed to match the contour data. Further, the contour data of each sub-display is matched with its corresponding spatial position information to facilitate the output of the matching result. According to the matching result, the spatial layout of the entire display is calculated.

[0061] In an alternative embodiment, the contour data of the sub-display (such as edge coordinates, shape features, etc.) is collected, and the spatial position information corresponding to each sub-display (such as coordinates, directions, dimensions, etc.) is collected. Key features are extracted from the contour data, such as the perimeter, area, centroid position, direction, etc. of the contour. These features are used as the input of the model, and the collected data is used to train the model so that it can learn the mapping relationship between the contour features and the spatial position information. For the contour data of a new sub-display, its features are extracted and input into the trained model, and the model outputs the predicted spatial position information. According to the predicted spatial position information, the spatial layout of the entire display is calculated.

[0062] In addition, a matching table is preset, which is used to store the contour features and the corresponding spatial position information. For the contour data of a new sub-display, its similarity with features such as A1 and A2 in the table is calculated, the feature with the highest similarity (such as A1) is found, and its corresponding spatial position information (such as x = 10, y = 20) is obtained. According to all the matched spatial position information, a spatial layout diagram of the entire display is drawn to present the spatial layout of the entire display.

[0063] Therefore, according to the spatial layout of the display of the mobile communication device and the relative angles of each sub-display, the opening form of the display of the mobile communication device is determined, which takes into account the overall consideration of the spatial layout of the display of the mobile communication device and the relative angles of each sub-display, and realizes the accuracy of the opening form of the display of the mobile communication device.

[0064] Specifically, the spatial layout of the display screen of the mobile communication device and the relative angles of each sub-display screen are introduced, and the spatial layout of the display screen of the mobile communication device and the relative angles of each sub-display screen are considered as a whole. At this time, after collecting the spatial layout of the display screen and the relative angles of the sub-display screens, an association model is established to describe the relationship between these elements. Once the association model is established, it can be applied to determine the opening form of the display screen based on the spatial layout of the display screen and the relative angles of the sub-display screens. This usually involves comparing and matching the actual measured angle and layout information with the predicted values ​​in the model. Based on the matching results, the current state of the display screen (such as fully unfolded, partially folded, or fully closed) and the relative positions of each sub-display screen can be determined.

[0065] Optionally, collect the spatial layout information of the display screen: the size of the main display screen is 7.6 inches, and the resolution is 2160x1914 pixels; the size of the sub-display screen is 6.5 inches, and the resolution is 2376x1080 pixels. The relative positions of the two in the folded state are known, and the relative angles of each sub-display screen are introduced. Based on geometric transformation and spatial coordinate system, a model describing the change of display screen morphology is established. The model can predict the degree of expansion of the display screen and the relative position of each sub-display screen according to the change of the angle. When the user opens the folding screen mobile phone, the angle measurement tool detects that the angle gradually increases to 180 degrees. By applying the association model, it can be determined that the mobile phone is in a fully expanded state at this time, and the main display screen and the sub-display screen are flat on the same plane. On the contrary, when the angle decreases to less than 180 degrees, the model will predict that the mobile phone is in a partially folded state and give the relative position information of each sub-display screen.

[0066] In step S13, the usage scenario of the display screen of the mobile communication device is determined according to the opening state of the display screen of the mobile communication device, the contents displayed on the multiple sub-display screens, and the priorities of the multiple sub-display screens;

[0067] In the specific implementation process of the present invention, the specific steps are:

[0068] S131: Acquire the opening state of the display screen of the mobile communication device;

[0069] S132: monitoring the plurality of sub-display screens in real time, and determining content types of the plurality of sub-display screens based on the contents displayed on the plurality of sub-display screens;

[0070] S133: determining a plurality of content areas according to the content types of the plurality of sub-display screens and synchronization signals between the plurality of sub-display screens;

[0071] S134: collecting priorities of the plurality of sub-display screens, and associating the opening state of the display screen of the mobile communication device, the plurality of content areas, and the priorities of the plurality of sub-display screens;

[0072] S135: Determine the usage scenario of the display screen of the mobile communication device according to the opening form of the display screen of the mobile communication device, multiple content areas, and the priorities of multiple sub-display screens.

[0073] In an embodiment of the present application, obtain the opening form of the display screen of the mobile communication device; monitor multiple sub-display screens in real time, determine the content types of the multiple sub-display screens based on the content displayed on the multiple sub-display screens, and perform subsequent control on the content types of the multiple sub-display screens.

[0074] Specifically, obtaining the opening form of the display screen of the mobile communication device introduces the opening form of the display screen of the mobile communication device. At the same time, monitor multiple sub-display screens in real time.

[0075] In the real-time monitoring of multiple sub-display screens, the content displayed on the multiple sub-display screens is introduced, and real-time images or video streams on each sub-display screen are captured. This can be achieved through technologies such as screen capture and video frame capture. For image content, computer vision technologies can be used to extract features, such as shape recognition, etc. These features help to distinguish different types of image content, such as natural scenery, portraits, charts, etc.

[0076] For image content, computer vision technologies can be used to extract features, such as edge detection, texture analysis, shape recognition, etc. These features help to distinguish different types of image content, such as natural scenery, portraits, charts, etc. For video content, in addition to extracting the features of single-frame images, the motion features, audio features, etc. of the video can also be analyzed to determine the type of the video, such as movies, TV shows, sports games, etc.

[0077] Furthermore, use a pre-trained machine learning model (such as a convolutional neural network CNN, etc.) to classify the extracted features. These models have learned to map features to specific content types. According to the output of the machine learning model, determine the content type of each sub-display screen. This may involve comparing the probability distributions output by the model, selecting the category with the highest probability as the final result, and formatting the final result into a form that is easy to understand and use. This may include assigning a label (such as "news", "video", "game", etc.) to each sub-display screen, or generating a summary report containing the content types of all sub-display screens, and presenting the formatted result to the user or integrating it into the user interface of the device. For example, an icon of the content type can be displayed in the status bar of the device, or different types of application windows can be distinguished by different colors or icons in the multitasking view.

[0078] In an optional embodiment, the formatted results are displayed to the user or integrated into the user interface of the device. For example, icons of content types can be displayed on the status bar of the device, or different types of application windows can be distinguished by different colors or icons in the multitasking view. Images and video frames on two sub-displays are captured. For news articles, the system extracts text features, such as keywords and sentence structures; for videos, the system extracts image features and audio features, and uses a machine learning model to classify the extracted features, determining that news articles belong to the "news" category and videos belong to the "video" category. Two icons are displayed on the status bar of the mobile phone, one for "news" and the other for "video", so as to intuitively show the user the content type of each sub-display.

[0079] Furthermore, multiple content areas are determined according to content types of multiple sub-display screens and synchronization signals between the multiple sub-display screens, thereby achieving multiple interactions of content types of multiple sub-display screens and synchronization signals between the multiple sub-display screens, and ensuring accurate division of multiple content areas.

[0080] At this point, multiple sub-displays have different content types and synchronization signals between them. The synchronization signals between them refer to the correlation or consistency between the displayed content of different sub-displays. For example, two sub-displays may play different parts of the same video at the same time, or display different views of the same application.

[0081] These synchronization signals need to be detected to determine which sub-displays have interrelated contents and should be considered as part of the same content area. After identifying the content type and detecting the synchronization signals, the system will determine multiple content areas based on this information. A content area refers to a collection of interrelated sub-displays that together present a complete content or function. Optionally, clustering is used to group sub-displays into different content areas.

[0082] Once the content area is determined, the system can implement multi-interaction capabilities. This means that users can perform actions related to the same content area on different sub-displays, and these actions will be reflected synchronously on all related sub-displays. For example, a user can scroll through a long document on one sub-display, and another sub-display showing a different part of the document will also scroll accordingly. This multi-interaction capability greatly improves the usability and user experience of the device.

[0083] To ensure accurate division of multiple content areas, the system may continuously monitor and update information on content types and synchronization signals. To ensure accurate division of multiple content areas, the system may continuously monitor and update information on content types and synchronization signals. This dynamic adjustment ensures that the division of content areas is always consistent with the user's actual usage and preferences.

[0084] In an optional embodiment, a user is using a smart phone with two foldable sub-displays, and an e-book reader application is displayed on the left sub-display, while different chapters of the same e-book are displayed on the right sub-display. The contents on the two sub-displays are synchronized because they both display different parts of the same e-book. Based on the content type and the information of the synchronization signal, the system determines that the two sub-displays belong to the same content area. The user can turn pages on the left sub-display, and the right sub-display will automatically synchronize to the corresponding page. This multi-interaction function allows users to browse e-books more conveniently. When the user switches to another application (for example, starts watching a video on the left sub-display), the system will re-evaluate and divide the content area to ensure that the new content area matches the user's current activity.

[0085] At the same time, the priorities of multiple sub-display screens are collected and associated with the opening state of the display screen of the mobile communication device, multiple content areas, and the priorities of multiple sub-display screens; the usage scenario of the display screen of the mobile communication device is determined according to the opening state of the display screen of the mobile communication device, the multiple content areas, and the priorities of multiple sub-display screens, which is compatible with the overall consideration of the opening state of the display screen of the mobile communication device, the multiple content areas, and the priorities of multiple sub-display screens, and realizes precise control of the usage scenarios of the display screen of the mobile communication device.

[0086] Specifically, the priority of multiple sub-displays is introduced, and the priority of each sub-display is collected. The priority may be determined based on the user's settings, the default configuration of the device, or the real-time usage. For example, the user may set a sub-display as the main working area, so it should have a higher priority. Or, if a sub-display is displaying urgent information (such as incoming calls, alarms, etc.), it may also be automatically given a higher priority.

[0087] The opening state of the display screen of the mobile communication device, the priorities of multiple content areas and multiple sub-display screens are associated, and at the same time, a complex mapping relationship is established to understand which content areas and sub-display screens have higher priorities under different display screen opening states, and adjust the display and behavior of the device accordingly. For example, when the device is in a folded state, the system may use a smaller sub-display screen for displaying notifications and shortcuts by default, and a larger sub-display screen for displaying main content and applications.

[0088] At the same time, the model learning method is to train a machine learning model so that it can predict and determine the usage scenario of the display screen according to the characteristics of the opening form of the display screen of the mobile communication device, multiple content areas, and the priority of multiple sub-display screens. At this time, a large amount of data on the usage scenarios of the display screen of the mobile communication device is collected, including the opening form of the display screen, content areas, sub-display screen priorities and other characteristics, as well as corresponding usage scenario labels, and the collected data is preprocessed and feature extracted. The original data is converted into a format that can be processed by the machine learning model, and a suitable machine learning algorithm (such as a neural network, etc.) is selected. The model is trained using the collected data, and the performance of the model is evaluated and optimized through methods such as cross-validation and adjustment of model parameters. The trained model is applied to actual devices to predict the usage scenario of the display screen based on the feature data input in real time.

[0089] Optionally, there is a mobile communication device with two foldable sub-displays, and the user often uses different applications when the device is in different open states. Through the model learning method, we can train a model to predict the usage scenarios of the device in different situations. When the device is in the unfolded state, the user may be more inclined to use the left sub-display for work (such as editing documents) and the right sub-display for entertainment (such as watching videos). At this time, the model can predict the current usage scenario as "work + entertainment" based on the characteristics of the display opening state, content area, and priority of the sub-display.

[0090] In addition, according to the characteristics of the device and user needs, a matching table is defined that includes the display opening state, content area, sub-display priority and corresponding usage scenarios. When the device is in a certain state, the corresponding usage scenario is searched in the matching table based on the real-time input feature data (such as the display opening state, content area, etc.).

[0091] Assume that there is a matching table for mobile communication devices as follows:

[0092]

[0093]

[0094] When the device is in the unfolded state, and the left sub-display screen displays a work document and the right sub-display screen plays a video, the current usage scenario can be determined as "work + entertainment" according to the matching table.

[0095] In step S14, a current usage system of the plurality of sub-display screens is determined based on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference with respect to the display screen;

[0096] In the specific implementation process of the present invention, the specific steps are:

[0097] S141: monitoring the display screen of the mobile communication device in real time, and collecting touch signals of the display screen of the mobile communication device;

[0098] S142: determining a current contact position of the display screen of the mobile communication device according to a touch signal of the display screen of the mobile communication device;

[0099] S143: collecting current user information of the display screen, and determining the user's usage preference with respect to the display screen according to the current user information and a display screen usage database;

[0100] S144: performing multiple interactions on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference with respect to the display screen;

[0101] S145: Determine a current usage system of the plurality of sub-display screens according to the usage scenario, the current contact position of the display screen of the mobile communication device, and multiple interactions of the user with respect to the usage preference of the display screen.

[0102] At this time, the display screen of the mobile communication device is monitored in real time, and the touch signal of the display screen of the mobile communication device is collected; the current contact position of the display screen of the mobile communication device is determined according to the touch signal of the display screen of the mobile communication device, and the current contact position of the display screen of the mobile communication device is introduced, thereby realizing the subsequent control of the current contact position of the display screen of the mobile communication device.

[0103] Specifically, the display screen of the mobile communication device is monitored in real time, and touch signals of the display screen of the mobile communication device are collected during the real-time monitoring. The touch signals of the display screen of the mobile communication device include the touch position, strength, duration, number of touch points, etc.

[0104] The collected touch signals are processed to extract key information, such as the specific location of the touch point. Based on the results of the signal processing, the system determines the specific location of the touch point on the display screen. Optionally, the touch screen controller usually provides a coordinate system for representing various locations on the display screen. The location of the touch point is determined based on the coordinate information in the touch signal, thereby determining the current contact position of the display screen of the mobile communication device.

[0105] An optional embodiment continuously monitors the status of the display screen. When the user's finger touches the screen, the touch screen controller detects this event and generates a touch signal, and collects these touch signals in real time, processes the collected touch signals, and extracts the coordinate information of the touch point. Based on the coordinate system provided by the touch screen controller, the system determines the specific position of the touch point on the display screen.

[0106] For example, suppose a user is browsing the web using a smartphone equipped with a touch screen. When the user touches a link on the screen with his finger, the touch screen controller detects the touch operation and generates a touch signal. The touch signal contains the coordinate information of the touch point, such as (500, 300). Based on these coordinate information, the touch point is determined to be located at a specific position on the display screen, that is, a link on the web page, triggering a click event of the link and opening the web page pointed to by the link.

[0107] Furthermore, the current user information of the display screen is collected, and the user's usage preference relative to the display screen is determined based on the current user information and the display screen usage database, thereby achieving a match between the current user information and the display screen usage database and introducing the user's usage preference relative to the display screen.

[0108] At this time, various types of information about users interacting with the display screen are collected, including but not limited to basic attributes of users (such as age, gender), device usage habits, historical operation records, etc. Collection methods may include active user input (such as registration information, questionnaires), automatic device records (such as usage time, operation frequency), and third-party data integration (such as social media behavior analysis).

[0109] The current user information and display screen usage database are introduced, and the collected user information is matched with the display screen usage database to identify the user's specific display screen usage habits and needs. The display screen usage database contains various preferences and settings of different users for the display screen, as well as related equipment performance, display effects and other information. The matching process may involve technical means such as data comparison and content matching to ensure that the user information accurately corresponds to the corresponding records in the database. After determining the user's usage preferences for the display screen, these preferences can be applied to the actual settings of the display screen to provide a personalized user experience.

[0110] In an optional embodiment, in a news application, the system can match the user's preference information with the display usage database to find similar user groups and their display settings. For example, the system may find that the user group generally prefers higher screen brightness contrast and smaller font size. At the same time, the news application can automatically adjust the screen brightness to the user's preferred level and apply a dark theme to reduce eye fatigue. At the same time, the application interface can also be optimized according to the user's one-handed operation habits, such as adjusting the button size and position for easy one-handed operation.

[0111] Furthermore, multiple interactions are performed on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference relative to the display screen; the current usage system of the multiple sub-display screens is determined based on the multiple interactions of the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference relative to the display screen, thereby achieving the multiple interactions of the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference relative to the display screen, and ensuring the accuracy of the current usage system of the multiple sub-display screens.

[0112] At this point, the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference relative to the display screen are introduced, and multiple interactions are performed on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference relative to the display screen, so as to achieve overall consideration of the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference relative to the display screen.

[0113] In the multiple interactions of the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference relative to the display screen, the user's current usage scenario (such as indoors, outdoors, driving, etc.), the current contact position of the display screen of the mobile communication device (i.e., the specific area that the user is touching or operating), and the user's usage preference relative to the display screen (such as brightness, color temperature, layout preference, etc.) are comprehensively considered. There is a mutual influence between these factors. At this time, an interaction model is established to capture these interaction relationships and dynamically adjust them according to real-time data to facilitate the identification of user behavior patterns in different scenarios and make intelligent decisions in combination with the user preference database.

[0114] At the same time, the usage scenario, the current contact position of the display screen of the mobile communication device and the user's usage preference relative to the display screen are introduced, and a current usage system is determined for each sub-display screen. The current usage system includes settings for display content, layout, interaction method, etc. The determination of the current usage system should ensure that users can get the best usage experience in different scenarios.

[0115] With respect to the determination of the current usage system for each sub-display screen, when the user actually uses the device, the system collects the current usage scenario, display screen contact position and usage preference information in real time, and inputs it into the trained usage system learning model. The usage system learning model predicts the optimal sub-display screen usage system based on the input information, and automatically adjusts the device's display and interaction settings. As user usage habits change, the system can regularly collect new data and retrain the usage system learning model to ensure the accuracy of the prediction results.

[0116] In step S15, in the current usage system of the multiple sub-display screens, the current usage coefficients of the multiple sub-display screens are marked, and the presentation angles of the display interfaces corresponding to the multiple sub-display screens are determined according to the current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed by the multiple sub-display screens;

[0117] In the specific implementation process of the present invention, the specific steps are:

[0118] S151: Obtaining the current usage system of multiple sub-display screens;

[0119] S152: In the current use system of the multiple sub-display screens, collecting the number of times the multiple sub-display screens are triggered within a preset time;

[0120] S153: determining current usage coefficients of the multiple sub-display screens according to the number of times the multiple sub-display screens are triggered within a preset time and the user's usage pattern with respect to the mobile communication device, and dynamically marking the current usage coefficients of the multiple sub-display screens;

[0121] S154: collecting a user's motion image, and determining a plurality of motion features according to recognition of the user's motion image;

[0122] S155: Determine the current posture of the user according to the plurality of motion features and the user's body features;

[0123] S156: Perform multiple interactions on current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed on the multiple sub-display screens; determine presentation angles of display interfaces corresponding to the multiple sub-display screens based on the multiple interactions on the current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed on the multiple sub-display screens.

[0124] At this time, the current usage system of the multiple sub-display screens is obtained; in the current usage system of the multiple sub-display screens, the number of times the multiple sub-display screens are triggered within a preset time is collected; the current usage coefficients of the multiple sub-display screens are determined according to the number of times the multiple sub-display screens are triggered within the preset time and the user's usage pattern relative to the mobile communication device, and the current usage coefficients of the multiple sub-display screens are dynamically marked, and the current usage coefficients of the multiple sub-display screens are introduced to control the frequency of current use of the multiple sub-display screens.

[0125] Specifically, a current usage system of multiple sub-display screens is introduced, and the current usage system of multiple sub-display screens is managed and controlled, and accurate management and control of multiple sub-display screens is achieved through the current usage system of multiple sub-display screens.

[0126] In the current usage system of multiple sub-displays, the number of times the multiple sub-displays are triggered within a preset time is collected. The number of times the multiple sub-displays are triggered within a preset time specifically refers to the frequency statistics of users operating multiple sub-displays installed on the device (which may be different parts of a foldable screen mobile phone, multiple display areas of a tablet computer, or other devices with multiple independent display units) within a preset time period. At this time, the number of times each sub-display is operated by the user (such as clicks, slides, touches, etc.) during this period is recorded. The preset time is usually a fixed time period, such as 5 minutes, 20 minutes or 60 minutes.

[0127] For example, a foldable phone has two sub-displays: the inner screen and the outer screen. A preset time of 5 minutes is set to count the user's operation behavior. During these 5 minutes, the user clicked and swiped 30 times on the inner screen, and only 5 times on the outer screen. Then, we can say that within the preset 5 minutes, the inner screen was triggered 30 times, and the outer screen was triggered 5 times. This data can help us understand the user's preferences and usage habits for different screens, thereby providing a basis for subsequent device optimization and user experience improvement.

[0128] The number of times multiple sub-display screens are triggered within a preset time and the user's usage pattern with respect to the mobile communication device are introduced. The user's usage pattern with respect to the mobile communication device generally refers to the way, habit or behavioral characteristics of the user using the mobile communication device in a specific situation.

[0129] Optionally, the current usage coefficient of each sub-display screen is calculated based on the number of triggers, the usage mode, and the corresponding weight distribution. The usage coefficient can be a value between 0 and 1, indicating the importance or activity of the screen in the current usage scenario.

[0130] For example: In the past 5 minutes, the inner screen was triggered 20 times (users frequently clicked on emails, scrolled pages, etc.), and the outer screen was triggered 5 times (users occasionally checked the time or weather information). Combining the user's usage pattern and the number of triggers, the system believes that in the current office scenario, the inner screen is more important. Therefore, a higher usage coefficient, such as 0.8, is assigned to the inner screen, and a lower usage coefficient, such as 0.2, is assigned to the outer screen. Optionally, this usage coefficient can be used for subsequent system optimization, interface adjustment, or user experience improvement. For example, the system can automatically adjust the brightness, contrast, or display mode of the inner and outer screens based on the usage coefficient to better meet the needs of the user in the current scenario.

[0131] Furthermore, the user's motion images are collected, and multiple motion features are determined based on the recognition of the user's motion images; the user's current posture is determined based on the multiple motion features and the user's body characteristics, which is compatible with the overall consideration of the multiple motion features and the user's body characteristics, and realizes the precise control of the user's current posture.

[0132] Specifically, the user's action image is introduced, and a device with an image acquisition function is used to capture the user's action image, and the user's action image is recognized. During the recognition process of the user's action image, the collected action image is processed by image processing technology, and the processed image is used for action recognition through a preset action learning model to extract multiple action features, such as the position of the hand, the tilt angle of the body, the direction of the head, etc. The recognized action features are quantified for subsequent posture judgment.

[0133] At the same time, the user's physical characteristics, such as height, weight, limb length, etc., are introduced. Combined with multiple motion features and the user's physical characteristics, the preset posture learning model is used for posture judgment. For example, if it is recognized that the user's hand position is high and the body is leaning forward, and considering the user's height and limb length, it can be judged that the user may be taking a selfie with a mobile phone. By comprehensively considering multiple motion features and physical characteristics, the user's current posture can be accurately controlled, providing a basis for subsequent interaction design and user experience optimization.

[0134] Therefore, multiple interactions are performed on the current usage coefficients of the multiple sub-display screens, the current postures of the users, and the contents displayed on the multiple sub-display screens; the presentation angles of the display interfaces corresponding to the multiple sub-display screens are determined based on the current usage coefficients of the multiple sub-display screens, the current postures of the users, and the multiple interactions on the contents displayed on the multiple sub-display screens, thereby ensuring the dynamic adaptation of the display interfaces corresponding to the multiple sub-display screens relative to the users.

[0135] Specifically, the current usage coefficients of multiple sub-displays, the user's current posture, and the content displayed on multiple sub-displays are introduced. At this time, the usage coefficient is an indicator to measure the activity or importance of the sub-display. This is usually based on the user's interaction behavior with each sub-display, such as clicks, slides, and dwell time. By recording these interaction data, the system can calculate the current usage coefficient of each sub-display.

[0136] The user's current posture refers to the user's body position and movement when using multiple sub-displays. This can be captured and recognized by technologies such as cameras and sensors. For example, the system can recognize whether the user is standing, sitting, leaning, etc.

[0137] The content displayed on each sub-display is also an important factor in multiple interactions. The system needs to recognize and understand this content so that it can adjust to the user's needs and preferences. For example, one sub-display may show work-related documents while another sub-display shows entertainment content.

[0138] Based on the usage coefficient, user posture and content relevance, multiple interaction analysis is performed. Multiple interactions may include user operation switching of different sub-display screens, content adjustment caused by posture changes, etc. At this time, based on the results of multiple interactions, the optimal presentation angle of the display interface corresponding to each sub-display screen is determined. The presentation angle can be the screen's tilt degree, rotation direction, etc., to ensure that the content is user-friendly and easy to read.

[0139] At this time, the interaction data between the user and each sub-display screen, the user's posture data, and the content data displayed on each sub-display screen are collected in real time. Based on the collected data, the system analyzes and calculates to determine the current usage coefficient of each sub-display screen, the user's current posture, and the relevance of the content. According to the analysis results, the system makes decisions, such as adjusting the layout, presentation angle, content order, etc. of the sub-display screen to optimize the user's interactive experience.

[0140] In an optional embodiment, the user is editing an important report on the document screen and occasionally checks the data charts on the chart screen to support the writing of the report. By monitoring the user's interactive behavior (such as clicks, slides, dwell time, etc.), it is calculated that the current usage coefficient of the document screen is higher, while the usage coefficient of the chart screen is relatively low, but still maintains a certain degree of activity. The user is sitting in front of the workstation, leaning forward slightly, with the eyes naturally focused on the front. At the same time, the system captures the user's posture data through cameras and sensors, and analyzes that the angle between the user's line of sight and the plane of the workstation is approximately 20 degrees.

[0141] The document screen displays the report content that the user is editing, and the chart screen displays data charts related to the report. It is recognized that the contents on the two screens are interrelated, and the user is frequently switching and comparing between the two. Therefore, the document screen: Since the user is concentrating on editing the report and the usage coefficient is high, the presentation angle of the document screen is adjusted to be approximately 0 degrees with the user's line of sight (that is, the screen is almost parallel to the user's line of sight) to ensure that the user can view and edit the document in the most comfortable way;

[0142] Chart screen: Although the usage coefficient of the chart screen is relatively low, considering that users need to frequently view charts to support report writing, and in order to avoid visual interference with the document screen, the system adjusts the presentation angle of the chart screen to be slightly tilted to the user's side (such as an angle of about 30 degrees with the user's line of sight), so that users can easily view the chart content without deviating from the main line of sight. By adjusting the presentation angles of the two sub-displays, the system provides users with a more comfortable, efficient and personalized work interface. Users can easily view and compare chart data while focusing on document editing, thereby improving work efficiency and satisfaction.

[0143] In step S16, a dynamic display mode of the display screen of the mobile communication device is determined according to the presentation angles of the display screens corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and a directional presentation of the display screens corresponding to the multiple sub-display screens is triggered based on the dynamic display mode and the user's voice command;

[0144] In the specific implementation process of the present invention, the specific steps are:

[0145] S161: Obtaining presentation angles of display interfaces corresponding to the plurality of sub-display screens;

[0146] S162: collecting corresponding posture data sets based on the detection of multiple sub-display screens; determining the current postures of the multiple sub-display screens according to the recognition of each posture data set;

[0147] S163: Determining a dynamic display mode of the display screen of the mobile communication device based on the current postures of the multiple sub-display screens, the presentation angles of the display interfaces corresponding to the multiple sub-display screens, and the relative positions of the multiple sub-display screens;

[0148] S164: Collecting a user's voice command based on a mobile communication device;

[0149] S165: Determine a corresponding directional indication according to the analysis of the user's voice command;

[0150] S166: triggering directional presentation of display interfaces corresponding to the plurality of sub-display screens according to the corresponding directional indication, the dynamic display mode of the display screen of the mobile communication device, and the static state of the user.

[0151] At this time, the presentation angles of the display interfaces corresponding to the multiple sub-display screens are obtained; corresponding posture data sets are collected based on the detection of the multiple sub-display screens; and the current postures of the multiple sub-display screens are determined based on the identification of each posture data set, thereby ensuring the accuracy of the current postures of the multiple sub-display screens.

[0152] The presentation angles of the display interfaces corresponding to the multiple sub-display screens are introduced. The presentation angles of the display interfaces corresponding to the multiple sub-display screens are the current physical tilt angles of each sub-display screen or the angles relative to a certain reference plane. At the same time, posture detection is performed on the multiple sub-display screens, and multiple posture data are collected in the posture detection of the multiple sub-display screens, so as to form a posture data set through the autonomous aggregation of the multiple posture data, so as to collect the posture data set.

[0153] For example, a mobile communication device may be equipped with multiple sensors (such as gyroscopes, magnetometers, etc.), which can detect the three-dimensional posture of the device in real time. At the same time, if the device is equipped with a front or rear camera, they can also capture the relative position and orientation of the device relative to the surrounding environment. All of these data are collected to form a posture data set.

[0154] For the identification of each posture data set, the collected posture data set is analyzed and identified to determine the current posture of each sub-display screen. Once the current posture is determined, the system can adjust the display content, layout or trigger other related functions based on this information.

[0155] In order to determine the current posture of multiple sub-display screens, a deep learning model, especially a convolutional neural network (CNN), is used to perform posture recognition. Specifically, the collected sensor data and image data are preprocessed, such as normalization and denoising, to improve the data quality, and the posture data (such as rotation angle, direction vector, etc.) are converted into a format that the model can understand. A CNN model is constructed, which can receive the preprocessed image data as input and output the posture information of the sub-display screen. Appropriate convolutional layers, pooling layers, fully connected layers, etc. are added to the model to extract features in the image and perform posture prediction. Therefore, the CNN model is trained using a labeled data set (i.e., a display screen image with a known posture), and the weight of the model is adjusted by a back propagation algorithm to minimize the error between the predicted posture and the true posture. By adopting the above model learning method, we can recognize the posture of each sub-display screen in real time. The posture of a sub-display screen refers to its specific position and orientation in three-dimensional space.

[0156] At the same time, the dynamic display mode of the display screen of the mobile communication device is determined based on the current postures of the multiple sub-display screens, the presentation angles of the display interfaces corresponding to the multiple sub-display screens, and the relative positions of the multiple sub-display screens, which is compatible with the overall consideration of the current postures of the multiple sub-display screens, the presentation angles of the display interfaces corresponding to the multiple sub-display screens, and the relative positions of the multiple sub-display screens, thereby ensuring the accuracy of the dynamic display mode of the display screen of the mobile communication device.

[0157] Specifically, the current postures of multiple sub-display screens, the presentation angles of the display interfaces corresponding to the multiple sub-display screens, and the relative positions of the multiple sub-display screens are introduced. At this time, the current postures of the multiple sub-display screens refer to the positions and orientations of the sub-display screens in three-dimensional space. This includes actions such as tilting and rotating. The presentation angle of the display interface corresponding to the multiple sub-display screens refers to the tilt and rotation angle of the display interface relative to the user's viewing angle or a fixed reference system. The presentation angle directly affects the user's viewing experience. The correct presentation angle can ensure that the displayed content remains clear and undistorted in the eyes of the user. The relative positions of multiple sub-display screens refer to the relative layout and distance between the sub-display screens in space.

[0158] The system interacts with the current postures of the multiple sub-displays, the presentation angles of the display interfaces corresponding to the multiple sub-displays, and the relative positions of the multiple sub-displays, and is compatible with the overall consideration of the current postures of the multiple sub-displays, the presentation angles of the display interfaces corresponding to the multiple sub-displays, and the relative positions of the multiple sub-displays, thereby ensuring the accuracy of the dynamic display mode of the display screen of the mobile communication device.

[0159] A dynamic display mode matching table is introduced to match the postures, presentation angles, relative positions and other information of multiple sub-display screens with the corresponding dynamic display modes. At this time, the dynamic display mode matching table is designed according to possible input information (such as the postures, presentation angles, relative positions, etc. of the sub-display screens) and output information (such as the dynamic display mode). In the dynamic display mode matching table, each row represents a specific input information combination and corresponding output information. The postures, presentation angles and relative positions and other information of the multiple sub-display screens are obtained in real time, and the rows matching the information are searched in the dynamic display mode matching table, and the corresponding dynamic display mode is obtained. According to the matched dynamic display mode, the display screen settings of the mobile communication device are adjusted.

[0160] Optionally, the current posture of the dual screens (such as fixed), the display interface presentation angle (such as landscape mode, portrait mode) and the relative position (such as left-right arrangement) are matched with the corresponding dynamic display mode. For example, in the matching table, we can define that when both screens are in landscape mode and left-right arrangement, one mode is used to enable both screens to display a wide video screen at the same time; when one of the screens is in portrait mode, another mode is used to enable the screen to display the main content and the other screen to display related control options or information.

[0161] Another example is a smartphone with dual screens:

[0162] When the user turns the phone sideways to watch a video, the main screen will automatically adjust to horizontal mode to accommodate a wider display area. At the same time, the secondary screen can display control options or related information, such as volume control, playlists, etc.

[0163] When the user tilts the phone to view the information on the secondary screen, the content on the secondary screen automatically rotates to adapt to the user's perspective to ensure that the information is clearly visible. At the same time, the video content on the main screen will also be fine-tuned according to the user's perspective to maintain the best viewing effect.

[0164] In game mode, the main screen can display the game screen, while the secondary screen displays the game map, control buttons or chat information. The content between the two screens will be updated in real time according to the game progress and maintain consistency, providing players with a richer and more immersive gaming experience.

[0165] Furthermore, based on collecting the user's voice commands through a mobile communication device and determining corresponding directional instructions based on the analysis of the user's voice commands, directional instructions are introduced to facilitate directional presentation of display interfaces corresponding to the multiple sub-display screens.

[0166] At this time, the built-in microphone of the mobile communication device is responsible for capturing the user's voice input. The voice signal undergoes pre-processing, such as noise reduction and enhancement, to improve the accuracy of subsequent analysis. Natural language processing and speech recognition technology are used to convert the user's voice commands into text form, and the text is further semantically analyzed to understand the user's intentions and specific needs.

[0167] At the same time, directional instructions are based on the analysis results of the user's voice commands to determine which sub-display screen or screens to perform specific operations or display content on. Based on the user's intentions and needs and combined with the current state of the mobile communication device (such as the posture, presentation angle, relative position, etc. of the sub-display screen), specific directional instructions are generated. The directional instructions may include operations such as switching display content, rotating, zooming, and moving the interface.

[0168] Therefore, according to the directional instructions, the display content of the designated sub-display screen is adjusted accordingly. The adjustment may include switching of display content, rearrangement of the interface, addition or reduction of elements, etc., so as to achieve collaborative work among multiple sub-display screens to ensure the coherence and consistency of the displayed content. For example, in dual-screen mode, one screen displays the main content and the other displays auxiliary information or control options. The two are updated synchronously according to the user's voice commands.

[0169] In an optional embodiment, suppose a user has a smart phone with dual screens and wants to control the display contents of the screens through voice commands. At this time, the user says: "Show the map on the main screen and the navigation information on the secondary screen."

[0170] The device captures the user's voice command and interprets it. The interpretation results show that the user wants to display the map application on the main screen and the navigation information associated with the map on the secondary screen. The device generates directional instructions based on the interpretation results, launches the map application on the main screen, and displays the navigation information on the secondary screen. The user confirms the operation results through visual feedback and performs further operations or adjustments as needed.

[0171] Therefore, the directional presentation of the display interfaces corresponding to the multiple sub-display screens is triggered according to the corresponding directional indication, the dynamic display mode of the display screen of the mobile communication device and the static state of the user, thereby ensuring the directional presentation of the display interfaces corresponding to the multiple sub-display screens.

[0172] Specifically, the mobile communication device first obtains the user's voice command through voice recognition technology, and uses natural language processing technology to parse the voice command to obtain a corresponding directional instruction. This directional instruction clarifies which sub-display screen or sub-display screens the user wants to display specific content or perform specific operations.

[0173] Corresponding directional indications, dynamic display modes of the display screen of the mobile communication device, and the user's static state are introduced. The device detects the user's static state through built-in sensors (such as accelerometers, gyroscopes, etc.). When the user is in a static state (for example, holding the device motionless or placing it on the table), the device triggers the directional presentation process.

[0174] Further, after obtaining the directional indication, determining the dynamic display mode and detecting the user's stationary state, the device triggers the directional presentation process. This process includes displaying content or performing operations on the specified sub-display according to the directional indication, and adjusting the display mode to adapt to the current display environment. Optionally, the user says "display the navigation route on the secondary screen, and keep the current music playback interface unchanged on the main screen", the device captures the user's voice command, and parses the directional indication through voice recognition and natural language processing technology, that is, "display the navigation route on the secondary screen", and the device detects that the main screen and the secondary screen of the dual-screen mobile phone are both in portrait mode, and the relative position is fixed. Based on this information, the device automatically selects a dynamic display mode suitable for portrait mode, that is, the content is arranged vertically on the screen, the user puts the mobile phone steadily on the mobile phone holder in the car, and the device detects that the user is in a stationary state through the built-in sensor. After obtaining the directional indication, determining the dynamic display mode and detecting the user's stationary state, the device triggers the directional presentation process. The navigation route is immediately displayed on the secondary screen, while the main screen keeps the current music playback interface unchanged. Users can clearly see the navigation route and enjoy music playback without manual operation.

[0175] In an embodiment of the present invention, through the method in the embodiment of the present invention, when the display screen of a mobile communication device contains multiple sub-display screens, the spatial positions of the multiple sub-display screens are collected; the opening state of the display screen of the mobile communication device is determined based on the spatial positions of the multiple sub-display screens; the usage scenario of the display screen of the mobile communication device is determined according to the opening state of the display screen of the mobile communication device, the content displayed by the multiple sub-display screens, and the priority of the multiple sub-display screens; based on the usage scenario, the current contact position of the display screen of the mobile communication device and the user's usage preference relative to the display screen, the current usage system of the multiple sub-display screens is determined, which is compatible with the overall consideration of the usage scenario, the current contact position of the display screen of the mobile communication device and the user's usage preference relative to the display screen, ensures the accuracy of the current usage system of the multiple sub-display screens, and realizes precise control of the multiple sub-display screens.

[0176] Furthermore, in the current usage system of multiple sub-display screens, current usage coefficients of the multiple sub-display screens are marked, and presentation angles of the display interfaces corresponding to the multiple sub-display screens are determined based on the current usage coefficients of the multiple sub-display screens, the current postures of the users, and the contents displayed on the multiple sub-display screens, thereby achieving control of the presentation angles of the display interfaces corresponding to the multiple sub-display screens and ensuring dynamic adaptation of the display interfaces corresponding to the multiple sub-display screens relative to the users.

[0177] Therefore, the dynamic display mode of the display screen of the mobile communication device is determined according to the presentation angles of the display interfaces corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and the directional presentation of the display interfaces corresponding to the multiple sub-display screens is triggered based on the dynamic display mode and the user's voice commands, thereby realizing the directional presentation of the display interfaces corresponding to the multiple sub-display screens and ensuring the directional display of the display interfaces corresponding to the multiple sub-display screens.

[0178] Embodiment 3

[0179] See also Figure 3 , Figure 3 The figure is a schematic diagram of the structure of a dynamic display system of a display screen of a mobile communication device in an embodiment of the present invention.

[0180] like Figure 3 As shown, a dynamic display system for a display screen of a mobile communication device, the dynamic display system for a display screen of the mobile communication device comprises:

[0181] The acquisition module 21 is used to acquire the spatial positions of the multiple sub-display screens when the display screen of the mobile communication device includes multiple sub-display screens;

[0182] A shape module 22, used to determine the opening shape of the display screen of the mobile communication device based on the spatial positions of the multiple sub-display screens;

[0183] A scenario module 23, for determining a usage scenario of the display screen of the mobile communication device according to the opening state of the display screen of the mobile communication device, the contents displayed by the multiple sub-display screens, and the priorities of the multiple sub-display screens;

[0184] A usage system module 24, for determining a current usage system of the plurality of sub-display screens based on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference with respect to the display screen;

[0185] Angle module 25, used to mark the current usage coefficients of the multiple sub-display screens in the current usage system of the multiple sub-display screens, and determine the presentation angles of the display interfaces corresponding to the multiple sub-display screens according to the current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed by the multiple sub-display screens;

[0186] The directional module 26 is used to determine the dynamic display mode of the display screen of the mobile communication device according to the presentation angles of the display interfaces corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and trigger the directional presentation of the display interfaces corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command.

[0187] Embodiment 4

[0188] In this embodiment, an electronic device is provided. Its internal structure diagram can be shown as follows: Figure 4 As shown. The electronic device includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program, and the non-volatile storage medium is deployed with a database, which is used to store user behavior data and user portraits. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The network interface of the electronic device is used to communicate with other electronic devices that deploy application software. When the computer program is executed by the processor, a low-altitude patrol method of a drone is implemented. The display screen of the electronic device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device can be a touch layer covered on the display screen, or a key, trackball or touchpad set on the housing of the electronic device, or an external keyboard, touchpad or mouse, etc.

[0189] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

Claims

1. A dynamic display method for a display screen of a mobile communication device, characterized in that: include: When the display screen of the mobile communication device includes multiple sub-display screens, collecting the spatial positions of the multiple sub-display screens; Determining an opening state of a display screen of the mobile communication device based on spatial positions of the plurality of sub-display screens; Determining a usage scenario of a display screen of the mobile communication device according to an opening state of the display screen of the mobile communication device, contents displayed on the plurality of sub-display screens, and priorities of the plurality of sub-display screens; Determining a current usage system of the plurality of sub-display screens based on the usage scenario, a current contact position of the display screen of the mobile communication device, and a user's usage preference with respect to the display screen; In the current usage system of the multiple sub-display screens, current usage coefficients of the multiple sub-display screens are marked, and presentation angles of display interfaces corresponding to the multiple sub-display screens are determined according to the current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed by the multiple sub-display screens; The dynamic display mode of the display screen of the mobile communication device is determined according to the presentation angles of the display interfaces corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and the directional presentation of the display interfaces corresponding to the multiple sub-display screens is triggered based on the dynamic display mode and the user's voice command.

2. The method for dynamic display of a display screen of a mobile communication device according to claim 1, characterized in that: When the display screen of the mobile communication device includes multiple sub-display screens, collecting the spatial positions of the multiple sub-display screens includes: Determining a plurality of screen signals based on screen detection of a display screen of the mobile communication device; Determining a plurality of sub-display screens according to the analysis of the plurality of screen signals, wherein the display screen of the mobile communication device includes a plurality of sub-display screens; Constructing a spatial coordinate system based on the display screen of the mobile communication device, and marking corresponding coordinates of the plurality of sub-display screens; The spatial positions of the multiple sub-display screens are determined according to the coordinates of the multiple sub-display screens.

3. The method for dynamic display of a display screen of a mobile communication device according to claim 2, characterized in that: The method of determining the opening state of the display screen of the mobile communication device based on the spatial positions of the plurality of sub-display screens includes: Get the spatial positions of multiple sub-displays; Predicting relative angles of the sub-display screens according to spatial positions of the multiple sub-display screens; Collecting the outlines of multiple sub-display screens; If the outer contours of the plurality of sub-display screens are inconsistent, determining the spatial layout of the display screens of the mobile communication device according to the outer contours of the plurality of sub-display screens and the spatial positions of the plurality of sub-display screens; The opening form of the display screen of the mobile communication device is determined according to the spatial layout of the display screen of the mobile communication device and the relative angles of each sub-display screen.

4. The method for dynamic display of a display screen of a mobile communication device according to claim 3, characterized in that: The method of determining the usage scenario of the display screen of the mobile communication device according to the opening state of the display screen of the mobile communication device, the contents displayed by the multiple sub-display screens, and the priorities of the multiple sub-display screens includes: Get the open state of the display screen of the mobile communication device; Monitor the multiple sub-display screens in real time, and determine the content types of the multiple sub-display screens based on the content displayed on the multiple sub-display screens; Determine multiple content areas according to content types of the multiple sub-display screens and synchronization signals between the multiple sub-display screens; Collecting priorities of multiple sub-display screens, associating the opening state of the display screen of the mobile communication device, multiple content areas, and priorities of multiple sub-display screens; The usage scenario of the display screen of the mobile communication device is determined according to the opening state of the display screen of the mobile communication device, the priorities of the multiple content areas and the multiple sub-display screens.

5. The method for dynamic display of a display screen of a mobile communication device according to any one of claims 1 to 4, characterized in that: The determining of the current usage system of the plurality of sub-display screens based on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference with respect to the display screen includes: Monitor the display screen of the mobile communication device in real time and collect touch signals of the display screen of the mobile communication device; Determining a current contact position of a display screen of the mobile communication device according to a touch signal of the display screen of the mobile communication device; Collecting current user information of the display screen, and determining the user's usage preference with respect to the display screen based on the current user information and the display screen usage database; Perform multiple interactions on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preference with respect to the display screen; The current usage system of the plurality of sub-display screens is determined according to the usage scenario, the current contact position of the display screen of the mobile communication device, and multiple interactions of the user's usage preference with respect to the display screen.

6. The method for dynamic display of a display screen of a mobile communication device according to claim 5, characterized in that: In the current use system of the multiple sub-display screens, the current use coefficients of the multiple sub-display screens are marked, and the presentation angles of the display interfaces corresponding to the multiple sub-display screens are determined according to the current use coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed by the multiple sub-display screens, including: Get the current usage system of multiple sub-displays; In a current use system of multiple sub-display screens, the number of times the multiple sub-display screens are triggered within a preset time is collected; The current usage coefficients of the multiple sub-display screens are determined according to the number of times the multiple sub-display screens are triggered within a preset time and the user's usage pattern relative to the mobile communication device, and the current usage coefficients of the multiple sub-display screens are dynamically marked.

7. The method for dynamic display of a display screen of a mobile communication device according to claim 6, characterized in that: In the current use system of the multiple sub-display screens, the current use coefficients of the multiple sub-display screens are marked, and the presentation angles of the display interfaces corresponding to the multiple sub-display screens are determined according to the current use coefficients of the multiple sub-display screens, the current postures of the users, and the contents displayed by the multiple sub-display screens, and further include: Collecting a user's motion image, and determining a plurality of motion features based on recognition of the user's motion image; Determine the user's current posture based on the plurality of motion features and the user's body features; Perform multiple interactions on current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed on the multiple sub-display screens; determine presentation angles of display interfaces corresponding to the multiple sub-display screens based on the multiple interactions on the current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed on the multiple sub-display screens.

8. The method for dynamic display of a display screen of a mobile communication device according to claim 7, characterized in that: The method of determining the dynamic display mode of the display screen of the mobile communication device according to the presentation angles of the display screens corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and triggering the directional presentation of the display screens corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command, includes: Obtaining the presentation angles of the display interfaces corresponding to the multiple sub-display screens; Based on the detection of multiple sub-display screens, corresponding posture data sets are collected; and according to the recognition of each posture data set, the current postures of the multiple sub-display screens are determined; The dynamic display mode of the display screen of the mobile communication device is determined based on the current postures of the multiple sub-display screens, the presentation angles of the display interfaces corresponding to the multiple sub-display screens, and the relative positions of the multiple sub-display screens.

9. The method for dynamic display of a display screen of a mobile communication device according to claim 8, characterized in that: The method of determining the dynamic display mode of the display screen of the mobile communication device according to the presentation angles of the display screens corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and triggering the directional presentation of the display screens corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command, further includes: Collecting user's voice commands based on mobile communication devices; Determining corresponding directional instructions based on the analysis of the user's voice command; The directional presentation of the display interfaces corresponding to the plurality of sub-display screens is triggered according to the corresponding directional indication, the dynamic display mode of the display screen of the mobile communication device and the static state of the user.

10. A dynamic display system for a display screen of a mobile communication device, characterized in that: The dynamic display system of the display screen of the mobile communication device is applied to the dynamic display method of the display screen of the mobile communication device as claimed in any one of claims 1 to 9, and the dynamic display system of the display screen of the mobile communication device comprises: A collection module, used for collecting the spatial positions of the multiple sub-display screens when the display screen of the mobile communication device contains multiple sub-display screens; A shape module, used to determine the opening shape of the display screen of the mobile communication device based on the spatial positions of the multiple sub-display screens; A scenario module, used to determine a usage scenario of the display screen of the mobile communication device according to the opening state of the display screen of the mobile communication device, the contents displayed by the multiple sub-display screens, and the priorities of the multiple sub-display screens; A usage system module for determining a current usage system of the plurality of sub-display screens based on the usage scenario, a current contact position of the display screen of the mobile communication device, and a user's usage preference with respect to the display screen; An angle module, used to mark the current usage coefficients of the multiple sub-display screens in the current usage system of the multiple sub-display screens, and determine the presentation angles of the display interfaces corresponding to the multiple sub-display screens according to the current usage coefficients of the multiple sub-display screens, the current posture of the user, and the contents displayed by the multiple sub-display screens; The directional module is used to determine the dynamic display mode of the display screen of the mobile communication device according to the presentation angles of the display interfaces corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and trigger the directional presentation of the display interfaces corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command.

Images