A dynamic display method and system for a display screen of a mobile communication device

Abstract

This invention discloses a dynamic display method and system for a mobile communication device's display screen. The invention relates to the technical field of mobile communication devices. Based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen, a current usage system for multiple sub-display screens is determined, ensuring the accuracy of the current usage system and achieving precise control over the multiple sub-display screens. Furthermore, within the current usage system of the multiple sub-display screens, current usage coefficients are marked. Based on these coefficients, the user's current posture, and the content displayed on the multiple sub-display screens, the presentation angle of the corresponding display interface is determined, ensuring dynamic adaptation of the display interface relative to the user and guaranteeing directional display of the corresponding display interface.

Description

Technical Field

[0001] This invention relates to the technical field of mobile communication devices, and more particularly to a dynamic display method and system for a mobile communication device's display screen. Background Technology

[0002] With the development of technology, mobile communication devices have been gradually applied to people's lives. Smartphones are a type of mobile communication device, including foldable phones. In this case, the mobile communication device contains multiple sub-displays, each of which is independent and distributed in different positions on the mobile communication device. In the existing technology, the display interface corresponding to the multiple sub-displays only has horizontal or vertical display, without fully considering the user's current posture and the content displayed on the multiple sub-displays, and it is impossible to determine the presentation angle of the display interface corresponding to the multiple sub-displays. Summary of the Invention

[0003] The purpose of this invention is to overcome the shortcomings of the prior art. This invention provides a dynamic display method and system for the display screen of a mobile communication device.

[0004] This invention provides a dynamic display method for a mobile communication device's display screen, comprising: when the mobile communication device's display screen contains multiple sub-display screens, acquiring the spatial positions of the multiple sub-display screens; determining the opening mode of the mobile communication device's display screen based on the spatial positions of the multiple sub-display screens; determining the usage scenario of the mobile communication device's display screen based on the opening mode of the mobile communication device's display screen, the content displayed on the multiple sub-display screens, and the priority of the multiple sub-display screens; determining the current usage system of the multiple sub-display screens based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preference relative to the display screen; marking the current usage coefficient of the multiple sub-display screens in the current usage system of the multiple sub-display screens, determining the presentation angle of the display interface corresponding to the multiple sub-display screens based on the current usage coefficient of the multiple sub-display screens, the user's current posture, and the content displayed on the multiple sub-display screens; determining a dynamic display mode of the mobile communication device's display screen based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and triggering the directional presentation of the display interface corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command.

[0005] This invention provides a dynamic display system for a mobile communication device's display screen. The dynamic display system is applied to the aforementioned dynamic display method for a mobile communication device's display screen. The dynamic display system includes:

[0006] The acquisition module is used to acquire the spatial positions of multiple sub-displays when the display screen of a mobile communication device contains multiple sub-displays;

[0007] The form module is used to determine the opening form of the mobile communication device's display screen based on the spatial position of multiple sub-display screens;

[0008] The scenario module is used to determine the usage scenario of the mobile communication device's display screen based on the opening mode of the mobile communication device's display screen, the content displayed by multiple sub-display screens, and the priority of the multiple sub-display screens.

[0009] The system module is used to determine the current usage system of multiple sub-displays based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen.

[0010] The angle module is used to mark the current usage coefficient of multiple sub-displays in the current usage system of multiple sub-displays, and determine the presentation angle of the display interface corresponding to the multiple sub-displays based on the current usage coefficient of the multiple sub-displays, the user's current posture, and the content displayed on the multiple sub-displays.

[0011] The orientation module is used to determine the dynamic display mode of the mobile communication device's display screen based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative position of the multiple sub-display screens. Based on the dynamic display mode and the user's voice command, the orientation presentation of the display interface corresponding to the multiple sub-display screens is triggered.

[0012] In this embodiment of the invention, when the display screen of a mobile communication device contains multiple sub-display screens, the spatial positions of the multiple sub-display screens are collected; the opening mode of the mobile communication device's display screen is determined based on the spatial positions of the multiple sub-display screens; the usage scenario of the mobile communication device's display screen is determined according to the opening mode of the mobile communication device's display screen, the content displayed on the multiple sub-display screens, and the priority of the multiple sub-display screens; and the current usage system of the multiple sub-display screens is determined based on the usage scenario, the current contact position of the mobile communication device's display screens, and the user's usage preferences relative to the display screens. This approach takes into account the overall considerations of the usage scenario, the current contact position of the mobile communication device's display screens, and the user's usage preferences relative to the display screens, ensuring the accuracy of the current usage system of the multiple sub-display screens and achieving precise control of the multiple sub-display screens.

[0013] Furthermore, in the current usage system of multiple sub-displays, the current usage coefficients of multiple sub-displays are marked. Based on the current usage coefficients of multiple sub-displays, the user's current posture, and the content displayed on multiple sub-displays, the presentation angle of the display interface corresponding to the multiple sub-displays is determined. This achieves control over the presentation angle of the display interface corresponding to the multiple sub-displays, ensuring that the display interface corresponding to the multiple sub-displays dynamically adapts to the user.

[0014] Therefore, the dynamic display mode of the mobile communication device's display screen is determined based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative position of the multiple sub-display screens. Based on this dynamic display mode and the user's voice commands, the directional presentation of the display interface corresponding to the multiple sub-display screens is triggered, thereby realizing the directional presentation of the display interface corresponding to the multiple sub-display screens and ensuring the directional display of the display interface corresponding to the multiple sub-display screens. Attached Figure Description

[0015] Figure 1 This is a schematic diagram illustrating an application scenario of a dynamic display method for a mobile communication device's display screen in one embodiment.

[0016] Figure 2 This is a flowchart illustrating the dynamic display method of the display screen of a mobile communication device according to an embodiment of the present invention.

[0017] Figure 3 This is a schematic diagram of the structure of the dynamic display system of the display screen of the mobile communication device in an embodiment of the present invention;

[0018] Figure 4 This is a hardware diagram of an electronic device according to an exemplary embodiment. Detailed Implementation

[0019] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.

[0020] Example 1

[0021] The dynamic display method for the display screen of a mobile communication device provided in this application can be applied to, for example... Figure 1 In the application environment shown, computer 102 communicates with server 104 via a network. Computer 102 can be, but is not limited to, various personal computers, servers, or mobile communication devices, and server 104 can be a standalone server or a server cluster consisting of multiple servers.

[0022] Example 2

[0023] Please see Figures 1 to 4A dynamic display method for a mobile communication device's display screen, applied to dynamic display scenarios of the mobile communication device's display screen; the dynamic display method for the mobile communication device's display screen includes:

[0024] Step S11: When the display screen of the mobile communication device contains multiple sub-display screens, collect the spatial positions of the multiple sub-display screens;

[0025] Step S12: Determine the opening mode of the mobile communication device's display screen based on the spatial positions of multiple sub-display screens;

[0026] Step S13: Determine the usage scenario of the mobile communication device's display screen based on the opening mode of the mobile communication device's display screen, the content displayed by the multiple sub-display screens, and the priority of the multiple sub-display screens.

[0027] Step S14: Based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen, determine the current usage system of multiple sub-display screens;

[0028] Step S15: In the current usage system of multiple sub-displays, mark the current usage coefficient of multiple sub-displays, and determine the presentation angle of the display interface corresponding to the multiple sub-displays based on the current usage coefficient of multiple sub-displays, the user's current posture, and the content displayed on the multiple sub-displays.

[0029] Step S16: Determine the dynamic display mode of the mobile communication device's display screen based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative position of the multiple sub-display screens. Based on the dynamic display mode and the user's voice command, trigger the directional presentation of the display interface corresponding to the multiple sub-display screens.

[0030] In step S11, when the display screen of the mobile communication device contains multiple sub-display screens, the spatial positions of the multiple sub-display screens are collected.

[0031] In the specific implementation of this invention, the specific steps are as follows:

[0032] S111: Determine multiple screen signals based on screen detection of the display screen of a mobile communication device;

[0033] S112: Multiple sub-displays are determined based on the analysis of multiple screen signals. At this time, the display screen of the mobile communication device contains multiple sub-displays.

[0034] S113: Construct a spatial coordinate system based on the display screen of the mobile communication device, and mark the corresponding coordinates of multiple sub-display screens;

[0035] S114: Determine the spatial location of multiple sub-display screens based on their coordinates.

[0036] In the embodiments of this application, multiple screen signals are determined based on screen detection of the display screen of the mobile communication device; multiple sub-display screens are determined based on the parsing of the multiple screen signals. At this time, the display screen of the mobile communication device contains multiple sub-display screens, which is compatible with the scenario where the display screen of the mobile communication device has multiple sub-display screens, so as to facilitate the management and control of multi-fold screens and realize the subsequent management and control of multiple sub-display screens.

[0037] Specifically, screen detection is performed on the display screen of mobile communication devices, realizing screen detection of the display screen of mobile communication devices. Optionally, when the mobile communication device (such as a smartphone, tablet, etc.) is powered on or enters a specific mode, its internal screen detection system will start. The screen detection system detects various parts of the display screen by sending and receiving electrical signals and outputs multiple screen signals.

[0038] Multiple screen signals are introduced and analyzed. By analyzing these signals, the mobile communication device can identify which signal combinations represent the corresponding sub-display screens, thus enabling the management and control of multiple sub-display screens. Furthermore, for each identified sub-display screen, the device further determines its attributes, such as resolution, color depth, and refresh rate. Optionally, the mobile communication device's display screen may contain multiple sub-display screens.

[0039] In an optional embodiment, a smartphone has a foldable display screen comprising two sub-display screens: a main screen and an outer screen. When the phone is powered on, a screen detection system activates, sending electrical signals across the entire display area. These signals are received and responded to on both the main screen and the outer screen. The response signals are collected and identified as originating from two independent sub-display screens. These signals are then analyzed to determine attributes such as the position, size, and resolution of the main screen and the outer screen. For example, the main screen may be located on the inside of the phone, with a higher resolution and a larger size, used to display main content and applications; while the outer screen is located on the outside of the phone, with a smaller size, used to display basic information such as time and notifications.

[0040] Furthermore, a spatial coordinate system is constructed based on the display screen of the mobile communication device, and the corresponding coordinates of multiple sub-display screens are marked; the spatial position of multiple sub-display screens is determined according to the coordinates of multiple sub-display screens, which takes into account the overall consideration of the coordinates of multiple sub-display screens, realizes the comparison of the coordinates of multiple sub-display screens, and ensures the accuracy of the spatial position of multiple sub-display screens.

[0041] Specifically, coordinate management of the mobile communication device's display screen involves introducing a spatial coordinate system for the screen. Optionally, the appropriate coordinate system type is selected based on the screen's shape (e.g., flat, curved, folded). For most flat displays, a two-dimensional Cartesian coordinate system is typically used; for more complex or three-dimensional displays, a three-dimensional coordinate system may be necessary.

[0042] Optionally, a fixed point can be selected on the display screen as the origin of the coordinate system. This point can be the upper left corner, lower right corner, or other easily identifiable location of the display screen, determining the direction of the coordinate axes. In a two-dimensional coordinate system, the horizontal direction is usually chosen as the X-axis, and the vertical direction as the Y-axis; in a three-dimensional coordinate system, a Z-axis is also added to represent depth or height. Based on the origin, the direction of the coordinate axes, and the size of the display screen, a spatial coordinate system for the mobile communication device's display screen is established.

[0043] In the spatial coordinate system of the mobile communication device's display screen, the display screen itself is introduced. By detecting the screen or pre-setting boundary information, the boundary of each sub-display screen on the overall display screen is identified. For each sub-display screen, the coordinates of its four vertices or center point in the coordinate system are marked. These coordinate points can uniquely determine the position of the sub-display screen on the display screen. The marked coordinate information is recorded inside the mobile communication device for subsequent use.

[0044] Simultaneously, the coordinate information of the markers is used to compare the positional relationships of different sub-displays within the coordinate system. This helps in understanding the relative layout between the sub-displays and the overall shape of the display screen. Based on the coordinate comparison results, the precise position of each sub-display within the overall display screen is determined. This information is crucial for subsequent adjustments to display content and optimization of the user interface.

[0045] In an optional embodiment, a user is making a video call using a foldable screen phone. During the call, the user wants the main screen to display the other party's video feed, while the outer screen displays call controls and related information. At this point, a screen detection system identifies the main screen and outer screen, establishes a two-dimensional Cartesian coordinate system, marks the coordinates of the main screen and outer screen in the coordinate system, and records them internally. Based on this coordinate information, the device determines the precise positions of the main screen and outer screen on the display screen. In the video call application, the device displays the other party's video feed on the main screen and the call controls and related information on the outer screen according to the user's selection and preferences. Because the device accurately knows the position and size of the main screen and outer screen, it can ensure the correct layout of the displayed content and the best user experience.

[0046] In step S12, the opening mode of the mobile communication device's display screen is determined based on the spatial positions of the multiple sub-display screens.

[0047] In the specific implementation of this invention, the specific steps are as follows:

[0048] S121: Obtain the spatial positions of multiple sub-display screens;

[0049] S122: Predict the relative angle of each sub-display based on the spatial position of multiple sub-displays;

[0050] S123: Collect the outline of multiple sub-display screens;

[0051] S124: If the outlines of multiple sub-displays are inconsistent, the spatial layout of the mobile communication device's display screen shall be determined based on the outlines of the multiple sub-displays and their spatial positions.

[0052] S125: Determine the opening mode of the mobile communication device's display screen based on the spatial layout of the display screen and the relative angles of each sub-display screen.

[0053] In the embodiments of this application, the spatial positions of multiple sub-displays are obtained; the relative angles of each sub-display are predicted based on the spatial positions of the multiple sub-displays, thus introducing the prediction of the relative angles of each sub-display and ensuring the accuracy of the relative angles of each sub-display.

[0054] Among them, the spatial positions of multiple sub-displays are obtained, which facilitates subsequent management of the spatial positions of multiple sub-displays.

[0055] Simultaneously, the spatial positions of multiple sub-displays are predicted by angle. Utilizing principles of geometry and trigonometry, the relative angles between the sub-displays are calculated based on their position information. Optionally, the position of each sub-display is determined within the spatial coordinate system of the mobile communication device's display screen. This is typically represented by coordinate values ​​obtained through measurement or detection, treating the position of each sub-display as a vector. If the device is two-dimensional (e.g., a flat foldable screen), these vectors can be two-dimensional; if the device is three-dimensional (e.g., a foldable stereoscopic display), these vectors can be three-dimensional. The formula for the angle between vectors is used to calculate the relative angle between two sub-displays. Optionally, in complex cases, an angle algorithm can also be used to predict the relative angle. This angle algorithm can learn from a large amount of position data and extract the features needed to predict the relative angle.

[0056] In an optional embodiment, taking a foldable phone with two sub-displays as an example, when the phone is folded, the two sub-displays are located on opposite sides of the phone. Precise position information of these two sub-displays can be obtained through sensors or a position detection system inside the phone. Based on this position information, the relative angle between them is calculated using geometric principles. For example, when the phone is fully folded, the relative angle between the two sub-displays is 0 degrees; when the phone is unfolded to a certain angle, the relative angle can be calculated to a specific value. This relative angle information can be used to adjust the phone's user interface layout, ensuring that content is displayed and interacted with correctly on both sub-displays. Optionally, suppose a user is watching a video on the phone. When the phone unfolds from its folded state, the system automatically adjusts the size and position of the video window based on the relative angle of the sub-displays to ensure that the video is displayed completely on both sub-displays without distortion.

[0057] Furthermore, the outlines of multiple sub-displays are collected; if the outlines of the multiple sub-displays are inconsistent, the spatial layout of the mobile communication device's display screen is determined based on the outlines and spatial positions of the multiple sub-displays, thus achieving overall control over the outlines and spatial positions of the multiple sub-displays and ensuring the accuracy of the spatial layout of the mobile communication device's display screen.

[0058] Specifically, the outlines of multiple sub-displays are introduced and controlled. At this time, a data acquisition device is used to scan or photograph each sub-display to obtain the raw data of its outline. The raw data is preprocessed, such as noise reduction and smoothing, to improve the accuracy and reliability of the data. The processed outline is recorded in digital form and stored in the device's memory or external storage medium.

[0059] Simultaneously, the mobile communication device's display screen has multiple sub-display screens, and the outlines of these sub-display screens are captured. The collected outlines of the multiple sub-display screens are compared to check for differences. A similarity metric is calculated between the outlines of each sub-display screen by matching their shapes. Based on the similarity metric value, it is determined whether the outlines of the sub-display screens are consistent. If the similarity metric value is below a certain threshold, the outlines of the two sub-display screens are considered to be different. Depending on the type and degree of the difference, a decision is made as to whether further processing or adjustment is needed.

[0060] To further address the issue of inconsistent outlines among multiple sub-displays, the system incorporates the outlines and spatial positions of multiple sub-displays. The spatial positions of these sub-displays are calibrated and converted to match the outline data. Furthermore, the outline data of each sub-display is matched with its corresponding spatial position information to output the matching results. Based on these matching results, the spatial layout of the entire display screen is calculated.

[0061] In an optional embodiment, the outline data of the sub-displays (such as edge coordinates, shape features, etc.) is collected, and the spatial location information (such as coordinates, orientation, size, etc.) corresponding to each sub-display is collected. Key features, such as the perimeter, area, centroid position, orientation, etc. of the outline, are extracted from the outline data. These features are used as input to the model, and the collected data is used to train the model so that it can learn the mapping relationship between the outline features and the spatial location information. For new sub-display outline data, its features are extracted and input into the trained model. The model outputs predicted spatial location information, and the spatial layout of the entire display is calculated based on the predicted spatial location information.

[0062] Another method involves pre-setting a matching table to store the shape contour features and their corresponding spatial location information. For new sub-display shape contour data, the similarity between it and features such as A1 and A2 in the table is calculated. The feature with the highest similarity (such as A1) is found, and its corresponding spatial location information (such as x=10, y=20) is obtained. Based on all the spatial location information obtained from the matching, the spatial layout diagram of the entire display screen is drawn to present the spatial layout of the entire display screen.

[0063] Therefore, by determining the opening form of the mobile communication device's display screen based on its spatial layout and the relative angles of each sub-display screen, the overall consideration of the display screen's spatial layout and the relative angles of each sub-display screen is taken into account, thus achieving precision in determining the opening form of the mobile communication device's display screen.

[0064] Specifically, the spatial layout of the mobile communication device's display screen and the relative angles of its sub-displays are introduced. This involves considering the spatial layout and relative angles of the display screen as a whole. After collecting the spatial layout and relative angles of the sub-displays, a correlation model is established to describe the relationships between these elements. Once the correlation model is established, it can be used to determine the opening configuration of the display screen based on its spatial layout and relative angles. This typically involves comparing and matching the actual measured angles and layout information with the predicted values ​​in the model. Based on the matching results, the current state of the display screen (e.g., fully unfolded, partially folded, or fully closed) and the relative positions of the sub-displays can be determined.

[0065] Optionally, information on the display space layout is collected: the main display is 7.6 inches with a resolution of 2160x1914 pixels; the secondary display is 6.5 inches with a resolution of 2376x1080 pixels. The relative positions of both in the folded state are known. The relative angles of each sub-display are introduced, and a model describing the changes in display form is established based on geometric transformations and a spatial coordinate system. This model can predict the degree of unfolding of the display and the relative positions of each sub-display based on changes in the included angle. When the user unfolds the foldable phone, the angle measurement tool detects that the included angle gradually increases to 180 degrees. By applying the correlation model, it can be determined that the phone is in a fully unfolded state, at which point the main and secondary displays are laid flat on the same plane. Conversely, when the included angle decreases to less than 180 degrees, the model predicts that the phone is in a partially folded state and provides the relative position information of each sub-display.

[0066] In step S13, the usage scenario of the mobile communication device's display screen is determined based on the opening mode of the mobile communication device's display screen, the content displayed by the multiple sub-display screens, and the priority of the multiple sub-display screens.

[0067] In the specific implementation of this invention, the specific steps are as follows:

[0068] S131: Obtain the open state of the display screen of the mobile communication device;

[0069] S132: Real-time monitoring of multiple sub-display screens, determining the content types of the multiple sub-display screens based on the content displayed on the multiple sub-display screens;

[0070] S133: Determine multiple content areas based on the content types of multiple sub-displays and the synchronization signals between multiple sub-displays;

[0071] S134: Collect the priority of multiple sub-displays, and associate the opening mode of the mobile communication device's display screen, multiple content areas, and the priority of multiple sub-displays;

[0072] S135: Determine the usage scenario of the mobile communication device's display screen based on the opening mode of the display screen, multiple content areas, and the priority of multiple sub-display screens.

[0073] In the embodiments of this application, the open state of the display screen of the mobile communication device is obtained; multiple sub-display screens are monitored in real time, the content types of the multiple sub-display screens are determined based on the content displayed on the multiple sub-display screens, and the content types of the multiple sub-display screens are subsequently managed.

[0074] Specifically, it acquires the open state of the mobile communication device's display screen, introduces the open state of the mobile communication device's display screen, and simultaneously monitors multiple sub-display screens in real time.

[0075] In real-time monitoring of multiple sub-displays, the content displayed on each sub-display is captured, along with real-time images or video streams. This can be achieved through techniques such as screenshots and video frame capture. For image content, computer vision techniques, such as shape recognition, can be used to extract features. These features help distinguish different types of image content, such as natural scenery, portraits, and charts.

[0076] For image content, computer vision techniques can be used to extract features, such as edge detection, texture analysis, and shape recognition. These features help distinguish different types of image content, such as natural scenery, portraits, and charts. For video content, in addition to extracting features from single frames, motion features and audio features can be analyzed to determine the video type, such as movies, television programs, and sporting events.

[0077] Furthermore, pre-trained machine learning models (such as convolutional neural networks, CNNs, etc.) are used to classify the extracted features. These models have learned to map features to specific content categories, determining the content category for each sub-display based on the machine learning model's output. This may involve comparing the probability distributions of the model outputs, selecting the category with the highest probability as the final result, and formatting the final result into an easy-to-understand and use format. This might include assigning a label to each sub-display (such as "News," "Videos," "Games," etc.), or generating a summary report containing all content categories for all sub-displays, displaying the formatted result to the user, or integrating it into the device's user interface. For example, icons representing content categories could be displayed on the device's status bar, or different types of application windows could be distinguished by different colors or icons in a multitasking view.

[0078] In optional embodiments, the formatted results are displayed to the user or integrated into the device's user interface. For example, icons representing content categories can be displayed on the device's status bar, or different types of application windows can be distinguished by different colors or icons in a multitasking view. Image and video frames are captured on two sub-displays. For news articles, the system extracts text features such as keywords and sentence structure; for videos, the system extracts image and audio features. A machine learning model is used to classify the extracted features to determine that news articles belong to the "News" category and videos belong to the "Video" category. Two icons are displayed on the phone's status bar, one representing "News" and the other representing "Video," to visually show the user the content category of each sub-display.

[0079] Furthermore, multiple content areas are determined based on the content types of multiple sub-displays and the synchronization signals between multiple sub-displays, enabling multiple interactions between the content types of multiple sub-displays and the synchronization signals between multiple sub-displays, thus ensuring the accurate division of multiple content areas.

[0080] At this point, the content types of multiple sub-displays and synchronization signals between them are introduced. These synchronization signals refer to the correlation or consistency in the displayed content between different sub-displays. For example, two sub-displays might simultaneously play different parts of the same video or display different views of the same application.

[0081] These synchronization signals need to be detected to determine which sub-displays have related content and should be considered part of the same content area. After identifying the content types and detecting the synchronization signals, the system uses this information to determine multiple content areas. A content area is a collection of related sub-displays that collectively present a complete content or function. Optionally, clustering can be used to group sub-displays into different content areas. Once the content areas are determined, the system can implement multi-interaction functionality. This means that users can perform operations related to the same content area on different sub-displays, and these operations will be reflected synchronously on all related sub-displays. For example, a user can scroll through a long document on one sub-display, while another sub-display displaying different parts of the document will scroll accordingly. This multi-interaction functionality greatly improves device usability and user experience.

[0082] To ensure accurate division of multiple content areas, the system may continuously monitor and update information on content types and synchronization signals. This dynamic adjustment ensures that the division of content areas always remains consistent with the user's actual usage and preferences.

[0083] In an optional embodiment, a user is using a smartphone with two foldable sub-displays. The left sub-display displays an e-book reader app, while the right sub-display displays different chapters of the same e-book. The content on both sub-displays is synchronized because they both display different parts of the same e-book. Based on information about the content type and synchronization signals, the system determines that the two sub-displays belong to the same content area. The user can turn pages on the left sub-display, and the right sub-display will automatically synchronize to the corresponding page. This multi-interaction feature makes it easier for users to browse e-books. When the user switches to another application (e.g., starts watching a video on the left sub-display), the system re-evaluates and re-divides the content area to ensure that the new content area matches the user's current activity.

[0084] Simultaneously, the priority of multiple sub-displays is collected, and the opening mode of the mobile communication device's display screen, multiple content areas, and the priority of multiple sub-displays are associated. Based on the opening mode of the mobile communication device's display screen, multiple content areas, and the priority of multiple sub-displays, the usage scenario of the mobile communication device's display screen is determined. This approach takes into account the overall consideration of the opening mode of the mobile communication device's display screen, multiple content areas, and the priority of multiple sub-displays, and achieves precise control over the usage scenario of the mobile communication device's display screen.

[0085] Specifically, a priority system for multiple sub-displays is introduced, and the priority of each sub-display is collected. Priorities may be determined based on user settings, device default configurations, or real-time usage. For example, a user might set a sub-display as their primary work area, thus giving it a higher priority. Alternatively, if a sub-display is displaying urgent information (such as incoming calls, alarms, etc.), it may be automatically assigned a higher priority.

[0086] The system associates the opening mode of the mobile communication device's display screen, the priorities of multiple content areas and multiple sub-display screens, and establishes a complex mapping relationship to understand which content areas and sub-display screens have higher priorities under different display screen opening modes, and adjusts the device's display and behavior accordingly. For example, when the device is in a folded state, the system may default to using the smaller sub-display screen to display notifications and shortcuts, while using the larger sub-display screen to display main content and applications.

[0087] Meanwhile, the model learning method involves training a machine learning model to predict and determine the usage scenario of a mobile communication device's display screen based on features such as the screen's opening shape, multiple content areas, and the priority of multiple sub-displays. This involves collecting a large amount of data on the usage scenarios of mobile communication device displays, including features such as the screen's opening shape, content areas, and sub-display priorities, as well as corresponding usage scenario labels. The collected data undergoes preprocessing and feature extraction, converting the raw data into a format that the machine learning model can process. A suitable machine learning algorithm (such as a neural network) is selected, and the model is trained using the collected data. The model's performance is evaluated and optimized through methods such as cross-validation and adjusting model parameters. Finally, the trained model is applied to actual devices to predict the display screen's usage scenario based on real-time input feature data.

[0088] Optionally, a mobile communication device has two foldable sub-displays, and users often use different applications when the device is in different open states. Using model learning methods, we can train a model to predict the device's usage scenarios in different situations. When the device is unfolded, the user might prefer to use the left sub-display for work (such as editing documents), while using the right sub-display for entertainment (such as watching videos). In this case, the model can predict the current usage scenario as "work + entertainment" based on features such as the open state of the displays, the content area, and the priority of the sub-displays.

[0089] Another approach is to define a matching table based on the characteristics of the device and user needs, which includes the display screen's opening mode, content area, sub-display screen priority, and corresponding usage scenarios. When the device is in a certain state, the corresponding usage scenario is searched in the matching table based on the real-time input feature data (such as the display screen's opening mode, content area, etc.).

[0090] Suppose we have a matching table for mobile communication devices as follows:

[0091]

[0092] When the device is in the unfolded state, with the left sub-display showing a work document and the right sub-display playing a video, the current usage scenario can be determined as "work + entertainment" based on the matching table.

[0093] In step S14, the current usage system of multiple sub-displays is determined based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen.

[0094] In the specific implementation of this invention, the specific steps are as follows:

[0095] S141: Monitor the display screen of the mobile communication device in real time and collect the touch signals of the display screen of the mobile communication device.

[0096] S142: Determine the current touch position of the display screen of the mobile communication device based on the touch signal of the display screen of the mobile communication device;

[0097] S143: Collect the current user information of the display screen, and determine the user's usage preference relative to the display screen based on the current user information and the display screen usage database;

[0098] S144: Perform multiple interactions with the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen;

[0099] S145: Determine the current usage system of multiple sub-displays based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's multiple interactions with the display screen based on their usage preferences.

[0100] At this time, the display screen of the mobile communication device is monitored in real time, and the touch signals of the display screen are collected. The current contact position of the display screen is determined based on the touch signals of the display screen, and the current contact position of the display screen is introduced to realize the subsequent control of the current contact position of the display screen.

[0101] Specifically, the display screen of the mobile communication device is monitored in real time, and the touch signals of the display screen are collected in real time. The touch signals of the display screen of the mobile communication device include the touch position, force, duration and number of touch points.

[0102] The collected touch signals are processed to extract key information, such as the specific location of the touch point. Based on the results of the signal processing, the system determines the specific location of the touch point on the display screen. Optionally, the touch screen controller usually provides a coordinate system to represent various locations on the display screen. The position of the touch point is determined according to the coordinate information in the touch signal, thereby determining the current contact position of the mobile communication device's display screen.

[0103] In an optional embodiment, the status of the display screen is continuously monitored. When a user's finger touches the screen, the touch screen controller detects this event and generates a touch signal. These touch signals are collected in real time, processed, and the coordinate information of the touch point is extracted. Based on the coordinate system provided by the touch screen controller, the system determines the specific location of the touch point on the display screen.

[0104] For example, suppose a user is browsing the web on a smartphone equipped with a touchscreen. When the user taps a link on the screen with their finger, the touchscreen controller detects the touch operation and generates a touch signal. The touch signal contains the coordinates of the touch point, such as (500, 300). Based on these coordinates, the specific location of the touch point on the display screen is determined, i.e., on a link on the webpage, triggering a click event on the link and opening the webpage that the link points to.

[0105] Furthermore, the system collects current user information from the display screen, and determines the user's usage preferences relative to the display screen based on the current user information and the display screen usage database. This achieves the matching of current user information and the display screen usage database, and introduces the user's usage preferences relative to the display screen.

[0106] At this point, various types of information about users interacting with the display screen are collected, including but not limited to basic user attributes (such as age and gender), device usage habits, and historical operation records. Collection methods may include user-initiated input (such as registration information and questionnaires), automatic device recording (such as usage duration and operation frequency), and integration of third-party data (such as social media behavior analysis).

[0107] This approach incorporates current user information and a display usage database. The collected user information is matched against this database to identify specific user habits and needs regarding display usage. The database contains various user preferences and settings for different displays, along with related information such as device performance and display quality. The matching process may involve data comparison and content matching techniques to ensure accurate correspondence between user information and the corresponding records in the database. Once user preferences for a display are determined, these preferences can be applied to the actual display settings to provide a personalized user experience.

[0108] In an optional embodiment, within a news application, the system can match the user's preference information with a display usage database to find similar user groups and their display settings. For example, the system might discover that this user group generally prefers higher screen brightness contrast and smaller font sizes. Simultaneously, the news application can automatically adjust the screen brightness to the user's preferred level and apply a dark theme to reduce eye strain. Furthermore, the application interface can be optimized based on the user's one-handed operation habits, such as adjusting button size and position for easier one-handed operation.

[0109] Furthermore, multiple interactions are performed on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen. Based on these multiple interactions, the current usage system of multiple sub-display screens is determined, thus realizing the accuracy of the current usage system of multiple sub-display screens.

[0110] At this point, the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen are introduced. Multiple interactions are performed on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen, so as to realize the overall consideration of the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen.

[0111] In this usage scenario, considering the current contact position of the mobile communication device's display screen and the user's usage preferences relative to the display screen, the following factors are considered: the user's current usage scenario (e.g., indoor, outdoor, driving), the current contact position of the mobile communication device's display screen (i.e., the specific area the user is touching or operating), and the user's usage preferences relative to the display screen (e.g., brightness, color temperature, layout preferences). These factors are interrelated. Therefore, an interaction model is established to capture these interaction relationships and dynamically adjust them based on real-time data to identify user behavior patterns in different scenarios and make intelligent decisions in conjunction with a user preference database.

[0112] Meanwhile, the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen are introduced. A current usage system is determined for each sub-display screen. The current usage system includes settings for display content, layout, interaction methods, etc. The determination of the current usage system should ensure that users can obtain the best user experience in different scenarios.

[0113] To determine the current usage system for each sub-display, when a user actually uses the device, the system collects information on the current usage scenario, display touch position, and usage preferences in real time, and inputs this information into a trained usage system learning model. The system learning model then predicts the optimal sub-display usage system based on the input information and automatically adjusts the device's display and interaction settings. As user habits change, the system can periodically collect new data and retrain the usage system learning model to ensure the accuracy of the prediction results.

[0114] In step S15, in the current usage system of multiple sub-displays, the current usage coefficients of multiple sub-displays are marked, and the presentation angle of the display interface corresponding to the multiple sub-displays is determined based on the current usage coefficients of multiple sub-displays, the user's current posture, and the content displayed on the multiple sub-displays.

[0115] In the specific implementation of this invention, the specific steps are as follows:

[0116] S151: Obtain the current operating system of multiple sub-displays;

[0117] S152: In the current usage system of multiple sub-displays, collect the number of times the multiple sub-displays are triggered within a preset time;

[0118] S153: Determine the current usage coefficient of multiple sub-displays based on the number of times multiple sub-displays are triggered within a preset time and the user's usage pattern relative to the mobile communication device, and dynamically mark the current usage coefficient of multiple sub-displays.

[0119] S154: Collect user motion images and determine multiple motion features based on the recognition of user motion images;

[0120] S155: Determine the user's current posture based on multiple motion features and the user's body characteristics;

[0121] S156: Perform multiple interactions based on the current usage coefficient of multiple sub-displays, the user's current posture, and the content displayed on the multiple sub-displays; determine the presentation angle of the display interface corresponding to the multiple sub-displays based on the multiple interactions of the current usage coefficient of multiple sub-displays, the user's current posture, and the content displayed on the multiple sub-displays.

[0122] At this point, the current usage system of multiple sub-displays is obtained; within the current usage system of multiple sub-displays, the number of times each sub-display is triggered within a preset time is collected; based on the number of times each sub-display is triggered within the preset time and the user's usage pattern relative to the mobile communication device, the current usage coefficient of multiple sub-displays is determined, and the current usage coefficient of multiple sub-displays is dynamically marked. The current usage coefficient of multiple sub-displays is introduced to control the frequency of current use of multiple sub-displays.

[0123] Specifically, a current usage system for multiple sub-displays was introduced and managed, thereby achieving precise control over the multiple sub-displays.

[0124] In the current usage system with multiple sub-displays, the number of times each sub-display is triggered within a preset time period is collected. Specifically, the number of times each sub-display is triggered within a preset time period refers to the frequency of user operations on multiple sub-displays installed on the device (which may be different parts of a foldable phone, multiple display areas of a tablet, or other devices with multiple independent display units) within a pre-set time period. At this time, the number of times each sub-display is operated by the user (such as clicking, swiping, touching, etc.) within this time period is recorded. The preset time period is usually a fixed time period, such as 5 minutes, 20 minutes, or 60 minutes.

[0125] For example, a foldable phone has two sub-displays: an inner screen and an outer screen. A preset 5-minute period is set to collect user activity data. Within these 5 minutes, the user performs 30 taps and swipes on the inner screen, but only 5 taps on the outer screen. Therefore, we can say that within the preset 5 minutes, the inner screen was triggered 30 times, while the outer screen was triggered 5 times. This data can help us understand user preferences and usage habits on different screens, thus providing a basis for subsequent device optimization and user experience improvements.

[0126] The system introduces the number of times multiple sub-displays are triggered within a preset time period and the user's usage pattern relative to the mobile communication device. The user's usage pattern relative to the mobile communication device usually refers to the way, habits, or behavioral characteristics of the user using the mobile communication device in a specific context.

[0127] Optionally, the current usage coefficient of each sub-display can be calculated based on the number of triggers, usage patterns, and corresponding weight allocations. The usage coefficient can be a value between 0 and 1, representing the importance or activity of the screen in the current usage scenario.

[0128] For example, in the past 5 minutes, the inner screen was triggered 20 times (users frequently clicked emails, scrolled pages, etc.), and the outer screen was triggered 5 times (users occasionally checked the time or weather information). Based on the user's usage patterns and the number of triggers, the system determines that the inner screen is more important in the current office scenario. Therefore, it assigns a higher usage coefficient to the inner screen, such as 0.8, and a lower usage coefficient to the outer screen, such as 0.2. Optionally, this usage coefficient can be used for subsequent system optimization, interface adjustments, or user experience improvements. For example, the system can automatically adjust the brightness, contrast, or display mode of the inner and outer screens based on the usage coefficient to better meet the user's needs in the current scenario.

[0129] Furthermore, the system collects motion images of the user and determines multiple motion features based on the recognition of these images. It then determines the user's current posture based on these multiple motion features and the user's body characteristics, taking into account both motion features and the user's body characteristics as a whole, thus achieving precise control over the user's current posture.

[0130] Specifically, user motion images are introduced. Devices with image acquisition capabilities are used to capture user motion images, which are then recognized. During the recognition process, image processing technology is used to process the captured motion images. Through a preset motion learning model, motion recognition is performed on the processed images, extracting multiple motion features, such as hand position, body tilt angle, and head turning. The recognized motion features are then quantified for subsequent posture judgment.

[0131] Simultaneously, user body characteristics, such as height, weight, and limb length, are incorporated. Combining multiple motion features with these body characteristics, a pre-defined posture learning model is used to determine posture. For example, if the system detects that the user's hands are positioned high and the body is leaning forward, and considering the user's height and limb length, it can be determined that the user may be taking a selfie. By comprehensively considering multiple motion and body characteristics, precise control over the user's current posture can be achieved, providing a basis for subsequent interaction design and user experience optimization.

[0132] Therefore, multiple interactions are performed on the current usage coefficients of multiple sub-displays, the user's current posture, and the content displayed on the multiple sub-displays. Based on the multiple interactions of the current usage coefficients of multiple sub-displays, the user's current posture, and the content displayed on the multiple sub-displays, the presentation angle of the display interface corresponding to the multiple sub-displays is determined, ensuring that the display interface corresponding to the multiple sub-displays dynamically adapts to the user.

[0133] Specifically, the system incorporates the current usage coefficients of multiple sub-displays, the user's current posture, and the content displayed on each sub-display. Here, the usage coefficient is an indicator of the activity or importance of the sub-display. This is typically based on the user's interactions with each sub-display, such as clicks, swipes, and dwell time. By recording this interaction data, the system can calculate the current usage coefficient for each sub-display.

[0134] A user's current posture refers to their body position and movements when using multiple sub-displays. This can be captured and identified using technologies such as cameras and sensors. For example, the system can identify whether the user is standing, sitting, or leaning to one side.

[0135] The content displayed on each sub-display is also a crucial factor in multi-level interaction. The system needs to recognize and understand this content in order to adapt it to the user's needs and preferences. For example, one sub-display might show work-related documents, while another might display entertainment content.

[0136] Based on usage coefficients, user posture, and content relevance, multiple interaction analysis is conducted. These multiple interactions may include user switching between different sub-displays, content adjustments caused by changes in posture, etc. In this case, based on the results of multiple interactions, the optimal presentation angle of the display interface corresponding to each sub-display is determined. The presentation angle can be the screen tilt, rotation direction, etc., to ensure that the content is user-friendly and easy to read.

[0137] At this time, the system collects real-time data on user interaction with each sub-display, user posture data, and content displayed on each sub-display. Based on the collected data, the system analyzes and calculates to determine the current usage coefficient of each sub-display, the user's current posture, and the relevance of the content. Based on the analysis results, the system makes decisions, such as adjusting the layout, presentation angle, and content order of the sub-displays, to optimize the user's interactive experience.

[0138] In an optional embodiment, a user is editing an important report on the document screen while occasionally viewing data charts on the chart screen to support report writing. By monitoring the user's interactive behavior (such as clicking, swiping, and dwell time), the system calculates that the current usage coefficient of the document screen is relatively high, while the usage coefficient of the chart screen is relatively low, but still maintains a certain level of activity. The user is sitting in front of the workstation, leaning slightly forward, with their eyes naturally focused in front. At the same time, the system captures the user's posture data through a camera and sensors, and analyzes that the angle between the user's line of sight and the workstation plane is approximately 20 degrees.

[0139] The document screen displays the report content that the user is editing, while the chart screen displays data charts related to the report. Recognizing that the content on these two screens is interconnected and that the user frequently switches between and compares them, the document screen's angle is adjusted to approximately 0 degrees (i.e., the screen is almost parallel to the user's line of sight) to ensure the user can view and edit the document in the most comfortable way, given that the user is focused on editing the report and its usage frequency is high.

[0140] Chart Screen: Although the chart screen is used relatively infrequently, considering users' frequent need to view charts to support report writing, and to avoid visual interference with the document screen, the system adjusts the chart screen's presentation angle to be slightly tilted towards the user (approximately 30 degrees from the user's line of sight). This allows users to easily view chart content without deviating from their primary line of sight. By adjusting the presentation angles of the two sub-screens, the system provides users with a more comfortable, efficient, and personalized work interface. Users can easily view and compare chart data while focusing on document editing, thereby improving work efficiency and satisfaction.

[0141] In step S16, the dynamic display mode of the mobile communication device's display screen is determined based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative position of the multiple sub-display screens. Based on the dynamic display mode and the user's voice command, the directional presentation of the display interface corresponding to the multiple sub-display screens is triggered.

[0142] In the specific implementation of this invention, the specific steps are as follows:

[0143] S161: Obtain the presentation angle of the display interface corresponding to multiple sub-display screens;

[0144] S162: Collect corresponding attitude data sets based on the detection of multiple sub-displays; determine the current attitude of multiple sub-displays based on the identification of each attitude data set;

[0145] S163: Determine the dynamic display mode of the mobile communication device's display screen based on the current posture of multiple sub-display screens, the presentation angle of the display interface corresponding to the multiple sub-display screens, and the relative position of the multiple sub-display screens.

[0146] S164: Collecting user voice commands based on mobile communication devices;

[0147] S165: Determine the corresponding directional indication based on the parsing of the user's voice command;

[0148] S166: Trigger the orientation presentation of the display interfaces corresponding to multiple sub-displays based on the corresponding orientation indication, the dynamic display mode of the mobile communication device's display screen, and the user's stationary state.

[0149] At this point, the presentation angles of the display interfaces corresponding to multiple sub-displays are obtained; corresponding attitude data sets are collected based on the detection of multiple sub-displays; and the current attitude of multiple sub-displays is determined based on the recognition of each attitude data set, thus ensuring the accuracy of the current attitude of multiple sub-displays.

[0150] The presentation angle of the display interface corresponding to multiple sub-displays is introduced. The presentation angle of the display interface corresponding to multiple sub-displays is the current physical tilt angle or the angle relative to a certain reference plane of each sub-display. At the same time, the attitude detection of multiple sub-displays is carried out, and multiple attitude data are collected in the attitude detection of multiple sub-displays, so as to form an attitude data set through the autonomous aggregation of multiple attitude data.

[0151] For example, mobile communication devices may be equipped with multiple sensors (such as gyroscopes, magnetometers, etc.), which can detect the device's three-dimensional attitude in real time. Simultaneously, if the device is equipped with front or rear cameras, they can also capture the device's relative position and orientation with respect to its surroundings. All this data is collected to form an attitude data set.

[0152] For the identification of each posture data set, the collected posture data sets are analyzed and identified to determine the current posture of each sub-display. Once the current posture is determined, the system can adjust the display content, layout, or trigger other related functions based on this information.

[0153] To determine the current pose of multiple sub-displays, a deep learning model, particularly a convolutional neural network (CNN), is employed for pose recognition. Specifically, the collected sensor and image data are preprocessed, such as through normalization and noise reduction, to improve data quality. Pose data (e.g., rotation angles, orientation vectors) is converted into a format understandable by the model. A CNN model is then constructed, which receives preprocessed image data as input and outputs the pose information of the sub-displays. Appropriate convolutional layers, pooling layers, and fully connected layers are added to the model to extract features from the images and predict poses. Therefore, a labeled dataset (i.e., images of displays with known poses) is used to train the CNN model. The model weights are adjusted using backpropagation to minimize the error between the predicted and true poses. By employing this model learning method, the pose of each sub-display can be identified in real time. The pose of a sub-display refers to its specific position and orientation in three-dimensional space.

[0154] Meanwhile, the dynamic display mode of the mobile communication device's display screen is determined based on the current posture of multiple sub-display screens, the presentation angle of the display interface corresponding to the multiple sub-display screens, and the relative position of the multiple sub-display screens. This takes into account the overall consideration of the current posture of multiple sub-display screens, the presentation angle of the display interface corresponding to the multiple sub-display screens, and the relative position of the multiple sub-display screens, thus ensuring the accuracy of the dynamic display mode of the mobile communication device's display screen.

[0155] Specifically, this involves introducing the current orientation of multiple sub-displays, the presentation angle of the corresponding display interfaces, and the relative positions of the sub-displays. Here, the current orientation of the sub-displays refers to their position and orientation in three-dimensional space. This includes tilting and rotation. The presentation angle of the display interfaces refers to the tilt and rotation angle of the display interface relative to the user's viewpoint or a fixed reference frame. The presentation angle directly affects the user's viewing experience. A correct presentation angle ensures that the displayed content remains clear and undistorted in the user's eyes. The relative positions of the sub-displays refer to their relative spatial arrangement and distance.

[0156] The system interacts with the current posture of multiple sub-displays, the presentation angle of the display interface corresponding to each sub-display, and the relative position of the multiple sub-displays. It takes into account the overall consideration of the current posture of multiple sub-displays, the presentation angle of the display interface corresponding to each sub-display, and the relative position of the multiple sub-displays, thus ensuring the accuracy of the dynamic display mode of the mobile communication device's display screen.

[0157] A dynamic display mode matching table is introduced to match the posture, presentation angle, and relative position of multiple sub-displays with corresponding dynamic display modes. The dynamic display mode matching table is designed based on possible input information (such as the posture, presentation angle, and relative position of the sub-displays) and output information (such as dynamic display modes). In the table, each row represents a specific combination of input information and corresponding output information. The posture, presentation angle, and relative position of multiple sub-displays are acquired in real time. The table is searched for rows that match this information, and the corresponding dynamic display mode is obtained. Based on the matched dynamic display mode, the display settings of the mobile communication device are adjusted.

[0158] Optionally, the current orientation of the two screens (e.g., fixed), the display angle (e.g., landscape mode, portrait mode), and their relative positions (e.g., left-right arrangement) can be matched with the corresponding dynamic display modes. For example, in the matching table, we can define that when both screens are in landscape mode and arranged left-right, one mode is used to allow both screens to display a wide-angle video simultaneously; when one screen is in portrait mode, the other mode is used to display the main content on that screen, while the other screen displays related control options or information.

[0159] Another example is a smartphone equipped with dual screens:

[0160] When a user holds their phone horizontally to watch a video, the main screen automatically adjusts to landscape mode to accommodate a wider display area. Meanwhile, the secondary screen can display control options or related information, such as volume control and playlists.

[0161] When a user tilts their phone to view information on the secondary screen, the content on the secondary screen automatically rotates to fit the user's viewing angle, ensuring the information is clearly visible. Simultaneously, the video content on the main screen also fine-tunes according to the user's viewing angle to maintain the best viewing experience.

[0162] In game mode, the main screen displays the game screen, while the secondary screen shows the game map, control buttons, or chat messages. The content on both screens updates in real time according to the game progress, maintaining continuity and providing players with a richer, more immersive gaming experience.

[0163] Furthermore, user voice commands are collected based on mobile communication devices; corresponding directional indicators are determined based on the parsing of user voice commands, thus introducing directional indicators to facilitate directional presentation of the display interfaces corresponding to multiple sub-displays.

[0164] At this time, the built-in microphone of the mobile communication device is responsible for capturing the user's voice input. The voice signal is preprocessed, such as noise reduction and enhancement, to improve the accuracy of subsequent parsing. Using natural language processing and speech recognition technology, the user's voice commands are converted into text form, and further semantic analysis is performed on the text to understand the user's intentions and specific needs.

[0165] Meanwhile, the directional indication is determined based on the user's voice command parsing results to indicate which one or more sub-displays to perform a specific operation or display content. Based on the user's intent and needs, combined with the current state of the mobile communication device (such as the posture, presentation angle, and relative position of the sub-displays), specific directional indications are generated. The directional indications may include operations such as switching displayed content, rotating, scaling, and moving the interface.

[0166] Therefore, based on the directional instructions, the display content of the designated sub-display screen is adjusted accordingly. The adjustments may include switching the display content, rearranging the interface, adding or removing elements, etc., to achieve collaborative work among multiple sub-display screens and ensure the continuity and consistency of the displayed content. For example, in dual-screen mode, one screen displays the main content, and the other screen displays auxiliary information or control options. Both are updated synchronously according to the user's voice commands.

[0167] In an alternative embodiment, suppose a user has a smartphone with dual screens and wants to control the content displayed on the screens via voice commands. The user might say, "Show the map on the main screen and the navigation information on the secondary screen."

[0168] The device captures and analyzes the user's voice commands. The analysis indicates that the user wants the map application displayed on the main screen, while navigation information associated with the map is displayed on the secondary screen. Based on the analysis results, the device generates directional instructions, launches the map application on the main screen, and displays the navigation information on the secondary screen. The user confirms the operation result through visual feedback and can perform further operations or adjustments as needed.

[0169] Therefore, based on the corresponding orientation instructions, the dynamic display mode of the mobile communication device's display screen, and the user's stationary state, the orientation presentation of the display interfaces corresponding to multiple sub-display screens is triggered, ensuring the orientation display of the display interfaces corresponding to multiple sub-display screens.

[0170] Specifically, mobile communication devices first acquire the user's voice commands through voice recognition technology, and then use natural language processing technology to parse the voice commands to obtain corresponding directional instructions. These directional instructions specify which sub-displays or sub-displays the user wants to display specific content or perform a specific operation.

[0171] The system incorporates corresponding orientation indicators, dynamic display modes of the mobile communication device's screen, and the user's stationary state. The device detects the user's stationary state using built-in sensors (such as accelerometers and gyroscopes). When the user is stationary (e.g., holding the device still or placing it on a table), the device triggers the orientation presentation process.

[0172] Furthermore, after acquiring the orientation instruction, determining the dynamic display mode, and detecting the user's stationary state, the device triggers the orientation presentation process. This process includes displaying content or performing operations on the designated sub-display screen according to the orientation instruction, and adjusting the display mode to adapt to the current display environment. Optionally, the user says, "Display the navigation route on the secondary screen, and keep the current music playback interface on the main screen." The device captures the user's voice command and parses the orientation instruction, i.e., "Display the navigation route on the secondary screen," through voice recognition and natural language processing technology. The device detects that both the main and secondary screens of the dual-screen phone are in portrait mode and their relative positions are fixed. Based on this information, the device automatically selects a dynamic display mode suitable for portrait mode, i.e., the content is vertically arranged on the screen. The user places the phone stably on a phone holder in the car, and the device detects that the user is stationary through built-in sensors. After acquiring the orientation instruction, determining the dynamic display mode, and detecting the user's stationary state, the device triggers the orientation presentation process. The navigation route is immediately displayed on the secondary screen, while the main screen maintains the current music playback interface. The user can clearly see the navigation route and enjoy music playback without manual operation.

[0173] In this embodiment of the invention, when the display screen of a mobile communication device contains multiple sub-display screens, the spatial positions of the multiple sub-display screens are collected; the opening mode of the mobile communication device's display screen is determined based on the spatial positions of the multiple sub-display screens; the usage scenario of the mobile communication device's display screen is determined according to the opening mode of the mobile communication device's display screen, the content displayed on the multiple sub-display screens, and the priority of the multiple sub-display screens; and the current usage system of the multiple sub-display screens is determined based on the usage scenario, the current contact position of the mobile communication device's display screens, and the user's usage preferences relative to the display screens. This approach takes into account the overall considerations of the usage scenario, the current contact position of the mobile communication device's display screens, and the user's usage preferences relative to the display screens, ensuring the accuracy of the current usage system of the multiple sub-display screens and achieving precise control of the multiple sub-display screens.

[0174] Furthermore, in the current usage system of multiple sub-displays, the current usage coefficients of multiple sub-displays are marked. Based on the current usage coefficients of multiple sub-displays, the user's current posture, and the content displayed on multiple sub-displays, the presentation angle of the display interface corresponding to the multiple sub-displays is determined. This achieves control over the presentation angle of the display interface corresponding to the multiple sub-displays, ensuring that the display interface corresponding to the multiple sub-displays dynamically adapts to the user.

[0175] Therefore, the dynamic display mode of the mobile communication device's display screen is determined based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative position of the multiple sub-display screens. Based on this dynamic display mode and the user's voice commands, the directional presentation of the display interface corresponding to the multiple sub-display screens is triggered, thereby realizing the directional presentation of the display interface corresponding to the multiple sub-display screens and ensuring the directional display of the display interface corresponding to the multiple sub-display screens.

[0176] Example 3

[0177] Please see Figure 3 , Figure 3 This is a schematic diagram of the structure of the dynamic display system of the display screen of the mobile communication device in an embodiment of the present invention.

[0178] like Figure 3 As shown, a dynamic display system for a mobile communication device's display screen includes:

[0179] The acquisition module 21 is used to acquire the spatial positions of multiple sub-displays when the display screen of a mobile communication device contains multiple sub-displays;

[0180] The form module 22 is used to determine the opening form of the mobile communication device's display screen based on the spatial position of multiple sub-display screens;

[0181] Scene module 23 is used to determine the usage scenario of the mobile communication device's display screen based on the opening mode of the mobile communication device's display screen, the content displayed by the multiple sub-display screens, and the priority of the multiple sub-display screens.

[0182] The system module 24 is used to determine the current usage system of multiple sub-displays based on the usage scenario, the current contact position of the display screen of the mobile communication device, and the user's usage preferences relative to the display screen.

[0183] Angle module 25 is used to mark the current usage coefficient of multiple sub-displays in the current usage system of multiple sub-displays, and determine the presentation angle of the display interface corresponding to the multiple sub-displays based on the current usage coefficient of multiple sub-displays, the user's current posture and the content displayed on the multiple sub-displays.

[0184] The orientation module 26 is used to determine the dynamic display mode of the mobile communication device's display screen based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative position of the multiple sub-display screens, and to trigger the orientation presentation of the display interface corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command.

[0185] Example 4

[0186] In this embodiment, an electronic device is provided. Its internal structure diagram can be shown as follows: Figure 4 As shown, the electronic device includes a processor, memory, network interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and computer programs, and also deploys a database for storing user behavior data and user profiles. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The network interface is used to communicate with other electronic devices that have deployed application software. When the computer program is executed by the processor, it implements a low-altitude reconnaissance method for a drone. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the device's casing, or an external keyboard, touchpad, or mouse.

[0187] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

Claims

1. A dynamic display method for a mobile communication device's display screen, characterized in that, include: When the display screen of a mobile communication device contains multiple sub-display screens, the spatial positions of the multiple sub-display screens are collected; The opening mode of the mobile communication device's display screen is determined based on the spatial position of multiple sub-display screens; The usage scenario of the mobile communication device's display screen is determined based on the opening mode of the mobile communication device's display screen, the content displayed on the multiple sub-display screens, and the priority of the multiple sub-display screens. Based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen, the current usage system of multiple sub-display screens is determined. The current usage system includes the settings of display content, layout, and interaction methods. In the current usage system of multiple sub-display screens, the current usage coefficient of multiple sub-display screens is marked, and the presentation angle of the display interface corresponding to multiple sub-display screens is determined based on the current usage coefficient of multiple sub-display screens, the user's current posture, and the content displayed on multiple sub-display screens. The dynamic display mode of the mobile communication device's display screen is determined based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative position of the multiple sub-display screens. Based on the dynamic display mode and the user's voice command, the directional presentation of the display interface corresponding to the multiple sub-display screens is triggered. The directional presentation process includes displaying content or performing operations on the designated sub-display screen according to the directional instructions, and adjusting the display mode to adapt to the current display environment.

2. The dynamic display method for the display screen of a mobile communication device according to claim 1, characterized in that, When the display screen of a mobile communication device contains multiple sub-display screens, the spatial positions of the multiple sub-display screens are collected, including: Multiple screen signals are determined based on screen detection of the display screen of a mobile communication device; Multiple sub-displays are determined based on the analysis of multiple screen signals. In this case, the display screen of the mobile communication device contains multiple sub-displays. A spatial coordinate system is constructed based on the display screen of the mobile communication device, and the corresponding coordinates are marked for multiple sub-display screens; The spatial location of multiple sub-display screens is determined based on their coordinates.

3. The dynamic display method for the display screen of a mobile communication device according to claim 2, characterized in that, Determining the opening mode of the mobile communication device's display screen based on the spatial position of multiple sub-display screens includes: Obtain the spatial positions of multiple sub-display screens; Predict the relative angles of each sub-display based on the spatial positions of multiple sub-displays; Collect the outline of multiple sub-display screens; If the outlines of multiple sub-displays are inconsistent, the spatial layout of the mobile communication device's display screen is determined based on the outlines of the multiple sub-displays and their spatial positions. The opening mode of the mobile communication device's display screen is determined based on the spatial layout of the display screen and the relative angles of each sub-display screen.

4. The dynamic display method for the display screen of a mobile communication device according to claim 3, characterized in that, The process of determining the usage scenario of the mobile communication device's display screen based on the opening state of the mobile communication device's display screen, the content displayed on the multiple sub-display screens, and the priority of the multiple sub-display screens includes: Obtain the open state of the mobile communication device's display screen; Real-time monitoring of multiple sub-display screens, and determination of the content types of the multiple sub-display screens based on the content displayed on them; Multiple content areas are determined based on the content types of multiple sub-displays and the synchronization signals between multiple sub-displays; Collect the priority of multiple sub-displays and associate the opening mode of the mobile communication device's display screen, multiple content areas, and the priority of multiple sub-displays. The usage scenario of the mobile communication device's display screen is determined based on the opening mode of the display screen, multiple content areas, and the priority of multiple sub-display screens.

5. The dynamic display method for the display screen of a mobile communication device according to any one of claims 1 to 4, characterized in that, The system for determining the current usage of multiple sub-displays based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen includes: Real-time monitoring of the display screen of mobile communication devices and collection of touch signals from the display screen of mobile communication devices; The current touch position of the mobile communication device's display screen is determined based on the touch signal from the display screen. Collect current user information on the display screen, and determine the user's usage preferences relative to the display screen based on the current user information and the display screen usage database; The system allows for multiple interactions based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen. The current usage system of multiple sub-displays is determined based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's multiple interactions with the display screen based on their usage preferences.

6. The dynamic display method for the display screen of a mobile communication device according to claim 5, characterized in that, In the current usage system of multiple sub-display screens, the current usage coefficients of the multiple sub-display screens are marked. Based on the current usage coefficients of the multiple sub-display screens, the user's current posture, and the content displayed on the multiple sub-display screens, the presentation angle of the display interface corresponding to the multiple sub-display screens is determined, including: Obtain the current operating system of multiple sub-displays; In the current system with multiple sub-displays, collect the number of times each sub-display is triggered within a preset time period; The current usage coefficient of the multiple sub-displays is determined based on the number of times they are triggered within a preset time and the user's usage pattern relative to the mobile communication device, and the current usage coefficient of the multiple sub-displays is dynamically marked.

7. The dynamic display method for the display screen of a mobile communication device according to claim 6, characterized in that, In the current usage system of multiple sub-display screens, marking the current usage coefficients of multiple sub-display screens, and determining the presentation angle of the display interface corresponding to the multiple sub-display screens based on the current usage coefficients of the multiple sub-display screens, the user's current posture, and the content displayed on the multiple sub-display screens, further includes: Collect user motion images and determine multiple motion features based on the recognition of user motion images; The user's current posture is determined based on multiple motion features and the user's body characteristics; Multiple interactions are performed on the current usage coefficients of multiple sub-displays, the user's current posture, and the content displayed on the multiple sub-displays; the presentation angle of the display interface corresponding to the multiple sub-displays is determined based on the current usage coefficients of multiple sub-displays, the user's current posture, and the multiple interactions on the content displayed on the multiple sub-displays.

8. The dynamic display method for the display screen of a mobile communication device according to claim 7, characterized in that, The process of determining the dynamic display mode of the mobile communication device's display screen based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative positions of the multiple sub-display screens, and triggering the directional presentation of the display interface corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command, includes: Obtain the display angle of the display interface corresponding to multiple sub-display screens; Collect corresponding pose data sets based on the detection of multiple sub-displays; determine the current pose of multiple sub-displays based on the identification of each pose data set; The dynamic display mode of the mobile communication device's display screen is determined based on the current orientation of multiple sub-display screens, the presentation angle of the display interface corresponding to the multiple sub-display screens, and the relative position of the multiple sub-display screens.

9. The dynamic display method for the display screen of a mobile communication device according to claim 8, characterized in that, The step of determining the dynamic display mode of the mobile communication device's display screen based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative position of the multiple sub-display screens, and triggering the directional presentation of the display interface corresponding to the multiple sub-display screens based on the dynamic display mode and the user's voice command, further includes: Collecting user voice commands based on mobile communication devices; The corresponding directional indication is determined based on the parsing of the user's voice commands; The orientation of the display interface corresponding to multiple sub-displays is triggered based on the corresponding orientation indication, the dynamic display mode of the mobile communication device's display screen, and the user's stationary state.

10. A dynamic display system for a display screen of a mobile communication device, characterized in that, The dynamic display system of the mobile communication device's display screen is applied to the dynamic display method of the mobile communication device's display screen as described in any one of claims 1-9, wherein the dynamic display system of the mobile communication device's display screen includes: The acquisition module is used to acquire the spatial positions of multiple sub-displays when the display screen of a mobile communication device contains multiple sub-displays; The form module is used to determine the opening form of the mobile communication device's display screen based on the spatial position of multiple sub-display screens; The scenario module is used to determine the usage scenario of the mobile communication device's display screen based on the opening mode of the mobile communication device's display screen, the content displayed by multiple sub-display screens, and the priority of the multiple sub-display screens. The system module is used to determine the current usage system of multiple sub-displays based on the usage scenario, the current contact position of the mobile communication device's display screen, and the user's usage preferences relative to the display screen. The current usage system includes the settings of display content, layout, and interaction methods. The angle module is used to mark the current usage coefficient of multiple sub-displays in the current usage system of multiple sub-displays, and determine the presentation angle of the display interface corresponding to the multiple sub-displays based on the current usage coefficient of the multiple sub-displays, the user's current posture, and the content displayed on the multiple sub-displays. The orientation module is used to determine the dynamic display mode of the mobile communication device's display screen based on the presentation angle of the display interface corresponding to the multiple sub-display screens and the relative position of the multiple sub-display screens. Based on the dynamic display mode and the user's voice command, the orientation presentation of the display interface corresponding to the multiple sub-display screens is triggered. The orientation presentation process includes displaying content or performing operations on the designated sub-display screen according to the orientation instruction, and adjusting the display mode to adapt to the current display environment.

Images