Information processing method and device, terminal equipment, storage medium and program product
By setting a blurred background for the second display interface in the mirrored display, the issues of inconsistent mirrored display effects and flickering were resolved, thus improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- BEIJING XIAOMI MOBILE SOFTWARE CO LTD
- Filing Date
- 2024-10-28
- Publication Date
- 2026-04-28
Smart Images
Figure CN121934798A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of information processing technology, and in particular to an information processing method, apparatus, terminal equipment, storage medium, and computer program product. Background Technology
[0002] With the development of technology, more and more terminal devices have emerged, and their functions have become increasingly rich. Each terminal device can be applied in its corresponding use case, and different terminal devices may have different use cases and different functions.
[0003] Some terminal devices have a mirroring function, which can mirror the content currently displayed on the screen. For example, you can mirror the screen to another device, or you can magnify the mirrored content using a magnifying glass. Summary of the Invention
[0004] This disclosure provides an information processing method, apparatus, terminal equipment, storage medium, and computer program product.
[0005] A first aspect of this disclosure provides an information processing method applied to a first device. The method includes: determining a target service request; wherein the target service request is used to display a first display interface; determining a second display interface; wherein the second display interface is an interface corresponding to the first display interface in mirror information; determining a background interface of the second display interface based on the mirror information; wherein at least a portion of the background interface has a blurring effect; the background interface is used to blur the background of the second display interface when it is displayed; and performing a target operation based on the background interface; wherein the target operation is used to display the second display interface based on the background interface.
[0006] In one embodiment, determining the second display interface includes: determining the mirror information; and determining the second display interface from the mirror information.
[0007] In one embodiment, determining the mirror information includes: acquiring each first layer and each second layer for display; wherein the first layer and the second layer have an interlayer relationship representing the original layer and the mirror layer; and determining the mirror layer from the first layer and the second layer according to the interlayer relationship.
[0008] In one embodiment, determining the second display interface from the mirror information includes: taking the interface corresponding to the highest display layer in the mirror information as the second display interface; wherein the mirror information includes multiple layers.
[0009] In one embodiment, determining the background interface of the second display interface includes: determining a blurred object based on the second display interface; and blurring the blurred object to obtain the background interface.
[0010] In one embodiment, determining the blurred object based on the second display interface includes: determining a third display interface; wherein the third display interface is: the interface corresponding to each layer below the layer where the second display interface is located in the mirror information when the second display interface is displayed; and determining the blurred object from the third display interface.
[0011] In one embodiment, determining the blurred object from the third display interface includes: obtaining the occlusion relationship of the displayed content in each of the third display interfaces; and determining the blurred object based on the occlusion relationship.
[0012] In one embodiment, determining the fuzzy object based on the third display interface includes: determining the fuzzy object based on preset information and the third display interface; wherein the preset information includes the association between the third display interface and the fuzzy object.
[0013] In one embodiment, the step of blurring the blurred object to obtain the background interface includes: blurring the blurred object to obtain a fourth display interface; superimposing the fourth display interface and the interfaces in the mirror information excluding the second display interface to form a fifth display interface; and determining the background interface based on the fifth display interface.
[0014] In one embodiment, determining the background interface of the second display interface includes: detecting whether the display content in the third display interface has changed; when the display content in the third display interface has changed, redetermining the background interface based on the changed third display interface; and when the display content in the third display interface has not changed, not redetermining the background interface.
[0015] In one embodiment, determining the background interface of the second display interface includes: removing duplicate layers from the mirror information and the original information of the mirror information; and determining the background interface based on the interface corresponding to the deduplicated layer.
[0016] In one embodiment, determining the target service request includes: detecting a target input operation performed on the display screen of the first device or the display screen of the second device; wherein the target input operation is used to display the first display interface; and determining the target service request based on the input operation.
[0017] In one embodiment, the mirror information is used to magnify and display the information displayed on the first device through a magnifying window; the step of performing the target operation based on the background interface includes: displaying the second display interface on the first device based on the background interface.
[0018] In one embodiment, the information displayed in the first device is mirrored in the second device; the step of performing the target operation based on the background interface includes: sending the mirrored information containing the background interface to the second device; wherein, the background interface is used by the second device to display the second display interface based on the background interface.
[0019] In one embodiment, the mirror information is used to magnify and display the information displayed by the first device through a magnifying window in the first device; the method further includes: determining the original interface corresponding to the first display interface in the original information of the mirror information; determining the background interface of the original interface; blurring the background interface of the original interface to obtain the background interface of the original interface; and displaying the original interface according to the background interface of the original interface.
[0020] A second aspect of this disclosure provides an information processing apparatus, comprising: a first determining module, configured to determine a target service request; wherein the target service request is configured to display a first display interface; a second determining module, configured to determine a second display interface; wherein the second display interface is an interface corresponding to the first display interface in mirrored information; a third determining module, configured to determine a background interface of the second display interface based on the mirrored information; wherein at least a portion of the background interface has a blurring effect; the background interface is configured to blur the background of the second display interface when it is displayed; and a processing module, configured to perform a target operation based on the background interface; wherein the target operation is configured to display the second display interface based on the background interface.
[0021] A third aspect of this disclosure provides a terminal device, including: a processor and a memory for storing executable instructions capable of running on the processor, wherein: when the processor runs the executable instructions, the executable instructions perform the method described in any of the above embodiments.
[0022] A fourth aspect of this disclosure provides a non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the method described in any of the above embodiments.
[0023] A fifth aspect of this disclosure provides a computer program product, including a computer program or executable instructions, which, when executed by a processor, implement the method described in any of the above embodiments.
[0024] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:
[0025] In the scheme of this embodiment, when displaying a first display interface and performing a mirrored display according to a target service request, the background interface of the second display interface corresponding to the first display interface in the mirrored information is determined, and a target operation for displaying the second display interface based on the background interface is performed. Since at least a portion of the determined background of the second display interface has a blurred effect, and this is used to blur the background of the second display interface when it is displayed, the background of the second display interface will have a blurred effect when the second display interface is mirrored, thus highlighting the second display interface and improving the display effect and user experience. Furthermore, since it is a mirrored display, when the background of the interface corresponding to the first display interface in the original display information has a blurred effect, the background interface of the second display interface in the mirrored information can also have a blurred effect, thus making the original information and mirrored information display the same, reducing the possibility of the mirrored effect differing from the original information display, improving the mirroring effect, and thus enhancing the user experience.
[0026] In addition, since the background interface is generated separately for the second display interface in the mirror information, the process of simultaneously determining the background interface for the interface corresponding to the first display interface in both the original display information and the mirror information, thus blurring the background, is reduced. This reduces flickering, improves the display effect, and enhances the user experience.
[0027] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0028] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0029] Figure 1 This is a schematic diagram illustrating an information processing method according to an exemplary embodiment;
[0030] Figure 2 This is a schematic diagram illustrating the determination of mirror information according to an exemplary embodiment;
[0031] Figure 3This is a schematic diagram illustrating a method for determining a background interface according to an exemplary embodiment;
[0032] Figure 4 This is a schematic diagram illustrating the determination of a fuzzy object according to an exemplary embodiment;
[0033] Figure 5 This is a schematic diagram illustrating the determination of a fuzzy object according to an exemplary embodiment;
[0034] Figure 6 This is a schematic diagram illustrating an example of obtaining a background interface according to an exemplary embodiment;
[0035] Figure 7 This is a schematic diagram illustrating an example of obtaining a background interface according to an exemplary embodiment;
[0036] Figure 8 This is a schematic diagram illustrating the determination of a target service request according to an exemplary embodiment;
[0037] Figure 9 This is a schematic diagram illustrating the effect of display in a first device according to an exemplary embodiment;
[0038] Figure 10 This is a schematic diagram illustrating the effect of display on a second device according to an exemplary embodiment;
[0039] Figure 11 This is another schematic diagram illustrating information processing according to an exemplary embodiment;
[0040] Figure 12 This is a schematic diagram illustrating an information processing apparatus according to an exemplary embodiment;
[0041] Figure 13 This is a schematic diagram illustrating another information processing method according to an exemplary embodiment;
[0042] Figure 14 This is a block diagram illustrating a terminal device according to an exemplary embodiment. Detailed Implementation
[0043] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses consistent with some aspects of this disclosure as detailed in the appended claims.
[0044] refer to Figure 1This is a schematic diagram of an information processing method, which can be applied to a first device. The method includes:
[0045] S100, determine the target service request; wherein, the target service request is used to display the first display interface.
[0046] S200, determine the second display interface; wherein, the second display interface is the interface corresponding to the first display interface in the mirror information.
[0047] S300, determine the background interface of the second display interface based on the mirror information; wherein, at least a portion of the background interface has a blurring effect; the background interface is used to blur the background of the second display interface when the second display interface is displayed.
[0048] S400 performs a target operation based on the background interface; wherein, the target operation is used to display a second display interface based on the background interface.
[0049] The solution in this embodiment can be applied to a first device, and the executing entity can be a first device with mirroring capabilities. The first device can include mobile terminal devices and fixed terminal devices, etc. Mobile terminal devices can include mobile phones, tablets, in-vehicle devices, wearable devices, smart devices, and aircraft, etc. Smart devices can include smart office equipment, smart home equipment, and robots, etc.
[0050] The target service request can be any kind of request used to display the first display interface. The target service request can be determined based on the user's operation. Different user operations may correspond to different target service requests, and the displayed first display interface will also be different.
[0051] For example, the target business request and the first display interface can have a one-to-one relationship or a many-to-one relationship.
[0052] For example, there can be a one-to-one relationship between user actions and target business requests.
[0053] For example, if the target service request is a request to drop down the control center, after identifying this target service request, the control center interface can be displayed accordingly. The content displayed in the control center interface is clear, while the background of the control center interface is blurred.
[0054] For example, if the target business request is to display a desktop application folder, this request can display the corresponding application folder on the desktop, which contains multiple applications. The icons of the applications within the folder are clear, the content displayed in the folder's display window is clear, and the area outside the folder's display window on the screen is blurry.
[0055] In summary, before mirroring, i.e. in the original display information, the first display interface is an interface with a blurred background. After displaying the first display interface, the background of the first display interface has a blurred effect.
[0056] During mirroring, mirror information is obtained, and both mirror information and original display information exist simultaneously. Mirror information is derived from the original display information, which may include the display content of the first device before mirroring.
[0057] After determining the target service request, a first display interface corresponding to the target service request can be determined based on the service request. For example, after determining the first display interface based on the target service request, the first display interface can be displayed.
[0058] For example, the first display interface has the highest display priority, and the layer containing the first display interface can be located at the highest layer. This way, the first display interface can be displayed after the target business request is determined, so as to achieve a timely response to the target business request.
[0059] After determining the target service request, a first display interface can be determined. This first display interface can exist simultaneously in both the original display information and the mirrored information. The mirrored information includes information about the first display interface, and the original display information also includes information about the first display interface. The first display interface can be displayed based on both the original and mirrored information.
[0060] Since the mirror information is a mirror of the original display information, after determining the target service request, the second display interface corresponding to the first display interface in the mirror information can be determined. The content displayed on the second display interface is the same as that displayed on the first display interface. The second display interface is used to represent the first display interface in the mirror information; that is, the first display interface in the mirror information is recorded as the second display interface.
[0061] This allows us to identify the interface corresponding to the first display interface in the image information, facilitating subsequent steps in determining the background interface of the second display interface in the image information.
[0062] After determining the second display interface, the background interface of the second display interface can be determined. At least a portion of the determined background interface has a blurred effect, thus blurring the background of the second display interface when it is displayed.
[0063] For example, the first device has a background blur mode, in which the background of the first display interface is blurred when the first display interface is displayed. During mirroring, the background of the second display interface in the mirrored data is blurred, and the background of the display interface corresponding to the first display interface in the original display data is also blurred.
[0064] For example, the first device has a background blur mode switch, which can be used to adjust the first device to background blur mode.
[0065] For example, the background interface can have a blurred effect over the entire area, or it can have a blurred effect over only a partial area. This can be determined based on business requirements.
[0066] Methods for determining the background interface can include:
[0067] The background interface is determined based on the layers below the layer containing the second display interface in the mirror information.
[0068] For example, the layers below the layer containing the second display interface in the mirror information can be overlaid, and the overlaid image can be used as the first image. The first image can be blurred to obtain the second image, which can then be used as the background interface.
[0069] Other ways to determine the background interface include:
[0070] The background interface is determined based on the layer adjacent to the layer containing the second display interface in the mirrored information. The image displayed on the layer adjacent to the layer containing the second display interface in the mirrored information can be used as the first image. This first image is then blurred to obtain the second image, which is then used as the background interface.
[0071] For example, the layers below the layer where the second display interface is located in the mirror information may include: the layers containing the various information displayed on the monitor when the target business request is determined.
[0072] After determining the target service request and displaying the first display interface according to the target service request, the layer containing the first display interface is located at the top level. Therefore, among the various layers contained in the mirror information, the layer containing the second display interface is also located at the top level, and the other layers contained in the mirror information are located below the layer containing the second display interface, which can be used to determine the background interface.
[0073] For example, after the target service request is determined, and before the first display interface is shown, the layers containing the various pieces of information displayed on the monitor remain unchanged, such as not being added or removed. Therefore, apart from the layer containing the second display interface, the other layers in the mirrored information also remain unchanged. This facilitates the determination of the target interface based on the current target service request, ensuring that the background interface matches the second display interface.
[0074] After determining the background interface, a target operation is performed based on the background interface. This target operation is used to display a second display interface based on the background interface. Displaying the second display interface based on the background interface can include: displaying the second display interface on a first device based on the background interface, and displaying the second display interface on a second device based on the background interface. Of course, other cases of displaying the second display interface based on the background interface may also be included.
[0075] The target operation may include any operation for displaying a second display interface based on the background interface, including but not limited to:
[0076] The second display interface is displayed on the first device based on the background interface;
[0077] The mirror information containing the background interface is sent to the second device, so that the second device can display the second display interface based on the background interface.
[0078] The scenario in which a second display interface is displayed on a first device based on a background interface can include: displaying the interface in a magnified manner through a magnified window.
[0079] Sending mirrored information, including the background interface, to the second device can be used in screen mirroring scenarios. This mirrors the information displayed on the first device to the second device, with the mirrored information being the information intended for display on the second device. This allows for a background blur effect on the second display interface in screen mirroring scenarios.
[0080] In the above embodiments, when displaying a first display interface and performing a mirrored display according to a target service request, the background interface of the second display interface corresponding to the first display interface in the mirrored information is determined, and a target operation for displaying the second display interface based on the background interface is performed. Since at least a portion of the determined background of the second display interface has a blurred effect, and this is used to blur the background of the second display interface when it is displayed, the background of the second display interface will have a blurred effect when the second display interface is mirrored, thus highlighting the second display interface and improving the display effect and user experience. Furthermore, since it is a mirrored display, when the background of the interface corresponding to the first display interface in the original display information has a blurred effect, the background interface of the second display interface in the mirrored information can also have a blurred effect, thus making the original information and mirrored information display the same, reducing the possibility of the mirrored effect differing from the original information display, improving the mirroring effect, and thus enhancing the user experience.
[0081] In addition, since the background interface is generated separately for the second display interface in the mirror information, the process of simultaneously determining the background interface for the interface corresponding to the first display interface in both the original display information and the mirror information, thus blurring the background, is reduced. This reduces flickering, improves the display effect, and enhances the user experience.
[0082] In one embodiment, S200, determining the second display interface includes:
[0083] Determine the image information, and then determine the second display interface from the image information.
[0084] When determining the second display interface, the mirror information can be determined first, and then the second display interface can be determined from the mirror information.
[0085] Methods for determining image information may include:
[0086] Based on the identifiers of the mirror information and the original display information, determine the mirror information from the mirror information and the original display information;
[0087] The mirror information is determined based on the relationship between the mirror information and the original display information.
[0088] refer to Figure 2 This is a schematic diagram of a method for determining mirror information, which includes:
[0089] S201, obtain each first layer and each second layer for display; wherein, the first layer and the second layer have an interlayer relationship representing the original layer and the mirrored layer.
[0090] S202, Based on the interlayer relationship, determine the mirror layer from the first layer and the second layer.
[0091] When determining mirroring information, it can be derived from all information used for display. This display information can include various display layers; during mirroring, the same layer may exist twice. The first and second layers used for display can be obtained, and a layer relationship indicating the original and mirrored layers can be established between them. This relationship indicates which layer is the original layer and which is the mirrored layer.
[0092] After obtaining the interlayer relationship, the mirror layer can be determined based on the interlayer relationship, and the mirror information can be determined after each mirror layer is determined.
[0093] For example, inter-layer relationships may include:
[0094] Father-son relationship;
[0095] Mirror relationship.
[0096] The parent-child relationship can indicate which of two identical layers is the parent layer and which is the child layer. The child layer can be used as a mirror layer, thus determining the mirror layer.
[0097] A mirror relationship indicates that one of two identical layers is the mirror image of the other, and the mirror image layer can also be determined based on this mirror relationship.
[0098] In one embodiment, determining the second display interface from the mirror information includes:
[0099] The interface corresponding to the highest-level layer in the mirror information is used as the second display interface; the mirror information includes multiple layers.
[0100] After determining the mirror information, it can include multiple display layers. These layers are stacked and have relative positions, which determine the top-level layer. When displaying the second display interface based on a target business request, since this request is the most recent, the second display interface will be displayed in response. To ensure the second display interface displays correctly and is not obscured by other layers, the layer containing the second display interface is placed at the top. In other words, the interface corresponding to the highest-level display layer in the mirror information is used as the second display interface.
[0101] The display level is positively correlated with the layer's position; the higher the display level, the higher the layer's position, and vice versa.
[0102] In one embodiment, reference Figure 3 This is a schematic diagram of determining a background interface. In step S300, determining the background interface of the second display interface includes:
[0103] S301, determine the blurred object based on the second display interface.
[0104] S302, blur the blurred object to obtain the background interface.
[0105] After determining the second display interface, the blurred object can be determined based on the second display interface. The method for determining the blurred object is not limited; it can be determined based on the layers below the layer containing the second display interface. The blurred object can be information displayed in at least one layer below the layer containing the second display interface. After determining the blurred object, it can be blurred to obtain the background interface.
[0106] For example, if the first display interface is not displayed and the mirror information does not contain a second display interface, then the blurred object is determined based on the layer where each piece of information currently displayed is located.
[0107] Blur processing can include: the location of the blur processing and / or the blur radius.
[0108] refer to Figure 4 This is a schematic diagram for determining a blurred object. S301, determining the blurred object based on the second display interface includes:
[0109] S3011, Determine the third display interface; wherein, the third display interface is: when the second display interface is displayed, the interface corresponding to each layer below the layer where the second display interface is located in the mirror information.
[0110] S3012, Identify the blurred object from the third display interface.
[0111] After determining the second display interface, a third display interface can be determined based on the second display interface. The third display interface is the interface corresponding to each layer below the layer where the second display interface is located in the mirror information when the second display interface is displayed. There can be one or more third display interfaces.
[0112] Once the third display interface is selected, the blurred object can be identified from the third display interface.
[0113] In one embodiment, reference Figure 5 S3012, a schematic diagram for determining a blurred object, includes determining the blurred object from the third display boundary, comprising:
[0114] S10, obtain the occlusion relationship of the content displayed in each third display interface.
[0115] S20, determine the blurred object based on the occlusion relationship.
[0116] When there are multiple third display interfaces, their display priority can be determined based on their relative positions. The higher the position of the layer, the higher the display priority of the third display interface; the lower the position of the layer, the lower the display priority of the third display interface.
[0117] Information displayed on a higher-priority third-level display interface may obscure information displayed on a lower-priority third-level display interface. The obscuring relationship between the content displayed on each third-level display interface can be determined based on their respective display priorities.
[0118] For example, the occlusion relationship can also be determined based on the position of the content displayed in each third display interface within its respective display interface, as well as the display priority of each third display interface.
[0119] If there is an overlapping area in the content displayed in two third display interfaces, the content of the third display interface with higher display priority will obscure the content of the third display interface with lower display priority.
[0120] This allows us to determine the occlusion relationships of the content displayed in each third display interface.
[0121] After obtaining the occlusion relationship, the blurred object can be determined based on this relationship. The occlusion relationship allows us to identify the unoccluded content in each third display interface. Since the unoccluded content can be displayed, the blurred object can be determined from the unoccluded content in each third display interface.
[0122] For example, a blurred object may include:
[0123] At least one piece of content in a third display interface that is not obscured;
[0124] or,
[0125] At least a portion of the content that is not obscured in each third display interface.
[0126] In one embodiment, S3012, determining the blurred object from the third display interface includes:
[0127] The blurred object is determined based on the preset information and the third display interface.
[0128] The preset information includes the relationship between the third display interface and the blurred object.
[0129] After determining the third display interface, the fuzzy object can be determined from the third display interface based on the preset information. If the display interface contained in the preset information is the same as the third display interface, the fuzzy object can be determined based on the preset information.
[0130] The relationships in the preset information can be one-to-one, many-to-one, or many-to-many.
[0131] For example, the preset information may also be related to the first display interface, and thus also to the second display interface.
[0132] For example, the preset information may also be related to the display content of the third display interface and the display content of the second display interface.
[0133] In one embodiment, reference Figure 6 S302, a schematic diagram for obtaining a background interface, involves blurring the blurred object to obtain the background interface, including:
[0134] S3021, blur the blurred object to obtain the fourth display interface.
[0135] S3022, Based on the fourth display interface and the interfaces other than the second display interface in the mirror information, a fifth display interface is formed by superimposing them.
[0136] S3023, determine the background interface based on the fifth display interface.
[0137] After identifying the object to be blurred, it can be blurred, with the blur radius determined according to display requirements. After blurring, the interface containing the blurred object becomes the fourth display interface. This fourth display interface is then superimposed with the interfaces in the mirrored information (excluding the second display interface) to form the fifth display interface. The interfaces in the mirrored information (excluding the second display interface) become the third display interface, in addition to the fourth display interface.
[0138] Since the blurred object has already been blurred, the fifth display interface includes the blurred target object, so the fifth display interface also includes the blurred area, and can be used as the background interface.
[0139] In one embodiment, blurring the blurred object to obtain the background interface may further include:
[0140] The layers containing the blurred object are overlaid to obtain the sixth display interface, which includes the blurred object. Then, the blurred object in the sixth display interface is blurred to obtain the seventh display interface, which is used as the background interface.
[0141] In one embodiment, reference Figure 7 This is a schematic diagram of obtaining a background interface. In step S300, the background interface of the second display interface is determined, including:
[0142] S303, detect whether the displayed content in the third display interface has changed.
[0143] S304, when a change is detected in the content displayed on the third display interface, the background interface is redefined based on the changed third display interface.
[0144] S305, if the content displayed on the third display interface has not changed, the background interface will not be redefined.
[0145] Detection can be performed according to a preset detection cycle, or at preset intervals of a number of image frames.
[0146] The content displayed in the third display interface can be static or dynamic. When static, the content displayed in the third display interface remains unchanged. When dynamic, the content displayed in the third display interface will change.
[0147] After the third display interface changes, the background interface is redefined. Otherwise, it is not necessary to redefine the background interface. This embodiment can reduce the number of times the background interface is determined, thereby reducing power consumption.
[0148] For example, if the content in the third display interface changes, the background interface can be redefined according to a preset cycle, thereby reducing the problem of excessive power consumption caused by frequent background interface updates.
[0149] In one embodiment, determining the background interface of the second display interface in step S300 may include:
[0150] The images in the mirror information and the layers in the original display information are deduplicated, and the background interface is determined based on the interface corresponding to the deduplicated layer.
[0151] Since the layers are the same in the mirror information and the original display information of the mirror information, the same layers can be deduplicated. After deduplication, the layers in the mirror information or the layers in the original display information are left. This can reduce the situation where a background interface is generated for the second display interface in the mirror information and the corresponding interface of the first display interface in the original display information at the same time.
[0152] Since the background interface is generated separately for the second display interface in the mirror information, or separately for the interface corresponding to the first display interface in the original display information, the process of simultaneously determining the background interface for the interface corresponding to the first display interface in both the original display information and the mirror information, thus blurring the background, is reduced. This reduces flickering, improves the display effect, and enhances the user experience.
[0153] If a background interface is generated separately for the interface corresponding to the first display interface in the original display information, then that background interface can be used as the background interface for the second display interface, thus saving the process of generating the background interface again.
[0154] In one embodiment, reference Figure 8 This is a schematic diagram for determining a target service request. S100, determining the target service request includes:
[0155] S101, detect a target input operation applied to the display screen of the first device or the display screen of the second device; wherein the target input operation is used to display the first display interface.
[0156] S102, determine the target service request based on the target input operation.
[0157] When determining the target service request, it can be done through a first device or a second device.
[0158] If the target input operation is an operation performed on the display screen of the first device, then the first device can detect the target input operation and then determine the target service request based on the target input operation.
[0159] The target input operation can also be an input operation performed on the display screen of a second device. In this case, the second device can detect the target input and then send the target input operation to the first device. The first device determines the target service request based on the target input operation.
[0160] The target input operation is associated with the target business request, for example, in a one-to-one relationship. Once the target input operation is determined, the corresponding target business request can be determined.
[0161] For example, the target input operation can also be an operation input from other input devices, not limited to the display screen. The display screen can be a touch display screen.
[0162] In one embodiment, the mirror information is used to magnify and display the information displayed on the first device through a magnifying window.
[0163] S400 performs target operations based on the background interface, including:
[0164] The second display interface is displayed on the first device based on the background interface.
[0165] This embodiment illustrates a display method in which a second display interface and a background interface are displayed in a first device, such that the second display interface has a blurred effect.
[0166] For example, when displaying the second display interface, a second display interface with a background interface is displayed via a magnified window. The magnified window can be displayed through a component or application with magnification functionality. (See reference) Figure 9 This is a schematic diagram of the effect displayed on the first device. After the zoom function is turned on, accessibility mode can be entered. Figure 9 The area with a blurred effect is the background interface when the second display interface is displayed, and the area displayed by the magnified display window is a magnified window of the second display interface with the blurred background interface.
[0167] In one embodiment, the mirror information is used to mirror the information displayed in the first device in the second device.
[0168] S400 performs target operations based on the background interface, including:
[0169] The image information, including the background interface, is sent to the second device; wherein, the background interface is used by the second device to display the second display interface based on the background interface.
[0170] This embodiment illustrates another display method: when mirroring the screen, the content displayed on the first device is mirrored on the second device. This allows the second display interface to be displayed on the second device, while also giving the second display interface a blurred background effect.
[0171] The second device can include devices different from the first device, such as in-vehicle devices, tablets, and televisions. (Reference) Figure 10 This is a schematic diagram illustrating the effect of displaying the image on a second device. Figure 10 The first device shown is a mobile phone, and the second device is an in-vehicle device, which may include an in-vehicle central control device with a display screen. Figure 10 The area with a blurred effect is the background interface when the second display interface is shown.
[0172] In one embodiment, the mirror information is used to magnify and display the information displayed on the first device through a magnified window.
[0173] refer to Figure 11 This is a schematic diagram of another method, which also includes:
[0174] S1, determine the original interface corresponding to the first display interface in the original information of the mirror information.
[0175] S2, determine the background interface of the original interface.
[0176] S3 blurs the background of the original interface, resulting in a background with a blurred effect.
[0177] S4 displays the original interface based on the background interface with a blurred effect.
[0178] The method for determining the original interface and the method for determining the second display interface are based on the same principle; the principle for determining the background interface of the original interface is the same as the principle for determining the background interface of the second display interface. The method for blurring the background interface of the original interface can refer to the blurring method used when obtaining the background interface of the second display interface in the above embodiments.
[0179] This example illustrates the process of determining the background interface for the interface corresponding to the first display interface in the original display information. In non-mirror projection, the background interface is generated separately for the interface corresponding to the first display interface in the original display information. This reduces the process of simultaneously determining the background interface for the interface corresponding to the first display interface in both the original and mirrored information, thus reducing the flickering, improving the display effect, and enhancing the user experience.
[0180] If a background interface is generated separately for the interface corresponding to the first display interface in the original display information, then that background interface can be used as the background interface for the second display interface, thus saving the process of generating the background interface again.
[0181] In one embodiment, reference Figure 12 This is a schematic diagram of an information processing device, which includes:
[0182] The first determining module 1 is used to determine the target service request; wherein the target service request is used to display the first display interface;
[0183] The second determining module 2 is used to determine the second display interface; wherein the second display interface is the interface corresponding to the first display interface in the image information;
[0184] The third determining module 3 is used to determine the background interface of the second display interface based on the mirror information; wherein at least a portion of the background interface has a blurring effect; the background interface is used to blur the background of the second display interface when the second display interface is displayed.
[0185] Processing module 4 is used to perform a target operation based on the background interface; wherein the target operation is used to display the second display interface based on the background interface.
[0186] In one embodiment, the second determining module 2 is configured to: determine the image information and determine the second display interface from the image information.
[0187] In one embodiment, the second determining module 2 includes:
[0188] The acquisition submodule is used to acquire each first layer and each second layer for display; wherein, there is an interlayer relationship between the first layer and the second layer representing the original layer and the mirrored layer;
[0189] The first determining submodule is used to determine the mirror layer from the first layer and the second layer based on the interlayer relationship.
[0190] In one embodiment, the second determining module 2 is further configured to:
[0191] The interface corresponding to the highest-level layer in the mirror information is used as the second display interface; wherein, the mirror information includes multiple layers.
[0192] In one embodiment, the third determining module 3 includes:
[0193] The second determination submodule is used to determine the fuzzy object based on the second display interface;
[0194] The blurring submodule performs blurring on the blurred object to obtain the background interface.
[0195] In one embodiment, the second determining submodule includes:
[0196] The first determining unit is used to determine the third display interface; wherein, the third display interface is: when the second display interface is displayed, the interface corresponding to each layer below the layer where the second display interface is located in the mirror information;
[0197] The first determining unit is used to determine the fuzzy object from the third display interface.
[0198] In one embodiment, the first determining unit includes:
[0199] The acquisition subunit is used to acquire the occlusion relationship of the content displayed in each of the third display interfaces;
[0200] A sub-unit is defined for determining the blurred object based on the occlusion relationship.
[0201] In one embodiment, the first determining unit is further configured to:
[0202] The fuzzy object is determined based on preset information and the third display interface; wherein, the preset information includes the association between the third display interface and the fuzzy object.
[0203] In one embodiment, the blurring submodule includes:
[0204] A blur processing unit is used to blur the blurry object to obtain a fourth display interface;
[0205] The overlay unit is used to overlay the fourth display interface and the interfaces in the mirror information excluding the second display interface to form a fifth display interface;
[0206] The second determining unit is used to determine the background interface based on the fifth display interface.
[0207] In one embodiment, the third determining module 3 includes:
[0208] The first detection submodule is used to detect whether the displayed content in the third display interface has changed;
[0209] The third determining module 3 is further configured to redetermine the background interface based on the changed third display interface when a change in the displayed content of the third display interface is detected; and not to redetermine the background interface when no change in the displayed content of the third display interface is detected.
[0210] In one embodiment, the third determining module 3 includes:
[0211] The deduplication submodule is used to remove duplicate layers from the mirror information and the original information of the mirror information.
[0212] The third determining submodule is used to determine the background interface based on the interface corresponding to the deduplicated layer.
[0213] In one embodiment, the first determining module 1 includes:
[0214] The second detection submodule is used to detect a target input operation applied to the display screen of the first device or the display screen of the second device; wherein the target input operation is used to display the first display interface;
[0215] The fourth determination submodule is used to determine the target service request based on the input operation.
[0216] In one embodiment, the mirror information is used to magnify and display the information displayed on the first device through a magnifying window in the first device;
[0217] Processing module 4 is used to display the second display interface on the first device according to the background interface.
[0218] In one embodiment, the mirroring information is used to mirror the information displayed in the first device in the second device;
[0219] Processing module 4 is used to send the image information containing the background interface to the second device; wherein the background interface is used by the second device to display the second display interface according to the background interface.
[0220] In one embodiment, the mirror information is used to magnify and display the information displayed on the first device through a magnifying window in the first device;
[0221] The second determining module 2 is further configured to determine the original interface corresponding to the first display interface in the original information of the image information;
[0222] The third determining module 3 is also used to determine the background interface of the original interface;
[0223] The device further includes: a blur module, used to blur the background interface of the original interface to obtain a background interface with a blurred effect on the original interface;
[0224] Processing module 4 is used to display the original interface based on the background interface with a blurred effect.
[0225] In one embodiment, reference Figure 13 This is a schematic diagram of another information processing method.
[0226] Vehicle-to-everything (V2X) connectivity is becoming increasingly important. When a phone connects to an in-vehicle device, for example, when a user taps the "Merge Device Center" on their phone, the center will display in-vehicle devices for the user to choose from. Once the connection is successful, the in-vehicle device will display a mirrored version of the phone screen, at which point the phone screen will be off. To conserve power, the phone will not composite layers. However, when background blur is needed, such as when the advanced texture setting is enabled on the phone, the system control center and desktop folders will not have a frosted glass blur effect.
[0227] To solve this problem, the layer to be blurred needs to be expanded to its mirror layer. However, expanding everything to the mirror layer also has problems. In non-screen mirroring scenarios, if the user enables the zoom function in Accessibility View, the window will mirror the layers on the phone. If the user enables Advanced Material, both the original layer and the mirror layer will be blurred simultaneously, causing the screen to flicker.
[0228] Therefore, it is particularly important to optimize the advanced material blur function, taking into account both screen projection and mirroring scenarios.
[0229] This embodiment provides an information processing method, including the following process:
[0230] 1. When determining the target business request, for example, when a user turns on the advanced material switch, the application side requests to display the first display interface with a background blur effect based on the business scenario (such as pulling down the control center / desktop folder), such as the advanced material blur function.
[0231] 2. Obtain the View Root Impl through the View view, which is the root of all Views. Use View RootImpl to pass application-side UI information (Surface) to the native layer.
[0232] 3. First, the data is updated in the Layer State controller. The Layer State encapsulates the application layer's requests and updates the application's Layer based on different requests.
[0233] 4. Within the layer, create encapsulation region (such as Pass Blur) objects to further store data requested from the upper layer.
[0234] 5. During the compositing process, based on different inter-layer relationships, which can be in the form of Path (as shown in the diagram, such as the child layer of a parent layer, mirrored layers, etc.), a compositing state of the encapsulated layer (Layer FE) is created. According to different Paths, the Pass Blur object encapsulated in the Layer is passed to the Layer FE, thereby ensuring that the mirrored layer can achieve the blur function when projected.
[0235] 6. LayerFE is further encapsulated into the background interface, such as in the Output Layer. During Output compositing and display, the layer requesting blur is identified based on the LayerFE in the Output Layer. Its underlying layers are then drawn layer by layer. Before drawing, layers with the same Path ID are removed, thus resolving the blur flickering issue when the original layer and its mirror image are in the same Output (in accessibility features, because the zoomed-in window is scaled, the underlying composite layer data returned to the application by the original layer and the mirror image layer of the zoomed-in window are different. In the current scenario, only the original layer is allowed to request blur functionality; the mirror image layer is cloned from the original layer and does not need to be blurred). Finally, the drawn underlying layer data is returned to the application, which then begins the blur rendering process.
[0236] 7. To reduce the number of data returns, in step 6, when the Output is composited and sent to the display, it is necessary to determine whether the Output has already made a blur request for the same frame. If it has, no more data returns or blur rendering will be performed. This avoids the in-vehicle device's virtual screen Output and the phone's physical screen Output simultaneously returning data to the application side when the phone screen is projected and not turned off, thereby reducing power consumption.
[0237] This embodiment extends advanced material blur to in-vehicle projection screen off-screen scenarios, optimizes blur functionality under accessibility features, and reduces power consumption while ensuring the effect, thereby improving the user experience.
[0238] It should be noted that the terms "first" and "second" in the embodiments of this disclosure are for ease of description and distinction only, and have no other specific meaning.
[0239] Figure 14 This is a block diagram illustrating a terminal device according to an exemplary embodiment. For example, the terminal device may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.
[0240] Reference Figure 14 The terminal device may include one or more of the following components: processing component 902, memory 904, power component 906, multimedia component 908, audio component 910, input / output (I / O) interface 912, sensor component 914, and communication component 916.
[0241] Processing component 902 typically controls the overall operation of the terminal device, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 902 may include one or more modules to facilitate interaction between processing component 902 and other components. For example, processing component 902 may include a multimedia module to facilitate interaction between multimedia component 908 and processing component 902.
[0242] Memory 904 is configured to store various types of data to support operation on the terminal device. Examples of this data include instructions for any application or method operating on the terminal device, contact data, phonebook data, messages, pictures, videos, etc. Memory 904 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0243] Power component 906 provides power to various components of the terminal device. Power component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the terminal device.
[0244] Multimedia component 908 includes a screen that provides an output interface between a terminal device and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a Touch Panel, the screen can be implemented as a touchscreen to receive input signals from the user. The Touch Panel includes one or more touch sensors to sense touches, swipes, and gestures on the Touch Panel. The touch sensors can sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 908 includes a front-facing camera and / or a rear-facing camera. When the terminal device is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera can receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
[0245] Audio component 910 is configured to output and / or input audio signals. For example, audio component 910 includes a microphone (MIC) configured to receive external audio signals when the terminal device is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 904 or transmitted via communication component 916. In some embodiments, audio component 910 also includes a speaker for outputting audio signals.
[0246] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0247] Sensor assembly 914 includes one or more sensors for providing status assessments of various aspects of the terminal device. For example, sensor assembly 914 can detect the on / off state of the terminal device, the relative positioning of components such as the display and keypad of the terminal device, changes in the position of the terminal device or a component of the terminal device, the presence or absence of user contact with the terminal device, the orientation or acceleration / deceleration of the terminal device, and temperature changes of the terminal device. Sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 914 may also include an optical sensor, such as a Complementary Metal Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD) image sensor, for use in imaging applications. In some embodiments, sensor assembly 914 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.
[0248] Communication component 916 is configured to facilitate wired or wireless communication between the terminal device and other devices. The terminal device can access wireless networks based on communication standards, such as Wi-Fi, 4G, or 5G, or combinations thereof. In one exemplary embodiment, communication component 916 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 916 also includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), Bluetooth (BT), and other technologies.
[0249] In an exemplary embodiment, the terminal device may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.
[0250] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including executable instructions or a computer program, which can be executed by the processor 920 of the device 900 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.
[0251] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of a mobile terminal, enables the mobile terminal to perform any of the information processing methods described in the embodiments of this disclosure.
[0252] This disclosure provides a computer program product comprising a computer program or executable instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program or executable instructions from the computer-readable storage medium and executes the computer program or executable instructions, causing the computer device to perform any of the information processing methods described in this disclosure.
[0253] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.
[0254] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. An information processing method, characterized in that, Applied to a first device, the method includes: Determine the target service request; wherein, the target service request is used to display the first display interface; Determine the second display interface; wherein the second display interface is the interface corresponding to the first display interface in the mirror information; The background interface of the second display interface is determined based on the mirror information; wherein at least a portion of the background interface has a blurring effect; the background interface is used to blur the background of the second display interface when the second display interface is displayed. Perform a target operation based on the background interface; wherein, the target operation is used to display the second display interface based on the background interface.
2. The method according to claim 1, characterized in that, Determining the second display interface includes: Determine the image information; The second display interface is determined from the image information.
3. The method according to claim 2, characterized in that, Determining the image information includes: Obtain each first layer and each second layer for display; wherein, the first layer and the second layer have an interlayer relationship representing the original layer and the mirrored layer; Based on the interlayer relationship, a mirror layer is determined from the first layer and the second layer.
4. The method according to claim 2, characterized in that, Determining the second display interface from the mirror information includes: The interface corresponding to the highest-level layer in the mirror information is used as the second display interface; wherein, the mirror information includes multiple layers.
5. The method according to claim 1, characterized in that, Determining the background interface of the second display interface includes: The blurred object is determined based on the second display interface; The blurred object is blurred to obtain the background interface.
6. The method according to claim 5, characterized in that, The step of determining the blurred object based on the second display interface includes: A third display interface is determined; wherein, the third display interface is: when the second display interface is displayed, the interface corresponding to each layer below the layer where the second display interface is located in the mirror information; The blurred object is determined from the third display interface.
7. The method according to claim 6, characterized in that, Determining the blurred object from the third display boundary includes: Obtain the occlusion relationship of the content displayed in each of the third display interfaces; The blurred object is determined based on the occlusion relationship.
8. The method according to claim 6, characterized in that, Determining the blurred object from the third display interface includes: The fuzzy object is determined based on preset information and the third display interface; wherein, the preset information includes the association between the third display interface and the fuzzy object.
9. The method according to claim 5, characterized in that, The process of blurring the blurred object to obtain the background interface includes: The blurred object is blurred to obtain the fourth display interface; The fifth display interface is formed by superimposing the fourth display interface and the interfaces in the mirror information excluding the second display interface; The background interface is determined based on the fifth display interface.
10. The method according to claim 6, characterized in that, Determining the background interface of the second display interface includes: Detect whether the displayed content in the third display interface has changed; When a change is detected in the displayed content of the third display interface, the background interface is redefined based on the changed third display interface. If the content displayed in the third display interface remains unchanged, the background interface will not be redefined.
11. The method according to any one of claims 1 to 10, characterized in that, Determining the background interface of the second display interface includes: The layers in the mirror information and the original information of the mirror information are deduplicated; The background interface is determined based on the interface corresponding to the deduplicated layer.
12. The method according to claim 1, characterized in that, The determination of the target service request includes: Detect a target input operation performed on the display screen of the first device or the display screen of the second device; wherein the target input operation is used to display the first display interface; The target service request is determined based on the target input operation.
13. The method according to claim 1, characterized in that, The mirror information is used to magnify and display the information displayed on the first device through a magnifying window in the first device; The step of performing the target operation based on the background interface includes: The second display interface is displayed on the first device according to the background interface.
14. The method according to claim 1, characterized in that, The mirroring information is used to mirror the information displayed in the first device in the second device; The step of performing the target operation based on the background interface includes: The image information containing the background interface is sent to the second device; wherein the background interface is used by the second device to display the second display interface according to the background interface.
15. The method according to claim 1, characterized in that, The mirror information is used to magnify and display the information displayed on the first device through a magnifying window in the first device; The method further includes: Determine the original interface corresponding to the first display interface in the original information of the mirror information; Determine the background interface of the original interface; The background interface of the original interface is blurred to obtain a background interface with a blurred effect. The original interface is displayed based on the background interface with a blurred effect.
16. An information processing device, characterized in that, include: The first determining module is used to determine the target service request; wherein the target service request is used to display the first display interface; The second determining module is used to determine the second display interface; wherein the second display interface is the interface corresponding to the first display interface in the image information; The third determining module is used to determine the background interface of the second display interface based on the mirror information; wherein at least a portion of the background interface has a blurring effect; the background interface is used to blur the background of the second display interface when the second display interface is displayed. The processing module is used to perform a target operation based on the background interface; wherein the target operation is used to display the second display interface based on the background interface.
17. A terminal device, characterized in that, include: A processor and a memory for storing computer programs or executable instructions capable of running on the processor, wherein: When the processor is used to run the computer program or the executable instructions, the executable instructions perform the method described in any one of claims 1 to 15.
18. A non-transitory computer-readable storage medium, characterized in that, The non-transitory computer-readable storage medium stores a computer program or computer-executable instructions, which, when executed by a processor, implement the method described in any one of claims 1 to 15.
19. A computer program product, comprising a computer program or executable instructions, characterized in that, When the computer program or executable instructions are executed by a processor, they implement the method of any one of claims 1 to 15.