Information transmission method, device and storage medium

Abstract

Provided in the present application are an information transmission method, a device and a storage medium. In the method, after a user performs a circle-selection operation, displaying on a user interface an icon of an application and / or service matching content selected by a circle-selection trajectory corresponding to the circle-selection operation; after the user adjusts the selected content, re-recommending an application and / or service on the basis of the adjusted content, such that the recommended application and / or service can be better adapted to actual use requirements of the user; in addition, invoking the any-door service by means of the circle-selection operation enables the transmission of content in a selected area, rather than the transmission of an entire picture corresponding to a first interface.

Description

Information transmission method and device, and storage medium

[0001] The present application claims priority to a Chinese patent application No. 202411244812.0, filed on September 5, 2024, and titled “Information transmission method and device, and storage medium”, and to a Chinese patent application No. 202411332538.2, filed on September 20, 2024, and titled “Data transmission method and related device”, the contents of which are incorporated herein by reference in their entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminal, and in particular to an information transmission method, device and storage medium. BACKGROUND

[0003] With the continuous development of electronic information technology, smart devices such as mobile phones and tablets have become indispensable products in our daily life, work and entertainment. In some use scenarios, users will use electronic devices to transmit information across applications, such as transferring information in a first application to a second application, and sharing or uploading the information by the second application.

[0004] However, at present, when users transmit information such as pictures between different applications, they can only transmit the entire picture. If the user wants to transmit the content of a local area in the picture, the user needs to edit the picture, save the content of the local area to be transmitted as a picture, and then transmit the edited picture to realize the transmission of the content of the local area in the original picture. That is, the user cannot quickly transmit the content of the local area in the picture. SUMMARY

[0005] To solve the above technical problems, the embodiments of the present application provide an information transmission method, device and storage medium, which aims to enable electronic devices to efficiently and quickly complete information transmission between applications, effectively reduce the operation steps required by users to complete information transmission across applications, improve the interaction efficiency between users and electronic devices, and thus improve the user experience.

[0006] In a first aspect, an embodiment of the present application provides an information transmission method. The method comprises: receiving a first operation acting on a first interface, the first operation being a circle selection operation; at a first time, in response to the first operation, displaying a second interface, the second interface comprising a circle selection track corresponding to the first operation displayed on the first interface; at a second time, displaying a third interface, the third interface comprising a selection display area and a service recommendation area, the selection display area comprising the first interface and a first selection mark displayed on the first interface, the first selection mark being used to identify a first selection area in the first interface corresponding to the circle selection track, the service recommendation area comprising icons of a first group of applications and / or services determined according to the first selection area; at a third time, receiving a second operation acting on the third interface, the second operation being an operation of adjusting the first selection area; in response to the second operation, displaying a fourth interface, the fourth interface comprising the selection display area and the service recommendation area, the selection display area comprising the first interface and a second selection mark displayed on the first interface, the second selection mark being used to identify a second selection area, the second selection area being a selection area obtained by adjusting the first selection area through the second operation, the service recommendation area comprising icons of a second group of applications and / or services determined according to the second selection area; wherein the second time is later than the first time, and the third time is later than the second time.

[0007] For example, the first interface can be understood as a currently displayed user interface, such as interface 10a, interface 10e, etc.

[0008] For example, the circle selection operation refers to a user operation of circling specific content on the screen.

[0009] For example, the circle selection operation can be a user operation made by a user using a knuckle on the screen.

[0010] For example, the circle selection operation can also be a user operation made by a user using a finger on the screen.

[0011] For example, the circle selection operation can also be a user operation made by a user using an external device, such as a stylus, a mouse, etc. on the screen.

[0012] For example, the second interface can be understood as a user interface displaying a circle selection track.

[0013] For example, when the first interface is interface 10a, the second interface can be interface 10d.

[0014] For example, when the first interface is interface 10e, the second interface can be interface 20e.

[0015] For example, the circle selection track can be a closed loop.

[0016] For example, in the scenario of selecting the first interface in the display area to perform the first operation, i.e., the opening door effect, the third interface can be understood as the interface 50d or the interface 60e. In this case, the first interface displayed in the third interface can be understood as the display element 50d-1 or the display element 60e-1. The first selection mark can be understood as the selection box 50d-3 or the selection box 60e-2. The first selection area can be understood as the area in the selection box 50d-3 or the selection box 60e-2. The service recommendation area displayed in the third interface can be understood as the icon area 50d-2 or the icon area 60e-4. The icons of the first group of applications and / or services are the icons displayed in the icon area 50d-2 or the icon area 60e-4.

[0017] For example, the second operation can be a user operation of adjusting the selection box 50d-3. The user operation can include a down event (clicking the Bar on the selection box 50d-3), a move event (moving the finger on the screen while pressing the Bar on the selection box 50d-3), and an up event (lifting the finger).

[0018] For example, the fourth interface can be understood as the user interface displayed after the second operation is completed, i.e., the user interface 70d. The second selection mark can be understood as the selection box 70d-3. The second selection area can be understood as the area in the selection box 70d-3. The service recommendation area displayed in the fourth interface can be understood as the icon area 70d-2. The icons of the second group of applications and / or services are the icons displayed in the icon area 70d-2.

[0019] Therefore, after the user performs the selection operation, the icons of the applications and / or services that match the content selected by the selection operation are displayed in the user interface. After the user adjusts the selected content, the applications and / or services are re-recommended according to the adjusted content, so that the recommended applications and / or services can better meet the actual use needs of the user. In addition, any door service can be pulled up by the selection operation, and the transmission of the content in the selection area can be realized instead of the transmission of the entire picture corresponding to the first interface.

[0020] According to the first aspect, after the second interface is displayed, the method further includes displaying a third selection mark, the third selection mark being used to identify the first selection area, and the shape of the third selection mark being different from the first selection mark; and displaying a first animation after the third selection mark is displayed, the first animation being an animation of transitioning from the third selection mark to the first selection mark.

[0021] For example, the first animation can be understood as the transition animation in the following embodiments.

[0022] For example, the first dynamic effect is displayed on the third selection mark, and after the first dynamic effect is displayed, the second dynamic effect is displayed on the third selection mark.

[0023] For example, the third selection mark displaying the first dynamic effect can be the circle 20d-1 (or the circle 30e-2, or the circle 20f-2), and the third selection mark displaying the second dynamic effect can be the circle 30d-1 (or the circle 40e-2, or the circle 30f-2).

[0024] For example, the third selection mark displaying the first dynamic effect can be the circle 20d-1 (or the circle 30e-2, or the circle 20f-2), and the third selection mark displaying the second dynamic effect can be the circle 30d-1 (or the circle 40e-2, or the circle 30f-2).

[0025] Therefore, by displaying the third selection mark in the interface during the waiting process of displaying the third interface, and sequentially displaying the first dynamic effect and the second dynamic effect on the third selection mark, the interestingness and the visual effect of the waiting process are increased, and the user experience is further improved.

[0026] For details of the specific implementation of the present aspect, see the description of the embodiments shown in FIG. 6A, FIG. 7A, and FIG. 7B in the following embodiments, which are not described here.

[0027] According to the first aspect, or any one of the implementations of the first aspect, after the first dynamic effect is displayed, the method further includes: displaying a second dynamic effect, the second dynamic effect being a dynamic effect simulating scanning the first selection region.

[0028] For example, the second dynamic effect can be understood as the scanning dynamic effect in the following embodiments.

[0029] For example, the third selection mark displaying the second dynamic effect is, for example, the circle 30d-1 displayed in the interface 40d. Correspondingly, the dynamic effect simulating scanning the first selection region is, for example, the effect of displaying the moving scanning box 30d-2 on the circle 30d-1 displayed in the interface 40d.

[0030] For example, the third selection mark displaying the second dynamic effect is, for example, the circle 100d-2 displayed in the interface 100d. Correspondingly, the dynamic effect simulating scanning the first selection region is, for example, the effect of displaying the moving scanning box 100d-3 on the circle 100d-2 displayed in the interface 100d.

[0031] For example, the third selection mark displays the second dynamic effect, for example, the selection frame 40e-2 displayed in the interface 50e. Accordingly, the dynamic effect of scanning the first selection region is simulated, for example, the effect of displaying the moving scanning frame 50e-1 on the selection frame 40e-2 displayed in the interface 50e.

[0032] For example, the third selection mark displays the second dynamic effect, for example, the selection frame 30f-2 displayed in the interface 30f. Accordingly, the dynamic effect of scanning the first selection region is simulated, for example, the effect of displaying the moving scanning frame 30f-3 on the selection frame 30f-2 displayed in the interface 30f.

[0033] Thus, by simulating the dynamic effect of scanning the first selection region during the process of waiting for displaying the fourth interface, the interestingness and visual effect of the waiting process are increased, and the user experience is further improved.

[0034] According to the first aspect, or any one of the implementation manners of the first aspect, the first selection region indicated by the third selection mark cannot be adjusted.

[0035] Thus, it is set that the first selection region indicated by the third selection mark cannot be adjusted, so that the adjustment of the first selection region by the user during the process of displaying the first dynamic effect and the second dynamic effect is avoided, and it is ensured that the icons of the applications and / or services finally displayed in the service recommendation region match the content of the first selection region.

[0036] According to the first aspect, or any one of the implementation manners of the first aspect, the first interface displayed in the selection display region in the third interface is the first interface after the first processing, the first selection mark is displayed on the first interface after the first processing, the first screenshot is displayed in the first selection mark, and the first screenshot is the screenshot corresponding to the first selection region indicated by the first selection mark; and the first processing includes one or more of the following: zooming, deforming, twisting, and changing transparency.

[0037] For example, the first processing on the first interface is the opening door effect performed on the full-screen screenshot corresponding to the interface 10a, that is, the visual effect of the display element 50d-1 during the process of changing the display interface from the interface 40d to the interface 50d.

[0038] For details of the specific implementation of the present aspect, refer to the description of the embodiments of the interface 40d to the interface 50d, or the interface 50e to the interface 60e in the following embodiments, which are not described herein.

[0039] According to the first aspect, or any one of the implementation manners of the first aspect, the first processing is used to make the first interface displayed in the selection display region in the third interface present a visual effect of being pushed inwards.

[0040] Exemplarily, in the case that the third interface is the interface 50d, the first interface selected by the display of the selection display region in the third interface is, for example, the display element 50d-1. In this case, the first processing performed on the first interface is, for example, scaling, deforming, twisting, changing transparency and the like of the screenshot of the interface 10a, and then the processed screenshot is pushed inwards to the extent of the display element 50d-1 in the interface 50d. The visual effect presented in the process is the visual effect of being pushed inwards.

[0041] According to the first aspect, or any one of the implementations of the above first aspect, in response to the second operation, displaying the fourth interface comprises: in response to a first part of the second operation, displaying the first interface on which the selection display region is displayed after the second processing and hiding the service recommendation region, the first part of the second operation comprises a down event and / or a partial move event in the second operation, the second processing is of the same processing type as the first processing, and the processing degree of the second processing is less than that of the first processing; in response to a second part of the second operation, displaying the first interface on which the selection display region is displayed after the first processing, displaying the second selection mark above the first interface after the first processing, displaying the second screenshot in the second selection mark, the second screenshot being a screenshot corresponding to the second selection region indicated by the second selection mark, and displaying the service recommendation region, the second part of the second operation comprising an up event in the second operation.

[0042] Exemplarily, the second processing performed on the first interface is, for example, the micro-door closing animation performed on the display element 50d-1 as described in the embodiments below, and becomes the display element 60d-1.

[0043] Exemplarily, in the case that the second selection mark is the circle selection box 60d-2, the second selection region can be understood as the region within the circle selection box 60d-2, and the second screenshot is, for example, the content displayed in the circle selection box 60d-2.

[0044] Therefore, in the process of adjusting the first selection mark by the user, the user interface presents the above changes, which not only improves the user's visual experience, but also avoids the accidental touch of the controls other than the first selection mark in the adjustment process, further ensuring the user's use experience.

[0045] For specific implementation details of this aspect, see the description of the embodiments shown in FIGS. 6A and 6D, and FIGS. 8A and 8B in the following embodiments, which are not described here in detail.

[0046] According to the first aspect, or any one of the implementations of the above first aspect, the second processing is configured to cause the first interface selected by the display of the selection display region in the third interface to present a visual effect of being slightly pulled outwards.

[0047] Exemplarily, in the case that the third interface is the interface 50d, the first interface displayed in the selection display area in the third interface is, for example, the display element 50d-1. In this case, the second processing on the first interface is, for example, slightly pulling out the display element 50d-1 in the interface 50d to the extent of the display element 60d-1 in the interface 60d. The visual effect presented in the process of the display element 50d-1 becoming the display element 60d-1 is, for example, the visual effect of slightly pulling out.

[0048] According to the first aspect, or any one of the implementations of the above first aspect, the selection display area further includes an editing control displayed on the first interface; in the case that the editing control is displayed, the method further includes: in response to a third operation performed on the editing control, displaying a fifth interface, the fifth interface including the first picture and a control for editing the first picture, the first picture being the first screenshot corresponding to the first selection area or the second screenshot corresponding to the second selection area; in response to a fourth operation performed on the first picture, displaying a second picture, the second picture being the picture obtained by editing the first picture through the fourth operation; in response to a fifth operation performed on the second picture, displaying a third picture on the second picture at the position where the fifth operation is performed by the user, the third picture having a size smaller than the second picture and including all the content of the second picture; in response to a sixth operation performed on the third picture, displaying a sixth interface, the sixth interface including the selection display area and a service recommendation area, the selection display area including the fifth interface displaying the second picture and the fourth picture displayed on the fifth interface, the fourth picture having a size smaller than the third picture and including all the content of the third picture, and the service recommendation area including icons of the third group of applications and / or services determined according to the fourth picture.

[0049] Exemplarily, in the case that the editing control is displayed on the first interface, the first interface is, for example, the first interface after the first processing. That is, the first interface with the door opening animation. In this case, the editing control displayed on the first interface in the selection display area is, for example, the editing control 50d-5, or the editing control 70d-5, or the editing control 110d-5, or the editing control 60e-6.

[0050] Therefore, by providing the editing control on the first interface of the selection display area, the editing of the content selected in the current interface can be realized. In this way, the content in the selected area does not need to be saved first and then edited in a special picture editing software, reducing the number of human-computer interactions and improving the user experience.

[0051] For specific implementation details of this aspect, refer to the description of the embodiment shown in FIG. 6D in the following embodiments. Here, no further description is given.

[0052] According to the first aspect, or any one of the implementations of the above first aspect, the selection display region further includes a text circle selection control displayed on the first interface; after the fourth interface is displayed, the method further includes: in response to a seventh operation on the text circle selection control, displaying a seventh interface, the seventh interface including a selection display region, the selection display region including the first interface and a fourth selection mark displayed on the first interface, the fourth selection mark being used to identify the second selection region, the fourth selection mark having a shape different from the second selection mark; after the fourth selection mark is displayed, displaying a first dynamic effect, the first dynamic effect being a dynamic effect of a transition from the fourth selection mark to a fifth selection mark; in a case where the second selection region includes a text element and a seventh interface is displayed for a set time, displaying an eighth interface, the eighth interface including a selection display region and a service recommendation region, the selection display region including the first interface and a fifth selection mark displayed on the first interface, the fifth selection mark being used to identify a third selection region corresponding to the text element in the second selection region, the service recommendation region including icons of a fourth group of applications and / or services determined according to the third selection region.

[0053] For example, in a case where the text circle selection control is displayed on the first interface, the first interface is, for example, the first interface after the first processing. That is, the first interface after the door opening dynamic effect. In this case, the text circle selection control displayed on the first interface in the selection display region is, for example, the text circle selection control 50d-4, or the text circle selection control 70d-4, or the text circle selection control 110d-4, or the text circle selection control 60e-5.

[0054] Therefore, by providing the text circle selection control on the first interface of the selection display region, the current selection mark can be automatically adjusted to the selection mark of the circled text element. That is, the selection region identified by the current selection mark is adjusted to a region representing the text element in the selection region.

[0055] For specific implementation details of this aspect, refer to the description of the embodiment shown in FIG. 6C in the following embodiments, which will not be repeated here.

[0056] According to the first aspect, or any one of the implementations of the above first aspect, the selection display region further includes a text circle selection control displayed on the first interface; in a case where the save control is displayed, the method further includes: in response to an eighth operation on the save control, saving the content in the circled track.

[0057] Exemplarily, the first interface is, for example, the first interface after the first processing. That is, the first interface with the door opening animation. In this case, the save control displayed on the first interface in the selection display area is selected, for example, the save control 50d-6, or the save control 70d-6, or the save control 110d-6, or the save control 60e-7.

[0058] In this way, by providing the save control on the first interface of the selection display area, the user demand of using the knuckle screenshot can be considered.

[0059] According to the first aspect, or any one of the implementation manners of the first aspect, the service recommendation area displayed in the third interface and the fourth interface both include icons of the custom recommendation application and / or service set by the user, and the service recommendation area displayed in the third interface further includes icons of the first group of application and / or service determined according to the first selection area, and the service recommendation area displayed in the fourth interface further includes icons of the second group of application and / or service determined according to the second selection area.

[0060] In this way, the custom demand of the user can be met, and the icons of the application and / or service displayed in the service recommendation area are matched with the content in the second selection area, and the diversified use demand of the user can be met.

[0061] According to the first aspect, or any one of the implementation manners of the first aspect, before displaying the fourth interface, the method further includes: performing intent recognition on the second selection area to determine the user intent corresponding to the second selection area; according to the user intent, obtaining information of the second group of application and / or service matched with the user intent; and according to the information of the second group of application and / or service, determining the icons of the second group of application and / or service displayed in the service recommendation area.

[0062] In this way, the icons of the application and / or service finally displayed in the service recommendation area can be matched with the content circled in the current interface, and thus the use experience of the user can be improved.

[0063] For the specific implementation details of the present aspect, refer to the description of the embodiments shown in FIG. 6B and FIG. 8B in the following embodiments, which will not be repeated here.

[0064] According to the first aspect, or any one of the implementation manners of the first aspect, the circle selection operation is a user operation made by the user through the knuckle.

[0065] Exemplarily, the circle selection operation made by the user through the knuckle is, for example, the user operation of drawing the circle selection track 10d-2 in the interface 10d, or the user operation of drawing the circle selection track 20e-1 in the interface 20e, or the user operation of drawing the circle selection track 10f-1 in the interface 10f.

[0066] Thus, without integrating new circle selection operation recognition capability, the existing knuckle recognition capability can be used to accurately recognize the circle selection operation made by the user.

[0067] According to the first aspect, or any one of the implementations of the first aspect, after displaying the fourth interface in response to the second operation, the method further includes: in response to a ninth operation on an icon of any application and / or service in the service recommendation area, transmitting the second selection area to an application or service corresponding to the selected icon.

[0068] For example, the ninth operation is a user operation of clicking an icon of any application and / or service in the service recommendation area, such as the user operation in the interface 70d shown in (2) of FIG. 6B.

[0069] For example, the ninth operation is a user operation of dragging the second selection area close to an icon of any application and / or service in the service recommendation area.

[0070] Thus, the content of the circle selection is transmitted to the application or service corresponding to the selected icon in a one-step direct manner.

[0071] According to the first aspect, or any one of the implementations of the first aspect, the method further includes: displaying a ninth interface; in response to a tenth operation on the ninth interface, displaying an operation track on the ninth interface, the tenth operation being a circle selection operation; after displaying the operation track, displaying a sixth selection mark on the ninth interface, the sixth selection mark being used to indicate a fourth selection area on the ninth interface, the fourth selection area being determined according to the operation track; after displaying the sixth selection mark, displaying a seventh selection mark on the ninth interface, the seventh selection mark being used to indicate a fifth selection area on the ninth interface, the fifth selection area being obtained by expanding the fourth selection area; displaying a tenth interface, the tenth interface including icons of applications and / or services recommended according to content in the fifth selection area; and in response to an eleventh operation of the user on the fifth selection area, transmitting the content in the fifth selection area through an application and / or service corresponding to an icon selected by the user.

[0072] In the above technical solution, the user determines a corresponding selection area in the interface through a circle selection operation, and thus displays matching service icons based on the content of the selection area, and shares the content of the selection area to a service corresponding to the service icon through a user operation, thereby avoiding misselecting data content that is not intended by the user, accurately transmitting the content selected by the user, and improving the user experience.

[0073] According to a first aspect, or any one of the implementations of the first aspect, the method further includes determining a first rectangle according to the operation trajectory, and taking the first rectangle as the fourth selection region. The above technical solution draws the first rectangle corresponding to the operation trajectory as the fourth selection region, which can ensure that the content displayed in the fourth selection region is substantially the same as the content in the operation trajectory selected by the user.

[0074] According to the first aspect, or any one of the implementations of the first aspect, the method further includes obtaining intersection content intersecting with the boundary of the fourth selection region in the ninth interface, and determining a fifth selection region according to the intersection content. The above technical solution can determine the fifth selection region according to the intersection content of the fourth selection region, so as to accurately display the region where the content intended to be selected by the user is located.

[0075] According to the first aspect, or any one of the implementations of the first aspect, determining the fifth selection region according to the intersection content includes determining a starting position and an ending position of the intersection content, determining a first text region corresponding to the starting position and a second text region corresponding to the ending position, determining a second rectangle according to the first text region and the second text region, and taking the second rectangle as the fifth selection region. The above technical solution can determine the second rectangle based on the text regions at the starting position and the ending position of the fourth selection region, and take the second rectangle as the fifth selection region, so as to accurately display the region where the content intended to be selected by the user is located.

[0076] According to the first aspect, or any one of the implementations of the first aspect, the ninth interface includes text, the intersection content includes a text line of the text, and in a case where the fourth selection region is located in a region where the text is located, the fifth selection region includes all content of the text line. In the above technical solution, the fifth selection region can include all content of the intersected text line, so that all content of the text line intersected with the fourth selection region can be transmitted.

[0077] According to the first aspect, or any one of the implementations of the first aspect, the ninth interface includes a map, the intersection content includes at least one address entity of the map, and in a case where the fourth selection region is located in a region where the map is located, the fifth selection region includes the at least one address entity. In the above technical solution, the fifth selection region can include the content of the intersected address entity, so that the content of the address entity intersected with the fourth selection region can be transmitted.

[0078] According to the first aspect, or any one of the implementations of the first aspect, determining the first text region corresponding to the start position comprises: determining, as the first text region corresponding to the start position, a text region closest to the start position in intersection content intersecting a boundary of the fourth selection region, the start position being a position corresponding to a first character closest to a first vertex of the fourth selection region in the intersection content, the first vertex being a top-left vertex of the fourth selection region. The above technical solution can determine the first text region according to the character closest to the top-left vertex of the fourth selection region, thereby improving the efficiency of identifying the first text region.

[0079] According to the first aspect, or any one of the implementations of the first aspect, determining the second text region corresponding to the end position comprises: determining, as the second text region corresponding to the end position, a text region closest to the end position in intersection content intersecting a boundary of the fourth selection region, the end position being a position corresponding to a second character closest to a second vertex of the fourth selection region in the intersection content, the second vertex being a bottom-right vertex of the fourth selection region. The above technical solution can determine the second text region according to the character closest to the bottom-right vertex of the fourth selection region, thereby improving the efficiency of identifying the second text region.

[0080] According to the first aspect, or any one of the implementations of the first aspect, the method further comprises: determining the start position of the fourth selection region as a start position of a fifth selection region, and displaying a first mark at the start position of the fifth selection region; determining the end position of the fourth selection region as an end position of the fifth selection region, and displaying a second mark at the end position of the fifth selection region; and setting a character in the fifth selection region within a range of the first mark and the second mark to a selected state. The above technical solution sets the character in the fifth selection region within the range of the first mark and the second mark to the selected state, which can further determine the content selected by the user, and further avoid misselecting data content.

[0081] According to the first aspect, or any one of the implementations of the first aspect, transmitting the content in the fifth selection region through an application and / or a service corresponding to the icon selected by the user comprises: transmitting the character in the fifth selection region in the selected state through the application and / or the service corresponding to the icon selected by the user. The above technical solution can transmit the character in the fifth selection region in the selected state through the application and / or the service corresponding to the icon selected by the user, thereby avoiding transmitting misselected content, and achieving accurate transmission of the content selected by the user.

[0082] According to the first aspect, or any one of the implementations of the first aspect, in response to the eleventh operation of the user on the fifth selection area, transmitting the content in the fifth selection area through the application and / or the service corresponding to the icon selected by the user comprises: in response to a long press operation of the user on the fifth selection area, dragging the content of the fifth selection area; and in response to an operation of the user dragging the dragged content of the fifth selection area to an application icon or a service icon, transmitting the content of the fifth selection area through the application and / or the service corresponding to the application icon or the service icon. The above technical solution realizes the dragging of the content of the fifth selection area through the long press operation on the fifth selection area, and then realizes the transmission of the dragged data to the target application icon or the target service icon through the dragging of the dragged data.

[0083] According to the first aspect, or any one of the implementations of the first aspect, in response to the eleventh operation of the user on the fifth selection area, transmitting the content in the fifth selection area through the application and / or the service corresponding to the icon selected by the user comprises: in response to a long press operation of the user on the fifth selection area, dragging the content of the fifth selection area; and in response to an operation of the user dragging the dragged content of the fifth selection area to an application icon or a service icon, transmitting the content of the fifth selection area through the application and / or the service corresponding to the application icon or the service icon. The above technical solution realizes the dragging of the content of the fifth selection area through the long press operation on the fifth selection area, and then realizes the transmission of the dragged data to the target application icon or the target service icon through the dragging of the dragged data to the target application icon or the target service icon.

[0084] According to the first aspect, or any one of the implementations of the first aspect, the method further comprises: displaying a text and image switching control on the tenth interface; if the text and image switching control is in an unselected state, in response to a touch operation of the user on the text and image switching control, setting the text and image switching control to be displayed in a selected state, performing text recognition on the content in the fifth selection area; determining an application or a service corresponding to the text recognition result; and displaying the determined application icon or service icon on the tenth interface. The above technical solution realizes the transmission of the selected content to the corresponding application or service in the form of text through the operation on the text and image switching control.

[0085] According to the first aspect, or any one of the implementations of the first aspect, the method further comprises: if the text and image switching control is in a selected state, in response to a touch operation of the user on the text and image switching control, setting the text and image switching control to be displayed in an unselected state, taking a screenshot of the content in the fifth selection area as a picture; determining an application or a service corresponding to the picture; and displaying the determined application icon or service icon on the tenth interface. The above technical solution realizes the transmission of the selected content to the corresponding application or service in the form of a picture through the operation on the text and image switching control.

[0086] According to a first aspect, or any possible implementation mode of the first aspect, the method further comprises: displaying an editing control on the tenth interface; and in response to a touch operation of the editing control by the user, displaying an editing interface, the editing interface being used for editing content in the fifth selection region. With the above technical solution, the user can edit the data selected by the fifth selection region through the editing control.

[0087] In a second aspect, the embodiments of the present application provide an electronic device. The electronic device comprises a memory and a processor, the memory and the processor being coupled; the memory stores program instructions, and the program instructions are executed by the processor to cause the electronic device to execute the instructions of the method in the first aspect or any possible implementation mode of the first aspect.

[0088] In a third aspect, the embodiments of the present application provide a computer readable medium for storing a computer program, the computer program comprising instructions for executing the method in the first aspect or any possible implementation mode of the first aspect.

[0089] In a fourth aspect, the embodiments of the present application provide a computer program, the computer program comprising instructions for executing the method in the first aspect or any possible implementation mode of the first aspect.

[0090] In a fifth aspect, the embodiments of the present application provide a chip, the chip comprising a processing circuit and a transceiver pin. The transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the first aspect or any possible implementation mode of the first aspect to control the receiving pin to receive a signal and control the sending pin to send a signal. BRIEF DESCRIPTION OF DRAWINGS

[0091] FIG. 1A is a schematic diagram of a user interface of an information transmission method;

[0092] FIG. 1B is a schematic diagram of a user interface of another information transmission method;

[0093] FIG. 2A is a schematic diagram of a user interface of another information transmission method;

[0094] FIG. 2B is a schematic diagram of a user interface of another information transmission method;

[0095] FIG. 3 is a schematic diagram of a hardware structure of an electronic device;

[0096] FIG. 4 is a schematic diagram of a software structure of an electronic device;

[0097] FIGS. 5A and 5B are schematic diagrams of a user interface in which a start circle selection operation triggers any gate;

[0098] FIG. 5C is a schematic view of a user interface illustrating another example of triggering an arbitrary gate by an open circle selection operation;

[0099] FIGS. 6A-6D are schematic views of a user interface illustrating another example of an information transmission method;

[0100] FIG. 7A is a schematic view of a user interface illustrating another example of an information transmission method;

[0101] FIG. 7B is a schematic view of a user interface illustrating another example of an information transmission method;

[0102] FIG. 8A is a schematic view of an interaction between functional modules in an information transmission method for implementing the scenario illustrated in FIG. 6A;

[0103] FIG. 8B is a schematic view of an interaction between functional modules in an information transmission method for implementing the scenario illustrated in FIG. 6B;

[0104] FIG. 9 is a schematic view of an embodiment of the present application, in which a user transmits address data in a map application to a collection space;

[0105] FIG. 10 is a schematic view of a user interface in which a user opens or closes a function of an arbitrary gate by setting a function entry provided by an application, according to an embodiment of the present application;

[0106] FIG. 11 is a schematic view of a change in a selection region displayed on a screen according to an operation trajectory in a scenario in which a user selects text, according to an embodiment of the present application;

[0107] FIG. 12 is a schematic view of a scenario in which a user selects content for transmission, according to an embodiment of the present application;

[0108] FIG. 13 is a schematic view of a change in a selection region displayed on a screen according to an operation trajectory in a scenario in which a user selects a partial region of a map application, according to an embodiment of the present application;

[0109] FIG. 14 is a flowchart of a data transmission method according to an embodiment of the present application. DETAILED DESCRIPTION

[0110] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings. It should be understood that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0111] The term "and / or" in this document is merely used to describe associated objects, and can represent three relationships, for example, A and / or B can represent three cases: A exists alone, A and B exist simultaneously, and B exists alone.

[0112] The terms "first", "second", "third", "fourth" and the like in the description and claims of the present application are used for distinguishing between similar objects and are not necessarily used to describe a specific sequential order. For example, a first target object and a second target object are used for distinguishing between two different target objects, and are not necessarily used to describe a specific sequential order.

[0113] In the present application embodiments, the words "exemplary" and "for example" are used to help clarify the description of the present application embodiments. Any embodiment or design scheme described as "exemplary" or "for example" in the present application embodiments should not be interpreted as being more preferred or advantageous than other embodiments or design schemes. Rather, the use of "exemplary" or "for example" is intended to present concepts in a concrete manner.

[0114] In the description of the present application embodiments, the meaning of "a plurality of" is two or more, unless otherwise specified. For example, a plurality of processing units refers to two or more processing units; a plurality of systems refers to two or more systems.

[0115] In the description of the present application embodiments, unless otherwise specified, only one user interface can be displayed at the same time. For example, in the case of displaying interface 10a, interface 20a will not be displayed in the current screen. Conversely, in the case of displaying interface 20a, interface 10a will not be displayed in the current screen.

[0116] In order to facilitate understanding, the related terms involved in the present application embodiments will be introduced first as follows.

[0117] (1) Cross-application transmission of information

[0118] In the present application embodiments, the cross-application transmission of information can be understood as the transmission of information between two applications in the same device. That is, the information in one application is transmitted (shared, uploaded) to another application. For example, pictures / photos, videos, etc. managed in a gallery application are shared with friends in an instant messaging application.

[0119] In addition, it should be noted that the information transmitted across applications can be not only pictures, but also text, video, document, link, etc. In the present application embodiments, pictures are taken as an example.

[0120] (2) Arbitrary gate

[0121] The arbitrary door is an interactive mode for cross-application transmission of information proposed in the embodiments of the present application.

[0122] In the interactive mode, when a user needs to transmit information in an interface to another application, the user can long press the screen content, and gently drag it to the edge of the screen. The electronic device will then perform a three-dimensional transformation on the original interface displayed in the screen, create a visual effect of the original interface being pushed inwards, and display icons of services or applications recommended by the electronic device for the dragged content on the side of the screen. After the user releases the dragged content on the icon, the content can be transmitted to the application or service corresponding to the icon, and the corresponding application or service function is started.

[0123] It should be understood that the above description is only an example for better understanding of the technical solutions of the embodiments of the present application, and is not the only limitation of the embodiments of the present application. In actual applications, any interactive mode of long-pressing and lifting the pressed content, and transmitting the lifted content to the recommended application or service can be regarded as the arbitrary door interactive mode in the embodiments of the present application. The embodiments of the present application do not limit whether the user interface is transformed in three dimensions during the process of transmitting information based on the interactive mode.

[0124] With the continuous development of electronic information technology, smart devices such as mobile phones and tablets have become indispensable products in our daily life, work and entertainment. In some use scenarios, users will use electronic devices to transmit information across applications, such as cross-application transmission of pictures. In order to facilitate understanding, the cross-application transmission of pictures is described below in combination with the drawings.

[0125] Referring to FIG. 1A, an example of a specific process in which a user shares a picture in a gallery application to an instant messaging application is shown.

[0126] The interface 10a shown in (1) of FIG. 1A is a user interface displayed by an electronic device (such as a mobile phone) after the user opens a picture 10a-1 in a gallery application. In the interface 10a, in addition to displaying the picture 10a-1, one or more controls (or options) such as a sharing control 10a-2, a collection control, an editing control, a deletion control, etc. can also be included.

[0127] For example, in some embodiments of the present application, the user can click the sharing control 10a-2 to achieve cross-application transmission of the picture 10a-1. Specifically, in the case where the user clicks the sharing control 10a-2, the mobile phone displays the interface 20a shown in (2) of FIG. 1A in response to the user operation.

[0128] The interface 20a shown in (2) of FIG. 1A is a user interface displayed by the mobile phone after the user selects the sharing control 10a-2. The interface 20a can include one or more controls (or options) such as an icon for selecting an application to which the picture 10a-1 is to be shared or an icon of a service provided by the application.

[0129] It is appreciated that in some embodiments of the present application, the icons displayed in the interface 20a for the user to select can be icons of all applications installed on the mobile phone and services provided by the applications.

[0130] In some other embodiments of the present application, the icons displayed in the interface 20a for the user to select can also be icons of default applications and / or services.

[0131] The icons displayed in the interface 20a for the user to select include an icon 20a-1 for sending to friends and an icon for sending to a circle of friends, an icon of a note application and an icon for saving to a network disk, as shown in (2) of FIG. 1A. In some embodiments of the present application, the user can click the icon 20a-1 to share the picture 10a-1 across applications to friends. Specifically, when the user clicks the icon 20a-1, the mobile phone displays the interface 30a shown in (3) of FIG. 1A in response to the user operation.

[0132] It is noted that the interface 30a is an exemplary user interface for selecting a chat object of an instant messaging application. The interface 30a can provide a search box for the user to search for a target object and can also display recently forwarded objects and chat objects.

[0133] In some embodiments of the present application, the user can select any object provided in the interface 30a. For example, when the user clicks the chat object “Petter” displayed in the interface 30a, the mobile phone can share the picture 10a-1 to Petter in response to the user operation.

[0134] Thus, the picture 10a-1 managed in the gallery application can be transmitted to the friend Petter through the instant messaging application, i.e., the cross-application transmission of the picture 10a-1 is achieved.

[0135] However, in some use scenarios, a user can only need to share partial content of a picture, and does not want to share the whole picture. For example, in a scenario where a picture to be transmitted across applications includes both text elements (such as "Zhang San" and "130***********1234" in the picture 10a-1) and image elements (such as the two-dimensional code in the picture 10a-1 (the part showing "two-dimensional code" is an image element of the two-dimensional code, and the specific style of the two-dimensional code is not specifically shown in this case)), the text elements or image elements included can involve private information or information that the user does not want to share. In this case, if the user wants to transmit the content of a partial region in the picture 10a-1 across applications, the user needs to intercept the partial region in the picture 10a-1 by means of picture editing, save the content of the intercepted partial region, and then transmit the picture corresponding to the partial region across applications in the manner shown in FIG. 1A.

[0136] For ease of understanding, the embodiments of this application take, as an example, a case where a user wants to transmit the two-dimensional code in the picture 10a-1 across applications, and are specifically described in combination with FIG. 1B.

[0137] Referring to (1) in FIG. 1B, in an exemplary scenario where a user needs to transmit an image element, such as a two-dimensional code, in the picture 10a-1 across applications, the user needs to first click the editing control 10a-3 in the interface 10a, and then enter the editing interface of the picture 10a-1. That is, in the case where the user clicks the editing control 10a-3, the phone displays the interface 40a shown in (2) in FIG. 1B in response to the user operation.

[0138] Referring to (2) in FIG. 1B, the interface 40a displays the picture 10a-1 (the picture 40a-1 in the interface 20a) to be edited, and one or more controls (or options), such as a back control for backing to the interface 10a, a save control 40a-2 for saving the editing of the picture 10a-1 performed by the user in the interface 40a, an adjustment bar for cropping the picture 10a-1, and various editing controls.

[0139] It should be noted that in some embodiments of the present application, when the interface 20a is displayed, the cropping control provided in the interface 20a can be selected by default, and the free cropping control, i.e., the user interface presents the style of the interface 20a. In the case where the free cropping control is selected, the picture 10a-1 displayed in the interface 20a is surrounded by adjustment bars (such as the bars displayed on the four corners of the picture 10a-1 and the bars displayed on the top, bottom, left and right four sides). In this way, the user can drag the bars at different positions to crop the picture 40a-1 to obtain a picture 40a-1' including only the image elements, as shown in the interface 50a in (3) of FIG. 1B.

[0140] Referring to (3) of FIG. 1B, for example, after the user edits the picture 40a-1, such as cropping, the picture 40a-1 displayed in the current interface will be updated to the cropped picture 40a-1', and the "reset" option will also be displayed in the current interface. In this way, the user can discard the current modification by operating the "reset" option to restore the picture 40a-1 to the picture 40a-1, so that the user can re-edit on the original picture.

[0141] Referring to (3) of FIG. 1B, for example, after the user edits the picture 40a-1, such as cropping, the picture 40a-1 displayed in the current interface will be updated to the cropped picture 40a-1', and the "reset" option will also be displayed in the current interface. In this way, the user can discard the current modification by operating the "reset" option to restore the picture 40a-1 to the picture 40a-1, so that the user can re-edit on the original picture.

[0142] Referring to (3) of FIG. 1B, for example, after the user edits the picture 40a-1, such as cropping, the picture 40a-1 displayed in the current interface will be updated to the cropped picture 40a-1', and the "reset" option will also be displayed in the current interface. In this way, the user can discard the current modification by operating the "reset" option to restore the picture 40a-1 to the picture 40a-1, so that the user can re-edit on the original picture.

[0143] Referring to (3) of FIG. 1B, for example, after the user edits the picture 40a-1, such as cropping, the picture 40a-1 displayed in the current interface will be updated to the cropped picture 40a-1', and the "reset" option will also be displayed in the current interface. In this way, the user can discard the current modification by operating the "reset" option to restore the picture 40a-1 to the picture 40a-1, so that the user can re-edit on the original picture.

[0144] It should be noted that the picture 10a-4 displayed in the interface 10a' is the picture 40a-1' obtained through the user operations shown in (1) to (4) of FIG. 1B. Thus, the picture 10a-4 cropped from the picture 10a-1 is obtained. In this case, the user clicks the sharing control 10a-2 in the interface 10a', and the mobile phone responds to the user operation to display the interface 20a' shown in (6) of FIG. 1B.

[0145] Referring to (6) in FIG. 1B, the interface 20a' is similar to the interface 20a, except that the picture selected for sharing is different. Specifically, the picture selected for sharing in the interface 20a is the picture 10a-1, and the picture selected for sharing in the interface 20a' is the picture 10a-4.

[0146] Continuing to refer to (6) in FIG. 1B, the phone displays the interface 30a described above in response to the user clicking the icon 20a-1 in the interface 20a'. In this way, the user can share the image element in the picture 10a-1, such as the picture 10a-4, to the selected chat object by selecting the chat object displayed in the interface 30a.

[0147] As can be seen from the description of the scenarios shown in FIGS. 1A and 1B, the above-described cross-application transmission method can only transmit the entire picture, such as the picture 10a-1. If the user wants to transmit the content in a local area of the picture 10a-1, such as the two-dimensional code, the user needs to perform complex and tedious operations on the picture 10a-1, such as editing the picture 10a-1, saving the content in the local area that needs to be transmitted as a separate picture, such as the picture 10a-4, and then transmitting the picture 10a-4 to achieve the transmission of the content in the local area of the picture 10a-1, such as the two-dimensional code.

[0148] In addition, the cross-application transmission method requires the user to perform multiple human-computer interactions with the phone, and frequent interface switching not only reduces the user's efficiency in processing data, but also brings a poor user experience.

[0149] For ease of distinction, the cross-application transmission method shown in FIGS. 1A and 1B is referred to as implementation 1 hereinafter.

[0150] In view of this, embodiments of the present application provide a human-computer interaction method for an arbitrary door. Specifically, in the embodiments, the user long-presses information that needs to be shared / transmitted, such as the picture 10a-1 displayed in the interface 10a shown in (1) in FIG. 2A, and the phone displays the interface 70a shown in (2) in FIG. 2A in response to the user operation.

[0151] Referring to (2) in FIG. 2A, the picture 10a-1 is processed (such as blurred or blurred) into the picture 10a-1' in the interface 70a under the long-press operation of the user, and a picture 70a-1 is displayed on the picture 10a-1'.

[0152] Continuing to refer to (2) of FIG. 2A, exemplary, the picture 70a-1 can move in the interface 70a along with the user's dragging operation without the user releasing the hand, and the picture 70a-1 can be displayed on top of the interface 70a, i.e., when the picture 70a-1 overlaps with the positions of other elements in the interface 70a, the other elements displayed in the interface 70a can be covered.

[0153] It should be noted that the content displayed by the picture 70a-1 can be the same as the content displayed by the picture 10a-1.

[0154] Optionally, in some embodiments of the present application, the picture 70a-1 can be a thumbnail picture obtained by the phone scaling down the picture 10a-1 at a same scale (or at other scales). That is, the picture 70a-1 has no difference from the picture 10a-1 except for the area size.

[0155] Optionally, in some other embodiments of the present application, after the picture 10a-1 is long-pressed to form the picture 70a-1, the phone can still display the picture 10a-1 in the interface 70a, and perform a blur processing or a blur processing on the picture 10a-1, i.e., the picture 10a-1' shown in the interface 70a.

[0156] Optionally, in some embodiments of the present application, the picture 10a-1' displayed in the interface 70a can have a lower definition than the picture 10a-1 displayed in the interface 10a. In this way, the user can be prompted that the picture 10a-1 is in a state of being selected and dragged, i.e., in the state of the picture 70a-1.

[0157] Continuing to refer to (2) of FIG. 2A, exemplary, the phone can display the interface 80a shown in (3) of FIG. 2A in response to the user operation of the picture 70a-1, such as the dragging operation shown in (2) of FIG. 2A.

[0158] Optionally, in some embodiments of the present application, during the user dragging the picture 70a-1 to the direction of the arrow shown in the interface 70a, when the picture 70a-1 is dragged to a distance less than a certain threshold value from the right edge of the screen, the phone responds to the user operation to pull up an arbitrary door service and display the interface 80a.

[0159] Referring to (3) of FIG. 2A, exemplary, the interface 80a can include the display element 10a-5, the icon area 10a-6, and the picture 10a-7.

[0160] It should be noted that the dashed line around the icon area 10a-6 is only for illustration. That is, in actual use, the dashed line is not displayed around the icon area 10a-6.

[0161] In addition, it should be noted that the dashed line shown in other diagrams of the embodiments of the present application is also only for illustration. That is, in actual use, it is not displayed.

[0162] Continuing to refer to (3) in FIG. 2A, the elements displayed in the display element 10a-5 can be the same as the elements displayed in the interface 10a. That is, the display element 10a-5 can be understood as the interface obtained by the mobile phone performing three-dimensional transformation on the elements of the interface 10a. In the interface 80a, the display element 10a-5 can create a visual effect of the original interface (i.e., the interface 10a) being pushed inward in the screen.

[0163] It should be noted that in the embodiments of the present application, this visual effect of “opening the door” metaphorically represents the behavior of transmitting information, which is more intuitive than copying and pasting (as shown in FIG. 1A and FIG. 1B).

[0164] Optionally, in some embodiments of the present application, in the interface 80a, the background 80a-1 behind the display element 10a-5 can be set as the picture obtained by superimposing a blur effect on the desktop background (i.e., the desktop wallpaper) of the mobile phone.

[0165] In addition, it should be noted that in some other embodiments of the present application, the display element 10a-5 can also not be processed with the opening-door animation. In this implementation manner, the icon area 10a-6 can be directly displayed on the upper layer of the display element 10a-5. For example, it is displayed in the sidebar of the current user interface. For another example, a floating window (which can be of any shape) is displayed on the upper layer of the current interface, and then the icons of the applications and / or services are displayed in the floating window.

[0166] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments. For the convenience of description, the embodiments of the present application take the display element 10a-5 being processed with the opening-door animation as an example.

[0167] Continuing to refer to (3) in FIG. 2A, the icon area 10a-6 can be used to display one or more icons of applications and / or services.

[0168] It can be understood that the application icons displayed in the icon area 10a-6 can be the icons of any application programs installed in the mobile phone. These applications can be system applications or third-party applications.

[0169] The icons of services displayed in the icon area 10a-6 can be icons of service functions provided by any application program. For example, the icon corresponding to the friend circle is the icon of the function of the friend circle provided by the WeChat application.

[0170] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0171] In addition, it should be noted that in some embodiments of the present application, a corresponding textual explanation can be displayed under each icon in the icon area 10a-6. It can be understood that the textual explanation can be used to explain the specific application name or service name corresponding to the icon.

[0172] In addition, it should be understood that the text under each icon is only for the convenience of the user to understand the specific application or specific service function corresponding to the icon, and the specific icon style and specific text content are not limited in the present application.

[0173] In addition, it should be noted that in some embodiments of the present application, the content included in the picture 10a-7 can be the same as the content included in the picture 70a-1 and the picture 10a-1. That is, the picture 10a-7 can be a thumbnail obtained by the phone reducing the picture 70a-1. Similarly, the picture 10a-7 has no difference from the picture 10a-1 and the picture 70a-1 except the area size. In this way, when the user selects the icon corresponding to the application and / or service he wants in the icon area 10a-6, the picture 10a-7 will not cause large-area occlusion to the icons and texts in the icon area 10a-6, which is more convenient for the user to select the icons.

[0174] In addition, it should be noted that unlike the reduction process of the picture 10a-1, after the picture 70a-1 is reduced to obtain the picture 10a-7, the picture 70a-1 can no longer be displayed in the interface 80a. That is, the picture 70a-1 can be regarded as a picture obtained by the phone reducing the picture 10a-1 after copying, and the picture 10a-7 can be regarded as a picture obtained by the phone directly reducing the picture 70a-1.

[0175] Continuing to refer to (3) in FIG. 2A, for example, in the interface 80a, the user drags the picture 10a-7 to the corresponding icon in the icon area 10a-6 and releases the hand, and the phone can respond to the user operation to transmit the picture 10a-7 to the application and / or service corresponding to the icon and display the user interface or feedback information corresponding to the icon of the application and / or service. For example, after the user drags the picture 10a-7 to the icon 10a-8 (such as the icon 20a-1 described above) displayed in the icon area 10a-6, the phone responds to the user operation to display the interface 30a described above.

[0176] In addition, in order to guide the user to accurately put the dragged information into the application and / or service that the user needs, when the picture 10a-7 is close to a certain icon in the icon area 10a-6, or the distance between the picture 10a-7 and the certain icon in the icon area 10a-6 is less than a certain threshold, the icon that is close to the picture 10a-7 can display a certain special effect, for example, the icon and the text corresponding to the icon can be attracted close to the picture 10a-7, and the icon and the text corresponding to the icon can be enlarged.

[0177] Taking the icon 10a-8 in the interface 80a and the text "friend" corresponding to the icon 10a-8 as an example, when the picture 10a-7 is close to the icon 10a-8, the icon 10a-8 and the text "friend" are closer to the left than other icons and texts, that is, the icon 10a-8 and the text "friend" are closer to the picture 10a-7 than other icons and texts.

[0178] In addition, the icon 10a-8 is also enlarged to prompt the user that if the user releases the picture 10a-7 (or the picture 10a-1) at this position, the picture 10a-7 (or the picture 10a-1) will be transmitted to the application or service corresponding to the icon 10a-8.

[0179] It should be understood that the above description is only an example for better understanding the technical solution of the embodiment and is not the only limitation of the embodiment.

[0180] Therefore, based on the cross-application transmission mode of the arbitrary gate, by long pressing the screen content such as the picture 10a-1 and dragging the picture 10a-1 to the right edge (or the left edge) of the screen, the user can directly reach the shortcut service or application. For example, the picture 10a-1 managed in the gallery application can be transmitted to the friend Petter through the instant messaging application.

[0181] In addition, it should be noted that the cross-application transmission operation of the picture 10a-1 shown in FIG. 2A is continuous from the time when the user drags the picture 10a-1 to the time when the picture 10a-1 is put into the target application and / or service.

[0182] It should be noted that the "continuous" here means that the user does not need to perform copy, paste and other operations, and does not need to perform application switching operation, and the user's finger does not need to leave the screen of the mobile phone during the entire operation process, and the operation is simple and fast.

[0183] In addition, the information transmission mode ensures the effective browsing area of the user interface, which can effectively improve the efficiency of the user in cross-application transmission of information and improve the user experience.

[0184] However, in some usage scenarios, for example, a scenario where the user only wants to share the content of a partial region in the picture 10a-1, it is still necessary to edit the picture 10a-1 through picture editing. For example, the partial region in the picture 10a-1 is first intercepted, and the content of the intercepted partial region is saved, and then the picture corresponding to the partial region is selected for cross-application transmission in the manner shown in FIG. 2A.

[0185] For ease of understanding, the embodiments of the present application take a scenario where the user wants to cross-application transmit the two-dimensional code in the picture 10a-1 as an example, and are specifically described in combination with FIG. 2B.

[0186] For example, in the case where the user clicks the control 10a-3 in the interface 10a, the phone displays the interface 40a shown in (1) of FIG. 2B in response to the user operation.

[0187] Referring to (1) to (4) of FIG. 2B, a user interface involved in editing the picture 10a-1 to intercept the content (such as the two-dimensional code) to be shared from the picture 10a-4 is exemplarily shown. As to the user interfaces corresponding to (1) to (4) of FIG. 2B, and the user operations made by the user on the user interfaces corresponding to (1) to (4) of FIG. 2B, the interface changes of the phone in response to the user operations can be referred to the description of (2) to (5) of FIG. 1B in the above embodiments, and will not be described herein again.

[0188] For example, after obtaining the picture 10a-4 in the picture editing manner shown in FIG. 1B, the user can pull up the arbitrary door service to realize cross-application transmission of the picture 10a-4 (or the picture 70a-2, or the picture 10a-9) based on the arbitrary door in the manner shown in FIG. 2A.

[0189] As to the specific implementation details of pulling up the arbitrary door service in the interface 10a' to realize cross-application transmission of the picture 10a-4 based on the arbitrary door, it can be referred to the description of cross-application transmission of the picture 10a-1 in the embodiments shown in FIG. 2A, and will not be described herein again.

[0190] In addition, it should be noted that in some other embodiments of the present application, when the user makes a clipping operation on the picture 40a-1 displayed in the interface 40a, and then clips the picture 40a-1 into the picture 40a-1', that is, the interface 50a is displayed, the picture 40a-1' can not be saved, but directly long-pressed to trigger the arbitrary door service to lift the picture 40a-1'. Specifically, the picture 40a-1' can be copied and then reduced to obtain a thumbnail picture similar to the picture 70a-2, and then the thumbnail picture is dragged to the icon of the target application or target service displayed in the icon area to realize transmission of the picture 40a-1' based on the target application or target service.

[0191] It should be noted that the target application or target service mentioned in the embodiments of the present application can be understood as an application or service selected by the user from the icon area for information transmission.

[0192] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0193] As can be known from the description of the scenarios shown in FIGS. 2A and 2B, when the picture is transmitted by using the cross-application transmission mode of the arbitrary door, only the whole picture such as the picture 10a-1 can be transmitted. That is, in the scenario of transmitting the whole picture, the number of human-computer interactions can be reduced (for the sake of distinction, the cross-application transmission mode shown in FIGS. 2A and 2B is referred to as implementation mode 2).

[0194] If the user wants to transmit the content (such as a two-dimensional code) in the local area of the picture 10a-1, the user still needs to perform complex and tedious operations on the picture 10a-1, such as editing the picture 10a-1, saving the content in the local area that needs to be transmitted as a picture such as the picture 10a-4, and then transmitting the picture 10a-4 based on the cross-application transmission mode of the arbitrary door, so as to realize the transmission of the content (such as a two-dimensional code) in the local area of the picture 10a-1. That is, in the scenario of only needing to transmit part of the elements in the whole picture, the user still needs to perform multiple human-computer interactions with the mobile phone.

[0195] In addition, in some use scenarios, the content in the current interface (such as the TikTok interface) cannot be lifted. For such use scenarios, if the user wants to share the content in the TikTok interface based on the implementation mode 2, the user needs to take a screenshot of the content in the TikTok interface, and then share the screenshot based on the implementation mode 2. That is, in the use scenario where the content in the current interface cannot be lifted, the content in the current interface cannot be directly transmitted based on the implementation mode 2.

[0196] Therefore, the embodiment of the present application further provides a human-computer interaction mode of the arbitrary door (implementation manner 3). In the embodiment, the electronic device monitors whether the user makes a circle selection operation in the current interface. When it is monitored that the user makes a circle selection operation, the arbitrary door service is pulled up, and a circle selection box that can be adjusted by the user is displayed in the current interface according to the circle selection area corresponding to the circle selection operation. In this way, the user can adjust the range of the circle selection by dragging the circle selection box, and the icons of the applications and / or services displayed in the icon area are updated according to the elements in the range of the circle selection. Finally, the user can directly reach the shortcut service or application by dragging the content in the circle selection box to the edge of the screen.

[0197] Understandably, in the embodiment of the present application, the circle selection operation refers to the user operation of circling specific content on the screen.

[0198] Optionally, in some embodiments of the present application, the circle selection operation can be a user operation made by the user using the knuckle on the screen.

[0199] Optionally, in some other embodiments of the present application, the circle selection operation can also be a user operation made by the user using the finger on the screen.

[0200] Optionally, in some other embodiments of the present application, the circle selection operation can also be a user operation made by the user using an external device such as a stylus, a mouse, etc. on the screen.

[0201] It should be understood that the above description is only an example for better understanding the technical solution of the embodiment and is not the only limitation of the embodiment.

[0202] In addition, in the embodiment of the present application, the electronic device can be a device with a touch / touch function screen, such as a mobile phone, a tablet computer, a wearable device (a smart watch), a notebook computer, etc. which will not be listed one by one here, and the present application does not make any limitation on the specific type of the electronic device.

[0203] As to the hardware structure and software structure of the electronic device for implementing the implementation manner 3 provided in the embodiment of the present application, it can be as shown in FIG. 3 and FIG. 4.

[0204] Referring to FIG. 3, a hardware structure of an electronic device for implementing the implementation manner 3 provided in the embodiment of the present application is exemplarily shown.

[0205] As shown in FIG. 3, the electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0206] It should be noted that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, or software, or a combination of software and hardware.

[0207] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a Modem, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a neural-network processing unit (NPU), etc., which are not listed one by one here, and the present application does not make any limitation.

[0208] The controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of fetching and executing instructions.

[0209] Different processing units can be independent devices or integrated in one or more processors.

[0210] The processor 110 can further include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can hold instructions or data that the processor 110 has just used or is reusing. If the processor 110 needs to use the instructions or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0211] The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0212] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0213] The modem processor can include a modulator and a demodulator.

[0214] The mobile communication module 150 can provide wireless communication solutions including second-generation mobile phone communication technology specifications (2-Generation wireless telephone technology, 2G), third-generation mobile communication technology (3rd-Generation, 3G), fourth-generation mobile communication technology (the 4th generation mobile communication technology, 4G), fifth-generation mobile communication technology (5th-Generation Mobile Communication Technology, 5G), etc. applied to the electronic device 100.

[0215] The wireless communication module 160 can provide solutions for wireless communication applied on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like.

[0216] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology.

[0217] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. In some implementations, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1. The electronic device 100 can implement the display function through a GPU, the display screen 194, and an application processor, and the like. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0218] In the embodiments of the present application, after the user drags the information element in the interface, the GPU in the electronic device 100 can perform three-dimensional transformation on the content displayed in the display screen 194 according to the content, create a visual effect of the original interface being pushed inwards in the screen, and display the icons of the recommended applications and / or services on the side of the screen of the electronic device 100.

[0219] In addition, in the embodiments of the present application, after the user drags the information element in the interface, the processor 110 can identify the information element, including identifying the type of the information element and the specific content in the information element, and determine the corresponding application icon and / or application service icon based on the identification result, and generate corresponding program instructions, which can be used to change the display information of the display screen 194, for example, update the interface in the display screen to a cross-application transmission interface, and the icons displayed in the cross-application transmission interface are the application icons and / or application service icons determined by the processor 110 based on the identification result.

[0220] In the embodiments of the present application, the display screen 194 is used to display the user interfaces shown in the following embodiments. The display screen 194 can also be used to receive user operations of the user acting on the display screen 194, such as a circle selection operation. The processor 110 is configured to determine the positions of various types of hot zones in response to the user operations detected by the electronic device 100, and trigger the functions corresponding to the hot zones in response to the user operations of the user acting on the various types of hot zones. The operations performed by various devices in the electronic device 100 can be specifically described in the related descriptions of the following embodiments, which are not described herein again.

[0221] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, files such as music and videos are saved in the external memory card.

[0222] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 executes various function applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (a screenshot function, an arbitrary gate function, etc.), and the like. The data storage area can store data created during the use of the electronic device 100 (such as information transmitted based on the cross-application transmission mode of the arbitrary gate), and the like. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

[0223] In the embodiments of the present application, the internal memory 121 is configured to store a computer program for implementing the information transmission method according to the implementation mode 3, and the processor 110 is configured to execute the computer program to implement the information transmission method.

[0224] In addition, it should be noted that the sensor module 180 can include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like, which are not listed one by one here, and the present application does not make any limitation thereto.

[0225] Specific to the embodiments of the present application, the touch sensor can be used to collect data corresponding to the input event generated when the user touches the screen, i.e., the display screen, so as to enable the input event framework to determine whether the input event currently occurring on the screen is an event triggered by the preset circle selection operation. For details of this implementation, please refer to the description of the following embodiments, which will not be repeated here.

[0226] In addition, it should be noted that an operating system runs on the above components. For example, the iOS operating system developed by Apple Inc., the Android open source operating system developed by Google Inc., the Windows operating system developed by Microsoft Corp., etc. These operating systems can adopt a layered architecture, or an event-driven architecture, or a microkernel architecture, or a microservice architecture, or a cloud architecture.

[0227] For ease of illustration, the embodiments of the present application take the Android system as an example to exemplarily illustrate the software structure of the electronic device 100.

[0228] It should be noted that, although the embodiments of the present application take the Android system as an example for illustration, the basic principles are also applicable to electronic devices based on iOS or Windows operating systems.

[0229] Referring to FIG. 4, it is a software structure block diagram of the electronic device 100 according to the embodiments of the present application.

[0230] As shown in FIG. 4, the layered architecture of the electronic device 100 divides the software into several layers, each of which has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments of the present application, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and the system library, and the kernel layer.

[0231] Among them, the application layer can include a series of application packages. As shown in FIG. 4, the application packages can include settings, control center, arbitrary door, smart screenshot, system interface, etc.

[0232] Optionally, in some embodiments of the present application, the adjustment of the circle selection range through the circle selection operation, and the implementation of the opening and closing of the information transmission function in the local area through the arbitrary door, can be realized through the function entry provided in the settings application.

[0233] Optionally, in some other embodiments of the present application, the adjustment of the circle selection range through the circle selection operation, and the implementation of the opening and closing of the information transmission function in the local area through the arbitrary door, can also be realized through a special arbitrary door application.

[0234] Referring to FIG. 5A, an exemplary user interface diagram of a function entry provided by a setting application and a function entry provided by an arbitrary door application for opening or closing the function is shown.

[0235] Taking a mobile phone as an example of an electronic device, referring to FIG. 5A (1), an exemplary user interface of a mobile phone is shown, such as interface 10b. In the interface 10b, icons of a plurality of applications are displayed, such as an icon 10b-1 of a setting application, an icon 10b-2 of an arbitrary door application, and icons of applications such as information (short message application), telephone, gallery, camera, clock, calendar, memo, music, file management, video, calculator, weather, email, sound recorder, browser, and the like.

[0236] It should be noted that in some embodiments of the present application, the interface 10b shown in FIG. 5A (1) can be referred to as a main interface.

[0237] Continuing to refer to FIG. 5A (1), in an exemplary manner, in the case where a user clicks on the icon 10b-1 of the setting application, the mobile phone responds to the user operation (such as a click operation / touch operation) to start the setting application and display a setting interface corresponding to the setting application, such as the interface 20b shown in FIG. 5A (2).

[0238] Referring to FIG. 5A (2), in an exemplary manner, a plurality of setting function entries (or options, controls) are displayed on the interface 20b, such as a setting entry 20b-1 of a smart assistant function, and setting entries of functions such as WLAN, Bluetooth, mobile network, more connections, desktop and personalization, display and brightness, sound and vibration, notification and status bar, and the like.

[0239] It should be noted that the smart assistant referred to in the embodiments of the present application can be understood as an intelligent assistant integrated with a plurality of functions, which aims to provide a convenient living and working environment for the user.

[0240] Alternatively, in some embodiments of the present application, the smart assistant can be referred to as "YOYO".

[0241] Continuing to refer to FIG. 5A (2), in an exemplary manner, in the case where a user clicks on the setting entry 20b-1 of the smart assistant function, the mobile phone responds to the user operation to display a setting interface corresponding to the smart assistant function, such as the interface 30b shown in FIG. 5A (3).

[0242] Referring to FIG. 5A (3), in an exemplary manner, a plurality of controls are displayed on the interface 30c, such as a setting entry 30b-1 of an arbitrary door function, and setting entries of functions such as YOYO suggestion, YOYO assistant, smart vision, mid-air gesture, smart perception, and the like.

[0243] Continuing to refer to (3) in FIG. 5A, for example, in a case where the user clicks the setting entry 30b-1 of the arbitrary door function, the mobile phone displays a setting interface corresponding to the arbitrary door function in response to the user operation, as shown in (4) in FIG. 5A.

[0244] Referring to (4) in FIG. 5A, for example, the interface 40b can include a control 40b-1 corresponding to the arbitrary door function and a control 40b-2 corresponding to the knuckle function. The function corresponding to the control 40b-1 can be understood as the arbitrary door function corresponding to the implementation manner 2, and the function corresponding to the control 40b-2 can be understood as the arbitrary door function corresponding to the implementation manner 3.

[0245] Continuing to refer to (4) in FIG. 5A, for example, the user clicks the control 40b-1, and the mobile phone starts the arbitrary door function corresponding to the implementation manner 2 in response to the user operation, and displays the interface 50b shown in (5) in FIG. 5A, that is, the switch of the arbitrary door function corresponding to the implementation manner 2, and the style of the control 40b-1 is switched to the style of the control 40b-1'.

[0246] Understandably, in a scenario where it is necessary to close the arbitrary door function corresponding to the implementation manner 2, the user clicks the control 40b-1', and the mobile phone closes the arbitrary door function corresponding to the implementation manner 2 in response to the user operation, and displays the interface 40b, that is, the switch of the arbitrary door function corresponding to the implementation manner 2, and the style of the control 40b-1' is switched back to the style of the control 40b-1.

[0247] Continuing to refer to (4) in FIG. 5A, for example, the user clicks the control 40b-2, and the mobile phone starts the arbitrary door function corresponding to the implementation manner 3 in response to the user operation, and displays the interface 60b shown in (6) in FIG. 5A, that is, the switch of the arbitrary door function corresponding to the implementation manner 3, and the style of the control 40b-2 is switched to the style of the control 40b-2'.

[0248] Understandably, in a scenario where it is necessary to close the arbitrary door function corresponding to the implementation manner 3, the user clicks the control 40b-2', and the mobile phone closes the arbitrary door function corresponding to the implementation manner 3 in response to the user operation, and displays the interface 50b, that is, the switch of the arbitrary door function corresponding to the implementation manner 3, and the style of the control 40b-2' is switched back to the style of the control 40b-2.

[0249] In addition, it needs to be noted that the starting or closing of the arbitrary door function corresponding to the implementation manner 2 and the starting or closing of the arbitrary door function corresponding to the implementation manner 3 can be determined according to the actual use demand of the user. That is, the user can start the arbitrary door function of the implementation manner 2 alone, or start the arbitrary door function of the implementation manner 3 alone, or start the arbitrary door functions of the implementation manner 2 and the implementation manner 3 simultaneously according to the actual use demand.

[0250] Thus, the function entry provided by the setting application is realized, and any door function corresponding to the implementation mode 2 and any door function corresponding to the implementation mode 3 are opened or closed.

[0251] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments. In another embodiment of the present application, the control 30b-1 can also be directly arranged in the interface 20b. In this way, the user clicks the control 30b-1 in the interface 20b, and the interface 40b is directly entered, thereby reducing the number of human-computer interactions.

[0252] Continuing to refer to (1) in FIG. 5A, for example, when the user clicks the arbitrary door application icon 10b-2 displayed on the interface 10b, the mobile phone starts the arbitrary door application in response to the user operation, and displays the interface corresponding to the arbitrary door application, such as the interface 40b, the interface 50b, the interface 60b (for example, the interface 60b is displayed by clicking the icon 10b-2 in FIG. 5A), or the interface 70b.

[0253] It should be noted that the user interface displayed after the user clicks the icon 10b-2 can be determined according to the opening and closing states recorded in the arbitrary door record document.

[0254] For example, when the opening and closing states of the arbitrary door corresponding to the implementation mode 2 recorded in the arbitrary door record document are in the closed state (the style of the control 40b-1), and the opening and closing states of the arbitrary door corresponding to the implementation mode 3 are in the closed state (the style of the control 40b-2), the user interface displayed after the user clicks the icon 10b-2 is the interface 40b.

[0255] For another example, when the opening and closing states of the arbitrary door corresponding to the implementation mode 2 recorded in the arbitrary door record document are in the open state (the style of the control 40b-1'), and the opening and closing states of the arbitrary door corresponding to the implementation mode 3 are in the open state (the style of the control 40b-2'), the user interface displayed after the user clicks the icon 10b-2 is the interface 60b.

[0256] For another example, when the opening and closing states of the arbitrary door corresponding to the implementation mode 2 recorded in the arbitrary door record document are in the open state (the style of the control 40b-1'), and the opening and closing states of the arbitrary door corresponding to the implementation mode 3 are in the closed state (the style of the control 40b-2), the user interface displayed after the user clicks the icon 10b-2 is the interface 50b.

[0257] For example, in the case that the switch of the arbitrary door corresponding to the implementation mode 2 is in the closed state (the style of the control 40b-1) and the switch of the arbitrary door corresponding to the implementation mode 3 is in the open state (the style of the control 40b-2'), the user interface displayed after the user clicks the icon 10b-2 is the interface 70b shown in FIG. 5B.

[0258] It can be understood that the arbitrary door record document can be stored in the internal memory of the mobile phone. The internal memory for storing the arbitrary door record document can be a read-only memory (ROM).

[0259] In this way, the function entry provided by the special arbitrary door application is realized, and the arbitrary door function corresponding to the implementation mode 2 and the arbitrary door function corresponding to the implementation mode 3 are opened or closed.

[0260] Optionally, in some embodiments of the present application, the adjustment of the range of the circle selection through the circle selection operation, and the opening, closing and other operations of the transmission function of the information in the local area based on the arbitrary door can also be realized through the function entry provided by the control center.

[0261] Referring to FIG. 5C, an exemplary user interface schematic diagram for opening or closing the function through the function entry provided by the control center is shown.

[0262] For example, in some embodiments of the present application, in the case that the interface of the mobile phone is an arbitrary interface after unlocking, the user slides the finger downward from a preset position of the screen of the mobile phone, such as the top area, and the mobile phone can respond to the user operation to call up the control center interface, such as the interface 10c shown in (1) of FIG. 5C.

[0263] Referring to (1) of FIG. 5C, for example, a plurality of controls (or entries, options) are displayed on the interface 10c, such as the control 10c-1 for opening the arbitrary door function, and the WLAN control, the ring control, the automatic rotation control, the wireless sharing control, the flight mode control, the mobile data control, the location information control, the screenshot control, the eye protection mode control, the Bluetooth control, the screen recording control, the NFC control, the flashlight control, the dark mode control, and the do-not-disturb control.

[0264] Continuing to refer to (1) of FIG. 5C, for example, in some embodiments of the present application, in the case that the arbitrary door function needs to be opened, the user clicks the control 10c-1, and the mobile phone responds to the user operation to directly open the arbitrary door function corresponding to the implementation mode 2 and the implementation mode 3, and displays the interface 20c shown in (2) of FIG. 5C, that is, the switch of the arbitrary door function is switched from the style of the control 10c-1 to the style of the control 10c-1'.

[0265] Understandably, in the scenario of needing to turn off the arbitrary door function, the user clicks the control 40b-1', and the phone, in response to the user operation, directly turns off the arbitrary door function corresponding to implementation manner 2 and implementation manner 3, and displays the interface 10c, that is, the switch of the arbitrary door function switches back from the style of the control 10c-1' to the style of the control 10c-1.

[0266] In addition, it needs to be noted that, in some other embodiments of the present application, in the scenario of needing to turn on the arbitrary door function, the user clicks the control 10c-1, and the phone, in response to the user operation, displays the interface 40b, or the interface 50b, or the interface 60b, or the interface 70b.

[0267] It needs to be noted that, after the user clicks the control 10c-1, the displayed user interface can be determined according to the switch state recorded in the arbitrary door record document. For details, reference can be made to the description part of the above-mentioned embodiments, which will not be described here again.

[0268] For example, when the user operates in the interface 40b, or the interface 50b, or the interface 60b, or the interface 70b, such as at least turns on the arbitrary door function corresponding to the implementation manner, if the user slides the finger downward from a preset position of the phone screen, such as the top area, the phone, in response to the user operation behavior, re-calls the control center interface, and the control center interface will be as shown in the interface 20c, that is, the control 10c-1 becomes the control 10c-1'.

[0269] It needs to be noted that, after the user clicks the control 10c-1, the displayed user interface can be determined according to the switch state recorded in the arbitrary door record document. For details, reference can be made to the description part of the above-mentioned embodiments, which will not be described here again.

[0270] Therefore, the function entry provided by the control center is realized to turn on or turn off the arbitrary door function corresponding to implementation manner 2 and the arbitrary door function corresponding to implementation manner 3.

[0271] In addition, it needs to be noted that, in some other embodiments of the present application, the arbitrary door function can also be turned on or turned off through other set gestures or actions.

[0272] For example, the user can turn on the arbitrary door function corresponding to implementation manner 3 by adopting the way of three-finger long pressing the screen, and turn off the arbitrary door function corresponding to implementation manner 3 by adopting the way of three-finger double-clicking the screen.

[0273] For example, the user can turn on the arbitrary door function corresponding to implementation manner 2 by adopting the way of two-finger long pressing the screen, and turn off the arbitrary door function corresponding to implementation manner 2 by adopting the way of two-finger double-clicking the screen.

[0274] It needs to be noted that, the above-mentioned descriptions are only examples for better understanding the technical solutions of the embodiments, and are not the only limitation of the embodiments.

[0275] In the case of opening any door function corresponding to the implementation mode 3, when the user makes a circle selection operation on the screen, such as a knuckle circle operation, the phone can realize screen capture through the intelligent screenshot application and display the circle selection track on the current interface through the system interface application. For details of this implementation, please refer to the following embodiment part for Figure 8A, which will not be described here.

[0276] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. In some embodiments of the present application, these programming interfaces and programming frameworks can be described as functions. As shown in Figure 4, the application framework layer can include an input event framework, a service management framework, an intent framework, an arbitrary door framework, etc.

[0277] The input event framework (Input framework) can include an event hub module (EventHub), an event reading module (InputReader), an event publishing module (InputDispatcher), a circle selection operation recognition module, etc.

[0278] Specifically, in the case of the circle selection operation being a knuckle triggered circle operation, the circle selection operation recognition module can be a knuckle module.

[0279] The EventHub is an event collection and processing service, which can store the Input events reported by the touch screen driver in the process of identifying the circle selection operation, such as the knuckle circle selection operation.

[0280] The InputReader is used to obtain the Input events generated by the touch screen from the EventHub, and call the circle selection operation recognition module (or called: operation recognition module) to determine whether the current touch operation is a circle selection operation based on a preset algorithm. In the embodiments of the present application, for example, the knuckle module is called to determine whether the current touch operation is a knuckle circle selection operation based on the knuckle recognition algorithm.

[0281] The circle selection operation recognition module is further configured to return the recognition result to the InputDispatcher, and the InputDispatcher is configured to determine, according to the recognition result, that the current touch operation is a circle selection operation, and to call a corresponding application, such as a smart screenshot application, a system interface application, etc., to implement a screenshot, display a circle selection track, a fourth selection area, a fifth selection area, etc., and to feed back to the user. In the embodiment of the present application, in the case of a knuckle module, the knuckle module knuckle recognition result is returned to the InputDispatcher, and the InputDispatcher is configured to determine, according to the knuckle recognition result, that the current touch operation is a knuckle circle selection operation, and to call a corresponding application, such as a smart screenshot application, a system interface application, etc., to implement a screenshot, display a circle selection track, a fourth selection area, a fifth selection area, etc., and to feed back to the user.

[0282] In the scenario of opening the arbitrary door function, the input event framework is further configured to, in the case of determining that a circle selection operation is currently occurring, pull up an arbitrary door framework, and then draw a corresponding door opening interface by the arbitrary door framework.

[0283] In the scenario of opening the arbitrary door function, the input event framework is further configured to, in the case of determining that a circle selection operation is currently occurring, transmit information (elements) in the circle selection (or fifth selection area) range corresponding to the circle selection operation to the intent framework, and then identify, by the intent framework, a user intent corresponding to the information.

[0284] After identifying the user intent corresponding to the information, the intent framework can obtain information of a corresponding application and / or service from the service management framework according to the user intent, and feed back the obtained service and / or application information to the arbitrary door framework, and then display, by the arbitrary door framework, the information in an icon area of a current interface.

[0285] As to the interaction logic of the input event framework, the service management framework, the intent framework, and the arbitrary door framework in the information transmission method (realized based on implementation manner 3) provided by the embodiment of the present application, please refer to the following embodiment part for FIG. 8A, which will not be described here in detail.

[0286] In addition, it needs to be noted that the above-mentioned framework located in the application program layer can also be described as a service or a module, etc. For example, the input event framework, the service management framework, the intent framework, and the arbitrary door framework can be described as an input event service, a service management service (or a service manager), an intent service, and an arbitrary door service, etc.

[0287] The Android Runtime includes a core library and a virtual machine. The Android Runtime is responsible for scheduling and management of the Android system.

[0288] The core library includes two parts: one part is the function function called by the java language, and the other part is the core library of Android.

[0289] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform the functions of object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0290] The system library can include a plurality of functional modules. For example: surface manager, media library, three-dimensional (3D) graphics processing library (for example: OpenGL ES), two-dimensional (2D) graphics engine (for example: SGL) and the like.

[0291] The surface manager is used to manage the display subsystem, and provides 2D and 3D layer fusion for multiple applications.

[0292] The media library supports a variety of commonly used audio, video format playback and recording, and static image files and the like. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG and the like.

[0293] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing and the like.

[0294] It can be understood that the 2D graphics engine described above is a drawing engine for 2D drawing.

[0295] The kernel layer is a layer between hardware and software, and includes various hardware drivers and hardware management. As shown in FIG. 4, the kernel layer can include display drivers, sensor drivers, camera drivers, power management drivers and the like.

[0296] The software structure of the electronic device 100 is introduced here, and it can be understood that the layers in the software structure shown in FIG. 4 and the components included in each layer do not constitute a specific limitation of the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer layers than shown, and each layer can include more or fewer components, which are not limited in the present application.

[0297] The following takes the electronic device shown in FIG. 3 and FIG. 4 as a mobile phone as an example, and the information transmission scheme provided by the embodiments of the present application is specifically described in combination with the drawings.

[0298] For ease of illustration, the embodiments of the present application take the scenario that a user uses a knuckle to make a circle selection operation on a screen, raises an arbitrary door service, realizes the selection adjustment of the content to be transmitted, and then transmits the content selected by the circle operation as an example to specifically describe the information transmission scheme based on the implementation manner 3.

[0299] For example, still taking the user interface of a mobile phone as an example, the interface 10d shown in (1) of FIG. 6A displays pictures in a gallery application. In the case where the user opens the arbitrary door function corresponding to the implementation manner 3 as shown in FIG. 5A or FIG. 5C, when the user uses a knuckle to make a circle selection operation on the screen of the mobile phone, such as drawing a circle selection track 10d-2 in the area where the two-dimensional code image element in the picture 10d-1 is located using the knuckle, the mobile phone recognizes that the user has made a circle selection operation, and will respond to the user operation to draw a circle selection box in the area where the two-dimensional code image element is located according to the circle selection track.

[0300] Optionally, the circle selection track drawn by the user using the knuckle can be a closed loop or can not be a closed loop. The specific determination can be based on the knuckle recognition algorithm adopted, which is not limited in the present application.

[0301] Optionally, the drawn circle selection box can be a rectangle.

[0302] Optionally, in some embodiments of the present application, the circle selection box drawn by the mobile phone in response to the circle selection operation is determined based on a layout analysis algorithm. Specifically, for this implementation manner, in the case where it is recognized that the user triggers a circle selection operation in the current interface, a full-screen screenshot of the current interface can be taken first, and then the full-screen screenshot is analyzed based on the layout analysis algorithm to divide the full-screen screenshot into different layout areas (such as image element areas, text paragraph areas, full-screen text information areas, etc.), and determine the relationship between these layout areas. Then, according to the circle selection area corresponding to the circle selection track and the divided layout areas, the coordinate information of the circle selection box is determined. Finally, the circle selection box can be drawn according to the determined coordinate information.

[0303] For example, the coordinate information of the circle selection box is determined based on whether the circle selection area corresponding to the circle selection track is completely contained in a certain divided layout area and the proportion exceeds a certain proportion, such as 50% or 60%, etc. The specific proportion can be set according to business needs, which is not limited in the present application.

[0304] For example, in the case where the circle selection area corresponding to the circle selection track is completely contained in a certain divided layout area, the coordinate information of the layout area can be determined as the coordinate information of the circle selection box to be drawn. In this way, the drawn circle selection box can completely display the elements (or contents) in the layout area.

[0305] For example, in the case that the circle selection region corresponding to the circle selection track is not completely contained in a certain layout region segmented, but intersects with multiple layout regions, the proportion of the circle selection region corresponding to the circle selection track in each layout region having the intersection relationship and the effective overlapping region (such as the overlapping region of a text element or the overlapping region of an image element) of the circle selection region and the intersected layout region can be further analyzed, and the coordinate information of the largest layout region (for example, a layout region combined by multiple layout regions having the intersection relationship) satisfying the set proportion and having the effective overlapping region is determined as the coordinate information of the circle selection box.

[0306] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments. For the convenience of description, the embodiments of the present application are taken as an example of determining the circle selection box based on the layout analysis algorithm.

[0307] Optionally, in some other embodiments of the present application, the mobile phone determines the circle selection box according to the circle selection track in response to the circle selection operation, for example, according to the minimum circumscribed rectangle algorithm. It can be understood that according to the minimum circumscribed rectangle algorithm, the minimum circumscribed rectangle corresponding to the circle selection track is determined as the circle selection box, which ensures that the content displayed in the circle selection box in the subsequent interface is basically the same as the content in the circle selection region selected by the user. In this use scenario, if the user is not satisfied with the content displayed in the circle selection box, the user can manually adjust the circle selection box to change the circle selection content.

[0308] For specific implementation details of determining the minimum circumscribed rectangle according to the minimum circumscribed rectangle algorithm, please refer to the relevant documents, and the present application does not make specific description.

[0309] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0310] Optionally, in some other embodiments of the present application, the mobile phone determines the circle selection box according to the circle selection track in response to the circle selection operation, for example, according to the minimum circumscribed rectangle algorithm and the layout analysis algorithm. Specifically, for this implementation, the mobile phone can first determine the circle selection box displayed in the interface based on the minimum circumscribed rectangle algorithm, and then adjust the size of the circle selection box according to the result of the layout analysis algorithm. For the interface changes involved in this scheme, please refer to the description of the embodiment shown in FIG. 7A below, which is not described here.

[0311] Optionally, in some embodiments of the present application, the phone, in response to the circling operation, determines the circling frame according to the circling track, for example, according to the minimum circumscribed rectangle algorithm, the OCR (Optical Character Recognition) algorithm, or the layout analysis algorithm. Specifically, for this implementation, the phone can first determine the circling frame displayed in the interface based on the minimum circumscribed rectangle algorithm, then perform optical character recognition on the content displayed in the minimum circumscribed rectangle according to the OCR algorithm to determine whether there are characters that are blocked by the minimum circumscribed rectangle, and further adjust the size of the circling frame to the size that does not block the characters according to the result of the layout analysis algorithm when it is determined that there are folded characters. For interface changes related to this scheme, please refer to the description of the embodiment shown in FIG. 7B below, which will not be described here.

[0312] Optionally, in the case where the circling frame capable of containing the complete two-dimensional code image element is drawn according to the circling track 10d-2, the display screen of the phone can first display the interface 20d shown in (2) of FIG. 6A. In the interface 20d, the circling frame 20d-1 in which the two-dimensional code element circled by the user is displayed is framed with a dashed line (only for illustration, the dashed line is not actually displayed).

[0313] It should be noted that in the embodiments of the present application, the circling frame 20d-1 can be understood as a transition border displayed before the arbitrary door service is pulled up based on the circling operation. That is, the circling frame 20d-1 cannot be adjusted by the user, and in order to improve the user's visual experience, the circling frame 20d-1 can be set with a transition effect, for example, by setting different states of the properties of the border color, width, style, etc. of the circling frame 20d-1, so that the border of the circling frame 20d-1 can change in the display interface 20d.

[0314] In addition, it should also be noted that in the case where it is identified that the user makes a circling operation, that is, the condition for pulling up the arbitrary door service is met, the content in the circling frame 20d-1 can be normally displayed, and the other areas will be blurred or blurred.

[0315] Optionally, after the first set time of the display interface 20d, the display screen of the phone can display the interface 30d shown in (3) of FIG. 6A. In the interface 30d, the circling frame 30d-1 in which the two-dimensional code element circled by the user is displayed.

[0316] It should be noted that in the embodiments of the present application, the circling frame 30d-1 is also a circling frame drawn according to the circling track 10d-1, and cannot be adjusted by the user. Unlike the circling frame 20d-1, the circling frame 30d-1 is not set with a transition effect, that is, the border color, width, style, etc. of the circling frame 30d-1 are fixed and unchanged during the display of the interface 30d.

[0317] Optionally, the first set time is, for example, 1 second, or several hundred milliseconds. The first set time can be determined according to the performance of the electronic device, such as the time required for pulling up the arbitrary door service and / or the time required for identifying the content in the selected track area, and the like, which is not limited in the present application.

[0318] Optionally, during the display of the interface 30d, a scanning effect can be set on the selected track 30d-1 to improve the user experience. For example, a scanning line or a scanning frame that can move up and down is set on the selected track 30d-1 to simulate the scanning effect, so that the user interface is more lively and interesting. For example, the interface 40d shown in (4) of FIG. 6A, a moving scanning frame 30d-2 is set on the selected track 30d-1.

[0319] Optionally, in some embodiments of the present application, after the arbitrary door service is pulled up and the information of the application and / or service that needs to be displayed in the icon area is received, the display screen of the mobile phone can display the interface 50d shown in (5) of FIG. 6A. The interface 50d can include a display element 50d-1, an icon area 50d-2, a selected track 50d-3, a text selection control 50d-4, an editing control 50d-5, a save control 50d-6, and the like.

[0320] It should be noted that in the embodiments of the present application, the selected track 50d-3 is also a selected track drawn according to the selected track 10d-1. Unlike the selected track 20d-1 and the selected track 30d-3, the selected track 50d-3 is a selected track that can be adjusted by the user. In this way, the selected track 50d-3 is displayed only after the arbitrary door service is pulled up and the information of the application and / or service that needs to be displayed in the icon area is received, so as to ensure that the icons of the application and / or service displayed in the icon area are the icons of the application and / or service that match the selected track 50d-3.

[0321] Continuing to refer to (5) of FIG. 6A, the elements displayed in the display element 50d-1 can be the same as the elements displayed in the interface 10d. In some embodiments of the present application, the display element 50d-1 can be understood as a three-dimensional transformed interface of the interface 10d. In the interface 50d, the display element 50d-1 can create a visual effect that the original interface (i.e., the interface 10d) is pushed inward.

[0322] In some other embodiments of the present application, the display element 50d-1 can also be understood as the interface 10d without three-dimensional transformation. That is, the interface 50d does not have the door opening effect, and the icon area 50d-2 is directly displayed on the upper layer of the display element 50d-1.

[0323] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments. For ease of illustration, the embodiments of the present application take the display element 50d-1 opening the door effect processing as an example.

[0324] Optionally, in some embodiments of the present application, in the interface 50d, the background 50d-7 behind the display element 50d-1 can be set as the resulting picture after superimposing the blur effect on the desktop background (i.e. the desktop wallpaper) of the mobile phone.

[0325] Continuing to refer to (5) in FIG. 6A, the icon area 50d-2 can be used to display one or more application and / or service icons, for example.

[0326] Optionally, in some embodiments of the present application, the application and / or service icons displayed in the icon area 50d-2 can be the application and / or service icons obtained by the intent framework performing intent recognition processing on the selected elements, such as the content in the picture held by the user, and then performing service matching processing according to the recognized user intent, and the application and / or service icons selected by the user through the provided custom application and / or service entry. That is, the icon area 50d-2 displays the application and / or service icons determined according to the two ways.

[0327] Optionally, in some embodiments of the present application, the application and / or service icons displayed in the icon area 50d-2 can be the application and / or service icons obtained by the intent framework performing intent recognition processing on the selected elements, such as the content in the picture held by the user, and then performing service matching processing according to the recognized user intent. For this implementation, the application and / or service icons displayed in the icon area 50d-2 can be different when the selected elements are different. That is, the application and / or service icons displayed in the icon area 50d-2 change with the change of the selected elements in the selection frame 50d-3.

[0328] Optionally, in some embodiments of the present application, the application and / or service icons displayed in the icon area 50d-2 can be only the application and / or service icons selected by the user through the provided custom application and / or service entry. For this implementation, the same application and / or service icons (the application and / or service icons selected by the user through the custom application and / or service entry) will be displayed in the icon area 50d-2 regardless of whether the selected elements are the same.

[0329] Optionally, in some embodiments of the present application, the application and / or service icons displayed in the icon area 50d-2 can be the application and / or service icons with a use frequency greater than a certain threshold.

[0330] Optionally, in some embodiments of the present application, the icons of the applications and / or services displayed in the icon area 50d-2 can be the icons of all the applications installed in the mobile phone and the icons of the services provided by the applications.

[0331] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0332] Continuing to refer to (5) in FIG. 6A, for example, after the text circle selection control 50d-4 is clicked by the user, the mobile phone will trigger a text recognition operation in response to the user operation, and then automatically adjust the circle selection box 50d-3 (such as the position, size, shape, etc. of the circle selection box 50d-3) according to the recognized text. For the description of this use scenario, see the description of FIG. 6C in the following embodiments, which is not described here in detail.

[0333] Continuing to refer to (5) in FIG. 6A, for example, after the edit control 50d-5 is clicked by the user, the mobile phone will display an edit interface in response to the user operation, so that the user can complete the editing of the content of the circle selection in the edit interface. For the description of this use scenario, see the description of FIG. 6D in the following embodiments, which is not described here in detail.

[0334] Continuing to refer to (5) in FIG. 6A, for example, after the save control 50d-6 is clicked by the user, the mobile phone will save the two-dimensional code element displayed in the circle selection box 50d-3 in response to the user operation. That is, the information transmission scheme provided in the embodiments of the present application can not only realize the lifting of the content displayed in the current interface based on the circle selection operation, and then realize the cross-application transmission of the lifted content by dragging the lifted content to the target application icon or the target service icon, or by clicking the target application icon or the target service icon, but also can meet the user's demand for screenshot using the knuckle circle selection operation.

[0335] Continuing to refer to (5) in FIG. 6A, for example, the four corners of the circle selection box 50d-3 and the upper, lower, left and right frames can display adjustment bars (Bars). The user can drag these Bars to adjust the circle selection box 50d-3, and then adjust the elements of the circle selection.

[0336] Continuing to refer to FIG. 6A, (5), an example is shown in which the user adjusts the circle selection box 50d-3 by dragging the bar on the top border of the circle selection box 50d-3. When the user drags the bar on the top border of the circle selection box 50d-3 to select the text elements, such as "Zhang San" and "130***********1234", in the picture 10d-1, the user interface of the mobile phone displays the interface 60d shown in FIG. 6A, (6). That is, the circle selection box 50d-3 becomes the circle selection box 60d-2.

[0337] It should be noted that, in the embodiments of the present application, the circle selection box 60d-2 is a circle selection box that can be adjusted by the user. Thus, before sharing the content displayed in the circle selection box 60d-2, the user can also adjust the circle selection box 60d-2 as needed to change the content to be shared.

[0338] In addition, it should be noted that, in some embodiments of the present application, during the process in which the user drags (it can be understood as: recognizing a down event and a part of a move event, that is, recognizing an event in which the user's finger clicks the screen and moves on the screen) any one of the bars displayed on the circle selection box 50d-3, the display element 50d-1 slightly turns right to perform a micro-closing door animation and becomes the display element 60d-1, and the icon area 50d-2 is hidden (that is, not displayed).

[0339] In addition, it should be noted that, in some embodiments of the present application, during the process in which the user drags (it can be understood as: recognizing a down event and a part of a move event, that is, recognizing an event in which the user's finger clicks the screen and moves on the screen) any one of the bars displayed on the circle selection box 50d-3, the display element 50d-1 slightly turns right to perform a micro-closing door animation and becomes the display element 60d-1, and the icon area 50d-2 is hidden (that is, not displayed).

[0340] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0341] It should be noted that, in the embodiments of the present application, the micro-closing door animation and the opening door animation both refer to the visual effect of pushing the display element in the current interface inward. The difference is that the angle of the display element pushed inward in the opening door animation is greater than the angle of the display element pushed inward in the micro-closing door animation.

[0342] In addition, it should be noted that, in the process of adjusting the circle selection box by the user, the text circle selection control and the editing control can also be hidden, so as to avoid the text circle selection control or the editing control being mistakenly touched in the process of dragging the bar of the circle selection box.

[0343] For example, as shown in FIG. 6B (1), after the user finishes adjusting the selection box 50d-3, for example, adjusts the selection box 50d-3 to the selection box 60d-2, and lifts the hand, the user interface of the mobile phone displays the interface 70d shown in FIG. 6B (2) in response to the user operation. That is, the display element 60d-1 in the interface 60d continues to push inwards, re-creates the opening door effect, and becomes the display element 70d-1 in the interface 70d. After re-creating the opening door effect, the icon area 70d-2 is also displayed in the interface 70d.

[0344] For example, as shown in FIG. 6B (1), after the user finishes adjusting the selection box 50d-3, for example, adjusts the selection box 50d-3 to the selection box 60d-2, and lifts the hand, the user interface of the mobile phone displays the interface 70d shown in FIG. 6B (2) in response to the user operation. That is, the display element 60d-1 in the interface 60d continues to push inwards, re-creates the opening door effect, and becomes the display element 70d-1 in the interface 70d. After re-creating the opening door effect, the icon area 70d-2 is also displayed in the interface 70d.

[0345] In addition, it should be noted that the selection box 70d-3 displayed in the interface 70d can be understood as the selection box 60d-2 in the interface 60d, that is, the selection box 70d-3 is a selection box that can be adjusted by the user. Therefore, before sharing the content displayed in the selection box 70d-3, the user can also adjust the selection box 70d-3 as needed, thereby changing the content to be shared.

[0346] In addition, it should be noted that the text selection control 70d-4, the editing control 70d-5, and the saving control 70d-6 displayed in the interface 70d have the same functions as the text selection control 50d-4, the editing control 50d-5, and the saving control 50d-6 described in the above embodiments, which will not be described herein again.

[0347] For example, as shown in FIG. 6B (1), after the user finishes adjusting the selection box 50d-3, for example, adjusts the selection box 50d-3 to the selection box 60d-2, and lifts the hand, the user interface of the mobile phone displays the interface 70d shown in FIG. 6B (2) in response to the user operation. That is, the display element 60d-1 in the interface 60d continues to push inwards, re-creates the opening door effect, and becomes the display element 70d-1 in the interface 70d. After re-creating the opening door effect, the icon area 70d-2 is also displayed in the interface 70d.

[0348] For example, as shown in FIG. 6B (1), after the user finishes adjusting the selection box 50d-3, for example, adjusts the selection box 50d-3 to the selection box 60d-2, and lifts the hand, the user interface of the mobile phone displays the interface 70d shown in FIG. 6B (2) in response to the user operation. That is, the display element 60d-1 in the interface 60d continues to push inwards, re-creates the opening door effect, and becomes the display element 70d-1 in the interface 70d. After re-creating the opening door effect, the icon area 70d-2 is also displayed in the interface 70d.

[0349] Referring to (3) in FIG. 6B, the interface 80d may, for example, include a display element 80d-1 and a floating window 80d-2.

[0350] In this case, the element displayed in the display element 80d-1 may be the same as the element displayed in the interface 10a.

[0351] In this case, the floating window 80d-2 may include a menu bar 80d-3 and a display area 80d-4.

[0352] Referring to (3) in FIG. 6B, the menu bar 80d-3 may, for example, include a maximize control 80d-31, a minimize control 80d-32, and a close control 80d-33.

[0353] In this case, when the user clicks the maximize control 80d-31, the mobile phone displays the floating window 80d-2 in full screen, for example, on the entire display screen, in response to the user operation. In this case, the maximize control 80d-31 is not displayed in the menu bar 80d-3, and a restore control is displayed instead.

[0354] Understandably, when the user clicks the restore control, the mobile phone displays the floating window 80d-2 in the style displayed in the interface 80d in response to the user operation.

[0355] In this case, when the user clicks the minimize control 80d-32, the mobile phone hides the floating window 80d-2 in response to the user operation. In this case, in some embodiments of the present application, a smaller floating ball may be displayed on the side edge of the current interface. In this way, the current interface is less obscured, and the floating window 80d-2 can be restored to the style displayed in the interface 80d when the user clicks the floating ball.

[0356] In this case, when the user clicks the close control 80d-33, the mobile phone closes the floating window 80d-2 in response to the user operation.

[0357] Optionally, in some embodiments of the present application, when the user clicks the close control 80d-33 to close the floating window 80d-2, the display interface of the mobile phone may display the previous interface of the current interface, such as the display interface 70d.

[0358] Optionally, in some embodiments of the present application, when the user clicks the close control 80d-33 to close the floating window 80d-2, the display interface of the mobile phone may display the original interface, such as the interface 10a.

[0359] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0360] The display area 80d-4 displays the interface of the application or service corresponding to the icon selected by the user. For example, when the user selects the icon 70d-7, the display area 80d-4 displays the interface of the "friends" application, such as the interface for selecting a chat object (e.g., the interface 30a described in the above embodiment).

[0361] Continuing to refer to FIG. 6B (3), for example, when the user clicks the chat object "Petter" displayed in the display area 80d-4, the phone displays the interface 90d shown in FIG. 6B (4) in response to the user operation. The interface 90d can include the sending editing interface 90d-1 and all elements in the interface 80d.

[0362] Referring to FIG. 6B (4), for example, the sending editing interface 90d-1 can be located above all elements included in the interface 80d.

[0363] Referring to FIG. 6B (4), for example, the sending editing interface 90d-1 can include the avatar of the chat object selected from the display area 80d-4, the name, the picture 90d-11 taken from the selected area in the selection frame 70d-3, the message box 90d-12, the cancel control, and the sending control 90d-13.

[0364] For example, after the user clicks the sending control 90d-13, the phone sends the picture 90d-11 (or the element selected in the selection frame 70d-3) to the friend "Petter" in response to the user operation.

[0365] It should be understood that the above description is only an example for better understanding the technical solution of the embodiment and is not the only limitation of the embodiment.

[0366] In addition, it should be noted that in another embodiment of the present application, when sharing the element selected in the selection frame 70d-3, the element in the selection frame 70d-3 can also be dragged to the icon of the corresponding application and / or service in the icon area to realize cross-application transmission of the element in the selection frame 70d-3 through the application or service corresponding to the icon.

[0367] In addition, it should be noted that in the actual use scenario, the change process of the user interface from the interface 10d to the interface 50d, i.e., from the user making the selection operation on the screen to pulling up the arbitrary door service and displaying the icon area, is usually completed in a short time, such as a few seconds, or a few hundred milliseconds, or even a few tens of milliseconds, and the user does not need to wait for a long time. In this process, the user interface sequentially presents the animation effects of the interface 10d, the interface 20d, the interface 30d, and the interface 40d, and thus is more lively and interesting.

[0368] Optionally, in some embodiments of the present application, when the user interface of the mobile phone displays the interface 40d shown in (4) of FIG. 6A, and the interface 40d displays the second set time, the current interface, such as the interface 40d, can not display the scanning frame 30d-2, and the displayed circle selection frame 30d-1 becomes the circle selection frame 50d-3.

[0369] Optionally, the second set time can be the same as the first set time, or can be different from the first set time.

[0370] It should be noted that in the embodiments of the present application, when the interface 40d displays the second set time, the arbitrary door service can be pulled up or can not be pulled up, and can receive the information of the application and / or service that needs to be displayed in the icon area or can not receive the information of the application and / or service that needs to be displayed in the icon area. That is, after the second set time is displayed, whether the arbitrary door service is pulled up or not, whether the information of the application and / or service that needs to be displayed in the icon area is received or not, the circle selection frame 50d-3 can be displayed in the user interface, and the scanning frame 30d-2 and the circle selection frame 30d-1 are not displayed. In this way, when the interface 50d is not displayed, the user can adjust the display of the circle selection frame 50d-3 according to the needs. For this use scenario, before the interface 50d is displayed, the mobile phone can reacquire the information of the matched application and / or service according to the elements selected by the adjusted circle selection frame, and after receiving the information of the application and / or service that needs to be displayed in the icon area, the interface 50d is displayed. Understandably, in this case, the icons of the application and / or service displayed in the icon area 50d-2 of the interface 50d are the icons of the application and / or service matched with the elements selected by the adjusted circle selection frame.

[0371] In addition, it should be further noted that the circle selection frame that cannot be adjusted by the user in the embodiments of the present application can be understood as that the size, shape and position of the circle selection frame cannot be adjusted, that is, after the interface is displayed, the size, shape and position of the circle selection frame are fixed and cannot be changed. The circle selection frame that can be adjusted by the user can be understood as that the size, shape and position of the circle selection frame can be adjusted, that is, after the interface is displayed, the user can change the size, shape and position of the circle selection frame by dragging or other ways.

[0372] Thus, after any door service is pulled up by a circle selection operation such as a finger joint circle selection operation, the user can adjust the circle selected element by dragging the Bar provided on the circle selection box (e.g., circle selection box 50d-2) displayed in the user interface. In this way, the element to be shared can be extracted from the entire picture by simple human-computer interaction operations such as a circle selection operation and a Bar dragging operation, and the entire process does not need to be frequently switched between interfaces, greatly improving the user experience.

[0373] In addition, since the content of the circle selection is captured after any door service is pulled up based on the circle selection operation, the content of the circle selection can be transmitted across applications based on the third implementation manner even if the content in the current interface cannot be pulled up. Moreover, based on this implementation manner, the shared content has no watermark, thus facilitating the user to further process the shared content.

[0374] In addition, during the adjustment of the circle selection box by the user, the display element in the current interface is slightly turned right, a micro-door closing effect is performed, and the icon area is hidden. After the user completes the adjustment of the circle selection box, the display element in the current interface is re-opened, and the icon area is displayed after being refreshed based on the element selected in the adjusted circle selection box. In this way, the user can select the element to be transmitted according to the actual demand, and the icon area can display more appropriate icons of the application and / or service, thus better meeting the user demand.

[0375] The following describes the use scenario of the text circle selection control and the editing control after being triggered in combination with the accompanying drawings.

[0376] Referring to FIG. 6C, an example is shown to illustrate the user interface change after the text circle selection control is clicked by the user.

[0377] Referring to (1) in FIG. 6C or (2) in FIG. 6B, in an example, when the text circle selection control 70d-4 is clicked by the user, the phone will perform text recognition processing in response to the user operation, and display the interface 100d shown in (2) in FIG. 6C. That is, the display element 70d-1 is slightly turned right, a micro-door closing effect is performed, and becomes the display element 100d-1, the icon area 70d-2, the text circle selection control 70d-4, the editing control 70d-5, and the save control 70d-6 are hidden. Moreover, when the interface 100d is displayed, the circle selection box 70d-3 becomes the circle selection box 100d-2.

[0378] It should be noted that in the embodiments of the present application, the marquee 100d-2 can have the same size, shape, and position as the marquee 70d-3 displayed on the display screen of the mobile phone. The difference is that the marquee 100d-2 is a marquee that cannot be adjusted by the user, and a scanning animation can be set on the marquee 100d-2 to improve the user experience. For example, the interface 100d shown in (2) of FIG. 6C, a moving scanning marquee 100d-3 is set on the marquee 100d-2.

[0379] In addition, it should also be noted that after the text recognition process is completed on the content selected in the marquee 70d-3, if a text element is recognized, the user interface of the mobile phone will display the interface 110d shown in (3) of FIG. 6C. That is, the display element 100d-1 in the interface 100d continues to push inwards, re-creating the opening door animation and becoming the display element 110d-1 in the interface 110d. After re-creating the opening door animation, the icon area 110d-2, the text marquee control 110d-4, the editing control 110d-5, the save control 110d-6, and the marquee 110d-3 of the text element recognized by the marquee are also displayed in the interface 110d.

[0380] It should be noted that in the embodiments of the present application, the marquee 110d-3 is a marquee that can be adjusted by the user.

[0381] It can be understood that since the element selected in the marquee 110d-3 is different from the element selected in the marquee 70d-3, that is, the selected element has changed, the icons displayed in the icon area 110d-2 can also be different from those displayed in the icon area 70d-2. For example, in the case where the element selected in the marquee 70d-3 includes a text element and an image element, the icons displayed in the icon area 70d-2 can include icons such as "phone", "message", "scan", "moments", "notes", and "network disk". In the case where the element selected in the marquee 110d-3 only includes a text element, the icons displayed in the icon area 110d-2 can include icons such as "phone", "message", "friends", "notes", and "network disk".

[0382] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments. In actual use, the icons displayed in the icon area can be customized by the user according to the provided entry, can be matched by intent recognition and service, or can be determined by a combination of various implementation manners. Details are not described here, and specific implementations can be referred to the description part of the above embodiments.

[0383] Therefore, by one-key operation of the text circle selection control, the user does not need to manually adjust the range of the circle selection frame, and the circled elements can be automatically adjusted, which reduces the number of human-computer interactions and enables the user's demand to be met faster and more accurately.

[0384] Referring to FIG. 6D, a schematic diagram of a user interface change after an editing control is clicked by a user is exemplarily shown.

[0385] Referring to FIG. 6D (1), exemplarily, in the case where the user clicks the editing control 50d-4, the display interface of the mobile phone displays the interface 120d shown in FIG. 6D (2) in response to the user operation.

[0386] Referring to FIG. 6D (2), exemplarily, the interface 120d can be understood as an editing interface of the circled elements in the circle selection frame 50d-3. In the interface 120d, the circle selection frame 120d-1 can be displayed.

[0387] It should be noted that in the embodiments of the present application, the circle selection frame 120d-1 is a circle selection frame that can be adjusted by the user, and the content circled in the circle selection frame 120d-1 is the same as that in the circle selection frame 50d-3.

[0388] Continuing to refer to FIG. 6D (2), exemplarily, a plurality of controls can be displayed in the interface 120d, such as the control 120d-2, the control 120d-3, the control 120d-4, the control 120d-5, and a pen-shaped selection control, a color selection control, a line thickness selection control, a sharing function control, a scribble function control, a mosaic function control, an eraser function control, and a scrolling screenshot function control.

[0389] The control 120d-2 is used to trigger a user interface rollback operation after the user touches. That is, in the case where the user clicks the control 120d-2, the display interface 50d is displayed in response to the user operation.

[0390] The control 120d-3 is used to cancel the user's editing of the image elements in the circle selection frame 120d-1 after the user touches.

[0391] The control 120d-4 is used to restore the user's editing of the image elements in the circle selection frame 120d-1 after the user touches.

[0392] The control 120d-5 is used to save the user's editing of the image elements in the circle selection frame 120d-1 after the user touches, and save the edited picture to the local.

[0393] For example, after the user draws a pen shape in the image elements in the circle selection box 120d-1 using the pen-shaped selection control, as shown in the mark 130d-1 displayed in the interface 130d in (3) of FIG. 6D, the user interface will change from the interface 130d to the interface 140d (as shown in (4) of FIG. 6D) and then to the interface 150d (as shown in (5) of FIG. 6D) using the implementation 2, i.e., the long-press method of the random door service. That is, the image elements in the circle selection box 120d-1 will be copied to generate corresponding thumbnails 140d-1, and the image elements in the circle selection box 120d-1 will be blurred or blurred to be in the style of the image elements 140d-2.

[0394] For example, in the interface 140d, the user drags the thumbnail 140d-1 to the edge of the screen, such as to the right edge of the screen along the arrow direction, and the phone displays the interface 150d shown in (5) of FIG. 6D in response to the user operation (such as the drag operation shown in (4) of FIG. 6D).

[0395] Optionally, in some embodiments of the present application, when the thumbnail 140d-1 is dragged to the right edge of the screen by a distance less than a certain threshold during the user dragging the thumbnail 140d-1 to the arrow direction shown in the interface 140d, the phone will respond to the user operation to raise the random door service and display the interface 150d.

[0396] Referring to (5) of FIG. 6D, for example, in some embodiments of the present application, when the interface 150d is displayed, the user can directly click any icon in the icon area 140-3 displayed in the interface 150d, and then transmit the image elements corresponding to the thumbnail 150d-2 (i.e., the graphical elements 120d-1) through the application or service corresponding to the icon.

[0397] For example, in some embodiments of the present application, the user can also drag the thumbnail 150d-2 to the vicinity of a certain icon displayed in the icon area 150d-3, and then transmit the image elements corresponding to the thumbnail 150d-2 (i.e., the graphical elements 120d-1) through the application or service corresponding to the icon.

[0398] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0399] For the processing involved in the change of the user interface from the interface 130d to the interface 140d and then to the interface 150d, please refer to the description of the implementation 2 in FIG. 2A, which will not be repeated here.

[0400] Thus, by providing the editing control in any interface, such as interface 50d, the user can operate the editing control to directly edit the element circled by the circled box, without the need to save the entire picture or the element circled by the circled box and then find the picture of the element through the gallery application to edit, thereby greatly reducing the number of human-computer interactions and simplifying the complexity of user operation.

[0401] In addition, for the content edited in the editing interface entered through the editing control, the user can directly transmit the content through the target service or application by long-pressing and dragging, so that the transmission of information is more convenient.

[0402] In addition, it should be noted that the information transmission scheme based on implementation manner 3 can be applied to any scenario, that is, the user can make a circled operation on any interface to take a screenshot of the picture displayed on the current screen, so that the scheme can be better applied to various user scenarios.

[0403] Referring to FIG. 7A, a schematic diagram of changes in a user interface in a use scenario in which the circled content is a text element is exemplarily shown.

[0404] Referring to (1) in FIG. 7A, an interface 10e of a learning application is exemplarily shown. The interface 10e includes various elements (such as text elements) and controls (such as a “home page” control, a “self-learning” control, a “member exclusive” control, a “my” control, and the like).

[0405] Continuing to refer to (1) in FIG. 7A, exemplarily, when the user uses the knuckle to make a circled operation on a text area 10e-1 in the interface 10e, the phone responds to the user operation to take a screenshot of the interface 10e (full-screen screenshot) and display a circled track corresponding to the circled operation on the interface 10e.

[0406] Exemplarily, the interface displaying the circled track is, for example, the interface 20e shown in (2) in FIG. 7A, which displays a circled track such as circled track 20e-1.

[0407] Exemplarily, in some embodiments of the present application, the phone can first determine a minimum circumscribed rectangle corresponding to the circled track 20e-1 based on a minimum circumscribed rectangle algorithm, and display the determined minimum circumscribed rectangle on the user interface of the phone, such as the interface 30e shown in (3) in FIG. 7A.

[0408] Referring to (3) in FIG. 7A, exemplarily, the interface 30e can include a display element 30e-1, a circled box 30e-2, and a text element 30e-3 displayed in the circled box 30e-2.

[0409] The element displayed in the display element 30e-1 can be the same as the element displayed in the interface 10e. In some embodiments of the present application, the display element 30e-1 can be a picture obtained by performing blur processing or virtualization processing on the full-screen screenshot obtained above.

[0410] The selection frame 30e-2 can be understood as a minimum bounding rectangle corresponding to the selection track 20e-1 determined based on a minimum bounding rectangle algorithm.

[0411] It should be noted that in the embodiments of the present application, the selection frame 30e-2 can be understood as a transition frame that is pulled up based on the selection operation and displayed before the arbitrary door service. That is, the selection frame 30e-2 cannot be adjusted by the user, and in order to improve the user experience, the selection frame 30e-2 can be set with a transition effect, for example, by setting different states of the attributes of the border color, width, style, etc. of the selection frame 30e-2, so that the border of the selection frame 30e-2 can change in the display interface 30e.

[0412] The text element 30e-3 can be understood as a picture cut from the full-screen screenshot according to the coordinate information of the selection frame 30e-2 in the full-screen screenshot.

[0413] Continuing to refer to (3) in FIG. 7A, the user interface of the mobile phone can display the interface 40e shown in (4) in FIG. 7A, for example, after the third specified time of the display interface 30e.

[0414] Optionally, the third specified time is, for example, 1 second or a few hundred milliseconds. The third specified time can be determined according to the performance of the electronic device, such as the time required to pull up the arbitrary door service and / or the time required to identify the content in the selection track area, etc., which is not limited in the present application.

[0415] Referring to (4) in FIG. 7A, the interface 40e can include a display element 40e-1, a selection frame 40e-2, and a text element 40e-3 displayed in the selection frame 40e-2, for example.

[0416] The element displayed in the display element 40e-1 can be the same as the element displayed in the interface 10e. In some embodiments of the present application, the display element 40e-1 can be a picture obtained by performing blur processing or virtualization processing on the full-screen screenshot obtained above.

[0417] The selection frame 40e-2 can also be understood as a minimum bounding rectangle corresponding to the selection track 20e-1 determined based on a minimum bounding rectangle algorithm, and also cannot be adjusted by the user. Unlike the selection frame 30e-2, the selection frame 40e-2 is not set with a transition effect, that is, the border color, width, style, etc. of the selection frame 40e-2 are fixed and unchanged during the display of the interface 40e.

[0418] The elements included in the text element 40e-3 can be the same as the elements included in the text element 30e-3.

[0419] Optionally, during the display of the interface 40e, a scanning effect can be set on the selected area 40e-2 to improve the user experience. For example, a scanning line or a scanning box that can move up and down is set on the selected area 40e-2 to simulate the scanning effect, so that the user interface is more lively and interesting. For example, the interface 50e shown in (5) of FIG. 7A, a moving scanning box 50e-1 is set on the selected area 40e-2.

[0420] It should be noted that, in the embodiments of the present application, during the process of presenting the user interface of the mobile phone from the interface 30e to the interface 50e, the previously intercepted full-screen screenshot can be divided into different layout areas based on the layout analysis algorithm, for example, each icon control is divided into a layout area, all icon controls in a row are divided into a layout area, the text area 10e-2 is divided into a layout area, the mathematical control is divided into a layout area, the Chinese control is divided into a layout area, the text area of the unit ability test is divided into a layout area, and the full-screen screenshot is divided into a layout area, and the present application does not limit this.

[0421] For example, after the division of the layout area is completed, the coordinate information meeting the requirements can be determined based on the selection track 20e-1, such as the coordinate information of the layout area corresponding to the text area 10e-2 containing the complete selection track 20e-1 as the determined coordinate information.

[0422] For example, based on the layout analysis algorithm, the coordinate information of the selected area to be drawn is determined, and in the case that the arbitrary door service is pulled up, the display interface of the mobile phone can display the interface 60e shown in (6) of FIG. 7A. The interface 60e can include a display element 60e-1, a selected area 60e-2, a text element 60e-3 displayed in the selected area 60e-2, an icon area 60e-4, a text selection control 60e-5, an editing control 60e-6, a save control 60e-7, and the like.

[0423] It should be noted that, in the embodiments of the present application, the selected area 60e-2 is a selected area drawn according to the coordinate information determined based on the layout analysis algorithm. Unlike the selected area 40e-2, the selected area 60e-2 is a selected area that can be adjusted by the user. In this way, the selected area 60e-2 is displayed only after the arbitrary door service is pulled up and the coordinate information is determined based on the layout analysis algorithm, so that the icons of the applications and / or services displayed in the icon area are the icons of the applications and / or services that match the text elements selected in the selected area 60e-2.

[0424] In the case that the circled box 60e-2 is drawn according to the coordinate information of the layout area corresponding to the text area 10e-2, the text element 60e-3 displayed in the circled box 60e-2 can be understood as the text element in the text area 10e-2.

[0425] In addition, it should be noted that in some other embodiments of the present application, in the case that the upper edge, the lower edge, the left edge and the right edge of the circled box determined based on the minimum bounding rectangle algorithm and the circled track 20e-1, such as the circled box 40e-2, are blocked by the text elements, when the coordinate information corresponding to the circled box, such as the circled box 60e-2, is determined based on the layout analysis algorithm, the left edge and the right edge of the circled box 40e-2 can be moved outward to the left end and the right end of the line of the circled text elements, and the upper edge and the lower edge of the circled box 40e-2 can be moved outward to the position where the blocked text elements can be completely displayed. Based on this principle, in the case that the circled box determined based on the minimum bounding rectangle algorithm and the circled track 20e-1 is the circled box 40e-2 displayed in the interface 50e, the coordinate information corresponding to the circled box determined based on the layout analysis algorithm is, for example, the coordinate information corresponding to the dashed box 60e-2' in the interface 60e. That is, the circled box finally displayed in the interface 60e is the dashed box 60e-2', not the circled box 60e-2.

[0426] Correspondingly, in the case that the circled box in the interface 60e is the dashed box 60e-2', the text elements displayed in the circled box are the text elements in the dashed box 60e-2' in the interface 60e, i.e., the text elements in the line of "View Unit Knowledge Summary".

[0427] It should be understood that the above description is only an example for better understanding the technical solution of the present embodiment, and is not the only limitation of the present embodiment.

[0428] Continuing to refer to (6) in FIG. 7A, the elements displayed in the display element 60e-1 can be the same as the elements displayed in the interface 10e, for example. In some embodiments of the present application, the display element 60e-1 can be understood as the interface obtained by three-dimensional transformation of the interface 10e or the above-mentioned full-screen screenshot. In the interface 60e, the display element 60e-1 can create a visual effect that the original interface (i.e., the interface 10e) is pushed inward.

[0429] It should be noted that in some other embodiments of the present application, the scenario shown in FIG. 7A can also be similar to the scenario shown in FIG. 6A, and the display element 60e-1 does not need to be opened with a door effect. That is, the icon area 60e-4 can be directly displayed above the display element 60e-1.

[0430] The purposes of the text circle selection control 60e-5, the edit control 60e-6, and the save control 60e-7 are the same as those of the text circle selection control 50d-4, the edit control 50d-5, and the save control 50d-6 in the above-described embodiments, and thus are not described herein again.

[0431] Therefore, in the scenario in which the user uses the circle selection operation to pull up an arbitrary door service, the circle selection frame in the interface displayed at different moments is determined based on the minimum circumscribed rectangle algorithm and the layout analysis algorithm, so that the user experience can be better improved.

[0432] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments. In actual applications, the circle selection and interception of the image element, such as the circle selection frame in the interface displayed at different moments in the scenario shown in FIGS. 6A and 6B, can also be determined based on the minimum circumscribed rectangle algorithm and the layout analysis algorithm, which is not limited in the present application.

[0433] In addition, technical details not described in detail in the embodiments can be referred to the description part of the embodiments shown in FIGS. 6A to 6D, which are not described herein again.

[0434] Referring to FIG. 7B, a schematic diagram of the change of the circle selection frame displayed on the interface according to the circle selection trajectory is exemplarily shown in the scenario of using the circle selection to select a local region in a map picture.

[0435] It should be noted that the map picture selected by the circle selection in the interface of the mobile phone shown in FIG. 7B is only shown, and other elements in the interface are not shown.

[0436] Referring to (1) in FIG. 7B, an interface 10f displaying a map picture is exemplarily shown. In the case where the user uses the knuckle to make a circle selection operation on the interface 10f, the mobile phone responds to the user operation to intercept the interface 10f (full-screen screenshot) and display the circle selection trajectory 10f-1 corresponding to the circle selection operation on the interface 10f.

[0437] Exemplarily, in some embodiments of the present application, the mobile phone can first determine the minimum circumscribed rectangle corresponding to the circle selection trajectory 10f-1 based on the minimum circumscribed rectangle algorithm, and display the determined minimum circumscribed rectangle on the user interface of the mobile phone, such as the interface 20f shown in (2) in FIG. 7B.

[0438] Referring to (2) in FIG. 7B, exemplarily, the interface 20f can include a display element 20f-1, a circle selection frame 20f-2, and an image element 20f-3 displayed in the circle selection frame 20f-2.

[0439] The element displayed in the display element 20f-1 can be the same as the element displayed in the interface 20f. In some embodiments of the present application, the display element 20f-1 can be a picture obtained by performing blur processing or virtualization processing on the full-screen screenshot obtained above.

[0440] The circled box 20f-2 can be understood as a minimum bounding rectangle corresponding to the circled track 20f-1 determined based on a minimum bounding rectangle algorithm.

[0441] It should be noted that in the embodiments of the present application, the circled box 20f-2 can be understood as a transition border raised by the arbitrary door service based on the circled operation. That is, the circled box 20f-2 cannot be adjusted by the user, and in order to improve the user experience, the circled box 20f-2 can be set with a transition effect, for example, by setting different states of the border color, width, style, etc. of the circled box 20f-2, so that the border of the circled box 20f-2 can change in the display interface 20f.

[0442] The image element 20f-3 can be understood as a picture cut from the full-screen screenshot according to the coordinate information of the circled box 20f-2 in the full-screen screenshot.

[0443] Continuing to refer to (2) in FIG. 7B, for example, after the fourth specified time of the display interface 20f, the user interface of the mobile phone can display the interface 30f shown in (3) in FIG. 7B.

[0444] Optionally, the fourth specified time is, for example, 1 second or a few hundred milliseconds. The fourth specified time can be determined according to the performance of the electronic device (such as the time required to raise the arbitrary door service and / or the time required to identify the content in the circled track area, etc.), which is not limited in the present application.

[0445] Referring to (3) in FIG. 7B, for example, the interface 30f can include a display element 30f-1, a circled box 30f-2, and an image element 30f-3 displayed in the circled box 30f-2.

[0446] The element displayed in the display element 30f-1 can be the same as the element displayed in the interface 10f. In some embodiments of the present application, the display element 30f-1 can be a picture obtained by performing blur processing or virtualization processing on the full-screen screenshot obtained above.

[0447] The circled box 30f-2 can also be understood as a minimum bounding rectangle corresponding to the circled track 10f-1 determined based on a minimum bounding rectangle algorithm, and also cannot be adjusted by the user. Unlike the circled box 20f-2, the circled box 30f-2 is not set with a transition effect, that is, the border color, width, style, etc. of the circled box 30f-2 are fixed and unchanged during the display of the interface 30f.

[0448] The element included in the image element 30f-3 can be the same as the element included in the image element 20f-3.

[0449] Optionally, during the display of the interface 30f, a scanning effect can be set on the selected frame 30f-2 to improve the user experience. For example, a scanning line or a scanning frame that can move up and down is set on the selected frame 30f-2 to simulate the scanning effect, so that the user interface is more lively and interesting. For example, as shown in (3) of FIG. 7B, the selected frame 30f-2 is provided with a moving scanning frame 30f-4.

[0450] It should be noted that, in the embodiments of the present application, during the process of presenting the user interface of the mobile phone from the interface 10f to the interface 30f, whether the smallest circumscribed rectangle (for example, the selected frame 20f-2 or the selected frame 30f-2) displayed in the interface blocks the character can be determined based on the OCR algorithm.

[0451] Continuing to refer to (3) of FIG. 7B, for example, there are characters that are folded by the frame of the selected frame 30f-2 in the interface 30f, such as the park, the bus stop P4, the taxi stop P5, the bus stop P1, and the taxi stop P3. For this case, when the selected frame is determined based on the layout analysis algorithm, the above-mentioned principle (enlarging the selected frame to a size that can completely display the folded characters) needs to be followed, and the selected frame 30f-2 is enlarged to the selected frame 40f-2 in the interface 40f shown in (4) of FIG. 7B. In this way, the image element 40f-3 displayed in the selected frame 40f-2 includes the characters of the park, the bus stop P4, the taxi stop P5, the bus stop P1, and the taxi stop P3 that are completely displayed.

[0452] In addition, it should be noted that the elements displayed in the display element 40f-1 included in the interface 40f can be the same as the elements displayed in the interface 10f.

[0453] Therefore, in the scenario where the user uses the selection operation to pull up any door service, the selected frame in the interface displayed at different times is determined based on the minimum circumscribed rectangle algorithm, the OCR algorithm, and the layout analysis algorithm, which can not only ensure that the selected frame that can be adjusted by the user and finally displayed in the interface can completely display the content selected by the user, but also avoid that the selected frame is too large, thereby better improving the user experience.

[0454] In addition, technical details not described in detail in the embodiments can be referred to the description of the embodiments shown in FIGS. 6A to 6D, which will not be described here again.

[0455] The following takes the scenario shown in FIG. 6A and FIG. 6B as an example to introduce the interaction processing logic of each framework in the information transmission method based on implementation 3 in detail.

[0456] Referring to FIG. 8A, an information transmission method provided by an embodiment of the present application is exemplarily shown.

[0457] It should be noted that before implementing the information transmission method provided by the embodiment shown in FIG. 8A, any door function corresponding to implementation 3 needs to be opened in the manner shown in FIG. 5A or FIG. 5B.

[0458] Exemplarily, in the case where any door function corresponding to implementation 3 is opened, the information transmission method provided by the embodiment shown in FIG. 8A specifically includes:

[0459] S101, the input event framework identifies the current received user operation in response to the user operation.

[0460] Specifically, in the embodiment of the present application, after receiving the user operation, the identification processing of the received user operation by the input event framework is specifically identifying whether the user operation is a circle selection operation.

[0461] Exemplarily, in the embodiment of the present application, the circle selection operation is, for example, an operation triggered by the user using the knuckle (knuckle circle selection operation). In this case, the input event framework identifying whether the current operation is a circle selection operation is specifically a knuckle framework.

[0462] Specifically, the knuckle framework can identify the user operation according to a knuckle identification algorithm, and then determine whether the current received user operation is a knuckle circle selection operation. For the knuckle framework, the specific implementation logic of identifying whether the current received user operation is a knuckle circle selection operation can be referred to the related documents of the knuckle identification algorithm, and the embodiment of the present application does not make specific description here.

[0463] Continuing to refer to FIG. 8A, exemplarily, in the case where it is determined that the current received user operation is a circle selection operation, the knuckle framework instructs the any door framework to pull up the any door service (the process corresponding to the any door service can be referred to as the any door service process), and the operation of drawing the any door interface (such as the interface 10d to the interface 50d in FIG. 6A) is implemented by the any door framework (or the any door service process), and the smart screenshot application is notified to take a full-screen screenshot of the current interface.

[0464] S102, in the case where it is determined that the current received user operation is a circle selection operation, the smart screenshot application takes a screenshot of the current interface in response to the notification of the input event framework, and obtains a full-screen screenshot corresponding to the current interface.

[0465] S103, in the case of determining that the current received user operation is the circle selection operation, the arbitrary door framework responds to the notification of the input event framework, pulls up the arbitrary door service process, and creates the activity corresponding to the arbitrary door interface.

[0466] It should be noted that all operations in the activity are closely related to the user, and the activity is a component responsible for interacting with the user. The specified control can be displayed through the corresponding interface (such as the interface for setting the content view, setcontentview (View)). For details of the use of the activity, see the description of the activity in the Android Application Programming Interface (API) document, and the present application embodiment does not make a specific description.

[0467] In addition, it should be noted that when the arbitrary door service process is pulled up and the activity corresponding to the arbitrary door interface is created, an external interface can be exposed, such as an external interface for interacting with the intent framework and an external interface for interacting with the intelligent screenshot application. In this way, the arbitrary door framework can interact with the intelligent screenshot application through the exposed external interface, transmit the circle selection trajectory corresponding to the circle selection operation, and obtain the first screenshot picture intercepted by the intelligent screenshot application according to the circle selection trajectory. And interact with the intent framework, transmit the first screenshot picture, obtain the information of the application and / or service that needs to be displayed in the icon area, the parameters of the call, etc.

[0468] S104, the arbitrary door framework draws the circle selection trajectory in the activity corresponding to the arbitrary door, and sends the coordinate information of the drawn circle selection trajectory to the intelligent screenshot application.

[0469] For example, in some embodiments of the present application, the arbitrary door framework can call the system interface application, for example, to draw the circle selection trajectory corresponding to the circle selection operation in the activity corresponding to the arbitrary door interface according to the coordinate information of the circle selection operation collected by the sensor, such as the touch sensor. For example, the circle selection trajectory 10d-2 in the interface 10d shown in (1) of FIG. 6A. That is, when the user makes a knuckle circle selection operation on the mobile phone screen, the circle selection trajectory corresponding to the circle selection operation will be drawn according to the movement of the user's knuckle on the current interface, that is, the user interface will display the circle selection trajectory 10d-2 in the interface 10d.

[0470] S105, the intelligent screenshot application determines the first coordinate information of the circle selection frame according to the circle selection trajectory and the preset algorithm, and intercepts the first screenshot picture from the full-screen screenshot according to the first coordinate information, and sends the full-screen screenshot, the first coordinate information and the first screenshot picture to the arbitrary door framework.

[0471] Optionally, in some embodiments of the present application, the preset algorithm is, for example, a minimum enclosing rectangle algorithm. For this implementation, the determined first coordinate information includes a set (such as the set of coordinate information drawn by the circle selection box 30e-2 or the circle selection box 40e-2 in FIG. 7A), and the intercepted first screenshot picture includes one (such as the picture corresponding to the text element 30e-3 displayed in the circle selection box 30e-2 or the picture corresponding to the text element 40e-3 displayed in the circle selection box 40e-2).

[0472] Optionally, in some other embodiments of the present application, the preset algorithm is, for example, a layout analysis algorithm. For this implementation, the determined first coordinate information includes a set (such as the set of coordinate information drawn by the circle selection box 60e-2 in FIG. 7A), and the intercepted first screenshot picture includes one (such as the picture corresponding to the text element 60e-3 displayed in the circle selection box 60e-2).

[0473] Optionally, in some other embodiments of the present application, the preset algorithm is, for example, a minimum enclosing rectangle algorithm and a layout analysis algorithm. For this implementation, the determined first coordinate information includes two sets (such as the set of coordinate information drawn by the circle selection box 30e-2 or the circle selection box 40e-2 and the set of coordinate information drawn by the circle selection box 60e-2 in FIG. 7A), and the intercepted first screenshot picture includes two (such as the picture corresponding to the text element 30e-3 displayed in the circle selection box 30e-2 or the picture corresponding to the text element 40e-3 displayed in the circle selection box 40e-2, and the picture corresponding to the text element 60e-3 displayed in the circle selection box 60e-2).

[0474] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0475] For ease of illustration, the embodiments of the present application take the layout analysis algorithm or the minimum enclosing rectangle algorithm as an example, i.e., the determined first coordinate information includes a set, and the intercepted first screenshot picture includes one.

[0476] S106, the intent framework receives the full-screen screenshot, the first coordinate information, and the first screenshot picture sent by the arbitrary door framework, analyzes and processes the first screenshot picture, determines the first user intent, and sends a first information acquisition request to the service management framework according to the first user intent, and acquires the matched first application and / or service information.

[0477] For example, in some embodiments of the present application, the analysis and processing of the first screenshot picture by the intent framework is, for example, analysis and processing based on the computer vision (CV) label analysis technology.

[0478] Specifically, in the process of analyzing and processing the first screenshot picture based on the CV label analysis technology, the CV label analysis technology can be used to identify the region where the text element is located and the region where the image element is located in the first screenshot picture, and add corresponding label information to the text element and the image element, and then perform intent recognition on the text element and the image element in the first screenshot picture according to the label information of the text element and the label information of the image element, and determine the first user intent corresponding to the first screenshot picture.

[0479] In S107, the service management framework queries the first application and / or service information matching the first user intent in response to the first information acquisition request.

[0480] Understandably, the first information acquisition request can carry the first user intent determined by the intent framework according to the first screenshot picture. In this way, after the service management framework receives the first information acquisition request, it can query the first application and / or service information matching the first user intent from the managed applications and / or services according to the first user intent parsed from the first information acquisition request. That is, the information of the application and / or the information of the service matching the first user intent.

[0481] Understandably, in the embodiments of the present application, the information of the application includes, for example, the package name (packageName), version number (versionCode), version name (versionNamer), application program name (applicationLabel), icon (icon), etc. The information of the service includes, for example, the service source (such as from which application), icon, etc.

[0482] Continuing to refer to FIG. 8A, for example, after the service management framework queries the first application and / or service information matching the first user intent, it will feed back the first application and / or service information to the intent framework, so that the intent framework generates the first recommended list.

[0483] In S108, the intent framework generates the first recommended list according to the first application and / or service information fed back by the service management framework, and feeds back the generated first recommended list and the parameter information of each application and / or service in the first recommended list to the arbitrary door framework.

[0484] For example, in some embodiments of the present application, the intent framework can sort the first application and / or service when generating the first recommended list according to the first application and / or service information. For example, according to certain sorting conditions, the order of the icons corresponding to the applications and / or services in the first recommended list is adjusted.

[0485] Optionally, the followed sorting condition can be determined according to the user usage habit (factor 1). For example, the icons of the applications and / or services habitually used by the user are adjusted to the front position in the recommendation list.

[0486] Optionally, the followed sorting condition can be determined according to the usage frequency of the applications and / or services (factor 2). For example, the icons of the applications and / or services with higher usage frequency in the first applications and / or services are adjusted to the front position in the recommendation list.

[0487] Optionally, the followed sorting condition can be determined according to the user-defined whitelist applications and / or services (factor 3). For example, the icons of the applications and / or services belonging to the whitelist in the first applications and / or services are adjusted to the front position in the recommendation list.

[0488] Optionally, the followed sorting condition can be determined according to the usage time length of the applications and / or services (factor 4). For example, the icons of the applications and / or services with longer usage time length in the first applications and / or services are adjusted to the front position in the recommendation list.

[0489] Optionally, the followed sorting condition can also be determined according to any two or more of the above factors 1 to 4.

[0490] It should be understood that the above description is only an example for better understanding the technical solution of the embodiment and is not the only limitation of the embodiment.

[0491] S109, any door frame according to the first coordinate information, according to the first coordinate information, draw the first circle selection box, set the transition effect for the first circle selection box, display the first screenshot picture in the first circle selection box.

[0492] Taking the full-screen screenshot as the interface 10d (i.e. the interface 10a) not including the circle selection track 10d-2, the first screenshot picture as the two-dimensional code image element in the picture 10d-1 as an example, the first circle selection box, for example, is the circle selection box 20d-1 displayed in the interface 20d. The specific effect is shown in the interface 20d.

[0493] It should be understood that the above description is only an example for better understanding the technical solution of the embodiment and is not the only limitation of the embodiment.

[0494] S110, after displaying the first circle selection box for the first setting time, any door frame according to the first coordinate information, draw the second circle selection box, display the scanning dynamic effect on the second circle selection box, and display the first screenshot picture in the second circle selection box.

[0495] The second circle selection box is a non-adjustable circle selection box, for example, the circle selection box 30d-1 displayed in the interface 30d.

[0496] In the second circle selection box, a corresponding interface is displayed after the scanning animation, such as interface 40d.

[0497] In step S112, the arbitrary door framework performs a door opening animation on the full-screen screenshot. According to the first coordinate information, a third circle selection box is drawn on the full-screen screenshot, the first screenshot picture is displayed in the third circle selection box, and the icons of each application and / or service in the first recommended list are displayed in the icon area at the edge of the screen.

[0498] The third circle selection box is an adjustable window, such as the circle selection box 50d-3 shown in interface 50d.

[0499] The icon area is, for example, the icon area 50d-2 shown in interface 50d.

[0500] The full-screen screenshot can be understood as the display element 50d-1 in interface 50d.

[0501] It should be noted that in some embodiments of the present application, the arbitrary door framework can not perform a door opening animation on the full-screen screenshot.

[0502] In addition, it should be noted that the steps S109 and S110 performed by the arbitrary door framework are performed in parallel with the steps S106 to S108 performed by the intent framework and the service management framework, that is, the steps in the two processing operations can not be distinguished in sequence. As long as the first recommended list and the parameters for calling each application and / or service sent by the intent framework are received before the arbitrary door framework performs step S111.

[0503] In step S112, in the case that the user selects any icon in the icon area, the service management framework starts the corresponding application or service according to the parameter information of the selected icon provided by the arbitrary door framework, and uses the started application or service to transmit the first screenshot picture.

[0504] The visible area of the icon area can display N icons by default, that is, by default, the user can see at most N icons in the icon area. For scenarios exceeding N icons, the user can view the icons corresponding to the application and / or service information included in the recommended list by sliding the icon area up and down.

[0505] The user can long press the icon in the icon area to move the display position of the icon.

[0506] For example, in some embodiments of the present application, the selection operation on any icon in the icon area is, for example, directly clicking any icon displayed in the icon area, as shown in interface 70d.

[0507] For example, in some embodiments of the present application, the selection operation on any icon in the icon area, such as the user's long press on the first screenshot icon in the third circle selection box, generates the first screenshot picture corresponding to the drag content (such as the thumbnail of the first screenshot picture), and after the user drags the drag content to a certain distance from the edge of the screen, the icon close to the edge is determined as the selected icon by the user, such as the effect shown in interface 80a.

[0508] Therefore, the technical scheme provided by the embodiments of the present application triggers the arbitrary door when the user makes a circle selection operation, and intercepts the elements in the circle selection trajectory corresponding to the circle selection operation, so that the user can conveniently transmit the elements in the circle selection trajectory based on the recommended applications and / or services displayed in the icon area in the current arbitrary door interface.

[0509] Referring to FIG. 8B, another information transmission method provided by an embodiment of the present application is exemplarily shown.

[0510] It should be noted that before implementing the information transmission method provided by the embodiment shown in FIG. 8B, the arbitrary door function corresponding to implementation mode 3 needs to be enabled in the manner shown in FIG. 5A or FIG. 5B.

[0511] For example, in the case of enabling the arbitrary door function corresponding to implementation mode 3, the information transmission method provided by the embodiment shown in FIG. 8B, the method specifically includes:

[0512] S201, the arbitrary door framework performs a door opening animation on the full-screen screenshot, draws a third circle selection box on the upper layer of the full-screen screenshot according to the first coordinate information, displays the first screenshot picture in the third circle selection box, and displays the icons of each application and / or service in the first recommended list in the icon area at the edge of the screen.

[0513] Wherein, step S201 is the same as step S111 in FIG. 8A, and the specific implementation details can be referred to the description part of step S111 described above, which will not be repeated here.

[0514] S202, the arbitrary door framework performs a door closing animation on the full-screen screenshot in the case of receiving the user's adjustment operation on the third circle selection box, hides the icon area, and adjusts the third circle selection box to a fourth circle selection box according to the adjustment operation.

[0515] Wherein, the fourth circle selection box is also an adjustable circle selection box, such as the circle selection box 60d-2 shown in interface 60d.

[0516] S203, after the user ends the adjustment operation on the third circle selection box, the arbitrary door framework sends the coordinate information of the fourth circle selection box displayed in the current interface to the intelligent screenshot application, so that the intelligent screenshot application intercepts a second screenshot picture from the full-screen screenshot according to the coordinate information of the fourth circle selection box.

[0517] Continuing to refer to FIG. 8B, the intelligent screenshot application may, for example, send the second screenshot picture to the arbitrary door framework through any interface exposed to the outside of the arbitrary door framework, so that the arbitrary door framework sends the second screenshot picture to the intent framework.

[0518] In addition, it should be noted that, in the case that the adjustment operation is to reduce the third circle selected region, i.e., the fourth circle selected region is the third circle selected region, the element included in the second screenshot picture is the element in the first screenshot picture.

[0519] In addition, it should be noted that, in the case that the adjustment operation is to enlarge the third circle selected region, i.e., the fourth circle selected region is larger than the third circle selected region (the third circle selected region is a part of the fourth circle selected region), the first element is the element in the full-screen screenshot.

[0520] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0521] S204, after receiving the second screenshot picture, the arbitrary door framework displays the second screenshot picture in the fourth circle selected region.

[0522] It should be noted that the fourth circle selected region is located on the upper layer of the full-screen screenshot. Therefore, before receiving the second screenshot picture, the fourth circle selected region may display the element in the underlying full-screen screenshot.

[0523] S205, the intent framework receives the second screenshot picture sent by the arbitrary door framework, analyzes and processes the second screenshot picture, determines the second user intent, and according to the second user intent, sends a second information acquisition request to the service management framework to acquire the matched second application and / or service information.

[0524] S206, the service management framework responds to the second information acquisition request and queries the second application and / or service information matched with the second user intent.

[0525] S207, the intent framework generates a second recommendation list according to the second application and / or service information fed back by the service management framework, and feeds back the generated second recommendation list and the parameter information of each application and / or service in the second recommendation list to the arbitrary door framework.

[0526] It should be noted that steps S205 to S207 in the embodiments of the present application are similar to steps S106 to S108 in the embodiments shown in FIG. 8A, and the specific implementation details can be referred to the description of steps S106 to S108 in the embodiments shown in FIG. 8A, which will not be repeated here.

[0527] In addition, it should be noted that in the case that the elements included in the first screenshot picture and the second screenshot picture are not the same (not completely the same), the determined user intention can be the same or can not be the same. For the scenario in which the determined user intention is the same, the first recommendation list and the second recommendation list can be the same. For the scenario in which the determined user intention is not the same, the first recommendation list and the second recommendation list are not the same. That is, in the process in which the user adjusts the third selection frame, the application and / or the service displayed in the icon area can be refreshed according to the element actually selected by the user. In this way, more suitable applications and / or services can be provided for the user, and the information transmission function based on the arbitrary door is more convenient and easy to use.

[0528] S208, the arbitrary door framework performs a door opening animation on the full-screen screenshot, and displays an icon of each application and / or service in the second recommendation list in the icon area at the edge of the screen.

[0529] It should be noted that in the embodiment of the present application, when the user adjusts the size of the third selection frame to the fourth selection frame, the arbitrary door service process has been pulled up before step S201, and therefore in the process of performing steps S205 to S207, the operations of steps S109 and S110 in FIG. 8A do not need to be performed again.

[0530] S209, in the case that the user selects any icon in the icon area, the service management framework starts the corresponding application or service according to the parameter information of the selected icon provided by the arbitrary door framework, and uses the started application or service to transmit the second screenshot picture.

[0531] Therefore, the technical scheme provided by the embodiment of the present application, when the user triggers the arbitrary door by performing the selection operation, displays the selection frame in the arbitrary door interface, so that the user can select the information (element) to be transmitted according to the need, and then directly transmits the selected information through the application and / or the service displayed in the icon area (service and / or application recommendation area) in the arbitrary door interface, which is convenient and fast.

[0532] In addition, in the process in which the user adjusts the selection frame, the application and / or the service displayed in the icon area is refreshed, so that more suitable applications and / or services can be provided for the user, and the information transmission function based on the arbitrary door is more convenient and easy to use.

[0533] In some application scenarios, the terminal device such as a mobile phone has increasingly rich functions. For example, a user uses the terminal device to perform cross-application transmission of data, such as transmitting data selected by the user in a first application to a second application. However, when selecting data, the user is prone to misselecting adjacent data, or needs to repeatedly confirm or adjust the selected data, which affects the efficiency of data selection and transmission, and brings more troubles to the user operation, and affects the user experience.

[0534] Referring to (1) in FIG. 9, in a service scenario of starting an arbitrary gate, when the user selects address data "Aaaaaaaaaa", "Bbbbbb", "Cccccc", "Dddddd", "Eee", and "AAAAA" in the operation track 10 through a circle selection operation, data "BBBBBB" near the data "Bbbbbb" and data "AAAAAAAAAA" are also selected. Referring to (3) in FIG. 9, when the user drags the selected screen content to an icon shown in (3) in FIG. 9 to transmit the screen content to an application or a service corresponding to the icon, the data "BBBBBB" and "AAAAAAAAAA" are also shared, which results in poor accuracy of data transmission and affects the user experience.

[0535] Therefore, the embodiment of the present application further provides a data transmission method of an arbitrary gate. In the embodiment, the terminal device monitors whether a tenth operation is performed by the user on a current interface. When it is monitored that the tenth operation is performed by the user, an arbitrary gate service is invoked, and a fourth selection area is displayed on the current interface according to an operation track corresponding to a preset operation. A fifth selection area is determined according to an intersection area of the fourth selection area and a text area in the fourth selection area. An application and / or a service icon displayed on the interface are determined according to content of the fifth selection area. Thus, the data content to be transmitted across applications and the application or the service can be accurately identified. Then, the user can directly reach a shortcut service or an application corresponding to the icon by dragging the content of the fifth selection area to the application and / or the service icon.

[0536] Understandably, in the embodiment of the present application, the tenth operation can be a circle selection operation or a sliding operation. The data transmission method of the embodiment of the present application is described below by taking the tenth operation as the circle selection operation.

[0537] In some embodiments of the present application, the circle selection operation refers to a user operation of circling specific content on a screen. In some embodiments of the present application, the circle selection operation can be a user operation of circling specific content on a screen by using a knuckle of a finger.

[0538] In some embodiments of the present application, the circle selection operation refers to a user operation of circling specific content on a screen. In some embodiments of the present application, the circle selection operation can be a user operation of circling specific content on a screen by using a knuckle of a finger.

[0539] In some embodiments of the present application, the circle selection operation can also be a user operation on the screen using an external device such as a stylus, a mouse, etc.

[0540] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0541] In some embodiments of the present application, the selection area range is determined by the circle selection operation, and the opening, closing, etc. of the transmission function of the data in the selection area range based on the arbitrary gate can be realized by setting the function entry provided in the application.

[0542] Referring to FIG. 10, a user interface schematic diagram for opening or closing the function of the arbitrary gate provided by the setting application in an embodiment of the present application is shown.

[0543] Taking a mobile phone as an example of a terminal device, referring to (1) in FIG. 10, a user interface of a mobile phone is exemplarily shown, such as interface 10g. Among them, the interface 10g displays icons of a plurality of application programs, such as an icon 10g-1 of a setting application, and icons of applications such as information (short message application), telephone, gallery, camera, clock, calendar, memo, music, file management, video, calculator, weather, email, sound recorder, browser, etc.

[0544] In some embodiments of the present application, the interface 10g shown in (1) in FIG. 10 can be the main interface of the terminal device (for example, a mobile phone).

[0545] Continuing to refer to (1) in FIG. 10, exemplarily, in the case that the user clicks the icon 10g-1 of the setting application, the mobile phone starts the setting application in response to the user operation (such as a click operation / touch operation), and displays the setting interface corresponding to the setting application, such as the interface 20g shown in (2) in FIG. 10.

[0546] Referring to (2) in FIG. 10, exemplarily, the interface 20g displays a plurality of setting function entries, which can also be setting options or setting controls. For example, a setting entry 20g-1 of a smart assistant function, and setting entries of functions such as WLAN, Bluetooth, mobile network, more connections, desktop and personalization, display and brightness, sound and vibration, notification and status bar, etc.

[0547] The smart assistant in the embodiments of the present application can be understood as an intelligent assistant integrating a plurality of functions, aiming to provide a convenient living and working environment for the user. In some embodiments of the present application, the smart assistant can be referred to as "YOYO".

[0548] With reference back to (2) in FIG. 10, illustratively, in a case where the user clicks the setting entry 20g-1 of the smart assistant function, the phone displays a setting interface corresponding to the smart assistant function in response to the user operation, as shown in the interface 30g in (3) in FIG. 10.

[0549] With reference to (3) in FIG. 10, illustratively, a plurality of controls are displayed on the interface 30g, such as a setting entry 30g-1 of the random door function, and setting entries of functions such as YOYO suggestion, YOYO assistant, smart vision, mid-air gesture, and smart perception.

[0550] In a case where the user clicks the setting entry 30g-1 of the random door function, the phone displays a setting interface corresponding to the random door function in response to the user operation, as shown in the interface 40g in (4) in FIG. 10.

[0551] With reference to (4) in FIG. 10, illustratively, the interface 40g can include a control 40g-1 corresponding to the random door function, and a control 40g-2 corresponding to the knuckle ring opening function. The control 40g-1 corresponds to a function of raising the random door service by a long press operation (hereinafter referred to as implementation mode 4). The control 40g-2 corresponds to a function of raising the random door service by a knuckle ring selection operation (hereinafter referred to as implementation mode 5). In other embodiments of the present application, the implementation mode 5 can also correspond to a function of raising the random door service by a knuckle ring selection operation or a sliding operation, which is not limited in the present application.

[0552] With reference back to (4) in FIG. 10, the user clicks the control 40g-1, and the phone starts the random door function corresponding to the implementation mode 4 in response to the user operation, and displays the interface 50g shown in (5) in FIG. 10, i.e., the switch of the random door function corresponding to the implementation mode 4, and the style of the control 40g-1 is switched to the style of the control 40g-1'.

[0553] Understandably, in a case where it is necessary to close the random door function corresponding to the implementation mode 4, the user clicks the control 40g-1', and the phone closes the random door function corresponding to the implementation mode 4 in response to the user operation, and displays the interface 40g, i.e., the switch of the random door function corresponding to the implementation mode 4, and the style of the control 40g-1' is switched back to the style of the control 40g-1.

[0554] With reference back to (4) in FIG. 10, if the user clicks the control 40g-2, the phone starts the random door function corresponding to the implementation mode 5 in response to the user operation, and displays the interface 60g shown in (6) in FIG. 10, i.e., the switch of the random door function corresponding to the implementation mode 5, and the style of the control 40g-2 is switched to the style of the control 40g-2'.

[0555] Understandably, in the scenario where it is needed to close the arbitrary door function corresponding to the implementation mode 5, the user clicks the control 40g-2', and the mobile phone closes the arbitrary door function corresponding to the implementation mode 5 in response to the user operation, and displays the interface 50g, i.e., the switch of the arbitrary door function corresponding to the implementation mode 5, and the style of the control 40g-2' is switched back to the style of the control 40g-2.

[0556] The above opening or closing of the arbitrary door function corresponding to the implementation mode 4, and the opening or closing of the arbitrary door function corresponding to the implementation mode 5, can be determined according to the actual use needs of the user. That is, the user can open the arbitrary door function of the implementation mode 4, or open the arbitrary door function of the implementation mode 6, or open the arbitrary door function of the implementation mode 4 and the implementation mode 5 at the same time, according to the actual use needs.

[0557] In the case where the arbitrary door function corresponding to the implementation mode 5 is opened, when the user makes a circle selection operation on the screen, such as a knuckle circle operation, the mobile phone can realize screen capture through a smart screenshot application, and display the operation track on the current interface through a system interface application. For details of this implementation, please refer to the embodiment part below with respect to FIG. 14.

[0558] The following takes the terminal device with the hardware structure shown in FIG. 3 and the software structure shown in FIG. 4 as a mobile phone as an example, and specifically describes the content sharing scheme provided by the embodiments of the present application in combination with the drawings.

[0559] For ease of illustration, the embodiments of the present application take the scenario where the user uses a knuckle to make a circle selection operation on the screen, pulls up an arbitrary door service, realizes selection adjustment of the to-be-transmitted content, and then transmits the circle-selected content as an example, and specifically describes the content sharing scheme realized based on the implementation mode 5.

[0560] Referring to FIG. 11, it is shown that, in the use scenario where the circle-selected content is text, the change of the selection area displayed on the interface according to the operation track.

[0561] Referring to FIG. 11, it is shown that, in the use scenario where the circle-selected content is text, the change of the selection area displayed on the interface according to the operation track.

[0562] With reference to (1) of FIG. 11, exemplarily, when the user uses the knuckle to make a circle selection operation on the text 10h-1 in the interface 10h, the phone intercepts the interface 10h (full-screen screenshot) in response to the user operation, and displays the operation trajectory corresponding to the circle selection operation on the interface 10h. The text 10h-1 includes text areas corresponding to the data "Aaaaaaaaaaaaa", "Bbbbbbbb", "Ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc", and "Ddddddddddd".

[0563] Exemplarily, the interface displaying the operation trajectory, such as the interface 20h shown in (2) of FIG. 11, displays the operation trajectory, such as the operation trajectory 20h-2. In some embodiments of the present application, the operation trajectory 20h-2 can be a closed loop.

[0564] In some embodiments of the present application, the operation trajectory 20h-2 is displayed by a first preset motion effect. The first preset motion effect is a motion effect of highlighting the operation trajectory 20h-2 after thickening. In other embodiments of the present application, the first preset motion effect can also be a motion effect of scanning the operation trajectory 20h-2, which is not limited in the present application. With reference to (2) of FIG. 11, the interface 20h includes the text 20h-1. When the user enables any door function corresponding to the implementation mode 5, after the user uses the knuckle to make a circle selection operation on the phone screen, such as drawing the operation trajectory 20h-2 in the area where the text 20h-1 is located, the phone further draws a fourth selection area in the area where the text 20h-1 is located according to the operation trajectory 20h-2.

[0565] In other embodiments of the present application, when the user uses the knuckle to make a circle selection operation on the phone screen without enabling any door function corresponding to the implementation mode 5, such as drawing the operation trajectory 20h-2 in the area where the text 20h-1 is located, the phone takes a screenshot according to the operation trajectory, and saves the content of the screenshot in a preset file, such as an album or a gallery.

[0566] With reference to (3) of FIG. 11, exemplarily, in some embodiments of the present application, the phone can determine a first rectangle corresponding to the operation trajectory 20h-2 based on a rectangle algorithm, take the first rectangle as the fourth selection area 30h-2, and display the determined fourth selection area 30h-2 on the user interface of the phone, such as the interface 30h shown in (3) of FIG. 11.

[0567] In some embodiments of the present application, the interface 30h can display a sixth selection mark, which can indicate the fourth selection region 20h-2 on the interface 30h. In some embodiments of the present application, the sixth selection mark can be a rectangular frame. Understandably, according to the rectangular algorithm, the first rectangle corresponding to the operation trajectory 20h-2 is drawn as the fourth selection region 20h-2, which can ensure that the content displayed in the fourth selection region 20h-2 is substantially the same as that in the operation trajectory 20h-2 selected by the user. Referring to (3) in FIG. 11, the interface 30h can include a text 30h-1, the fourth selection region 30h-2, and a text region 30h-3, for example. In some embodiments of the present application, the fourth selection region 30h-2 is a highlighted region. The region of the interface 30h other than the fourth selection region 30h-2 can be a picture obtained by performing blur processing or virtualization processing on the full-screen screenshot acquired by the interface 10h. In other embodiments of the present application, the fourth selection region 30h-2 can also be suspended above the interface 30h. The display manner described above can be adjusted according to actual application, which is not limited in the present application.

[0568] In embodiments of the present application, the fourth selection region 30h-2 is a transition frame displayed before any door service is pulled up based on the selection operation. That is, the fourth selection region 30h-2 cannot be adjusted by the user, and in order to improve the user experience, a transition effect can be set for the fourth selection region 30h-2, for example, by setting different states of the attributes of the frame color, width, style, etc. of the fourth selection region 30h-2, so that the frame of the fourth selection region 30h-2 can change in the display interface 30h.

[0569] The text region 30h-3 includes one text line or multiple text lines.

[0570] Continuing to refer to (3) in FIG. 11, the user interface of the mobile phone can display the interface 40h shown in (4) in FIG. 11 after a first time length of the display interface 30h, for example.

[0571] In some embodiments of the present application, the first time length is, for example, 1 second or a few hundred milliseconds. The specific time length can be determined according to the performance of the terminal device (such as the time required to pull up any door service and / or the time required to identify the content in the operation trajectory region, etc.), which is not limited in the present application.

[0572] In other embodiments of the present application, the interface 40h shown in (4) in FIG. 11 can be directly displayed after the display interface 30h.

[0573] Referring to (4) in FIG. 11, the interface 40h includes a text 40h-1, a fourth selection region 40h-2, and a text region 40h-3.

[0574] In some embodiments of the present application, during the display of interface 30h, a scanning effect can be set on the fourth selection area 30h-2 to improve the user experience. For example, a scanning line or scanning frame that can move up and down is set on the fourth selection area 30h-2 to simulate the scanning effect, so that the user interface is more lively and interesting. For example, interface 40h shown in (4) of FIG. 11, a moving scanning frame 40h-4 is set on the fourth selection area 40h-2.

[0575] Exemplarily, the text area intersecting the text 40h-1 and the fourth selection area 40h-2 is taken as a target text area, and the fourth selection area 40h-2 is expanded based on the target text area to obtain a fifth selection area, and in the case of pulling up the arbitrary door service, the display interface of the mobile phone can display the interface 50h shown in (5) of FIG. 11. The interface 50h can include a fifth selection area 50h-2, a text area 50h-3 displayed in the fifth selection area 50h-2, an icon area 50h-4, a text and image switching control 50h-5, an editing control 50h-6, a save control 50h-7, and the like.

[0576] In some embodiments of the present application, the intersection content intersecting the boundary of the fourth selection area 40h-2 in the interface 40h is obtained, a second rectangle is determined according to the intersection content, and the second rectangle is taken as the fifth selection area 50h-2.

[0577] In some embodiments of the present application, the fifth selection area 50h-2 is a highlight display area. The content displayed in the fifth selection area 50h-2 does not deform (such as deformation caused by three-dimensional transformation) relative to the original interface (such as interface 10h) after the arbitrary door is opened. The area in the interface 50h except the fifth selection area 50h-2 can be a picture obtained by blurring or virtualizing the full-screen screenshot obtained above. The area in the interface 50h except the fifth selection area 50h-2 and the icon area 50h-4 deforms relative to the original interface 10h after the arbitrary door is opened.

[0578] In some embodiments of the present application, the fourth selection area 40h-2 can be expanded based on the entire content of the text line of the intersection content to obtain the fifth selection area 50h-2.

[0579] In some embodiments of the application, the interface 50h can display a seventh selection mark, which can indicate the fifth selection region 50h-2 on the interface 50h. In some embodiments of the application, the seventh selection mark can be a rectangular frame. Illustratively, continuing with (4) in FIG. 11, from all target text regions intersecting the fourth selection region 40h-2, a first target text region at a starting position of the fourth selection region 40h-2 is determined, and a second target text region at an ending position of the fourth selection region 40h-2 is determined. Based on the bounding rectangle algorithm, a second rectangle is determined according to the first target text region and the second target text region, and the second rectangle is the fifth selection region 50h-2.

[0580] Continuing with (4) in FIG. 11, illustratively, from all target text regions intersecting the fourth selection region 40h-2, a target text region (e.g., the text region corresponding to the data "Bbbbbbb") closest to any one vertex (e.g., the upper left corner point) of the fourth selection region 40h-2 is taken as the first target text region at the starting position of the fourth selection region 40h-2; a target text region (e.g., the text region corresponding to the data "Ccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc") closest to any one vertex (e.g., the lower right corner point) of the fourth selection region 40h-2 other than the starting position is taken as the second target text region at the ending position of the fourth selection region 40h-2; based on the bounding rectangle algorithm, a second rectangle including the first target text region and the second target text region is determined, and the second rectangle is taken as the fifth selection region 50h-2 displayed on the interface 50.

[0581] In some embodiments of the application, the starting position is a position corresponding to a character closest to the upper left corner point of the fourth selection region 40h-2 in intersecting content (e.g., target text regions) intersecting the fourth selection region 40h-2. Illustratively, the starting position is a position corresponding to a character closest to the upper left corner point in a text line closest to the upper left corner point, and a character in the text line closest to the upper left corner point in the intersecting content intersecting the fourth selection region 40h-2.

[0582] In some embodiments of the application, the ending position is a position corresponding to a character closest to the lower right corner point of the fourth selection region 40h-2 in intersecting content intersecting the fourth selection region 40h-2. Illustratively, the ending position is a position corresponding to a character closest to the lower right corner point in a text line closest to the lower right corner point, and a character in the text line closest to the lower right corner point in the intersecting content intersecting the fourth selection region 40h-2.

[0583] In some embodiments of the present application, the starting position of the fourth selection region 40h-2 is taken as the starting position of the fifth selection region 50h-2, and the first mark 50h-8 is displayed at the starting position of the fifth selection region 50h-2; the ending position of the fourth selection region 40h-2 is taken as the ending position of the fifth selection region 50h-2, and the second mark 50h-9 is displayed at the ending position of the fifth selection region 50h-2; the text in the fifth selection region 50h-2 within the range determined by the starting position and the ending position is set to the selected state. In the embodiments of the present application, the text in the fifth selection region 50h-2 within the range determined by the first mark and the second mark of the fifth selection region 50h-2 is set to the selected state, which can clearly indicate the text content selected by the user in the interface. In some embodiments of the present application, the fifth selection region 50h-2 is displayed through a second preset motion effect. The second preset motion effect can be a motion effect of switching the fourth selection region 40h-2 to the fifth selection region 50h-2 for display through Matrx mapping animation. The embodiments of the present application display the fifth selection region 50h-2 through the second preset motion effect, which can avoid the problem of display jump during the process of switching the fourth selection region 40h-2 to display the fifth selection region 50h-2, and ensure the smooth display of the fifth selection region 50h-2.

[0584] Continuing to refer to (5) in FIG. 11, the icon region 50h-4 can be used to display one or more application and / or service icons, for example.

[0585] In some embodiments of the present application, the application and / or service icons displayed in the icon region 50h-4 can be icons of applications and / or services obtained by the intent framework according to the data selected by the fifth selection region 50h-2, for example, performing intent recognition processing on the text in the fifth selection region 50h-2 or on the text in the fifth selection region 50h-2 in the selected state, and then performing service matching processing according to the recognized user intent. In the case where the data selected by the fifth selection region 50h-2 is not the same, the application and / or service icons displayed in the icon region 50h-4 can be different. The application and / or service icons displayed in the icon region 50h-4 change with the change of the data selected by the fifth selection region 50h-2.

[0586] In some embodiments of the present application, the user can switch the display of the application and / or service icons displayed in the icon region 50h-4 by performing a sliding operation, such as a swipe-up or swipe-down operation, in the icon region 50h-4.

[0587] In some embodiments of the present application, in response to the eleventh operation of the user on the fifth selection region 50h-2, the data of the fifth selection region 50h-2 is dragged up, and the data of the fifth selection region 50h-2 after being dragged up is transmitted through the application and / or service corresponding to the triggered icon. In some embodiments of the present application, dragging up the data of the fifth selection region 50h-2 means that the data of the fifth selection region 50h-2 is displayed in a floating manner, for example, displayed in a floating manner on the interface 50h.

[0588] For example, referring to (5) in FIG. 11, in response to the long press operation of the user on the fifth selection region 50h-2, the data of the fifth selection region 50h-2 is dragged up and displayed in the floating box, and the floating box is displayed on the user interface, as shown in the interface 60h in (6) in FIG. 11. For example, the interface 60h includes the fifth selection region 60h-2, the floating box 60h-3, and the icon region 60h-4. The floating box 60h-3 can follow the drag operation of the user on the screen to adjust the display position in real time. Referring to (6) in FIG. 11, after displaying the floating box 60h-3, in response to the operation of the user dragging the floating box 60h-3 to one application and / or service icon in the icon region 60h-4, the application and / or service corresponding to the application and / or service icon is triggered to transmit the data in the floating box 60h-3.

[0589] The embodiments of the present application realize the dragging up of the content of the fifth selection region by the long press operation on the fifth selection region, and then realize the transmission of the dragged-up data by dragging the dragged-up data to the target application icon or the target service icon.

[0590] In some embodiments of the present application, referring to FIG. 12, in the case of displaying the interface 50, in response to the touch operation of the user on one application and / or service icon in the icon region 50h-4, the application and / or service corresponding to the application and / or service icon is triggered to transmit the data in the fifth selection region 50h-2, such as the text in the fifth selection region 50h-2 in the selected state.

[0591] The embodiments of the present application realize the transmission of the content of the fifth selection region to the application and / or service corresponding to the target application icon or the target service icon through the touch operation on the application and / or service icon, thereby simplifying the operation of the user to transmit the selected data across applications.

[0592] With reference to (5) of FIG. 11, exemplarily, if the text and image switching control 50h-5 is clicked by the user while in the unselected state, the phone displays the text and image switching control 50h-5 in the selected state in response to the user operation, performs text recognition on the data in the fifth selection area 50h-2, and automatically displays the matched application and / or service icons in the icon area 50h-4 according to the recognized text recognition result. If the text and image switching control 50h-5 is clicked again by the user while in the selected state, the phone displays the text and image switching control 60h-5 in the unselected state in response to the user operation, and takes a screenshot of the data in the fifth selection area 50h-2 as a picture, and then automatically displays the matched application and / or service icons in the icon area 50h-4 according to the picture. In the embodiment of the present application, the default state of the text and image switching control 50h-5 is the selected state.

[0593] With reference to (5) of FIG. 11, exemplarily, if the edit control 50h-6 is clicked by the user, the phone displays an edit interface in response to the user operation, so that the user can complete the editing of the data selected by the fifth selection area 50h-2 in the edit interface.

[0594] With reference to (5) of FIG. 11, exemplarily, if the save control 50h-7 is clicked by the user, the phone takes a screenshot of the data in the fifth selection area 50h-2 as a picture, and saves the picture in a preset file, such as an album or a gallery, in response to the user operation. That is, the information transmission scheme provided in the embodiment of the present application can not only transmit the selected content across applications based on the selection operation, but also take into account the user's demand for taking a screenshot using the knuckle selection operation.

[0595] It should be understood that the above description is only an example for better understanding the technical scheme of the embodiment, and is not the only limitation of the embodiment.

[0596] With reference to (5) of FIG. 11, exemplarily, the interface 50h can be the interface obtained by the phone performing three-dimensional transformation on all elements of the interface 10h or the above-mentioned full-screen screenshot. In some embodiments of the present application, the interface 50h can display the visual effect of the original interface (i.e., the interface 10h) being pushed inwards in the screen. In other embodiments of the present application, the interface 50h can display the visual effect of the original interface changing in transparency or scaling in the screen, and the present application does not limit the visual effect displayed by the interface 50h.

[0597] It should be understood that, in the embodiments of the present application, the interface 50h shown in (5) of FIG. 11 and FIG. 12, and the interface 60h shown in FIG. 12 are displayed with a status bar, for example, displaying time, network connection status, signal, power and the like, in other embodiments of the present application, the interface 50h and the interface 60h do not include the status bar.

[0598] It should be understood that the interfaces 10h, 20h, 30h and 40h are interfaces displayed at different time points of the same interface (for example, the ninth interface). The interfaces 50h and 60h are interfaces displayed at different time points of the same interface (for example, the tenth interface).

[0599] It should be understood that, in the embodiments of the present application, the dashed lines shown in the interface 50h and the interface 60h are only used to mark the icon display area, and there is no dashed line in the actual interface displayed by the terminal device.

[0600] In the scenario of using the circle selection operation to pull up an arbitrary door service by the user, the embodiments of the present application determine the selection area corresponding to the circle selection operation in the interface based on the external rectangle algorithm, display the matching service icon based on the content of the selection area, and share the content of the selection area to the service corresponding to the service icon through the user operation (for example, the eleventh operation described above), thereby avoiding the misselection of the data content not intended by the user, realizing the accurate transmission of the content selected by the user, and improving the user experience.

[0601] Referring to FIG. 13, FIG. 13 is a schematic diagram of the change of the selection area displayed on the interface according to the operation trajectory in the scenario of using a local area of a circle selection map application according to an embodiment of the present application.

[0602] Referring to (1) of FIG. 13, an interface 10i displaying a map application is exemplarily shown. In the case that the user uses the knuckle to make a circle selection operation on the interface 10i, the mobile phone responds to the user operation to intercept the interface 10i (full screen screenshot), and displays the operation trajectory 10i-2 corresponding to the circle selection operation on the interface 10i. In some embodiments of the present application, the operation trajectory can be a closed loop.

[0603] In some embodiments of the present application, the operation trajectory 10i-2 is displayed through a first preset motion effect. The first preset motion effect is a motion effect of highlighting the operation trajectory 10i-2 after thickening the operation trajectory 10i-2. In other embodiments of the present application, the first preset motion effect can also be a motion effect of scanning the operation trajectory 10i-2, which is not limited in the present application.

[0604] Exemplarily, in some embodiments of the present application, the mobile phone can determine a rectangle corresponding to the operation trajectory 10i-2 as a fourth selection area based on the external rectangle algorithm, and display the determined rectangle on the user interface of the mobile phone, as shown in the interface 20i of (2) of FIG. 13.

[0605] Referring to (2) of FIG. 13, exemplarily, the interface 20i can include a fourth selection region 20i-2 and a text region 20i-3. In some embodiments of the present application, the text region of the map application can be an address entity.

[0606] In some embodiments of the present application, the fourth selection region 20i-2 is a highlighted region, and the region of the interface 20i other than the fourth selection region 20i-2 can be a picture obtained by performing blur processing or virtualization processing on the full-screen screenshot obtained above. In other embodiments of the present application, the fourth selection region 20i-2 can also be suspended above the interface 20i. The display mode described above can be adjusted according to actual application, which is not limited in the present application.

[0607] The fourth selection region 20i-2 can be a rectangle corresponding to the operation trajectory 10i-2 determined based on a bounding rectangle algorithm.

[0608] It should be noted that in the embodiments of the present application, the fourth selection region 20i-2 can be a transition frame displayed before the arbitrary door service is pulled up based on the circle selection operation. In order to improve the user's visual experience, the fourth selection region 20i-2 can be provided with a transition effect, for example, by setting different states of the attributes of the border color, width, style, etc. of the fourth selection region 20i-2, so that the border of the fourth selection region 20i-2 can change in the display interface 20i.

[0609] The text region 20i-3 can include one text line or multiple text lines.

[0610] Continuing to refer to (2) of FIG. 13, exemplarily, after the second time length of the display interface 20i, the user interface of the mobile phone can display the interface 30i shown in (3) of FIG. 13.

[0611] In some embodiments of the present application, the second time length is, for example, 1 second or a few hundred milliseconds. The specific time length can be determined according to the performance of the terminal device (such as the time required to pull up the arbitrary door service and / or the time required for the recognition processing of the content in the operation trajectory region, etc.), which is not limited in the present application.

[0612] Referring to (3) of FIG. 13, exemplarily, the interface 30i can include a second region 30i-2 and a text region 30i-3.

[0613] The fourth selection region 30i-2 can also be a rectangle corresponding to the operation trajectory 10i-2 determined based on a bounding rectangle algorithm, and also cannot be adjusted by the user.

[0614] In some embodiments of the present application, during the display of the interface 30i, a scanning effect can be set on the fourth selection area 30i-2 to improve the user experience. For example, a scanning line or a scanning box that can move up and down is set on the fourth selection area 30i-2 to simulate the scanning effect, so that the user interface is more lively and interesting. For example, as shown in (3) of FIG. 13, a moving scanning box 30i-4 is set on the fourth selection area 30i-2.

[0615] Exemplarily, the text area 30i-3 intersecting with the fourth selection area 30i-2 in the interface 30i is taken as a target text area, and the fourth selection area 30i-2 is expanded based on the target text area to obtain a fifth selection area. In the case of pulling up the arbitrary door service, the display interface of the mobile phone can display the interface 40i shown in (4) of FIG. 13. The interface 40i can include the fifth selection area 40i-2, the text area 40i-3, the icon area 40i-4, the text and image switching control 40i-5, the editing control 40i-6, the saving control 40i-7, and the like.

[0616] In some embodiments of the present application, the intersection content intersecting with the boundary of the fourth selection area 30i-2 in the interface 30i is obtained, a second rectangle is determined according to the intersection content, and the second rectangle is taken as the fifth selection area 40i-2.

[0617] In some embodiments of the present application, the fifth selection area 40i-2 is a high-light display area. The content displayed in the fifth selection area 40i-2 does not deform (such as deformation caused by three-dimensional transformation) relative to the original interface (such as the interface 10i) after the arbitrary door is opened. The area in the interface 40i except the fifth selection area 40i-2 can be a picture obtained by performing blur processing or virtualization processing on the full-screen screenshot obtained above. The area in the interface 40i except the fifth selection area 40i-2 and the icon area 40i-4 deforms relative to the original interface 10i after the arbitrary door is opened.

[0618] In some embodiments of the present application, the fourth selection area 30i-2 can be expanded to obtain the fifth selection area 40i-2 based on the content of the address entity in the intersection content.

[0619] In some embodiments of the present application, the interface 40i can display a seventh selection mark, and the seventh selection mark can indicate the fifth selection area 40i-2 on the interface 40i. In some embodiments of the present application, the seventh selection mark can be a rectangular box.

[0620] Exemplarily, referring to (3) in FIG. 13, from all the target text regions intersecting with the fourth selection region 30i-2, a first target text region at the start position of the fourth selection region 30i-2 is determined, and a second target text region at the end position of the fourth selection region 30i-2 is determined. Based on the bounding rectangle algorithm, a second rectangle is determined according to the first target text region and the second target text region, and the second rectangle is the fifth selection region 40i-2.

[0621] Continuing to refer to (3) in FIG. 13, exemplarily, the target text region (such as the data corresponding to the data “Dddddd”) closest to the top-left corner point of the fourth selection region 30i-2 among all the target text regions intersecting with the fourth selection region 30i-2 is taken as the first target text region at the start position of the fourth selection region 30i-2; the target text region (such as the data corresponding to the data “AAAAA”) closest to the bottom-right corner point of the fourth selection region 30i-2 among all the target text regions intersecting with the fourth selection region 30i-2 is taken as the second target text region at the end position of the fourth selection region 30i-2; based on the bounding rectangle algorithm, a second rectangle including the first target text region and the second target text region is determined, and the second rectangle is taken as the fifth selection region 40i-2.

[0622] In some embodiments of the present application, the start position is the position corresponding to the character closest to the top-left corner point of the fourth selection region 30i-2 among the intersecting contents (such as target text regions) intersecting with the fourth selection region 30i-2. The start position is the position corresponding to the character closest to the top-left corner point among the character line closest to the top-left corner point and the character in the character line closest to the top-left corner point among the intersecting contents intersecting with the fourth selection region 30i-2.

[0623] In some embodiments of the present application, the end position is the position corresponding to the character closest to the bottom-right corner point of the fourth selection region 30i-2 among the intersecting contents intersecting with the fourth selection region 30i-2. The end position is the position corresponding to the character closest to the bottom-right corner point among the character line closest to the bottom-right corner point and the character in the character line closest to the bottom-right corner point among the intersecting contents intersecting with the fourth selection region 30i-2.

[0624] In some embodiments of the present application, the starting position of the fourth selection region 30i-2 is taken as the starting position of the fifth selection region 40i-2, and the first mark 40i-8 is displayed at the starting position of the fifth selection region 40i-2; the ending position of the fourth selection region 30i-2 is taken as the ending position of the fifth selection region 40i-2, and the second mark 40i-9 is displayed at the ending position of the fifth selection region 40i-2; the text in the fifth selection region 40i-2 within the range of the first mark and the second mark of the fifth selection region 40i-2 is set in a selected state. Referring to (4) in FIG. 13, in some embodiments of the present application, the interface 40i further includes a text region 40i-3 displayed in the fifth selection region 40i-2, an icon region 40i-4, a text and image switching control 40i-5, an editing control 40i-6, and a saving control 40i-7.

[0625] In some embodiments of the present application, the fifth selection region 40i-2 is displayed through a second preset motion effect. The second preset motion effect can be a motion effect of switching the fourth selection region 30i-2 to the fifth selection region 40i-2 for display through Matrx mapping animation. The display of the fifth selection region 40i-2 through the second preset motion effect in the embodiments of the present application can avoid the problem of display jump in the process of switching the fourth selection region 30i-2 to display the fifth selection region 40i-2, and ensure the smooth display of the fifth selection region 40i-2.

[0626] In some other embodiments of the present application, it is determined whether there is a text region intersecting the fifth selection region 40i-2. If there is a text region intersecting the fifth selection region 40i-2, the text region intersecting the fifth selection region 40i-2 is taken as a third target text region, and a third rectangle is determined based on the fifth selection region 40i-2 and the third target text region according to the bounding rectangle algorithm, and the fifth selection region 40i-2 is updated according to the third rectangle. In the above embodiments of the present application, after the fifth selection region 40i-2 is displayed, if the fifth selection region 40i-2 intersects with a text region, the fifth selection region 40i-2 is also expanded according to the intersecting text region.

[0627] Continuing to refer to (4) in FIG. 13, exemplary, the icon region 40i-4 can be used to display one or more application and / or service icons.

[0628] In some embodiments of the present application, the application and / or service icons displayed in the icon area 40i-4 can be icons of applications and / or services matched by the intent framework according to the data selected by the fifth selection area 40i-2, for example, the intent recognition processing of the text in the fifth selection area 40i-2 or the text in the fifth selection area 40i-2 in the highlighted state, and the service matching processing according to the recognized user intent. In the case that the data selected by the fifth selection area 40i-2 is different, the application and / or service icons displayed in the icon area 40i-4 can be different. The application and / or service icons displayed in the icon area 40i-4 can change with the change of the data selected by the fifth selection area 40i-2.

[0629] In some embodiments of the present application, the user can switch the display of the application and / or service icons displayed in the icon area 40i-4 by sliding operation in the icon area 40i-4, such as up sliding or down sliding.

[0630] In some embodiments of the present application, in response to the eleventh operation of the user on the fifth selection area 40i-2, the data in the fifth selection area 40i-2 is dragged up, and the data in the fifth selection area 40i-2 after being dragged up is transmitted through the application and / or service icons.

[0631] In some embodiments of the present application, referring to (4) in FIG. 13, in response to the long press operation of the user on the fifth selection area 40i-2, the data in the fifth selection area 40i-2 is dragged up and the content after being dragged up is displayed in the floating box, and the floating box is displayed in the user interface, such as the interface 50i shown in (5) in FIG. 13. Exemplarily, the interface 50i includes the fifth selection area 50i-2, the floating box 50i-3, and the icon area 50i-4. The floating box 50i-3 can adjust the display position in real time following the drag operation of the user on the screen. Referring to (5) in FIG. 13, in response to the operation of the user dragging the fifth selection area 50i-2 to one application and / or service icon in the icon area 50i-4, the application and / or service icon corresponding to the application and / or service is triggered to transmit the data in the fifth selection area 50i-2.

[0632] In some embodiments of the present application, referring to (6) in FIG. 13, in the case of displaying the interface 40i, in response to the touch operation of the user on one application and / or service icon, the application and / or service icon corresponding to the application and / or service is triggered to transmit the content in the fifth selection area after being dragged up.

[0633] The embodiment of the present application realizes the dragging of the data of the fifth selection region 50i-2 by long pressing the fifth selection region, and then realizes the transmission of the dragged data by dragging the dragged data to a target application icon or a target service icon.

[0634] Continuing to refer to (4) in FIG. 13, exemplarily, if the text and image switching control 40i-5 is in the unselected state and is clicked by the user, the phone displays the text and image switching control 40i-5 in the selected state in response to the user operation, and performs text recognition on the content of the fifth selection region, and automatically displays the matched application and / or service icon in the icon region 40i-4 according to the recognized text recognition result. If the text and image switching control 40i-5 is in the selected state and is clicked by the user again, the phone displays the text and image switching control 40i-5 in the unselected state in response to the user operation, and takes a screenshot of the data in the fifth selection region 40i-2 as a picture, and then automatically displays the matched application and / or service icon in the icon region 40i-4 according to the picture. In the embodiment of the present application, the default state of the text and image switching control 40i-5 is the selected state.

[0635] Continuing to refer to (4) in FIG. 13, exemplarily, if the editing control 40i-6 is clicked by the user, the phone displays an editing interface in response to the user operation, so that the user can complete the editing of the data selected by the fifth selection region in the editing interface.

[0636] Continuing to refer to (4) in FIG. 13, exemplarily, if the saving control 40i-7 is clicked by the user, the phone takes a screenshot of the data in the fifth selection region 40i-2 as a picture, and saves the picture in a preset file, such as an album or a gallery.

[0637] Continuing to refer to (4) in FIG. 13, exemplarily, the interface 40i can be an interface obtained by performing three-dimensional transformation on all elements of the interface 10i or the above-mentioned full-screen screenshot. The interface 40i can display the visual effect that the original interface (i.e., the interface 10i) is pushed inwards in the screen. In other embodiments of the present application, the interface 40i can display the visual effect that the original interface changes in transparency or changes in scale in the screen, and the present application does not limit the visual effect of the display of the interface 40i.

[0638] It should be understood that, in the embodiments of the present application, the interface 40i shown in (4) and (6) in FIG. 13, and the interface 50i shown in (5) and (6) in FIG. 13 display a status bar, for example, display information such as time, network connection state, signal, and power, and in other embodiments of the present application, the interface 40i and the interface 50i do not include the status bar.

[0639] It should be understood that, in the embodiments of the present application, the dashed lines shown in the interfaces 40i and 50i are only used to mark the icon display areas, and the dashed lines do not exist in the actual interfaces displayed by the terminal device.

[0640] In the scenario of using the circle selection operation to pull up an arbitrary door service by the user, the embodiments of the present application determine the selection area in the interface based on the circumscribed rectangle algorithm, which can ensure that the area finally displayed in the interface can completely display the content selected by the user, and can also avoid that the determined selection area is too large, thereby better improving the user experience. Further, the embodiments of the present application can determine the selection area corresponding to the circle selection operation in the interface, display the matching service icon based on the content of the selection area, and share the content of the selection area to the service corresponding to the service icon through the user operation, thereby avoiding the misselection of the data content not intended by the user, realizing the accurate transmission of the content selected by the user, and improving the user experience.

[0641] The interaction processing logic of each framework in the data transmission method based on the implementation manner 5 will be described in detail below taking the scenario shown in FIG. 11 as an example.

[0642] Referring to FIG. 14, a flowchart of a data transmission method provided by an embodiment of the present application is shown.

[0643] It should be noted that before implementing the data transmission method provided by the embodiment shown in FIG. 14, the arbitrary door function corresponding to the implementation manner 5 needs to be started in the manner shown in FIG. 10.

[0644] Exemplarily, in the case of starting the arbitrary door function corresponding to the implementation manner 5, the data transmission method provided by the embodiment shown in FIG. 14 specifically includes:

[0645] S301, the input event framework responds to the user operation and identifies the currently received user operation.

[0646] Specifically, in the embodiments of the present application, after receiving the user operation, the input event framework identifies the received user operation, which specifically refers to identifying whether the user operation is a circle selection operation.

[0647] Exemplarily, in the embodiments of the present application, the circle selection operation is, for example, an operation triggered by the user using the knuckle (knuckle circle selection operation). In this case, the input event framework identifying whether the current operation is a circle selection operation is specifically a knuckle framework.

[0648] Specifically, the knuckle framework can identify the user operation according to the knuckle identification algorithm, and determine whether the current received user operation is a knuckle circle selection operation. The specific implementation logic of the knuckle framework for identifying whether the current received user operation is a knuckle circle selection operation can be referred to related documents of the knuckle identification algorithm, and details are not described herein.

[0649] With reference back to FIG. 14, in a case where it is determined that the current received user operation is a circle selection operation, the knuckle framework instructs the arbitrary door framework to pull up an arbitrary door service (a process corresponding to the arbitrary door service can be referred to as an arbitrary door service process), and the arbitrary door framework (or the arbitrary door service process) draws an arbitrary door interface, such as the interface 10h to the interface 60h in FIG. 11, and notifies the intelligent screenshot application to take a full-screen screenshot of the current interface.

[0650] S302, in a case where it is determined that the current received user operation is a circle selection operation, the intelligent screenshot application responds to the notification of the input event framework to take a screenshot of the current interface to obtain a full-screen screenshot corresponding to the current interface.

[0651] S303, in a case where it is determined that the current received user operation is a circle selection operation, the arbitrary door framework responds to the notification of the input event framework to pull up an arbitrary door service process and create an activity corresponding to the arbitrary door interface.

[0652] It should be noted that all operations in the activity are closely related to the user, and the activity is a component responsible for interacting with the user. The specified control can be displayed through a corresponding interface (such as an interface for setting a content view, setcontentview (View)). For details of the use of the activity, refer to the description of the activity in the application programming interface (API) document of ANDROIDTM, and details are not described herein.

[0653] In addition, it should be noted that when the arbitrary door service process is pulled up and the activity corresponding to the arbitrary door interface is created, an external interface can be exposed, such as an external interface for interacting with the intent framework and an external interface for interacting with the intelligent screenshot application. In this way, the arbitrary door framework can interact with the intelligent screenshot application through the exposed external interface, transmit the operation track corresponding to the circle selection operation, and obtain the screenshot image taken by the intelligent screenshot application according to the operation track. In addition, the arbitrary door framework can interact with the intent framework, transmit the screenshot image of the operation track, obtain the information of the application and / or service to be displayed in the icon area, and call the parameters.

[0654] S304, the arbitrary door framework draws an operation track in the activity corresponding to the arbitrary door, and sends the coordinate information of the drawn operation track to the intelligent screenshot application.

[0655] For example, in some embodiments of the present application, the arbitrary door framework may, for example, call the system interface application, draw an operation track corresponding to the circle selection operation according to the coordinate information collected by the sensor, such as a touch sensor, in the activity corresponding to the arbitrary door interface. For example, the operation track 20h-2 in the interface 20h shown in (2) of FIG. 11. That is, when the user performs a knuckle circle selection operation on the screen of the mobile phone, an operation track corresponding to the circle selection operation will be drawn according to the movement of the user's knuckle on the current interface, that is, the user interface will display the operation track 20h-2 in the interface 20h.

[0656] S305, based on a preset algorithm, the intelligent screenshot application determines a fourth selection area according to the coordinate information of the operation track, and cuts out a first screenshot picture of the fourth selection area from the full-screen screenshot, and sends the fourth selection area and the first screenshot picture to the arbitrary door framework.

[0657] In some embodiments of the present application, the preset algorithm is, for example, a circumscribed rectangle algorithm. Based on the circumscribed rectangle algorithm, the fourth selection area (such as the fourth selection area 30h-2 or the fourth selection area 40h-2 drawn in FIG. 11) is determined according to the coordinate information of the operation track, and the first screenshot picture cut out includes at least one text area (such as the text area 30h-3 displayed in the fourth selection area 30h-2, or the text area 40h-3 displayed in the fourth selection area 40h-2).

[0658] S306, the arbitrary door framework draws the fourth selection area and sets a transition effect for the fourth selection area.

[0659] The fourth selection area is, for example, the fourth selection area 30h-2 displayed in the interface 30h. The specific effect is shown in the interface 40h.

[0660] It should be understood that the above description is only an example for better understanding the technical solutions of the embodiments and is not the only limitation of the embodiments.

[0661] S307, after a first time length of displaying the fourth selection area, the arbitrary door framework displays a scanning animation effect on the fourth selection area and displays the first screenshot picture in the fourth selection area.

[0662] The fourth selection area is a non-adjustable circle selection frame, for example, the fourth selection area 40h-2 displayed in the interface 50h shown in FIG. 11.

[0663] The interface corresponding to the scanning animation displayed on the fourth selection area is shown, for example, the interface 50h shown in FIG. 11.

[0664] In S308, the arbitrary door frame identifies the text region in the first screenshot picture, and determines the fifth selection area based on the fourth selection area and the text region in the first screenshot picture.

[0665] In some embodiments of the present application, the arbitrary door frame determines the first target text region at the starting position of the fourth selection area and the second target text region at the ending position of the fourth selection area from all target text regions intersecting the fourth selection area. Based on the bounding rectangle algorithm, the arbitrary door frame determines the fifth selection area according to the first target text region and the second target text region. For example, referring to (4) in FIG. 11, the target text region (such as the data corresponding to the data “Aaaa”) closest to the upper left corner of the fourth selection area 40h-2 from all target text regions intersecting the fourth selection area 40h-2 is determined as the first target text region at the starting position of the fourth selection area 40h-2, and the target text region (such as the data corresponding to the data “Bbbb”) closest to the lower right corner of the fourth selection area 40h-2 from all target text regions intersecting the fourth selection area 40h-2 is determined as the second target text region at the ending position of the fourth selection area 40h-2. Based on the bounding rectangle algorithm, the second rectangle including the first target text region and the second target text region is determined as the fifth selection area 60h-2.

[0666] In S309, the arbitrary door frame takes a screenshot of the fifth selection area to obtain a second screenshot picture of the fifth selection area, and sends the second screenshot picture to the intent framework.

[0667] In S310, the intent framework receives the second screenshot picture of the fifth selection area sent by the arbitrary door frame, identifies the data of the second screenshot picture, determines the user intent according to the identified data, and sends an information acquisition request to the service management framework according to the user intent to acquire the matched application and / or service information.

[0668] For example, in some embodiments of the present application, the analysis and processing of the second screenshot picture by the intent framework is implemented based on the computer vision (CV) label analysis technology.

[0669] Specifically, in the process of analyzing and processing the second screenshot picture based on the CV label analysis technology, the text elements (e.g., characters) of the character region in the second screenshot picture can be recognized based on the CV label analysis technology, and the corresponding label information can be added to the text elements. Then, the intent recognition can be performed on the text elements of the second screenshot picture according to the label information of the text elements in the second screenshot picture, and the user intent corresponding to the second screenshot picture can be determined.

[0670] S311, the service management framework queries the application and / or service information matching the user intent in response to the information acquisition request.

[0671] Understandably, the information acquisition request can carry the user intent determined by the intent framework according to the second screenshot picture. In this way, after the service management framework receives the information acquisition request, the application and / or service information matching the user intent can be queried from the managed applications and / or services according to the user intent parsed from the information acquisition request.

[0672] Understandably, in the embodiments of the present application, the information of the application includes, for example, the package name (packageName), version number (versionCode), version name (versionNamer), application program name (applicationLabel), icon, etc. The information of the service includes, for example, the service source (e.g., from which application), icon, etc.

[0673] Continuing to refer to FIG. 14, exemplarily, after the service management framework queries the application and / or service information matching the user intent, the application and / or service information can be fed back to the intent framework so that the intent framework generates a recommendation list.

[0674] S312, the intent framework generates a recommendation list according to the application and / or service information fed back by the service management framework, and feeds back the generated recommendation list and the parameter information of each application and / or service in the recommendation list to the arbitrary door framework.

[0675] Exemplarily, in some embodiments of the present application, the intent framework can sort the first application and / or service when generating the recommendation list according to the application and / or service information. For example, the order of the icons corresponding to the applications and / or services in the recommendation list can be adjusted according to certain sorting conditions.

[0676] In some embodiments of the present application, the sorting conditions followed can be determined according to the user usage habits (factor 1). For example, the icons of the applications and / or services frequently used by the user can be adjusted to the front position in the recommendation list.

[0677] In some embodiments of the present application, the sorting condition followed can be determined according to the number of times of use of the application and / or service (factor 2). For example, the icons of the application and / or service with a larger number of times of use are adjusted to a position in the front of the recommended list.

[0678] In some embodiments of the present application, the sorting condition followed can be determined according to the user-defined whitelist application and / or service (factor 3). For example, the icons of the application and / or service belonging to the whitelist are adjusted to a position in the front of the recommended list.

[0679] In some embodiments of the present application, the sorting condition followed can be determined according to the use duration of the application and / or service (factor 4). For example, the icons of the application and / or service with a longer use duration are adjusted to a position in the front of the recommended list.

[0680] In some embodiments of the present application, the sorting condition followed can also be determined according to any two or more of the above factors 1 to 4.

[0681] It should be understood that the above description is only an example for better understanding the technical solution of the embodiments and is not the only limitation of the embodiments.

[0682] S313, any door framework draws a fifth selection area on the full-screen screenshot and displays a second screenshot picture in the fifth selection area.

[0683] In some embodiments of the present application, the fifth selection area is, for example, the fifth selection area 40i-2 displayed in the interface 40i shown in FIG. 12.

[0684] It should be understood that the above description is only an example for better understanding the technical solution of the embodiments and is not the only limitation of the embodiments.

[0685] S314, any door framework makes a door opening animation on the full-screen screenshot and displays the icon of each application and / or service in the recommended list in the icon area at the edge of the screen.

[0686] The icon area is, for example, the icon area 40h-4 displayed in the interface 40h shown in FIG. 11.

[0687] The full-screen screenshot can be understood as the interface content in the interface 10h-1.

[0688] It should be noted that in some other embodiments of the present application, any door framework can not make a door opening animation on the full-screen screenshot.

[0689] S315, in the case of receiving the selection operation of any icon in the icon area by the user, the service management framework starts the application or service corresponding to the selected icon according to the parameter information of the application or service corresponding to the selected icon provided by any door framework, and transmits the data of the second screenshot picture corresponding to the fifth selection area using the started application or service.

[0690] The visual area of the icon area can display N icons by default, that is, by default, the user can see at most N icons in the icon area. For a scenario of more than N icons, the user can view all icons corresponding to the application and / or service information included in the recommendation list by sliding the icon area up and down.

[0691] The user can long press an icon in the icon area to move the display position of the icon.

[0692] For example, in some embodiments of the present application, the selection operation of any icon in the icon area is, for example, directly clicking any icon displayed in the icon area.

[0693] For example, the technical solution provided in the embodiments of the present application triggers any door when the user makes a circle selection operation, and determines the selection area and the content in the selection area according to the operation track, so that the user can conveniently implement the transmission of the content in the selection area based on the recommended application and / or service displayed in the icon area in the current any door interface, and the accuracy of data transmission is improved.

[0694] In addition, the embodiments of the present application further provide an electronic device, which comprises one or more processors and a memory. The memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code comprising computer instructions, and the one or more processors invoke the computer instructions to enable the electronic device to perform the information transmission method shown in the foregoing embodiments.

[0695] It can be understood that, in order to implement the above functions, the electronic device can include hardware, software, firmware or any combination thereof corresponding to each function. Whether a certain function is implemented in hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered beyond the scope of the present application.

[0696] In addition, it should be noted that in actual application scenarios, the information transmission method provided by the above-mentioned embodiments implemented by the electronic device can also be executed by a chip system included in the electronic device, wherein the chip system can include a processor. The chip system can be coupled with a memory, so that the chip system invokes the computer program stored in the memory when running, and realizes the steps executed by the above-mentioned electronic device. The processor in the chip system can be an application processor or a processor other than an application processor.

[0697] In addition, the embodiments of the present application also provide a computer readable storage medium, which stores computer instructions, when the computer instructions run on the electronic device, the electronic device executes the above-mentioned related method steps to realize the information transmission method in the above-mentioned embodiments.

[0698] In addition, the embodiments of the present application also provide a computer program product, when the computer program product runs on the electronic device, the electronic device executes the above-mentioned related steps to realize the information transmission method in the above-mentioned embodiments.

[0699] In addition, the embodiments of the present application also provide a chip (which can also be a component or a module), which can include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuits communicate with each other through internal connection paths, and the processing circuits execute the above-mentioned related method steps to realize the information transmission method in the above-mentioned embodiments, to control the receiving pins to receive signals, and to control the sending pins to send signals.

[0700] In addition, as known from the above description, the electronic device, computer readable storage medium, computer program product or chip provided by the embodiments of the present application are all used to execute the corresponding methods provided above, so the beneficial effects that can be achieved thereby can refer to the beneficial effects in the corresponding methods provided above, which will not be described here again.

[0701] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements for some technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

A method of information transmission, characterized in that The method comprises: receiving a first operation acting on a first interface, the first operation being a circle selection operation; at a first time, in response to the first operation, displaying a second interface, the second interface comprising a circle selection track corresponding to the first operation displayed on the first interface; at a second time, displaying a third interface, the third interface comprising a selection display area and a service recommendation area, the selection display area comprising the first interface and a first selection identifier displayed on the first interface, the first selection identifier being used to identify a first selection area in the first interface corresponding to the circle selection track, the service recommendation area comprising icons of a first group of applications and / or services determined according to the first selection area; at a third time, receiving a second operation acting on the third interface, the second operation being an operation of adjusting the first selection area; in response to the second operation, displaying a fourth interface, the fourth interface comprising the selection display area and the service recommendation area, the selection display area comprising the first interface and a second selection identifier displayed on the first interface, the second selection identifier being used to identify a second selection area, the second selection area being a selection area after the first selection area is adjusted by the second operation, the service recommendation area comprising icons of a second group of applications and / or services determined according to the second selection area; wherein the second time is later than the first time, and the third time is later than the second time. The method of claim 1, wherein After the second interface is displayed, the method further comprises: displaying a third selection identifier, the third selection identifier being used to identify the first selection area, the third selection identifier having a shape different from the first selection identifier; after the third selection identifier is displayed, displaying a first dynamic effect, the first dynamic effect being a dynamic effect of transition from the third selection identifier to the first selection identifier. The method according to claim 2, characterized in that After the first dynamic effect is displayed, the method further comprises: displaying a second dynamic effect, the second dynamic effect being a dynamic effect of simulating scanning the first selection area. The method according to claim 3, characterized in that The first selection area of the third selection identifier cannot be adjusted. The method according to any one of claims 1 to 4, characterized in that The first interface displayed in the selection display area in the third interface is a first interface after a first processing, the first interface after the first processing has the first selection identifier displayed thereon, the first selection identifier has a first screenshot displayed therein, the first screenshot being a screenshot corresponding to the first selection area indicated by the first selection identifier; wherein the first processing comprises one or more of the following: scaling, deformation, distortion, and changing transparency. The method according to claim 5, characterized in that The first processing is used to make the first interface displayed in the selection display area in the third interface present a visual effect of being pushed inwards. The method according to claim 6, characterized in that The response to the second operation and the display of the fourth interface comprises: in response to a first part of the second operation, display the first interface that has undergone a second process in the selected display area, and hide the service recommendation area, the first part of the second operation including a down event and / or a partial move event in the second operation, the second process being of a same type of process as the first process, and the second process being of a smaller degree of process than the first process; in response to a second part of the second operation, display the first interface that has undergone the first process in the selected display area, display the second selection mark on the first interface that has undergone the first process, display a second screenshot in the second selection mark, the second screenshot being a screenshot corresponding to the second selection area indicated by the second selection mark, and display the service recommendation area, the second part of the second operation including an up event in the second operation. The method of claim 7, wherein the second process is configured to cause the first interface displayed in the selected display area in the third interface to present a visual effect of being slightly pulled outwards. The method according to any one of claims 1 to 8, characterized in that the selected display area further includes an edit control displayed on the first interface; in a case where the edit control is displayed, the method further includes: in response to a third operation acting on the edit control, display a fifth interface, the fifth interface including a first picture and a control for editing the first picture, the first picture being a first screenshot corresponding to the first selection area or a second screenshot corresponding to the second selection area; in response to a fourth operation acting on the first picture, display a second picture, the second picture being a picture obtained by editing the first picture through the fourth operation; in response to a fifth operation acting on the second picture, display a third picture at a position on the second picture where the fifth operation is made by a user, the third picture being smaller in size than the second picture and including all contents of the second picture; in response to a sixth operation acting on the third picture, display a sixth interface, the sixth interface including the selected display area and the service recommendation area, the selected display area including the fifth interface displaying the second picture and a fourth picture displayed on the fifth interface, the fourth picture being smaller in size than the third picture and including all contents of the third picture, and the service recommendation area including icons of a third group of applications and / or services determined according to the fourth picture. The method according to any one of claims 1 to 9, characterized in that the selected display area further includes a text circle selection control displayed on the first interface; after the fourth interface is displayed, the method further includes: in response to a seventh operation acting on the text circle selection control, display a seventh interface, the seventh interface including the selected display area, the selected display area including the first interface and a fourth selection mark displayed on the first interface, the fourth selection mark being used to identify the second selection area, and a shape of the fourth selection mark being different from a shape of the second selection mark; after the fourth selection mark is displayed, display a first dynamic effect, the first dynamic effect being a dynamic effect of a transition from the fourth selection mark to a fifth selection mark; In a case where the seventh interface is displayed for a set time and the second selection region includes a text element, a eighth interface is displayed, the eighth interface includes the selection display region and the service recommendation region, the selection display region includes the first interface and a fifth selection mark displayed on the first interface, the fifth selection mark is used to identify a third selection region corresponding to the text element in the second selection region, and the service recommendation region includes icons of a fourth group of applications and / or services determined according to the third selection region. The method according to any one of claims 1 to 10, characterized in that The selection display region further includes a save control displayed on the first interface; In a case where the save control is displayed, the method further includes: In response to an eighth operation on the save control, saving the content in the selection track. The method according to any one of claims 1 to 11, characterized in that The service recommendation region displayed in the third interface and the fourth interface both include icons of a custom recommendation application and / or service set by a user, and the service recommendation region displayed in the third interface further includes icons of the first group of applications and / or services determined according to the first selection region, and the service recommendation region displayed in the fourth interface further includes icons of the second group of applications and / or services determined according to the second selection region. The method of claim 12, wherein Before the fourth interface is displayed, the method further includes: Performing intent recognition on the second selection region to determine a user intent corresponding to the second selection region; According to the user intent, obtaining information of the second group of applications and / or services matched with the user intent; According to the information of the second group of applications and / or services, determining icons of the second group of applications and / or services displayed in the service recommendation region. The method according to any one of claims 1 to 13, characterized in that The selection operation is a user operation made by a user through a knuckle. The method according to any one of claims 1 to 14, characterized in that After the fourth interface is displayed in response to the second operation, the method further includes: In response to a ninth operation on an icon of any application and / or service in the service recommendation region, transmitting the second selection region to an application or a service corresponding to the selected icon. The method according to any one of claims 1 to 15, characterized in that The method further includes: Displaying a ninth interface; In response to a tenth operation on the ninth interface, displaying an operation track on the ninth interface, the tenth operation being a selection operation; After the operation track is displayed, displaying a sixth selection mark on the ninth interface, the sixth selection mark being used to indicate a fourth selection region on the ninth interface, the fourth selection region being determined according to the operation track; After the sixth selection mark is displayed, displaying a seventh selection mark on the ninth interface, the seventh selection mark being used to indicate a fifth selection region on the ninth interface, the fifth selection region being obtained by expanding the fourth selection region; Displaying a tenth interface, the tenth interface including icons of applications and / or services recommended according to content in the fifth selection region; In response to an eleventh operation of a user on the fifth selection region, transmitting the content in the fifth selection region through an application and / or service corresponding to an icon selected by the user. The data transmission method of claim 16, wherein, The method further includes: The first rectangle is determined according to the operation track, and the first rectangle is taken as the fourth selection region. The data transmission method of claim 16, wherein, The method further includes: Obtaining intersection content intersecting with the boundary of the fourth selection region in the ninth interface; The fifth selection region is determined according to the intersection content. The data transmission method of claim 18, wherein, The fifth selection region is determined according to the intersection content, including: A starting position and an ending position of the intersection content are determined; A first text region corresponding to the starting position and a second text region corresponding to the ending position are determined; A second rectangle is determined according to the first text region and the second text region, and the second rectangle is taken as the fifth selection region. The data transmission method of claim 18 or 19, wherein, The ninth interface includes text, the intersection content includes a line of text of the text, and in a case where the fourth selection region is in a region where the text is located, the fifth selection region includes all content of the line of text. The data transmission method of claim 18 or 19, wherein, The ninth interface includes a map, the intersection content includes at least one address entity of the map, and in a case where the fourth selection region is in a region where the map is located, the fifth selection region includes the at least one address entity. The data transmission method of claim 21, wherein, The first text region corresponding to the starting position is determined, including: A text region closest to the starting position among the intersection content intersecting with the boundary of the fourth selection region is taken as the first text region corresponding to the starting position, the starting position is a position corresponding to a first text closest to a first vertex of the fourth selection region in the intersection content, and the first vertex is a top-left corner vertex of the fourth selection region. The data transmission method of claim 21, wherein, The second text region corresponding to the ending position is determined, including: A text region closest to the ending position among the intersection content intersecting with the boundary of the fourth selection region is taken as the second text region corresponding to the ending position, the ending position is a position corresponding to a second text closest to a second vertex of the fourth selection region in the intersection content, and the second vertex is a bottom-right corner vertex of the fourth selection region. The data transmission method of claim 21, wherein, The method further includes: The starting position of the fourth selection region is taken as the starting position of the fifth selection region, and a first mark is displayed at the starting position of the fifth selection region; The ending position of the fourth selection region is taken as the ending position of the fifth selection region, and a second mark is displayed at the ending position of the fifth selection region; Text in the fifth selection region within a range of the first mark and the second mark is set to a selected state. The data transmission method of claim 24, wherein, The content in the fifth selection region is transmitted through an application and / or a service corresponding to an icon selected by a user, including: Text in the fifth selection region in a selected state is transmitted through an application and / or a service corresponding to an icon selected by a user. The data transmission method of claim 16, wherein, The content in the fifth selection region is transmitted through an application and / or a service corresponding to an icon selected by a user in response to an eleventh operation of the fifth selection region by a user, including: In response to a long-press operation of the fifth selection region by a user, content of the fifth selection region is dragged up. In response to the operation of the user dragging the content of the fifth selection area to the application and / or service icon after the dragging, the content of the fifth selection area is transmitted through the application and / or service corresponding to the application and / or service icon. The data transmission method of claim 16, wherein, The transmitting the content in the fifth selection area through the application and / or service corresponding to the icon selected by the user in response to the eleventh operation of the user on the fifth selection area includes: In response to the touch operation of the user on the application and / or service icon, the content of the fifth selection area is transmitted through the application and / or service corresponding to the application and / or service icon. The data transmission method of claim 16, wherein, The method further includes: displaying a text and image switching control on the tenth interface; if the text and image switching control is in an unselected state, in response to the touch operation of the user on the text and image switching control, setting the text and image switching control to be displayed in a selected state, and performing text recognition on the content in the fifth selection area; determining an application or a service corresponding to the text recognition result; displaying the determined application icon or service icon on the tenth interface. The data transmission method of claim 28, wherein, The method further includes: if the text and image switching control is in a selected state, in response to the touch operation of the user on the text and image switching control, setting the text and image switching control to be displayed in an unselected state, and taking a screenshot of the content in the fifth selection area as a picture; determining an application or a service corresponding to the picture; displaying the determined application icon or service icon on the tenth interface. The data transmission method of claim 16, wherein, The method further includes: displaying an editing control on the tenth interface; in response to the touch operation of the user on the editing control, displaying an editing interface, the editing interface being used for editing the content in the fifth selection area. An electronic device, characterized by comprising: The electronic device includes a memory and a processor, the memory and the processor being coupled; the memory stores program instructions, and the program instructions are executed by the processor to cause the electronic device to perform the information transmission method according to any one of claims 1 to 30. A computer-readable storage medium, characterized by, The computer program, when executed on an electronic device, causes the electronic device to perform the information transmission method according to any one of claims 1 to 30.

Images