Data transmission method, related device
By detecting the start and end points of drag operations, combined with light strip guidance and door opening hot zones, the intelligent flow service is triggered, solving the problems of complex data transmission operations and accidental triggering of the menu bar. This enables intuitive data transmission across applications and improves the user experience.
Patent Information
- Application Number
- CN202510319565.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-29
- Publication Date
- 2026-01-06
- Estimated Expiration
- 2043-06-29
AI Technical Summary
In existing technologies, data transmission on electronic devices is complex and unintuitive, and is prone to accidental triggering of menus.
By detecting the start and end points of the drag operation, combined with light strip guidance and door opening hot zones, the intelligent flow service is triggered, the menu bar is displayed, and cross-application data transmission is achieved.
It provides a convenient, simple, and fast data transmission solution, reducing the probability of accidentally triggering the menu bar and improving the user experience.
Smart Images

Figure CN120196259B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of terminal, and in particular, to a data transmission method and related device. BACKGROUND
[0002] When a user uses an electronic device such as a mobile phone, there is often a need to transmit data such as text, pictures, files, and videos. For example, the user wants to transmit a photo in a photo gallery to a contact in a social software, or transmit text in a browser to a translation software for translation, and so on. Providing a convenient, simple, and intuitive data transmission solution for the user is the current and future research direction. SUMMARY
[0003] The present application provides a data transmission method and related device, which facilitates the user to transmit data when needed.
[0004] In a first aspect, a data transmission method is provided, which can include: displaying a first interface, the first interface including a first element; detecting a drag operation on the first element;
[0005] When the drag operation is a first drag operation, a touch starting point of the first drag operation is on the first element and located in a first area of a display screen, and a touch ending point is located in a second area of the display screen, a first menu bar is displayed, the first menu bar including an icon of a first application and an icon of a second application, the first area and the second area do not overlap; after detecting an operation of continuing to drag the first element into an area where the icon of the first application is located and releasing, transmitting first data corresponding to the first element to the first application;
[0006] When the drag operation is a second drag operation, a touch starting point of the second drag operation is on the first element and located in the second area, and a touch ending point is located in the second area of the display screen, a track of the second drag operation is located in the second area, and the first menu bar is not displayed;
[0007] When the drag operation is a third drag operation, a touch starting point of the third drag operation is on the first element and located in the second area, and a touch ending point is located in the second area, a track of the third drag operation passes through the first area, and the first menu bar is displayed.
[0008] The method of the first aspect is implemented, and the electronic device displays the first menu bar after detecting an operation of dragging the first element from the first area to the second area, or detecting an operation of dragging the first element from the second area to the first area and then to the second area, while the electronic device does not display the first menu bar after detecting an operation of dragging the first element in the second area, which can provide a convenient, simple, fast, smooth, and intuitive data transmission solution for the user, facilitate the user to transmit data when needed, and avoid displaying the first menu bar when the touch point is located in the second area for the first time to achieve an anti-mis-touch effect.
[0009] In conjunction with the first aspect, in some embodiments, when the drag operation is a first drag operation, a first menu bar is displayed in response to the first drag operation; when the drag operation is a second drag operation, the first menu bar is displayed without responding to the second drag operation; and when the drag operation is a third drag operation, the first menu bar is displayed in response to the third drag operation.
[0010] In conjunction with the first aspect, in some implementations, when the drag operation is a first drag operation, the first menu bar is displayed after the touch endpoint of the first drag operation stays in the second area for a first duration; when the drag operation is a second drag operation, the first menu bar is not displayed after the touch endpoint of the second drag operation stays in the second area for a first duration; when the drag operation is a third drag operation, the first menu bar is displayed after the touch endpoint of the third drag operation stays in the second area for a first duration. The touch endpoint staying in the second area for a first duration can be considered as a user having a data transmission need; therefore, displaying the first menu bar again allows the electronic device to provide data transmission services to the user more accurately and avoids accidental triggering of the first menu bar.
[0011] In conjunction with the first aspect, in some implementations, the first drag operation and the operation of continuing to drag the first element into the area where the icon of the first application is located and releasing it are continuous and uninterrupted.
[0012] In conjunction with the first aspect, in some embodiments, before displaying the first interface, the method may further include: displaying a second interface, the second interface including text; detecting an operation that selects the first text, displaying a toolbar on the first text, the toolbar including multiple controls for processing the first text; displaying the first interface, including: detecting a long-press operation applied to the first text, stopping the display of the toolbar, and displaying the first interface; wherein, the first element includes a preview image of the first text, and the first data includes the first text. Essentially, the electronic device can conveniently transmit the text selected by the user.
[0013] In conjunction with the first aspect, in some embodiments, before displaying the first interface, the method may further include: detecting a screenshot operation while displaying the second interface; displaying the first interface includes: in response to the screenshot operation, displaying the first interface, wherein the first element includes a preview image of the screenshot of the second interface, and the first data includes the screenshot image. Essentially, the electronic device can conveniently transmit screenshots.
[0014] In conjunction with the first aspect, in some embodiments, before displaying the first interface, the method may further include: displaying a second interface, the second interface including icons of the first image and the second image; detecting an operation of selecting the icon of the first image; displaying the first interface, including: detecting a long-press operation applied to the icon of the first image, and displaying the first interface; wherein, the first element includes a preview image of the icon of the first image, and the first data includes the first image. Essentially, the electronic device can conveniently transmit images, which may include types such as pictures, GIFs, and videos.
[0015] In conjunction with the first aspect, in some embodiments, the first menu bar and the second area where the touch endpoint of the first or third drag operation is located are on the same side of the display screen. That is, the electronic device displays the first menu bar in the direction in which the user drags the first element, which can provide the user with a better user experience.
[0016] In conjunction with the first aspect, in some embodiments, when the drag operation is a first drag operation, or when the drag operation is a third drag operation, the first interface is also adjusted to a first-side perspective style when the first menu bar is displayed, where the first side is the side of the first menu bar on the display screen. In this way, the first interface and the first menu bar in the first-side perspective style can visually form an "opening door" effect.
[0017] In conjunction with the first aspect, in some embodiments, the first interface further includes a playing video, and the method may further include: when the drag operation is a first drag operation, or when the drag operation is a third drag operation, displaying a screenshot of the first interface when the first menu bar is displayed, and the screenshot of the first interface is displayed in a perspective style of a first side, where the first side is one side of the first menu bar on the display screen.
[0018] In conjunction with the first aspect, in some embodiments, the second region includes: a rectangular region at the left edge of the display screen, and a rectangular region at the right edge of the display screen, the height of the rectangular region being the same as the height of the display screen.
[0019] In conjunction with the first aspect, in some embodiments, when the drag operation is a first drag operation, the trajectory of the first drag operation passes through a third region, the third region including the second region; the method may further include: in response to the operation of dragging a first element to the third region in the first drag operation, displaying a light strip, the light strip and the first menu bar being located on the same side of the display screen; displaying the first menu bar includes: in response to the operation of dragging the first element to the third region and then dragging it to the second region in the first drag operation, stopping the display of the light strip and displaying the first menu bar. The electronic device displays a light strip, which can prompt the user to continue dragging in the same direction to trigger the display of the first menu bar, thereby transmitting data.
[0020] In some implementations, the third region includes a rectangular region at the left edge of the display screen and a rectangular region at the right edge of the display screen, the height of the third region being the same as the height of the display screen.
[0021] In conjunction with the first aspect, in some embodiments, the first menu bar further includes icons for a third application and a fourth application, arranged sequentially from top to bottom: icons for the first application, the second application, the third application, and the fourth application; after displaying the first menu bar, the method may further include: detecting a fourth drag operation that continues to drag the first element within a fourth region, the fourth region including a second region where the touch endpoint of the first or third drag operation is located, the touch start point of the fourth drag operation being the same as the touch endpoint of the first or third drag operation, and the touch endpoint of the fourth drag operation being closest to the icon of the second application in the first menu bar; in response to the fourth drag operation, displaying the icon of the fourth application at its base size, displaying the icon of the second application at a size enlarged by a first ratio on top of the base size, and displaying the icons of the first and third applications at a size enlarged by a second ratio on top of the base size; the first ratio being greater than the second ratio.
[0022] In the above implementation, the closer the user's touch point and the display screen are to the application icon in the first menu bar, the larger the corresponding application icon can be. This creates the effect of the application icon in the first menu bar being attracted by the user's finger, and by enlarging the size of the application icon, the user's attention can be drawn to the corresponding application icon.
[0023] In conjunction with the previous embodiment, the fourth region includes a rectangular region containing the touch endpoint of the first drag operation or the third drag operation, and the height of the fourth region is the same as the height of the display screen.
[0024] In conjunction with the first aspect, in some embodiments, after detecting a fourth drag operation that continues to drag the first element within the fourth region, the method may further include: detecting a fifth drag operation that continues to drag the first element to a fifth region, wherein the fifth region and the fourth region do not overlap; and in response to the fifth drag operation, displaying each icon in the first menu bar at its base size.
[0025] In conjunction with the first aspect, in some embodiments, when the drag operation is a first drag operation, or when the drag operation is a third drag operation, after displaying the first menu bar, the method may further include: detecting a sixth drag operation that continues to drag the first element to a sixth region, the sixth region and the second region not overlapping, and the sixth region being located on opposite sides of the first menu bar in the display screen; and stopping the display of the first menu bar in response to the sixth drag operation.
[0026] Through the above implementation method, the electronic device provides a sixth area for stopping the display of the first menu bar. After the user accidentally triggers the display of the first menu bar, the user can easily, conveniently and quickly stop the erroneous operation.
[0027] In some implementations, the touch start point of the sixth drag operation is the same as the touch end point of the first or third drag operation, meaning the sixth drag operation is continuous and uninterrupted with the first or third drag operation. This allows the user to avoid accidental operations by maintaining continuous contact with the screen without removing their finger.
[0028] In some implementations, the sixth region and the fifth region do not overlap.
[0029] In conjunction with the first aspect, in some embodiments, the method may further include: displaying a third interface, the third interface including a second element; detecting a drag operation on the second element; when the drag operation is a seventh drag operation, the touch start point of the seventh drag operation is on the second element and located in the seventh area of the display screen, and the touch end point is located in the eighth area of the display screen, displaying a second menu bar, wherein the seventh area and the eighth area do not overlap; when the drag operation is an eighth drag operation, the touch start point of the eighth drag operation is on the second element and located in the eighth area, and the touch end point is located in the eighth area of the display screen, and the trajectory of the eighth drag operation passes through the seventh area, displaying the second menu bar; when the drag operation is neither a seventh nor an eighth drag operation, not displaying the second menu bar; wherein the eighth area is a portion of the second area.
[0030] The above implementation method is equivalent to reducing the area used to trigger the display of the menu bar from the second area to the eighth area. By reducing this area, the probability of users accidentally triggering the menu bar can be reduced.
[0031] In some implementations, the eighth region includes: a rectangular region on the left edge of the display screen, and a rectangular region on the right edge of the display screen; the height of the eighth region is the same as the height of the second region, and the width of the eighth region is half the width of the second region.
[0032] In some implementations, the third interface is provided by a fifth application, which may include a text editing application.
[0033] In some implementations, the icons of the applications included in the second menu bar may be different from those included in the first menu bar. Specifically, the icons in the first menu bar may include icons of applications that support receiving the first data, and the icons in the second menu bar may include icons of applications that support receiving the second data corresponding to the second element.
[0034] In conjunction with the first aspect, in some embodiments, the second area of the display screen in landscape mode is different from the second area of the display screen in portrait mode.
[0035] In conjunction with the first aspect, in some implementations, the first interface is provided by a sixth application, which is different from the first application. Essentially, this method enables data transfer across applications.
[0036] In a second aspect, an electronic device is provided, comprising: a memory and one or more processors; the memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, and the one or more processors invoking the computer instructions to cause the electronic device to perform a method performed by the electronic device as described in the first aspect or any embodiment of the first aspect.
[0037] Thirdly, a computer-readable storage medium is provided, including instructions that, when executed on an electronic device, cause the electronic device to perform a method performed by the electronic device as described in the first aspect or any embodiment of the first aspect.
[0038] Fourthly, a computer program product is provided that, when run on a computer, causes the computer to perform a method performed by an electronic device as described in the first aspect or any embodiment of the first aspect.
[0039] Fifthly, a chip system is provided, the chip system including at least one processor for implementing the methods performed by an electronic device as described in the first aspect or any embodiment of the first aspect. Attached Figure Description
[0040] FIGS. 1A-1N A set of user interfaces for implementing data transmission on an electronic device, provided for embodiments of this application;
[0041] FIG. 2 A schematic diagram of various hot zones of a mobile phone in portrait mode, provided in an embodiment of this application;
[0042] FIG. 3 This is a schematic diagram of the hot zone of a mobile phone in landscape mode, provided in an embodiment of this application.
[0043] FIGS. 4A-4F A user interface for a set of transmission screenshots provided in the embodiments of this application;
[0044] FIG. 4G A user interface for preventing accidental touches provided in this application embodiment;
[0045] FIGS. 4H-4L Another user interface for preventing accidental touches provided in the embodiments of this application;
[0046] FIGS. 4M-4R Another user interface for preventing accidental touches provided in the embodiments of this application;
[0047] FIGS. 5A-5B A set of user interfaces for moving floating windows provided in the embodiments of this application;
[0048] FIGS. 5C-5L This application provides a user interface for preventing accidental touches in a floating window scenario.
[0049] FIG. 6 A hardware structure block diagram of the electronic device provided in the embodiments of this application;
[0050] FIG. 7 The software architecture of the electronic device provided in the embodiments of this application. Detailed Implementation
[0051] The technical solutions in the embodiments of this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the word "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.
[0052] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.
[0053] The term "user interface (UI)" used in the following embodiments of this application refers to the medium interface through which an application or operating system interacts and exchanges information with a user. It realizes the conversion between the internal form of information and the form that the user can accept. The user interface is source code written in a specific computer language such as Java or Extensible Markup Language (XML). The interface source code is parsed and rendered on the electronic device, ultimately presenting content that the user can recognize. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be visible interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of an electronic device.
[0054] The following embodiments of this application provide a data transmission method and related equipment.
[0055] This method can be applied to electronic devices, which are smart terminal devices and can be of various types. This application does not limit the specific type of such device. For example, the electronic device can be a mobile phone, and may also include tablet computers, desktop computers, laptops, handheld computers, smart screens, wearable devices, augmented reality (AR) devices, virtual reality (VR) devices, artificial intelligence (AI) devices, in-vehicle systems, smart headphones, game consoles, and may also be Internet of Things (IoT) devices or smart home devices such as smart TVs, etc.
[0056] In this method, after acquiring the data to be transmitted, the electronic device generates a corresponding floating element. When the electronic device detects that the user drags this floating element into a preset hotspot, it triggers a smart transfer service, displaying icons of one or more applications that can receive the transmitted data. Subsequently, the electronic device detects continuous dragging of the floating element to the area of any application icon and release, and then sends the transmitted data to the corresponding application.
[0057] This method provides users with a convenient, simple, fast, smooth, and intuitive data transmission solution, making it easy for users to transmit data when needed and improving the user's terminal experience.
[0058] The dragging operation mentioned in this method can be performed by the user's finger or by information input devices such as a stylus or mouse.
[0059] First, let's introduce several concepts involved in the data transmission method provided in this application, as follows:
[0060] Data to be transmitted
[0061] The data to be transmitted can be stored locally on the electronic device, such as in the storage path corresponding to some applications (e.g., the image gallery) on the electronic device, or it can be stored on a cloud device.
[0062] The data to be transmitted can include various types; some examples are listed below:
[0063] (1) Text. Text can be text displayed on web pages on electronic devices, text in browsers, text in social software, text recognized from images (such as images stored in the gallery of electronic devices, screenshots, etc.), text converted from speech, etc.
[0064] (2) Documents. Documents may include text documents, table documents, code documents, etc.
[0065] (3) Images. Images may include static images or animated images. Images may also include full-screen screenshots, partial screenshots (i.e., screenshots of irregular shapes), edited screenshots, etc.
[0066] (4) Video. Video may include videos shot by electronic devices, videos downloaded from the Internet, screen recordings, etc.
[0067] (5) Hyperlinks.
[0068] Floating elements
[0069] Electronic devices can display data to be transmitted. After the user inputs a user action (such as a long press) on this data, the electronic device can generate the corresponding floating element.
[0070] A floating element is an element displayed on the screen that floats above other interface elements and can be dragged to any position on the screen by the user. A floating element can be a thumbnail or preview of the corresponding data to be transmitted, or it can be in other forms such as a name, a label, or part or all of the data to be transmitted; this application does not limit this.
[0071] Hot Zone
[0072] A hot zone is a region on the display screen of an electronic device that is used to trigger a specific function.
[0073] The data transmission method provided in this application can involve multiple hot zones used to trigger different functions during execution, which will be described in detail later. The size (i.e., dimensions), position, and shape of each hot zone in this application can be set according to user needs and user experience.
[0074] The various hot zones provided in this application are areas that the electronic device handles automatically and do not require notification to the user. In other words, the electronic device does not need to display the various hot zones on the screen to the user.
[0075] In some implementations, when an electronic device uses the function corresponding to a hot zone for the first time, the electronic device can provide usage instructions to inform the user of the location of each hot zone and the specific functions that it can trigger.
[0076] In other implementations, electronic devices may also highlight hot zones to the user. For example, each hot zone may be highlighted using shadows, colors, or other methods to make it known to the user.
[0077] Smart circulation services
[0078] The intelligent data transfer service is a system service or function provided by the electronic device in this application, which enables the electronic device to conveniently transfer data from one application to another. Specifically, the intelligent data transfer service allows the electronic device to display one or more icons of applications that can be used to receive the data to be transferred on the display screen, and after detecting an operation of continuously dragging a floating element to the area where any application icon is located and releasing it, the data to be transferred is sent to the corresponding application.
[0079] "Intelligent workflow service" is merely a term used in this embodiment, and its meaning has been described in this embodiment. Its name does not constitute any limitation on this embodiment. Furthermore, in other embodiments of this application, "intelligent workflow service" may also be referred to as other terms such as "anywhere door."
[0080] The data transmission method is described below using the exemplary UI provided in this application.
[0081] FIGS. 1A-1N A set of user interfaces for implementing data transmission on electronic device 100.
[0082] Generate floating elements
[0083] FIG. 1A This is a user interface provided in the embodiments of this application.
[0084] The application providing this user interface can be a system application or a third-party application. In this embodiment, a system application refers to an application directly provided by the operating system of the electronic device 100 to achieve a specific function. A third-party application refers to an application provided by other developers and obtained by the electronic device 100 through the Internet to achieve a specific function.
[0085] In some embodiments, the aforementioned user interface may also be the main interface (homepage), negative one screen, lock screen, etc. of the electronic device 100, and this application does not limit it in this regard.
[0086] In display FIG. 1A During the user interface process shown, the electronic device 100 can detect a long-press operation applied to the display screen. This is not limited to long-press operations; it can also include double-click operations, swipe operations along a preset trajectory, and other user operations. In response to the above operations, the electronic device 100 can acquire the text in the area where the long-press operation is located in the user interface and display the following on this text: a text selection box, drag bars for the start and end positions of the text selection box, and a toolbar above the text selection box. When the electronic device 100 initially detects a long-press operation, it may only display the text selection box on a small portion of the text (e.g., 1-2 characters in the area where the touch point of the long-press operation is located). The drag bars for the start and end positions of the text selection box can be dragged by the user to adjust the size of the text selection box, i.e., adjust the selected text. The toolbar may include multiple controls for processing the selected text, such as cut, copy, paste, and share controls.
[0087] Then, the electronic device 100 can detect user actions that adjust the selected text (such as dragging the start or end position of the text selection box to adjust the area or size of the text selection box). Based on these user actions, the electronic device 100 can determine the target text the user wants to select. (Reference) FIG. 1B For example, the user adjusts the text selection box to FIG. 1B After determining the size shown, the electronic device 100 can determine the target text 111 based on user operation.
[0088] refer to FIGS. 1C-1D After identifying the target text 111, the electronic device 100 can detect a long press operation applied to the target text 111. In response to the operation, the electronic device 100 can display a control 112 corresponding to the floating state of the target text 111. The control 112 can be located at the touch point position on the display screen when the user inputs the long press operation.
[0089] In some implementations, in response to a long press operation on the target text 111, the electronic device can generate a floating control 112 using the touch point on the display screen where the long press operation is performed as an anchor point. Using a touch point as an anchor point means that a certain position point of the control 112 (such as the upper center, the middle point of the top edge, the center point, the middle point of the right edge, or other points) is located at the anchor point. FIG. 1D The example given is a position on the right side of control 112 near the anchor point.
[0090] Optionally, the control 112 may display the aforementioned target text 111. In some embodiments, when the target text 111 contains a large amount of content, the control 112 may display a portion of the target text 111, such as the first sentence of the target text 111, or a summary of the target text 111. In some embodiments, the control 112 may also be implemented as a preview image or thumbnail of the target text 111.
[0091] FIG. 1D The floating control 112 generated in the middle is the floating element in this application.
[0092] The floating control 112 can adjust its display position in real time according to the user's drag operation on the control 112.
[0093] In some implementations, when a user drags control 112, if the touch point enters the edge of the display screen, part of the content of control 112 may extend beyond the screen and not be displayed. Alternatively, the electronic device may reduce the size of control 112 to avoid incomplete display.
[0094] refer to FIG. 1D After the electronic device generates the floating control 112, the text selection box below it remains displayed to keep the corresponding text selected. However, the drag bars for the start and end positions of the text selection box, as well as the toolbar above the text selection box, are no longer displayed. In some embodiments, when the electronic device generates the floating control 112, it can also output a vibration signal to prompt the user that the floating control 112 can be dragged.
[0095] Light band guides the hot zone
[0096] The display screen features a corresponding light strip guide area. This guide area is used to trigger the light strip effect in the direction the smart flow service is triggered.
[0097] refer to FIG. 1D After the electronic device 100 generates the floating control 112, the electronic device 100 generates a light strip to guide the hot zone. For example... FIG. 1DAs shown, the light strip guiding the hot zone may include area 113A, bounded by the dashed line L1 on the left side of the display screen and the top edge E1, left edge E3, and bottom edge E2 of the display screen, and area 113B, bounded by the dashed line L2 on the right side of the display screen and the top edge E1, right edge E4, and bottom edge E2 of the display screen. The height of areas 113A and 113B is the same as the height of the display screen, and the width of each area can be 25% of the width of the display screen x.
[0098] refer to FIGS. 1D-1E The electronic device 100 can detect a user operation where the user drags the control 112 to the right edge of the display screen. After detecting that the user's finger touches the light guide heat zone 113B on the right side of the display screen, the electronic device 100 can display something like this on the right edge of the display screen. FIG. 1F The light strip 114 is shown. Alternatively, the electronic device 100 can display the light strip after detecting that a user's finger touches the light strip guide area 113B on the right side of the display screen and remains in the light strip guide area 113B for a certain period of time (e.g., 600ms). The long press operation for generating the floating state control 112, and the dragging operation for the control 112, can be a continuous uninterrupted operation or two operations with an interval in between.
[0099] The light strip 114 can be a strip-shaped interface element with attributes such as color, shadow, gradient, and graphic fill (e.g., grid fill, diagonal fill). In some implementations, the light strip 114 can also present dynamic effects, such as changing colors, flashing, etc.
[0100] The light strip 114 on the right edge of the display screen can be used to indicate the following information: 1. The current control 112 has been dragged to the right side of the display screen; 2. The direction of dragging to the right is the direction of dragging to trigger the smart flow service, that is, if the user continues to drag the control 112 to the right, the smart flow service can be triggered.
[0101] refer to FIGS. 1D-1E As shown, when the control 112 is dragged and slid, the electronic device 100 can reduce the size of the control 112 to reduce obstruction of other content on the display screen.
[0102] In other embodiments, if the electronic device 100 detects that the user will FIG. 1D If the control 112 is dragged to the light guide area 113A on the left side of the display screen, the electronic device 100 can display a light strip on the left edge of the display screen. This light strip can be used to indicate the following information: 1. The control 112 has been dragged to the left side of the display screen; 2. The direction of dragging to the left is the direction that triggers the intelligent flow service, that is, if the user continues to drag the control 112 to the left, the intelligent flow service can be triggered.
[0103] In other words, dragging control 112 to the left or right side of the light strip guide area on the display screen will trigger the display of the light strip.
[0104] Hot Zone
[0105] The display screen shows a corresponding door opening hotspot. This hotspot is used to trigger the intelligent workflow service.
[0106] refer to FIG. 1G After the electronic device 100 generates the floating control 112, the electronic device 100 generates a door opening hot zone. For example... FIG. 1G As shown, the door opening hot zone can include area 115A, bounded by the dashed line L3 on the left side of the display screen and the top edge E1, left edge E3, and bottom edge E2 of the display screen; and area 115B, bounded by the dashed line L4 on the right side of the display screen and the top edge E1, right edge E4, and bottom edge E2 of the display screen. The height of areas 115A and 115B is the same as the height of the display screen, and the width of each area can occupy 40% of the display screen width (density-independent pixel, dp). Here, dp is an abstract unit based on screen density; 1dp * pixel density / 160 = actual number of pixels. Therefore, the width of areas 115A and 115B is related to the pixel density of the display screen; the higher the pixel density, the larger the width.
[0107] refer to FIGS. 1F-1G The electronic device 100 can detect user actions, such as dragging the control 112 further to the right side of the display screen. Upon detecting that the user's finger touch point on the display screen enters the door opening hot zone 115B on the right side of the display screen, the electronic device 100 can stop displaying the light strip and trigger the intelligent flow service. Alternatively, upon detecting that the user's finger touch point on the display screen enters the door opening hot zone 115B on the right side of the display screen and remains in the door opening hot zone 115B for a certain period of time (e.g., 600ms), the electronic device 100 can stop displaying the light strip and trigger the intelligent flow service. This duration can be set as needed and is not limited here.
[0108] Smart data transfer service refers to an electronic device 100 being matched with an application capable of receiving data to be transferred, providing users with a service to quickly send the data to other target applications. The data corresponding to the floating element that the user interacts with when the smart data transfer service is triggered is the data to be transferred. For example, in... FIGS. 1F-1H In the scenario shown where the drag control 112 is slid to the right to enter the right-side door opening hot zone 115B to trigger the smart transfer service, the target text 111 corresponding to the control 112 is the data to be transmitted.
[0109] refer to FIG. 1HAfter detecting that a user's finger touches the right side of the display screen and enters the door opening hot zone 115B, or after detecting that a user's finger touches the right side of the display screen and remains in the door opening hot zone 115B for a certain period of time (e.g., 600ms), the electronic device 100 may display a menu bar 116 on the right side of the display screen, which includes icons of one or more candidate applications. This period of time may be referred to as the first duration.
[0110] The menu bar 116 may include icons for favorites, search, share, notes, and SMS. The favorites icon corresponds to a system application, providing global system favorites functionality. The notes icon corresponds to a note-taking application, which can be a system application or a third-party application, providing in-app recording and favorites functions. Candidate applications are those selected by the electronic device 100 from all installed applications that support receiving the data to be transmitted. The electronic device 100 can determine candidate applications based on the information type and semantic information of the data to be transmitted. Candidate applications may include global applications that support receiving any type of data (such as favorites applications, search applications, share applications, email applications, etc.), or applications that only support receiving certain types of data (such as image editing applications that only support receiving images, navigation applications that only support receiving text, etc.). Different types of data to be transmitted can correspond to different menu bars.
[0111] In some implementations, when the electronic device 100 displays the menu bar 116, the control 112 can be further scaled to avoid obscuring the menu bar 116. For example, the electronic device can shrink the control 112 so that its height matches the height of the candidate application icons in the menu bar 116.
[0112] refer to FIG. 1H The electronic device 100 displays a menu bar 116 containing icons of candidate applications on the right side of the screen. Simultaneously, the electronic device 100 can adjust the original foreground user interface to a right-perspective style, visually creating an "opening door" animation effect with the menu bar 116. This foreground user interface can refer to the interface displayed on the screen excluding the status bar, or it can refer to all content displayed on the screen including the status bar.
[0113] If the original user interface displayed by the electronic device 100 includes dynamic effects, such as videos or animated GIFs, the electronic device can take a screenshot of that user interface and then adjust the screenshot to a perspective style. That is, the perspective-style interface can be a screenshot processed by the electronic device's operating system. In other implementations, the electronic device can also adjust the original user interface to a perspective style and continue playing dynamic effects within that perspective-style user interface, such as continuing to play videos or animated GIFs.
[0114] In other embodiments, if the electronic device 100 detects that the user will FIGS. 1D-1F If the control 112 in the display is dragged to the door opening hot zone 115A on the left side of the display screen, the electronic device 100 can display a menu bar containing icons of candidate applications on the left side of the display screen, and adjust the original front-end user interface to a left perspective style, forming an "opening" animation effect with the menu bar.
[0115] In other words, dragging control 112 to the left edge of the display screen or to the right side of the door opening hot zone will trigger the "door opening" animation and also trigger the smart circulation service.
[0116] The width of the door opening area can be narrower than the width of the light strip guidance area. In this way, when the electronic device 100 drags the control 112, it will first enter the light strip guidance area to trigger the guidance light strip effect, and then enter the door opening area to trigger the smart circulation service.
[0117] hover to zoom in on the hot zone
[0118] The display screen shows a corresponding hover zoom-in area. The hover zoom-in area is used to trigger the approach hover animation.
[0119] refer to FIG. 1H After the electronic device 100 displays the menu bar 116, a hover zoom-in hotspot is generated. For example... FIG. 1H As shown, the hover amplification hotspot may include the area 117 enclosed by the dashed line L5 on the right side of the display and the top edge E1, right edge E4, and bottom edge E2 of the display. The height of the area 117 is the same as the height of the display, and the width can be 120dp of the width of the display.
[0120] The proximity hover effect refers to the following: after the user drags the control 112 into the hover zoom zone on the screen, the icon of the candidate application closest to the touch point in the menu bar 116 is enlarged in its basic size, and the adjacent application icons before and after the candidate application icon are also enlarged accordingly, but to a lesser extent than the enlargement of the candidate application icon.
[0121] The base size can be set as needed and is not limited here. The icon of the candidate application closest to the touch point can be enlarged to a first ratio of the base size (such as 150% or other ratios), and its enlarged state can be called the hover state. The app icon immediately before and after the icon of the candidate application closest to the touch point can be enlarged to a second ratio of the base size (such as 120% or other ratios), and its enlarged state can be called the proximity hover state. The first ratio is greater than the first and second ratios, and the first and second ratios can be preset.
[0122] Specifically, the electronic device first detects whether the touch point is located within the hover zoom area. If so, it determines the icon of the candidate application closest to the touch point. For example, electronic device 100 first determines the position of each candidate application icon (including its base size) on the display screen, then draws a straight line parallel to the horizontal direction of the display screen from the touch point; the icon of the candidate application that coincides with this line is the icon of the closest candidate application. As another example, electronic device 100 first determines the position of each candidate application icon (including its base size) on the display screen, then calculates the distance between the touch point and the center point of each candidate application icon; the icon of the candidate application with the smallest distance is the icon of the closest candidate application.
[0123] refer to FIG. 1H When the user's finger touches the hover zoom zone 117 on the display screen, and the touch point is closest to the note icon in the menu bar 116, the note icon is magnified, and the share icon and information icon adjacent to it are magnified in turn. The text at the bottom of the icon can also be magnified accordingly.
[0124] refer to FIG. 1I As the user continues to drag control 112, the touch point also moves accordingly. FIG. 1I At the location shown. FIG. 1I In the middle, the user's finger and the touch point of the display screen are closest to the search icon in the menu bar 116, so the share icon is enlarged, and the adjacent favorite icons and share icons are enlarged accordingly. The text at the bottom of the icons can also be enlarged accordingly.
[0125] from FIGS. 1H-1I As can be seen, in the near-hover animation, the closer the user's and the screen's touch point is to the candidate application icon in the menu bar 116, the larger the corresponding candidate application icon can be. This creates the effect of the candidate application icon in the menu bar 116 being attracted by the user's finger, and by enlarging the size of the application icon, the user's attention can be drawn to the corresponding candidate application icon.
[0126] In some implementations, the electronic device 100 may first display the icons of candidate applications at their base size, and then enlarge the icons of some candidate applications based on the position of the touch point in the hover zoom-in area, presenting a dynamic change process. In other implementations, the processing speed of the electronic device 100 is fast enough that it is not necessary to first display the icons of candidate applications at their base size, but can directly display the enlarged icons of some candidate applications based on the position of the touch point in the hover zoom-in area.
[0127] In other embodiments, if the electronic device 100 displays a menu bar containing icons of candidate applications on the left side of the display screen, adjusting the original foreground user interface to a left perspective style, the electronic device 100 generates a hover zoom-in hotspot on the left side of the display screen. This hover zoom-in hotspot on the left side of the display screen can be used to trigger hover animations of the menu bar on the left side of the display screen.
[0128] Essentially, the left and right sides of the display screen in electronic device 100 can both include hover hotspots, both of which can trigger hover animations. The hover hotspot is always located in the direction of the menu bar on the display screen.
[0129] In addition to the proximity hover animation triggered by the hover hot zone described above, in some embodiments, after the user drags the control 112 into the hover magnification hot zone on the display screen, the electronic device can also perform other effects on the icon of the candidate application closest to the touch point in the menu bar 116, such as increasing the display brightness of the candidate application icon, marking the candidate application icon with a bright color, etc.
[0130] Closing hot zone
[0131] The electronic device 100 displays a menu bar containing icons of candidate applications on the side of the screen. After adjusting the original front-end user interface to a perspective style, i.e., after triggering the door opening effect, the screen corresponds to the door closing hot zone. The door closing hot zone is used to close the smart circulation service.
[0132] refer to FIG. 1J The electronic device 100 displays a menu bar 116 containing icons of candidate applications on the right side of the display screen. After adjusting the original foreground user interface to a right perspective style, the electronic device 100 generates a closing hot zone 118 enclosed by the dotted line L6 on the left side of the display screen and the top edge E1, left edge E3, and bottom edge E2 of the display screen. The height of the closing hot zone 118 is the same as the height of the display screen, and the width can be half the width of the display screen x.
[0133] refer to FIGS. 1J-1K The electronic device 100 can detect user operations where the user continues to drag the control 112 to the left side of the display screen.
[0134] like FIGS. 1I-1J As shown, the electronic device detects that the user drags control 112 from the hover zoom area 117 to a portion of the display screen that is outside the hover zoom area 117 and the door closing area 118, therefore the electronic device 100 stops displaying the approach hover effect. That is, refer to FIG. 1J All icons in menu bar 116 are the same size and are based on the same dimensions.
[0135] like FIG. 1K As shown, after detecting that a user's finger touches the closing hot zone 118 on the left side of the display screen, the electronic device 100 can close the smart scrolling service. Alternatively, after detecting that a user's finger touches the closing hot zone 118 on the left side of the display screen and remains in the closing hot zone 118 for a certain period of time (e.g., 600ms), the electronic device 100 can close the smart scrolling service. This duration can be set as needed and is not limited here.
[0136] refer to FIG. 1L Disabling the intelligent workflow service means that the electronic device 100 stops displaying the menu bar 116 on the right side of the screen, and changes the original front-end user interface (excluding the status bar) from a right-view perspective style to a non-perspective style. Combined with... FIG. 1K and FIG. 1L The style adjustment of the front-end user interface and the disappearance of the menu bar 116 can vividly create the animation effect of "closing the door".
[0137] In other embodiments, if the electronic device 100 displays a menu bar containing icons of candidate applications on the left side of the display screen and adjusts the original foreground user interface to a left perspective style, the electronic device 100 generates a closing hotspot on the right side of the display screen. This closing hotspot on the right side of the display screen can be used to trigger a "closing" animation of the menu bar on the left side of the display screen.
[0138] This means that the left and right sides of the display screen in electronic device 100 can both include a door-closing hot zone, which can trigger a "closing" animation. The door-closing hot zone is always located in the opposite direction of the menu bar on the display screen.
[0139] In this application, the above FIGS. 1E-1J During the dragging process of the drag control 112 shown, the user's finger and the display screen can remain in continuous contact, that is, the dragging operation can be continuous and uninterrupted.
[0140] After the electronic device 100 detects that a user's finger and the touch point of the display screen have entered the door opening hot zone and activates the smart flow service (i.e., displaying the menu bar 116), if the user's finger leaves the display screen, that is, if the electronic device no longer detects a touch point, the electronic device 100 will deactivate the smart flow service (i.e., stop displaying the menu bar 116). For example, if FIG. 1H If the finger touch point shown disappears, the electronic device will also stop displaying. FIG. 1H The menu bar 116 in the middle. That is to say, in this application, the user can turn off the smart circulation service either by closing the hot zone or by stopping the touch screen.
[0141] Transmit data
[0142] FIGS. 1M-1N The user interface for transferring data via the Smart Flow Service is shown.
[0143] refer to FIG. 1M After detecting that a user drags control 112 to the right-side door opening hot zone 115B and displays the menu bar 116, electronic device 100 can detect user actions such as the user continuing to drag control 112 to the area where any candidate application icon is located in the menu bar 116 and then releasing the drag. For details, refer to... FIG. 1M The electronic device 100 can detect the user's action of dragging the control 112 to the note-taking application icon and releasing it. The electronic device 100 can then confirm the note-taking application as the target application. After detecting the dragging of the control 112 to the note-taking application icon, the electronic device 100 can highlight the note-taking application icon, for example, by increasing its size, changing its color, increasing its brightness, or outputting a vibration signal, to prompt the user that the note-taking application is currently selected as the target application, thus preventing accidental transmission.
[0144] In some implementations, after the electronic device 100 detects the user's action of releasing the control 112 after it continues to drag the control 112 to the area where the icon of any candidate application is located in the menu bar 116, it can also display an animation of the control 112 being sucked into or absorbed into the icon of the corresponding candidate application, so as to prompt the user that the electronic device will transfer the data to be transferred to the corresponding candidate application.
[0145] Subsequently, the electronic device 100 can write the data to be transmitted (i.e., the target text 111) corresponding to the control 112 into the note-taking application.
[0146] refer to FIG. 1NAfter the target text 111 is written to the note-taking application, the electronic device 100 can close the menu bar 116 of the Smart Transfer service and redisplay the original user interface. Optionally, the electronic device 100 can also display a prompt window 119. The prompt window 119 can indicate to the user that the transfer was successful, that is, the data to be transferred selected by the user has been successfully written to the target application. The prompt window 119 may also include a control 120. The control 120 can be used to open the target application, such as a note-taking application, that received the aforementioned data to be transferred, so that the user can continue to edit the data written through the Smart Transfer service in the target application.
[0147] Not limited to FIG. 1N The electronic device 100 directly writes the data to be transmitted into the target application. In some other embodiments, after determining the target application, the electronic device 100 may also display a window provided by the target application. This window may display one or more options. The user can set how the data to be transmitted is used in the target application (such as printing parameters, sharing to contacts, etc.) according to the one or more options. Then, the target application can process the data to be transmitted according to the usage method set by the one or more options.
[0148] Various hot zones in a mobile phone
[0149] FIG. 2 Examples of various hot zones are shown on the phone in portrait mode.
[0150] exist FIG. 2 middle:
[0151] a shows the door opening hot zone, including two areas on the left and right sides of the display, each occupying 40dp of the display width.
[0152] b shows the light strip guiding the hot zone, including two areas on the left and right sides of the display, each occupying 1 / 4 of the display width.
[0153] c shows the hover zoomed-in hotspot when the door opens to the right, including an area on the right side of the display, occupying 120dp of the display width.
[0154] d shows the closing heat zone when the door is open to the right, including an area on the left side of the display, which occupies 1 / 2 of the width of the display.
[0155] e shows the hover-magnified heat area when the door opens to the left, including an area on the left side of the display, occupying 120dp of the display width.
[0156] f shows the closing heat area when the door is open to the left, including an area on the right side of the display, which occupies 1 / 2 of the width of the display.
[0157] Previous text FIGS. 1A-1N as well asFIG. 2 These examples all use mobile phones as a model, listing the various hot zones and functions of a mobile phone in portrait mode. In the embodiments of this application, the hot zones of an electronic device of the same form may differ in different states. These states may include portrait mode and landscape mode.
[0158] refer to FIG. 3 , FIG. 3 The following is an example illustrating the various hot zones of a mobile phone in landscape mode.
[0159] and FIGS. 1A-1N and FIG. 2 The vertical screen states are different, due to FIG. 3 When the phone is in landscape mode, the positions of each edge surface relative to the user change. FIG. 3 Each edge in the middle can correspond to FIGS. 1A-1N Edges with the same label in the middle.
[0160] exist FIG. 3 middle:
[0161] The area enclosed by dashed line L3 and display screen edges E1, E4, and E3, and the area enclosed by dashed line L4 and display screen edges E2, E4, and E3, are the door opening hot zones.
[0162] The area enclosed by dashed line L1 and display screen edges E1, E4, and E3, and the area enclosed by dashed line L2 and display screen edges E2, E4, and E3, are the light band guiding the heat zone.
[0163] The area enclosed by the dashed line L5 and the display screen edges E2, E4, and E3 is the hover amplification hot zone under the "right-opening door" effect;
[0164] The area enclosed by the dashed line L6 and the display screen edges E1, E4, and E3 is the closing hot zone under the "right-opening door" effect.
[0165] Of course, under the "left-opening door" effect, FIG. 3 The hover amplification heat zone and the door closing heat zone are both in the opposite direction shown so far.
[0166] Not limited to smartphones, other electronic devices such as foldable phones and tablets can also have different hot zones in landscape and portrait modes. The areas of each hot zone on the display screen are similar to those in smartphones, as described above; please refer to the relevant content previously.
[0167] The height of each of the aforementioned hot zones mentioned in this application can be measured as a percentage of the display screen height or as a percentage (dp) of the display screen height. The width is similar and is not limited here.
[0168] The names of the various hot zones mentioned in this application are merely examples, and the functions of each hot zone have been described above. Their names do not constitute a limitation on this application.
[0169] The size (i.e., dimensions), position, and shape of the various hot zones mentioned in the UI above are just examples. In actual implementation, the size (i.e., dimensions), position, and shape of the various hot zones in the electronic device can be set according to user needs and user experience. This application does not impose any specific restrictions on this.
[0170] The gray fill effect used to indicate the hot zones in the above UI embodiments is for illustrative purposes only. In the actual user interface presented to the user by the electronic device, the corresponding hot zones do not include the gray fill effect. That is, the electronic device does not need to indicate the location of each hot zone to the user; the user can perceive the existence of each hot zone while using its functions.
[0171] Preventing accidental touches in the door opening hot zone
[0172] FIGS. 4A-4F This shows one way to take a screenshot of the transmission.
[0173] refer to FIG. 4A In display FIG. 4A During the user interface process shown, the electronic device 100 can detect a screenshot operation. The screenshot operation can be implemented through physical buttons on the electronic device 100, such as the power button or volume buttons, or through touch operations on the display screen of the electronic device 100, such as a three-finger swipe down operation, etc. This application does not limit the scope of the screenshot operation.
[0174] In response to the aforementioned screenshot operation, the electronic device 100 can save a frame of the user interface on the display screen at the current moment, i.e., a screenshot. The electronic device 100 can write the screenshot to its memory for storage, so that the user can view the screenshot at any time through access operations.
[0175] In this embodiment of the application, the electronic device 100 may also display a preview of the above screenshot on the display screen to prompt the user to obtain a screenshot.
[0176] FIG. 4B It is the user interface on which an electronic device displays a screenshot preview on its screen. For example... FIG. 4B As shown, the electronic device 100 can display image 411 in the lower left corner of the display screen. Image 411 can be... FIG. 4AThe image shown is a screenshot preview of the user interface. Users can preview the screenshot obtained from the aforementioned screenshot operation through image 411. The lower left corner of the display screen can be referred to as the default screenshot display area. However, it is not limited to the lower left corner; the default screenshot display area can also be the upper right corner, lower right corner, upper left corner, etc., of the display screen, and this embodiment does not impose any limitations on this.
[0177] The electronic device 100 may maintain the display of image 411 for a period of time according to a preset timer. This period of time is, for example, 3 seconds. After the timer expires, the electronic device 100 may stop displaying image 411.
[0178] In this embodiment of the application, during the display of image 411, electronic device 100 can detect whether there is a user operation on image 411.
[0179] refer to FIG. 4C The electronic device 100 can detect a long press operation on the display screen (hereinafter referred to as a long press operation) applied to image 411, and the touch point of the user's finger is located in an area other than the door opening hot zone 412A and door opening hot zone 412B. In response to the above user operation, the electronic device 100 can switch image 411 to such... FIG. 4D The image 411 is shown in a floating state. The floating image 411 can adjust its display position in real time following the movement trajectory of the user's touch operation. The floating image 411 is the floating element of this application.
[0180] In some embodiments, after the electronic device 100 switches the image 411 to a floating state, the user interface may not display any prompts, meaning there appears to be no difference before and after the switch. In other embodiments, after the electronic device 100 switches the image 411 to a floating state, the user interface may display some prompts (e.g., FIG. 4D Add a black border to image 411 (or display other animations around image 411) to indicate to the user that image 411 can be dragged.
[0181] refer to FIGS. 4D-4E After generating the floating image 411, the electronic device 100 can detect the continuous dragging of the floating image 411 to the right side of the display screen to the door opening hot zone 412B. In response to this operation, the electronic device 100 can activate the smart flow service, that is, display a menu bar containing icons of multiple candidate applications on the right side of the display screen. Subsequently, the electronic device 100 can also detect the continued dragging of the floating image 411 into the area where the icon of a candidate application is located in the menu bar, and in response to this operation, send the original screenshot of image 411 to the application corresponding to the icon of that candidate application.
[0182] After a user triggers the electronic device 100 to generate a floating element, there may be various intentions. For example, the user may drag the floating element to the door opening area to trigger the smart flow service, or drag the floating element to other locations on the display screen (such as dragging a preview image of a screenshot, or dragging the text in a memo). The door opening area and other locations on the display screen may overlap. Therefore, when the user drags the floating element, the electronic device 100 needs to accurately identify the user's intention and respond to the user's needs accurately to avoid misoperation.
[0183] FIG. 4G A solution to prevent accidental touches is shown by reducing the hot zone when the door is opened.
[0184] FIG. 4G The user interface shown can be an electronic device that detects an action acting on... FIG. 4B The image 411 is displayed by long-pressing.
[0185] like FIG. 4G As shown, the door opening hot zone in the user interface includes: area 412A enclosed by dashed line L7, dashed line L8, and the upper edge E1 and left edge E3 of the display screen, and area 412B enclosed by dashed line L4 and the upper edge E1, right edge E4 and lower edge E2 of the display screen.
[0186] Compared to the conventional door opening hotspots before the anti-accidental touch solution was implemented (such as...) FIG. 1G or FIG. 4G (the hot zone in the middle) FIG. 4G The hot zone for opening doors has been adjusted in one or more of the following ways:
[0187] 1. Due to FIG. 4G The default screenshot display area of electronic devices is located in the lower left corner of the screen, therefore the width of the door opening hotspot 412A on the same side (i.e., the left side of the screen) is shorter than the width of the conventional door opening hotspot on the same side. For example, FIG. 4G The width of the hot zone 412A of the center-opening door can be FIG. 4C Half the width of the hot zone 412A of the center-opening door.
[0188] 2. Due to FIG. 4G The default screenshot display area of the electronic device is located in the lower left corner of the screen. Therefore, the height of the door opening hot zone 412A on the same side (i.e., the left side of the screen) can range from the top of the screen to a certain position in the middle of the screen, rather than being directly connected. For example, the height of the door opening hot zone 412A can range from the top of the screen to the top of the image 411.
[0189] The adjusted door opening hot zone, based on one or more of the above adjustments, is smaller than the regular door opening hot zone. When a user interacts with the floating image 411 (e.g., by long-pressing), the probability of the touch point directly entering the door opening hot zone is reduced, thus decreasing the probability of triggering the smart circulation service immediately after the floating image 411 is activated.
[0190] This allows users to more freely and conveniently choose to trigger the intelligent flow service or simply move the image 411's position on the display screen while dragging it. Specifically, the user can drag the image 411 to... FIG. 4G The smart circulation service can be triggered by opening the door in the left-hand door opening zone 412A or the right-hand door opening zone 412B. The user can drag image 411 to... FIG. 4G Outside the hot zone of the center-opening door, the position of image 411 on the display screen can be moved.
[0191] In other implementations, if the default screenshot display area is located in another area of the electronic device's display screen, the opening hotspot after generating the floating element can be adjusted accordingly based on the default screenshot display area. For example, if the default screenshot display area is located in the upper right corner, the width of the opening hotspot on the right side of the display screen can be half the width of the regular right-side opening hotspot, and its height extends from the top to the bottom of the screenshot preview.
[0192] FIGS. 4H-4L The solution demonstrates a method to prevent accidental activation by requiring two entries into the door opening hot zone to trigger the intelligent circulation service.
[0193] refer to FIG. 4H In response to the user's screenshot operation, the electronic device 100 displays image 411 in the lower left corner of the screen.
[0194] Subsequently, the electronic device 100 can detect a long press operation (hereinafter referred to as a long press operation) applied to image 411. In response to the aforementioned user operation, the electronic device 100 can switch image 411 to... FIG. 4I The suspended state shown.
[0195] like FIG. 4H As shown, when the electronic device 100 detects a long press operation on image 411, the user's finger touch point on the display screen is located in the door opening hot zone on the left side of the display screen. At this time, although the touch point enters the door opening hot zone, the electronic device will not trigger the smart circulation service, that is, it will not trigger the "door opening" animation.
[0196] refer to FIGS. 4I-4LThe electronic device 100 can detect user actions such as dragging image 411 outside the left-side door opening area and then dragging image 411 back to the left-side door opening area. The electronic device will only trigger the intelligent flow service, i.e., trigger the "door opening" animation, after detecting that the user's finger touch point on the display screen enters the door opening area for the second time.
[0197] refer to FIG. 4L , FIG. 4L The image shows the menu bar displayed after the electronic device triggers the smart circulation service, following the second entry of the user's finger into the door opening hot zone on the display screen.
[0198] As can be seen, after generating the floating element, if the user's finger touches the opening area on the screen for the first time, the intelligent flow service is not triggered. The intelligent flow service is only triggered when the user's finger moves out of the opening area and then re-enters it. Here, "the first touch point being in the opening area" means that the user's touch point on the screen used to make the element float is located within the opening area. The opening areas where the two touch points are located can be the opening areas on the left and right sides of the screen, or both on the same side.
[0199] This allows users to more freely and conveniently choose to trigger the intelligent flow service or simply move the image 411's position on the display screen while dragging it. Specifically, when the user drags the image 411 a second time... FIG. 4D The smart circulation service can be triggered by opening the hot zone in the middle; the user can drag image 411 directly to... FIG. 4D Outside the hot zone of the center-opening door, the position of image 411 on the display screen can be moved.
[0200] In other implementations, if the electronic device detects a long press operation on image 411 and the user's finger touch point on the display screen is outside the door opening hot zone, then the smart circulation service can be triggered after the electronic device detects that the user drags image 411 to the door opening hot zone for the first time.
[0201] In the above embodiments, the operation to trigger the smart circulation service, in addition to the touch point being located in the door opening hot zone, may also include staying in the door opening hot zone for a certain period of time (e.g., 600ms). This duration can be set as needed and is not limited here.
[0202] Not limited to screenshots, any of the above methods can be used to prevent accidental touches when generating floating elements for other types of data to be transmitted.
[0203] FIGS. 4M-4R A solution to prevent accidental touches by combining the two methods described above is shown.
[0204] existFIGS. 4M-4R In the anti-accidental touch solution shown, the electronic device reduces the door opening hot zone, and the smart circulation service is only triggered after the user's touch point enters the door opening hot zone twice.
[0205] FIG. 4M A user interface provided by the electronic device 100 is shown.
[0206] FIG. 4N This shows that the electronic device 100 detects an action acting on FIG. 4M After a user interacts with the device, a floating control 413 is generated. The specific generation process of control 413 can be found in the preceding text. FIGS. 1A-1D Related descriptions.
[0207] refer to FIG. 4N and FIG. 4O There are two door opening hot zones on the display screen: area 412A enclosed by dashed line L9 and the upper edge E1, left edge E3 and lower edge E2 of the display screen, and area 412B enclosed by dashed line L4 and the upper edge E1, right edge E4 and lower edge E2 of the display screen.
[0208] Compared to the conventional door opening hotspots before the anti-accidental touch solution was implemented (such as...) FIG. 1G The width of the door opening hotspot (414A) on the left side of the display screen is shorter than the width of the conventional left-side door opening hotspot, for example... FIG. 4N The width of the door opening hot zone 414A in the middle can be FIG. 4C The width of the hot zone 412A in the door is 1 / 2.
[0209] In some implementations, the width of the door opening hot zone 414B on the right side of the display screen may also be shorter than the width of the conventional right-side door opening hot zone, for example, FIG. 4N The width of the door opening hot zone 414B can be FIG. 4C The width of the hot zone 412B in the door is 1 / 2.
[0210] like FIG. 4N As shown, when the electronic device 100 detects a long press operation on the control 413, the user's finger touch point on the display screen is located in the door opening hot zone 414A on the left side of the display screen. At this time, although the touch point has entered the door opening hot zone, the electronic device will not trigger the smart circulation service, that is, it will not trigger the "door opening" animation.
[0211] refer to FIGS. 4N-4R The electronic device 100 can detect user actions such as dragging control 413 outside the left-side door opening area and then dragging control 413 back to the left-side door opening area. (Reference) FIG. 4RThe electronic device will only trigger the smart flow service, i.e., the "open door" animation, after detecting that the user's finger has entered the door opening hot zone for the second time on the display screen. The definitions of the first and second entry into the door opening hot zone can be found in the relevant introduction above.
[0212] In some implementations, after the electronic device 100 generates the floating control 413, it shortens the width of the door opening hot zone, and triggers the smart flow service only after entering the door opening hot zone twice. Either one of these can be executed, rather than both.
[0213] In some implementations, the electronic device 100 can execute the above-described combination of two methods to prevent accidental touches in scenarios where the data to be transmitted is text and the text's position in the user interface can be dragged. Such scenarios are typically provided by text editing applications; therefore, the electronic device can execute the above-described accidental touch prevention scheme when it detects that a text editing application is currently running, or when it detects that the foreground application is a text editing application. For example, the above-described accidental touch prevention scheme can be executed for text in a memo. Specifically, after the electronic device 100 detects that it is currently in the above-described scenario, it can execute the above-described accidental touch prevention scheme.
[0214] In this application embodiment, the scenario of implementing the above-mentioned anti-accidental touch scheme combining the two methods can be provided by a fifth application, which may include a text editing application.
[0215] Not limited to text-type data to be transmitted, other types of data to be transmitted can also use the above-mentioned combination of shortening the width of the door opening hot zone and triggering the smart transfer service only after entering the door opening hot zone twice to prevent accidental touches.
[0216] Window avoidance
[0217] One type of floating element is the floating window. Floating windows can be created based on split-screen operations and can float above other user interfaces.
[0218] When the floating element is a floating window, a corresponding hotspot for opening the door will also appear on the display screen. The interaction between the user and this floating window involves avoiding interference with the intelligent workflow service, which will be explained in different scenarios below.
[0219] Dragging the floating window does not trigger the intelligent workflow service.
[0220] FIG. 5A This is a user interface provided by electronic device 100 in a split-screen scenario. For example... FIG. 5A As shown, the user interface displays content provided by two applications simultaneously, including a user interface provided by the gallery application at the bottom layer, and a window 511 provided by the note-taking application floating at the top layer.
[0221] refer toFIGS. 5A-5B The electronic device 100 can detect dragging operations performed by the user at any position on the window 511 or on the horizontal bar at the top of the window 511, and then adjust the position of the window 511 on the display screen in real time according to the movement trajectory of the user's dragging operation. During this process, even if the touch point of the dragging operation moves to the door opening hot zone, the electronic device 100 will not trigger the intelligent flow service, but will only adjust the position of the window 511 on the display screen.
[0222] Preventing accidental touches in floating window scenarios
[0223] refer to FIG. 5C The user interface provided by the gallery at the bottom layer displays one or more icons, each icon corresponding to an image (such as a photo or video). FIGS. 5C-5D As shown, the electronic device can detect user actions (such as clicks) applied to one or more icons. In response to the action, the electronic device 100 selects the corresponding icon and displays a selected mark on the selected icon.
[0224] refer to FIGS. 5D-5E After selecting one or more icons, the electronic device 100 can detect a long press operation on the screen. In response to the operation, the electronic device 100 can display a floating control 512. The control 512 may include a preview or thumbnail of the selected icon, and a top-right corner marker (e.g., "2") indicating the number of selected icons, i.e., the number of images selected.
[0225] refer to FIG. 5E There are two door opening hot zones on the display screen, namely the door opening hot zone on the left side of the display screen and the door opening hot zone on the right side of the display screen.
[0226] like FIGS. 5E-5F As shown, the electronic device can detect the operation of dragging control 512 to the right-side door opening hot zone. In response to this operation, the electronic device can activate the smart circulation service. (Reference) FIG. 5G In response to control 512 being dragged to the right-hand opening area, the electronic device displays a menu bar with icons of multiple candidate applications on the right side of the display screen and adjusts the original user interface to a perspective style. In some embodiments, the electronic device can initiate the smart flow service after detecting that the touch point of the finger dragging control 512 has remained on the right-hand opening area for a period of time. FIG. 5G As shown, the user's finger touch point is still located in the hover zoom-in area, so the icons of candidate applications in the menu bar also present a hover animation effect.
[0227] like FIGS. 5G-5HAs shown, the electronic device can detect that the control 512 is being dragged from the right-side opening area to a portion of the display screen that is outside the hover zoom area and the closing area, therefore the electronic device 100 stops displaying the approach hover effect. That is, refer to FIG. 1H All icons in menu bar 116 are the same size and are based on the same dimensions.
[0228] like FIGS. 5H-5I As shown, the electronic device can detect the continued dragging of control 512 to the door-closing hot zone on the left side of the display screen. (Reference) FIG. 5J In response to this operation, the electronic device will disable the smart circulation service, meaning it will no longer display the menu bar or show the door opening effect.
[0229] like FIGS. 5J-5L As shown, after detecting a user action of dragging control 512 to window 511 and then releasing it, electronic device 100 can send the image corresponding to control 512 to the note-taking application corresponding to window 511. Then, electronic device 100 can display the image corresponding to the selected icon in window 511.
[0230] FIGS. 5C-5L The example shown provides a quick and convenient way for users to close the Smart Flow service after accidentally starting it, without interrupting their next action. Specifically, suppose the user... FIG. 5E The original purpose of dragging control 512 was to drag control 512 into window 511 to send the image corresponding to control 512 to the note-taking application. However, the user mistakenly dragged control 512 to... FIG. 5F In the door opening hot zone shown, the electronic device subsequently displays as follows: FIG. 5G The "open door" effect shown. However, FIG. 5G The displayed "opening" effect is not the user's desired result. Therefore, the user can continue to drag control 512 to the closing hotspot on the left side of the screen to turn off the "opening" effect. Furthermore, after turning off the "opening" effect, the user can continue to drag control 512 and release it into window 511 to complete the data transfer, thus achieving the original purpose. During this process, although the user accidentally triggered the intelligent transfer service, the user can close the intelligent transfer service and achieve the original purpose by continuously dragging control 512. In this process, the user continuously drags control 512, allowing for a simple, convenient, and quick way to avoid accidental operation, achieving the original purpose without removing their finger from the screen.
[0231] In this embodiment of the application, the hot zone for opening the door can also be referred to as the second region, and the region outside the hot zone for opening the door can be referred to as the first region. The first region and the second region do not overlap.
[0232] For example, the second region may include FIGS. 1G-1H The door opening hot zones 115A and 115B shown may include a first region. FIGS. 1G-1H Other display screen areas besides the center-opening hot zone 115A and the door-opening hot zone 115B.
[0233] For example, the second region may include FIGS. 4C-4R The door opening hot zone 412A and door opening hot zone 412B shown may include the first region. FIGS. 4C-4R Other display screen areas besides the center door hot zone 412A and the door hot zone 412B.
[0234] For example, the second region may include FIG. 5F The left-side and right-side door opening hot zones shown in the diagram, the first zone may include FIG. 5F Other display screen areas besides the left-side and right-side door opening hot zones.
[0235] In this embodiment, the light-guided hot zone can also be referred to as the third region, which includes the second region. Examples of light-guided hot zones can be found in the preceding UI embodiment description.
[0236] In this embodiment, the hover zoom-in area can also be referred to as the fourth region. The fourth region includes the second region on the side where the menu bar is located, or the second region where the touch endpoint of the first drag operation or the third drag operation is located. Examples of hover zoom-in areas can be found in the UI embodiment described above. The first drag operation and the third drag operation can be found in the following description.
[0237] The second area on the side where the menu bar is located, or the second area containing the touch endpoint of the first or third drag operation, refers to a portion of the second area, such as an area on one side. For example, this portion of the second area may include... FIGS. 1G-1H The door opening hot zone 115B shown is... FIGS. 4C-4F The door opening hot zone 412B shown is... FIGS. 4H-4R The door opening hot zone 412A shown is... FIG. 5G The right-side door opening hot zone is shown.
[0238] In this embodiment, the area on the display screen other than the hover zoom hot zone and the door close hot zone can also be referred to as the fifth region. Examples of the fifth region may include... FIG. 1J The area outside of the hover amplification hotspot 117 and the door-closing hotspot 118, or, FIG. 5H The area outside the hover amplification hot zone and the door-closing hot zone.
[0239] In this embodiment, the door closing hot zone can also be referred to as the sixth region. Examples of door closing hot zones can be found in the preceding UI embodiment description.
[0240] In this embodiment of the application, the floating element can be referred to as the first element, and the user interface displaying the floating element can be referred to as the first interface.
[0241] For example, examples of the first interface may include FIG. 1D The interface shown may include examples of the first element. FIG. 1D 112 is a floating control.
[0242] For example, an example of the first interface may include FIGS. 4B-4D ,or FIG. 4G ,or FIGS. 4H-4I The interface shown may include examples of the first element. FIGS. 4B-4D ,or FIG. 4G ,or FIGS. 4H-4I Image 411 in the image.
[0243] For example, an example of the first interface may include FIG. 4N The interface shown may include examples of the first element. FIG. 4N 413 is a floating control.
[0244] For example, an example of the first interface may include FIG. 5E The interface shown may include examples of the first element. FIG. 5E 512 is a floating control.
[0245] In this embodiment of the application, the data corresponding to the floating element can be referred to as the first data.
[0246] For example, examples of the first data may include FIG. 1C The selected text, or FIG. 4A A screenshot of the user interface shown, or FIG. 5D The image corresponding to the selected icon.
[0247] An application that provides the first interface can be called the sixth application, for example... FIG. 1A , FIG. 4A The browser application shown FIG. 4M The memo application shown, FIG. 5C The image gallery application shown is an example.
[0248] In this embodiment of the application, the user interface used to generate the floating element before displaying the floating element can be referred to as the second interface.
[0249] For example, examples of the second interface may include FIGS. 1A-1C The user interface shown. FIGS. 1A-1CIn the user interface, the text selected by the user can be referred to as the first text.
[0250] For example, examples of the second interface may include FIG. 4A The user interface shown.
[0251] For example, examples of the second interface may include FIGS. 5C-5D The user interface shown. FIGS. 5C-5D In the user interface shown, the selected icon can be referred to as the icon of the first image, and the unselected icon can be referred to as the icon of the second image.
[0252] In this embodiment of the application, various drag operations on the first element may be included. Wherein:
[0253] Drag operations on the first element to trigger the smart flow service or to trigger the door opening effect can include the following two types:
[0254] 1. A first drag operation, wherein the touch start point of the first drag operation is on the first element and located in the first area of the display screen, and the touch end point is located in the second area of the display screen.
[0255] For example, examples of the first drag operation may include FIGS. 1D-1G The illustration shows the operation of dragging control 112 from a display area other than the door opening hot zone 115A and door opening hot zone 115B to the door opening hot zone 115B.
[0256] For example, examples of the first drag operation may include FIGS. 4D-4E The illustration shows the operation of dragging image 411 from a display area other than the door opening hot zone 412A and door opening hot zone 412B to the door opening hot zone 412B.
[0257] 2. A third drag operation, wherein the touch start point of the third drag operation is on the first element and located in the second area, the touch end point is located in the second area, and the trajectory of the third drag operation passes through the first area.
[0258] For example, examples of the third drag operation may include FIGS. 4I-4K The illustration shows the operation of dragging control 112 from the door opening hot zone 412A to the non-door opening area, and then dragging it back to the door opening hot zone 412A.
[0259] For example, examples of a third drag operation could include FIGS. 4N-4Q The illustration shows the operation of dragging control 413 from the door opening hot zone 414A to the non-door opening area, and then dragging it back to the door opening hot zone 414A.
[0260] A drag operation on the first element that is not used to trigger the smart circulation service or to trigger the door opening effect may include a second drag operation. The touch start point of the second drag operation is on the first element and located in the second area, the touch end point is located in the second area of the display screen, and the trajectory of the second drag operation is located in the second area.
[0261] For example, examples of the second drag operation may include in FIGS. 1D-1G Dragging operations within the hot zone 115A or hot zone 115B of the center-opening door, or... FIGS. 4D-4E Dragging operations within the hot zone 412A or hot zone 412B of the center-opening door, or... FIGS. 4I-4K Dragging operations within the hot zone 412A or hot zone 412B of the center-opening door, or... FIGS. 4N-4Q Drag operations within the hot zone 414A or hot zone 414B of the center door opening.
[0262] The touch start point and touch end point of the first, second, and third drag operations mentioned above only represent the start and end positions of the corresponding drag operations. The touch start point does not necessarily mean that the user's finger touched the display screen at the beginning of the drag operation, and the touch end point does not mean that the user's finger left the display screen at the end of the drag operation. That is, before the first, second, and third drag operations, there can be other operations that continuously and persistently touch the display screen, or there can be no other operations that continuously and persistently touch the display screen. After the first, second, and third drag operations, there can be other operations that continuously and persistently touch the display screen.
[0263] In this embodiment, the menu bar displayed on the electronic device, which includes icons for one or more candidate applications, may be referred to as the first menu bar. Examples of the first menu bar may include... FIGS. 1H-1K , FIG. 1M The menu bar 116 in the middle may also include FIG. 4F , FIG. 4L , FIG. 4R , FIGS. 5G-5I The menu bar shown in the image.
[0264] In this embodiment, after the electronic device displays the first menu bar, it can also detect the operation of dragging the first element into the area where the icon of the candidate application is located in the first menu bar and releasing it. This candidate application can be referred to as the first application. Examples of the first application may include... FIG. 1M Note-taking applications in the context of [the application].
[0265] In this embodiment, after the electronic device displays the first menu bar, a fourth drag operation can be detected, in which the first element is dragged further within the fourth area. The touch start point of the fourth drag operation is the same as the touch end point of the first or third drag operation, and the touch end point of the fourth drag operation is closest to the icon of the second application in the first menu bar. That is, the fourth drag operation is continuous and uninterrupted with the first or third drag operation.
[0266] Examples of the fourth drag operation may include FIGS. 1H-1I The operation of drag control 112 is shown.
[0267] When the first menu bar is displayed, in the proximity hover animation, the icon of the candidate application closest to the user's touch point can be called the icon of the second application. The application icon adjacent to the second application icon can be called the icon of the first application and the icon of the third application, respectively. The icons of other applications can be called the icon of the fourth application.
[0268] FIG. 1I The icons for favorites, search, share, and notes in the menu bar 116 shown are examples of icons for the first application, the second application, the third application, and the fourth application, respectively.
[0269] In this embodiment, after the electronic device detects the fourth drag operation, it can also detect a fifth drag operation that continues to drag the first element to a fifth region, wherein the fifth region and the fourth region do not overlap; in response to the fifth drag operation, the icons in the first menu bar are displayed at the base size. An example of the fifth drag operation can be found in [reference needed]. FIGS. 1I-1J The drag operation shown, or, FIGS. 5G-5H The drag operation shown.
[0270] The starting point of the fifth drag operation is the same as the ending point of the fourth drag operation. That is, the fifth drag operation and the fourth drag operation are continuous and uninterrupted.
[0271] In this embodiment of the application, after the electronic device displays the first menu bar, it can also detect a sixth drag operation that drags the first element to the sixth area, wherein the sixth area and the second area do not overlap, and the sixth area is located on the opposite side of the first menu bar on the display screen; in response to the sixth drag operation, the display of the first menu bar is stopped.
[0272] Examples of the sixth drag operation may include FIGS. 1H-1K The drag operation shown, or, FIGS. 5G-5I The drag operation shown.
[0273] In this embodiment, regarding the above-described solution of preventing accidental touches by reducing the hot zone when opening a door, the electronic device can display a third interface, which includes a second element; a drag operation on the second element is detected; when the drag operation is a seventh drag operation, the touch start point of the seventh drag operation is on the second element and located in the seventh area of the display screen, and the touch end point is located in the eighth area of the display screen, a second menu bar is displayed; when the drag operation is an eighth drag operation, the touch start point of the eighth drag operation is on the second element and located in the eighth area, the touch end point is located in the eighth area of the display screen, and the trajectory of the eighth drag operation passes through the seventh area, the second menu bar is displayed; when the drag operation is neither the seventh nor the eighth drag operation, the second menu bar is not displayed; wherein, the eighth area is a portion of the second area.
[0274] The eighth area is the reduced door opening hot zone, and the seventh area is the display screen area outside the reduced door opening hot zone.
[0275] For example, refer to FIG. 4G The eighth area includes door opening hot zones 412A and 412B, and the seventh area includes the display screen area other than door opening hot zones 412A and 412B.
[0276] For example, refer to FIGS. 4N-4R The eighth area includes door opening hot zones 412A and 412B, and the seventh area includes the display screen area other than door opening hot zones 412A and 412B.
[0277] The electronic device provided in the embodiments of this application is described below.
[0278] FIG. 6 A schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of this application is shown. This electronic device 100 is used to execute the data transmission method provided in the preceding method embodiments.
[0279] Electronic device 100 may include a processor 101, a memory 102, a wireless communication module 103, a mobile communication module 104, an antenna 103A, an antenna 104A, a power switch 105, a sensor module 106, a focusing motor 107, a camera 108, a display screen 109, etc. The sensor module 106 may include a gyroscope sensor 106A, an accelerometer sensor 106B, an ambient light sensor 106C, an image sensor 106D, a proximity sensor 106E, etc. The wireless communication module 103 may include a WLAN communication module, a Bluetooth communication module, etc. All of the above components can transmit data via a bus.
[0280] Processor 101 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0281] Memory 102 can be used to store computer executable program code, which may include instructions. Processor 101 executes various functional applications and data processing of electronic device 100 by running the instructions stored in memory 102. Memory 102 may include a program storage area and a data storage area. In specific implementations, memory 102 may include high-speed random access memory, and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
[0282] The wireless communication function of the electronic device 100 can be implemented through antenna 103A, antenna 104A, mobile communication module 104, wireless communication module 103, modem processor, and baseband processor.
[0283] Antennas 103A and 104A can be used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization.
[0284] The mobile communication module 104 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on electronic devices 100.
[0285] The wireless communication module 103 can provide solutions for wireless communication applications on electronic devices 100, including wireless local area networks (WLAN), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR).
[0286] The power switch 105 can be used to control the power supply to the electronic device 100.
[0287] Electronic device 100 can perform shooting functions through ISP, camera 108, video codec, GPU, display screen 109 and application processor.
[0288] Electronic device 100 can implement display functions through a GPU, display screen 109, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 109 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 101 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0289] The display screen 109 is used to display images, videos, etc. The display screen 109 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N displays 109, where N is a positive integer greater than 1.
[0290] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0291] In this embodiment, the display screen 109 is used to display the preceding text. FIGS. 1A-1N , FIGS. 4A-4M , FIGS. 5A-5K The user interface shown is illustrated. The display screen 109 can also be used to receive user operations performed on the display screen. The processor 101 is used to respond to user operations detected by the electronic device 100, determine the location of various hot zones, and trigger the corresponding functions of the hot zones in response to user operations performed on them. The specific operations performed by each device in the electronic device 100 can be found in the descriptions of the method embodiments above, and will not be elaborated upon here.
[0292] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses a layered mobile operating system as an example to exemplify the software structure of electronic device 100.
[0293] FIG. 7 This is a software structure block diagram of an electronic device 100 according to an embodiment of this application.
[0294] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, a mobile operating system is divided into four layers, from top to bottom: the application layer, the application framework / core service layer, the system libraries and runtime, and the kernel layer.
[0295] The application layer can include a series of application packages.
[0296] like FIG. 7 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
[0297] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0298] like FIG. 7 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0299] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0300] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0301] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0302] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).
[0303] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0304] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0305] Runtime can refer to all the code libraries, frameworks, etc., required for a program to run. For example, for the C language, the runtime includes a series of function libraries required for C programs to run. For the Java language, in addition to the core libraries, the runtime also includes the virtual machine required for Java programs to run. The aforementioned core libraries can include the functionalities that the Java language needs to call.
[0306] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0307] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0308] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0309] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0310] A 2D graphics engine is a graphics engine for 2D drawing.
[0311] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0312] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor.
[0313] This application also provides an electronic device, which may include a memory and a processor. The memory may be used to store a computer program; the processor may be used to invoke the computer program in the memory, causing the electronic device to execute the method executed on the electronic device side in any of the above embodiments.
[0314] This application also provides an electronic device, which may include a memory and a processor. The memory may be used to store a computer program; the processor may be used to invoke the computer program in the memory, causing the electronic device to execute the method executed on the electronic device side in any of the above embodiments.
[0315] This application also provides a chip system including at least one processor for implementing the functions involved in the electronic device side of any of the above embodiments.
[0316] In one possible design, the chip system also includes a memory for storing program instructions and data, which may be located within or outside the processor.
[0317] The chip system can consist of chips or include chips and other discrete components.
[0318] Optionally, the chip system may include one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.
[0319] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.
[0320] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.
[0321] This application also provides a computer program product, the computer program product comprising: a computer program (also referred to as code or instructions), which, when the computer program is run, causes the computer to perform the method executed on the electronic device side in any of the above embodiments.
[0322] This application also provides a computer-readable storage medium storing a computer program (also referred to as code or instructions). When the computer program is run, it causes the computer to perform the method executed on the electronic device side in any of the above embodiments.
[0323] The various embodiments of this application can be combined arbitrarily to achieve different technical effects.
[0324] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).
[0325] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0326] In summary, the above description is merely an embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made based on the disclosure of this application should be included within the scope of protection of this application.
Claims
1. A data transmission method, characterized by, The method is applied to an electronic device including a display screen, and comprises the following steps: displaying a first element and a first interface; displaying a first light strip on a first side of the display screen during dragging of the first element to a first hot area; stopping displaying the first light strip and displaying a first menu bar and content of the first interface in a reduced size when a first operation of dragging the first element to the first hot area is received, the first menu bar and the first hot area being located on the first side, a plurality of icons including an icon of a first application being displayed in the first menu bar; displaying a second light strip on a second side of the display screen during dragging of the first element to a second hot area; stopping displaying the second light strip and displaying a second menu bar and content of the first interface in a reduced size when a second operation of dragging the first element to the second hot area is received, the second menu bar and the second hot area being located on the second side, a plurality of icons including the icon of the first application being displayed in the second menu bar, the first side being opposite to the second side; wherein, in a case of displaying the first menu bar or in a case of displaying the second menu bar, stopping displaying the content of the first interface in the reduced size and stopping displaying the first menu bar or stopping displaying the second menu bar when a third operation of continuing to drag the first element to a third hot area is received, the third hot area being different from the first hot area and different from the second hot area; the first operation and the third operation being continuous operations without a finger leaving the display screen, and the second operation and the third operation being continuous operations without the finger leaving the display screen; transmitting first data corresponding to the first element to the first application in response to a release operation when the first element is continued to be dragged onto the icon of the first application.
2. The method of claim 1, wherein, The first hot area is used to trigger displaying the first menu bar, the second hot area is used to trigger displaying the second menu bar, and the third hot area is used to trigger stopping displaying the first menu bar or stopping displaying the second menu bar.
3. The method of claim 1, wherein, The content of the first interface in the reduced size is displayed in a perspective style.
4. The method of claim 1, wherein, The first light strip is an interface element with color, shadow, gradient or graphic fill properties; The second light strip is an interface element with color, shadow, gradient or graphic fill properties.
5. The method of claim 1, wherein, Part of the content of the first element is not displayed after the first element is dragged to the first hot area.
6. The method of claim 1, wherein displaying the first menu bar and the content of the first interface in the reduced size is used to indicate that a data transmission service is started; displaying the second menu bar and the content of the first interface in the reduced size is used to indicate that the data transmission service is started.
7. The method according to any one of claims 1 to 6, characterized in that, The first interface includes first text, and the method further comprises the following steps: In response to a fourth operation on the first text, the first element is displayed on the first interface, the fourth operation and the first operation are continuous operations without the finger leaving the display screen, and the fourth operation and the second operation are continuous operations without the finger leaving the display screen.
8. The method of claim 7, wherein, The first interface is an interface of a second application, the first application and the second application are different, and the method further includes: The first interface includes text; In response to an operation of detecting that the first text in the text is selected, a toolbar is displayed on the first text, and the toolbar includes a plurality of controls for processing the first text; The fourth operation on the first text specifically includes a long press operation on the first text. The method further includes: In response to the long press operation, the first element is displayed on the first interface, and the first element includes a preview of the first text.
9. The method of claim 8, wherein, The preview of the first text includes part or all of the content of the first text.
10. The method of claim 8, wherein, The method further includes: in response to the long press operation, outputting a vibration signal.
11. The method of claim 8, wherein, A center point of the first element coincides with a touch point of the long press operation.
12. The method according to any one of claims 1 to 6, characterized in that, The first interface is an interface of a second application, the first application and the second application are different, and the method further includes: When the first interface is displayed, a screenshot operation is detected; In response to the screenshot operation, a screenshot image is displayed on the first interface; In response to an operation on the screenshot image, the first element is displayed on the first interface, and the first element includes a preview of the screenshot image of the first interface.
13. The method of claim 9, wherein, The first side is the right side of the display screen, and the second side is the left side of the display screen.
14. The method of claim 13, wherein, After the first data corresponding to the first element is transmitted to the first application, the method further includes: Stop displaying the content of the first interface after being zoomed out, and stop displaying the first menu bar or stop displaying the second menu bar.
15. The method of claim 14, wherein, After the first data corresponding to the first element is transmitted to the first application, the method further includes: Display a prompt window, and the prompt window is used to prompt that the first data has been successfully transmitted to the first application.
16. The method of claim 2, wherein, The display area of the first hot area in the display screen and the display area of the second hot area in the display screen are symmetrically distributed.
17. The method of claim 1, wherein, The plurality of icons in the first menu bar are arranged from top to bottom, and the plurality of icons in the second menu bar are arranged from top to bottom.
18. The method of claim 15, wherein, The method further includes: In response to the third operation, a second interface is displayed, and a first window is displayed on the second interface, and the first window corresponds to a third application; When a fifth operation of detecting that the first element is continuously dragged to the first window is detected; In response to the fifth operation, first data corresponding to the first element is transmitted to the third application.
19. The method according to any one of claims 1-6, characterized in that, During the process of dragging the first element to the first hot area, a first light band is displayed on the first side, specifically including: a sixth operation of detecting that the first element is dragged to a fourth hot area, the fourth hot area is located on the same side as the first hot area, the fourth hot area is different from the first hot area, and the fourth hot area is used to trigger display of the first light bar; in response to the sixth operation, displaying the first light bar on the first side, the sixth operation and the first operation being continuous operations without the finger leaving the display screen.
20. The method of claim 19, wherein, The displaying of the second light bar on the second side during the dragging of the first element to the second hot area specifically includes: a seventh operation of detecting that the first element is dragged to a fifth hot area, the fifth hot area is located on the same side as the third hot area, the fifth hot area is different from the third hot area, and the fifth hot area is used to trigger display of the second light bar; in response to the seventh operation, displaying the second light bar on the second side, the seventh operation and the third operation being continuous operations without the finger leaving the display screen.
21. The method of claim 20, wherein, The display area of the fourth hot area in the display screen and the display area of the fifth hot area in the display screen are symmetrically distributed.
22. The method of claim 1, wherein, The first data is one of a text, a document, a picture, a video, or a hyperlink.
23. An electronic device, comprising: An electronic device includes one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, the one or more memories are configured to store computer program codes, and the computer program codes include computer instructions that, when executed by the one or more processors, cause the electronic device to perform the method of any one of claims 1-22.
24. A computer-readable storage medium comprising instructions, wherein, The instructions, when executed on the electronic device, cause the electronic device to perform the method of any one of claims 1-22.
Citation Information
Patent Citations
Information processing method and electronic equipment
CN103870121A
Processing method for content and mobile terminal
CN106844067A
Information sharing method and device, electronic equipment and storage medium
CN111258486A
Application program processing method and electronic equipment
CN111368188A
Interface element display method and device
CN114756151A