An information flow method and related equipment
By enabling information flow between wearable devices and mobile phones, the problem of decreased user experience caused by software and hardware limitations has been solved, improving the user experience and information flow efficiency on the watch.
Patent Information
- Application Number
- CN202311051363.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-18
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2043-08-18
AI Technical Summary
Due to hardware and software limitations, wearable devices such as smartwatches cannot offer the same level of functionality as smartphones, making it difficult for users to transfer their smartphone usage habits to smartwatches, resulting in a decreased user experience.
By enabling information flow between wearable devices and mobile phones, the watch can display app icons from the phone and receive and display information from the phone, including screenshots and dynamic information flow, while optimizing the user interface to fit the watch's screen size.
It enhances the user experience on wearable devices, reduces the sense of functional gap between mobile phones and watches, and improves the efficiency of information flow and user interaction.
Smart Images

Figure CN119496849B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic technology, and in particular to an information transfer method and related equipment. Background Technology
[0002] In recent years, wearable devices (such as smartwatches and smart bracelets) have become increasingly indispensable in people's lives. Taking smartwatches as an example, people's functional needs for smartwatches are becoming closer to those of mobile phones. However, due to the limitations of hardware and software, the functions of smartwatches cannot be as rich as those of mobile phones. Therefore, users' usage habits on mobile phones cannot be transferred to smartwatches, resulting in a decline in user experience. Summary of the Invention
[0003] This application provides an information flow method and related equipment to improve the user experience of wearable devices.
[0004] In a first aspect, an information transfer method is provided, applied to a second device, such as a wearable device, like a watch or bracelet. The method includes: the second device connecting to a first device; the second device receiving M icons sent by the first device, where the M icons are icons of M applications installed on the first device, and M is a positive integer; the second device displaying the M icons; the second device receiving a first operation; when the second device determines that the operation position of the first operation is within the display area of the first icon among the M icons, it sends a first instruction to the first device, the first instruction instructing the first device to transfer information of a first application to the second device, where the first application is the application corresponding to the first icon; and the second device receiving and displaying the first information sent by the first device.
[0005] Taking a watch as the second device and a mobile phone as the first device as an example, in this embodiment, the watch can obtain and display the icons of applications on the mobile phone. Furthermore, after receiving a click operation (e.g., clicking an icon), the watch can instruct the mobile phone to open the application corresponding to that icon, and then receive and display the application information transferred from the mobile phone. In other words, users can open applications on their mobile phones on the watch and see the application's interface on the watch. It should be noted that currently, due to significant differences in hardware and software between watches and mobile phones, for the same application (e.g., WeChat®), the mobile version of the application is installed on the phone, while the watch version is installed on the watch. However, the watch version has far fewer functions than the mobile version. Therefore, for the same application (e.g., WeChat®), after users become accustomed to using the various functions of the mobile version, they can only use the watch version when using the watch. Due to the limited functionality of the watch version, users cannot experience the same functions as the mobile version, leading to a sense of dissatisfaction and affecting the user experience of the watch. Through the technical solution of this application embodiment, users can open the application (mobile version) on the mobile phone on the watch and see the interface of the application (mobile version) on the watch, reducing the sense of gap from mobile phone to watch and improving the user experience of the watch.
[0006] In one possible design, the second device does not include the installation packages for the M applications. It is understood that the phone installs the mobile version of the applications, and the watch's hardware and software cannot run the mobile version's installation package. Furthermore, after the watch obtains the mobile application icon from the phone, it uses the phone to open the corresponding application, without the watch needing to run the installation package itself. Therefore, the watch may not include the mobile application installation package.
[0007] In one possible design, the second device includes a second application, and the second device displays the M icons, including: the second device displays the M icons in response to an operation for opening the second application.
[0008] Taking the second application, Super Desktop, as an example, when Super Desktop is opened on the watch, icons obtained from the phone can be displayed. This can be understood as the user seeing icons of applications on the phone within the watch's Super Desktop. Furthermore, when the user clicks on an icon, Super Desktop instructs the phone to open the corresponding application, then receives and displays the application's information from the phone. Therefore, in this embodiment, the user can open applications on the phone within the watch's Super Desktop and see the application's interface, enhancing the watch's user experience.
[0009] In one possible design, the method further includes: the second device receiving an operation to close the second application and displaying P icons, where the P icons are icons of applications locally installed on the second device, and P is a positive integer.
[0010] Taking the second application as a super desktop as an example, the watch can have two desktops: a normal desktop and a super desktop. When the second application is not open on the watch, the normal desktop is displayed. The normal desktop includes icons for P locally installed applications (watch version applications). Users can open locally installed applications from the normal desktop. When the second application is open on the watch, the super desktop is displayed, which includes icons obtained from the phone. Users can open applications from their phones from the super desktop and see the application's interface. It is understandable that users can choose to use either the normal desktop or the super desktop based on their current situation. For example, if a user is out and about without their phone, they can use the watch version applications from the normal desktop. Or, if a user is on public transportation and it is inconvenient to hold their phone, they can connect the watch to their phone, open the phone's applications from the watch's super desktop, and see the application's interface. Therefore, this embodiment provides both a way to open local watch applications and a way to open phone applications, improving the user experience of the watch.
[0011] In one possible design, the second device receives and displays first information sent by the first device, including: the second device receiving a first image sent by the first device, the first image being a screenshot of a first interface of the first application by the first device; the second device determining a target area on the first image, the target area including a first area and a second area, the first area being the area containing fixed information on the first image, the fixed information including a title bar and / or navigation bar on the first image, and the second area being other areas on the first image outside the first area; the second device combining image blocks within the first area and image blocks within the second area to create a second interface; and the second device displaying the second interface.
[0012] In this embodiment, after receiving the first image, the watch determines a target area on the first image and then displays information within that target area. The target area determined by the watch includes the area containing fixed information (e.g., the title bar and / or navigation bar). This allows users to see the fixed information such as the title bar and / or navigation bar on the watch, facilitating operations within that area (e.g., operations within the navigation bar) and providing a better user experience.
[0013] In one possible design, the method further includes: the second device receiving an upward swipe operation; the second device determining a third region on the first image, the third region being located below the second region; the second device controlling an image block within the second region of the second interface to gradually move upward and exit the display screen, and controlling an image block within the fourth region to gradually enter the display screen from bottom to top.
[0014] In this embodiment, the user can swipe up on the watch screen to view more content. Furthermore, the watch responds quickly when the user swipes up. This is because the first image received by the watch is a screenshot of the entire first interface. The watch currently only displays a portion of the content in the screenshot. Therefore, when the watch receives the swipe-up operation, it only needs to re-identify the target area within the screenshot and display the information within that newly identified target area. It does not need to retrieve information from the phone temporarily, resulting in a fast response.
[0015] In one possible design, the second device receives and displays first information sent by the first device, including: the second device receiving a first image sequence, a first image, and first location information sent by the first device; the first image sequence being a multi-frame screenshot of the area containing dynamic information within a first interface of the first application; the first image being a screenshot of the first interface from which information within the area containing the dynamic information is removed; the first location information indicating the position of the first image sequence within the first image; and the dynamic information being information that is being dynamically played. The second device determines a target area on the first image, the target area including a first area and a second area; the first area being the area containing fixed information on the first image, including a title bar and / or navigation bar on the first image; and the second area being other areas on the first image besides the first area. Based on the first location information, the second device determines that the entire first image sequence is located within the second area. The second device combines image blocks within the first area, image blocks within the second area, and the first image sequence into a second interface, in which the first image sequence is dynamically played. The second device then displays the second interface.
[0016] In this embodiment, after receiving the first image, the watch determines a target area on the first image. If the image sequence is located within the target area, the target area and the image sequence are combined into a single interface, which is then displayed with the image sequence playing dynamically. Therefore, the user can see dynamically playing information on the watch.
[0017] Furthermore, it should be noted that if the first interface contains both dynamic and static information, and if screenshots of the entire first interface are taken at a certain frequency to obtain an image sequence, then each frame of the image sequence received by the watch will be larger than the watch screen. For the parts not displayed, there is actually no need to transmit them, wasting transmission power. Moreover, each frame of the image sequence received by the watch includes the same information (i.e., static information), wasting transmission power. In this embodiment, when the first interface contains both dynamic and static information, only one screenshot needs to be transmitted for static information, and an entire image sequence can be transmitted for dynamic information. Therefore, the watch only needs to receive one image and the image sequence. Furthermore, each frame of this image sequence does not include static information, greatly reducing transmission power consumption.
[0018] In one possible design, the method further includes: the second device determining, based on the first location information, that a portion of the first image sequence is located within the second region and a portion is located outside the target region; the second device cropping the portion of each frame in the first image sequence located outside the second region, retaining the portion located within the second region, to obtain a second image sequence; the second device combining the image blocks within the first region, the image blocks within the second region, and the second image sequence into a second interface, wherein the second image sequence is dynamically played in the second interface; and the second device displaying the second interface.
[0019] In this embodiment, after receiving the first image, the watch determines a target area on the first image. If part of the image sequence is within the target area and part is outside the target area, the part of the image sequence outside the target area is cropped, and the target area and the part of the image sequence within the target area are combined into an interface, which is then displayed with the image sequence playing dynamically. Therefore, the user can see dynamically playing information on the watch.
[0020] In one possible design, the method further includes: the second device receiving an upward swipe operation; the second device determining a third region on the first image, the third region being located below the second region; the second device determining, based on the first position information, that the entire first image sequence is located within the third region; the second device controlling the second region within the second interface to gradually move upwards and exit the display screen, and controlling the third region to gradually enter the display screen from bottom to top, while the first image sequence within the third region is dynamically played.
[0021] In one possible design, before the second device determines the target area on the first image, the method further includes: the second device receiving second location information sent by the first device, the second location information being the location of the first area on the first image; the second device determining the target area on the first image includes: the second device determining the first area in the first image based on the second location information; and the second device determining the second area based on the display size of the second device and the first area.
[0022] In this embodiment, the watch can receive location information of the area where the fixed information is located from the mobile phone, determine a first area on a first image based on the location information, and determine a second area based on the watch screen size and the first area. Therefore, the target area determined by the watch includes the first area and the second area. The first area is where the fixed information (e.g., the title bar and / or navigation bar) is located, and the user can perform some operations (e.g., operations in the navigation bar) in the area where the fixed information is located, resulting in a better user experience.
[0023] In one possible design, the display screen of the second device is circular with a diameter of L. The second device determines the second region based on the display screen size and the first region, including: the second device determining a ratio m of the width of the first image to L, where m is greater than or equal to 1; the second device determining the height of the first region to be H, and the width to be the width of the first image; the second device determining the height of the second region to be m. The difference between L and H, the width of the second region is the width of the first region, and the upper edge of the second region is determined to be the upper edge of the remaining regions on the first image other than the first region.
[0024] In this embodiment, the target area determined by the watch includes a first area and a second area. The first area is where fixed information (e.g., the title bar and / or navigation bar) is located, and the second area is determined based on the watch screen size and the first area. In short, the combined interface width and / or width of the second area and the first area is equal to m. L, so that after the composite interface is reduced by a factor of m, it can be exactly equal to the diameter of the watch screen, so as to ensure that the composite interface can be fully displayed in width and / or height as much as possible.
[0025] In one possible design, the display screen of the second device is circular, and before the second device displays the second interface, it also includes: The second device reduces the width of the second interface to be equal to the diameter of the circle, and / or reduces the height of the second interface to be equal to the diameter of the circle; the second device displays the second interface, including: the second device displays the reduced second interface.
[0026] In this embodiment of the application, when the watch display screen is circular, the width and / or height of the composite interface can be reduced to be equal to the diameter of the circle, so as to ensure that the composite interface can be fully displayed in width and / or height as much as possible.
[0027] In one possible design, the display screen of the second device is a first circle. Before the second device displays the second interface, the method further includes: the second device cropping the second interface into a second circle; if the diameter of the second circle is larger than the diameter of the first circle, the second device reducing the diameter of the second circle to be equal to the diameter of the first circle; the second device displaying the second interface includes: the second device displaying the second interface in the shape of the reduced second circle.
[0028] In this embodiment, when the watch display is circular, the composite interface can be cropped into a circle before displaying. Assuming the diameter of the composite interface after cropping is larger than the diameter of the watch display, the diameter of the composite interface can be reduced to be equal to the diameter of the watch display to ensure that all information within the composite interface is displayed on the watch display.
[0029] In one possible design, the method further includes: the second device determining that the distance between the lower edge of the third region and the lower edge of the first image is less than a preset distance; the second device sending a second instruction to the first device, the second instruction being used to instruct the first interface to be updated; and the second device receiving and displaying the second information sent by the first device.
[0030] In this embodiment, after the watch receives the first image, if the user performs a swipe-up operation on the watch screen, causing the lower area of the first image to be displayed and the lower edge of that area to be close to the lower edge of the screenshot, the watch sends an update command to the phone. In this way, the watch can obtain a new screenshot from the phone in advance. If the user continues to swipe up, the target area is determined in the new screenshot and the screenshot within that target area is displayed. Because the new screenshot has been obtained in advance, the watch can respond quickly when it receives the swipe-up operation.
[0031] In one possible design, the display screen of the second device is circular with a diameter of L. The second device receives and displays the first information sent by the first device, including: the second device receiving the first image sequence sent by the first device, the first image sequence being a multi-frame screenshot of the scaled-down first interface of the first application by the first device, or the first image sequence being a multi-frame screenshot of a portion of the first interface by the first device, the first interface playing dynamic information in full screen, and the width and / or height of the scaled-down first interface being equal to L; the second device displaying the first image sequence.
[0032] In this embodiment, for scenarios where a mobile phone plays a video in full screen, the watch can receive and then display the image sequence. Therefore, users can watch videos on the watch. One possible approach is that the user sees the complete video frame on the watch, but in a scaled-down format. Another possible approach is that the user sees a portion of the video frame on the watch, which may not be scaled down or may be scaled down less than the scaled-down portion of the complete frame. This allows users to watch various movies, television programs, etc., on their watches, providing a superior viewing experience.
[0033] In one possible design, the dynamic information includes a playing video and / or a playing animated GIF. For example, animated GIFs include animated GIFs, animated emoticons, etc., and this application embodiment is not limited to any particular type.
[0034] In one possible design, the first device is a mobile phone; the second device is a watch or bracelet. It is understood that the first device can also be a tablet computer, laptop computer, etc. The second device can also be a mobile phone, etc. In summary, the embodiments of this application are applicable to any scenario where the display screen of the second device is smaller than the display screen of the first device.
[0035] Secondly, an information transfer method is also provided, applied to a first device, such as a mobile phone. The method includes: the first device connecting to a second device; the first device sending M icons to the second device, the M icons being icons of M applications installed on the first device, where M is a positive integer; the first device receiving a first instruction sent by the second device, the first instruction instructing the first device to transfer information of a first application to the second device, the first application being one of the M applications; and the first device sending the information of the first application to the second device.
[0036] Taking a watch as the second device and a mobile phone as the first device as an example, in this embodiment, the mobile phone can send the icons of locally installed applications to the watch, and after receiving the first instruction from the watch, it transfers information to the watch. This can be understood as the mobile phone displaying the icons and interfaces of local applications on the watch screen, thus enriching the phone's functionality and increasing its appeal to users.
[0037] In one possible design, the first device includes a first application, and the first device sends M icons to the second device, including: the first device launching the first application, and the first application sending M icons to the second device.
[0038] Taking the first application as an example, the HyperTerminal on the mobile phone can transfer the icons of local applications to the watch, and it can also transfer the interface of local applications to the watch for display.
[0039] In one possible design, the first device includes a whitelist containing the names of the M applications. Sending M icons to the second device includes the first application sending the M icons of the M applications in the whitelist to the second device.
[0040] In this embodiment of the application, the icons of which applications are transferred from the mobile phone to the watch can be pre-configured.
[0041] In one possible design, before the first device sends M icons to the second device, the method further includes: the first device displaying a first graphic and a sidebar, the sidebar including K icons of K applications installed on the first device; K being a positive integer; the first device sending M icons to the second device includes: the first device responding to a drag operation to send the M icons to the second device, the drag operation being used to drag the M icons in the sidebar into the first graphic, M being a positive integer less than or equal to K.
[0042] In this embodiment, users can choose which app icons to transfer to the watch according to their needs, resulting in a better user experience.
[0043] In one possible design, the first device sends information about the first application to the second device, including: the first device opening a first interface of the first application; the first device determining that the first interface contains only static information; and the first device sending a first image to the second device, wherein the first image is a screenshot of the first interface.
[0044] In this embodiment, if the first interface contains only static information, the mobile phone only needs to send a screenshot of the first interface to the watch, thereby reducing transmission power consumption.
[0045] In one possible design, the first device sends information about the first application to the second device, including: the first device opening a first interface of the first application; the first device determining that the first interface includes static information and dynamic information, wherein the dynamic information is information that is being dynamically played; the first device sending a first image, a first image sequence, and a first positional relationship to the second device, wherein the first image sequence is a screenshot of the area where the dynamic information is located within the first interface at a first frequency, the first image is a screenshot of the first interface and the information within the area where the dynamic information is located in the screenshot is removed, and the first positional information is used to indicate the position of the first image sequence in the first image.
[0046] In this embodiment, when the first interface contains both dynamic and static information, if screenshots of the entire first interface are taken at a certain frequency to obtain an image sequence, each frame of the image sequence sent from the phone to the watch will include the same information (i.e., static information), wasting transmission power. In this embodiment, when the first interface contains both dynamic and static information, only one screenshot needs to be transmitted for static information, and an image sequence can be transmitted for dynamic information. Therefore, the phone only needs to transmit one image and the image sequence, and each frame of the image sequence does not include static information, greatly reducing transmission power consumption.
[0047] In one possible design, before the first device sends the first image, the first image sequence, and the first positional relationship to the second device, the method further includes: the first device determining a target area within the first interface; and the first device determining that the area where the dynamic information is located overlaps with the target area.
[0048] In this embodiment, when the first interface contains both dynamic and static information, only one screenshot needs to be transmitted for static information. For dynamic information, the mobile phone determines whether the dynamic information is located within the target area. If so, it takes screenshots of the area containing the dynamic information at a certain frequency and sends the resulting image sequence to the watch. If there is no dynamic information within the target area, the dynamic information can be temporarily withheld to reduce transmission power consumption.
[0049] In one possible design, the method further includes: when the first device determines that the area where the dynamic information is located does not overlap with the target area, it sends the first image to the second device; when the first device receives the swipe-up command sent by the second device, it re-determines the target area in the first interface; the first device determines that the area where the dynamic information is located overlaps with the re-determined target area; the first device sends the first image sequence and a first positional relationship to the second device, wherein the first image sequence is a screenshot of the area where the dynamic information is located at a first frequency, and the first positional information is used to indicate the position of the first image sequence in the first image.
[0050] In this embodiment, when the first interface contains both dynamic and static information, only one screenshot needs to be transmitted for static information. For dynamic information, since there is no dynamic information within the target area of the first interface, the phone temporarily does not transmit dynamic information to reduce transmission power consumption. When the phone receives the swipe-up command, it re-determines the target area. If there is dynamic information in the re-determined target area, it takes screenshots of the area containing the dynamic information at a certain frequency and sends the resulting image sequence to the watch.
[0051] In one possible design, the method further includes: the first device determining fixed information in the first interface, the fixed information including a title bar and / or a navigation bar; the first device sending second location information to the second device, the second location information indicating the location of the area where the fixed information is located on the first image.
[0052] In this embodiment, the mobile phone sends the location of the fixed information (title bar and / or navigation bar) to the watch so that the watch can display the fixed information, making it convenient for the user to operate within the area of the fixed information on the watch.
[0053] In one possible design, the target area includes a first area and a second area. The first area is the area where fixed information is located in the first interface, and the fixed information includes a title bar and / or a navigation bar. The second area is other parts of the first interface besides the first area.
[0054] In one possible design, the height of the second region is m. The difference between L and H, where L is the diameter of the display screen of the second device, and m is the ratio of the width of the first interface to L, where m is greater than or equal to 1; the width of the second region is the width of the first region, and the width of the first region is equal to the width of the first interface; the upper edge of the second region is the upper edge of the remaining regions of the first interface excluding the first region.
[0055] In this embodiment, the mobile phone determines a target area based on the watch display parameters. The target area includes a first area and a second area, such that the width and / or the width of the interface formed by the second area and the first area is equal to m. L, where L is the diameter of the watch display screen. In this way, the interface formed by the first and second areas, after being reduced by a factor of m, can be exactly equal to the diameter of the watch display screen, so as to ensure that the interface formed by the first and second areas can be fully displayed in width and / or height as much as possible.
[0056] In one possible design, the first device sends information about the first application to the second device, including: the first device determining that the first interface is playing dynamic information in full screen; the first device sending a first image sequence to the second device, the first image sequence being a screenshot of the scaled-down first interface taken at a first frequency, wherein the width and / or height of the scaled-down first interface is equal to the diameter of the display screen of the second device; or, the first image sequence being a screenshot of a portion of the first interface taken at a first frequency.
[0057] In this embodiment, when the first interface plays a video in full screen, the phone can shrink the video frame and then take screenshots of the shrunken frame at a certain frequency to obtain an image sequence. In this way, the user sees the complete video frame on the watch, but the frame is shrunken. Alternatively, the phone can not shrink the video frame, but instead determine a target area within the video frame and then take screenshots of that target area at a certain frequency to obtain an image sequence. In this way, the user sees a portion of the video frame on the watch, which is not shrunken or only slightly shrunken.
[0058] In one possible design, the second device display screen is circular with a diameter of L, and the partial area is circular with a diameter of m. L, or, the partial region is rectangular and the width and / or height of the rectangle is m. L,m is the ratio of the width of the first interface to L, where m is greater than or equal to 1, and the partial area is located in the middle of the first interface.
[0059] In one possible design, before the first device sends the first image sequence to the second device, the first device further includes: determining that the current network signal is higher than a first threshold.
[0060] In this embodiment of the application, if the network signal is good, the mobile phone can send the image sequence directly to the watch without performing frame extraction processing, so as to ensure that the user can see more details of the dynamic information on the watch.
[0061] In one possible design, the method further includes: when the first device determines that the current network signal is lower than the first threshold, performing frame extraction processing on the first image sequence to obtain a third image sequence; and sending the third image sequence to the second device.
[0062] In this embodiment of the application, if the network signal is poor, the mobile phone can perform frame-by-frame processing on the image sequence and send the image sequence after frame-by-frame processing to the watch to ensure that the watch can play dynamic information smoothly.
[0063] In one possible design, the dynamic information includes a playing video and / or a playing animated GIF. For example, animated GIFs include animated GIFs, animated emoticons, etc., and this application embodiment is not limited to any particular type.
[0064] In one possible design, the first device is a mobile phone; the second device is a watch or bracelet. It is understood that the first device can also be a tablet computer, laptop computer, etc. The second device can also be a mobile phone, etc. In summary, the embodiments of this application are applicable to any scenario where the display screen of the second device is smaller than the display screen of the first device.
[0065] Thirdly, an electronic device is also provided, comprising: Processor, memory, and one or more programs; The one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the method provided in the first aspect above.
[0066] Fourthly, an electronic device is also provided, comprising: Processor, memory, and one or more programs; The one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the method provided in the second aspect above.
[0067] Fifthly, a communication system is also provided, comprising: a first device and a second device; The first device is used to perform the method steps provided in the second aspect above; The second device is used to perform the method steps provided in the first aspect above.
[0068] In a sixth aspect, a computer-readable storage medium is also provided for storing a computer program that, when run on a computer, causes the computer to perform the methods provided in the first or second aspect above.
[0069] In a seventh aspect, a computer program product is also provided, comprising a computer program that, when run on a computer, causes the computer to perform the methods provided in the first or second aspect above.
[0070] Eighthly, a chip is also provided, which is coupled to a memory in an electronic device for calling a computer program stored in the memory and executing the technical solutions of the first or second aspect of the embodiments of this application. In the embodiments of this application, "coupling" means that two components are directly or indirectly combined with each other.
[0071] For the technical effects that can be achieved in the third to eighth aspects mentioned above, please refer to the description of the technical effects that can be achieved by the corresponding design schemes in the first and second aspects mentioned above. This application will not repeat them here. Attached Figure Description
[0072] Figure 1 A schematic diagram of a system provided in an embodiment of this application; Figure 2A A hardware schematic diagram of an electronic device provided in an embodiment of this application; Figure 2B A software schematic diagram of an electronic device provided in an embodiment of this application; Figure 3 This is a schematic diagram illustrating the icon transfer from a mobile phone to a watch according to an embodiment of this application; Figures 4A to 4B This is a first schematic diagram illustrating the transfer of information from a mobile phone to a watch according to an embodiment of this application; Figure 4C This is a second schematic diagram illustrating the flow of information from a mobile phone to a watch according to an embodiment of this application; Figure 4D This is a third schematic diagram illustrating the flow of information from a mobile phone to a watch according to an embodiment of this application; Figure 5A This is a fourth schematic diagram illustrating the flow of information from a mobile phone to a watch according to an embodiment of this application; Figure 5B This is a fifth schematic diagram illustrating the transfer of information from a mobile phone to a watch according to an embodiment of this application; Figure 6 This is a sixth schematic diagram illustrating the flow of information from a mobile phone to a watch, provided in one embodiment of this application. Figure 7 This is a schematic diagram of another structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0073] The following explanations of some terms used in the embodiments of this application are provided to facilitate understanding by those skilled in the art.
[0074] The embodiments of this application involve at least one, including one or more; where "multiple" means two or more. Furthermore, it should be understood that in the description of this specification, terms such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating relative importance or order. For example, "first device" and "second device" do not represent the degree of importance of the two or their order, but are merely for descriptive distinction. In the embodiments of this application, "and / or" merely describes an association relationship, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Additionally, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.
[0075] The directional terms mentioned in the embodiments of this application, such as "up", "down", "left", "right", "inner", and "outer", are only for reference to the directions in the accompanying drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of this application, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the embodiments of this application.
[0076] References to "one embodiment" or "some embodiments" as used in this specification mean that one or more embodiments of this specification include a particular feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0077] The information transfer method provided in this application is applicable to a system. The system includes a first device and a second device. The first device can transfer information to the second device for display. For example, the first device can be a portable electronic device such as a mobile phone, tablet, or laptop, or a desktop computer or television. The second device can be a portable electronic device such as a mobile phone, tablet, or laptop, or a wearable device such as a watch or bracelet. This application does not limit the device types of the first and second devices. The display screen sizes of the first and second devices may differ. For example, the display screen of the first device may be larger than that of the second device. For example, the first device may be a mobile phone and the second device may be a watch, or the first device may be a laptop and the second device may be a mobile phone, or the first device may be a television and the second device may be a tablet, etc. The information transfer method provided in this application can be applied to any scenario where information is transferred from a large-screen device to a small-screen device. For ease of understanding, this article mainly uses the example of a mobile phone as the first device and a watch as the second device for explanation. For example, as... Figure 1 The diagram shown is a schematic representation of a system provided in an embodiment of this application. The system includes a mobile phone and a watch. The mobile phone can transfer information to the watch, and the transfer process will be described later.
[0078] Figure 2A A schematic diagram of an electronic device is shown. This electronic device can be, for example, the first device in a system, such as a mobile phone. Figure 2A As shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0079] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, memory, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the nerve center and command center of the electronic device. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has just used or is recurring. If processor 110 needs to reuse an instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 110, and thus improves system efficiency.
[0080] The processor 110 can be used to execute the information transfer method provided in this application embodiment. For example, the processor 110 can be connected to the second device via the wireless communication module 160. The processor 110 can also receive display screen parameters sent by the second device via the wireless communication module 160, including the shape and / or size of the second device's display screen. Therefore, the processor 110 can determine that the display screen of the second device is smaller than the display screen of the first device based on the display screen parameters. Thus, after the processor 110 receives an instruction to instruct information transfer to the second device (e.g., receiving the instruction via the wireless communication module 160), since the display screen of the second device is smaller than the display screen of the first device, the processor 110 sends information from a portion of the display interface of the first device to the second device for display. Information outside this portion can be temporarily withheld or reduced to decrease transmission power consumption. The specific implementation process will be described later.
[0081] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0082] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0083] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.
[0084] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0085] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.
[0086] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.
[0087] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0088] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0089] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0090] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in conjunction with a tuning switch.
[0091] The mobile communication module 150 can provide solutions for wireless communication applications including 2G / 3G / 4G / 5G in electronic devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0092] The wireless communication module 160 can provide solutions for wireless communication applications in electronic devices, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0093] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the electronic device to communicate with networks and other devices via wireless communication technology.
[0094] The display screen 194 is used to display the application's interface, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include one or more display screens 194.
[0095] The electronic device 100 can perform shooting functions through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor. The ISP is used to process the data fed back by the camera 193.
[0096] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code of at least one application. The data storage area may store data (e.g., images, videos, etc.) generated during the use of the electronic device. In addition, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, general-purpose flash memory, etc. For example, internal memory 121 may store program code of the information transfer method provided in the embodiments of this application, and processor 110 may run the program code to implement the information transfer method of the embodiments of this application. The specific method will be described later.
[0097] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.
[0098] Electronic devices can implement audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, headphone jacks 170D, and application processors.
[0099] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.
[0100] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls and other external playback scenarios through one or more speakers 170A.
[0101] The receiver 170B, also known as a "handpiece," can be one or more, and is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.
[0102] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.
[0103] The 170D headphone jack is used to connect wired headphones.
[0104] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.
[0105] The gyroscope sensor 180B can be used to determine the motion attitude of an electronic device. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization.
[0106] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.
[0107] The magnetic sensor 180D includes a Hall effect sensor. For example, electronic devices can use the magnetic sensor 180D to detect the opening and closing of a flip cover.
[0108] The 180E accelerometer can detect the magnitude of acceleration in various directions (typically three axes) of electronic devices. When the electronic device is stationary, it can detect the magnitude and direction of gravity.
[0109] The 180F distance sensor is used to measure distance. Electronic devices can measure distance using infrared or laser.
[0110] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device emits infrared light outward through the LED. The electronic device uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near the electronic device. When insufficient reflected light is detected, the electronic device can determine that no object is near the electronic device.
[0111] An ambient light sensor 180L is used to detect ambient light levels. Electronic devices can adaptively adjust the brightness of the display screen 194 based on the detected ambient light levels.
[0112] The fingerprint sensor 180H is used to collect fingerprints.
[0113] The 180J temperature sensor is used to detect temperature.
[0114] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K is used to detect touch operations applied to or near it. The touch sensor can then transmit the detected touch operation to the application processor to determine the type of touch event.
[0115] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords.
[0116] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. The electronic device can receive button inputs and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device.
[0117] Understandable, Figure 2A The components shown do not constitute a specific limitation on the electronic device. The electronic device in the embodiments of this application may include, but is not limited to, components that are... Figure 2A More or fewer parts. Furthermore, Figure 2A The combination / connection relationships between the components can also be adjusted and modified.
[0118] Figure 2B This is a software structure diagram of an electronic device provided in an embodiment of this application. The electronic device may be the first device in the system, such as a mobile phone. Figure 2BAs shown, the software architecture of an electronic device can be a layered structure. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. The layered architecture can be, for example, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. This application uses a layered Android® system as an example to illustrate the software architecture of an electronic device. In some embodiments, the Android® system is divided into five layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, the kernel layer, and the hardware layer.
[0119] like Figure 2B As shown, the application layer can include a series of application packages, such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and other applications.
[0120] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications within the application layer. For example... Figure 2B As shown, the application framework layer can include a User Interface (UI) flow entry point, an application management system (AMS), a window manager service (WMS), page management (or interface management), and so on. The UI flow entry point is responsible for starting or stopping the UI flow. The AMS manages the applications on the first device, including application installation and uninstallation, application startup and shutdown, etc. The WMS manages the application interface, for example, it is responsible for rendering the application interface. Page management is responsible for detecting the interface, such as detecting whether there is dynamic information on the interface. Dynamic information will be explained later.
[0121] When the first device does not need to transfer information to the second device, the processing flow includes: The touch sensor in the hardware layer receives an instruction to open application A. The hardware layer sends command a to AMS (e.g., command a is sent to AMS through the kernel layer), command a instructs application A to be launched. After receiving command a, AMS determines that application A should be launched and sends command b to WMS, command b instructing WMS to draw the interface of application A. After receiving command b, WMS draws the interface of application A, such as the homepage of application A. After drawing the interface, WMS displays the interface through the display screen in the hardware layer.
[0122] When the first device needs to transfer information to the second device, the processing flow includes: The touch sensor or Wi-Fi transceiver in the hardware layer receives an instruction to transfer information to the second device, and this instruction includes the application's package name and / or icon (described later). The hardware layer sends Command 1 to the UI transfer entry point (e.g., via the kernel layer), Command 1 instructing the transfer of information to the second device. Command 1 may include the application's package name or icon. Based on Command 1, the UI transfer entry point determines the application to be transferred to the second device. Therefore, the UI transfer entry point sends Command 2 to the AMS, instructing the launch of the application and the transfer of its information to the second device; for example, Command 2 includes the application's package name and / or icon. After receiving Command 2, the AMS determines the application to be launched and sends Command 3 to the WMS, instructing the WMS to draw the application's interface and transfer the information within the interface to the second device. After receiving Command 3, the WMS draws the application's interface, such as the application's homepage. After WMS completes the interface rendering, it sends command 4 to the page management system. Command 4 indicates that the information within the interface needs to be transferred to the second device. Upon receiving command 4, the page management system checks whether there is dynamic information in the interface. If not, it uses the technical solution described in Scenario 1 below. If there is dynamic information, and it is local dynamic information, it uses the technical solution described in Scenario 2 below. If there is dynamic information, and it is global dynamic information, it uses the technical solution described in Scenario 3 below. Dynamic information, static information, local dynamic information, and global dynamic information will be explained later.
[0123] It should be noted that, Figure 2BTaking the UI flow entry point, AMS, WMS, and page management as examples, all located in the application framework layer, it's understandable that one or more of these modules could reside in other layers. For instance, the UI flow entry point might be located in the system library. Furthermore, the application framework layer can include many more modules. For example, it could include a phone manager, resource manager, and notification manager. The phone manager provides communication functions for electronic devices, such as managing call status (including connection and disconnection). The resource manager provides various resources for the application, such as localized strings, icons, images, layout files, video files, etc. The notification manager allows the application to display notification information in the status bar, conveying informative messages that can disappear automatically after a short pause without user interaction. For example, the notification manager can be used to notify of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the system's top status bar, such as notifications from background applications, or as dialog windows on the screen. Examples include displaying text messages in the status bar, emitting alert sounds, vibrating the electronic device, or flashing indicator lights.
[0124] The Android Runtime consists of the core libraries and the virtual machine. The Android runtime is responsible for scheduling and managing the Android system. The core libraries consist of two parts: one part contains the functionalities that Java needs to call, and the other part is the core Android library itself. The application layer and application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0125] The system library can include multiple functional modules, such as a surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), and 2D graphics engines (e.g., SGL). The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media libraries support playback and recording of various common audio and video formats, as well as still image files. They support multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG. The 3D graphics processing libraries implement 3D graphics drawing, image rendering, compositing, and layer processing. The 2D graphics engine is the drawing engine for 2D graphics.
[0126] The kernel layer is the layer between hardware and software. The kernel layer includes at least Wi-Fi drivers, display drivers, camera drivers, audio drivers, and sensor drivers.
[0127] The hardware layer includes various hardware components, such as touch sensors, displays, and Wi-Fi transceivers.
[0128] Understandable, Figure 2B The software structure shown does not constitute a specific limitation on the software structure of the electronic device. The software structure of the electronic device in the embodiments of this application may include more than Figure 2B More or fewer modules, for example, than Figure 2B More or fewer layers, or, a layer containing more than Figure 2B More or fewer modules, etc. Furthermore, Figure 2B The combination / connection relationships between modules can also be adjusted and modified.
[0129] For ease of understanding, the following text will use... Figure 1 The system shown is used as an example for illustration. Figure 1 The system includes both mobile phones and watches. Mobile phones can install various applications, and similarly, watches can also install various applications. Considering the significant differences between watches and mobile phones, both in hardware and software, an application can include both a mobile version and a watch version. A mobile phone can install the mobile version of an application, while a watch can install the watch version. Generally, the watch version has far fewer features than the mobile version. Taking WeChat® as an example, the functionality comparison between the watch version and the mobile version of WeChat® is shown in Table 1 below; Table 1: Function Comparison between WeChat® Watch Version and Mobile Version
[0130] As shown in Table 1 above, the mobile version of WeChat® offers a wider range of features, while the watch version has limited functionality. For example, the watch version cannot forward images or play videos. Understandably, once users are accustomed to the various functions of the mobile version of an application, they are limited to the watch version when using it. Because the watch version's features are limited, users cannot experience the same functionality as the mobile version, leading to a sense of disappointment and negatively impacting their overall watch user experience.
[0131] To enhance the user experience of a smartwatch, this application provides an information transfer method that allows users to experience as many functions on a smartwatch as possible, similar to those on a smartphone. For example, after connecting a smartphone to a smartwatch, information from the smartphone's display can be sent to the smartwatch for display, so the user can see the same information on the smartphone's display on the smartwatch with minimal noticeable difference. Furthermore, considering that the smartwatch's screen is smaller than the smartphone's screen, the smartwatch cannot display all the information from the smartphone's display simultaneously. Therefore, the smartphone can send information from a portion of its display area to the smartwatch, while information outside that area can be temporarily withheld or reduced to minimize power consumption during transmission.
[0132] The following text explains the process of information transfer from a mobile phone to a watch.
[0133] After the phone and watch are connected, app icons from the phone can be sent to the watch. One possible implementation is that the phone has a first app, and the watch has a second app. Both the first and second apps can be dedicated to handling the information flow between the phone and watch. The first app can send app icons from the phone to the second app. After receiving the icons, the second app displays them on the watch screen and can also record the icon's position on the watch screen. The first app can be a system app on the phone, such as HyperTerminal, and the second app can be a system app on the watch, such as Super Launcher.
[0134] Optionally, the first application stores a whitelist, which includes the names of the applications. The first application can send the icons of the applications in the whitelist to the second application on the watch. The whitelist can be pre-configured, for example, it might be pre-configured when the phone leaves the factory.
[0135] Optionally, the first app can also send the icon of the app selected by the user to the watch. For example, see [link to example]. Figure 3 In (a), when the phone opens the first application, the interface 301 of the first application is displayed. When the watch opens the second application, the interface 310 of the second application is displayed. There are several ways for the phone to open the first application; for example, the first application's icon may be included in the control center, allowing access to the first application via this icon. Alternatively, the phone may automatically open the first application when it detects a successful connection with the watch. Similarly, there are several ways for the watch to open the second application; for example, the second application's icon may be included on the watch's home screen, allowing access to the second application via this icon. Alternatively, the watch may automatically open the second application when it detects a successful connection with the phone. Here, the watch can open the second application in the foreground or in the background. Figure 3Taking the foreground opening as an example, this allows users to intuitively see the icon transition process, resulting in a better user experience. It's understandable that if the second application hasn't yet received the icon from the phone, its interface 310 may not contain an icon. Continuing... Figure 3 In (a), the interface 301 of the first application includes a graphic 302. When the mobile phone receives an operation to open the sidebar (e.g., a left swipe operation within interface 301), it opens the sidebar 303, as shown below. Figure 3 (b) The sidebar 303 includes icons of apps installed on the phone. When the phone detects that the user drags an icon from the sidebar 303 to the graphic 302, it sends the icon in graphic 302 to a second app on the watch. For example... Figure 3 In (c), the second application interface 310 on the watch displays an icon received from the mobile phone.
[0136] In this embodiment, the first application sends an icon to the second application on the watch, which can be done by sending a screenshot of the icon. It should be noted that the first application may only send the application icon and not the application's installation package. This is because the application installed on the phone is a mobile version, and the watch's hardware and software cannot run the mobile version's installation package. Furthermore, after the second application obtains the icon from the phone, it will use the first application on the phone to open the application corresponding to the icon, without needing to run the installation package itself. Therefore, the watch does not need to obtain the application's installation package.
[0137] Optional, Figure 3 In (a) of the diagram, the shape of graphic 302 can be arbitrary, such as square, circle, etc. One possible approach is that after the phone and watch are connected, the phone's first application can obtain the watch's display parameters, including the shape and / or size of the watch's display. The first application determines the shape and / or size of graphic 302 based on the watch's display shape and / or size. For example, if the watch's display is circular, then graphic 302 is circular, and the diameter of graphic 302 is equal to the diameter of the watch's display. Alternatively, if the watch's display is square, then graphic 302 is square, and the side length of graphic 302 is equal to the side length of the watch's display. Optionally, the position of graphic 302 in interface 301 can be arbitrary, such as the center of interface 301. Optionally, the inner area and outer area of graphic 302 can be displayed differently, for example, the inner area can be brighter than the outer area to highlight the destination of the icon dragging, resulting in a better user experience. It should be noted that interface 301 is only an example and can be designed in other styles; this application does not limit the specific design.
[0138] Optional, Figure 3The icon transition process shown can be executed during the watch initialization process (e.g., the first power-on after factory installation), or it can be executed when the watch is first connected to the phone, or at any other time; this embodiment of the application does not limit this. After the second application in the watch obtains the icons from the phone, it can retain the icons. For example, after disconnecting from the phone or restarting, the second application will still retain these icons unless the user manually deletes them on the watch. Of course, even after the user manually deletes the icons, the second application can still obtain the icons from the phone.
[0139] pass Figure 3 As shown, the watch retrieves the app's mobile version icon from the phone. As mentioned earlier, the watch can install a watch version of an app locally, and usually, the watch version of the app also has a corresponding icon. Therefore, there may be two types of icons on the watch: one is the mobile version icon retrieved from the phone, and the other is the icon of the watch version app installed locally. One possible approach is that when the second app is open in the foreground, the icon retrieved from the phone is displayed, and the icon of the locally installed watch version app is not displayed. When the second app is not open in the foreground, the icon of the locally installed watch version app is displayed, and the icon retrieved from the phone is not displayed. Taking the second app as a super launcher as an example, it can be understood that the watch has two launchers: a regular launcher and a super launcher. When the second app is not open in the foreground, the display shows the regular launcher. The regular launcher includes the icon of the locally installed watch version app. The regular launcher also includes the icon of the second app. When the second app is open in the foreground, the display shows the super launcher, such as... Figure 3 (c) The watch's display interface 310 includes icons obtained from the phone. Optionally, the watch can also display a mark on the icon obtained from the phone. The mark indicates that the icon was obtained from the phone. Icons of locally installed applications on the watch do not have this mark. Therefore, the user can determine which icons were obtained from the phone by using the mark. One possible scenario is that the icons under the normal desktop correspond to the watch version of the application, which can be used independently when the watch is not connected to the phone, while the icons under the super desktop correspond to the phone version of the application, which requires connection to the phone and can be used with the phone. Therefore, the user can choose to use the normal desktop or the super desktop according to the current situation. For example, when the user is out and about without their phone, they can use the watch version of the application on the normal desktop. Or, when the user is on public transportation and it is inconvenient to hold their phone, they can connect the watch to their phone and then open the watch's second application to enter the super desktop, which includes icons for the phone version of the application, and can open the application corresponding to these icons with the phone.
[0140] In the above embodiments, the second application obtains the mobile version icon from the mobile phone. In other embodiments, the second application already includes the mobile version icon when the watch is manufactured, eliminating the need to obtain it from the mobile phone. Similarly, the watch may only include the mobile version icon, excluding the mobile version installation package, for reasons described above.
[0141] In this embodiment, the watch opens a second application and displays icons transferred from the phone. The second application can record the display position of each icon and the application corresponding to each icon, forming a first correspondence. For example, the first correspondence can be Table 2 below: Table 2: First Correspondence
[0142] Taking icon 1 as an example, the corresponding application is WeChat®, and its display position is (a1, a2, a3, a4), where a1 to a4 are four coordinate points on the display screen, representing that icon 1 is displayed within an area, and the four vertices of this area are a1 to a4. When the second application receives an input operation (e.g., a click operation), it compares the operation position of the input operation with the display position in the first correspondence. Assuming the operation position of the input operation is within the area (a1, a2, a3, a4), it is determined that the input operation is directed at icon 1, and the corresponding application is WeChat®. The second application can send operation information to the first application on the phone. The operation information can include the operation type (i.e., click) and the target object of the operation (e.g., the name of the application, i.e., WeChat®). It can be understood that if the second application receives an input operation and detects that the phone is not currently connected, it can output a prompt to remind the user to connect the phone to the watch. After detecting a successful connection with the phone, it sends operation information to the first application on the phone. After receiving the operation information, the first application on the phone opens the display interface of the corresponding application (e.g., WeChat®) and transfers the information flow within the display interface to the second application on the watch for display.
[0143] The first possible streaming method involves a first application taking screenshots of the entire display interface at a certain frequency, resulting in multiple frames, known as an image stream or image sequence. The first application then sends the image sequence to a second application for display. This method is relatively simple, but since the watch screen is small and cannot display the entire image, the undisplayed parts do not actually need to be transmitted, wasting transmission power.
[0144] The second possible transmission method is as follows: the first application takes screenshots of a portion of the display interface at a certain frequency, omitting screenshots of information outside that portion, thus obtaining an image sequence. The first application then sends the image sequence to the second application. This method reduces the file size of the resulting image sequence and lowers transmission power consumption because it avoids capturing the entire display interface. However, if only static information exists within a portion of the interface, taking screenshots of that portion at a certain frequency results in identical frames in the resulting image sequence, wasting transmission power.
[0145] The third possible flow method is as follows: The first application can determine whether the information displayed on the screen is globally static, locally dynamic, or globally dynamic, and determine which flow method to use based on the determination result. If it is globally static information, then the technical solution of method A or method B in scenario one below is used; if it is locally dynamic information, then the technical solution of method A or method B in scenario two below is used; if it is globally dynamic information, then the technical solution of method A or method B in scenario three below is used. Static information refers to information that does not change dynamically, such as still text and / or images. Dynamic information refers to information that is changing dynamically, such as a playing video or a playing GIF. GIFs include GIF images, animated emoticons, graphical user interface (GUI) GIFs, or other types. It is worth noting that when the mobile phone's display screen includes video, the video is not necessarily dynamic information. For example, when a video is playing, it is dynamic information; when the video stops or pauses playback, it is not dynamic information. Globally static information can be understood as all static information on the display screen. Local dynamic information can be understood as dynamic information in a local area of the display interface, while other areas contain static information. Global dynamic information can be understood as dynamic information being played in full screen on the display interface, such as a video playing in full screen on a mobile phone. There are multiple ways for the first application to determine whether the information on the display interface is globally static, locally dynamic, or globally dynamic. For example, since the mobile phone's display interface refreshes frame by frame, the first application can compare N consecutive frames of the display interface, where N is an integer greater than or equal to 2. If all the display information in the N consecutive frames is the same, then the information on the display interface is determined to be globally static. If the display information in one area of the N consecutive frames is different, while the display information in other areas is the same, then the information on the display interface is determined to be locally dynamic. If all the information in the N consecutive frames is different, then the information on the display interface is determined to be globally dynamic. Of course, the mobile phone can also use other methods to determine whether the information on the display interface is globally static, globally dynamic, or locally dynamic; these are not all illustrated in this application's embodiments.
[0146] The following section provides a detailed explanation of the third flow method. For ease of understanding, examples from different scenarios are provided. Specifically, there are three scenarios: Scenario 1: The phone's display screen shows globally static information. Scenario 2: The phone's display screen shows locally dynamic information. Scenario 3: The phone's display screen shows globally dynamic information.
[0147] Scenario 1: The phone's display screen shows global static information.
[0148] For example, see Figure 4A In (a), the watch displays Super Launcher 310. Super Launcher 310 includes icon 401. Icon 401 is an icon transferred from the phone; please refer to the previous text for the transfer process. Figure 3 The description is as follows. When the second application receives an input operation (e.g., a click operation on icon 401), it compares the operation position of the input operation with the display position in the first correspondence (see Table 2 above), and determines that the operation position of the input operation is within the area (a1, a2, a3, a4), that is, it determines that the input operation is for icon 1 and the corresponding application is WeChat®. The second application sends operation information to the first application on the phone. The operation information includes the operation type of the input operation (e.g., click) and the target object (e.g., the name of WeChat®). After receiving the operation information, the first application on the phone displays as shown below. Figure 4A Interface 402 (b) is an example of WeChat®'s homepage. Interface 402 contains only static information and no dynamic information. The first application transfers the information within interface 402 to the second application, specifically through either method A or method B.
[0149] In Method A, the first application sends all the information within interface 402 to the second application on the watch.
[0150] One possible approach is for the first application to send a screenshot of interface 402 to the second application on the watch. Another possible approach is for the first application to package the page structure and display elements of interface 402 and send them to the second application on the watch. The page structure can be understood as the layout of various display elements within the page. Display elements include text, images, buttons, etc., within the page. After receiving the page structure and display elements, the second application on the watch assembles the display elements into an interface according to the page structure and displays the interface. If the interface is large, the second application can reduce the width of the interface to be equal to the diameter of the watch screen and then display the reduced interface. It is understood that when the second application reduces the width of the page, the display elements within the interface are also reduced. Of course, the second application can also display the interface directly without reducing its width; this embodiment does not limit this. The following example uses the first application sending a screenshot of interface 402 to the second application on the watch. For ease of description, this screenshot is referred to as screenshot A. Since the watch screen is small and cannot fully display the entire screenshot A, after receiving screenshot A, the second application can determine the target area within screenshot A and display the information within that area.
[0151] One possible approach is for the first application to define N regions within interface 402, where N is a positive integer. These N regions can be areas containing fixed information within interface 402. The fixed information may include: a title bar, a navigation bar, etc. The title bar is below the status bar (including battery information, carrier information, time information, etc.) and includes the application's name, for example, Figure 4A Region 403. The navigation bar is usually located at the bottom of the phone screen and includes some common buttons, such as... Figure 4A Area 404 in the interface includes buttons such as the Contacts button, Discover button, and My Profile button. After the first application identifies N areas within interface 402, it sends N area markers and N location information to the second application. The N area markers are used to mark the N areas, and the N location information refers to the positions of the N areas shown in screenshot A. For example, the N area markers and N location information can be found in Table 3 below: Table 3:
[0152] The second application determines N regions on screenshot A based on N region markers and N location information (e.g., Table 3 above). For example, as... Figure 4A In the first part (c), the second application determines region 403 based on (c1, c2, c3, c4) and region 404 based on (d1, d2, d3, d4). Region 403 is the area containing the title bar. Region 404 is the area containing the navigation bar.
[0153] Continue as Figure 4A In (c), besides regions 403 and 404, the second application also determines region 405. Unlike regions 403 and 404, the information in region 405 is non-fixed information, meaning it is information other than the fixed information. One possible approach is that the second application can determine region 405 based on the watch display size. For example, the second application determines the difference between m times the diameter of the watch display and the height H (the sum of the heights of regions 403 and 405), then determines this difference as the height of region 405, and determines the width of regions 403 and 404 (i.e., the width of screenshot A) as the width of region 405, and uses the lower edge of region 403 as the upper edge of region 405. Here, m is the ratio of the width of screenshot A to the diameter of the watch display.
[0154] Therefore, as Figure 4A In (c), the target area determined by the second application in screenshot A includes three dashed areas: area 403, area 404, and area 405. The second application can combine areas 403, 404, and 405 into a single interface. For example, the second application can extract image blocks from the three areas in screenshot A and then stitch them together into an interface. It is understandable that the vertical position of these three areas can be maintained during the interface composition process; for example, in the composed interface, area 403 is at the top, area 404 is at the bottom, and area 405 is in the center.
[0155] Understandably, after the watch combines the three areas into a single interface (referred to as the composite interface), the height of this composite interface is m times the diameter of the watch screen, and its width is the width of screenshot A, which is also m times the diameter of the watch screen. Therefore, if m > 1, the second application can shrink the composite interface, for example, by reducing its width and height by a factor of m, and then display the shrunken interface. Of course, if m = 1, the second application can display the composite interface directly without shrinking it.
[0156] Optionally, after the watch combines the three areas into a single interface (referred to as the composite interface), the second application can further crop the composite interface. For example, it can crop the composite interface according to the shape of the watch screen. Assuming the watch screen is circular with a diameter of L, the composite interface can be cropped to a circle with a diameter m times L. If m > 1, the second application can reduce the diameter of the cropped circular interface by a factor of m and then display the reduced interface, such as... Figure 4A (c) Of course, if m=1, the second application can directly display the composite interface without scaling down.
[0157] Figure 4AIn step (c), the second application can also record the number of each area in the composite interface and the display position of each area on the watch screen, forming a second correspondence. For example, the second correspondence is shown in Table 4 below: Table 4: Second Correspondence
[0158] Taking region 405 as an example, its corresponding number is 0010, and its display position is (g1, g2, g3, g4). Here, g1 to g4 are four coordinate points on the display screen, representing that region 405 is displayed within a region, and the four vertices of this region are g1 to g4. For example... Figure 4A In step (c), when the second application receives the swipe-up operation, it compares the operation position of the swipe-up operation with the display position in the second correspondence (Table 4 above). Assuming the operation position of the swipe-up operation is within (g1, g2, g3, g4), it determines that the swipe-up operation targets area numbered 0010, i.e., area 405. Based on the swipe-up operation, the second application determines the target area within screenshot A, for example, area 406. Figure 4A In (d), region 406 is located below region 405. The second application reduces the width and height of region 406 by a factor of m, then gradually moves region 405 upwards out of the watch display, while simultaneously gradually moving the reduced region 406 into the watch display. For example, when the watch updates... Figure 4A The interface in (d) is shown. It is understandable that since the second application has already received the entire screenshot of interface 402, it can update the interface more quickly and improve the response speed when it receives the swipe-up operation.
[0159] Similarly, Figure 4A In step (d), the second application can record the number of each area in the composite interface and the display position of each area on the watch screen, forming a third correspondence. For example, the third correspondence is shown in Table 5 below: Table 5: Second Correspondence
[0160] Figure 4A In step (d), when the second application receives an upward swipe operation, it compares the operation position of the upward swipe operation with the display position in the third correspondence (Table 5 above). Assuming the operation position of the upward swipe operation is within (h1, h2, h3, h4), it determines that the upward swipe operation targets area numbered 0012, i.e., area 406. Based on the upward swipe operation, the second application determines the target area within screenshot A, for example, area 407. Figure 4BIn (a), region 407 is located below region 406. The second application reduces the width and height of region 407 by a factor of m, then gradually moves region 406 upwards out of the watch display, while simultaneously gradually moving the reduced region 407 into the watch display. For example, when the watch updates... Figure 4B The interface of (a) in the middle.
[0161] Figure 4B In (a), the second application determines that the distance between the lower edge of region 407 and the lower edge of screenshot A is less than or equal to a preset distance, and sends a command to the first application to instruct the interface to be updated. Figure 4B In (b), the phone displays interface 408. The first application determines that interface 408 is global static information and sends a screenshot of interface 408 to the second application. This screenshot is called screenshot B. Optionally, since screenshot B has the same fixed information as screenshot A mentioned above, and the first application has already sent N area markers and N location information to indicate the area where the fixed information is located, the first application may not send the N area markers and N location information this time.
[0162] Figure 4B In (a) of the above, if the second application receives an up swipe operation and determines that the up swipe operation is within region 407, then the target region is redefined. For example, if... Figure 4B In (c), the target areas determined by the second application include area 409 in screenshot A and area 410 in screenshot B. The second application reduces the width and height of areas 409 and 410 by a factor of m. Then, it moves area 407 upwards, gradually moving it off the watch display screen. Simultaneously, the reduced areas 409 and 410 gradually move into the watch display screen. For example, when the watch updates... Figure 4B The interface of (c) in the middle.
[0163] In the example above, the first application displays interface 402 in the foreground and sends a screenshot of interface 402 to the second application on the watch. The second application identifies the target area in the screenshot and composites that area into the displayed interface. Optionally, the first application can also display interface 402 in the background and send a screenshot of the background interface 402 to the second application. Please see [link to relevant documentation]. Figure 4C In (a), the watch displays a super desktop, which includes icon 401. After receiving an input operation (e.g., the user clicking icon 401), the second application sends operation information to the first application on the phone (see previous description). Upon receiving the operation information, the first application creates a virtual display (VD) in the background and displays interface 402 in the VD, such as... Figure 4C(b) In this case, the phone displays the main interface in the foreground. Since interface 402 is global static information, the first application can send a screenshot of interface 402 to the second application on the watch. The second application identifies the target area in the screenshot and then composites the target area into the interface for display, such as... Figure 4C (c) in the text. The process of determining the target area in the screenshot and compositing that area into the interface for display, as described in the second application, is explained above and will not be repeated here. Of course, Figure 4C In section (c), after the second application receives the swipe-up operation, the processing method is the same as described above, and will not be repeated. It should be noted that... Figure 4C During the process, the main interface is displayed in the foreground of the phone, and users can open other applications in the main interface without affecting the user's handling of other tasks, resulting in a good user experience.
[0164] In Method B, the first application sends information within the target area of interface 402 to the watch, while information outside the target area can be temporarily not sent.
[0165] For example, see Figure 4D In (a), the target area determined by the first application includes three dashed areas: area 403, area 404, and area 405. The principle by which the first application determines the target area is the same as that of the second application in method A described above. Figure 4A The principle is the same as in (c)). For example, the first application determines the area containing fixed information within interface 402, such as area 404 and area 405. Then, the first application also determines area 405. For example, the first application can obtain the watch screen size from the second application and then determine area 405 based on the watch screen size. Please refer to the previous text for the process of the first application determining area 405 based on the watch screen size. After determining the target area, the first application sends the information within the target area to the second application on the watch. For example, the first application sends three screenshots to the second application on the watch. Figure 1 Screenshot 2 and screenshot Figure 3 Among them, the cut Figure 1 Screenshot 1 is a screenshot of region 403, and screenshot 2 is a screenshot of region 405. Figure 3 This is a screenshot of a 404 error in the region. The watch's second application needs to integrate the three screenshots into a single interface for display. One possible approach is that the first application is for taking screenshots... Figure 1 Screenshot 2 and screenshot Figure 3 Each screenshot is assigned a number, and the number of each screenshot, along with the positional relationship between the three screenshots, is sent to the watch's second application. For example, screenshot... Figure 1 The number in screenshot 1 is 0000, located at the top. The number in screenshot 2 is 0001, located in the center. Figure 3The number is 0010, located at the bottom. The watch's second application combines the three screenshots into a single interface based on their position. Understandably, the height and width of the combined interface are both m times the diameter of the watch screen. If m > 1, the second application reduces the width and height of the combined interface by a factor of m, and then displays the reduced interface. Of course, if m = 1, the second application may not reduce the size of the combined interface. Optionally, the second application can also crop the combined interface, for example, cropping it according to the shape of the watch screen. For instance, if the watch screen is circular with a diameter of L, the combined interface is cropped to a circle with a diameter m times L. Then, the second application reduces the diameter of the cropped circular interface by a factor of m, and then displays the reduced interface, such as... Figure 4D (b) in the middle.
[0166] The second application will also record the number of each region and the display position of each region on the watch screen, forming a second correspondence, as shown in Table 4 above. Figure 4D In step (b), when the second application receives the swipe-up operation, it compares the operation position of the swipe-up operation with the display position in the second correspondence. Assuming the operation position of the swipe-up operation is within (g1, g2, g3, g4), it determines that the swipe-up operation targets area number 0010, i.e., area 405. The second application sends operation information to the first application on the phone. Here, the operation information includes the operation type (e.g., swipe-up) and the target area (e.g., area number 0001). After receiving the operation information, the first application on the phone re-determines the target area based on the operation information. For example, the re-determined target area is... Figure 4D In section (c), the dashed area 406 is shown. The first application then sends screenshot 4 and its number to the second application. Screenshot 4 is a screenshot of the information within area 406. Furthermore, the first application also sends screenshot 4 and the screenshot... Figure 1 and intercept Figure 3 The positional relationship between them, for example, truncated Figure 1 At the top, screenshot 4 is centered. Figure 3 At the bottom. The watch's second application combines the three screenshots into a single interface based on this positional relationship. Similarly, the second application can also perform operations such as scaling and cropping the interface (details will not be repeated here), displaying it as follows: Figure 4D The interface of (d) in the middle.
[0167] Optionally, in method B, the first application can also display the 402 error in the background and then send a screenshot of the 402 error to the second application, achieving the same result. Figure 4C .
[0168] Comparing Method A and Method B, Method A transmits all information within interface 402 together, while Method B only transmits information within the target area. Therefore, Method A consumes more power. However, in Method A, the watch can respond quickly when receiving an up swipe operation, significantly improving the user experience. Therefore, in practical applications, the first application on the phone can choose to use either Method A or Method B. For example, it can use Method A or Method B by default. Alternatively, before transferring information to the watch, the first application can determine whether to use Method A or Method B based on the current network signal strength. For example, if the current network signal strength is higher than a first threshold, Method A is used; if the current network signal strength is lower than a second threshold, Method B is used. The second threshold is lower than or equal to the first threshold, and the specific values of the first and second thresholds are not limited in this embodiment.
[0169] Scenario 2: The mobile phone's display interface includes some dynamic information.
[0170] For example, see Figure 5A In (a), the watch's second application displays an interface. This interface is composited by the second application; the compositing method can be found in Method A or Method B of Scenario 1 above. When the second application receives an input operation, it converts the specific location of the input operation within screenshot A to the phone's coordinate system and then sends the operation information to the phone. Here, the operation information includes the operation type (i.e., a single click) and the location coordinates (i.e., the location coordinates after conversion to the phone's coordinate system). Figure 5A In (b), the first application, based on the operation information, determines that the operation is a click on the "Discover" button in interface 402, and then opens... Figure 5A Interface 501 (c) in the diagram. Interface 501 includes a Moments option. The phone transfers information from interface 501 to the watch. Since interface 501 includes global static information, it can use method A or method B from scenario one above for the transfer, which will not be repeated here. The watch's second application is displayed as follows. Figure 5A The interface of (d) in the middle. Figure 5A In step (d), after receiving the input operation, the second application sends operation information to the phone. This operation information includes the operation type (i.e., a single click) and location coordinates (the location coordinates obtained after converting the input operation's location coordinates to the phone's coordinate system). After receiving the operation information, the first application on the phone determines that it is a click operation on the "Friends" option in interface 501, and then opens... Figure 5AInterface 502 is shown in (e) of the diagram. Interface 502 includes partial dynamic information, such as videos 503 and 504. It should be noted that when a video is present in the Moments interface 502, the video will play automatically and in a loop. That is, videos 503 and 504 will each play automatically and in a loop. To distinguish them from static information, videos 503 and 504 are indicated by a slash, which represents that they are currently playing. The first application needs to transfer the information within interface 502 to the watch. The first application can transfer interface 502 to the second application in either method A or method B.
[0171] Method A: The first application sends all dynamic information and all static information within interface 502 to the second application respectively.
[0172] For example, the first application determines the area containing dynamic information within interface 502, and then takes screenshots of this area at a certain frequency (e.g., 20 frames per second) to obtain an image sequence, which includes multiple frames. The first application sends the image sequence to the second application. Optionally, the first application can determine the area containing dynamic information by comparing N consecutive frames of the displayed interface, identifying the area where information changes in the N consecutive frames, and then expanding outwards from the center point of this area to find points whose RGB values change more than a preset value. The area enclosed by these points is the area containing dynamic information. This is because points on the edge of the area containing dynamic information will have a color abrupt change compared to points outside the edge. For example, the RGB value of a point on the edge may differ significantly from the RGB values of its neighboring points (outside the edge). Therefore, the first application can determine the area containing dynamic information in this way. For example, Figure 5A In step (e), the first application determines that the regions containing the dynamic information include regions 520 and 530. The first application captures a screenshot of region 520 at frequency 1, obtaining image sequence 1; and captures a screenshot of region 530 at frequency 2, obtaining image sequence 2. Frequency 1 and frequency 2 may be the same or different. Therefore, the first application sends image sequence 1 and image sequence 2 to the second application.
[0173] like Figure 5A In step (e), the first application can also take a screenshot of interface 502, and then remove the area containing the dynamic information from the screenshot. For example, it can extract areas 520 and 530 from the screenshot, and then send the remaining part to the second application. Of course, the area containing the dynamic information in the screenshot may not be removed, and this embodiment of the application does not limit this.
[0174] In other words, the first application sends image sequence 1, image sequence 2, and a screenshot to the second device. After receiving image sequence 1, image sequence 2, and the screenshot, the second application on the watch needs to integrate image sequence 1, image sequence 2, and the screenshot for display.
[0175] One possible approach is that the first application can also send position relationship 1 and position relationship 2 to a second application on the watch. Position relationship 1 indicates the position of image sequence 1 within the screenshot. For example, the distance between image sequence 1 and the top edge of the screenshot, and the distance between image sequence 2 and the left edge of the screenshot. Position relationship 2 indicates the position of image sequence 2 within the screenshot. Based on position relationship 1 and position relationship 2, the second application combines image sequence 1, image sequence 2, and the screenshot into a single interface, such as... Figure 5A (f) in the middle.
[0176] The second application involves defining the target region within the compositing interface. For the principle behind defining the target region, please refer to Scenario 1. For example... Figure 5A In (f), the target area determined by the second application includes area 505 and area 506. The second application combines area 505 and area 506 into a new interface. Optionally, the second application can perform cropping, scaling, or other processing on the combined new interface, which will not be repeated here. For example, the second application displays as follows: Figure 5A The interface in (f) is shown with image sequence 1 playing, so it is indicated by a slash.
[0177] The second application also records the number of each region and the display position of each region on the watch screen. Figure 5A In step (f), when the second application receives the swipe-up operation, it determines which area the swipe-up operation applies to based on the operation position, for example, applying to area 506. Figure 5A In step (g), the second application determines region 507. It should be noted that region 507 contains only a portion of image sequence 2. One possible implementation is that the second application removes the portion of each frame in image sequence 2 located outside region 507, retaining only the portion within region 507. After determining region 507, the second application can also perform scaling, cropping, or other processing on region 507, which will not be repeated here. The second application gradually moves region 506 upwards out of the watch display, while simultaneously gradually moving the scaled-down and cropped region 507 into the watch display. For example, when the watch updates... Figure 5A The interface in (g) shows a portion of image sequence 2.
[0178] Another possible approach is that after the second application receives image sequence 1, image sequence 2, and the screenshot, it can determine the target area within the screenshot instead of compositing the interface first. Figure 5A In (f), the target area determined by the second application includes area 505 and area 506. Then, according to positional relationship 1, the second application determines that image sequence 1 is located within target area 506 and according to positional relationship 2, it determines that image sequence 2 is outside target area 506. Then, according to positional relationship 1, the screenshot area 506 and image sequence 1 are combined to form an interface. Figure 5A In step (g), after receiving the swipe-up operation, the second application determines that the swipe-up operation is applied within region 506, and then re-targets the region, i.e., region 507. Based on positional relationship 2, the second application determines that part of image sequence 2 is located within region 507 and part is located outside region 507. Therefore, it removes the portion outside region 507 from each frame of image sequence 2, retaining only the portion within region 507, thus obtaining a new image sequence. Based on positional relationship 2, the second application synthesizes the new image sequence into region 507 and controls region 507 to gradually move upwards into the watch display screen, while simultaneously controlling region 506 to gradually move out of the watch display screen, as shown below. Figure 5A (g) in the middle.
[0179] In the above embodiment, the first application needs to send image sequence 1 and image sequence 2 to the second application. Taking image sequence 1 as an example, image sequence 1 includes multiple frames of images, and its transmission requires a high network signal strength. If the network signal is poor, the transmission rate is low, and stuttering may occur during playback on the watch, affecting the user experience. In this embodiment, before sending image sequence 1 to the second application, the first application can first determine whether the current network signal strength is lower than a third threshold. If so, frame extraction processing is performed on image sequence 1, and the processed image sequence 1 is sent to the watch; otherwise, frame extraction processing is not required. It is understood that after frame extraction, image sequence 1 has less information, which can improve the transmission rate and prioritize smooth playback on the watch. Optionally, frame extraction processing can be performed by extracting K frames from each P frames in image sequence 1, where P and K are positive integers and less than the total number of frames in the image sequence, and K is less than P. It should be understood that the same method can be used for image sequence 2.
[0180] In the above embodiment, the first application needs to send image sequence 1, image sequence 2, and a screenshot to the second application. In this embodiment, image sequence 1, image sequence 2, and the screenshot can be sent separately. One possible implementation is that the first application sends three files (e.g., three compressed files) to the second application. File 1 includes image sequence 1, file 2 includes image sequence 2, and file 3 includes a screenshot. Files 1, 2, and 3 can be in the same message or different messages. Taking the same message as an example, the message includes fields 1, 2, and 3, where file 1 is located in field 1, file 2 in field 2, and file 3 in field 3. The message also includes fields 4 and 5. Field 4 includes positional relationship 1, used to indicate the position of file 1 in the screenshot of file 3. Field 5 includes positional relationship 2, used to indicate the position of file 2 in the screenshot of file 3. After receiving the message, the second application parses it to obtain three files. Based on positional relationships 1 and 2, it integrates image sequence 1 from file 1, image sequence 2 from file 2, and the screenshot from file 3 into a single interface for display. For example, file 1, file 2, and file 3 might be in different messages: file 1 in message 1, file 2 in message 2, and file 3 in message 3. Messages 1, 2, and 3 can be transmitted in the same or different transmission channels. A transmission channel can be understood as the connection between a port on a mobile phone and a port on a watch; different transmission channels correspond to different ports. Messages 1, 2, and 3 are related. For example, message 1 carries indication information that instructs message 3; message 2 carries indication information that instructs message 3; and message 3 carries indication information that instructs both messages 1 and 2. Furthermore, message 1 includes positional information 1, indicating the position of image sequence 1 in message 1 within the screenshot of message 3. Message 2 includes location information 2, which indicates the position of image sequence 2 in message 2 within the screenshot in message 3. After receiving the three messages, the watch parses image sequence 1, image sequence 2, and the screenshot, as well as location information 1 and location information 2, from the three messages. Based on location relationship 1 and location information 2, it integrates image sequence 1, image sequence 2, and the screenshot into a single interface for display.
[0181] Method B: The first application sends all static information within interface 502 and dynamic information within the target area to the second application respectively.
[0182] like Figure 5B In (a), the first application defines the target area within interface 502. For the method of defining the target area, please refer to Scenario 1. Figure 5BIn (a), the target region includes two dashed areas, region 505 and region 506. The first application determines whether there is dynamic information within the target region. If so, it captures the area containing the dynamic information at a certain frequency (e.g., 20 frames per second) to obtain an image sequence. One way the first application determines whether there is dynamic information within the target region is to identify the area containing the dynamic information (see above for how to identify the area containing the dynamic information), and then compare whether the area containing the dynamic information overlaps with the target region. If they do, the target region is determined to contain dynamic information; otherwise, the target region is determined not to contain dynamic information. For example... Figure 5B In (a), region 506 includes video 503, so the first application takes a screenshot of region 520 where video 503 is located at frequency 1 to obtain image sequence 1.
[0183] It should be noted that since video 504 is not within the target area, the area containing video 504 will not be captured frequently. Because the target area also includes static information, the first application also needs to send the static information within the target area to the watch. One approach is for the first application to only send the static information within the target area to the watch (e.g., send a screenshot), temporarily omitting static information outside the target area. Another approach is for the first application to send all static information within interface 502 to the watch, allowing for a faster response when the watch receives an up swipe operation. For example, the first application can take a screenshot of interface 502, then remove all dynamic information from the screenshot area, such as removing area 520 containing video 503 and area 530 containing video 504 (leaving areas 520 and 530 blank), and send the remaining portion to the second application.
[0184] In other words, the first application sends image sequence 1 and a screenshot to the second device. After receiving image sequence 1 and the screenshot, the second application needs to combine them for display. One possible approach is that the first application on the phone can also send a positional relationship 1 to the second application on the watch, indicating the position of image sequence 1 within the screenshot. For example, positional relationship 1 includes the distance from the top edge of the screenshot and the distance from the left edge of the screenshot. Based on this positional relationship, the second application on the watch combines image sequence 1 and the screenshot into a single interface, such as... Figure 5B (b) Since the first application has already determined the target area, it can send the area markers and location coordinates of the target area (i.e., areas 505 and 506) to the second application. The second application then determines areas 505 and 506 based on the area markers and location coordinates. The second application combines areas 505 and 506 into a single interface. Optionally, the second application can perform cropping, scaling, or other processing on the combined interface. For example, the second application displays... Figure 5BThe interface in (b) is shown with image sequence 1 playing, so it is indicated by a slash.
[0185] The second application also records the number of each region and the display position of each region on the watch screen. Figure 5B In (b) of the above, when the second application receives an up swipe operation, it determines which area the up swipe operation applies to based on the operation position, for example, within area 506. The second application sends operation information to the first application. This operation information includes the operation type (i.e., up swipe) and the targeted area (area 506). The first application determines the target area based on the operation information, for example... Figure 5B The dashed area 507 in (c) is shown. The first application determines that part of the video 504 falls within area 507 and part falls outside area 507 (this is indicated by a slash because the video 504 is playing). The first application can take screenshots of area 530 where the video 504 is located at a certain frequency to obtain image sequence 2, and then send image sequence 2 to the second application. Taking screenshots of area 530 where the video 504 is located at a certain frequency means taking screenshots of the entire area 530, including the part that falls within area 507 and the part that does not fall within area 507. It can be understood that the first application has already sent screenshots of all static information within interface 502 to the watch's second application, so there is no need to send static information again this time. The first application can also send position relationship 2 to the watch to indicate the position of image sequence 2 in the screenshot, such as the distance between it and the top edge of the screenshot, and the distance between it and the left edge of the screenshot. After receiving image sequence 2, the watch's second application combines image sequence 2 and the screenshot into an interface based on the position coordinates, such as Figure 5B (d) Since the first application has already determined the target area (area 507), the area marker and coordinates of the target area (area 507) can be sent to the second application. The second application then determines area 507 in the compositing interface based on the area marker and coordinates. Figure 5B In (d), region 507 includes a portion of image sequence 2. One possible implementation is that the second application removes the portion of each frame in image sequence 2 located outside region 507, retaining only the portion within region 507. After determining region 507, the second application can also perform scaling, cropping, or other processing on region 507, which will not be repeated here. The second application gradually moves region 506 upwards out of the watch display, while simultaneously gradually moving the scaled and cropped region 507 into the watch display. For example, when the watch updates... Figure 5B The interface in (d) shows a portion of image sequence 2. Since image sequence 2 is currently playing, it is indicated by a slash.
[0186] Scenario 3: The phone's display interface includes global dynamic information.
[0187] For example, see Figure 6 In (a), the watch's second application displays an interface including a video 504 that is playing. After receiving an input operation (e.g., clicking on video 504), the second application sends operation information to the phone. This operation information includes the operation type (i.e., click) and coordinate position (the coordinate position after converting the input operation's coordinate position to the phone's coordinate system). Based on the operation information, the phone's first application opens... Figure 6 Interface 602 (b) is shown in section (b). Video 504 is playing in full-screen mode within interface 602, hence indicated by a slash. The first application transfers information from interface 602 to the watch in either method C or method D.
[0188] Method C
[0189] The first application shrinks the interface 602, that is, it shrinks the video playback screen, and then takes screenshots of the shrunken interface 602 at a certain frequency to obtain an image sequence and sends it to the second application on the watch. Shrinking the interface 602 includes: reducing the width of the interface 602 to be equal to the diameter of the watch screen, and / or reducing the height of the interface 602 to be equal to the diameter of the watch screen. It should be understood that if the watch screen is rectangular, then the width of the interface 602 is reduced to be equal to the width of the watch screen, and / or the height of the interface 602 is reduced to be equal to the height of the watch screen. Since the interface 602 does not contain static information, the first application does not need to send static information. After receiving the image sequence, the second application on the watch, since the width and / or height of the images are already adapted to the diameter of the watch, can display them on the screen without further scaling. Optionally, when the second application on the watch receives an operation to zoom in or out of the video playback screen, it can zoom in or out of the video playback screen accordingly.
[0190] Method D
[0191] The first application defines the target area within interface 602, for example... Figure 6 The dashed area in (b) is shown. It should be understood that since interface 602 does not include fixed information, the first application determines the target area based on the display parameters of the second device. For example, if the second device's display is circular with a diameter of L, then the target area is circular with a diameter of m. L, or, the target area is square with a side length of m. L and m are the ratio of the width of interface 602 to L, where m is greater than or equal to 1. The target area can be located in the middle of interface 602. The first application captures a sequence of images of the target area at a certain frequency, without capturing anything outside the target area, and then sends the resulting image sequence to the watch's second application. Since interface 602 does not contain static information, there is no need to send static information. After receiving the image sequence, if the image size in the image sequence is large, the watch's second application can reduce the width of the image to be equal to the diameter of the watch's display screen, and then display the image sequence with the reduced width, for example, displaying... Figure 6 The interface shown in (c) is as follows. When the watch's second application receives an up swipe operation, it sends operation information to the phone. This operation information includes the operation type (i.e., up swipe) and the operation location (within video 504). Based on the operation information, the phone's first application redetermines the target area, for example... Figure 6 The dashed area in (d) is shown. The first application captures images of the dashed area at a certain frequency to obtain an image sequence, which is then sent to the second application on the watch. After receiving the image sequence, the second application on the watch can reduce the width of the images in the image sequence to be equal to the diameter of the watch screen, and then display the reduced-width image sequence, for example, displaying... Figure 6 The interface shown in (e) is shown in the image.
[0192] Optionally, the first application can choose to use either method C or method D. For example, it can default to using method C or method D; or, it can determine whether to use method C or method D based on the situation of interface 602. For example, if the video is playing in the middle area of interface 602 and there is no video in the upper and lower areas (e.g., a black screen), then method D is used, recording only the middle area. Alternatively, it can determine whether to use method C or method D based on the current network signal strength. For example, if the current network signal strength is higher than the third threshold, method C is used; if the current network signal strength is lower than the fourth threshold, method D is used. The fourth threshold is lower than or equal to the third threshold, and the specific values of the third and fourth thresholds are not limited in this embodiment.
[0193] Figure 7 This is a schematic diagram of the structure of the electronic device 700 provided in an embodiment of this application. The electronic device 700 can be the first device or the second device mentioned above. Figure 7As shown, the electronic device 700 may include: one or more processors 701; one or more memories 702; a communication interface 703; and one or more computer programs 704. These components can be connected via one or more communication buses 705. The one or more computer programs 704 are stored in the memory 702 and configured to be executed by the one or more processors 701. The one or more computer programs 704 include instructions. For example, when the electronic device 700 is the first device described above, the instructions can be used to perform the relevant steps of the first device as described in the corresponding embodiments above. Similarly, when the electronic device 700 is the second device described above, the instructions can be used to perform the relevant steps of the second device as described in the corresponding embodiments above. The communication interface 703 is used to enable communication between the electronic device 700 and other devices; for example, the communication interface may be a transceiver.
[0194] The methods provided in the embodiments of this application above are described from the perspective of electronic devices (such as mobile phones, watches, etc.) as the executing entity. To implement the functions of the methods provided in the embodiments of this application above, the electronic device may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.
[0195] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)). Where there is no conflict, the solutions in the above embodiments can be used in combination.
[0196] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0197] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0198] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0199] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0200] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope and intent of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and variations.
Claims
1. An information flow method, characterized in that, Applied to a second device, the method includes: The second device is connected to the first device; The second device receives M icons sent by the first device. The M icons are icons of M applications that have been installed on the first device, where M is a positive integer. The second device does not include the installation packages of the M applications. The second device stores and displays the M icons; After the second device disconnects from the first device or restarts, the second device displays the M icons; The second device receives the first operation, and the operation position of the first operation is located within the display area of the first icon among the M icons; After the second device connects to the first device, it sends a first instruction to the first device. The first instruction is used to instruct the first device to transfer information of the first application to the second device. The first application is the application corresponding to the first icon. The second device receives and displays the first information sent by the first device.
2. The method according to claim 1, characterized in that, The second device includes a second application, and the second device displays the M icons, including: The second device displays the M icons in response to an operation to open the second application.
3. The method according to claim 2, characterized in that, The method further includes: The second device receives an operation to close the second application and displays P icons, where P icons are icons of applications installed locally on the second device, and P is a positive integer.
4. The method according to claim 1, characterized in that, The second device receives and displays the first information sent by the first device, including: The second device receives a first image sent by the first device, the first image being a screenshot of the first interface of the first application by the first device; The second device determines a target area on the first image. The target area includes a first area and a second area. The first area is the area where fixed information is located on the first image. The fixed information includes the title bar and / or navigation bar on the first image. The second area is other parts of the first image besides the first area. The second device combines image blocks in the first region and image blocks in the second region to create a second interface; The second device displays the second interface.
5. The method according to claim 4, characterized in that, The method further includes: The second device receives the swipe-up operation; The second device determines a third region on the first image, the third region being located below the second region; The second device controls the image blocks in the second area of the second interface to gradually move upwards and exit the display screen, and controls the image blocks in the third area to gradually enter the display screen from bottom to top.
6. The method according to claim 1, characterized in that, The second device receives and displays the first information sent by the first device, including: The second device receives a first image sequence, a first image, and first location information sent by the first device. The first image sequence is a multi-frame screenshot of the area where dynamic information is located in the first interface of the first application by the first device. The first image is a screenshot of the first interface by the first device, and the information in the area where the dynamic information is located in the screenshot is removed. The first location information is used to indicate the position of the first image sequence in the first image. The dynamic information is information that is being played dynamically. The second device determines a target area on the first image. The target area includes a first area and a second area. The first area is the area where fixed information is located on the first image. The fixed information includes the title bar and / or navigation bar on the first image. The second area is other parts of the first image besides the first area. The second device determines, based on the first location information, that the entire first image sequence is located within the second region; The second device combines the image blocks in the first area, the image blocks in the second area, and the first image sequence into a second interface, in which the first image sequence is played dynamically. The second device displays the second interface.
7. The method according to claim 6, characterized in that, The method further includes: The second device determines, based on the first location information, that a portion of the first image sequence is located within the second region and a portion is located outside the target region; The second device crops out the portion of each frame in the first image sequence that is outside the second region, and retains the portion that is within the second region, to obtain the second image sequence; The second device combines the image blocks in the first area, the image blocks in the second area, and the second image sequence into a second interface, in which the second image sequence is played dynamically. The second device displays the second interface.
8. The method according to claim 7, characterized in that, The method further includes: The second device receives the swipe-up operation; The second device determines a third region on the first image, the third region being located below the second region; The second device determines, based on the first location information, that the entire first image sequence is located within the third region; The second device controls the second area within the second interface to gradually move upwards and exit the display screen, and controls the third area to gradually enter the display screen from bottom to top, while the first image sequence within the third area is dynamically played.
9. The method according to claim 4, characterized in that, Before the second device determines the target area on the first image, it further includes: The second device receives second location information sent by the first device, the second location information being the location of the first region on the first image; The second device determines the target area on the first image, including: The second device determines the first region in the first image based on the second location information; The second device determines the second area based on the display screen size of the second device and the first area.
10. The method according to claim 9, characterized in that, The display screen of the second device is circular with a diameter of L. Based on the size of the display screen and the first area, the second device determines the second area, including: The second device determines the ratio m of the width of the first image to L, where m is greater than or equal to 1; The second device determines that the height of the first region is H, and the width is the width of the first image; The second device determines the height of the second area to be m. The difference between L and H, the width of the second region is the width of the first region, and the upper edge of the second region is determined to be the upper edge of the remaining regions on the first image other than the first region.
11. The method according to any one of claims 4-10, characterized in that, The second device has a circular display screen, and before displaying the second interface, the second device also includes: The second device reduces the width of the second interface to be equal to the diameter of the circle, and / or reduces the height of the second interface to be equal to the diameter of the circle; The second device displays the second interface, including: the second device displays a scaled-down version of the second interface.
12. The method according to any one of claims 4-10, characterized in that, The display screen of the second device is circular, and before the second device displays the second interface, it also includes: The second device cuts the second interface into a second circle; If the diameter of the second circle is greater than the diameter of the first circle, the second device reduces the diameter of the second circle to be equal to the diameter of the first circle; The second device displays the second interface, including: the second device displays the second interface in a scaled-down shape that is the second circle.
13. The method according to claim 5 or 8, characterized in that, The method further includes: The second device determines that the distance between the lower edge of the third region and the lower edge of the first image is less than a preset distance; The second device sends a second instruction to the first device, the second instruction being used to instruct the first interface to be updated; The second device receives and displays the second information sent by the first device.
14. The method according to any one of claims 1-10, characterized in that, The display screen of the second device is circular with a diameter of L. The second device receives and displays the first information sent by the first device, including: The second device receives a first image sequence sent by the first device. The first image sequence is a multi-frame screenshot of the first interface after the first device has scaled down the first interface of the first application, or the first image sequence is a multi-frame screenshot of a part of the first interface taken by the first device. The first interface plays dynamic information in full screen, and the width and / or height of the scaled-down first interface is equal to L. The second device displays the first image sequence.
15. The method according to any one of claims 1-10, characterized in that, The first device is a mobile phone; the second device is a watch or bracelet.
16. An information flow method, characterized in that, Applied to a first device, the method includes: The first device is connected to the second device; The first device sends M icons to the second device. The M icons are icons of M applications that have been installed on the first device, where M is a positive integer. The second device does not contain the installation packages of the M applications. The second device is used to store and display the M icons. The second device displays the M icons after disconnecting from or restarting from the first device. After the first device connects to the second device, it receives a first instruction sent by the second device. The first instruction is used to instruct the first device to transfer information of the first application to the second device. The first application is the application corresponding to the first icon. The first icon is the user-triggered icon among the M icons on the second device. The first device sends first information to the second device.
17. The method according to claim 16, characterized in that, The method further includes: The first device displays a first graphic and a sidebar, the sidebar including K icons of K applications installed on the first device; K is a positive integer; The first device sends M icons to the second device, including: the first device responds to a drag operation by sending M icons to the second device, the drag operation being used to drag M icons from the K icons in the sidebar into the first graphic, where M is a positive integer less than or equal to K.
18. The method according to claim 16, characterized in that, The first device includes a second application, and the first device sends M icons to the second device, including: The first device launches the second application, and the second application sends M icons to the second device.
19. The method according to claim 16, characterized in that, The first device includes a whitelist, which includes the names of the M applications.
20. The method according to claim 16, characterized in that, The first device sends first information to the second device, including: The first device opens the first interface of the first application; The first device determines that all information on the first interface is static. The first device sends a first image to the second device, the first image being a screenshot of the first interface.
21. The method according to claim 16, characterized in that, The first device sends first information to the second device, including: The first device opens the first interface of the first application; The first device determines that the first interface includes static information and dynamic information, wherein the dynamic information is information that is being played dynamically. The first device sends a first image, a first image sequence, and first location information to the second device. The first image sequence is a screenshot of the area where the dynamic information is located in the first interface at a first frequency. The first image is a screenshot of the first interface in which the information in the area where the dynamic information is located is removed. The first location information is used to indicate the position of the first image sequence in the first image.
22. The method according to claim 21, characterized in that, Before the first device sends the first image, the first image sequence, and the first location information to the second device, it also includes: The first device determines the target area within the first interface; The first device determines that the area where the dynamic information is located overlaps with the target area.
23. The method according to claim 22, characterized in that, The method further includes: When the first device determines that the area where the dynamic information is located does not overlap with the target area, it sends the first image to the second device. When the first device receives the swipe-up command sent by the second device, it re-determines the target area in the first interface; The first device determines that the area where the dynamic information is located overlaps with the redefined target area; The first device sends the first image sequence and the first location information to the second device. The first image sequence is a screenshot of the area where the dynamic information is located at a first frequency, and the first location information is used to indicate the position of the first image sequence in the first image.
24. The method according to any one of claims 20-23, characterized in that, The method further includes: The first device determines fixed information in the first interface, the fixed information including a title bar and / or a navigation bar; The first device sends second location information to the second device, the second location information being used to indicate the location of the area where the fixed information is located on the first image.
25. The method according to claim 22, characterized in that, The target area includes a first area and a second area. The first area is the area where fixed information is located in the first interface. The fixed information includes the title bar and / or navigation bar. The second area is other parts of the first interface besides the first area.
26. The method according to claim 25, characterized in that, The height of the second region is m The difference between L and H, where L is the diameter of the display screen of the second device, m is the ratio of the width of the first interface to L, m is greater than or equal to 1, and H is the height of the first area; The width of the second region is the width of the first region, and the width of the first region is equal to the width of the first interface; The upper edge of the second region is the upper edge of the remaining regions in the first interface other than the first region.
27. The method according to claim 16, characterized in that, The first device sends the first information to the second device, including: The first device determines that the first interface will play dynamic information in full screen. The first device sends a first image sequence to the second device. The first image sequence is a screenshot of the scaled-down first interface taken at a first frequency. The width and / or height of the scaled-down first interface is equal to the diameter of the display screen of the second device. Alternatively, the first image sequence is a screenshot of a portion of the first interface taken at a first frequency.
28. The method according to claim 27, characterized in that, The second device's display screen is circular with a diameter of L, and the aforementioned portion is circular with a diameter of m. L, or, the partial region is rectangular and the width and / or height of the rectangle is m. L,m is the ratio of the width of the first interface to L, where m is greater than or equal to 1, and the partial area is located in the middle of the first interface.
29. The method according to claim 21 or 27, characterized in that, Before the first device sends the first image sequence to the second device, it further includes: The first device determines that the current network signal is higher than a first threshold.
30. The method according to claim 29, characterized in that, The method further includes: When the first device determines that the current network signal is lower than the first threshold, it performs frame extraction on the first image sequence to obtain a third image sequence. The first device sends the third image sequence to the second device.
31. The method according to any one of claims 16-23, characterized in that, The first device is a mobile phone; the second device is a watch or bracelet.
32. An electronic device, characterized in that, include: Processor, memory, and one or more programs; The one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the method steps as claimed in any one of claims 1 to 15; or, when executed by the processor, cause the electronic device to perform the method steps as claimed in any one of claims 16 to 31.
33. A communication system, characterized in that, include: First equipment and second equipment; The second device is used to instruct the method steps as claimed in any one of claims 1 to 15; the first device is used to perform the method steps as claimed in any one of claims 16 to 31.
34. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 31.
35. A computer program product, characterized in that, Includes a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 31.
Citation Information
Patent Citations
Method for controlling terminal by using wearable device and related assembly thereof
CN116301693A
