Information circulation method and related equipment
By implementing information flow methods on wearable devices, the watch allows the watch to receive and display application icons on the phone, and circulate application information when the user operates, the problem of limited watch functions is solved and the user experience is improved.
Patent Information
- Application Number
- CN202311051363.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-18
- Publication Date
- 2025-02-21
Smart Images

Figure CN119496849A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of electronic technology, and in particular to an information flow method and related equipment. Background Art
[0002] In recent years, wearable devices (e.g., smart watches, smart bracelets) have become increasingly indispensable devices in people's lives. Taking smart watches as an example, people's functional requirements for smart watches are getting closer and closer to mobile phones. However, due to the limitations of the software and hardware of watches, their functions are not as rich as those of mobile phones. Therefore, users' usage habits on mobile phones cannot be applied to watches, resulting in a reduced user experience. Summary of the invention
[0003] The embodiments of the present application provide an information flow method and related devices to enhance the user experience of wearable devices.
[0004] In a first aspect, an information transfer method is provided, which is applied to a second device, where the second device is, for example, a wearable device, such as a watch or a bracelet. The method includes: the second device is connected to the first device; the second device receives M icons sent by the first device, where the M icons are icons of M applications installed in the first device, where M is a positive integer; the second device displays the M icons; the second device receives a first operation; when the second device determines that the operation position of the first operation is within the display area of the first icon among the M icons, the second device sends a first instruction to the first device, where the first instruction is used to instruct the first device to transfer information of the first application to the second device, where the first application is the application corresponding to the first icon; the second device receives and displays the first information sent by the first device.
[0005] Taking the second device being a watch and the first device being a mobile phone as an example, in the embodiment of the present application, the watch can obtain and display the icon of the application in the mobile phone, and after receiving a click operation (such as the operation of clicking an icon), the watch can instruct the mobile phone to open the application corresponding to the icon, and then receive and display the information of the application transferred from the mobile phone. In other words, the user can open the application in the mobile phone on the watch and see the interface of the application on the watch. It should be noted that at present, due to the great differences in hardware and software between watches and mobile phones, for the same application (such as ), the mobile version of the app is installed on the phone, and the watch version of the app is installed on the watch. However, the watch version has fewer functions than the mobile version. Therefore, for the same app (for example ), after users are used to using the various functions of the mobile version of the application, they can only use the watch version of the application when using the watch. Since the watch version has limited functions, users cannot experience the same functions as the mobile version, which will cause a sense of gap and affect the user experience of the watch. Through the technical solution of the embodiment of the present application, users can open the application (mobile version) in the mobile phone on the watch and see the interface of the application (mobile version) on the watch, reducing the sense of gap from the mobile phone to the watch and improving the user experience of the watch.
[0006] In a possible design, the second device does not include the installation packages of the M applications. It is understandable that the mobile phone installs the mobile version of the application, and the software and hardware of the watch cannot run the installation package of the mobile version of the application. Moreover, after the watch obtains the icon of the mobile version of the application from the mobile phone, it will use the mobile phone to open the application corresponding to the icon, and the watch does not need to run the installation package by itself, so the watch does not need to include the installation package of the mobile version of the application.
[0007] In one possible design, the second device includes a second application, and the second device displays the M icons, including: the second device displays the M icons in response to an operation for opening the second application.
[0008] Taking the second application as a super desktop as an example, when the super desktop is opened in the watch, the icon obtained from the mobile phone can be displayed. It can be understood that in the super desktop of the watch, the user can see the icon of the application in the mobile phone, and when the user clicks on an icon, the super desktop can instruct the mobile phone to open the application corresponding to the icon, and then receive and display the information of the application transferred from the mobile phone. Therefore, in the embodiment of the present application, the user can open the application in the mobile phone in the super desktop of the watch and see the interface of the application in the super desktop, thereby improving the user experience of the watch.
[0009] In one possible design, the method also includes: when the second device receives an operation for closing the second application, P icons are displayed, where the P icons are icons of applications locally installed on the second device, and P is a positive integer.
[0010] Taking the second application as a super desktop as an example, the watch can have two desktops, one is a normal desktop and the other is a super desktop. When the watch does not open the second application, the normal desktop is displayed. The normal desktop includes icons of P applications (watch version applications) installed locally. Users can open locally installed applications in the normal desktop. When the watch opens the second application, the super desktop is displayed, and the super desktop includes icons obtained from the mobile phone side. Users can open applications in the mobile phone in the super desktop and see the interface of the application in the super desktop. It is understandable that users can choose to use the normal desktop or the super desktop according to the current actual situation. For example, when the user goes out without a mobile phone, the watch version application in the normal desktop can be used. Alternatively, when it is inconvenient for the user to hold the mobile phone in his hand on public transportation, the watch can be connected to the mobile phone, and the application of the mobile phone can be opened in the super desktop of the watch and the interface of the application can be displayed. Therefore, in the embodiment of the present application, both the opening method of the local application of the watch and the opening method of the mobile phone application are provided to enhance the user's experience of using the watch.
[0011] In a possible design, the second device receives and displays the first information sent by the first device, including: the second device receives the first picture sent by the first device, the first picture is a screenshot of the first interface of the first application by the first device; the second device determines a target area on the first picture, the target area includes a first area and a second area, the first area is an area where fixed information on the first picture is located, the fixed information includes a title bar and / or a navigation bar on the first picture, and the second area is other partial areas of the first picture outside the first area; the second device synthesizes the image blocks in the first area and the image blocks in the second area into a second interface; the second device displays the second interface.
[0012] In the embodiment of the present application, after receiving the first image, the watch determines the target area on the first image and then displays the information in the target area. The target area determined by the watch includes the area where the fixed information (e.g., the title bar and / or the navigation bar) is located, so that the user can see the fixed information such as the title bar and / or the navigation bar on the watch, which is convenient for the user to perform some operations (e.g., operations in the navigation bar) in the area where the fixed information is located, and the experience is better.
[0013] In one possible design, the method also includes: the second device receives a swipe up operation; the second device determines a third area on the first picture, and the third area is located below the second area; the second device controls the image blocks in the second area in the second interface to gradually move up and exit the display screen, and controls the image blocks in the fourth area to gradually enter the display screen from bottom to top.
[0014] In the embodiment of the present application, the user can perform a swipe up operation on the watch display to view more content. Moreover, the watch responds faster when the user swipes up. This is because the first picture received by the watch is a screenshot of the entire first interface, and the watch currently only displays part of the content in the screenshot. Therefore, when the watch receives the swipe up operation, it only needs to redefine the target area in the screenshot and display the information in the redefined target area. It does not need to obtain information from the mobile phone temporarily, so the response is faster.
[0015] In a possible design, the second device receives and displays the first information sent by the first device, including: the second device receives a first image sequence, a first picture and first position information sent by the first device, the first image sequence is a multi-frame screenshot of the area where dynamic information is located in the first interface of the first application by the first device, the first picture is a screenshot of the first interface by the first device and the information in the area where the dynamic information is located in the screenshot is removed, the first position information is used to indicate the position of the first image sequence in the first picture, and the dynamic information is information that is being dynamically played; the second device determines a target area on the first picture, the target area includes a first area and a second area, the first area is an area where fixed information on the first picture is located, the fixed information includes a title bar and / or a navigation bar on the first picture, and the second area is other partial areas on the first picture other than the first area; the second device determines, based on the first position information, that the first image sequence is entirely located in the second area; the second device synthesizes the image blocks in the first area, the image blocks in the second area and the first image sequence into a second interface, and the first image sequence is dynamically played in the second interface; the second device displays the second interface.
[0016] In the embodiment of the present application, after the watch receives the first picture, it determines the target area on the first picture. If the position of the image sequence is within the target area, the target area and the image sequence are combined into one interface, and then the interface is displayed and the image sequence is dynamically played in the interface. Therefore, the user can see the dynamically played information on the watch.
[0017] In addition, it should be noted that if there is dynamic information and static information in the first interface, if the entire first interface is screenshoted at a certain frequency to obtain an image sequence. Then each frame of the image sequence received by the watch is larger than the watch display screen, and the undisplayed part does not actually need to be transmitted, which wastes transmission power consumption. Moreover, each frame of the image sequence received by the watch includes the same information (i.e., static information), which wastes transmission power consumption. In an embodiment of the present application, when there is dynamic information and static information in the first interface, only one screenshot needs to be transmitted for the static information, and an image sequence can be transmitted for the dynamic information, so the watch only needs to receive one picture and an image sequence. Moreover, each frame of the image in the image sequence does not include static information, which greatly reduces transmission power consumption.
[0018] In one possible design, the method also includes: the second device determines, based on the first position information, that a portion of the first image sequence is located within the second area and a portion is located outside the target area; the second device crops the portion of each frame of the first image sequence that is located outside the second area, and retains the portion that is located within the second area, to obtain a second image sequence; the second device synthesizes the image blocks within the first area, the image blocks within the second area, and the second image sequence into a second interface, and the second image sequence is dynamically played in the second interface; the second device displays the second interface.
[0019] In the embodiment of the present application, after the watch receives the first picture, it determines the target area on the first picture. If part of the image sequence is within the target area and part is outside the target area, the part of the image sequence outside the target area is cropped, and the target area and the part of the image sequence within the target area are combined into one interface, which is then displayed and the image sequence is dynamically played in the interface. Therefore, the user can see the dynamically played information on the watch.
[0020] In one possible design, the method also includes: the second device receives a swipe up operation; the second device determines a third area on the first picture, and the third area is located below the second area; the second device determines, based on the first position information, that the first image sequence is entirely located within the third area; the second device controls the second area in the second interface to gradually move up and exit the display screen, and controls the third area to gradually enter the display screen from bottom to top, and the first image sequence in the third area is dynamically played.
[0021] In a possible design, before the second device determines the target area on the first picture, it also includes: the second device receives second position information sent by the first device, and the second position information is the position of the first area on the first picture; the second device determines the target area on the first picture, including: the second device determines the first area in the first picture according to the second position information; the second device determines the second area according to the display screen size of the second device and the first area.
[0022] In an embodiment of the present application, the watch can receive the location information of the area where the fixed information is located from the mobile phone, determine the first area on the first picture based on the location information, and determine the second area based on the size of the watch display screen and the first area. Therefore, the target area determined by the watch includes the first area and the second area. The first area is the area where the fixed information (for example, the title bar and / or the navigation bar) is located, and the user can perform some operations (for example, operations in the navigation bar) in the area where the fixed information is located, which provides a better experience.
[0023] In one possible design, the display screen of the second device is circular and has a diameter of L. The second device determines the second area based on the size of the display screen of the second device and the first area, including: the second device determines a ratio m of the width of the first picture to the L, where m is greater than or equal to 1; the second device determines a height of the first area to be H, and a width to be the width of the first picture; the second device determines a height of the second area to be a difference between m*L and H, a width of the second area to be the width of the first area, and determines an upper edge of the second area to be an upper edge of an area remaining on the first picture except the first area.
[0024] In the embodiment of the present application, the target area determined by the watch includes a first area and a second area. The first area is the area where fixed information (e.g., the title bar and / or navigation bar) is located, and the second area is determined based on the size of the watch display and the first area. In short, the width and / or width of the interface synthesized by the second area and the first area is equal to m*L, so that the synthesized interface can be exactly equal to the diameter of the watch display after being reduced by m times, so as to ensure that the synthesized interface can be fully displayed in width and / or height as much as possible.
[0025] In one possible design, the display screen of the second device is circular, and before the second device displays the second interface, it also includes: the second device reduces the width of the second interface to be equal to the diameter of the circle, and / or reduces the height of the second interface to be equal to the diameter of the circle; the second device displays the second interface, including: the second device displays the reduced second interface.
[0026] In an embodiment of the present application, when the watch display screen is circular, the width and / or height of the composite interface can be reduced to be equal to the diameter of the circle, so as to ensure that the composite interface can be fully displayed in width and / or height as much as possible.
[0027] In one possible design, the display screen of the second device is a first circle, and before the second device displays the second interface, it also includes: the second device crops the second interface into a second circle; if the diameter of the second circle is larger than the diameter of the first circle, the second device reduces the diameter of the second circle to be equal to the diameter of the first circle; the second device displays the second interface, including: the second device displays the second interface in a reduced shape of the second circle.
[0028] In the embodiment of the present application, when the watch display screen is circular, the composite interface can be cropped into a circular shape and then displayed. Assuming that the diameter of the composite interface after being cropped into a circular shape is larger than the diameter of the watch display screen, the diameter of the composite interface can be reduced to be equal to the diameter of the watch display screen to ensure that all the information in the composite interface is displayed on the watch display screen.
[0029] In one possible design, the method also includes: the second device determines that the distance between the lower edge of the third area and the lower edge of the first picture is less than a preset distance; the second device sends a second instruction to the first device, and the second instruction is used to instruct to update the first interface; the second device receives and displays the second information sent by the first device.
[0030] In the embodiment of the present application, after the watch receives the first picture, if the user swipes up on the watch display, resulting in the area below the first picture being displayed and the lower edge of the area being close to the lower edge of the screenshot, a command to update the interface is sent to the mobile phone. In this way, the watch can obtain a new screenshot from the mobile phone in advance. If the user continues to swipe up, the target area is determined in the new screenshot and the screenshot in the target area is displayed. Since the new screenshot has been obtained in advance, the watch can respond quickly when receiving the swipe up operation.
[0031] In one possible design, the display screen of the second device is circular and has a diameter of L, and the second device receives and displays the first information sent by the first device, including: the second device receives a first image sequence sent by the first device, the first image sequence is a multi-frame screenshot of the first interface of the first application after the first interface is reduced in size by the first device, or the first image sequence is a multi-frame screenshot of a partial area of the first interface taken by the first device, the first interface plays dynamic information in full screen, and the width and / or height of the reduced first interface is equal to L; the second device displays the first image sequence.
[0032] In an embodiment of the present application, for a scenario where a mobile phone plays a video in full screen, the watch can receive an image sequence and then display the image sequence. Therefore, the user can watch the video on the watch. One possible way is that the user sees the full screen of the video on the watch but the screen is reduced. Another possible way is that the user sees a partial screen of the video on the watch, which may not be reduced or the reduction degree is lower than the reduction degree of the full screen. In this way, the user can watch various movies, TV sets, etc. on the watch with a high experience.
[0033] In a possible design, the dynamic information includes a video being played and / or a dynamic image being played. Exemplarily, the dynamic image includes a GIF dynamic, a dynamic emoticon package, etc., which is not limited in the embodiment of the present application.
[0034] In one possible design, the first device is a mobile phone; the second device is a watch or a bracelet. It is understandable that the first device may also be a tablet computer, a laptop computer, etc. The second device may also be a mobile phone, etc. In short, the embodiment of the present application is applicable to any scenario where the display screen of the second device is smaller than the display screen of the first device.
[0035] In a second aspect, an information transfer method is also provided, which is applied to a first device, and the first device is, for example, a mobile phone. The method includes: the first device is connected to a second device; the first device sends M icons to the first device, and the M icons are icons of M applications installed in the first device, and M is a positive integer; the first device receives a first instruction sent by the second device, and the first instruction is used to instruct the first device to transfer information of a first application to the second device, and the first application is one of the M applications; the first device sends information of the first application to the second device.
[0036] Taking the second device as a watch and the first device as a mobile phone as an example, in the embodiment of the present application, the mobile phone can send the icon of the locally installed application to the watch, and after receiving the first instruction sent by the watch, transfer information to the watch. It can be understood that the mobile phone displays the icon of the local application through the watch display screen, and displays the interface of the local application through the watch display screen, and the mobile phone has more functions and is more attractive to users.
[0037] In a possible design, the first device includes a first application, and the first device sends M icons to the second device, including: the first device starts the first application, and the first application sends M icons to the second device.
[0038] Taking the first application as a hyperterminal as an example, the hyperterminal in the mobile phone can transfer the icon of the local application to the watch, and can also transfer the interface of the local application to the watch for display.
[0039] In one possible design, the first device includes a whitelist, the whitelist includes the names of the M applications, and the first device sends M icons to the first device, including: the first application sends the M icons of the M applications in the whitelist to the second device.
[0040] In the embodiment of the present application, the icons of applications that are transferred from the mobile phone to the watch may be pre-configured.
[0041] In one possible design, before the first device sends M icons to the first device, it also includes: the first device displays a first graphic and a sidebar, the sidebar including K icons of K applications installed in the first device; K is a positive integer; the first device sends M icons to the first device, including: the first device sends the M icons to the second device in response to a drag operation, the drag operation is used to drag the M icons in the sidebar into the first graphic, and M is a positive integer less than or equal to K.
[0042] In the embodiment of the present application, the user can choose which application icons to transfer to the watch according to their needs, which provides a better user experience.
[0043] In one possible design, the first device sends information of the first application to the second device, including: the first device opens the first interface of the first application; the first device determines that all information in the first interface is static information; the first device sends a first picture to the second device, and the first picture is a screenshot of the first interface.
[0044] In the embodiment of the present application, if there is only static information in the first interface, the mobile phone only needs to send a screenshot of the first interface to the watch to reduce transmission power consumption.
[0045] In one possible design, the first device sends information of the first application to the second device, including: the first device opens a first interface of the first application; the first device determines that the first interface includes static information and dynamic information, and the dynamic information is information that is being dynamically played; the first device sends a first picture, the first image sequence and a first position relationship to the second device, the first image sequence is a screenshot of an area where dynamic information is located in the first interface at a first frequency, the first picture is a screenshot of the first interface and the information in the area where the dynamic information is located in the screenshot is removed, and the first position information is used to indicate the position of the first image sequence in the first picture.
[0046] In an embodiment of the present application, when there is dynamic information and static information in the first interface, if the entire first interface is screenshotted at a certain frequency to obtain an image sequence. Each frame of the image sequence sent by the mobile phone to the watch includes the same information (i.e., static information), which wastes transmission power consumption. In an embodiment of the present application, when there is dynamic information and static information in the first interface, only one screenshot needs to be transmitted for static information, and one image sequence can be transmitted for dynamic information, so the mobile phone only needs to transmit one picture and an image sequence, and each frame of the image sequence does not include static information, which greatly reduces transmission power consumption.
[0047] In a possible design, before the first device sends the first picture, the first image sequence and the first position relationship to the second device, it also includes: the first device determines a target area within the first interface; the first device determines that the area where the dynamic information is located overlaps with the target area.
[0048] In the embodiment of the present application, when there is dynamic information and static information in the first interface, only one screenshot needs to be transmitted for the static information. For the dynamic information, the mobile phone determines whether the dynamic information is located in the target area. If so, the mobile phone takes screenshots of the area where the dynamic information is located at a certain frequency and sends the obtained image sequence to the watch. If there is no dynamic information in the target area, the dynamic information may not be sent temporarily to reduce transmission power consumption.
[0049] In a possible design, the method also includes: when the first device determines that the area where the dynamic information is located does not overlap with the target area, sending the first picture to the second device; when the first device receives the swipe-up instruction sent by the second device, redefining the target area in the first interface; the first device determines that the area where the dynamic information is located overlaps with the re-determined target area; the first device sends the first image sequence and the first position relationship to the second device, the first image sequence is a screenshot of the area where the dynamic information is located at a first frequency, and the first position information is used to indicate the position of the first image sequence in the first picture.
[0050] In the embodiment of the present application, when there is dynamic information and static information in the first interface, only one screenshot needs to be transmitted for the static information. For the dynamic information, since there is no dynamic information in the target area of the first interface, the mobile phone temporarily does not send the dynamic information to reduce transmission power consumption. When the mobile phone receives the swipe up instruction, it redefines the target area. If there is dynamic information in the redetermined target area, the area where the dynamic information is located is screenshoted at a certain frequency and the obtained image sequence is sent to the watch.
[0051] In one possible design, the method also includes: the first device determines fixed information in the first interface, the fixed information including a title bar and / or a navigation bar; the first device sends second location information to the second device, and the second location information is used to indicate the location of the area where the fixed information is located on the first picture.
[0052] In an embodiment of the present application, the mobile phone sends the location of the area where the fixed information (title bar and / or navigation bar) is located to the watch, so that the watch displays the fixed information to facilitate user operations in the area where the fixed information is located on the watch.
[0053] In a possible design, the target area includes a first area and a second area, the first area is the area where fixed information in the first interface is located, the fixed information includes a title bar and / or a navigation bar, and the second area is the other partial area outside the first area in the first interface.
[0054] In a possible design, the height of the second area is the difference between m*L and H, where L is the display screen diameter of the second device, m is the ratio of the width of the first interface to L, and m is greater than or equal to 1; the width of the second area is the width of the first area, and the width of the first area is equal to the width of the first interface; the upper edge of the second area is the upper edge of the remaining area of the first interface except the first area.
[0055] In the embodiment of the present application, the mobile phone determines the target area according to the watch display screen parameters, and the target area includes the first area and the second area, so that the width and / or width of the interface synthesized by the second area and the first area is equal to m*L, where L is the diameter of the watch display screen. In this way, the interface synthesized by the first area and the second area can be exactly equal to the diameter of the watch display screen after being reduced by m times, so as to ensure that the interface synthesized by the first area and the second area can be fully displayed in terms of width and / or height as much as possible.
[0056] In one possible design, the first device sends information of the first application to the second device, including: the first device determines dynamic information of full-screen playback of the first interface, and the first device sends a first image sequence to the second device, where the first image sequence is a screenshot of the first interface after it is reduced in size at a first frequency, and the width and / or height of the reduced first interface is equal to the diameter of the display screen of the second device; or, the first image sequence is a screenshot of a partial area of the first interface at a first frequency.
[0057] In an embodiment of the present application, when the first interface plays a video in full screen, the mobile phone can reduce the video screen and then take screenshots of the reduced screen at a certain frequency to obtain an image sequence. In this way, the user sees the complete screen of the video on the watch, but the screen is reduced. Alternatively, the mobile phone does not reduce the video screen, but determines the target area in the video screen, and then takes screenshots of the target area at a certain frequency to obtain an image sequence. In this way, the user sees a partial screen of the video on the watch, which is not reduced or is reduced to a low degree.
[0058] In one possible design, the display screen of the second device is circular and has a diameter of L, the partial area is circular and has a diameter of m*L, or, the partial area is rectangular and the width and / or height of the rectangle is m*L, m is the ratio of the width of the first interface to L, m is greater than or equal to 1, and the partial area is located in the middle position of the first interface.
[0059] In a possible design, before the first device sends the first image sequence to the second device, the process also includes: the first device determining that a current network signal is higher than a first threshold.
[0060] In an embodiment of the present application, if the network signal is good, the mobile phone can send the image sequence directly to the watch without frame extraction, so as to ensure that the user can see more details of the dynamic information on the watch side.
[0061] In one possible design, the method also includes: when the first device determines that the current network signal is lower than the first threshold, performing frame extraction on the first image sequence to obtain a third image sequence; and the first device sends the third image sequence to the second device.
[0062] In an embodiment of the present application, if the network signal is poor, the mobile phone can perform frame extraction on the image sequence and send the image sequence after frame extraction to the watch to ensure that the watch side can play dynamic information smoothly.
[0063] In a possible design, the dynamic information includes a video being played and / or a dynamic image being played. Exemplarily, the dynamic image includes a GIF dynamic, a dynamic emoticon package, etc., which is not limited in the embodiment of the present application.
[0064] In one possible design, the first device is a mobile phone; the second device is a watch or a bracelet. It is understandable that the first device may also be a tablet computer, a laptop computer, etc. The second device may also be a mobile phone, etc. In short, the embodiment of the present application is applicable to any scenario where the display screen of the second device is smaller than the display screen of the first device.
[0065] In a third aspect, an electronic device is also provided, including:
[0066] a processor, a memory, and one or more programs;
[0067] The one or more programs are stored in the memory, and the one or more programs include instructions, which, when executed by the processor, enable the electronic device to execute the method provided in the first aspect above.
[0068] In a fourth aspect, an electronic device is also provided, including:
[0069] a processor, a memory, and one or more programs;
[0070] Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions, and when the instructions are executed by the processor, the electronic device executes the method provided in the second aspect above.
[0071] In a fifth aspect, a communication system is also provided, including: a first device and a second device;
[0072] The first device is used to execute the method steps provided in the second aspect above;
[0073] The second device is used to execute the method steps provided in the first aspect above.
[0074] In a sixth aspect, a computer-readable storage medium is also provided, wherein the computer-readable storage medium is used to store a computer program. When the computer program is run on a computer, the computer executes the method provided in the first aspect or the second aspect above.
[0075] In a seventh aspect, a computer program product is also provided, comprising a computer program, which, when executed on a computer, enables the computer to execute the method provided in the first or second aspect above.
[0076] In the eighth aspect, a chip is also provided, which is coupled to a memory in an electronic device, and is used to call a computer program stored in the memory and execute the technical solution of the first aspect or the second aspect of the embodiment of the present application. In the embodiment of the present application, "coupling" refers to the direct or indirect combination of two components with each other.
[0077] For the technical effects that can be achieved in the above-mentioned third to eighth aspects, please refer to the description of the technical effects that can be achieved by the corresponding design schemes in the above-mentioned first and second aspects, and this application will not repeat them here. BRIEF DESCRIPTION OF THE DRAWINGS
[0078] Figure 1 A schematic diagram of a system provided in accordance with an embodiment of the present application;
[0079] Figure 2A A hardware schematic diagram of an electronic device provided in an embodiment of the present application;
[0080] Figure 2B A software schematic diagram of an electronic device provided in an embodiment of the present application;
[0081] Figure 3 A schematic diagram of transferring icons from a mobile phone to a watch according to an embodiment of the present application;
[0082] FIG. 4A to FIG. 4B A first schematic diagram of information transfer from a mobile phone to a watch provided in an embodiment of the present application;
[0083] Figure 4C A second schematic diagram of information transfer from a mobile phone to a watch provided in an embodiment of the present application;
[0084] Figure 4D A third schematic diagram of information transfer from a mobile phone to a watch provided in an embodiment of the present application;
[0085] Figure 5A A fourth schematic diagram of information transfer from a mobile phone to a watch provided in an embodiment of the present application;
[0086] Figure 5B A fifth schematic diagram of information transfer from a mobile phone to a watch provided in an embodiment of the present application;
[0087] Figure 6 A sixth schematic diagram of information transfer from a mobile phone to a watch provided in an embodiment of the present application;
[0088] Figure 7 Another structural schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION
[0089] Below, some terms in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.
[0090] The at least one involved in the embodiments of the present application includes one or more; wherein, more than one means greater than or equal to two. In addition, it should be understood that in the description of this specification, the words "first", "second", etc. are only used for the purpose of distinguishing the description, and cannot be understood as an explicit or implicit relative importance, nor can they be understood as an explicit or implicit order. For example, the first device and the second device do not represent the importance of the two or the order of the two, but are only for distinguishing the description. In the embodiments of the present application, "and / or" is only a description of the association relationship, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the objects associated before and after are in an "or" relationship.
[0091] The directional terms mentioned in the embodiments of the present application, such as "up", "down", "left", "right", "inside", "outside", etc., are only references to the directions of the drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of the present application, rather than indicating or implying that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the embodiments of the present application.
[0092] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the specification. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0093] The information flow method provided in the embodiment of the present application is applicable to a system. The system includes a first device and a second device. The first device can transfer information to the second device for display. For example, the first device can be a portable electronic device such as a mobile phone, a tablet computer, a laptop computer, or a desktop computer, a television, etc. The second device can be a portable electronic device such as a mobile phone, a tablet computer, a laptop computer, or a wearable device such as a watch or a bracelet. The embodiment of the present application does not limit the device types of the first device and the second device. Among them, the display screen size of the first device and the display screen size of the second device may be inconsistent. For example, the display screen of the first device can be larger than the display screen of the second device. For example, the first device is a mobile phone and the second device is a watch, or the first device is a laptop computer and the second device is a mobile phone, or the first device is a television and the second device is a tablet computer, and so on. The information flow method provided in the embodiment of the present application can be applicable to any scenario where a large-screen device transfers information to a small-screen device. For ease of understanding, this article mainly takes the example that the first device is a mobile phone and the second device is a watch. For example, Figure 1 , which is a schematic diagram of a system provided by an embodiment of the present application. The system includes a mobile phone and a watch. The mobile phone can transfer information to the watch, and the transfer process will be described later.
[0094] Figure 2A FIG. 1 shows a schematic diagram of the structure of an electronic device. The electronic device may be, for example, a first device in a system, such as a mobile phone. Figure 2A As shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0095] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. Among them, the controller may be the nerve center and command center of the electronic device. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
[0096] Among them, the processor 110 can be used to execute the process of the information flow method provided in the embodiment of the present application. For example, the processor 110 can be connected to the second device through the wireless communication module 160. The processor 110 can also receive the display screen parameters sent by the second device through the wireless communication module 160, and the display screen parameters include the shape and / or size of the display screen of the second device. Therefore, the processor 110 can determine that the display screen of the second device is smaller than the display screen of the first device according to the display screen parameters. In this way, after the processor 110 receives an instruction for indicating information flow to the second device (for example, receiving an instruction through the wireless communication module 160). Since the display screen of the second device is smaller than the display screen of the first device, the processor 110 sends the information in a partial area of the display interface of the first device to the second device for display. Information outside the partial area may not be sent temporarily or sent less to reduce transmission power consumption. The specific implementation process will be described later.
[0097] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0098] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0099] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
[0100] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0101] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.
[0102] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0103] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0104] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.
[0105] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0106] The wireless communication function of the electronic device can be implemented by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modulation and demodulation processor and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0107] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to electronic devices. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0108] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to electronic devices. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0109] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that the electronic device can communicate with the network and other devices through wireless communication technology.
[0110] The display screen 194 is used to display the display interface of the application, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include one or more display screens 194.
[0111] The electronic device 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor, etc. Among them, the ISP is used to process the data fed back by the camera 193.
[0112] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, and software code of at least one application program, etc. The data storage area may store data (such as images, videos, etc.) generated during the use of the electronic device. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory, etc. Exemplarily, the program code of the information flow method provided in the embodiment of the present application may be stored in the internal memory 121, and the processor 110 may run the program code to implement the information flow method of the embodiment of the present application. The specific method will be described later.
[0113] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as pictures and videos are stored in the external memory card.
[0114] The electronic device can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0115] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.
[0116] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to external speaker scenarios such as hands-free calls through one or more speakers 170A.
[0117] The receiver 170B, also called a "earpiece", may be one or more and is used to convert an audio electrical signal into a sound signal. When the electronic device 100 receives a call or a voice message, the voice can be received by placing the receiver 170B close to the ear.
[0118] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.
[0119] The earphone jack 170D is used to connect a wired earphone.
[0120] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .
[0121] The gyro sensor 180B can be used to determine the motion posture of the electronic device. In some embodiments, the angular velocity of the electronic device around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting.
[0122] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
[0123] The magnetic sensor 180D includes a Hall sensor. For example, the electronic device can use the magnetic sensor 180D to detect the opening and closing of the flip leather case.
[0124] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device in various directions (generally three axes), and can detect the magnitude and direction of gravity when the electronic device is stationary.
[0125] Distance sensor 180F, used to measure distance. Electronic devices can measure distance through infrared or laser.
[0126] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device emits infrared light outward through the light emitting diode. The electronic device uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device. When insufficient reflected light is detected, the electronic device can determine that there is no object near the electronic device.
[0127] The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device can adaptively adjust the brightness of the display screen 194 according to the sensed brightness of the ambient light.
[0128] The fingerprint sensor 180H is used to collect fingerprints.
[0129] The temperature sensor 180J is used to detect the temperature.
[0130] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
[0131] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of a human vocal part.
[0132] The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The electronic device can receive the button input and generate a key signal input related to the user settings and function control of the electronic device. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195, or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device.
[0133] Understandably, Figure 2A The components shown do not constitute a specific limitation on the electronic device. The electronic device in the embodiment of the present application may include Figure 2A In addition, Figure 2A The combination / connection relationship between the components can also be adjusted and modified.
[0134] Figure 2B The software structure diagram of the electronic device provided in the embodiment of the present application. The electronic device may be the first device in the system, such as a mobile phone. Figure 2BAs shown, the software structure of the electronic device can be a layered structure. The layered architecture is to divide the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. The layered architecture can be, for example, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application is based on the layered architecture. The system is taken as an example to illustrate the software structure of the electronic device. The system is divided into five layers, from top to bottom: application layer, application framework layer, Android runtime and system library, kernel layer and hardware layer.
[0135] like Figure 2B As shown, the application layer can include a series of application packages, such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video and other applications.
[0136] The application framework layer provides application programming interface (API) and programming framework for applications in the application layer. Figure 2B As shown, the application framework layer may include a user interface (UI) flow entry, an application management system (AMS), a window management service (WMS), a page management (or interface management), and the like. Among them, the UI flow entry is responsible for starting or stopping the UI flow. AMS is responsible for managing the applications in the first device, including the installation and uninstallation of applications, the start and stop of applications, etc. WMS is used to manage the interface of the application, for example, it is responsible for drawing the interface of the application, and the page management is responsible for detecting the interface, for example, detecting whether there is dynamic information in the interface. Among them, the dynamic information will be explained later.
[0137] When the first device does not need to transfer information to the second device, the processing flow includes: the touch sensor in the hardware layer receives an instruction, and the instruction is used to instruct to open application A. The hardware layer sends command a to AMS (for example, sends command a to AMS through the kernel layer), and command a is used to instruct to start application A. After receiving command a, AMS determines to start application A and sends command b to WMS, and command b is used to instruct WMS to draw the interface of application A. After receiving command b, WMS draws the interface of application A, such as the homepage of application A. After WMS draws the interface, it displays the interface through the display screen in the hardware layer.
[0138] When the first device needs to transfer information to the second device, the processing flow includes: the touch sensor or wifi transceiver in the hardware layer receives an instruction, the instruction is used to instruct the information to flow to the second device, and the instruction includes the package name and / or icon of the application (which will be described later). The hardware layer sends command 1 to the UI flow entry (for example, sends command 1 to the UI flow entry through the kernel layer), and command 1 is used to instruct the information to flow to the second device. Command 1 may include the package name or icon of the application. The UI flow entry determines the application to be transferred to the second device based on command 1. Therefore, the UI flow entry sends command 2 to the AMS, and command 2 is used to instruct the application to be started and the information of the application to be transferred to the second device. For example, command 2 includes the package name and / or icon of the application. After receiving command 2, the AMS determines the application to be started and sends command 3 to the WMS, and command 3 is used to instruct the WMS to draw the interface of the application and transfer the information in the interface to the second device. After receiving command 3, the WMS draws the interface of the application, such as the homepage of the application. After WMS draws the interface, it sends command 4 to the page management, which is used to indicate that the information in the interface needs to be transferred to the second device. After receiving command 4, the page management detects whether there is dynamic information in the interface. If not, the technical solution of scenario one below is used. If there is dynamic information and it is local dynamic information, the technical solution of scenario two below is used. If there is dynamic information and it is global dynamic information, the technical solution of scenario three below is used. Among them, dynamic information, static information, local dynamic information, global dynamic information, etc. will be explained later.
[0139] It should be noted that Figure 2BIn the example, the UI flow entry, AMS, WMS, page management, etc. are all located in the application framework layer. It can be understood that one or more of the UI flow entry, AMS, WMS, and page management can also be located in other layers, for example, the UI flow entry is located in the system library. In addition, the application framework layer can also include more modules. For example, it can also include a phone manager, a resource manager, a notification manager, etc. The phone manager is used to provide communication functions for electronic devices. For example, the management of call status (including connected, hung up, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables the application to display notification information in the status bar, which can be used to convey notification type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify the download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0140] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system. The core library consists of two parts: one is the function that the Java language needs to call, and the other is the Android core library. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0141] The system library can include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc. Among them, the surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.
[0142] The kernel layer is the layer between hardware and software. The kernel layer includes at least wifi driver, display driver, camera driver, audio driver, sensor driver, etc.
[0143] The hardware layer includes various hardware such as touch sensors, displays, wifi transceivers, etc.
[0144] Understandably, Figure 2B The software structure shown does not constitute a specific limitation on the software structure of the electronic device. The software structure of the electronic device in the embodiment of the present application may include Figure 2B More or fewer modules in Figure 2B More or fewer layers, or a layer contains more than Figure 2B More or fewer modules, etc. In addition, Figure 2B The combination / connection relationship between modules can also be adjusted and modified.
[0145] For ease of understanding, the following Figure 1 The system shown is used as an example for explanation. Figure 1 The system includes mobile phones and watches. Mobile phones can install various applications, and similarly, watches can also install various applications. Considering that watches and mobile phones are very different in both hardware and software, an application can include a mobile version and a watch version. Mobile phones can install the mobile version of applications. Watches can install the watch version of applications. Generally speaking, the watch version has fewer functions than the mobile version. For example, The function comparison between the watch version and the mobile version is shown in Table 1;
[0146] Table 1: Function comparison between watch version and mobile version
[0147]
[0148] From the above Table 1, we can see that The mobile version of the app is more functional, while the watch version is limited in functionality. For example, the watch version cannot forward pictures or play videos. It is understandable that for an app, after users are accustomed to using the various functions of the mobile version of the app, when using the watch, they can only use the watch version of the app. Since the watch version has limited functions, users cannot experience the same functions as the mobile version, which will cause a sense of gap and affect the user experience of the watch.
[0149] In order to enhance the user's experience of operating the watch, an embodiment of the present application provides an information flow method, which can allow the user to experience the same functions as the mobile phone on the watch as much as possible. For example, after the mobile phone is connected to the watch, the information in the display interface of the mobile phone can be sent to the watch for display, so the user can see the information in the display interface of the mobile phone on the watch, and the sense of difference is not obvious. Moreover, in the embodiment of the present application, considering that the display screen of the watch is smaller than the display screen of the mobile phone, the display screen of the watch cannot display all the information in the display interface of the mobile phone together. Therefore, the mobile phone can send the information in some areas of the display interface to the watch for display, and the information outside the partial area can be temporarily not sent or sent less to reduce transmission power consumption.
[0150] The following describes the process of information transfer from the mobile phone to the watch.
[0151] After the mobile phone is connected to the watch, the icon of the application in the mobile phone can be sent to the watch. One possible implementation method is that the mobile phone has a first application. The watch has a second application. The first application and the second application can be applications specifically responsible for the flow of information between the mobile phone and the watch. The first application can send the icon of the application in the mobile phone to the second application. After receiving the icon, the second application displays the icon on the watch display, and can also record the display position of the icon on the watch display. Among them, the first application can be a system application in the mobile phone, such as a super terminal. The second application can be a system application in the watch, such as a super desktop.
[0152] Optionally, a whitelist is stored in the first application, and the whitelist includes the names of the applications. The first application can send icons of the applications included in the whitelist to the second application of the watch. The whitelist can be pre-configured, for example, pre-configured when the mobile phone leaves the factory.
[0153] Optionally, the first application can also send the icon of the application selected by the user to the watch according to the user's selection. For example, see Figure 3 (a), when the mobile phone opens the first application, the interface 301 of the first application is displayed. When the watch opens the second application, the interface 310 of the second application is displayed. There are many ways for the mobile phone to open the first application. For example, the control center includes an icon of the first application, and the first application can be opened through the icon. Alternatively, when the mobile phone detects that the connection with the watch is successful, the first application is automatically opened. There are many ways for the watch to open the second application. For example, the desktop of the watch includes an icon of the second application, and the second application can be opened through the icon. Alternatively, when the watch detects that the connection with the mobile phone is successful, the second application is automatically opened. Here, the watch can open the second application in the foreground or in the background. Figure 3The example is taken as the foreground opening. In this case, the user can intuitively see the icon transfer process, and the experience is high. It is understandable that if the second application has not yet received the icon transferred from the mobile phone, the interface 310 of the second application may not include the icon. Figure 3 (a), the interface 301 of the first application includes a graphic 302. When the mobile phone receives an operation for opening the sidebar (for example, a left swipe operation in the interface 301), the sidebar 303 is opened, such as Figure 3 (b) The sidebar 303 includes icons of applications installed in the mobile phone. When the mobile phone detects that the user drags an icon in the sidebar 303 to the graphic 302, the icon in the graphic 302 is sent to the second application in the watch. Figure 3 (c) The interface 310 of the second application in the watch displays the icon received from the mobile phone.
[0154] In an embodiment of the present application, the first application sends an icon to the second application of the watch, which may be a screenshot of the icon sent to the second application. It should be noted that the first application may only send the icon of the application without sending the installation package of the application. This is because the version of the application installed on the mobile phone is the mobile version, and the software and hardware of the watch cannot run the installation package of the mobile version. Moreover, after the second application obtains the icon from the mobile phone, it will use the first application of the mobile phone to open the application corresponding to the icon, without running the installation package by itself, so the watch does not need to obtain the installation package of the application.
[0155] Optional, Figure 3 The shape of the graphic 302 in (a) can be arbitrary, such as a square, a circle, etc. One possible way is that after the mobile phone is connected to the watch, the first application of the mobile phone can obtain the display screen parameters of the watch, and the display screen parameters include the shape and / or size of the watch display screen. The first application determines the shape and / or size of the graphic 302 according to the shape and / or size of the display screen of the watch. For example, if the display screen of the watch is circular, then the graphic 302 is circular, and the diameter of the graphic 302 is equal to the diameter of the display screen of the watch. Or, if the display screen of the watch is square, then the graphic 302 is square, and the side length of the graphic 302 is equal to the side length of the display screen of the watch. Optionally, the position of the graphic 302 in the interface 301 can be arbitrary, such as the center position of the interface 301. Optionally, the inner area of the graphic 302 and the outer area of the graphic 302 can be displayed differently, for example, the brightness of the inner area is higher than that of the outer area, so as to highlight the destination of the icon dragging, and the user experience is better. It should be noted that the interface 301 is only an example, and can also be designed as other styles, which are not limited in the embodiments of the present application.
[0156] Optional, Figure 3The icon transfer process shown can be executed in the watch initialization process (for example, the first time it is turned on after leaving the factory), or it can also be executed when the watch is connected to the mobile phone for the first time. Of course, it can also be executed at any other time, and the embodiments of the present application are not limited. After the second application in the watch obtains the icon from the mobile phone side, the icon can be retained. For example, after disconnecting from the mobile phone or restarting, these icons are still retained in the second application unless the user manually deletes them on the watch. Of course, after the user manually deletes the icon, the second application can also obtain the icon from the mobile phone side.
[0157] pass Figure 3 In the manner shown, the watch obtains the icon of the mobile version of the application from the mobile phone side. As mentioned above, the watch version of the application can be installed locally on the watch, and usually, the watch version of the application also has a corresponding icon. Therefore, there may be two types of icons in the watch, one is the icon of the mobile version obtained from the mobile phone, and the other is the icon of the watch version of the application installed locally on the watch. One possible way is that when the second application is opened in the foreground of the watch, the icon obtained from the mobile phone is displayed, and the icon of the locally installed watch version of the application is not displayed. When the second application is not opened in the foreground of the watch, the icon of the locally installed watch version of the application is displayed, and the icon obtained from the mobile phone side is not displayed. Taking the second application as a super desktop as an example, it can be understood that there are two desktops in the watch, one is the ordinary desktop and the other is the super desktop. When the second application is not opened in the foreground of the watch, the ordinary desktop is displayed on the display. The ordinary desktop includes the icon of the locally installed watch version of the application. The ordinary desktop also includes the icon of the second application. When the second application is opened in the foreground of the watch, the super desktop is displayed on the display. The super desktop, for example Figure 3 (c) The display interface 310 of the watch in the interface 310 includes icons obtained from the mobile phone side. Optionally, for icons obtained from the mobile phone side, the watch can also display a mark on the icon. The mark is used to indicate that the icon is obtained from the mobile phone. The icon of the application installed locally on the watch does not have this mark. Therefore, the user can determine which icons are obtained from the mobile phone side through the mark. One possible situation is that the icons under the ordinary desktop correspond to the watch version application, which can be used independently when the watch is not connected to the mobile phone, while the icons under the super desktop correspond to the mobile phone version application, which needs to be connected to the mobile phone and can be used with the help of the mobile phone. Therefore, the user can choose to use the ordinary desktop or the super desktop according to the current actual situation. For example, when the user goes out without carrying a mobile phone, the watch version application in the ordinary desktop can be used. Alternatively, when the user is not convenient to hold the mobile phone in his hand on public transportation, he can connect the watch to the mobile phone, and then open the second application of the watch to enter the super desktop, which includes icons of mobile version applications, and the applications corresponding to these icons can be opened with the help of the mobile phone.
[0158] In the above embodiment, the second application obtains the icon of the mobile version of the application from the mobile phone. In other embodiments, the second application comes with the icon of the mobile version of the application when the watch leaves the factory, and there is no need to obtain it from the mobile phone. Similarly, the watch may only include the icon of the mobile version of the application, but not the installation package of the mobile version of the application. Please refer to the above description for the reason.
[0159] In the embodiment of the present application, the watch opens the second application and displays the icons transferred from the mobile phone. The second application can record the display position of each icon and the application corresponding to each icon to form a first correspondence. For example, the first correspondence can be the following Table 2:
[0160] Table 2: First correspondence
[0161]
[0162] Taking icon 1 as an example, the corresponding application is The display position is (a1, a2, a3, a4), where a1 to a4 are four coordinate points on the display screen, representing that icon 1 is displayed in an area, and the four vertices of this area are a1 to a4. When the second application receives an input operation (for example, a click operation), the operation position of the input operation is compared with the display position in the first correspondence. Assuming that the operation position of the input operation is within the area of (a1, a2, a3, a4), it is determined that the input operation is for icon 1, and the corresponding application is The second application can send operation information to the first application in the mobile phone. The operation information may include the operation type (i.e., click), the object targeted by the operation (e.g., the name of the application, ). It is understandable that if the second application receives the input operation and detects that the mobile phone is not currently connected, it can output a prompt to prompt the user to connect the mobile phone to the watch, and after detecting that the connection with the mobile phone is successful, it sends the operation information to the first application in the mobile phone. After receiving the operation information, the first application in the mobile phone opens the corresponding application (for example ) display interface, and transfers the information in the display interface to the second application in the watch for display.
[0163] The first possible transfer mode is that the first application takes screenshots of the entire display interface at a certain frequency to obtain multiple frames of images, which are called image streams or image sequences. The first application sends the image sequence to the second application for display. This method is relatively simple, but because the watch display is too small to display the entire image, the undisplayed part does not actually need to be transmitted, which wastes transmission power consumption.
[0164] The second possible flow mode is that the first application takes screenshots of a part of the display interface at a certain frequency, and does not take screenshots of information outside the part of the area, to obtain an image sequence. The first application sends the image sequence to the second application. In this way, since there is no need to take screenshots of the entire display interface, the file size of the obtained image sequence is reduced, and the transmission power consumption is reduced. However, if there is only static information in the part of the area, if the said part of the area is screenshoted at a certain frequency, each frame of the image in the obtained image sequence is the same, which wastes transmission power consumption.
[0165] The third possible flow mode is that the first application can determine whether the display interface contains global static information, local dynamic information or global dynamic information, and determine which flow mode to use based on the judgment result. If it is global static information, use the technical solution of method A or method B in scenario 1 below; if it is local dynamic information, use the technical solution of method A or method B in scenario 2 below; if it is global dynamic information, use the technical solution of method A or method B in scenario 3 below. Among them, static information refers to information that does not change dynamically, such as static text and / or pictures. Dynamic information refers to information that is changing dynamically, such as a video being played, a gif being played, etc. Among them, the gif includes gif pictures, dynamic emoticons, graphical user interface (GUI) gifs or other types. It is worth noting that when the display interface of the mobile phone includes a video, the video is not necessarily dynamic information. For example, when a video is playing, it is dynamic information, and when the video stops or pauses, it is not dynamic information. Global static information can be understood as all static information in the display interface. Local dynamic information can be understood as dynamic information in a local area of the display interface, and static information in other areas. Global dynamic information can be understood as dynamic information being played in full screen in the display interface, for example, the mobile phone is playing a video in full screen. Among them, there are many ways for the first application to determine whether the display interface is global static information, local dynamic information or global dynamic information. For example, since the display interface of the mobile phone is refreshed frame by frame, the first application can compare N consecutive frames of display interface, N is an integer greater than or equal to 2. If the display information in the N consecutive frames of display interface is all the same, it is determined that the display interface is global static information. If the display information in one area of the N consecutive frames of display interface is different, and the display information in other areas is the same, it is determined that the display interface is local dynamic information. If all the information in the N consecutive frames of display interface is different, it is determined that the display interface is global dynamic information. Of course, the mobile phone can also use other methods to determine whether the display interface is global static information, global dynamic information or local dynamic information, and the embodiments of the present application do not give examples one by one.
[0166] The following mainly describes the third circulation method in detail. For ease of understanding, the following uses different scenarios as examples. Specifically, there are three scenarios: Scenario 1: The display interface of the mobile phone contains global static information. Scenario 2: The display interface of the mobile phone contains local dynamic information. Scenario 3: The display interface of the mobile phone contains global dynamic information.
[0167] Scenario 1: The display interface of the mobile phone contains global static information.
[0168] For example, see Figure 4A (a), the watch displays the super desktop 310. The super desktop 310 includes icons 401. Icons 401 are icons transferred from the mobile phone. Please refer to the previous text for the transfer process. Figure 3 When the second application receives an input operation (e.g., a click operation on icon 401), it compares the operation position of the input operation with the display position in the first correspondence (see Table 2 above), and determines that the operation position of the input operation is within the region (a1, a2, a3, a4), that is, it determines that the input operation is for icon 1, and the corresponding application is The second application sends operation information to the first application of the mobile phone. The operation information includes the operation type of the input operation (for example, click), the target object (for example, After receiving the operation information, the first application of the mobile phone displays the following Figure 4A (b) interface 402. Interface 402 is, for example, The interface 402 contains only static information and no dynamic information. The first application transfers the information in the interface 402 to the second application, and the specific transfer method includes the following method A or method B.
[0169] Mode A: The first application sends all the information in the interface 402 to the second application on the watch.
[0170] One possible way is that the first application sends a screenshot of the interface 402 to the second application of the watch. Another possible way is that the first application packages the page structure and display elements of the interface 402 and sends them to the second application of the watch. The page structure can be understood as the layout of each display element in the page. Display elements include text, pictures, buttons, etc. in the page. After receiving the page structure and display elements, the second application of the watch assembles the display elements into an interface according to the page structure and displays the interface. If the size of the interface is large, the second application can reduce the width of the interface to be equal to the diameter of the watch display screen, and then display the reduced interface. It can be understood that when the second application reduces the width of the page, the display elements in the interface are reduced together. Of course, the second application can also display the interface directly without reducing it, which is not limited in the embodiment of the present application. The following takes the example of the first application sending a screenshot of the interface 402 to the second application of the watch. For the convenience of description, the screenshot is called screenshot A. Since the watch display screen is small, it is impossible to fully display the entire screenshot A, so after the second application receives the screenshot A, it can determine the target area in the screenshot A and display the information in the target area.
[0171] One possible way is that the first application determines N areas in the interface 402, where N is a positive integer, and the N areas may be areas where fixed information in the interface 402 is located. The fixed information may include: a title bar, a navigation bar, etc. The title bar is below the status bar (including power information, operator information, time information, etc.) and includes the name of the application, for example, Figure 4A The middle area 403. The navigation bar is generally located at the bottom of the mobile phone interface and includes some general buttons, such as Figure 4A The first application determines the N areas in the interface 402, and sends N area marks and N location information to the second application. The N area marks are used to mark the N areas, and the N location information is the location of the N areas on the screenshot A. For example, the N area marks and the N location information can be seen in the following Table 3:
[0172] Table 3:
[0173] Area Marking Display Location 1 (c1, c2, c3, c4) 2 (d1, d2, d3, d4) … …
[0174] The second application determines N regions on the screenshot A according to the N region tags and the N location information (such as Table 3 above). Figure 4A (c), the second application determines area 403 according to (c1, c2, c3, c4), and determines area 404 according to (d1, d2, d3, d4). Area 403 is the area where the title bar is located, and area 404 is the area where the navigation bar is located.
[0175] Continue as Figure 4A (c), in addition to area 403 and area 404, the second application also determines area 405. Unlike area 403 and area 404, the information in area 405 is non-fixed information, that is, non-fixed information is other information other than fixed information. One possible way is that the second application can determine area 405 according to the size of the watch display screen. For example, the second application determines the difference between m times the diameter of the watch display screen and the height H (the sum of the heights of area 403 and area 405), and then determines the difference as the height of area 405, and determines the width of area 403 and area 404 (that is, the width of screenshot A) as the width of area 405, and uses the lower edge of area 403 as the upper edge of area 405. Wherein, m is the ratio of the width of screenshot A to the diameter of the watch display screen.
[0176] Therefore, if Figure 4A (c), the target area determined by the second application in screenshot A includes three dotted areas, namely area 403, area 404 and area 405. The second application can synthesize area 403, area 404 and area 405 into one interface. For example, the second application cuts out the image blocks in the three areas from screenshot A and then splices them into one interface. It is understandable that when synthesizing the interface, the upper and lower positional relationship of the three areas can be kept unchanged, for example, in the synthesized interface, area 403 is at the top, area 404 is at the bottom, and area 405 is in the middle.
[0177] It is understandable that after the watch combines the three areas into one interface (referred to as the composite interface), the height of the composite interface is m times the diameter of the watch display screen, and the width is the width of screenshot A, which is also m times the diameter of the watch display screen. Therefore, if m>1, the second application can reduce the composite interface, for example, reduce the width and height of the interface by m times respectively, and then display the reduced interface. Of course, if m=1, the second application can directly display the composite interface without reducing it.
[0178] Optionally, after the watch combines the three areas into one interface (referred to as the combined interface), the second application can also crop the combined interface, for example, crop the combined interface according to the shape of the watch display. Assuming that the watch display is circular and its diameter is L, the combined interface is cropped into a circle with a diameter m times L. If m>1, the second application can reduce the diameter of the interface cropped into a circle by m times, and then display the reduced interface, such as Figure 4A (c) Of course, if m=1, the second application may not be reduced and directly display the composite interface.
[0179] Figure 4AIn (c), the second application may also record the number of each area in the synthetic interface and the display position of each area on the watch display screen to form a second corresponding relationship. For example, the second corresponding relationship is as shown in Table 4 below:
[0180] Table 4: Second correspondence
[0181] area serial number Display Location Area 403 0000 (e1, e2, e3, e4) Area 404 0001 (f1, f2, f3, f4) Area 405 0010 (g1, g2, g3, g4)
[0182] Taking area 405 as an example, the corresponding number is 0010, and the display position is (g1, g2, g3, g4), where g1 to g4 are four coordinate points on the display screen, indicating that area 405 is displayed in an area, and the four vertices of this area are g1 to g4. Figure 4A (c), when the second application receives the swipe-up operation, it compares the operation position of the swipe-up operation with the display position in the second correspondence (Table 4 above). Assuming that the operation position of the swipe-up operation is within (g1, g2, g3, g4), it is determined that the swipe-up operation is for the area numbered 0010, that is, area 405. The second application determines the target area in screenshot A, such as area 406, based on the swipe-up operation. Figure 4A (d), area 406 is located below area 405. The second application reduces the width and height of area 406 by m times respectively, and then moves area 405 upward and gradually out of the watch display screen, and at the same time, gradually moves the reduced area 406 into the watch display screen. For example, the watch is updated to Figure 4A It is understandable that, since the second application has received the entire screenshot of the interface 402 in advance, when receiving the upward sliding operation, the interface can be updated quickly to improve the response speed.
[0183] Similarly, Figure 4A In (d), the second application can record the number of each area in the synthetic interface and the display position of each area on the watch display screen to form a third corresponding relationship. For example, the third corresponding relationship is as shown in Table 5 below:
[0184] Table 5: Second correspondence
[0185] area serial number Display Location Area 403 0000 (e1, e2, e3, e4) Area 404 0001 (f1, f2, f3, f4) Area 406 0012 (h1, h2, h3, h4)
[0186] Figure 4A In (d), when the second application receives the swipe-up operation, it compares the operation position of the swipe-up operation with the display position in the third correspondence (Table 5 above). Assuming that the operation position of the swipe-up operation is within (h1, h2, h3, h4), it is determined that the swipe-up operation is directed to the area numbered 0012, that is, area 406. The second application determines the target area in screenshot A, such as area 407, based on the swipe-up operation. Figure 4B(a), area 407 is located below area 406. The second application reduces the width and height of area 407 by m times respectively, and then moves area 406 upward and gradually out of the watch display screen, and at the same time, gradually moves the reduced area 407 into the watch display screen. For example, the watch is updated to Figure 4B (a) Interface.
[0187] Figure 4B In (a), the second application determines that the distance between the lower edge of the area 407 and the lower edge of the screenshot A is less than or equal to the preset distance, and sends an instruction to the first application, which is used to instruct to update the interface. Figure 4B (b), the mobile phone displays interface 408. The first application determines that interface 408 is global static information, and sends a screenshot of interface 408 to the second application. The screenshot is referred to as screenshot B. Optionally, since screenshot B has the same fixed information as the screenshot A above, and the first application has sent N area marks and N location information for indicating the area where the fixed information is located, the first application may not send N area marks and N location information this time.
[0188] Figure 4B In (a), if the second application receives the swipe up operation and determines that the swipe up operation is within area 407, the target area is re-determined. Figure 4B (c), the target area determined by the second application includes area 409 in screenshot A and area 410 in screenshot B. The second application reduces the width and height of area 409 and area 410 by m times respectively, and then moves area 407 upward and gradually out of the watch display screen. At the same time, the reduced area 409 and area 410 gradually move into the watch display screen. For example, the watch is updated to Figure 4B (c) interface.
[0189] In the above example, the first application displays the interface 402 in the foreground and sends a screenshot of the interface 402 to the second application of the watch. The second application determines the target area in the screenshot and synthesizes the target area into an interface for display. Optionally, the first application can also display the interface 402 in the background and send the screenshot of the background interface 402 to the second application. Figure 4C (a), the watch displays a super desktop, which includes icon 401. After the second application receives the input operation (for example, the user clicks on icon 401), it sends the operation information to the first application of the mobile phone (see the above description). After the first application receives the operation information, it creates a virtual display (Virtual Display, VD) in the background and displays interface 402 in the VD, such as Figure 4C(b). At this time, the main interface is displayed on the front of the mobile phone. Since the interface 402 is global static information, the first application can send a screenshot of the interface 402 to the second application of the watch. The second application determines the target area in the screenshot, and then synthesizes the target area into an interface for display, such as Figure 4C (c). The process of the second application determining the target area in the screenshot and displaying the target area synthesis interface can be found in the previous text and will not be repeated. Figure 4C In (c), after the second application receives the swipe up operation, the processing method is the same as above, and will not be repeated. Figure 4C During the process, the main interface is displayed on the front of the phone. Users can open other applications in the main interface without affecting the user's processing of other matters, providing a good experience.
[0190] Mode B: The first application sends the information in the target area in the interface 402 to the watch, and the information outside the target area may not be sent temporarily.
[0191] For example, see Figure 4D (a), the target area determined by the first application includes three dotted areas, namely area 403, area 404 and area 405. The principle of determining the target area by the first application is the same as that of determining the target area by the second application in the above method A ( Figure 4A (c)) is the same principle. For example, the first application determines the area where the fixed information in the interface 402 is located, such as area 404 and area 405. Afterwards, the first application also determines area 405. For example, the first application can obtain the size of the watch display screen from the second application, and then determine area 405 based on the size of the watch display screen. Please refer to the above text for the process of the first application determining area 405 based on the size of the watch display screen. After the first application determines the target area, it sends the information in the target area to the second application of the watch. For example, the first application sends three screenshots to the second application of the watch. Figure 1 , Screenshot 2 and Screenshot Figure 3 Among them, Figure 1 The first screenshot is a screenshot of area 403, the second screenshot is a screenshot of area 405, and the third screenshot is a screenshot of area 406. Figure 3 is a screenshot of area 404. The second application of the watch needs to integrate the three screenshots into one interface for display. One possible way is that the first application is a screenshot Figure 1 , Screenshot 2 and Screenshot Figure 3 A number is set for each screenshot in the watch, and the number of each screenshot and the positional relationship between the three screenshots are sent to the second application of the watch, for example, the screenshot Figure 1 The number of screenshot 2 is 0001, which is located in the middle. Figure 3The number is 0010, and the position is at the bottom. The second application of the watch combines the three screenshots into one interface based on the positional relationship. It can be understood that the height and width of the composite interface are both m times the diameter of the watch display. If m>1, the second application will reduce the width and height of the composite interface by m times respectively, and then display the reduced interface. Of course, if m=1, the second application may not reduce the composite interface. Optionally, the second application may also crop the composite interface, for example, crop the composite interface according to the shape of the watch display. For example, if the watch display is circular and has a diameter of L, then the composite interface is cropped into a circle with a diameter of m times L. Afterwards, the second application will reduce the diameter of the interface cropped into a circle by m times, and then display the reduced interface, such as Figure 4D (b).
[0192] The second application also records the number of each area and the display position of each area on the watch display screen to form a second corresponding relationship, such as the second corresponding relationship in Table 4 above. Figure 4D In (b), when the second application receives a swipe-up operation, it compares the operation position of the swipe-up operation with the display position in the second corresponding relationship. Assume that the operation position of the swipe-up operation is within (g1, g2, g3, g4), that is, it is determined that the swipe-up operation is targeted at the area numbered 0010, that is, area 405. The second application sends operation information to the first application of the mobile phone. Here, the operation information includes the operation type (such as swiping up) and the target object (such as the area numbered 0001). After the first application of the mobile phone receives the operation information, it redetermines the target area based on the operation information. For example, the target area re-determined by the mobile phone is Figure 4D (c) The dotted area 406. Then, the first application sends screenshot 4 and the number of screenshot 4 to the second application. Screenshot 4 is a screenshot of the information in area 406. In addition, the first application also sends screenshot 4 and the number of screenshot 4. Figure 1 and cut Figure 3 The positional relationship between Figure 1 Top, screenshot 4 in the middle, screenshot Figure 3 The second application of the watch combines the three screenshots into one interface based on the position relationship. Similarly, the second application can also reduce or crop the interface (not repeated here), and display the following: Figure 4D (d) interface.
[0193] Optionally, in method B, the first application may also display interface 402 in the background, and then send a screenshot of the interface 402 displayed in the background to the second application, and the implementation principle is the same as Figure 4C .
[0194] Comparing method A and method B, in method A, all information in interface 402 is transmitted together, and in method B, only information in the target area is transmitted, so method A consumes a lot of power, but in method A, when the watch receives a swipe-up operation, it can respond quickly, and the user experience is significantly improved. Therefore, in actual applications, the first application of the mobile phone can choose to use either method A or method B. For example, method A is used by default or method B is used by default. Alternatively, before the first application transfers information to the watch, it can determine whether to use method A or method B based on the current network signal strength. For example, when the current network signal strength is higher than the first threshold, method A is used, and when the current network signal strength is lower than the second threshold, method B is used. Among them, the second threshold is lower than or equal to the first threshold, and the specific values of the first threshold and the second threshold are not limited in the embodiments of the present application.
[0195] Scenario 2: The display interface of the mobile phone includes local dynamic information.
[0196] For example, see Figure 5A (a), the second application of the watch displays an interface, which is synthesized by the second application. For the synthesis method, please refer to method A or method B in the previous scenario 1. When the second application receives the input operation, it converts the specific position of the input operation in screenshot A to the mobile phone coordinate system, and then sends the operation information to the mobile phone. Here, the operation information includes the operation type (i.e. single click) and the position coordinates (i.e. the position coordinates after conversion to the mobile phone coordinate system). Figure 5A (b) The first application determines, based on the operation information, that the operation is a click operation on the discovery button in the interface 402, and then opens the Figure 5A (c) Interface 501. Interface 501 includes a friend circle option. The mobile phone transfers the information in interface 501 to the watch. Since interface 501 includes global static information, it can be transferred using method A or method B in scenario 1 above, which will not be repeated here. The second application of the watch displays as follows Figure 5A (d) interface. Figure 5A In (d), after receiving the input operation, the second application sends the operation information to the mobile phone. Here, the operation information includes the operation type (i.e., single click) and the location coordinates (the location coordinates obtained after the location coordinates of the input operation are converted to the mobile phone coordinate system). After receiving the operation information, the first application of the mobile phone determines that it is a click operation on the friend circle option in the interface 501, and then opens the Figure 5A(e) Interface 502 shown. Interface 502 includes local dynamic information, for example, video 503 and video 504. It should be noted that when there is a video in the friend circle interface 502, the video will play automatically and in a loop. That is, video 503 and video 504 are each played automatically and in a loop. In order to distinguish them from static information, video 503 and video 504 are marked with a slash, and the slash represents that they are playing. The first application needs to transfer the information in interface 502 to the watch. The way in which the first application transfers interface 502 to the second application includes the following method A or method B.
[0197] In mode A, the first application sends all dynamic information and all static information in the interface 502 to the second application respectively.
[0198] For example, the first application determines the area where the dynamic information is located in the interface 502, and then takes a screenshot of the area at a certain frequency (for example, 20 frames per second) to obtain an image sequence, which includes multiple frames of images. The first application sends the image sequence to the second application. Optionally, the first application can determine the area where the dynamic information is located by comparing N consecutive frames of display interface, determining the area where the information changes in the N consecutive frames of display interface, and expanding the neighborhood with the center point of this area as the center to find points whose RGB change values are greater than a preset value. The area surrounded by these points is the area where the dynamic information is located. This is because the points on the edge line of the area where the dynamic information is located will have a sudden change in color compared to the points outside the edge line. For example, the RGB value of a point on the edge line is significantly different from the RGB value of the adjacent point (outside the edge line). Therefore, in this way, the first application can determine the area where the dynamic information is located. For example, Figure 5A In (e), the first application determines that the area where the dynamic information is located includes area 520 and area 530. The first application takes a screenshot of area 520 at frequency 1 to obtain image sequence 1; and takes a screenshot of area 530 at frequency 2 to obtain image sequence 2. Frequency 1 and frequency 2 can be the same or different. Therefore, the first application sends image sequence 1 and image sequence 2 to the second application.
[0199] like Figure 5A (e), the first application can also take a screenshot of the interface 502, and then remove the area where the dynamic information is located in the screenshot, for example, cut out area 520 and area 530 from the screenshot, and then send the remaining part to the second application. Of course, the area where the dynamic information is located in the screenshot may not be removed, and this embodiment of the application is not limited thereto.
[0200] That is, the first application sends image sequence 1, image sequence 2 and screenshots to the second device. After receiving image sequence 1, image sequence 2 and screenshots, the second application of the watch needs to integrate image sequence 1, image sequence 2 and screenshots for display.
[0201] In one possible way, the first application can also send position relationship 1 and position relationship 2 to the second application of the watch, where position relationship 1 is used to indicate the position of image sequence 1 in the screenshot. For example, the distance from the top edge of the screenshot and the distance from the left edge of the screenshot. Position relationship 2 is used to indicate the position of image sequence 2 in the screenshot. The second application combines image sequence 1, image sequence 2 and the screenshot into one interface based on position relationship 1 and position relationship 2, such as Figure 5A (f).
[0202] The second application determines the target area in the synthesis interface. For the principle of determining the target area, please refer to Scenario 1. Figure 5A (f), the target area determined by the second application includes area 505 and area 506. The second application synthesizes area 505 and area 506 into a new interface. Optionally, the second application can perform processing such as cropping and shrinking on the synthesized new interface, which will not be repeated. For example, the second application displays the following Figure 5A (f) The interface in which image sequence 1 is playing is indicated by a slash.
[0203] The second app also records the number of each zone and the position where each zone is displayed on the watch display. Figure 5A In (f), when the second application receives the swipe up operation, it determines which area the swipe up operation is applied to based on the operation position of the swipe up operation, for example, the area 506. Figure 5A (g), the second application determines area 507. It should be noted that area 507 contains only a portion of image sequence 2. One possible implementation is that the second application removes the portion of each frame in image sequence 2 that is outside area 507, and only retains the portion that is within area 507. After the second application determines area 507, it can also perform processing such as shrinking and cropping on area 507, which will not be repeated. The second application moves area 506 upward and gradually out of the watch display screen, and at the same time, gradually moves area 507 that has been shrunk, cropped, etc. into the watch display screen. For example, the watch is updated to Figure 5A (g) is an interface in which a portion of the image sequence 2 is displayed.
[0204] In another possible manner, after receiving the image sequence 1, the image sequence 2 and the screenshot, the second application may not synthesize the interface first, but determine the target area in the screenshot, for example Figure 5A In (f), the target area determined by the second application includes area 505 and area 506. Then, the second application determines that image sequence 1 is within target area 506 based on positional relationship 1, and determines that image sequence 2 is outside target area 506 based on positional relationship 2. Then, area 506 in the screenshot is synthesized with image sequence 1 according to positional relationship 1 to form an interface. Figure 5AIn (g), after receiving the swipe-up operation, the second application determines that the swipe-up operation is applied to area 506, and then re-targets area 507. The second application determines that part of image sequence 2 is located in area 507 and part is located outside of area 507 based on position relationship 2, and then removes the part of each frame image in image sequence 2 that is located outside of area 507, and only retains the part that is located in area 507, thereby obtaining a new image sequence. The second application synthesizes the new image sequence into area 507 based on position relationship 2, and controls area 507 to gradually move up into the watch display screen, while controlling area 506 to gradually move out of the watch display screen, as shown in FIG. Figure 5A (g).
[0205] In the above embodiment, the first application needs to send image sequence 1 and image sequence 2 to the second application. Taking image sequence 1 as an example, image sequence 1 includes multiple frames of images, and has high requirements for network signals during transmission. If the network signal is not good and the transmission rate is low, there may be freezes when the watch side is playing, affecting the user experience. In the embodiment of the present application, before the first application sends image sequence 1 to the second application, it can first determine whether the current network signal strength is lower than the third threshold. If so, the image sequence 1 is subjected to frame extraction processing, and the image sequence 1 after frame extraction processing is sent to the watch. Otherwise, frame extraction processing is not required. It can be understood that the image sequence 1 after frame extraction processing has a reduced amount of information, which can improve the transmission rate and give priority to ensuring smooth playback on the watch side. Optionally, frame extraction processing can be to extract K frames from each P frame in image sequence 1, where P and K are both positive integers and are less than the total number of frames in the image sequence, and K is less than P. It should be understood that the same method can also be used for image sequence 2.
[0206] In the above embodiment, the first application needs to send image sequence 1, image sequence 2 and screenshots to the second application. In the embodiment of the present application, image sequence 1, image sequence 2 and screenshots can be sent separately. A possible implementation method is that the first application sends three files (for example, three compressed packages) to the second application. Among them, file 1 includes image sequence 1, file 2 includes image sequence 2, and file 3 includes screenshots. File 1, file 2 and file 3 can be in the same message or in different messages. Taking the same message as an example, the message includes field 1, field 2 and field 3, wherein file 1 is located in field 1, file 2 is located in field 2, and file 3 is located in field 3. The message also includes field 4 and field 5, and field 4 includes position relationship 1, which is used to indicate the position of file 1 in the screenshot in file 3. Field 5 includes position relationship 2, which is used to indicate the position of file 2 in the screenshot in file 3. After receiving the message, the second application parses the message to obtain three files, and integrates the image sequence 1 in file 1, the image sequence 2 in file 2, and the screenshots in file 3 into one interface for display according to the position relationship 1 and the position relationship 2. Take file 1, file 2, and file 3 in different messages as an example, for example, file 1 is in message 1, file 2 is in message 2, and file 3 is in message 3. Message 1, message 2, and message 3 can be transmitted in the same transmission channel or in different transmission channels, wherein the transmission channel can be understood as the channel between the port on the mobile phone and the port on the watch, and different transmission channels correspond to different ports. Among them, message 1, message 2, and message 3 have an association relationship, for example, message 1 carries indication information, which is used to indicate message 3, message 2 carries indication information, which is used to indicate message 3, and message 3 carries indication information, which is used to indicate message 1 and message 2. Moreover, message 1 includes position information 1, which is used to indicate the position of image sequence 1 in message 1 in the screenshot of message 3. Message 2 includes position information 2, which is used to indicate the position of image sequence 2 in message 2 in the screenshot of message 3. After receiving the three messages, the watch parses the three messages into image sequence 1, image sequence 2 and the screenshot, as well as position information 1 and position information 2, and integrates image sequence 1, image sequence 2 and the screenshot into one interface for display according to position relationship 1 and position information 2.
[0207] Mode B: The first application sends all static information in the interface 502 and dynamic information in the target area to the second application respectively.
[0208] like Figure 5B (a), the first application determines the target area in the interface 502. For the method of determining the target area, please refer to scenario 1. Figure 5B(a), the target area includes two dotted areas, namely area 505 and area 506. The first application determines whether there is dynamic information in the target area. If so, the area where the dynamic information is located is captured at a certain frequency (for example, 20 frames per second) to obtain an image sequence. Among them, one way for the first application to determine whether there is dynamic information in the target area is that the first application can determine the area where the dynamic information is located (for the method of determining the area where the dynamic information is located, please refer to the previous text), and then compare whether the area where the dynamic information is located and the target area overlap. If so, it is determined that the target area includes dynamic information. Otherwise, it is determined that there is no dynamic information in the target area. For example, Figure 5B In (a), area 506 includes video 503, so the first application takes a screenshot of area 520 where video 503 is located at frequency 1 to obtain image sequence 1.
[0209] It should be noted that since video 504 is not in the target area, multi-frequency screenshots are not taken of the area where video 504 is located. Since the target area also includes static information, the first application also needs to send the static information in the target area to the watch. One way is that the first application only sends the static information in the target area to the watch (for example, screenshot sending), and the static information outside the target area is not sent temporarily. Another way is that the first application sends all static information in the interface 502 to the watch, so that the watch can respond faster when it receives a swipe up operation. For example, the first application takes a screenshot of the interface 502, and then removes the area where all dynamic information in the screenshot is located, such as removing area 520 where video 503 is located and area 530 where video 504 is located (area 520 and area 530 are blank after removal), and sends the remaining part to the second application.
[0210] That is to say, the first application sends image sequence 1 and screenshots to the second device. After the second application receives image sequence 1 and the screenshots, it needs to integrate image sequence 1 and the screenshots for display. One possible way is that the first application on the mobile phone can also send position relationship 1 to the second application on the watch to indicate the position of image sequence 1 in the screenshot. For example, position relationship 1 includes: the distance from the top edge of the screenshot, and the distance from the left edge of the screenshot. The second application on the watch combines image sequence 1 and the screenshot into an interface based on the position relationship, such as Figure 5B (b). Since the first application has already determined the target area, the first application can send the area mark and position coordinates of the target area (i.e., area 505 and area 506) to the second application, and the second application determines area 505 and area 506 based on the area mark and position coordinates. The second application combines area 505 and area 506 into one interface. Optionally, the second application can crop, reduce, etc. the combined interface. For example, the second application displays Figure 5B(b) The interface where image sequence 1 is playing is indicated by a slash.
[0211] The second app also records the number of each zone and the position where each zone is displayed on the watch display. Figure 5B In (b), when the second application receives the swipe-up operation, it determines which area the swipe-up operation is applied to based on the operation position of the swipe-up operation, for example, within area 506. The second application sends operation information to the first application. The operation information here includes the operation type (i.e., swipe-up) and the targeted area (area 506). The first application determines the target area based on the operation information, for example Figure 5B (c) The dotted area 507 in FIG. 4 . The first application determines that a portion of the video 504 falls within the area 507 and a portion falls outside the area 507 (since the video 504 is playing, it is indicated by a slash). The first application can take screenshots of the area 530 where the video 504 is located at a certain frequency, obtain an image sequence 2, and then send the image sequence 2 to the second application. Among them, taking screenshots of the area 530 where the video 504 is located at a certain frequency is to take screenshots of the entire area 530, including the portion that falls within the area 507 and the portion that does not fall within the area 507. It can be understood that the first application has sent screenshots of all static information in the interface 502 to the second application of the watch, so there is no need to send static information this time. The first application can also send a position relationship 2 to the watch to indicate the position of the image sequence 2 in the screenshot, such as the distance from the upper edge of the screenshot, and the distance from the left edge of the screenshot. After receiving the image sequence 2, the second application of the watch combines the image sequence 2 and the screenshot into one interface according to the position coordinates, such as Figure 5B (d) Since the first application has already determined the target area (area 507), the area mark and coordinate position of the target area (area 507) can be sent to the second application, and the second application determines area 507 in the composite interface according to the area mark and coordinate position. Figure 5B (d), region 507 includes a portion of image sequence 2. One possible implementation is that the second application removes the portion of each frame in image sequence 2 that is outside region 507, and only retains the portion that is within region 507. After the second application determines region 507, it may also perform processing such as shrinking and cropping on region 507, which will not be repeated. The second application moves region 506 upward and gradually out of the watch display screen, and at the same time, gradually moves region 507 that has been shrunk, cropped, etc. into the watch display screen. For example, the watch is updated to Figure 5B (d) is an interface in which a portion of image sequence 2 is displayed. Image sequence 2 is currently being played, so it is indicated by a slash.
[0212] Scenario 3: The display interface of the mobile phone includes global dynamic information.
[0213] For example, see Figure 6 (a), the second application of the watch displays an interface, which includes video 504 and is playing. After receiving the input operation (for example, the operation of clicking on video 504), the second application sends the operation information to the mobile phone. Here, the operation information includes the operation type (i.e., click) and the coordinate position (the coordinate position after the coordinate position of the input operation is converted to the coordinate system of the mobile phone). The first application of the mobile phone opens the mobile phone according to the operation information. Figure 6 (b) interface 602. Video 504 is playing in full screen in interface 602, so it is indicated by slashes. The first application transfers the information flow in interface 602 to the watch in the following ways: method C or method D.
[0214] Method C
[0215] The first application shrinks the interface 602, that is, shrinks the video playback screen, and then takes screenshots of the shrunken interface 602 at a certain frequency to obtain an image sequence and sends it to the second application of the watch. Among them, shrinking the interface 602 includes: shrinking the width of the interface 602 to be equal to the diameter of the watch display screen, and / or, shrinking the height of the interface 602 to be equal to the diameter of the watch display screen. It should be understood that if the watch display screen is a rectangle, the width of the interface 602 is reduced to be equal to the width of the watch display screen, and / or, the height of the interface 602 is reduced to be equal to the height of the watch display screen. Since the interface 602 does not include static information, the first application does not need to send static information. After the second application of the watch receives the image sequence, since the width and / or height of the image have been adapted to the diameter of the watch, it can be displayed on the display screen without shrinking or enlarging. Optionally, when the second application of the watch receives an operation for enlarging or reducing the video playback screen, the video screen can be enlarged or reduced for playback.
[0216] Method D
[0217] The first application determines a target area in the interface 602, for example, Figure 6(b) The dotted area. It should be understood that since the interface 602 does not include fixed information, the first application here determines the target area by determining the target area based on the display screen parameters of the second device. For example, if the display screen of the second device is circular and has a diameter of L, then the target area is circular and has a diameter of m*L, or, the target area is square and has a side length of m*L, where m is the ratio of the width of the interface 602 to L, and m is greater than or equal to 1. The position of the target area may be the middle position of the interface 602. The first application takes screenshots of the target area at a certain frequency to obtain an image sequence, does not take screenshots outside the target area, and then sends the obtained image sequence to the second application of the watch. Since the interface 602 does not include static information, there is no need to send static information. After the second application of the watch receives the image sequence, if the size of the image in the image sequence is large, the width of the image can be reduced to be equal to the diameter of the watch display screen, and then the image sequence with reduced width is displayed, for example, as shown in the following figure. Figure 6 (c) The second application of the watch receives the swipe up operation, and sends the operation information to the mobile phone. The operation information here includes the operation type (i.e., swipe up) and the operation location (in video 504). The first application of the mobile phone re-determines the target area based on the operation information, for example Figure 6 (d) The first application takes screenshots of the dotted area at a certain frequency to obtain an image sequence and sends it to the second application of the watch. After receiving the image sequence, the second application of the watch can reduce the width of the image in the image sequence to be equal to the diameter of the watch display screen, and then display the image sequence with the reduced width, for example, as shown in FIG. Figure 6 (e) The interface shown.
[0218] Optionally, the first application can choose to use either method C or method D. For example, method C or method D is used by default; or, it can also be determined whether to use method C or method D based on the situation of interface 602. For example, in interface 602, the video is played in the middle area, and there is no video in the upper and lower areas (such as a black screen), then method D is used to record the screen only in the middle area. Alternatively, it can also be determined based on the current network signal strength whether to use method C or method D. For example, when the current network signal strength is higher than the third threshold, method C is used, and when the current network signal strength is lower than the fourth threshold, method D is used. Among them, the fourth threshold is lower than or equal to the third threshold, and the specific values of the third threshold and the fourth threshold are not limited in the embodiments of the present application.
[0219] Figure 7 The electronic device 700 provided in the embodiment of the present application is a schematic diagram of the structure of the electronic device 700. The electronic device 700 may be the first device or the second device mentioned above. Figure 7As shown, the electronic device 700 may include: one or more processors 701; one or more memories 702; a communication interface 703, and one or more computer programs 704, and the above-mentioned devices may be connected via one or more communication buses 705. The one or more computer programs 704 are stored in the above-mentioned memory 702 and are configured to be executed by the one or more processors 701, and the one or more computer programs 704 include instructions. For example, when the electronic device 700 is the first device in the foregoing text, the instruction can be used to execute the relevant steps of the first device in the corresponding embodiment above. For another example, when the electronic device 700 is the second device in the foregoing text, the instruction can be used to execute the relevant steps of the second device in the corresponding embodiment above. The communication interface 703 is used to realize the communication between the electronic device 700 and other devices, for example, the communication interface can be a transceiver.
[0220] In the embodiments provided by the present application, the method provided by the embodiments of the present application is introduced from the perspective of an electronic device (such as a mobile phone, a watch, etc.) as an execution subject. In order to implement the functions in the method provided by the embodiments of the present application, the electronic device may include a hardware structure and / or a software module to implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a function of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.
[0221] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc. In the absence of conflict, the solutions of the above embodiments can be used in combination.
[0222] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.
[0223] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0224] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0225] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0226] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. An information flow method, characterized in that: Applied to the second device, the method includes: The second device is connected to the first device; The second device receives M icons sent by the first device, where the M icons are icons of M applications installed in the first device, and M is a positive integer; The second device displays the M icons; The second device receives a first operation; When the second device determines that the operation position of the first operation is located in the display area of the first icon among the M icons, the second device sends a first instruction to the first device, where the first instruction is used to instruct the first device to transfer information of a first application to the second device, where the first application is the application corresponding to the first icon; The second device receives and displays the first information sent by the first device.
2. The method according to claim 1, characterized in that The second device does not include installation packages of the M applications.
3. The method according to claim 1 or 2, characterized in that: The second device includes a second application, and the second device displays the M icons, including: The second device displays the M icons in response to an operation for opening the second application.
4. The method according to claim 3, characterized in that The method further comprises: The second device receives an operation for closing the second application and displays P icons, where the P icons are icons of applications locally installed on the second device, and P is a positive integer.
5. The method according to any one of claims 1 to 4, characterized in that: The second device receives and displays the first information sent by the first device, including: The second device receives a first picture sent by the first device, where the first picture is a screenshot of a first interface of the first application by the first device; The second device determines a target area on the first picture, where the target area includes a first area and a second area, the first area is an area where fixed information on the first picture is located, the fixed information includes a title bar and / or a navigation bar on the first picture, and the second area is other partial areas on the first picture except the first area; The second device combines the image blocks in the first area and the image blocks in the second area into a second interface; The second device displays the second interface.
6. The method according to claim 5, characterized in that The method further comprises: The second device receives a swipe up operation; The second device determines a third area on the first picture, where the third area is located below the second area; The second device controls the image blocks in the second area in the second interface to gradually move upward and exit the display screen, and controls the image blocks in the fourth area to gradually enter the display screen from bottom to top.
7. The method according to any one of claims 1 to 4, characterized in that: The second device receives and displays the first information sent by the first device, including: The second device receives a first image sequence, a first picture, and first position information sent by the first device, the first image sequence being a multi-frame screenshot of a region where dynamic information is located in a first interface of the first application taken by the first device, the first picture being a screenshot of the first interface taken by the first device and information in the region where the dynamic information is located in the screenshot being removed, the first position information being used to indicate a position of the first image sequence in the first picture, and the dynamic information being information being dynamically played; The second device determines a target area on the first picture, where the target area includes a first area and a second area, the first area is an area where fixed information on the first picture is located, the fixed information includes a title bar and / or a navigation bar on the first picture, and the second area is other partial areas on the first picture except the first area; The second device determines, according to the first position information, that all of the first image sequence is located within the second area; The second device combines the image blocks in the first area, the image blocks in the second area, and the first image sequence into a second interface, and the first image sequence is dynamically played in the second interface; The second device displays the second interface.
8. The method according to claim 7, characterized in that The method further comprises: The second device determines, according to the first position information, that a portion of the first image sequence is located within the second area and a portion of the first image sequence is located outside the target area; The second device cuts off the portion of each frame of the first image sequence that is outside the second area, and retains the portion that is within the second area, to obtain a second image sequence; The second device combines the image blocks in the first area, the image blocks in the second area, and the second image sequence into a second interface, and the second image sequence is dynamically played in the second interface; The second device displays the second interface.
9. The method according to claim 8, characterized in that The method further comprises: The second device receives a swipe up operation; The second device determines a third area on the first picture, where the third area is located below the second area; The second device determines, according to the first position information, that all of the first image sequence is located within the third area; The second device controls the second area in the second interface to gradually move upward and exit the display screen, and controls the third area to gradually enter the display screen from bottom to top, and the first image sequence in the third area is dynamically played.
10. The method according to any one of claims 5 to 9, characterized in that: Before the second device determines the target area on the first picture, the second device further includes: The second device receives second location information sent by the first device, where the second location information is a location of the first area on the first picture; The second device determines a target area on the first picture, including: The second device determines the first area in the first picture according to the second position information; The second device determines the second area according to a display screen size of the second device and the first area.
11. The method according to claim 10, characterized in that The display screen of the second device is circular and has a diameter of L. The second device determines the second area according to the size of the display screen of the second device and the first area, including: The second device determines a ratio m of a width of the first picture to L, where m is greater than or equal to 1; The second device determines that the height of the first area is H, and the width is the width of the first picture; The second device determines the height of the second area as the difference between m*L and the H, the width of the second area as the width of the first area, and determines the upper edge of the second area as the upper edge of the remaining area on the first picture except the first area.
12. The method according to any one of claims 5 to 11, characterized in that: The display screen of the second device is circular, and before the second device displays the second interface, the method further includes: The second device reduces the width of the second interface to be equal to the diameter of the circle, and / or reduces the height of the second interface to be equal to the diameter of the circle; The second device displays the second interface, including: the second device displays a reduced second interface.
13. The method according to any one of claims 5 to 12, characterized in that: The display screen of the second device is a first circle, and before the second device displays the second interface, the second device further includes: The second device cuts the second interface into a second circle; If the diameter of the second circle is larger than the diameter of the first circle, the second device reduces the diameter of the second circle to be equal to the diameter of the first circle; The second device displays the second interface, including: the second device displays the second interface in a reduced shape of the second circle.
14. The method according to claim 6 or 9, characterized in that: The method further comprises: The second device determines that the distance between the lower edge of the third area and the lower edge of the first picture is less than a preset distance; The second device sends a second instruction to the first device, where the second instruction is used to instruct to update the first interface; The second device receives and displays the second information sent by the first device.
15. The method according to any one of claims 1 to 4, characterized in that: The display screen of the second device is circular and has a diameter of L, and the second device receives and displays the first information sent by the first device, including: The second device receives a first image sequence sent by the first device, where the first image sequence is a multi-frame screenshot of a first interface of the first application after the first interface is reduced in size by the first device, or the first image sequence is a multi-frame screenshot of a partial area of the first interface taken by the first device, the first interface plays dynamic information in full screen, and a width and / or a height of the reduced first interface is equal to L; The second device displays the first sequence of images.
16. The method according to any one of claims 1 to 15, characterized in that: The first device is a mobile phone; the second device is a watch or a bracelet.
17. An information flow method, characterized in that: Applied to a first device, the method includes: The first device is connected to the second device; The first device sends M icons to the first device, where the M icons are icons of M applications installed in the first device, and M is a positive integer; The first device receives a first instruction sent by the second device, where the first instruction is used to instruct the first device to transfer information of a first application to the second device, where the first application is one of the M applications; The first device sends information of the first application to the second device.
18. The method according to claim 17, characterized in that The first device includes a first application, and the first device sends M icons to the first device, including: The first device starts the first application, and the first application sends M icons to the second device.
19. The method according to claim 17 or 18, characterized in that The first device includes a whitelist, the whitelist includes the names of the M applications, and the first device sends the M icons to the first device, including: The first application sends the M icons of the M applications in the whitelist to the second device.
20. The method according to claim 17 or 18, characterized in that Before the first device sends the M icons to the first device, the method further includes: The first device displays a first graphic and a sidebar, wherein the sidebar includes K icons of K applications installed in the first device; K is a positive integer; The first device sending M icons to the first device includes: The first device sends the M icons to the second device in response to a drag operation, where the drag operation is used to drag the M icons in the sidebar into the first graphic, and M is a positive integer less than or equal to K.
21. The method according to claim 20, characterized in that The first device sending information of the first application to the second device includes: The first device opens a first interface of the first application; The first device determines that all information in the first interface is static information; The first device sends a first picture to the second device, where the first picture is a screenshot of the first interface.
22. The method according to claim 20, characterized in that The first device sending information of the first application to the second device includes: The first device opens a first interface of the first application; The first device determines that the first interface includes static information and dynamic information, and the dynamic information is information that is being dynamically played; The first device sends a first picture, the first image sequence and a first position relationship to the second device, the first image sequence takes screenshots of an area in the first interface where dynamic information is located at a first frequency, the first picture is a screenshot of the first interface and information in the area in the screenshot where the dynamic information is located is removed, and the first position information is used to indicate a position of the first image sequence in the first picture.
23. The method according to claim 22, characterized in that Before the first device sends the first picture, the first image sequence and the first position relationship to the second device, the method further includes: The first device determines a target area in the first interface; The first device determines that an area where the dynamic information is located overlaps with the target area.
24. The method according to claim 23, characterized in that The method further comprises: When the first device determines that the area where the dynamic information is located does not overlap with the target area, sending the first picture to the second device; When the first device receives the slide-up instruction sent by the second device, re-determines the target area in the first interface; The first device determines that the area where the dynamic information is located overlaps with the re-determined target area; The first device sends the first image sequence and a first position relationship to the second device, the first image sequence is a screenshot of the area where the dynamic information is located at a first frequency, and the first position information is used to indicate the position of the first image sequence in the first picture.
25. The method according to any one of claims 21 to 24, characterized in that: The method further comprises: The first device determines fixed information in the first interface, where the fixed information includes a title bar and / or a navigation bar; The first device sends second location information to the second device, where the second location information is used to indicate a location of an area where fixed information is located on the first picture.
26. The method according to claim 23, characterized in that The target area includes a first area and a second area. The first area is an area where fixed information in the first interface is located. The fixed information includes a title bar and / or a navigation bar. The second area is a partial area of the first interface other than the first area.
27. The method according to claim 26, characterized in that The height of the second area is the difference between m*L and H, where L is the diameter of the display screen of the second device, and m is the ratio of the width of the first interface to L, and m is greater than or equal to 1; The width of the second region is the width of the first region, and the width of the first region is equal to the width of the first interface; The upper edge of the second region is the upper edge of the remaining region of the first interface except the first region.
28. The method according to claim 20, characterized in that The first device sending information of the first application to the second device includes: The first device determines that the first interface plays dynamic information in full screen, The first device sends a first image sequence to the second device, where the first image sequence is a screenshot of the first interface after it is reduced in size at a first frequency, and the width and / or height of the reduced first interface is equal to the diameter of the display screen of the second device; or, the first image sequence is a screenshot of a partial area of the first interface at a first frequency.
29. The method according to claim 28, characterized in that The display screen of the second device is circular and has a diameter of L, the partial area is circular and has a diameter of m*L, or the partial area is rectangular and the width and / or height of the rectangle is m*L, m is the ratio of the width of the first interface to L, m is greater than or equal to 1, and the partial area is located in the middle position of the first interface.
30. The method according to claim 22 or 28, characterized in that Before the first device sends the first image sequence to the second device, the method further includes: The first device determines that a current network signal is higher than a first threshold.
31. The method according to claim 30, characterized in that The method further comprises: When the first device determines that the current network signal is lower than the first threshold, performing frame extraction processing on the first image sequence to obtain a third image sequence; The first device sends the third image sequence to the second device.
32. The method according to any one of claims 17 to 31, characterized in that: The first device is a mobile phone; the second device is a watch or a bracelet.
33. An electronic device, characterized in that: include: a processor, a memory, and one or more programs; Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions, which, when executed by the processor, enable the electronic device to perform the method steps as described in any one of claims 1 to 16; or, when the instructions are executed by the processor, enable the electronic device to perform the method steps as described in any one of claims 17 to 32.
34. A communication system, characterized in that: include: a first device and a second device; The second device is used to indicate the method steps as described in any one of claims 1 to 16; the first device is used to execute the method steps as described in any one of claims 17 to 32.
35. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 32.
36. A computer program product, characterized in that The method comprises a computer program which, when executed on a computer, causes the computer to execute the method according to any one of claims 1 to 32.
Citation Information
Patent Citations
UI part display method and electronic equipment
CN111666119A
Display method and electronic equipment
CN114253495A
Display method and electronic equipment
CN114253496A
Method for controlling terminal by using wearable device and related assembly thereof
CN116301693A
Electronic device interacting with external electronic device and interaction method thereof
WO2022186578A1