Device control method, apparatus, and electronic device

Abstract

Embodiments of the present application disclose a device control method and device and electronic device. The method comprises: in response to a content carrier being moved to a target display content, obtaining a target application program, wherein the target application program is an application program corresponding to the target display content; and controlling the target application program to perform an operation corresponding to target content based on the target content in the content carrier. Thus, the target display content in the electronic device can be used as an interface for triggering the electronic device to perform a corresponding operation, and the target application program can be caused to perform an operation corresponding to the target content by moving the content carrier to the target display content, so that the electronic device can be caused to perform a corresponding function more flexibly and conveniently.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminal, and more particularly, to a device control method and device, and an electronic device. BACKGROUND

[0002] With the increasing types of application programs installed in electronic devices, the functions that can be implemented by the electronic devices are increasingly rich. For example, the electronic devices can search and display information in a network. For another example, the electronic devices can play audio and video, etc. However, the related ways of triggering the electronic devices to perform corresponding functions are not flexible and convenient enough. SUMMARY

[0003] In view of the above problems, the present application provides a device control method and device, and an electronic device to improve the above problems.

[0004] In a first aspect, the present application provides a device control method applied to an electronic device, the method comprising: displaying a content carrier; in response to the content carrier being moved to a target display content, obtaining a target application program, the target application program being an application program corresponding to the target display content; and controlling the target application program to perform an operation corresponding to a target content in the content carrier based on the target content.

[0005] In a second aspect, the present application provides a device control device running in an electronic device, the device comprising: a display unit configured to display a content carrier; a target determination unit configured to obtain a target application program in response to the content carrier being moved to a target display content, the target application program being an application program corresponding to the target display content; and a device control unit configured to control the target application program to perform an operation corresponding to a target content in the content carrier based on the target content.

[0006] In a third aspect, the present application provides an electronic device comprising one or more processors and a memory, one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the above method.

[0007] In a fourth aspect, the present application provides a computer readable storage medium storing processor executable program codes, the computer readable storage medium comprising stored program codes, wherein the above method is performed when the program codes are executed.

[0008] The device control method and device and electronic device provided in the application can determine a target application based on target display content after a content carrier object is displayed, and control the target application to perform an operation corresponding to target content in the content carrier based on the target content in response to the content carrier being moved to the target display content. Thus, the target display content in the electronic device can be used as an interface for triggering the electronic device to perform a corresponding operation, and the target application can be controlled to perform an operation corresponding to target content by moving the content carrier to the target display content, thereby making the electronic device perform a corresponding function more flexibly and conveniently. BRIEF DESCRIPTION OF DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the application, and other drawings can be obtained by those skilled in the art without creative effort.

[0010] Figure 1 A flowchart of a device control method according to an embodiment of the application is shown;

[0011] Figure 2 A schematic diagram of size transformation of a content carrier according to an embodiment of the application is shown;

[0012] Figure 3 A schematic diagram of a content carrier according to an embodiment of the application is shown;

[0013] Figure 4 A schematic diagram of a display triggering mode of target display content according to an embodiment of the application is shown;

[0014] Figure 5 A schematic diagram of moving a content carrier according to an embodiment of the application is shown;

[0015] Figure 6 A schematic diagram of moving a copy object corresponding to a content carrier according to an embodiment of the application is shown;

[0016] Figure 7 A flowchart of a device control method according to another embodiment of the application is shown;

[0017] Figure 8 A schematic diagram of a content carrier synchronously covering multiple application icons according to an embodiment of the application is shown;

[0018] Figure 9 A schematic diagram of reducing the size of a content carrier according to an embodiment of the application is shown;

[0019] Figure 10 Fig. 1 shows a schematic diagram of selecting an application icon from a plurality of application icons covered by a content carrier in an embodiment of the present application;

[0020] Figure 11 Fig. 2 shows a flow chart of a device control method in another embodiment of the present application;

[0021] Figure 12 Fig. 3 shows a schematic diagram of synchronously displaying a content carrier and an application interface in a screen in an embodiment of the present application;

[0022] Figure 13 Fig. 4 shows a schematic diagram of a thumbnail of an application interface in an embodiment of the present application;

[0023] Figure 14 Fig. 5 shows a schematic diagram of synchronously moving a content carrier to a plurality of application interfaces in an embodiment of the present application;

[0024] Figure 15 Fig. 6 shows a schematic diagram of reducing the size of a content carrier in an embodiment of the present application;

[0025] Figure 16 Fig. 7 shows a schematic diagram of a thumbnail of another application interface in an embodiment of the present application;

[0026] Figure 17 Fig. 8 shows a flow chart of a device control method in another embodiment of the present application;

[0027] Figure 18 Fig. 9 shows a flow chart of a device control method in another embodiment of the present application;

[0028] Figure 19 Fig. 10 shows a flow chart of a device control method in another embodiment of the present application;

[0029] Figure 20 Fig. 11 shows a structural block diagram of a device control apparatus in an embodiment of the present application;

[0030] Figure 21 Fig. 12 shows a structural block diagram of an electronic device for executing a device control method according to an embodiment of the present application;

[0031] Figure 22 Fig. 13 is a storage unit for storing or carrying program codes for implementing a device control method according to an embodiment of the present application. DETAILED DESCRIPTION

[0032] With reference to the drawings, the technical solutions in the embodiments of the present application will be clearly and completely described below. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0033] The electronic device can implement corresponding functions based on the application programs installed therein, and as the categories of the application programs installed in the electronic device increase, the functions that the electronic device can implement are increasingly rich. For example, in the case where the electronic device is installed with a browser, the electronic device can search information through the browser and show the search result to the user. For another example, in the case where the electronic device is installed with an audio playing program, the electronic device can play audio through the audio playing program. For another example, in the case where the electronic device is installed with an accounting program, the electronic device can record the consumption of the user.

[0034] However, the inventors have found in research that the related manner of triggering the electronic device to perform the corresponding function is not flexible and convenient enough. Therefore, the inventors propose a device control method, apparatus and electronic device in the present application, after displaying a content carrier object, the target application program can be determined based on the target display content in response to the content carrier being moved to the target display content, so as to control the target application program to perform an operation corresponding to the target content based on the target content in the content carrier. Thus, by the above manner, the target display content in the electronic device can be used as an interface for triggering the electronic device to perform the corresponding operation, and thus the target application program can be caused to perform the operation corresponding to the target content by moving the content carrier to the target display content, thereby triggering the electronic device to perform the corresponding function more flexibly and conveniently.

[0035] The embodiments of the present application will be described in detail below with reference to the drawings.

[0036] Please refer to Figure 1 The device control method provided in the present application is applied to an electronic device, and the method comprises the following steps.

[0037] S110: Display a content carrier.

[0038] In the embodiments of the present application, the content carrier can be understood as a carrier for displaying content. For example, the content carrier can include a card. The content displayed in the content carrier can be various, for example, the content displayed in the content carrier can be text, picture, video and the like. Alternatively, the content displayed in the content carrier can also be content linked with other objects. The linked objects can be text, picture, video or application interface. Optionally, when the content carrier is displayed, if the content carrier is linked with objects and receives a touch operation, the linked objects can be triggered to be displayed. In addition, the content displayed in the content carrier can also be a control for controlling the electronic device. In this case, if a touch operation acting on the control is detected, the corresponding control operation can be triggered.

[0039] In the embodiments of the present application, the size of the content carrier can be smaller than the size of the screen.

[0040] In the embodiments of the present application, there can be various categories of content carriers, and the content included in the content carriers of different categories can be different. For example, there can be audio category content carriers, news category content carriers, video category content carriers and automobile category content carriers and the like.

[0041] As a kind of way, the content included in the content carrier can include the content displayed in the content carrier when the content carrier is displayed. For example, when the audio category content carrier is displayed, the content displayed in the content carrier can include the name of the music being played by the electronic device, and can also display a control for controlling the audio playing. Alternatively, the recommended music can be displayed in the audio category content carrier. For another example, when the news category content carrier is displayed, the content displayed in the content carrier can include the detailed content of the news or the latest news information. When the video category content carrier is displayed, the content displayed in the content carrier can include the recommended video. When the automobile category content carrier is displayed, the content displayed in the content carrier can include the related information of the vehicle, which can include the picture, model and mileage of the car and the like.

[0042] As another approach, the content carrier may include not only the content displayed on the content carrier during display, but also associated content. Associated content can be understood as content related to the content displayed on the content carrier. In some cases, the area available for displaying content on the content carrier is limited. In such cases, only a portion of the content included in the content carrier can be displayed, while the remaining undisplayed content can be considered associated content. Optionally, the user can configure which content can be displayed on the content carrier and which content can serve as associated content. For example, if the content carrier includes content C1, content C2, content C3, and content C4, and the user configures content C1 and content C2 to be displayed on the content carrier, then when the content carrier is displayed, content C1 and content C2 will be displayed, while content C3 and content C4 will serve as associated content.

[0043] Optionally, the same content carrier can correspond to different display modes. In different display modes, the size of the content carrier can be different, and consequently, the amount of content that can be displayed on the content carrier can also differ. For example, such as... Figure 2 As shown, when the content carrier 20 is in Figure 2 In the display mode shown in the left image, the content carrier 20 is relatively small, and therefore the amount of content that can be displayed is also less. Thus, content C1 and content C2, which are included in the content carrier 20, can be displayed within the content carrier 20. When the content carrier 20 is in... Figure 2 In the display mode shown in the image on the right, the size of the content carrier 20 will be relatively larger, so more content can be displayed in the content carrier 20. Therefore, in addition to displaying content C1 and content C2, content C3 and content C4 can also be displayed.

[0044] In this embodiment, the content carrier can be displayed in multiple locations. Optionally, the content carrier can be displayed on the desktop of the electronic device. Optionally, the content carrier can be displayed on the negative one screen of the electronic device. Optionally, the content carrier can be displayed in the drop-down toolbar of the electronic device.

[0045] like Figure 3 As shown, an exemplary content carrier 30 is illustrated, which is a content carrier for automobiles. The content carrier 30 displays the automobile's model, image, mileage, and current status.

[0046] S120: in response to the content carrier being moved to the target display content, acquiring a target application program, the target application program being an application program corresponding to the target display content.

[0047] In the embodiments of the present application, there can be various ways for moving the content carrier.

[0048] As one way, the content carrier can be moved by acting a drag operation on the content carrier. As another way, the content carrier can be automatically moved to a moving target by first triggering the content carrier to enter a movable state and then touching the moving target.

[0049] In the embodiments of the present application, the target display content can be understood as content for triggering the electronic device to perform an operation corresponding to a target application program, the target application program being an application program corresponding to the target display content. There can be various categories of the target display content. For example, the target display content can be an application program icon, can be an application program name, or can be an application interface. For the application program icon and the application program name, the application program represented thereby can be understood as the corresponding application program. For the application interface, the application program to which the application interface belongs can be understood as the corresponding application program.

[0050] After displaying the content carrier, the content carrier can be moved to the target display content to trigger the electronic device to perform a corresponding operation. In some cases, the content carrier can be directly moved after being displayed. In some other cases, the content carrier can be switched to a state supporting movement (e.g., a floating state) after being displayed, and then be moved. Alternatively, the content carrier can be switched to a state supporting movement by acting a specified touch operation on the content carrier after being displayed. After the content carrier is switched to the state supporting movement by acting the specified touch operation, the touch object (e.g., a stylus or a finger) acting the specified touch operation can move the content carrier while keeping contact with the screen.

[0051] It should be noted that, in the embodiments of the present application, the specified touch operation for switching the content carrier to the state supporting movement can have various implementation manners. Alternatively, the specified touch operation can be a long press operation or can be a large-area press operation, wherein the long press operation can be a press operation with a press duration longer than a specified duration, and the large-area press operation can be a press operation with a press area larger than a specified area. Alternatively, the specified touch operation can be a multi-finger sliding operation. The multi-finger sliding operation can be a two-finger sliding operation or a three-finger sliding operation, etc.

[0052] In some cases, the content carrier can be displayed in the screen synchronously with the target display content when the display is performed. In this case, the content carrier can be directly moved to the target display content. For example, when the target display content is an application icon, the content carrier and the application icon can be displayed in the same desktop. In other cases, the content carrier is not displayed synchronously with the target display content. In this case, as one way, the interface in which the target display content is displayed can be triggered when the content carrier is switched to the floating state, so that the target object can be moved to the target display content. Alternatively, as another way, the interface in which the target display content is displayed can be triggered during the movement of the content carrier to the floating state, so that the content carrier can be moved to the target display content.

[0053] For example, as shown in FIG. 11, the content carrier 40 and a plurality of application icons are displayed in the interface 11. If the application icon required by the user is not displayed in the interface 11, the electronic device can be triggered to switch the displayed interface when the content carrier 40 is switched to the floating state, for example, to the interface 12 as shown in FIG. 12. Figure 4 Figure 4 For example, as shown in FIG. 11, the content carrier 40 and a plurality of application icons are displayed in the interface 11. If the application icon required by the user is not displayed in the interface 11, the electronic device can be triggered to switch the displayed interface when the content carrier 40 is switched to the floating state, for example, to the interface 12 as shown in FIG. 12. Figure 4 As shown in the right image, the interface 12 is displayed. In the embodiment of the present application, when the content carrier is in the floating state, the electronic device can be triggered to switch the displayed interface in various ways.

[0054] As one way, when the content carrier is switched to the floating state by applying a specified touch operation by a touch object, the electronic device can be triggered to switch the displayed interface by applying a sliding operation on the screen by another touch object. As another way, the content carrier can be moved to the edge of the screen to trigger the electronic device to switch the displayed interface.

[0055] In the embodiment of the present application, the target application corresponding to the target display content can be acquired as the target application when the content carrier is detected to be moved to the target display content, so as to perform the subsequent steps. Alternatively, the target application can be acquired in response to the end of the drag operation applied to the target object when the content carrier is moved to the target display content.

[0056] In addition, it should be noted that the content carrier itself can be moved or the copy object corresponding to the content carrier can be moved during the movement of the content carrier. In the case of moving the content carrier itself, the content carrier is moved away from the original display position. For example, as shown in FIG. 13, the content carrier 40 is moved to the edge of the screen, and the interface 13 is displayed. Figure 5 ​As shown in Figure 5 When the content carrier 40 is moved by itself and moves towards the bottom of the electronic device, as shown in the left image, the content carrier 40 will be moved away from the original display position. Figure 5 As shown in the right image, the content carrier 40 will be moved away from the original display position.

[0057] In this way, the copy object corresponding to the content carrier can be understood as an object that is at least partially identical to the display style or display content of the corresponding content carrier. In this way, the content carrier corresponding to the copy object can remain displayed in the original position during the movement of the copy object. Alternatively, the display of the copy object corresponding to the content carrier at the touch object acting on the specified touch operation can be triggered when the specified touch operation acting on the content carrier is performed, and then the copy object is moved following the touch object when the touch object is moved while maintaining contact with the screen, so as to realize the movement of the copy object. When the copy object is moved to the target display content, it is equivalent to moving the content carrier to the target display content, thereby triggering the target application corresponding to the target display content as the target application. For example, as shown in Figure 6 As shown, the display of the copy object 41 corresponding to the content carrier 40 can be triggered when the specified touch operation acting on the content carrier 40 is performed, and then the copy object 41 is moved following the touch object when the touch object is moved while maintaining contact with the screen, so as to realize the movement of the copy object 41.

[0058] S130: Based on the target content in the content carrier, control the target application to perform an operation corresponding to the target content.

[0059] The application installed in the electronic device can perform a corresponding operation during running. The operation corresponding to the application can be understood as the operation performed by the application to realize its function. For example, for an audio playing program, the corresponding operation can include playing audio. For a video playing program, the corresponding operation can include playing video. For a vehicle maintenance program, the corresponding operation can include recommending items that need to be maintained to the user.

[0060] So that the target application program is controlled based on the target content in the content carrier to perform a corresponding operation, it can be understood that the operation performed by the target application program is associated with the target content in the content carrier. For example, in the case where the determined target application program is an audio playing program, when the audio playing program performs audio playing, the played audio can be a song of a singer appearing in the target content included in the content carrier. For another example, in the case where the determined target application program is a vehicle maintenance program, when the vehicle maintenance program recommends a maintenance item, the recommended maintenance item can be determined according to the driving mileage appearing in the target content included in the content carrier. For another example, in the case where the determined target application program is a browser, when the browser performs content searching, the searched content can be related to the target content included in the content carrier.

[0061] It should be noted that the target content in the content carrier can be content displayed in the content carrier when the content carrier is displayed, and can also include content corresponding to the content carrier and not displayed.

[0062] The device control method provided in this embodiment can determine a target application program based on the target display content after displaying the content carrier object, and control the target application program to perform an operation corresponding to the target content in the content carrier based on the target content in the content carrier when the content carrier is moved to the target display content. Thus, the target display content in the electronic device can be used as an interface for triggering the electronic device to perform a corresponding operation, and the target application program can be controlled to perform an operation corresponding to the target content by moving the content carrier to the target display content, so that the electronic device can be triggered to perform a corresponding function more flexibly and conveniently.

[0063] Please refer to Figure 7 The device control method provided in this embodiment is applied to an electronic device, and the method comprises the following steps.

[0064] S210: Display a content carrier.

[0065] S220: In response to the content carrier being moved to an application program icon, acquire an application program corresponding to the application program icon as a target application program.

[0066] Optionally, the content carrier can be determined to be moved to the application program icon in a case where the content carrier is moved to overlap with a display position of the application program icon or in a case where a distance between a display position of the content carrier after being moved and the application program icon is less than a specified threshold.

[0067] As indicated by the foregoing, the application icon is one kind of target display content in the embodiment of the present application. When it is detected that the content carrier is moved to the application icon, it can be determined that the user expects the application corresponding to the application icon to be run, and the application corresponding to the application icon to which the content carrier is moved can be acquired as the target application.

[0068] It should be noted that the size corresponding to different content carriers is different. For a relatively large content carrier, it can cover multiple application icons at the same time, thereby causing the user-selected application icon to be not accurately acquired. For example, as shown in Figure 8 After the content carrier 40 is moved towards the application icons, the content carrier 40 can cover the multiple application icons shown in Figure 8 In this case, the electronic device can not accurately acquire which application icon is the user-selected application icon.

[0069] In order to improve the above situation, as one way, the size of the content carrier can be reduced in response to the content carrier being moved. Alternatively, the size of the content carrier can be reduced in response to the content carrier being in a movable state. It should be noted that after the size of the content carrier is reduced, the range that can be covered by the content carrier is also reduced, thereby facilitating the user-selected application icon to be more accurately acquired. For example, as shown in Figure 9 During the movement of the content carrier 40, the size of the content carrier 40 is reduced, thereby enabling the content carrier 40 to cover only one application icon when it is moved to the application icon, and enabling the user-selected application icon to be more accurately acquired.

[0070] As another way, in response to the content carrier being moved to the application icon and the content carrier corresponding to multiple application icons, one target icon can be determined from the multiple application icons, and the application corresponding to the target icon is acquired as the target application. Alternatively, the content carrier can be moved in response to the movement operation of the touch object, and the application icon closest to the touch object is selected as the user-selected application icon when the touch object keeps in contact with the content carrier. For example, as shown in Figure 10As shown, after the user moves the content carrier 40 by a finger (a touch object), the content carrier 40 synchronously covers multiple application icons, and in the case that the user's finger keeps in contact with the content carrier 40, the application icon 41 is overlapped, and it can be determined that the application icon 41 is the closest application icon to the finger, and the application corresponding to the application icon 41 is taken as the target application. Alternatively, in the case that the content carrier corresponds to multiple application icons, the electronic device can also display a prompt information to prompt the user to manually select an application icon from the multiple application icons as the target icon.

[0071] It should be noted that the content carrier can not be transparent when displaying, in this case, in order to facilitate the user to more conveniently and intuitively see the application icons currently covered by the content carrier during the movement of the content carrier, the content carrier can be configured to be in a transparent state during the movement of the content carrier, or when the content carrier is switched to the floating state, so that the user can see the application icons currently covered by the content carrier through the content carrier.

[0072] S230: based on the target content in the content carrier, control the target application to perform an operation corresponding to the target content.

[0073] In the case that the application can perform multiple operations, an operation can be determined from the operations corresponding to the application as the main operation corresponding to the application. In this case, when the content carrier is moved to the application icon, the target application can be controlled to perform the corresponding main operation based on the target content in the content carrier. The main operation corresponding to the target application can be determined by the user in advance, or can be determined in real time. Alternatively, the electronic device can automatically determine the target content included in the moved content carrier.

[0074] This embodiment provides a device control method that, after displaying a content carrier object, responds to the content carrier being moved to an application icon, identifies the application corresponding to that application icon as the target application, and controls the target application to perform operations corresponding to the target content based on the target content in the content carrier. This allows the application icon on the electronic device to serve as an interface for triggering corresponding operations, enabling the electronic device to execute operations corresponding to the identified target application simply by moving the content carrier to the application icon. This provides a more flexible and convenient way to trigger corresponding functions on the electronic device. Furthermore, in this embodiment, considering that the size of the content carrier may be larger than the size of the application icon, the size of the content carrier can be reduced when it is moved or in a movable state, allowing the user to more accurately and conveniently perform the operation of moving the content carrier to the application icon.

[0075] Please see Figure 11 This application provides a device control method applied to electronic devices, the method comprising:

[0076] S310: Display content carrier.

[0077] S320: In response to the content carrier being moved to the application interface, obtain the application corresponding to the application interface as the target application.

[0078] The content carrier is moved to the application interface, which may include at least a portion of the content carrier overlapping with the application interface.

[0079] It should be noted that in this embodiment, the content carrier can be displayed synchronously on the screen along with the application interface. In this case, the content carrier can be directly moved to the application interface. For example, as shown... Figure 12 As shown, the interface 50 containing the application interface 13 and the content carrier 51 can be displayed in a split-screen manner. In this case, the content carrier 51 and the application interface 13 can be displayed synchronously on the screen.

[0080] Additionally, there may be situations where the content carrier and the application interface are not initially displayed synchronously on the screen. For example, the content carrier may already be displayed on the screen, but the application interface may not be shown. In this case, the application interface for which the user expects to perform the corresponding operation can be triggered first, allowing the content carrier and the application interface to be displayed synchronously on the screen, thus enabling the content carrier to be moved within the application interface. As one approach, when the content carrier is switched to a floating state, a thumbnail of the currently running application's interface can be triggered to display, achieving synchronous display of the content carrier and application interface on the screen. The already running application can include applications running in the foreground and applications running in the background. For applications running in the background, the application interface displayed in the thumbnail is the application interface displayed during the most recent foreground run of that background application.

[0081] For example, such as Figure 13 As shown, after the content carrier 40 is triggered to switch to a floating state, thumbnails of the application interface can be displayed synchronously. These thumbnails can include thumbnails of application interface 60, application interface 61, application interface 62, and application interface 63. In this case, the content carrier 40 can be moved to... Figure 13 At any of the application interfaces shown.

[0082] In this case, the thumbnail size of the application interface is smaller than the size of the application interface itself. When moving content to the thumbnail of an application interface, the content may end up appearing on the thumbnails of two application interfaces simultaneously. For example, as... Figure 14 As shown, content carrier 40 is simultaneously moved to both application interface 60 and application interface 62. In this situation, the electronic device may not be able to accurately determine the application interface the user intends to select. As a method, the size of the content carrier can be simultaneously reduced when the thumbnail of the application interface is triggered for display, so that the electronic device can accurately determine the application interface the user intends to select. For example, as... Figure 15 As shown, after the size of the content carrier 40 is reduced, the content carrier 40 can overlap with only the thumbnail of one application interface, thus preventing it from being moved to the thumbnails of multiple application interfaces at the same time.

[0083] It should be noted that, Figures 13 to 15 The thumbnail styles used in the application interface are merely illustrative. For example, as shown... Figure 16 As shown, the thumbnails of the application interface can also be displayed as follows: Figure 16The thumbnail of the application interface 64, the thumbnail of the application interface 65 and the thumbnail of the application interface 66 can be displayed side by side. Among them, the thumbnail of the application interface (for example, the application interface 64) can be displayed completely on the screen, and the thumbnails of the application interfaces (for example, the application interface 65 and the application interface 66) at the edge can only display a partial area in the screen. In addition, the user can slide in the direction indicated by the arrow in the middle to switch the thumbnail of the application interface displayed completely on the screen. Figure 16

[0084] S330: Based on the target content in the content carrier, control the target application program to perform an operation corresponding to the target content.

[0085] For some application programs, the possible operations that can be performed can be relatively single. For example, for an audio playing program, the operation that can be performed can only include playing audio. For another example, for a video playing program, the operation that can be performed can only include playing video. However, for some other application programs, the possible operations that can be performed can be relatively diverse. For example, for a browser, the operations that can be performed can include displaying information, playing audio and playing video, etc. For another example, for a vehicle maintenance program, the operations that can be performed can include recommending maintenance items, and can also include selling vehicle parts online, etc. Among them, in the case where the application program can perform multiple operations, the application program can correspondingly perform an operation through different application interfaces, so that the multiple application interfaces of the application program can correspondingly perform different operations. In this case, in order to more accurately determine the actual operation intention of the user, the target application program can be controlled to perform an operation corresponding to the application interface to which the content carrier is moved based on the target content in the content carrier. Among them, the operations corresponding to different application interfaces can be different.

[0086] In the case where the application program can perform multiple operations, the operation to be performed can still be determined based on the target application program when the content carrier is moved to the application interface.

[0087] Among them, in the case where the application program can perform multiple operations, an operation can be determined from the operations corresponding to the application program as the main operation corresponding to the application program. In this case, when the content carrier is moved to the application interface, the target application program can be controlled to perform the corresponding main operation based on the target content in the content carrier. Among them, the main operation corresponding to the target application program can be determined by the user in advance, or can be determined in real time. Optionally, the main operation can be determined automatically by the electronic device according to the content included in the content carrier that is moved.

[0088] ​In addition, in the case that there is only one operation that the target application program can perform, the target application program can be triggered to perform the one operation that it can perform when the content carrier is moved to the application interface.

[0089] The device control method provided in this embodiment can determine the application program corresponding to the application interface to which the content carrier is moved as a target application program after displaying the content carrier object, and control the target application program to perform an operation corresponding to the target content in the content carrier based on the content carrier identifier. In this way, the application interface in the electronic device can be used as an interface for triggering the electronic device to perform a corresponding operation, and the electronic device can be triggered to perform a corresponding operation by moving the content carrier to the application interface, thereby making the device control method provided in this embodiment more flexible.

[0090] Referring to Figure 17 The device control method provided in this embodiment is applied to an electronic device, and the method comprises the following steps.

[0091] S410: Display a content carrier.

[0092] S420: In response to the content carrier being moved to a target display content, obtain a target application program, which is an application program corresponding to the target display content.

[0093] S430: Obtain a content carrier identifier of the content carrier.

[0094] In this embodiment, the content carrier identifier can be used to uniquely identify an object. The object can be an object displayed in the content carrier or an object not displayed in the content carrier. Optionally, the content carrier identifier of the content carrier can be obtained by identifying the content displayed in the content carrier. In the case that an object is displayed in the content carrier, the name of the object can be obtained by identifying the object, and then the name of the object can be used as the content carrier identifier. The object can be a person, an animal, a plant, or other objects.

[0095] S440: Control the target application program to perform an operation corresponding to the content carrier identifier based on the content carrier identifier.

[0096] In the case that the target application program is controlled to perform a corresponding operation based on the content carrier identifier, the target application program can take the content carrier identifier as a basis or reference when performing the corresponding operation. For example, the content carrier displayed on the electronic device can be an identity content carrier of a user of the electronic device. Optionally, the identity content carrier displays an avatar of the user of the electronic device. When the identity content carrier is moved to the target display content, the name of the user of the electronic device can be obtained as the content carrier identifier, so that the target application program can perform a corresponding operation based on the name of the user of the electronic device. For example, if the corresponding operation of the target application program is to play audio, the target application program can be caused to play a song preferred by the user of the electronic device when the name of the user of the electronic device is obtained as the content carrier identifier.

[0097] In addition, the character displayed in the identity content carrier can be a character other than the user of the electronic device, for example, a singer. In this case, if the corresponding operation of the target application program is to play audio, the target application program can be caused to play a song of the singer when the name of the singer is obtained as the content carrier identifier.

[0098] For example, the content carrier displayed on the electronic device can also be a vehicle content carrier of a vehicle owned by the user of the electronic device. In this case, the vehicle model of the vehicle can be obtained as the content carrier identifier. If the corresponding operation of the target application program is to recommend spare parts, the target application program can recommend spare parts related to the vehicle model.

[0099] The device control method provided in this embodiment makes it possible to take the target display content in the electronic device as an interface for triggering the electronic device to perform a corresponding operation, and further makes it possible to control the electronic device to perform an operation corresponding to a target application program determined by the target display content based on a content carrier identifier by moving a content carrier to the target display content, thereby more flexibly and conveniently triggering the electronic device to perform a corresponding function.

[0100] Please refer to Figure 18 The device control method provided in this embodiment is applied to an electronic device, and the method comprises the following steps.

[0101] S510: Display a content carrier.

[0102] S520: In response to the content carrier being moved to target display content, obtain a target application program, which is an application program corresponding to the target display content.

[0103] S530: Obtain target content in the content carrier.

[0104] In the embodiment of the present application, the target content can be understood as the content required by the target application program to perform the corresponding operation. Optionally, after moving the content carrier to the target display content to determine the target application program, the target content in the content carrier can be acquired according to the target application program. For example, if the operation performed by the target application program is to recommend vehicle maintenance items, and the corresponding required content is vehicle mileage, the vehicle mileage can be acquired from the content included in the content carrier as the target content. If the operation performed by the target application program is to play audio, and the corresponding required content is the name of a singer or a song, the name of the singer or the name of the song can be acquired from the content included in the content carrier.

[0105] As a manner, the content carrier is subjected to a screenshot operation, the corresponding screenshot content is acquired, and the target content in the content carrier is acquired by performing picture content acquisition on the screenshot content.

[0106] S540: based on the target content, the target application program is controlled to perform the corresponding operation.

[0107] The device control method provided in the embodiment makes the target display content in the electronic device as an interface for triggering the electronic device to perform the corresponding operation, and further makes it possible to control the electronic device to perform the operation corresponding to the target application program determined by the target display content based on the target content in the content carrier by moving the content carrier to the target display content, thereby more flexibly and conveniently triggering the electronic device to perform the corresponding function.

[0108] Please refer to Figure 19 The device control method provided in the present application is applied to an electronic device, and the method comprises the following steps:

[0109] S610: in response to a specified operation, a content carrier is displayed.

[0110] The specified operation can be understood as an operation for triggering the display of the content carrier. In the embodiment of the present application, the specified operation can have various implementation manners.

[0111] As a manner, in response to the specified operation, the display of the content carrier can comprise: in response to moving an application interface to a specified position, the content carrier is displayed, wherein the category of the displayed content carrier corresponds to the moved application interface. The specified position can have various cases, for example, the specified position can be the top of the screen or the bottom of the screen. The category of the displayed content carrier corresponding to the moved application interface can be understood as determining the category of the generated content carrier based on the attribute of the moved application interface. The attribute can be the category of the application program to which the application interface belongs, or can be the content displayed in the application interface.

[0112] Optionally, the displaying the content carrier in response to the moving the application interface to the specified position can include: in response to the moving the application interface to the specified position, obtaining an application program to which the moved application interface belongs, and displaying the content carrier based on a category of the application program. It should be noted that there can be multiple application programs in the electronic device, and the operations that can be performed by different categories of application programs can be different. Therefore, in the process of triggering the generation of the content carrier by moving the application interface, the category of the generated content carrier is determined based on the category of the application program to which the application interface belongs, which is beneficial to more accurately generating the content carrier of the category currently required by the user.

[0113] For example, if the application program to which the application interface moved to the specified position belongs is an application program for audio playing, the electronic device can infer that the user currently needs an audio playing function, and then generate a content carrier of an audio category. For another example, if the application program to which the application interface moved to the specified position belongs is an application program for displaying information, the electronic device can infer that the user currently needs an information display function, and then generate a content carrier of an information category.

[0114] In the electronic device, a corresponding relationship between the names of the application programs and the categories of the application programs can be stored. In this case, after obtaining the application program to which the moved application interface belongs, the category of the application program can be determined according to the name of the application program and the corresponding relationship between the names of the application programs and the categories of the application programs. For example, the corresponding relationship between the names of the application programs and the categories of the application programs can be as shown in the following table:

[0115] ID Name Category 1 Application A1 Audio playing category 2 Application A2 Video playing category 3 Application A3 News category

[0116] As shown in the above table, if the application program to which the moved application interface belongs is the application program A2, the category of the generated content carrier can be a video playing category. If the application program to which the moved application interface belongs is the application program A3, the category of the generated content carrier can be a news category.

[0117] Optionally, the displaying the content carrier in response to the moving the application interface to the specified position can include: in response to the moving the application interface to the specified position, obtaining content displayed in the moved application interface, and displaying the content carrier based on the displayed content. It should be noted that the displayed content can be different for different application interfaces. Moreover, even for different application interfaces belonging to the same application program, the displayed content can be different. In this case, the category of the generated content carrier is determined according to the displayed content in the moved application interface, which can improve the accuracy of the category of the generated content carrier meeting the user's needs.

[0118] For example, for an application program of the instant chat type, it can include an application interface for displaying information, or an application interface for playing a video. If the user moves the application interface for playing a video to a specified position, the user can expect the generated content carrier to be a video type content carrier, but if the content carrier is generated directly based on the instant chat type, the user's needs can not be met.

[0119] As another way, the content carrier can be displayed in response to searching for target content, wherein the displayed content carrier corresponds to the target content. It should be noted that when the user searches for target content, the user can expect to understand information related to the searched target content, and thus determining the category of the generated content carrier according to the target content searched by the user can improve the accuracy of the category of the generated content carrier meeting the user's needs.

[0120] It should be noted that after the display of the content carrier is triggered by the specified operation, the content carrier can always remain in the display state. For example, after the electronic device is restarted, the content carrier can be automatically displayed.

[0121] S620: In response to the content carrier being moved to the target display content, obtaining a target application program.

[0122] S630: Based on the target content in the content carrier, controlling the target application program to perform an operation corresponding to the target content.

[0123] The device control method provided in this embodiment, so that the target display content in the electronic device can be used as an interface for triggering the electronic device to perform a corresponding operation in the above manner, and the target application program can be caused to perform an operation corresponding to the target content by moving the content carrier to the target display content, thereby more flexible and convenient triggering the electronic device to perform a corresponding function. In this embodiment, the corresponding content carrier can be generated by searching for the target content or by moving the application interface to the target display content, thereby realizing a flexible and diverse content carrier generation method and improving the user experience.

[0124] Please refer to Figure 20 The device control apparatus 700 provided in this application runs in an electronic device, and the apparatus 700 includes:

[0125] The display unit 710 is configured to display a content carrier.

[0126] The target determination unit 720 is configured to obtain a target application program in response to the content carrier being moved to the target display content.

[0127] The device control unit 730 is configured to control the target application to perform an operation corresponding to the target content in the content carrier based on the target content in the content carrier.

[0128] As a manner, the target display content includes an application icon. In this manner, the target determination unit 720 is specifically configured to acquire an application corresponding to the application icon as the target application in response to the content carrier being moved to the application icon. Optionally, the target determination unit 720 is further configured to reduce the size of the content carrier in response to the content carrier being moved, or to reduce the size of the content carrier in response to the content carrier being in a movable state.

[0129] Optionally, the target determination unit 720 is specifically configured to determine a target icon from a plurality of application icons in response to the content carrier being moved to the application icon, and the content carrier corresponding to the plurality of application icons; and acquire an application corresponding to the target icon as the target application.

[0130] As a manner, the target display content includes an application interface. In this manner, the target determination unit 720 is specifically configured to acquire an application corresponding to the application interface as the target application in response to the content carrier being moved to the application interface. Correspondingly, the device control unit 730 is specifically configured to control the target application to perform an operation corresponding to the application interface and the target content in the content carrier based on the target content in the content carrier.

[0131] As a manner, the device control unit 730 is specifically configured to acquire a content carrier identifier of the content carrier.

[0132] The device control unit 730 is configured to control the target application to perform an operation corresponding to the target content in the content carrier based on the target content in the content carrier.

[0133] As a manner, the device control unit 730 is specifically configured to acquire a content carrier identifier of the content carrier.

[0134] As a kind of mode, display unit 710, specifically for displaying content carrier in response to specified operation.It is optional that display unit 710, specifically for displaying content carrier in response to moving application interface to specified position, wherein the category of generated content carrier corresponds to the application interface moved;Or in response to searching target content, display content carrier, wherein the displayed content carrier corresponds to target content.It is optional that display unit 710, specifically for obtaining the application program to which the application interface moved belongs in response to moving application interface to specified position, and displaying content carrier based on the category of application program;Or in response to moving application interface to specified position, obtain the content displayed in the application interface moved, and display content carrier based on the content displayed.

[0135] As a kind of mode, device control unit 730, specifically for obtaining target application program in response to content carrier being moved to target display content and the end of drag operation acting on target object.

[0136] The device control device provided in the embodiment makes it possible to use target display content in electronic device as interface for triggering electronic device to execute corresponding operation, and further realizes that target application program can execute operation corresponding to target content by moving content carrier to target display content, so that corresponding function of electronic device can be triggered more flexibly and conveniently.

[0137] It should be noted that the device embodiment in the present application corresponds to the foregoing method embodiment, and the specific implementation principles of each unit in the device embodiment are similar to those in the foregoing method embodiment, and the specific content in the device embodiment can be referred to the method embodiment, and the device embodiment will not be described again.

[0138] The following will be combined Figure 21 An electronic device provided in the present application is described.

[0139] Please refer to Figure 21 Based on the device control method and device described above, the present embodiment further provides an electronic device 1000 capable of executing the foregoing device control method.The electronic device 1000 includes one or more (only one is shown in the figure) processors 105, a memory 104, an audio playing module 106 and an audio acquisition device 108 coupled to each other.The memory 104 stores programs capable of executing the content in the foregoing embodiments, and the processor 105 can execute the programs stored in the memory 104.

[0140] The processor 105 can include one or more processing cores. The processor 105 connects various parts within the electronic device 1000 with various interfaces and lines, performs various functions of the electronic device 1000 and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 104, and calling data stored in the memory 104. Alternatively, the processor 105 can be implemented in at least one of a hardware form of a digital signal processor (DSP), a field-programmable gate array (FPGA), a programmable logic array (PLA). The processor 105 can integrate a combination of one or several of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes an operating system, a user interface, and an application program, etc.; the GPU is responsible for rendering and drawing display content; and the modem is used for processing wireless communication. It can be understood that the above-mentioned modem can also not be integrated into the processor 105, but be implemented by a separate communication chip.

[0141] The memory 104 can include a random access memory (RAM) and can also include a read-only memory (ROM). The memory 104 can be used to store instructions, programs, codes, code sets, or instruction sets. The memory 104 can include a program storage area and a data storage area, wherein the program storage area can store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing each of the following method embodiments, etc.

[0142] Furthermore, in addition to the above-mentioned devices, the electronic device 1000 can further include a network module 110 and a sensor module 112.

[0143] The network module 110 is configured to realize information interaction between the electronic device 1000 and other devices. For example, the network module 110 can establish a connection with other audio playback devices or other electronic devices, and perform information interaction based on the established connection. As one way, the network module 110 of the electronic device 1000 is a radio frequency module configured to receive and send electromagnetic waves, realize mutual conversion between electromagnetic waves and electrical signals, and thus communicate with a communication network or other devices. The radio frequency module can include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption / decryption chip, a subscriber identity module (SIM) card, a memory, and the like. For example, the radio frequency module can interact with external devices through transmitted or received electromagnetic waves.

[0144] The sensor module 112 can include at least one sensor. Specifically, the sensor module 112 can include, but is not limited to, a pressure sensor, a motion sensor, an acceleration sensor, and other sensors.

[0145] The pressure sensor can detect pressure generated by pressing on the electronic device 1000. That is, the pressure sensor detects pressure generated by contact or pressing between a user and the electronic device 1000, such as pressure generated by contact or pressing between the user's ear and the electronic device 1000. Therefore, the pressure sensor can be used to determine whether contact or pressing occurs between the user and the electronic device 1000, and the magnitude of the pressure.

[0146] The acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and when at rest, can detect the magnitude and direction of gravity, and can be used for applications that identify the posture of the electronic device 1000 (such as switching between landscape and portrait screens, related games, magnetometer posture calibration), vibration recognition related functions (such as a pedometer, tapping), and the like. In addition, the electronic device 1000 can also be configured with a gyroscope, a barometer, a hygrometer, a thermometer, and other sensors, which will not be described here.

[0147] The audio acquisition device 108 is configured to acquire an audio signal. Optionally, the audio acquisition device 108 includes a plurality of audio acquisition devices, which can be microphones.

[0148] Please refer to Figure 22 which shows a structural block diagram of a computer readable storage medium provided by an embodiment of the present application. The computer readable medium 1100 stores program code, which can be called by a processor to execute the methods described in the above method embodiments.

[0149] The computer-readable storage medium 1100 can be an electronic, magnetic, optical, or other storage device capable of storing data. The computer-readable storage medium 1100 can also be non-transitory computer-readable storage medium. The computer-readable storage medium 1100 can have stored thereon the program code 1110 for execution by the computer 1102. The program code 1110 can include the program code 1110 for implementing any of the methods described above. The program code 1110 can be written in any of a number of suitable programming languages and can be executed by the computer 1102.

[0150] In the description of the specification, the description of the terms "one embodiment", "some embodiments", "an example", "a specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the description of the specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Also, the specific features, structures, materials or characteristics described can be combined in any suitable manner in one or more embodiments or examples. In addition, the person skilled in the art can combine and combine the different embodiments or examples described in the specification and the features of the different embodiments or examples, without contradiction.

[0151] In addition, the terms "first", "second" are only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "a plurality of" is at least two, for example, two, three, etc., unless otherwise specifically limited.

[0152] Any process or method descriptions or descriptions of the flow diagrams in the specification or elsewhere in this document can be understood as representing the steps of the code of the modules, segments or portions of the code for implementing specific logic functions or steps, and the scope of the preferred embodiments of the present application includes additional implementation in which the steps are performed in different order, including essentially simultaneously, or in reverse order, depending on the functionality involved, which will be apparent to those skilled in the art of the embodiments described herein.

[0153] The logic and / or steps represented in the flow diagrams, or otherwise described herein, for example, can be considered as a sequence of executable instructions, and can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions, or a combination thereof.

[0154] It should be understood that parts of the application can be implemented in hardware, software, firmware or combinations thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, and as in another embodiment, it can be implemented using any or a combination of the following technologies, which are all well known in the art: a discrete logic circuit having logic gates for implementing logic functions on data signals, an application specific integrated circuit having appropriate combinational logic gates, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0155] In summary, the device control method, device and electronic device provided by the present application can determine a target application based on the target display content after displaying the content carrier object, and control the target application to perform an operation corresponding to the target content based on the target content in the content carrier in response to the content carrier being moved to the target display content. Thus, the target display content in the electronic device can be used as an interface for triggering the electronic device to perform a corresponding operation in the above manner, and the target application can be caused to perform an operation corresponding to the target content by moving the content carrier to the target display content, thereby making it more flexible and convenient to trigger the electronic device to perform a corresponding function.

[0156] Finally, it should be noted that: the above examples are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing examples, those skilled in the art will understand that they can still modify the technical solutions described in the foregoing examples, or make equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A device control method characterized by, The method is applied to an electronic device, and comprises: displaying a content carrier; in response to the content carrier being moved to a target display content, acquiring a target application program corresponding to the target display content; based on target content in the content carrier, controlling the target application program to perform an operation corresponding to the target content.

2. The method of claim 1, wherein, The target display content comprises an application icon, and the acquiring the target application program in response to the content carrier being moved to the target display content comprises: in a case where the content carrier is moved to overlap with a display position of the application icon or in a case where a distance between a display position of the content carrier after being moved and the application icon is less than a specified threshold, acquiring an application program corresponding to the application icon as the target application program.

3. The method of claim 2, wherein, The method further comprises: in response to the content carrier being moved, reducing a size of the content carrier; or in response to the content carrier being in a movable state, reducing a size of the content carrier.

4. The method of claim 2, wherein, The acquiring the application program corresponding to the application icon as the target application program comprises: if the content carrier corresponds to a plurality of application icons, determining a target icon from the plurality of application icons; and acquiring an application program corresponding to the target icon as the target application program.

5. The method of claim 1, wherein, The target display content comprises an application interface, and the acquiring the target application program in response to the content carrier being moved to the target display content comprises: in response to the content carrier being moved to the application interface, acquiring an application program corresponding to the application interface as the target application program.

6. The method of claim 5, wherein, The controlling the target application program to perform an operation corresponding to the target content based on the target content in the content carrier comprises: based on the target content in the content carrier, controlling the target application program to perform an operation corresponding to the application interface and the target content.

7. The method of claim 1, wherein, The target content comprises a content carrier identifier, and the controlling the target application program to perform an operation corresponding to the target content based on the target content in the content carrier comprises: acquiring a content carrier identifier of the content carrier; and based on the content carrier identifier, controlling the target application program to perform an operation corresponding to the content carrier identifier.

8. The method of claim 1, wherein, The method further comprises: performing a screenshot operation on the content carrier to acquire corresponding screenshot content; and performing picture content acquisition on the screenshot content to acquire target content in the content carrier.

9. The method of claim 1, wherein, The method further comprises, before the acquiring the target application program in response to the content carrier being moved to the target display content: in response to a specified operation, displaying the content carrier.

10. The method of claim 9, wherein, The displaying the content carrier in response to the specified operation comprises: in response to moving the application interface to a specified position, displaying the content carrier, wherein a type of the generated content carrier corresponds to the moved application interface; or in response to searching for target content, displaying the content carrier, wherein the displayed content carrier corresponds to the target content.

11. The method of claim 10, wherein, The displaying the content carrier in response to moving the application interface to the specified position comprises: In response to the application interface being moved to the specified position, an application program to which the moved application interface belongs is acquired, and a content carrier is displayed based on a category of the application program; or In response to the application interface being moved to the specified position, content displayed in the moved application interface is acquired, and a content carrier is displayed based on the displayed content.

12. The method of claim 1, wherein, The acquiring the target application program in response to the content carrier being moved to the target display content includes: The acquiring the target application program in response to the content carrier being moved to the target display content and the drag operation acting on the target object being ended.

13. An apparatus control device characterized by comprising: An electronic device, the apparatus comprising: a display unit configured to display a content carrier; a target determination unit configured to acquire a target application program in response to the content carrier being moved to target display content; a device control unit configured to control the target application program to perform an operation corresponding to target content in the content carrier based on the target content.

14. An electronic device, comprising: one or more processors and memory; one or more programs stored in the memory and configured for execution by the one or more processors, the one or more programs configured for performing the method of any of claims 1-12.

15. A computer readable storage medium storing program code executable by a processor, the program code comprising instructions for causing the processor to perform operations comprising: the computer readable storage medium comprising stored program code, wherein the program code, when executed, performs the method of any of claims 1-12.

Images