Interaction control method and apparatus, device, and storage medium

By determining the target control based on the direction information of the touch input in the picture editing interface, the error operation problem caused by overlapping control areas of the control is solved, and the accuracy and convenience of picture editing are improved.

WO2025145863A1PCT designated stage expired Publication Date: 2025-07-10BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/138078
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-01-05
Filing Date
2024-12-10
Publication Date
2025-07-10

AI Technical Summary

Technical Problem

During the image editing process, the overlap of control areas of the controls leads to misoperation and inconvenience in interaction operations, which affects the accuracy and convenience of interaction.

Method used

By presenting a set of controls associated with the target object in the target interface, the activated target control is determined based on the direction information of the touch input, and corresponding operations are performed to avoid erroneous operations caused by overlapping the control areas of the control.

Benefits of technology

Improve the accuracy and convenience of image editing to ensure that users can perform subsequent operations smoothly.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024138078_10072025_PF_FP_ABST
    Figure CN2024138078_10072025_PF_FP_ABST
Patent Text Reader

Abstract

According to embodiments of the present disclosure, provided are an interaction control method and apparatus, a device, and a storage medium. The method comprises: presenting, in a target interface, a set of controls associated with a target object; in response to the touch position of a received touch input being within a common control area of a plurality of controls in the set of controls, determining an activated target control among the plurality of controls on the basis of direction information associated with the touch input, wherein a control area indicates a range for controlling a corresponding control; and executing a first operation corresponding to the target control on the target object on the basis of the touch input. In this way, misoperations on controls caused by overlapping of control areas of the controls can be effectively avoided, and the picture editing efficiency is effectively improved.
Need to check novelty before this filing date? Find Prior Art

Description

Interactive control method, device, equipment and storage medium

[0001] This application claims priority to the Chinese invention patent application entitled “Interactive control method, device, equipment and storage medium” and application number 202410022300.3, filed on January 5, 2024. The entire contents of that application are incorporated herein by reference. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to interactive control methods, devices, apparatuses, and computer-readable storage media. Background Art

[0003] With the advancement of imaging technology, users' demand for interactive control is increasing. For example, users expect to edit images using portable devices such as smartphones or tablets. For example, users expect to add specific layers to an image or perform operations such as cropping and / or scaling. This places higher demands on the accuracy and flexibility of interactive control during image editing. Summary of the Invention

[0004] In a first aspect of the present disclosure, an interactive control method is provided. The method includes presenting a group of controls associated with a target object in a target interface; in response to a touch position of a received touch input being within a common control region of multiple controls in the group of controls, determining an activated target control among the multiple controls based on direction information associated with the touch input, wherein the control region indicates a range for controlling the corresponding control; and performing a first operation corresponding to the target control on the target object based on the touch input.

[0005] In a second aspect of the present disclosure, an interactive control device is provided. The device includes a presentation module configured to present a group of controls associated with a target object in a target interface; a target control determination module configured to, in response to a touch position of a received touch input being within a common control region of multiple controls in the group of controls, determine an activated target control among the multiple controls based on direction information associated with the touch input, where the control region indicates a range for controlling the corresponding control; and a first operation execution module configured to execute a first operation corresponding to the target control on the target object based on the touch input.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the medium, and when the program is executed by a processor, the method of the first aspect is implemented.

[0008] In a fifth aspect of the present disclosure, a computer program product is provided, which includes computer-executable instructions, which, when executed by a processor, implement the method according to the first aspect of the present disclosure.

[0009] It should be understood that the contents described in the summary of the present invention are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0011] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] 2A to 2C are schematic diagrams illustrating layer editing according to some embodiments of the present disclosure;

[0013] 3A and 3B are schematic diagrams showing a process of interactive control according to some embodiments of the present disclosure;

[0014] FIG4 shows a schematic diagram of layer editing according to some embodiments of the present disclosure;

[0015] FIG5 is a schematic diagram showing a process of interactive control according to another embodiment of the present disclosure;

[0016] 6A and 6B are schematic diagrams showing layer editing according to some embodiments of the present disclosure;

[0017] FIG7 shows a schematic diagram of an interactive control process according to yet another embodiment of the present disclosure;

[0018] FIG8 shows a flowchart of a process of interactive control according to some embodiments of the present disclosure;

[0019] FIG9 shows a block diagram of an interactive control device according to some embodiments of the present disclosure; and

[0020] FIG10 shows a block diagram of a device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0021] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0022] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.

[0023] It is understandable that the image data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0024] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the type, scope of use, usage scenarios, etc. of the data involved in the present disclosure should be informed to relevant users and authorization should be obtained from relevant users in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.

[0025] As mentioned above, users expect to edit images by interacting with portable devices such as smartphones and tablets, such as adding specific layers to an image or performing operations such as cropping and / or scaling an image. When users interact with portable devices to edit images, such as scaling a layer, due to the small interactive area, when the layer is reduced to a certain extent, the component controls used to control the scaling of the layer may become hidden, or the control areas of these controls may overlap, making it difficult for the user to perform the next layer editing operation, thereby affecting the accuracy and convenience of the interaction.

[0026] The technical solution of the present disclosure provides an interactive control solution. According to the interactive control solution of an embodiment of the present disclosure, a group of controls associated with a target object are presented in a target interface. If the touch position of the received touch input is within the common control area of ​​multiple controls in the group of controls, the activated target control among the multiple controls is determined based on the direction information associated with the touch input. The control area indicates the range for controlling the corresponding control. Based on the touch input, a first operation corresponding to the target control is performed on the target object. In this way, it is possible to effectively avoid erroneous operations on controls due to overlapping control areas of controls, thereby effectively improving the efficiency of picture editing.

[0027] Sample Environment

[0028] First, reference is made to FIG1 , which schematically illustrates a diagram of an example environment 100 in which example implementations according to the present disclosure may be implemented.

[0029] FIG1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In the example environment 100, a target application 120 is installed in an electronic device 110. A user 102 can interact with the target application 120 via the electronic device 110 and / or an attached device of the electronic device 110. The target application 120 can be an application that can provide media content-related services to the user 102, including creation (e.g., shooting and / or editing), publishing, browsing, etc. of media content. In this document, "media content" can be content in various forms, including video, audio, images, image collections, text, etc.

[0030] In the environment 100 of FIG1 , if the target application 120 is active, the electronic device 110 may present an interface 140 of the target application 120 to the user 102. The interface 140 may be various pages that the target application 120 may provide, such as a media content presentation page, a content creation page, a content editing page, and the like.

[0031] In some embodiments, the electronic device 110 communicates with the server 130 to enable the supply of services to the target application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The server 130 is a computing system / server of various types that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0032] It should be understood that the structure and functionality of environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0033] Interactive control process

[0034] Figures 2A to 2C illustrate schematic diagrams of layer editing according to some embodiments of the present disclosure. Interface 200A shown in Figure 2A, interface 200B shown in Figure 2B, and interface 200C shown in Figure 2C may be presented by electronic device 110. For ease of discussion, the process shown in Figure 2 will be described with reference to environment 100 of Figure 1.

[0035] As shown in Figure 2A, electronic device 110 presents interface 200A for picture editing. After detecting user 102's operation on control 213 (e.g., adding a graphic), the initial state of the target object (e.g., graphic 211) selected by user 102 for addition can be presented on interface 200A. The graphic 211 is within an edit box 212. A plurality of controls 201, 202, 203, 204, 205, 206, 207, and 208 for scaling the graphic 211 are presented around the edit box 212. The plurality of controls 201, 202, 203, 204, 205, 206, 207, and 208 can be understood as a group of controls associated with the target object (e.g., graphic 211). By operating these controls 201, 202, 203, 204, 205, 206, 207, and 208, the graphic 211 can be scaled proportionally or non-proportionally.

[0036] For example, if the user operates controls 201, 202, 203, or 204, graphic 211 may be scaled proportionally, whereas if user 102 operates controls 205, 206, 207, or 208, graphic 211 may be scaled non-proportionally. In this context, operations performed on controls may include single-clicking, double-clicking, dragging, sliding, and the like, and the scope of the present disclosure is not limited in this respect.

[0037] In some embodiments, if the user 102 performs non-proportional scaling on the graphic 211 by operating controls 205, 206, 207 and / or 208, some of the multiple controls 201, 202, 203, 204, 205, 206, 207 and 208 for scaling the graphic 211 are in very adjacent positions.

[0038] For example, in the interface 200B shown in FIG2B , since the user 102 performs non-proportional scaling on the graphic 211 through 205 and / or 207 , the controls 203 , 208 and 204 are in very adjacent positions, and the controls 201 , 206 and 202 are also in very adjacent positions.

[0039] For another example, in the interface 200C shown in FIG2C , since the user 102 performs non-proportional scaling on the graphic 211 through 206 and / or 208 , the controls 203 , 205 and 201 are in very adjacent positions, and the controls 204 , 207 and 202 are also in very adjacent positions.

[0040] Each control has its own control area, which indicates the range within which it can be controlled. When multiple controls are located very close to each other, the control areas corresponding to their respective controls may overlap. In some scenarios, this control area can also be understood as a hotspot.

[0041] Although in the above and below embodiments of the present disclosure, multiple controls 201, 202, 203, 204, 205, 206, 207, and 208 are used to scale a target object (e.g., graphic 211), it should be understood that the solutions described in the present disclosure are also applicable to controls with other functions, such as controls for cropping a target object. The scope of the present disclosure is not limited in this respect.

[0042] Figures 3A and 3B are schematic diagrams illustrating an interactive control process according to some embodiments of the present disclosure. The following describes in detail the interactive control process for multiple controls when their control areas overlap, with reference to Figures 3A and 3B.

[0043] As shown in FIG3A , control 301 and control 302 are located very close to each other, and a control area 311 of control 301 and a control area 312 of control 302 overlap, that is, control 301 and control 302 have a common control area 313 .

[0044] If the touch position of the touch input received by the electronic device 110 is in the common control area 313 , the electronic device 110 determines the activated target control from the controls 301 and 302 based on the direction information associated with the touch input.

[0045] Electronic device 110 may obtain range information indicating multiple angle ranges corresponding to control 301 and control 302. For example, the angle ranges corresponding to control 301 are 0° to 75° and 180° to 255°, while the angle ranges corresponding to control 302 are 75° to 180° and 255° to 0° (i.e., 360°).

[0046] In some embodiments, the range information can be determined based on historical touch data. For example, the electronic device 110 obtains historical touch information, which can be generated based on a set of historical touch inputs for multiple controls (such as control 301 and control 302). For example, this historical numerical control information can be obtained by a tester performing one or more touches on a set of test controls. Based on the direction indicated by the historical touch information, the electronic device 110 can determine the angular range corresponding to each of the multiple controls (such as control 301 and control 302).

[0047] It should be understood that in the example shown in FIG3A , control 301 is, for example, a proportionally scaled control located in the upper left corner of an edit box, and control 302 is, for example, a control located at the upper boundary of the edit box. If control 301 were, for example, a proportionally scaled control located in the lower left corner of an edit box, and control 302 were, for example, a control located at the lower boundary of the edit box, the angular ranges corresponding to control 301 and control 302 would change. The example shown in FIG3A is intended only to illustrate one embodiment for determining a target control, and the present disclosure is not limited in terms of the angular ranges corresponding to the multiple controls involved.

[0048] If the touch position of the touch input received by the electronic device 110 is within the common control area 313 and the direction information associated with the touch input is determined to match a specific angle range, the electronic device 110 determines the control corresponding to the specific angle range as the target control. For example, if the electronic device 110 detects that the direction 314 associated with the touch input of the user 102 falls within an angle between 180° and 255°, the electronic device 110 determines the control 301 as the target control.

[0049] For example, the electronic device 110 may determine the direction information associated with the touch input based on the trajectory of the touch input of the user 102 within a predetermined distance range. In some embodiments, the electronic device 110 may detect the angle of the sliding trajectory of the user 102 within a predetermined number of pixels (e.g., 8px), and the sliding trajectory may involve a direction determined by a line connecting the starting point to the end point, or a fitted direction associated with the sliding trajectory. In some other embodiments, the electronic device 110 may detect the sliding trajectory within a specific time period (e.g., a few microseconds) after the touch input starts (the user 102 touches the interface) to determine the direction information associated with the touch input.

[0050] After the electronic device 110 determines the target control, the electronic device 110 performs an operation corresponding to the determined target control on the target object based on the user's touch input. For example, if control 301 is determined as the target control, the electronic device 110 performs an operation corresponding to control 301 on the target object based on the touch input of the user 102, that is, performs proportional scaling on the target object.

[0051] It should be understood that if the touch position of the touch input received by the electronic device 110 is not within the common control area of ​​multiple controls, for example, in Figure 3A, the touch position of the touch input received by the electronic device 110 is in an area of ​​the control area 311 other than the common control area 313 or in an area of ​​the control area 312 other than the common control area 313, then the control 301 or the control 302 can be directly determined as the target control.

[0052] In some other embodiments, the control areas of more than two controls may overlap. For example, as shown in FIG3B , controls 331, 332, and 333 are located in close proximity. Control area 341 of control 331, control area 342 of control 332, and control area 343 of control 333 overlap, meaning that controls 331, 332, and 333 share a common control area 351. In addition to the common control area 351 of controls 331, 332, and 333, controls 331 and 333 also share a common control area 352, and controls 332 and 333 also share a common control area 353.

[0053] The electronic device 110 may acquire range information indicating multiple angle ranges corresponding to the control 331, the control 332, and the control 333. For example, the angle ranges corresponding to the control 331 are 0° to 75° and 180° to 255°, the angle ranges corresponding to the control 332 are 105° to 180° and 285° to 0° (i.e., 360°), and the angle ranges corresponding to the control 333 are 75° to 105° and 255° to 285°.

[0054] In some embodiments, the range information can be determined based on historical touch data. For example, the electronic device 110 obtains historical touch information, which can be generated based on a set of historical touch inputs for multiple controls (e.g., control 331, control 332, and control 333). For example, these historical numerical control information can be obtained by a tester performing one or more touches on a set of test controls. Based on the direction indicated by the historical touch information, the electronic device 110 can determine the angular range corresponding to each of the multiple controls (e.g., control 331, control 332, and control 333).

[0055] It should be understood that in the example shown in FIG3B , control 331 is, for example, a proportionally scaled control located in the upper left corner of the edit box, while control 332 is, for example, a proportionally scaled control located in the upper right corner of the edit box. If control 331 were, for example, a proportionally scaled control located in the lower left corner of the edit box, and control 332 were, for example, a proportionally scaled control located in the lower right corner of the edit box, the angular ranges corresponding to control 331 and control 332 may change. The example shown in FIG3B is merely intended to illustrate one embodiment for determining a target control, and the present disclosure is not limited in terms of the angular ranges corresponding to the multiple controls involved.

[0056] In Figure 3B, if the touch position of the touch input received by the electronic device 110 is in the common control area 351 of controls 331, 332 and 333, the electronic device 110 determines the activated target control from controls 331, 332 and 333 based on whether the direction information associated with the touch input matches a specific angle range.

[0057] For example, if the touch position of the touch input received by the electronic device 110 is within the common control area 351 and the direction 371 associated with the touch input is determined to fall within an angle between 180° and 255°, the electronic device 110 determines the control 331 as the target control. The determination of the direction associated with the touch input has been described in conjunction with FIG. 3A and will not be repeated in this embodiment.

[0058] After the electronic device 110 determines the target control, the electronic device 110 performs an operation corresponding to the determined target control on the target object based on the user's touch input. For example, if control 331 is determined to be the target control, the electronic device 110 performs an operation corresponding to control 331 on the target object based on the touch input of the user 102, i.e., performs proportional scaling on the target object.

[0059] It should be understood that if the touch position of the touch input received by the electronic device 110 is in the common control area of ​​two of the three controls, for example, the touch position is in the common control area 352 of control 331 and control 333 or the common control area 353 of control 332 and control 333, the target control can be determined according to the process described in combination with Figure 3A.

[0060] It should be understood that if the touch position of the touch input received by the electronic device 110 is not within the common control area of ​​multiple controls, that is, it is neither within the common control area 351 of control 331, control 332 and control 333 nor within the common control area 352 of control 331 and control 333 or the common control area 353 of control 332 and control 333, then control 331 or control 332 or control 333 can be directly determined as the target control based on the control area corresponding to the touch position.

[0061] FIG4 shows a schematic diagram of layer editing according to some embodiments of the present disclosure. The interface 400 shown in FIG4 may be presented by the electronic device 110. For ease of discussion, the process shown in FIG2 will be described with reference to the environment 100 of FIG1.

[0062] In the interface 400 shown in FIG4 , multiple controls 451, 452, 453, and 454 for scaling a target object (e.g., graphic 461) are presented. These multiple controls 451, 452, 453, and 454 can be understood as a group of controls associated with the target object (e.g., graphic 461). By operating these controls 451, 452, 453, and 454, non-proportional scaling of graphic 461 can be performed. In the interface 400, controls 451, 452, 453, and 454 are located in close proximity.

[0063] Similarly, each control corresponds to its own control area, which is used to indicate the range of controlling the corresponding control. When multiple controls are located very close to each other, the control areas corresponding to the respective controls may overlap.

[0064] FIG5 is a schematic diagram illustrating an interactive control process according to some embodiments of the present disclosure. The following describes in detail the interactive control process for multiple controls 451, 452, 453, and 454 when their control areas overlap in the example shown in FIG4 , with reference to FIG5 .

[0065] 5 , control area 461 of control 451, control area 462 of control 452, control area 463 of control 453, and control area 464 of control 454 have a common control area 531. Electronic device 110 may obtain range information indicating multiple angle ranges corresponding to controls 451, 452, 453, and 454. As an example, the angle range corresponding to control 451 is 45° to 135°, the angle range corresponding to control 452 is 135° to 225°, the angle range corresponding to control 453 is 225° to 315°, and the angle range corresponding to control 454 is 315° to 0° (i.e., 360°).

[0066] The range information corresponding to the respective angular ranges of controls 451 , 452 , 453 and 454 can be similarly determined based on historical touch data, which will not be further described here.

[0067] In Figure 3B, if the touch position of the touch input received by the electronic device 110 is in the common control area 531 of controls 451, 452, 453 and 454, the electronic device 110 determines the activated target control from controls 451, 452, 453 and 454 based on whether the direction information associated with the touch input matches a specific angle range.

[0068] For example, if the touch position of the touch input received by the electronic device 110 is within the common control area 531 and the direction 541 associated with the touch input is determined to fall within an angle of 225° to 315°, the electronic device 110 determines the control 453 as the target control. The determination of the direction associated with the touch input has been described in conjunction with FIG. 3A and will not be repeated in this embodiment.

[0069] After the electronic device 110 determines the target control, the electronic device 110 performs an operation corresponding to the determined target control on the target object based on the user's touch input. For example, if control 453 is determined to be the target control, the electronic device 110 performs an operation corresponding to control 453 on the target object based on the touch input of the user 102, that is, performs non-proportional downward scaling on the target object.

[0070] It should be understood that if the touch position of the touch input received by the electronic device 110 is in the common control area of ​​three or two controls among controls 451, 452, 453 and 454, it can also be determined based on the direction information of the touch input and the above-mentioned respective angle ranges corresponding to the controls.

[0071] It should be understood that if the touch position of the touch input received by the electronic device 110 is not within the common control area of ​​multiple controls, the control 451, 452, 453 or 454 can be directly determined as the target control based on the control area corresponding to the touch position.

[0072] In some other scenarios, the target object may be reduced to a specific size, causing some controls to overlap. To ensure that the user can continue to perform subsequent operations on the target object, some overlapping controls will be hidden. Figures 6A and 6B show schematic diagrams of layer editing according to some embodiments of the present disclosure. The following describes the situation where some controls are hidden in conjunction with Figures 6A and 6B.

[0073] In the interface 600A shown in FIG6A , for example, when a target object 621 is being zoomed out, the control 601 for proportionally scaling the target object and the control 606 may overlap, so the control 606 is hidden. The other controls 602, 603, 604, and 605 for non-proportionally scaling the target object remain displayed.

[0074] It should be understood that, although not shown, other possible proportional scaling controls may also be hidden due to overlapping with control 601. Optionally, to make the user operation clearer, even if other possible proportional scaling controls do not overlap with control 601, these proportional scaling controls may also be hidden. That is, in this case, only one control 601 for proportionally scaling the target object is retained.

[0075] For example, the control 601 may be determined from multiple controls corresponding to the proportional zoom function based on historical trigger information for the control 601. For example, the historical trigger information indicates the number of times the proportional zoom function is triggered using the control 601.

[0076] It should be understood that the control 601 for proportional scaling is retained for exemplary purposes only, and it is also possible to hide the control 601 while retaining other controls for proportional scaling.

[0077] 6B shows another embodiment of the control overlap. In interface 600B, all controls that may appear on edit box 661 and may be used to edit the target object overlap with control 631. In this case, other controls except control 631 are hidden.

[0078] With respect to the example shown in FIG6A , FIG7 shows a schematic diagram illustrating the process of interactive control according to another embodiment of the present disclosure. Similar to the example shown in FIG6A , all proportional scaling controls except control 601 are hidden. In this case, if the electronic device 110 detects that the touch position 721 of the user's touch input is within the control area 711 of control 601, control 601 is determined as the target control. The electronic device 110 then performs the operation corresponding to the control 601. That is, in this case, the control area 711 of control 601 is placed at the top, which means that the control area 711 of control 601 is above the control areas of controls 602, 603, 604, and 605 used for non-proportional scaling of the target object. This ensures that in extreme cases, the user can first perform proportional scaling on the target object. Such a design can make the interactive operation of the interface more consistent with the user's operating logic and improve the user experience.

[0079] For the example shown in FIG6B , since there is only space 631 on the interface, the electronic device 110 can interpret any touch input of the user as an operation on the control 631 , thereby performing the operation corresponding to the control 631 on the target object.

[0080] Through the detailed description of the embodiments of the present disclosure above, it can be understood that the solution of the present disclosure provides a solution for selecting target controls based on the user's touch input. This solution can effectively avoid incorrect operation of controls due to overlapping control areas and / or overlapping controls, effectively improve the accuracy and convenience of images, and thereby improve the efficiency of image editing.

[0081] Example Process

[0082] 8 shows a flow chart of a process 800 of interactive control according to some embodiments of the present disclosure. The process 800 may be implemented at the electronic device 110. It should be understood that the process 800 may also be implemented at the server 130.

[0083] In box 810, the electronic device 110 presents a set of controls associated with a target object in a target interface.

[0084] In box 820, if the touch position of the touch input received by the electronic device 110 is within the common control area of ​​multiple controls in the group of controls, then in box 830, the electronic device 110 determines the activated target control among the multiple controls based on the direction information associated with the touch input, where the control area indicates the range used to control the corresponding control.

[0085] In box 840, the electronic device 110 performs a first operation corresponding to the target control on the target object based on the touch input.

[0086] In some embodiments, in response to the direction information matching the target angle range, the electronic device 110 determines the target control corresponding to the target angle range from the multiple controls.

[0087] In some embodiments, the electronic device 110 obtains range information indicating multiple angle ranges corresponding to the multiple controls; and based on the range information, determines that the direction information matches the target angle range in the multiple angle ranges.

[0088] In some embodiments, the range information is determined based on the following process: the electronic device 110 obtains historical touch information, which is generated based on a set of historical touch inputs for the multiple controls; and based on the direction indicated by the historical touch information, determines the multiple angle ranges corresponding to the multiple controls.

[0089] In some embodiments, the electronic device 110 determines the direction information associated with the touch input based on a trajectory of the touch input within a predetermined distance range.

[0090] In some embodiments, the touch input is a first touch input, the touch position is a first touch position, and the electronic device 110 receives a zoom operation on the target interface; in response to the first control in the group of controls overlapping with the second control, the second control is stopped from being displayed, and the first control and the second control have corresponding target functions; and in response to the second touch position of the received second touch input being within the target control area of ​​the first control, a second operation corresponding to the first control is performed based on the second touch input.

[0091] In some embodiments, the first control is determined from a plurality of target controls corresponding to the target function based on historical triggering information for the first control, the historical triggering information indicating the number of times the target function is triggered using the first control.

[0092] In some embodiments, the target function includes proportional scaling of the target object.

[0093] In some embodiments, the target interface includes a media editing interface, and the target object includes a media element to be edited.

[0094] In some embodiments, the first operation includes: a scaling operation on the media element; or a cropping operation on the media element.

[0095] Example devices and equipment

[0096] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 9 shows a schematic structural block diagram of a device 900 for data processing according to some embodiments of the present disclosure.

[0097] As shown in Figure 9, the device 900 may include a presentation module 910, which is configured to present a group of controls associated with the target object in the target interface. The device 900 may also include a target control determination module 920, which is configured to determine the activated target control among the multiple controls in response to the touch position of the received touch input being within the common control area of ​​multiple controls in the group of controls based on the direction information associated with the touch input, wherein the control area indicates the range for controlling the corresponding control. The device 900 may also include a first operation execution module 930, which is configured to perform a first operation corresponding to the target control on the target object based on the touch input.

[0098] In some embodiments, the target control determination module 920 is further configured to: in response to the direction information matching the target angle range, determine the target control corresponding to the target angle range from the multiple controls.

[0099] In some embodiments, the device 900 also includes: a range information acquisition module, configured to: acquire range information, wherein the range information indicates multiple angle ranges corresponding to the multiple controls; and a range matching module, configured to: determine, based on the range information, that the direction information matches the target angle range in the multiple angle ranges.

[0100] In some embodiments, the range information is determined based on the following process: obtaining historical touch information, where the historical touch information is generated based on a set of historical touch inputs for the multiple controls; and determining the multiple angle ranges corresponding to the multiple controls based on the direction indicated by the historical touch information.

[0101] In some embodiments, the apparatus 900 further includes a direction information determination module configured to determine the direction information associated with the touch input based on a trajectory of the touch input within a predetermined distance range.

[0102] In some embodiments, the touch input is a first touch input, the touch position is a first touch position, and the device 900 also includes a zoom operation receiving module, configured to: receive a zoom operation for the target interface; a stop display module, configured to: stop displaying the second control in response to the first control in the group of controls overlapping with the second control, the first control and the second control having corresponding target functions; and a second operation execution module, configured to: in response to the second touch position of the received second touch input being within the target control area of ​​the first control, execute a second operation corresponding to the first control based on the second touch input.

[0103] In some embodiments, the first control is determined from a plurality of target controls corresponding to the target function based on historical triggering information for the first control, the historical triggering information indicating the number of times the target function is triggered using the first control.

[0104] In some embodiments, the target function includes proportional scaling of the target object.

[0105] In some embodiments, the target interface includes a media editing interface, and the target object includes a media element to be edited.

[0106] In some embodiments, the first operation includes: a scaling operation on the media element; or a cropping operation on the media element.

[0107] The units included in the device 900 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units in the device 900 can be implemented at least in part by one or more hardware logic components. As an example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0108] Figure 7 shows a block diagram of a computing device / server 1000 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the computing device / server 1000 shown in Figure 10 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein.

[0109] As shown in Figure 10, computing device / server 1000 is in the form of a general-purpose computing device. Components of computing device / server 1000 may include, but are not limited to, one or more processors or processing units 1010, memory 1020, storage device 1030, one or more communication units 1040, one or more input devices 1060, and one or more output devices 1060. Processing unit 1010 may be a real or virtual processor and is capable of performing various processes according to a program stored in memory 1020. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of computing device / server 1000.

[0110] The computing device / server 1000 typically includes a plurality of computer storage media. Such media can be any available media accessible to the computing device / server 1000, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1020 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1030 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data (e.g., training data for training) and can be accessed within the computing device / server 1000.

[0111] The computing device / server 1000 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 10 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 1020 may include a computer program product 1025 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0112] The communication unit 1040 enables communication with other computing devices via a communication medium. Additionally, the functionality of the components of the computing device / server 1000 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the computing device / server 1000 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or other network nodes.

[0113] Input device 1050 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 1060 may be one or more output devices, such as a display, a speaker, or a printer. Computing device / server 1000 may also communicate with one or more external devices (not shown) via communication unit 1040, as needed, such as storage devices, display devices, or the like, with one or more devices that allow a user to interact with computing device / server 1000, or with any device that allows computing device / server 1000 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0114] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which one or more computer instructions are stored, wherein the one or more computer instructions are executed by a processor to implement the method described above.

[0115] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0116] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0117] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device, so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0118] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0119] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the implementations disclosed herein.

Claims

1. An interaction control method, comprising: Presenting a set of controls associated with a target object in a target interface; In response to a touch position of a received touch input being within a common control area of multiple controls in the set of controls, determining a target control activated among the multiple controls based on direction information associated with the touch input, wherein the control area indicates a range for controlling a corresponding control; And Performing, based on the touch input, a first operation corresponding to the target control on the target object.

2. The method according to claim 1, wherein determining the target control activated among the multiple controls based on direction information associated with the touch input comprises: In response to the direction information matching a target angle range, determining the target control corresponding to the target angle range from the multiple controls.

3. The method according to claim 2, further comprising: Obtaining range information, the range information indicating multiple angle ranges corresponding to the multiple controls; And Based on the range information, determining that the direction information matches the target angle range among the multiple angle ranges.

4. The method according to claim 3, wherein the range information is determined based on the following process: Obtaining historical touch information, the historical touch information being generated based on a set of historical touch inputs for the multiple controls; and Based on the direction indicated by the historical touch information, determining the multiple angle ranges corresponding to the multiple controls.

5. The method according to claim 1, further comprising: Determining the direction information associated with the touch input based on a trajectory of the touch input within a predetermined distance range.

6. The method according to claim 1, wherein the touch input is a first touch input, the touch position is a first touch position, and the method further comprises: Receiving a zoom operation on the target interface; In response to a first control and a second control in the set of controls overlapping, stopping displaying the second control, the first control and the second control having corresponding target functions; And In response to a second touch position of a received second touch input being within a target control area of the first control, performing a second operation corresponding to the first control based on the second touch input.

7. The method according to claim 6, wherein the first control is determined from multiple target controls corresponding to the target function based on historical trigger information for the first control, the historical trigger information indicating the number of times of using the first control to trigger the target function.

8. The method according to claim 6 or 7, wherein the target function includes equal-proportion scaling of the target object.

9. The method according to claim 1, wherein the target interface includes a media editing interface, and the target object includes a media element to be edited.

10. The method according to claim 9, wherein the first operation includes: A zoom operation on the media element; Or A cropping operation on the media element.

11. An interaction control device, comprising: A presentation module, configured to present a set of controls associated with a target object in a target interface; A target control determination module, configured to, in response to a touch position of a received touch input being within a common control area of a plurality of controls in the set of controls, determine a target control activated among the plurality of controls based on direction information associated with the touch input, where the control area indicates a range for controlling a corresponding control; And A first operation execution module, configured to perform a first operation corresponding to the target control on the target object based on the touch input.

12. An electronic device, comprising: At least one processing unit; And At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to execute the method according to any one of claims 1 to 10.

13. A computer-readable storage medium, having stored thereon a computer program, the program, when executed by a processor, implementing the method according to any one of claims 1 to 10.

14. A computer program product, comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Interaction control method and device, equipment and storage medium

    CN117827068A

  • Operation method and device, electronic equipment and computer readable storage medium

    CN114385061A

  • Control response area adjusting method and device, storage medium and electronic equipment

    CN115525204A

  • Techniques to magnify images

    US20120218468A1