Content transmission method, apparatus, and system

By detecting preset gestures on the touch screen device and using the transit area to transmit the target object, the problem of low copy and paste efficiency from long distances is solved, fast and convenient object transmission is achieved, and user experience is improved.

WO2025145710A1PCT designated stage expired Publication Date: 2025-07-10HUAWEI TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/123449
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-01-05
Filing Date
2024-10-08
Publication Date
2025-07-10

AI Technical Summary

Technical Problem

Existing touch screen devices are inefficient in copying, pasting and cutting operations during long distances, cross-axis or cross-screen operations, which are easy to interrupt and affect the user experience.

Method used

By detecting preset gestures on the touch screen device, the target object is quickly transferred, the target object is temporarily stored using the transit area, and the receiving position is determined at the receiving end for display, supporting local, cross-device and cloud transit area transmission, and combining dynamic image effects to improve interaction efficiency.

Benefits of technology

It improves the efficiency and user experience of cross-screen and cross-axis operations, reduces the multiple interaction requirements of the hands or mouse, and achieves fast and convenient object transfer.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024123449_10072025_PF_FP_ABST
    Figure CN2024123449_10072025_PF_FP_ABST
Patent Text Reader

Abstract

Provided in the present application are a content transmission method, which is mainly used in electronic devices. The method comprises: when a first operation has been detected, acquiring first information of a target object, the first information of the target object comprising at least one of the target object, a link address of the target object, or a mirror image of the target object; and when a second operation has been detected, determining a second position, and displaying the target object at the second position. The method can be used for achieving content transmission on a local device, between different electronic devices and between electronic devices logged into the same account. The method can improve the efficiency and convenience in content transmission and effectively improve the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Content delivery method, device and system

[0001] This application claims priority to Chinese patent application No. 202410024260.6, filed on January 5, 2024, entitled “A content delivery method, device and system”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present application relates to the field of computer technology, and in particular to a content delivery method, device, and system. Background Art

[0003] Touch screen devices have become ubiquitous in today's work and life. The original intention of the touch screen was to facilitate users to use touch operations more quickly to perform some common office operations. However, some common operations including copying, pasting, cutting, etc. currently require the collaboration of the mouse and both hands to achieve, or require multiple operations to achieve, and their operation efficiency is low, which seriously affects office efficiency.

[0004] Currently, copying, pasting, and cutting operations by dragging are only effective for short-distance operations. They are extremely prone to interruption in long-distance, cross-axis, or cross-screen scenarios, and repeated dragging is required to reference objects. Based on this, a solution to interactive operations in cross-screen, cross-axis, and long-distance interaction scenarios is a key research topic in current touch screen applications.

[0005] Summary of the Invention

[0006] The present application provides a method for achieving fast interaction based on the transmission of object content, which is mainly used on touch screen electronic devices. It can help users achieve fast interaction on the touch screen by dragging and dropping, thereby improving interaction efficiency and user experience.

[0007] The first aspect of the present application provides a method for achieving fast interaction based on the transmission of object content, which is applied to a touch screen electronic device. When the sending end detects a preset gesture on the target object, the sending end obtains a transmission object based on the target object and sends the transmission object to one or more transfer areas. When the receiving end detects a read input, the electronic device determines a receiving application based on the read input, obtains the transmission object from the transfer area, sends the transmission object to the receiving application, and the receiving application receives and displays the target object or a mirror image of the target object. The present application proposes a content transmission method, which includes: detecting a first operation, obtaining first information of the target object, the first information of the target object including at least one of the target object, the link address of the target object, or the mirror image of the target object; detecting a second operation, determining a second position, and displaying the target object at the second position.

[0008] In this solution, a content transmission method is proposed. The method can be applied to electronic devices to achieve rapid transmission of target objects. This solution can effectively improve the efficiency and convenience of transmitting target objects.

[0009] In one possible implementation, obtaining the first information of the target object includes: detecting the first operation, performing a third operation to obtain the first information of the target object, and transmitting the first information of the target object to a transfer area, wherein the third operation is one of copying, moving or cutting, and the transfer area is one of a local transfer area, a cross-device transfer area or a cloud transfer area.

[0010] In this solution, the first operation is also used to transfer the target object to a transfer area, where the type of the transfer area can be a local transfer area mainly for scenarios where content is transferred within the same electronic device; it can be a cross-device transfer area, which is mainly used for scenarios where content is transferred between different devices; it can also be a cloud transfer area, where multiple devices can log in to the same cloud account and transfer content between the devices.

[0011] In a possible implementation, the detecting the second operation and determining the second position includes: detecting the second operation, acquiring the first information of the target object from the transfer area, and displaying the first information at the second position.

[0012] In a possible implementation, the method further includes: the first position and the second position are located in the same application window.

[0013] In this solution, the two parties of the content transmission can be performed in the same application window on an electronic device.

[0014] In a possible implementation, the method further includes: the first position is located in the first application window, the second position is located in the second application window, and the first application window and the second application window are displayed on a screen of the same electronic device.

[0015] In this solution, the content transmission may be performed in an application window not used by an electronic device.

[0016] In one possible implementation, the method further includes: detecting the first operation, displaying a first dynamic image at the first position, the first dynamic image including multiple concentric circles of different radii, the multiple concentric circles presenting at least one of the following changes from the outside to the inside: from opaque to transparent, from white to black, and then to white; in response to the second operation, displaying a second dynamic image at the second position, the second dynamic image including multiple concentric circles of different radii, the multiple concentric circles presenting at least one of the following changes from the inside to the outside: from transparent to opaque, from white to black, and then to white.

[0017] In this solution, the target object will display dynamic special effects during the sending and receiving process. The sending end is mainly used to display the process of the target object's continuous contraction of gravitational waves, and the receiving end displays the process of the gravitational waves outside the target object continuously expanding.

[0018] In a possible implementation, the method further includes: detecting that the transfer area is not empty, and the second operation is only used to instruct to obtain the first information of the target object from the transfer area.

[0019] In this solution, when the transfer area is not empty, the second operation may define a function in the system, but at this time the second operation can only be used to implement the function of obtaining the target object from the transfer area.

[0020] In a possible implementation, the target object includes at least one of text, image, audio, video, document, folder, and web page address.

[0021] In a second aspect, a method for transmitting content is applied to a first electronic device, comprising: detecting a first operation, obtaining first information of the target object, the first information of the target object including at least one of the target object, a link address of the target object, or a mirror of the target object.

[0022] In one possible implementation, obtaining the first information of the target object includes: detecting the first operation, performing a third operation to obtain the first information of the target object, and transmitting the first information of the target object to a transfer area, wherein the third operation is one of copying, moving or cutting, and the transfer area is one of a local transfer area, a cross-device transfer area or a cloud transfer area.

[0023] In one possible implementation, the method further includes: detecting the first operation, displaying a first dynamic image at the first position, wherein the displayed first dynamic image includes multiple concentric circles of different radii, and the multiple concentric circles present at least one of the following changes from the outside to the inside: from opaque to transparent, from white to black, and then to white.

[0024] In a possible implementation, the target object includes at least one of text, image, audio, video, document, folder, and web page address.

[0025] In a third aspect, a content transmission method is provided, which is applied to a second electronic device and includes:

[0026] A second operation is detected, a second position is determined, and the target object is displayed at the second position.

[0027] In a possible implementation, the method further includes: detecting the second operation, acquiring first information of the target object from the transfer area, and displaying the first information at the second position.

[0028] In one possible implementation, the method further includes: detecting the second operation, displaying a second dynamic image at the second position, wherein the second dynamic image includes multiple concentric circles of different radii, and the multiple concentric circles present at least one of the following changes from the inside to the outside: from transparent to opaque, from white to black, and then to white.

[0029] In a possible implementation, the method further includes: detecting that the transfer area is not empty, and the second operation is only used to indicate receiving the first information of the target object.

[0030] In a possible implementation, the target object includes at least one of text, image, audio, video, document, folder, and web page address.

[0031] In a fourth aspect, a device for transmitting content is proposed, which includes: a detection module for detecting a first operation and a second operation; a processing module for obtaining first information of a target object in response to the first operation, wherein the first information of the target object includes at least one of the target object, a link address of the target object, or a mirror of the target object; the processing module is also used to determine a second position in response to the second operation, and display the target object at the second position; wherein the target object includes at least one of text, image, audio, video, document, folder, and web page address.

[0032] In a fifth aspect, a device for transmitting content is proposed, which includes: a detection module for detecting a first operation; a processing module for obtaining first information of a target object in response to the first operation, wherein the first information of the target object includes at least one of the target object, a link address of the target object, or a mirror of the target object; wherein the target object includes at least one of text, image, audio, video, document, folder, and web page address.

[0033] In the sixth aspect, a device for receiving transmitted content is proposed, the device comprising: a detection module for detecting a second operation; a processing module for determining a second position in response to the second operation, and displaying a target object at the second position; wherein the target object includes at least one of text, image, audio, video, document, folder and web page address.

[0034] In the seventh aspect, a computer-readable storage medium is proposed, comprising computer instructions. When the computer instructions are executed on a computer system, the computer system implements the human-computer interaction method as described in any of the first aspect, the second aspect, or the third aspect above.

[0035] In the eighth aspect, an electronic device is proposed, comprising a processor coupled to a memory, the processor being used to store instructions, and when the instructions are executed by the processor, the electronic device executes the method as described in any one of the first aspect, the second aspect, or the third aspect above.

[0036] In a ninth aspect, a computer program product is proposed, which includes instructions. When the instructions are executed, the computer implements the method as described in any one of the first aspect, the second aspect, or the third aspect.

[0037] The beneficial effects of the second to ninth aspects mentioned above can be referred to the introduction of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] FIG1 is a schematic diagram of an architecture of an application scenario provided by an embodiment of the present application;

[0039] FIG2( a ) is a schematic diagram of content interaction in a same-terminal touch screen device according to an embodiment of the present application;

[0040] FIG2( b ) is a schematic diagram of another touch screen content interaction provided by an embodiment of the present application;

[0041] FIG2( c ) is a logic diagram of the target object's gravitational wave effect display during a content interaction process according to an embodiment of the present application;

[0042] FIG3 is a schematic diagram of content interaction between different electronic touch screen devices connected to the same local area network according to an embodiment of the present application;

[0043] FIG4 is a schematic diagram of content interaction between different electronic touch screen devices logged into the same account provided by an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solutions and advantages of this application more clear, the embodiments of this application are described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only embodiments of a part of this application, rather than all embodiments. It is known to those skilled in the art that with the emergence of new application scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0045] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the descriptions used in this way can be interchangeable where appropriate so that the embodiments can be implemented in a sequence other than that illustrated or described in this application. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or modules is not necessarily limited to those steps or modules clearly listed, but may include other steps or modules that are not clearly listed or that are inherent to these processes, methods, products or devices. The naming or numbering of steps in this application does not mean that the steps in the method flow must be executed in the time / logical sequence indicated by the naming or numbering. The named or numbered process steps can change the execution order according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved.

[0046] The division of units in this application is a logical division. In actual application, there may be other division methods. For example, multiple units can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, and the indirect coupling or communication connection between units can be electrical or other similar forms, which are not limited in this application. Moreover, the units or sub-units described as separate components may or may not be physically separated, may or may not be physical units, or may be distributed into multiple circuit units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this application.

[0047] To facilitate understanding, some technical terms involved in the embodiments of this application are first introduced below.

[0048] (1) Touch screen

[0049] A touch screen is a display screen of an electronic device that allows operations corresponding to touch instructions to be completed by touching, thereby realizing the operation of the electronic device.

[0050] (2) Application Window

[0051] An application window refers to a window displayed when an application software is opened. The information displayed in this window is all the content displayed in the application software. Each application window can correspond to the same application software. These application windows can be stacked or displayed in the form of previews or bubbles in floating boxes.

[0052] (3) Transit Area

[0053] The transit area is a logically defined structure that defines part of the storage area on the memory as the transit area for temporarily storing the target object. After a preset time or when the electronic device is powered off, the transferred object is lost from the transit area.

[0054] The transfer area includes at least a local transfer area and a cross-device transfer area. The local transfer area and the cross-device transfer area can be the same. There can be multiple local transfer areas, each corresponding to a different receiving device. For example, one transfer area is used to realize the transmission of local objects, and another transfer area is used to realize the transmission of local area network devices in the same local area network as the local device. Therefore, this solution can not only realize the reference of the target object on the local end, but also realize cross-device reference.

[0055] The staging area can also include a cloud staging area. As the name suggests, a cloud cache is a storage area set up in the cloud for storing transferred objects. After a preset time, or if no account is connected to the cloud, the objects in the storage area are lost. Transferred objects can be sent to the cloud staging area.

[0056] (4) Receiving equipment

[0057] The receiving device includes the local device, a device logged into the same account, or other user devices in the same local area network. The receiving device can be a smart phone, tablet computer, laptop computer, PC, electronic whiteboard, robot, display screen and other electronic devices with a touch screen.

[0058] (5) Target audience

[0059] In this solution, the target objects can be: text, images, audio and video, documents, folders, web addresses, cards, chat bubbles. From the data structure, they can be divided into text (text), URI (file), HTML (rich text), and intent (custom format).

[0060] Currently, when using touch screen electronic devices, users usually need to perform daily operations such as copying, pasting, cutting, and moving through multiple interactions of their hands or coordination of their hands with a mouse. However, hand dragging operations often experience interruptions during long-distance, cross-axis, or cross-screen operations, which greatly affects the user's operating efficiency and usage experience.

[0061] Based on this, the present application proposes a fast interaction method that does not require long dragging of objects and can be combined with mouse or pen clicks to achieve fast reception, significantly improving operational efficiency and user experience. This method can be applied to touchscreen electronic devices, including smartphones, tablets, laptops, PCs, electronic whiteboards, robots, and display screens, among other electronic devices containing touchscreens.

[0062] Please refer to Figure 1, which is a schematic diagram of the architecture of an application scenario provided in an embodiment of the present application. As shown in Figure 1, the application scenario includes an electronic device 001 and a stylus 002. The electronic device 001 can be a touch screen electronic device such as a mobile phone, a watch, a tablet, a laptop, a PC, a robot, or an electronic whiteboard. The electronic device 001 is equipped with an operating system and has at least two applications installed, Application 1 and Application 2. The stylus 002 is used to connect to the electronic device 001 and can replace the user's hand to interact with the touch screen.

[0063] The user can use either a stylus 002, a hand, or a mouse as input to operate the touch screen to transfer files, images, text, and other objects in application window 1 to the window of application 2. The two inputs can be applied to different locations on the same touchscreen electronic device, or to different touchscreen electronic devices, respectively, corresponding to device-to-device transfers and cross-device transfers from one device to another. Transferring here can mean copying, pasting, moving, sending, or cutting.

[0064] In one possible implementation scenario, on a touch screen electronic device 1, applications 1 and 2 run as small windows, and at least part of each window is displayed on the touch screen, so that the display interface is not completely blocked. The touch screen electronic device 1 can use a stylus or a hand to operate the touch screen. For example, using a hand, one hand or a finger performs a first operation on a target object on the display interface of application 1, and another hand or a finger performs a second operation on the target object on the display interface of application 2. The first operation includes selecting to copy, move, or send, and the second operation includes clicking. The first operation is used to indicate what operation to perform, and the second operation is used to indicate the location of the receipt.

[0065] In one implementation of the above-mentioned embodiment, the first operation is a copy operation, and the second operation is a click operation. After the execution of the first operation is detected, the number of times the second operation is executed is equal to the number of times it is pasted at the corresponding position, that is, click once to paste one target object, click twice to paste two target objects, and so on.

[0066] In a possible implementation scenario, on a touch screen electronic device 1, application 1 and application 2 are run in the form of small windows, and at least part of the window of each is displayed on the touch screen, and the display interface is not completely blocked. The touch screen electronic device 1 can use a stylus or a hand to operate the touch screen, where a hand is used as an example. One hand or a finger performs a first operation on a target object on the display interface of application 1, and another hand or a finger performs a second operation on the target object on the display interface of application 2, where the first operation may include a drag and throw gesture, where dragging and throwing are a continuous operation. Specifically, the drag gesture is used to select the target object, and the throw gesture is used to indicate the start of transmitting and receiving the object. The throw gesture is detected on the display screen as a short-distance fast sliding operation; the second operation generally occurs before the throw gesture in the first operation appears. The second operation corresponds to a long press operation. When a short-distance fast sliding gesture after dragging is detected in the first operation, the long press gesture is used to indicate the reception of the transmitted object.

[0067] In one implementation of the above-mentioned embodiment, the first gesture is detected as dragging in application 1, and before the throwing gesture, a second operation long press is detected on the second application 2. After detecting the second operation long press, the electronic device converts the first gesture dragging into the second gesture throwing (sliding). At this time, the second gesture throwing is used to indicate the start of transmitting the target object, and the second operation is used to indicate the location of the transmitted target object.

[0068] In one implementation of the above embodiment, if the first gesture is detected as a drag in application 1 and no gesture is detected in application 2, then if the first gesture is converted to the second gesture, and if the second operation, a long press, is detected within 0.5 seconds after the second gesture is detected, the second operation can still be used to indicate the receipt of the target object. The 0.5-second interval can be customized according to user needs.

[0069] In one possible implementation scenario, on a touchscreen electronic device 1, application 1 and application 2 run as small windows, with at least a portion of each window displayed on the touchscreen, ensuring that the display interface is not completely obscured. A user can apply two hands to application 1 and application 2, respectively, and perform preset gestures to transfer objects between application 1 and application 2. For example, an object such as a file, image, or text in application 1 can be transferred to application 2.

[0070] In one possible implementation scenario, on a touchscreen electronic device 1, application 1 and application 2 run as small windows, with at least a portion of each window displayed on the touchscreen, ensuring that the display interface is not completely obscured. A user can apply a hand or finger and a stylus to application 1 and application 2, respectively, and perform preset operations to transfer objects between application 1 and application 2. For example, an object such as a file, image, or text in application 1 can be transferred to application 2.

[0071] In a possible implementation scenario, there are two interacting touch screen electronic devices 1 and 2. The user can use both hands to operate the two different electronic devices to transfer objects. Specifically, objects such as files, pictures or texts in electronic device 1 can be transferred to electronic device 2.

[0072] In a possible implementation scenario, there are two interacting touch screen electronic devices 1 and 2. The user can use one hand or one finger and a stylus to operate the two electronic devices in the interaction stage to transfer objects. Specifically, objects such as files, pictures or texts in electronic device 1 can be transferred to electronic device 2.

[0073] In a possible implementation scenario, there are two touch screen electronic devices 1 and touch screen electronic devices 2 that are communicating. The user can use one hand or one finger and a mouse to operate the two electronic devices in the interaction stage to realize the transfer of objects. Specifically, objects such as files, pictures or texts in electronic device 1 can be transferred to electronic device 2.

[0074] In one possible implementation of the above application scenario, the electronic device has a screen, and the screen is a touch screen. The electronic device is equipped with a touch module that can detect the position of the touch input in real time, detect the touch trajectory, determine the type of touch gesture based on the touch trajectory, and then generate a computer instruction that matches the current page based on the touch type to execute the function corresponding to the gesture. For example, if a left swipe gesture is detected, and the left swipe gesture on the current page corresponds to a return to previous level operation, the electronic device generates a "return to previous level" computer instruction based on the gesture type and executes the return to previous level operation.

[0075] In another possible implementation of the above application scenario, the electronic device may also be configured with a stylus. The stylus serves as an external device of the electronic device and establishes a connection with the electronic device via wireless communication such as Bluetooth, thereby operating the electronic device through the stylus.

[0076] In one possible implementation of the above application scenario, the transmission function of this embodiment can be turned on or off through the setting function. If the transmission function is turned off in the settings, subsequent actions will not be triggered when a preset gesture is detected. In addition, the implementation of the transmission function also depends on some system functions, which should also be enabled. If the corresponding system functions are disabled, it will also affect the implementation of the transmission function, resulting in the inability to achieve transmission, or only partial implementation. For example, the transmission function uses the "drag service" and "clipboard writing" services. If the "clipboard writing" of the current application is disabled, then since the target object cannot be written to the clipboard, the action of determining the target object after detecting the preset gesture can still be performed, but subsequent actions cannot be performed; if the "drag service" is not enabled, similarly, since the target object cannot be written to the clipboard, the action of determining the target object after detecting the preset gesture can still be performed, but subsequent actions cannot be performed.

[0077] In one possible implementation, the transmission function can also send the target object to other devices logged into the same account, or devices of other different users in the local area network.

[0078] In one possible implementation, when the transmission function is enabled, the electronic device maintains real-time detection of input on the touch screen. If the input type is detected to be consistent with the preset gesture of the transmission function, the target object is first determined based on the touch position of the preset gesture. The type of the preset gesture can be pre-set. In this embodiment, the preset gesture is to long press first and then drag and move. When the electronic device detects a long press gesture, it determines the target object based on the touch position of the long press gesture and selects the target object. If a drag and move gesture for the target object is detected again, the transmission function of this application is triggered. Of course, only the long press gesture can be used, or other gestures / gesture combinations can be used as gestures to trigger the transmission function.

[0079] In a possible implementation of this embodiment, after the target object is determined, at least one action can be performed on the target object to indicate that the target object is selected. The at least one action may include: ① displaying the target object in suspension; ② adding a shadow effect; ③ displaying a thumbnail of the target object of a preset size near the touch position; ④ adjusting the size of the target object, and making the center of the adjusted target object coincide with the center of the touch point. Taking the album application as an example, the photos in the album are displayed in the small window. When the photo is long pressed, the current photo is determined as the target object, and the photo is reduced and adjusted to a preset size. It is displayed near the current touch position and overlaps with the center of the touch point. The reduced photo is displayed in suspension and a shadow effect is added. In this way, it can be directly reflected at the visual level that the current object is the object the user is operating.

[0080] In this embodiment, in order to reflect the advantages of transmission being faster than traditional drag operations and supporting multi-side interaction, when the target object is sent to the transfer area, the electronic device can also generate a prompt graphic at the touch position, and the prompt graphic can be a dynamic graphic.

[0081] In this scheme, a dynamic image, centered around the touch point, consists of a series of concentric rings that influence the image display according to a pre-set pattern. Specifically, the concentric rings shift the pixels within their range, with the shift direction being the vector from the pixel to the ring's center. The amount of shift is proportional to the distance from the pixel to the ring's center. That is, pixels outside the ring's center shift toward it, with the shift increasing toward the outside. Pixels in the center of the ring do not shift. As the rings shrink, the image pixels within them shift sequentially, creating the visual effect of gravitational waves.

[0082] The above is the action on the sending side. After the action on the sending side is completed, it needs to wait for the input of the receiving side to trigger the reading of the target object from the staging area. In other words, in this embodiment, the actions on the sending side and the receiving side are isolated, and both require user input as a trigger condition.

[0083] Please refer to Figure 2(a), which is a schematic diagram of content interaction in a same-end touch screen device provided by an embodiment of the present application. The embodiment of the present application provides a method for transmitting objects in the same electronic device, wherein the electronic device has a screen, and the screen is a touch screen.

[0084] In this embodiment, the electronic device is a local device. First, a first operation is detected at a first position of the local device (a position in a first application window). A target object is displayed at the first position. The first operation is used to indicate the acquisition of the target object, the link address of the target object, or the mirror image of the target object. At the same time, when the first operation is detected, a third operation is also detected. The third operation can be one of copy, move, or cut. The third operation is used to perform a corresponding operation on the target object to complete the copy, move, send, or cut of the target object. Similarly, after the completion of the third operation is detected, the content acquired by the third operation is transferred to a transfer area. For the same electronic device, the transfer area is a transfer area within the device that is used to temporarily cache content information for interaction or transmission. When a second operation is detected, a second position is determined. The second position is the position on the screen where the second operation is detected and is also the target position for the target object to be transferred. The second position is located in a second application window. The second application window can be different from the first application window or the same as the first application window, but the first position and the second position are different.

[0085] The first operation and the second operation may be a single gesture or a combination of multiple gestures.

[0086] In one possible implementation of this embodiment, the first operation is a combination of a first gesture and a second gesture, wherein the first gesture is a long press and the second gesture is a drag. Upon detecting the long press followed by the drag, the electronic device determines that the object being long pressed and dragged is a target object and performs a third operation on the target object to obtain the target object, a link address of the target object, or a mirror image of the target object.

[0087] In a possible implementation of this embodiment, the second operation is a long press gesture.

[0088] After determining the target object and obtaining the target object, the link address of the target object, or the image of the target object, the target object, the link address of the target object, or the image of the target object needs to be sent to the staging area. Sending the target object, the link address of the target object, or the image of the target object to the staging area can be performed automatically or with a preset trigger condition.

[0089] In one possible implementation, after detecting the first operation and obtaining the target object, the link address of the target object, or the image of the target object, the electronic device automatically sends the target object, the link address of the target object, or the image of the target object to the transfer area.

[0090] In another possible implementation, the electronic device detects a preset trigger gesture, and after detecting the preset trigger gesture, sends the target object, the link address of the target object, or the image of the target object to the transfer area.

[0091] In one embodiment, the trigger gesture is a throwing gesture applied to a target object. After detecting the throwing gesture applied to the target object, the target object, the link address of the target object, or the mirror image of the target object is sent to the transfer area. The throwing gesture can directly follow the gesture or gesture combination of the first operation. For example, long press to select the target object, then drag the target object, and then throw the target object, that is, the target object, the link address of the target object, or the mirror image of the target object is sent to the transfer area. In this way, the first operation and the trigger gesture can be naturally connected, which is in line with human operating habits.

[0092] In another embodiment, the trigger gesture reuses the gesture of the second operation. That is, while maintaining the first operation, if the second operation is detected at the same time, the target object, the link address of the target object, or the image of the target object is sent to the staging area. A time condition can also be added. If the second operation is detected and the second operation is maintained for a time exceeding a preset value, the target object, the link address of the target object, or the image of the target object is sent to the staging area.

[0093] In a possible implementation of this embodiment, when the content in the transfer area is not empty and before a read input gesture is detected on the local device, the read input gesture on the local device will only be used to read the target object from the transfer area, and can also be used to display the target object at a second location. The read input hand operation is effective for the entire system and is only used to read the target object from the transfer area and display it at a second location, so that the current content transmission process is not interrupted.

[0094] In one possible implementation of this embodiment, the content in the transfer area of ​​the local device is regularly cleared, and its temporary storage duration can be 5 seconds or 10 seconds. Alternatively, the user can set a fixed value to implement the cache duration setting function. In one possible implementation, when the transfer area is empty, the input read gesture can be used to perform other operations that have been customized or defaulted in the system. The read input gesture will restore its originally defined operation and is no longer limited to its function of reading the target object from the transfer area and displaying it in the second position.

[0095] In a possible implementation of this embodiment, when an input reading gesture is detected, the target object at the first position is presented as a dynamic image and produces a dynamic change effect, and finally slowly disappears in the form of concentric circles; the target object at the second position is also presented as a dynamic image and produces a dynamic change effect, and finally slowly appears in the form of concentric circles.

[0096] In this embodiment, when the electronic device is a local device, if a read input is detected (taking the stylus pen hovering as an example), the position of the input focus is determined, and then the receiving application is determined based on the position of the input focus. If the input focus falls within an application window, the application corresponding to the application window is the receiving application. If there are multiple application windows corresponding to the focus position, that is, multiple application windows overlap, the application corresponding to the topmost application window (layer) is determined as the receiving application. In addition, when a read input is detected, the electronic device accesses at least one transfer area, which can be the local transfer area described above or a cloud transfer area. For example, when sending a transmission object to the transfer area, at least the target object is transferred to the local application transfer area. If the local device is connected to a local area network, the transmission object is also transferred to the cross-device transfer area. In this embodiment, the electronic device only needs to access the local application transfer area, obtain the transmission object stored in the transfer area from the local application transfer area, and then send the transmission object to the receiving application. The determination of the receiving application and the access to the transfer area can be performed simultaneously, or the receiving application can be determined first and then the transfer area is accessed after the receiving application is determined.

[0097] In one possible implementation of this embodiment, the read input can reuse other common inputs, such as hovering and clicking in this embodiment. In this solution, to prevent misoperation, after detecting a preset gesture, the electronic device can disable other operations corresponding to the read input on the current interface or globally in the system, so that the read input is only used to trigger reading of the transfer area.

[0098] In this embodiment, stylus hovering is a commonly used function. Assume that stylus hovering is defined in the operating system as selecting the object corresponding to the hover focus. After detecting a preset gesture, the electronic device can globally disable stylus hovering as an input for selecting an object in the operating system and activate stylus hovering as a reading input function. When stylus hovering is detected, the electronic device determines a receiving application, reads a transfer object from the transfer area, and sends the transfer object in the transfer area to the receiving application. The receiving application then obtains the target object or a mirror image of the target object based on the transfer object and displays it at the location where the stylus was hovered.

[0099] Please refer to Figure 2(b), which is a schematic diagram of another touch screen content interaction provided by an embodiment of the present application. The first application and the second application belong to different applications in the same electronic device. As shown in Figure 2(b), the first application is a gallery and the second application is a note. In this process, the first operation is a long press, click, or drag. The type of the first operation is not specifically limited and is mainly used to select the target object. The third operation is a copy operation. The type of the third operation is also not limited. The third operation is an optional operation. When only the first operation is present, the function of the first operation is to select the target object and perform a copy operation on the target object. In this embodiment, based on the first position of the long press gesture, the target object is determined to be a sunflower image. The second operation is a click. The first position in the gallery application of the local electronic device is detected to select the target object sunflower image and perform a copy operation on the target object to obtain a mirror image of the sunflower image. A click operation is performed on the second position of the second application note. When the electronic device detects the click operation, based on the second position of the click, it determines that the receiving application is a note. The electronic device reads the mirror image of the sunflower from the transfer area and sends it to the note application, or the note application reads the radial direction of the sunflower from the transfer area. After the note-taking application obtains the sunflower image, it displays the sunflower pattern at a second location. When multiple clicks are made at the second location, the number of sunflower patterns to be pasted is selected based on the number of clicks. In one possible implementation, a drag-and-drop method can be used to copy and paste. When a cursor, stylus, or touch point clicks from a first location of a target object, the image of the target object is dragged and transferred to a transfer area on the local device. As the cursor, stylus, or touch point is dragged until a second location is clicked, the image of the target object is retrieved from the transfer area and pasted to the clicked second location.

[0100] Please refer to Figure 2(c), which is a logical schematic diagram of the display of the target object's gravitational wave effect during a content interaction process in an embodiment of the present application.

[0101] In this embodiment, the first application and the second application belong to the same electronic device, and the first application and the second application may be the same or different. In the process of the first electronic device sending the target object and the second electronic device receiving the target object, a gravitational wave effect will be displayed. The gravitational wave effect is used to indicate the outward movement trend of the target object on the first electronic device on the sending side and to indicate the inward movement trend of the target object on the second electronic device on the receiving side. Therefore, during the transmission of the target object, a dynamic effect of transmission and reception echoing each other based on the gravitational waves at the sending end and the gravitational waves at the receiving end will appear.

[0102] For example, FIG2(c) shows the dynamic logic implementation diagrams of the transmitting side and the receiving side, respectively, wherein the left side of the figure is the dynamic logic implementation diagram of the transmitting side, and the right side is the dynamic logic implementation diagram of the receiving side.

[0103] The thumbnail center points C1 and C2 are the positions selected by a finger, stylus, or mouse, where C1 is the center of the first position selected on the transmitting side, and C2 is the center of the second position selected on the receiving side. As can be seen from the "object disappearance" image on the left, the diameter of the initial concentric circle of the image is M, which is also the range where the gravitational wave initially shrinks, and m is the width of the thumbnail when the thumbnail is dragged. At the first position on the transmitting side, the dynamic range of the gravitational wave is Mm, and the gravitational wave appears in a contracted state within this range; as can be seen from the "object appearance" image on the right side of the figure, the diameter of the target object at the first appearance is n. As the gravitational wave continues to spread outward under the action of the gravitational wave, the maximum diameter of the gravitational wave is N. At the second position on the receiving side, the dynamic range of the gravitational wave is Nn, and the gravitational wave appears in an expanded state within this range.

[0104] Among them, the gravitational wave effect at the first position on the sending side and the gravitational wave dynamic effect at the second position on the receiving side are displayed simultaneously and echo each other. At the same time that the target object dynamically disappears at the first position of the first application on the sending side, it is dynamically displayed at the second position of the second application on the receiving side. Specifically, on the sending side, when the target object is small, the concentric circles are gradually displayed from the outside to the inside, and the closer to the outside, the higher the transparency of the concentric circles; while on the receiving side, the closer to the circle, the higher the transparency. Even on the same device, due to the different sizes of the application windows, the maximum radius of the concentric circles on the sending and receiving sides can be different, which is specifically determined by the size of the target object, the target object displayed on the receiving application, or the mirror image of the target object.

[0105] In one possible implementation of this embodiment, a confirmation input is used to trigger the transfer of the object to the transfer zone. For example, if the confirmation input is a throwing gesture, the target object is transferred to the transfer zone after both the selection of the target object and the throwing gesture are detected. The throwing gesture is recognized as a touch trace sliding in a certain direction, with the touch pressure gradually decreasing along the sliding direction.

[0106] In this embodiment, in order to better reflect the transmission process of the target object in this scheme, the gravitational wave dynamic effects on the re-transmitting side and the receiving side shown in Figure 2(c) can also be used. The specific implementation method is as described in the above embodiment and will not be elaborated here.

[0107] Refer to Figure 3, which is a schematic diagram of content interaction between different electronic touch screen devices connected to the same local area network, provided in an embodiment of the present application. This embodiment of the present application provides a method for transmitting objects between different electronic devices within a local area network, wherein both the first electronic device and the second electronic device have a screen, and the screen is a touch screen.

[0108] In this embodiment, the first electronic device is a sending device, the second electronic device is a receiving device, and the first electronic device and the second electronic device are located in the same local area network. First, a first operation is detected at a first position of the first electronic device (a certain position in the first application window), and the first position displays a target object. The first operation is used to indicate the acquisition of the target object, the link address of the target object, or the mirror image of the target object. At the same time, when the first operation is detected, a third operation is also detected. The third operation can be one of copy, move, or cut. The third operation is used to perform a corresponding operation on the target object to complete the copy, move, or cut of the target object. Similarly, after the completion of the third operation is detected, the content obtained by the third operation will be transferred to a transfer area. For different electronic devices, the transfer area is a cross-device transfer area, which is used to temporarily cache content information for interaction or transmission. After the second electronic device detects the read input, a second position is determined. The second position is used to specify the target position to which the target object is to be transferred. The second position is located in the second application window.

[0109] In a possible implementation of this embodiment, when the content in the transfer area is not empty and before a read input gesture is detected on the second electronic device, all operations other than the read input gesture or operation are prohibited on the second electronic device so that the current content transfer process is not interrupted.

[0110] In one possible implementation of this embodiment, the content in the cross-device transfer area is regularly cleared, and its temporary storage period can be 5 seconds or 10 seconds, or the user can set a fixed value to implement the cache duration setting function. In one possible implementation, when the content in the transfer area is empty, the input reading gesture on the second electronic device will be prohibited, or the input reading gesture will continue to be executed until the content obtained from the cross-device transfer area is empty, at which time the input reading gesture will become invalid.

[0111] In a possible implementation of this embodiment, when an input reading gesture is detected, the target object at the first position is presented as a dynamic image and produces a dynamic change effect, and finally slowly disappears in the form of concentric circles; the target object at the second position is also presented as a dynamic image and produces a dynamic change effect, and finally slowly appears in the form of concentric circles.

[0112] In this embodiment, the first electronic device is a local device, that is, a sending side device, and the second electronic device is a local external device in a local area network, that is, a receiving side device. The first electronic device transmits the target object to the cross-device transfer area by detecting that the target object is selected and recognizing the throwing gesture (the touch track slides in a certain direction, and the touch pressure gradually decreases along the sliding direction). In one possible implementation, the first electronic device not only sends the target object to the cross-device transfer area, but also sends it to the local application transfer area. After the cross-device transfer area receives the target object, it transmits the target object to the second electronic device in the local area network through the communication module in a local area network broadcast manner. After the second electronic device receives it, it stores the target object in the cross-device transfer area of ​​the second electronic device or the local application transfer area. In one possible implementation, the first electronic device can actively send the target object to the cross-device transfer area of ​​the second electronic device in the same local area network. The second electronic device can actively obtain the target object from the cross-device transfer area when detecting the read input.

[0113] When the second electronic device detects a read input (using a stylus hovering as an example), it determines the location of the input focus and then determines the receiving application based on the location of the input focus. If the input focus falls within an application window, the application corresponding to that application window is the receiving application. If there are multiple application windows corresponding to the focus location, that is, multiple application windows overlap, the application corresponding to the topmost application window (layer) is determined as the receiving application.

[0114] In one possible implementation of this embodiment, the read input can reuse other common inputs, such as hovering and clicking in this embodiment. In this solution, to prevent misoperation, after detecting a preset gesture, the electronic device can disable other operations corresponding to the read input on the current interface or globally in the system, so that the read input is only used to trigger reading of the transfer area.

[0115] In this embodiment, in order to better reflect the transmission process of the target object in this scheme, the gravitational wave dynamic effects on the re-transmitting side and the receiving side shown in Figure 2(c) can also be used. The specific implementation method is as described in the above embodiment and will not be elaborated here.

[0116] Please refer to Figure 4, which is a schematic diagram of content interaction between different electronic touch screen devices logged into the same account, provided in an embodiment of the present application. This embodiment of the present application provides a method for transferring objects between two external electronic devices logged into the same account, wherein both the first electronic device and the second electronic device have screens, and the screens are touch screens.

[0117] In this embodiment, the first electronic device is a sending device, the second electronic device is a receiving device, and the first electronic device and the second electronic device are logged in with the same account. First, a first operation is detected at a first position of the first electronic device (a certain position in the first application window). There is a target object at the first position. The first operation is used to indicate the acquisition of the target object, the connection address of the target object, or the mirror image of the target object. At the same time, when the first operation is detected, a third operation is also performed. The third operation can be one of copy, move, or cut. The third operation is used to perform a corresponding operation on the target object to complete the copy, move, or cut of the target object. Similarly, after the completion of the third operation is detected, the content obtained by the third operation will be transmitted to a transfer area. For different electronic devices logged in with the same account, the transfer area is a cloud transfer area, which is used to temporarily cache content information for interaction or transmission. After the second electronic device detects the read input, it determines a second position. The second position is used to specify the target position to which the target object is to be transferred. The second position is located in the second application window.

[0118] In a possible implementation of this embodiment, when the content in the transfer area is not empty and before a read input gesture is detected on the second electronic device, all operations other than the read input gesture or operation are prohibited on the second electronic device so that the current content transfer process is not interrupted.

[0119] In one possible implementation of this embodiment, the content in the cloud transfer area is regularly cleared, and its temporary storage period can be 5 seconds or 10 seconds. Alternatively, the user can set a fixed value to implement a caching period setting function. In one possible implementation, when the content in the transfer area is empty, the input reading gesture on the second electronic device will be prohibited, or the input reading gesture will continue to be executed until the content obtained from the cross-device transfer area is empty, at which point the input reading gesture will become invalid.

[0120] In a possible implementation of this embodiment, when an input reading gesture is detected, the target object at the first position is presented as a dynamic image and produces a dynamic change effect, and finally slowly disappears in the form of concentric circles; the target object at the second position is also presented as a dynamic image and produces a dynamic change effect, and finally slowly appears in the form of concentric circles.

[0121] In this embodiment, the first electronic device is a local device, that is, a sending side device, and the second electronic device is an external electronic device that is logged in to the same account as the first electronic device, and is also a receiving side device. The first electronic device transmits the target object to the cloud cache by detecting that the target object is selected and recognizing the throwing gesture (the touch trajectory slides along a certain direction, and the touch pressure gradually decreases along the sliding direction). The first electronic device will synchronously send a notification signal to the cloud, and the notification signal will be sent via the cloud to all online devices logged in to the current account to notify the online devices that the cloud transfer area is available. In one possible implementation method, the first electronic device sends the target object to the cloud transfer area, and the cloud transfer area will also synchronously send the target object to all online devices under the account; in another implementation method, the first electronic device sends the target object to the cloud transfer area, and the cloud transfer area notifies all online devices of the account that the cloud transfer area is available. When the second electronic device detects the read input, it actively goes to the cloud transfer area to obtain the target object.

[0122] When the second electronic device detects a read input (using a stylus hovering as an example), it determines the location of the input focus and then determines the receiving application based on the location of the input focus. If the input focus falls within an application window, the application corresponding to that application window is the receiving application. If there are multiple application windows corresponding to the focus location, that is, multiple application windows overlap, the application corresponding to the topmost application window (layer) is determined as the receiving application.

[0123] In one possible implementation of this embodiment, the read input can reuse other common inputs, such as hovering and clicking in this embodiment. In this solution, to prevent misoperation, after detecting a preset gesture, the electronic device can disable other operations corresponding to the read input on the current interface or globally in the system, so that the read input is only used to trigger reading of the transfer area.

[0124] In this embodiment, in order to better reflect the transmission process of the target object in this scheme, the gravitational wave dynamic effects on the re-transmitting side and the receiving side shown in Figure 2(c) can also be used. The specific implementation method is as described in the above embodiment and will not be elaborated here.

[0125] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0126] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, training equipment or data center to another website, computer, training equipment or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a training equipment, data center, etc. that includes one or more available media integrations. Available media can be magnetic media, (e.g., floppy disk, hard disk, tape), optical media (e.g., DVD), or semiconductor media (e.g., solid-state drive (SSD)), etc.

Claims

1. A content delivery method, characterized in that, Including: Detecting a first operation, and obtaining first information of a target object, where the first information of the target object includes at least one of the target object, a link address of the target object, or an image of the target object; Detecting a second operation, determining a second position, and displaying the target object at the second position.

2. The method according to claim 1, characterized in that The obtaining the first information of the target object includes: Detecting the first operation, performing a third operation to obtain the first information of the target object, and transmitting the first information of the target object to a transfer area, where the third operation is one of copying, moving, or cutting, and the transfer area is one of a local transfer area, a cross-device transfer area, or a cloud transfer area.

3. The method according to claim 1, characterized in that, The detecting the second operation and determining the second position includes: Detecting the second operation, obtaining the first information of the target object from the transfer area, and displaying it at the second position.

4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: The first position and the second position are within the same application window.

5. The method according to any one of claims 1 to 3, characterized in that The method further includes: The first position is within the first application window, the second position is within the second application window, and the first application window and the second application window are displayed on the screen of the same electronic device.

6. The method according to any one of claims 1-5, characterized in that, The method further includes: Detecting the first operation, a first dynamic image is displayed at the first position, the first dynamic image includes a plurality of concentric circles with different radii, and the plurality of concentric circles sequentially present at least one of the following changes from the outside to the inside: changing from opaque to transparent, changing from white to black and then to white; In response to the second operation, a second dynamic image is displayed at the second position, the second dynamic image includes a plurality of concentric circles with different radii, and the plurality of concentric circles present at least one of the following changes from the inside to the outside: changing from transparent to opaque, changing from white to black and then to white.

7. The method according to any one of claims 1-6, characterized in that, The method further includes: Detecting that the transfer area is not empty, and the second operation is only used to indicate obtaining the first information of the target object from the transfer area.

8. The method according to any one of claims 1-7, characterized in that, The target object includes at least one of text, image, audio, video, document, folder, and web address.

9. A content delivery method, characterized in that, Applied to a first electronic device, including: Detecting a first operation, and obtaining first information of the target object, where the first information of the target object includes at least one of the target object, a link address of the target object, or an image of the target object.

10. The method according to claim 9, wherein The obtaining the first information of the target object includes: Detecting the first operation, performing a third operation to obtain the first information of the target object, and transmitting the first information of the target object to a transfer area, where the third operation is one of copying, moving, or cutting, and the transfer area is one of a local transfer area, a cross-device transfer area, or a cloud transfer area.

11. The method according to claim 9, wherein The method further includes: Detecting the first operation, a first dynamic image is displayed at the first position, the first dynamic image includes a plurality of concentric circles with different radii, and the plurality of concentric circles present at least one of the following changes from the outside to the inside: changing from opaque to transparent, changing from white to black and then to white color.

12. The method according to any one of claims 9 - 11, characterized in that, The target object includes at least one of text, image, audio, video, document, folder, and web address.

13. A content delivery method, characterized in that, Applied to a second electronic device, it includes: Upon detecting a second operation, determining a second position and displaying the target object at the second position.

14. The method according to claim 13, wherein The method further includes: Upon detecting the second operation, obtaining first information of the target object from the transfer area and displaying it at the second position.

15. The method according to claim 13, characterized in that, The method further includes: Upon detecting the second operation, a second dynamic image is displayed at the second position. The second dynamic image includes multiple concentric circles with different radii, and the multiple concentric circles present at least one of the following changes from the inside out: changing from transparent to opaque, changing from white to black and then back to white.

16. The method according to claim 13, wherein The method further includes: Upon detecting that the transfer area is not empty, the second operation is only used to indicate receiving the first information of the target object.

17. The method according to any one of claims 13-16, characterized in that, The target object includes at least one of text, image, audio, video, document, folder, and web address.

18. A device for transmitting content, characterized in that, It includes: A detection module for detecting a first operation and a second operation; A processing module for, in response to the first operation, obtaining first information of the target object, where the first information of the target object includes at least one of the target object, the link address of the target object, or the mirror image of the target object; The processing module is further configured to, in response to the second operation, determine a second position and display the target object at the second position; Wherein, the target object includes at least one of text, image, audio, video, document, folder, and web address.

19. A device for transmitting content, characterized in that, It includes: A detection module for detecting a first operation; A processing module for, in response to the first operation, obtaining first information of the target object, where the first information of the target object includes at least one of the target object, the link address of the target object, or the mirror image of the target object; Wherein, the target object includes at least one of text, image, audio, video, document, folder, and web address.

20. A device for receiving transmitted content, characterized in that, It includes: A detection module for detecting a second operation; A processing module for, in response to the second operation, determining a second position and displaying the target object at the second position; Wherein, the target object includes at least one of text, image, audio, video, document, folder, and web address.

21. A computer-readable storage medium, characterized in that, It includes computer instructions that, when running on a computer system, cause the computer system to implement the human-computer interaction method described in any one of claims 1-8 or 9-12 or 13-17.

22. An electronic device, characterized in that, It includes a processor, the processor is coupled to a memory, and the processor is used to store instructions. When the instructions are executed by the processor, the electronic device is caused to execute the method described in any one of claims 1-8 or 9-12 or 13-17.

23. A computer program product, comprising instructions therein, characterized in that, When the instructions are executed, the computer is caused to implement the method described in any one of claims 1-8 or 9-12 or 13-17.

Citation Information

Patent Citations

  • Using a gesture to transfer an object across multiple multi-touch devices

    CN102725723A

  • Method and equipment for calling information between application programs

    CN114003158A

  • Cross-screen control method and device

    CN115390741A

  • Method and system of mobile virtual desktop and virtual trackball therefor

    US20120192078A1