Interaction method, interaction apparatus, electronic device, and storage medium

Abstract

An interaction method, an interaction apparatus, an electronic device, and a storage medium. The interaction method comprises: determining a user intention; performing signal connection between a first terminal and a second terminal; and on the basis of the user intention, executing an interaction operation between the first terminal and the second terminal. The method is used for implementing interaction operations such as intelligent screen projection and file transmission among a plurality of terminals, and can, on the basis of identified user intentions, provide a user with a prompt for whether to perform interaction operations, thereby reducing manual operations by the user for initiating these interaction operations, improving the convenience, stability, and level of intelligence of the execution of the interaction operations among the plurality of terminals, and providing the user with a better use experience.

Description

Interaction methods, interaction devices, electronic devices and storage media Technical Field

[0001] At least one embodiment of this disclosure relates to an interaction method, interaction device, electronic device, and storage medium. Background Technology

[0002] With the continuous development of technology, interconnectivity between multiple terminal devices has become an important requirement in modern life. Among multiple terminal devices, the screen mirroring function of electronic software has received widespread attention because it enables the sharing and transmission of screen content. Additionally, file sharing can be achieved by transferring files between interconnected terminal devices.

[0003] However, existing screen mirroring technologies still have shortcomings in several aspects and cannot meet the growing needs of users. How to make screen mirroring technology faster, more convenient, and able to meet users' diverse needs for screen mirroring functions, as well as how to improve the ease of transferring files between multiple interconnected terminal devices, has become a research direction. Summary of the Invention

[0004] At least one embodiment of this disclosure provides an interaction method, the interaction method comprising: determining a user intent; signal connecting a first terminal and a second terminal; and performing an interaction operation between the first terminal and the second terminal according to the user intent.

[0005] For example, in at least one embodiment of the interaction method provided in this disclosure, the user's intention is to project a target file from the first terminal to the second terminal, and the interaction operation includes projecting the target file from the first terminal to the second terminal.

[0006] For example, in at least one embodiment of the interaction method provided in this disclosure, the method of determining the user's intent includes at least one of the following methods:

[0007] The user's intent is determined by identifying that the content viewed or selected by the user on the first terminal is of a specific type.

[0008] By analyzing users' daily usage habits and preferences, the screen-sharing needs of the users in specific scenarios at specific times can be predicted to determine the users' intentions.

[0009] The user's intent is determined in response to the detection that the first terminal and the second terminal are connected to the same network or have established a Bluetooth or wireless network connection with each other;

[0010] The user's intent can be determined by recognizing specific gestures.

[0011] The user's intent is determined by analyzing the user's language commands through speech recognition; and

[0012] The user's intent is determined by detecting that the first terminal being operated by the user is in a specific environment, wherein the first terminal being in a specific environment includes the first terminal being in a specific location and / or the first terminal being connected to the second terminal.

[0013] For example, in the interaction method provided in at least one embodiment of this disclosure, after determining that the user's intention is to project the target file of the first terminal to the second terminal, the target file is determined based on the user's daily usage habits and preferences or based on the specific environment in which the first terminal is located.

[0014] For example, in at least one embodiment of the interaction method provided in this disclosure, projecting a target file from the first terminal to the second terminal includes: uploading the target file to a cloud relay station via the first terminal; and obtaining and displaying the target file from the cloud relay station via the second terminal.

[0015] For example, in at least one embodiment of the interaction method provided in this disclosure, projecting a target file from the first terminal to the second terminal further includes: during the process of the first terminal uploading the target file to the cloud relay station, detecting the format of the target file and encrypting the target file; establishing a connection between the second terminal and the cloud relay station; and

[0016] The second terminal obtains a unique file identifier generated by the system where the cloud relay station is located after the target file is uploaded to the cloud relay station, and accesses the target file uploaded to the cloud relay station based on the file identifier, wherein the file identifier is bound to the first terminal; or, the second terminal obtains information of the first terminal bound to the file identifier, and accesses the target file uploaded to the cloud relay station based on the information of the first terminal.

[0017] For example, in at least one embodiment of the interaction method provided in this disclosure, projecting the target file of the first terminal to the second terminal further includes: performing a processing operation on the target file in the cloud relay station through the first terminal; and updating the target file after the processing operation is performed to the second terminal, wherein the second terminal displays the target file after the processing operation is performed.

[0018] For example, in at least one embodiment of the interaction method provided in this disclosure, the user intent is to distribute files from the second terminal to a plurality of first terminals, and the interaction operation includes sending files from the second terminal to the plurality of first terminals.

[0019] For example, in at least one embodiment of the interaction method provided in this disclosure, the method of determining the user's intent includes at least one of the following methods:

[0020] In response to detecting that the content displayed on the second terminal has changed to a preset condition, the changed content is analyzed, and based on the analysis results of the changed content, it is determined that the user's intention is to distribute files from the second terminal to multiple first terminals;

[0021] By analyzing the set meeting time information, it is predicted that the meeting is about to end, and it is determined that the user's intention is to distribute files from the second terminal to multiple first terminals.

[0022] By detecting that a user's file operation behavior on the second terminal is an act with the intention of file distribution, it is determined that the user's intention is to distribute files from the second terminal to multiple first terminals. The act with the intention of file distribution includes at least one of the following: viewing the handwritten annotations displayed on the second terminal more than a preset frequency, saving the file, or exporting the file.

[0023] For example, in at least one embodiment of the interaction method provided in this disclosure, determining the user's intent to distribute files from the second terminal to multiple first terminals based on the analysis results of the changed content includes:

[0024] In response to recognizing that the changed content displayed on the second terminal is a meeting summary, it is determined that the meeting is about to end. It is also determined that the user's intention is to distribute files from the second terminal to multiple first terminals. The changed content includes content manually entered by the user. The user automatically analyzes the manually entered content and determines that the manually entered content is a meeting summary.

[0025] For example, in at least one embodiment of the interaction method provided in this disclosure, the distribution of files from the second terminal to a plurality of first terminals includes:

[0026] In response to determining that the user's intent is to distribute files from the second terminal to multiple first terminals, the files to be distributed are automatically collected and organized on the second terminal to generate a file list; and

[0027] The files in the file list are sent to multiple first terminals, and a file receiving prompt is displayed on each first terminal device.

[0028] For example, in at least one embodiment of the interaction method provided in this disclosure, the user's intention is to remotely annotate the second terminal, and the interaction operation includes remotely annotating the second terminal through the first terminal.

[0029] For example, in at least one embodiment of the interaction method provided in this disclosure, the method of determining the user's intent includes at least one of the following methods:

[0030] The user's intention is determined to be to remotely annotate the second terminal by recognizing the remote annotation command issued by the user.

[0031] By recognizing the changes in the device state of the first terminal caused by user operations, it can be determined that the user's intention is to remotely annotate the second terminal.

[0032] By analyzing the touch or gesture operations performed by the user on the first terminal, it is determined that the user's intention is to remotely annotate the second terminal; and

[0033] By analyzing the real-time meeting content displayed on the second terminal, it is determined that the user's intention is to remotely annotate the second terminal.

[0034] For example, at least one embodiment of the interaction method provided in this disclosure further includes: after determining the user's intention, automatically prompting the user whether they wish to perform an interaction operation between the first terminal and the second terminal.

[0035] For example, in at least one embodiment of the interaction method provided in this disclosure, the step of signaling the first terminal and the second terminal includes: the second terminal generating a unique identifier that identifies the identity information of the second terminal and sending the unique identifier signal; the first terminal receiving and recognizing the unique identifier signal and parsing the unique identifier signal; and the first terminal automatically signaling to the second terminal according to the parsing result of the unique identifier signal, wherein, after the first terminal and the second terminal are signaled connected, the interaction operation between the first terminal and the second terminal is allowed to be performed.

[0036] For example, in at least one embodiment of the interaction method provided in this disclosure, the second terminal sends network information it has accessed, or generates and transmits wireless network information or hotspot information; the signal connection between the first terminal and the second terminal further includes: the first terminal acquiring network information associated with the second terminal, wherein the network information associated with the second terminal includes one of the network information accessed by the second terminal, wireless network information transmitted by the second terminal, and hotspot information transmitted by the second terminal; the first terminal connecting to the network associated with the second terminal according to the network information associated with the second terminal; and after the first terminal connects to the network associated with the second terminal, the first terminal automatically connects to the second terminal according to the parsing result of the unique identifier signal.

[0037] For example, in at least one embodiment of the interaction method provided in this disclosure, the step of connecting the first terminal and the second terminal by signal further includes: encrypting the unique identifier; and allowing the first terminal to obtain the key used to encrypt the unique identifier, wherein the first terminal obtains network information associated with the second terminal based on the key.

[0038] For example, in the interaction method provided in at least one embodiment of this disclosure, the first terminal is a first display device, the second terminal is a second display device, and the size of the display screen of the first display device is smaller than the size of the display screen of the second display device.

[0039] At least one embodiment of this disclosure also provides an interaction method, the interaction method comprising: determining a user intention through a first terminal, wherein the first terminal is signal-connected to a second terminal; and the first terminal performing an interaction operation with the second terminal according to the user intention.

[0040] For example, in at least one embodiment of the interaction method provided in this disclosure, the user's intention is to project a target file from the first terminal to the second terminal, and the interaction operation includes projecting the target file from the first terminal to the second terminal.

[0041] For example, in at least one embodiment of the interaction method provided in this disclosure, the method of determining the user's intent through the first terminal includes at least one of the following methods:

[0042] The user's intent is determined by identifying that the content viewed or selected by the user on the first terminal is of a specific type.

[0043] By analyzing users' daily usage habits and preferences, the screen-sharing needs of the users in specific scenarios at specific times can be predicted to determine the users' intentions.

[0044] The user's intent is determined in response to the detection that the first terminal and the second terminal operated by the user are connected to the same network or have established a Bluetooth or wireless network connection with each other.

[0045] The user's intent can be determined by recognizing specific gestures.

[0046] The user's intent is determined by analyzing the user's language commands through speech recognition; and

[0047] The user's intent is determined by detecting that the first terminal being operated by the user is in a specific environment, wherein the first terminal being in a specific environment includes the first terminal being in a specific location and / or the first terminal being connected to the second terminal.

[0048] For example, in at least one embodiment of the interaction method provided in this disclosure, the user's intention is to remotely annotate the second terminal, and the interaction operation includes remotely annotating the second terminal through the first terminal.

[0049] For example, in at least one embodiment of the interaction method provided in this disclosure, the method of determining the user's intent through the first terminal includes at least one of the following methods:

[0050] The user's intention is determined to be to remotely annotate the second terminal by recognizing the remote annotation command issued by the user.

[0051] By recognizing the changes in the device state of the first terminal caused by user actions, it is determined that the user's intention is to remotely annotate the second terminal; and

[0052] By analyzing the touch or gesture operations performed by the user on the first terminal, it is determined that the user's intention is to remotely annotate the second terminal.

[0053] At least one embodiment of this disclosure provides an interaction method, the interaction method comprising: determining a user intention through a second terminal, wherein the first terminal and the second terminal are signal-connected; and the second terminal performing an interaction operation with the first terminal according to the user intention.

[0054] For example, in at least one embodiment of the interaction method provided in this disclosure, the user intent is to distribute files from the second terminal to a plurality of first terminals, and the interaction operation includes sending files from the second terminal to the plurality of first terminals.

[0055] For example, in at least one embodiment of the interaction method provided in this disclosure, the method of determining the user's intent includes at least one of the following methods:

[0056] In response to the management system of the second terminal detecting that the content displayed on the second terminal has changed to a preset condition, the management system analyzes the changed content and determines, based on the analysis results, that the user's intention is to distribute files from the second terminal to multiple first terminals.

[0057] The management system analyzes the set meeting time information to predict that the meeting is about to end and determines that the user's intention is to distribute files from the second terminal to multiple first terminals.

[0058] The management system detects that a user's file operation behavior on the second terminal is an act with the intention of file distribution, and determines that the user's intention is to distribute files from the second terminal to multiple first terminals. The acts with the intention of file distribution include at least one of the following: viewing the handwritten annotations displayed on the second terminal more than a preset frequency, saving the file, or exporting the file.

[0059] For example, in at least one embodiment of the interaction method provided in this disclosure, the user intent is to remotely annotate the second terminal, and the interaction operation includes remotely annotating the second terminal through the first terminal; the method of determining the user intent through the second terminal includes: analyzing the real-time meeting content displayed on the second terminal through the management system of the second terminal to determine that the user intent is to remotely annotate the second terminal.

[0060] At least one embodiment of this disclosure also provides an interactive device, which includes a first intent analysis module and a first execution module. The first intent analysis module is configured to analyze user operations of a first terminal to identify user intent, wherein the first terminal is signal-connected to a second terminal; the first execution module is configured to execute interactive operations between the first terminal and the second terminal according to the user intent.

[0061] At least one embodiment of this disclosure also provides another interactive device, which includes: a second intent analysis module and a second execution module. The second intent analysis module is configured to analyze user operations of a second terminal to identify user intent, and a first terminal and a second terminal are connected by a signal; the second execution module is configured to execute interactive operations between the second terminal and the first terminal according to the user intent.

[0062] At least one embodiment of this disclosure also provides an electronic device, including a processor, a memory, and one or more computer program modules. The one or more computer program modules are stored in the memory and configured to be executed by the processor, and the one or more computer program modules include instructions for performing an interactive method that implements any of the interactive methods provided in the embodiments of this disclosure.

[0063] At least one embodiment of this disclosure also provides a storage medium that non-transitory stores computer-readable instructions that, when executed by a computer, can perform any of the interactive methods provided in the embodiments of this disclosure. Attached Figure Description

[0064] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings of the embodiments will be briefly described below. Obviously, the drawings described below only relate to some embodiments of this disclosure and are not intended to limit this disclosure.

[0065] Figure 1 is a flowchart of an interaction method provided in an embodiment of this disclosure;

[0066] Figure 2 is a flowchart of a method for signal connection between a first terminal and a second terminal in an interaction method provided in an embodiment of the present disclosure;

[0067] Figure 3 is a flowchart of a method for projecting the screen of a first terminal onto a second terminal in an interactive method provided in an embodiment of this disclosure;

[0068] Figure 4 is a schematic diagram showing the relationship between the first terminal, the second terminal, and the server involved in the interaction method provided in at least one embodiment of this disclosure;

[0069] Figures 5 and 6 are schematic diagrams of two working modes of the cloud transfer station, respectively;

[0070] Figures 7 and 8 are partial display interface diagrams of the process of uploading the target file of the first terminal to the cloud transfer station;

[0071] Figure 9 is a flowchart of a method for projecting a target file from a first terminal to a second terminal in an interactive method provided in an embodiment of this disclosure.

[0072] Figure 10a is a schematic block diagram of an interactive device provided in an embodiment of the present disclosure;

[0073] Figure 10b is a schematic block diagram of an interactive device provided in an embodiment of this disclosure;

[0074] Figure 11 is a schematic block diagram of an electronic device provided in at least one embodiment of the present disclosure;

[0075] Figure 12 is a schematic block diagram of another electronic device provided in at least one embodiment of the present disclosure;

[0076] Figure 13 is a schematic diagram of a storage medium provided in at least one embodiment of the present disclosure. Detailed Implementation

[0077] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. The embodiments described below are some, but not all, embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the described embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0078] Unless otherwise defined, the technical or scientific terms used herein should be understood in their ordinary sense by one of ordinary skill in the art to which this invention pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, terms such as “comprising” or “including” indicate that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. Terms such as “connected” or “linked” are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as “upper,” “lower,” “left,” and “right” are used only to indicate relative positional relationships, and these relative positional relationships may change accordingly when the absolute position of the described object changes.

[0079] First, traditional screen mirroring methods often require data cables or other wired connections, which not only limits the mobility between devices but also increases the complexity of operation. Furthermore, wired connections are easily limited by factors such as cable length and interface compatibility, affecting the flexibility and stability of screen mirroring.

[0080] Secondly, regarding wireless screen mirroring technology, although various methods have been proposed, such as Wi-Fi Direct, Miracast, and AirPlay, these technologies often require establishing complex connections between devices and suffer from compatibility issues. Furthermore, the stability and transmission speed of wireless screen mirroring technology are affected by the network environment, making it difficult to meet the demands for high-definition and smooth screen mirroring.

[0081] Furthermore, existing screen-sharing technologies lack intelligent features and cannot automatically recognize the user's screen-sharing intent, resulting in inconvenient operation. Often, each screen-sharing session requires the user to manually connect to the target device and open the screen-sharing software. For example, in scenarios such as meeting rooms, frequent screen-sharing operations and switching between screen-sharing modes are often necessary. Existing screen-sharing methods often require users to manually select the screen-sharing device and set screen-sharing parameters, which is not only cumbersome but also affects meeting efficiency.

[0082] In addition, for other interactive operations between interconnected terminal devices, such as transferring files to share files on one terminal device across multiple terminal devices, manual operation is often required to select and organize the files to be transferred and send the files to other devices. It cannot automatically recognize the user's intention to share files, is not intelligent enough, and the operation steps are cumbersome, which affects the efficiency of performing file sharing functions.

[0083] At least one embodiment of this disclosure provides an interaction method, the interaction method comprising: determining a user intent; signal connecting a first terminal and a second terminal; and performing an interaction operation between the first terminal and the second terminal according to the user intent.

[0084] The interaction method provided in this disclosure can be used to realize interactive operations such as intelligent screen projection and file transfer between multiple terminals. According to the interaction method provided in this disclosure, based on the recognition of user intent, interactive operations between multiple terminals are automatically executed according to the user intent. This enables fast, stable, and intelligent screen projection operations between multiple terminals. Furthermore, it can provide the user with prompts regarding whether to perform interactive operations based on the recognized user intent, reducing the manual operations required to initiate these interactive operations and improving the convenience, stability, and intelligence of performing interactive operations between multiple terminals, thus providing a better user experience.

[0085] At least one embodiment of this disclosure provides an interaction method, the interaction method comprising: determining a user intent through a first terminal, wherein the first terminal is signal-connected to a second terminal; and the first terminal performing an interaction operation with the second terminal according to the user intent.

[0086] At least one embodiment of this disclosure provides an interaction method, the interaction method comprising: determining a user intention through a second terminal, wherein the first terminal and the second terminal are signal-connected; and the second terminal performing an interaction operation with the first terminal according to the user intention.

[0087] At least one embodiment of this disclosure also provides an interactive device, which includes a first intent analysis module and a first execution module. The first intent analysis module is configured to analyze user operations of a first terminal to identify user intent, wherein the first terminal is signal-connected to a second terminal; the first execution module is configured to execute interactive operations between the first terminal and the second terminal according to the user intent.

[0088] At least one embodiment of this disclosure also provides another interactive device, which includes: a second intent analysis module and a second execution module. The second intent analysis module is configured to analyze user operations of a second terminal to identify user intent, and a first terminal and a second terminal are connected by a signal; the second execution module is configured to execute interactive operations between the second terminal and the first terminal according to the user intent.

[0089] At least one embodiment of this disclosure also provides an electronic device, including a processor, a memory, and one or more computer program modules. The one or more computer program modules are stored in the memory and configured to be executed by the processor, and the one or more computer program modules include instructions for performing an interactive method that implements any of the interactive methods provided in the embodiments of this disclosure.

[0090] At least one embodiment of this disclosure also provides a storage medium for non-temporarily storing computer-readable instructions that, when executed by a computer, can perform any of the interactive methods provided in the embodiments of this disclosure.

[0091] For example, FIG1 is a flowchart of an interaction method provided in an embodiment of the present disclosure. Referring to FIG1, the interaction method includes steps S1 to S3.

[0092] S1: Determine user intent.

[0093] S2: Connect the first terminal and the second terminal via signal; and

[0094] S3: Perform interactive operations between the first terminal and the second terminal according to the user's intent.

[0095] The interaction method provided in this disclosure can be used to realize interactive operations such as intelligent screen projection and file transfer between multiple terminals. According to the interaction method provided in this disclosure, based on the recognition of user intent, interactive operations between multiple terminals are automatically executed according to the user intent, enabling fast, stable, and intelligent screen projection operations between multiple terminals.

[0096] For example, this interaction method also includes automatically prompting the user whether they wish to perform an interactive operation between the first terminal and the second terminal after determining the user's intent. Thus, it can provide the user with prompts regarding whether to perform an interactive operation based on the identified user intent, reducing the manual operations required to initiate these operations and improving the convenience, stability, and intelligence of performing interactive operations between multiple terminals, thereby providing a better user experience.

[0097] The order of steps S1 and S2 is not fixed as shown in Figure 1. For example, in other embodiments, step S2 can be executed first, followed by step S1.

[0098] For step S1, depending on the different intent recognition scenarios and methods, the user intent can be determined by the built-in system of the first terminal or the second terminal, or by a cloud-based system, such as a management system connected to the first terminal signal or a management system connected to the second terminal signal.

[0099] The executing entity of step S2 may include a first terminal and a second terminal, which cooperate to achieve signal connection with each other. Alternatively, the executing entity of step S2 may be the first terminal, whose control module can control its signal connection with the second terminal; or the executing entity of step S2 may be the second terminal, whose control module can control its signal connection with the first terminal.

[0100] Situations where the first and second terminals are connected include situations where they are connected to the same network, such as the same local area network (LAN), including wired connections or wireless connections, or one of the terminals accessing the other's Wi-Fi or hotspot. Situations where the first and second terminals are connected also include situations where each terminal establishes a connection with a cloud relay station to enable screen mirroring from the first terminal to the second terminal or file distribution from the second terminal to the first terminal. For example, the cloud system can automatically search for and identify available second terminals in the vicinity and establish a signal connection between the first and second terminals, or the second terminal can be manually connected to the first terminal. The specific process of connecting the first and second terminals is described in the following section on the connection process.

[0101] Depending on the scenario, the executing entity of step S3 can be either the first terminal or the second terminal. For example, when the user's intention is to project a target file from the first terminal to the second terminal, the executing entity of step S3 is the first terminal (including the hardware device of the first terminal and / or the server connected to the first terminal by a signal). The first terminal performs the interaction operation with the second terminal according to the user's intention, that is, the first terminal projects the target file from the first terminal to the second terminal according to the user's intention. For example, when the user's intention is to distribute files from the second terminal to multiple first terminals, the executing entity of step S3 is the second terminal (including the hardware device of the second terminal and / or the server connected to the second terminal by a signal). The second terminal performs the interaction operation with the first terminal according to the user's intention, that is, the second terminal distributes files to multiple first terminals according to the user's intention. The specific process of executing the interaction operation between the first terminal and the second terminal in different scenarios is described in the following description of specific embodiments.

[0102] For example, Figure 2 is a flowchart of a method for signal connecting a first terminal and a second terminal in an interaction method provided in an embodiment of this disclosure. Referring to Figure 2, signal connecting the first terminal and the second terminal includes the following steps S21 to S23.

[0103] S21: The second terminal generates a unique identifier that identifies the second terminal and sends the unique identifier signal.

[0104] S22: The first terminal receives and identifies the unique identifier signal, and parses the unique identifier signal.

[0105] For example, the unique identifier signal can be parsed using the control module of the first terminal.

[0106] S23: The first terminal automatically connects to the second terminal based on the parsing result of the unique identifier signal. After the first terminal and the second terminal are connected, interactive operations between the first terminal and the second terminal are allowed.

[0107] The parsing result of the unique identifier signal includes the network connection information of the second terminal, including the name and password of the network accessed by the second terminal.

[0108] Therefore, the second terminal is tagged using a unique identifier. The second terminal can be the only device to be connected in the current scenario, or there can be multiple second terminal devices in the current scenario. Each second terminal device has a corresponding unique identifier, so that the first terminal can select the second terminal device with characteristics to connect based on the unique identifier.

[0109] For example, it is necessary to automatically connect the first terminal and the second terminal so that they can access the same network and enable interactive operations between them.

[0110] For example, in order to automatically connect the first terminal and the second terminal to the same network to achieve signal connection between them, the signal connection between the first terminal and the second terminal also includes the following steps S24 to S26.

[0111] S24: The first terminal obtains network information associated with the second terminal, wherein the network information associated with the second terminal includes one of the following: network information accessed by the second terminal, wireless network information transmitted by the second terminal, and hotspot information transmitted by the second terminal.

[0112] S25: The first terminal connects to the network associated with the second terminal based on the network information associated with the second terminal.

[0113] S26: After the first terminal connects to the network associated with the second terminal, the first terminal automatically connects to the second terminal based on the parsing result of the aforementioned unique identifier signal.

[0114] Specifically, during the signal connection process between the first terminal and the second terminal, the second terminal sends the network information it accesses, including the network name and password. Alternatively, during the signal connection process, the second terminal generates and transmits wireless network information or hotspot information. The second terminal encodes its accessed network information or hotspot information into a network signal (e.g., an ultrasonic signal), including the network name and password. The first terminal receives and parses this network signal. After receiving the ultrasonic signal, the first terminal's ultrasonic receiver transmits it to the control module. The control module of the first terminal, based on the parsed network connection information (i.e., the unique identifier signal), parses the network name and password, and then controls its own Wi-Fi module to automatically connect to the network associated with the second terminal. The network associated with the second terminal includes the network accessed by the second terminal, or the WiFi or hotspot emitted by the second terminal.

[0115] For example, the identifier signal can be sent out via a Wi-Fi module or other wireless communication technologies (such as Bluetooth, NFC, etc.). For instance, after a successful connection, the first terminal can send an acknowledgment signal to the second terminal, indicating that the connection was successful. Simultaneously, the second terminal can also display a connection success message on its display interface.

[0116] Therefore, it is possible to automatically connect the first terminal and the second terminal to the same network. In this case, the first terminal connects to the second terminal with a unique identifier to realize interactive operation between the first terminal and the specific second terminal identified by the unique identifier.

[0117] For example, establishing a signal connection between the first terminal and the second terminal also includes: encrypting a unique identifier; and allowing the first terminal to obtain the key used to encrypt the unique identifier, wherein the first terminal uses the key to obtain network information associated with the second terminal. Thus, only the first terminal holding the correct key can decipher the network information associated with the second terminal, thereby preventing unauthorized device connections.

[0118] For example, taking a meeting scenario where the first terminal and the second terminal need to be automatically connected to the same network to enable interactive operations such as screen projection and file distribution, the process of connecting the first terminal and the second terminal is explained.

[0119] For example, the first terminal is a small-screen device, and the second terminal is a large-screen device.

[0120] 1. Tag Generation and Transmission: In the conference room, the large-screen device (second terminal) generates its unique identifier through the tagging module and broadcasts the identifier through the Wi-Fi module or other wireless communication technologies (such as Bluetooth, NFC, etc.).

[0121] 2. Tag Recognition and Parsing: After the small-screen device (first terminal) enters the conference room, its tag recognition module begins to search for and receive surrounding identifier signals. Once a unique identifier from the large-screen device is recognized, the control module of the small-screen device will parse the identifier and obtain the network connection information of the large-screen device (such as network name, password, etc.).

[0122] 3. Automatic Network and Device Connection: The control module of the small-screen device automatically connects to the network where the large-screen device is located based on the parsed network connection information. If the network requires a password, the control module of the small-screen device will automatically enter the parsed password to connect. Afterward, the device connection is completed automatically, and the small screen can directly begin operations such as screen mirroring.

[0123] 4. Connection Confirmation and Feedback: Upon successful connection, the smaller screen device sends a confirmation signal to the larger screen device, indicating a successful connection. Simultaneously, the larger screen device displays a connection success message on its interface. If the connection fails, either the smaller screen device's system or the larger screen device's management system can provide an error message and allow the user to manually attempt to connect.

[0124] For example, multiple conference rooms can operate simultaneously, and each conference room's large-screen device has a different unique identifier. By using the unique identifier of the large-screen device, the small-screen device can select the large-screen device to connect to based on the unique identifier of each large-screen device.

[0125] For example, the system for small-screen devices can record the connection history between small-screen and large-screen devices, making it convenient for users to view and manage. At the same time, the system for small-screen devices can automatically optimize connection strategies based on historical records, improving connection success rates and efficiency.

[0126] Ultrasonic-assisted Wi-Fi connection is a near-field communication method that triggers Wi-Fi Direct. By carrying the necessary data for Wi-Fi Direct using sound waves, the other end can obtain information about Wi-Fi Direct usage, establish a Wi-Fi Direct channel, and transfer files. Alternatively, Bluetooth BLE broadcasting can be used for Wi-Fi Direct communication. This solution aims to quickly discover target devices using ultrasound or BLE broadcasting, and then achieve wireless communication between devices via Wi-Fi Direct technology. The entire process includes near-field communication (ultrasound or BLE broadcasting), Wi-Fi information exchange, and the establishment of a Wi-Fi Direct connection. Ultrasound and BLE broadcasting will be collectively referred to as near-field broadcasting below.

[0127] For example, the following steps are required to implement the above-described ultrasonic-assisted Wi-Fi connection scheme.

[0128] 1. Discovery of Near-Field Broadcasting

[0129] First, ensure that both the small-screen and large-screen devices support the near-field broadcast and Wi-Fi Direct functions we use, and are in a state where they can broadcast and receive broadcasts. Then, include device information and Wi-Fi Direct connection information (such as SSID and password) in the broadcast, and after encapsulation, it can be sent via near-field broadcast.

[0130] 2. Device pairing

[0131] After scanning for near-field broadcasts, the receiving device detects and identifies the device. If necessary, the receiving end can perform a reverse broadcast to establish a connection between the two ends, exchange identity information, and so on, ensuring communication security.

[0132] 3. Wi-Fi information exchange

[0133] The receiving end obtains WiFi configuration information through near-field broadcast, and the receiving device parses the WiFi configuration information to extract the SSID and password (or the encrypted hash of the password).

[0134] 4. Establishing a Wi-Fi Direct connection

[0135] The receiving device uses the parsed Wi-Fi information to connect to the designated Wi-Fi network. The receiving device can then confirm the connection via near-field broadcast or Wi-Fi broadcast. File transfers can then be made.

[0136] 5. Optimization Items

[0137] Near-field broadcast optimization: Optimize near-field broadcast content to ensure that it contains enough information for device identification while minimizing the size of broadcast packets to improve transmission efficiency.

[0138] Security considerations: Sensitive information such as Wi-Fi passwords should be encrypted or hashed to avoid direct exposure in BLE broadcasts.

[0139] Fault tolerance mechanisms and retransmission mechanisms should be considered to address potential packet loss issues in near-field broadcasting and ensure reliable transmission of WIFI configuration information.

[0140] Near-field broadcasting has a limited payload capacity and may not be able to directly transmit complete Wi-Fi configuration information (especially the password). Therefore, it needs to be processed through methods such as encryption, hashing, or fragmented transmission.

[0141] For example, when the second terminal is the only device in the application scenario, the following schemes 1 and 2 can be used to implement the tagging of the second terminal. Scheme 1 determines whether to assign a tag based on mutual identification between the second terminals. Scheme 2 verifies the validity of the current tag based on the message received by the first terminal.

[0142] Option 1

[0143] The second terminal uses wireless broadcasting to check for similar near-field broadcasts nearby. If a relevant near-field broadcast is received, an access point (AP) with a special name is activated. The first terminal, by scanning the SSID via WiFi, discovers the AP with the special name and thus recognizes the tagged device. However, in actual use, some special methods like ultrasonic broadcasts have relatively short ranges, while WiFi coverage is much wider. This can cause broadcasts to be unreceived, resulting in multiple hotspots being activated simultaneously, leading to tag failure.

[0144] The specific implementation process is as follows:

[0145] 1. Second terminal preparation: First, the second terminal needs to support BLE broadcast transmission and reception, and then carry its own device information in the broadcast.

[0146] 2. Near-Field Broadcast Transmission and Reception: The second terminal needs to continuously send near-field broadcasts containing its own device information. If a broadcast is received, it continues sending broadcasts. If no broadcast is received, it proceeds to the next step of WiFi hotspot processing.

[0147] 3. Enable WiFi Hotspot: When the second terminal cannot receive BLE broadcasts from other large screens, it can stop sending its own BLE broadcasts and enable a Wi-Fi hotspot. The hotspot name will then help the first terminal identify the tagged second terminal within the current scene. If it receives BLE broadcasts from other second terminals at this time...

[0148] 4. First terminal processing: The first terminal scans for the SSIDs of all WiFi networks in the area, identifies the second terminal by the SSID name, and then connects to the second terminal.

[0149] 5. Precautions: If this method is used, the SSID name and password of the second terminal's hotspot need to be predetermined to allow the first terminal to connect, which poses a security risk. An SSID name can be generated using a specific pattern, and the hotspot password can be generated based on this pattern. There are still differences in coverage between BLE broadcast and WiFi hotspots; it's possible that two second terminals might not receive the broadcast but both will activate their hotspots. For example, in a scenario where two meeting rooms A and B are adjacent, each with a second terminal, the wall might prevent BLE broadcast reception, but the first terminal can scan for hotspots on both sides simultaneously. In this case, a signal strength check can be added to identify the legitimate tag and connect to it. Alternatively, WiFi promiscuous mode can be used to replace BLE broadcast for broadcast transmission and reception to avoid this problem.

[0150] Option 2

[0151] The specific implementation process is as follows:

[0152] 1. Second terminal preparation: A device capable of sending and receiving BLE broadcasts is required. BLE broadcasts need to be sent continuously, and the broadcasts need to carry device information, the SSID and password of the second terminal's hotspot, to facilitate connection by the first terminal.

[0153] 2. First terminal preparation: The first terminal needs to be able to receive BLE broadcasts and should be ready to receive them.

[0154] 3. The first terminal receives and parses the broadcast: After receiving the BLE broadcast, the first terminal parses the information of the second terminal, such as the second terminal's name, hotspot SSID, password, etc. If information about two or more devices is parsed at this time, the first terminal considers the tag invalid and the second terminal not the only device in this area, and will not connect. If only the information of a single device is found, the first terminal connects to the second terminal. Meanwhile, BLE broadcast reception continues; once multiple device information is parsed, the connection is interrupted.

[0155] 4. Precautions:

[0156] Security considerations: Sensitive information such as Wi-Fi passwords should be encrypted or hashed to avoid direct exposure in BLE broadcasts.

[0157] Fault tolerance mechanism: Consider implementing a retransmission mechanism to address potential packet loss issues in near-field broadcasting and ensure reliable transmission of Wi-Fi configuration information. BLE broadcasting has a limited payload and may not be able to directly transmit complete Wi-Fi configuration information (especially the password). Therefore, it needs to be processed through encryption, hashing, or fragmented transmission.

[0158] In summary, there are two approaches to implementing second-terminal tagging. One approach involves communication between second terminals to ensure no other second terminal exists in the area. Each second terminal then activates a tagged hotspot, declaring its own tag for that area. If another second terminal is detected in the area, it hides its tag. The second approach involves the second terminal directly displaying the tag, while the first terminal identifies and verifies its validity. If multiple tags are found in an area, the tag is considered invalid, and no connection is established. If only one tag is found, the tag is considered valid, and the first terminal establishes a connection.

[0159] The interaction method provided in this disclosure is described below through several specific embodiments for different intent recognition scenarios.

[0160] For example, in at least one embodiment, the user's intention is to project a target file from the first terminal to the second terminal, and the interactive operation in step S3 includes projecting the target file from the first terminal to the second terminal.

[0161] For example, in various embodiments of this disclosure, the first terminal is a first display device, and the second terminal is a second display device. The size of the display screen of the first display device is smaller than the size of the display screen of the second display device; that is, the first terminal is a small-sized display device, and the second terminal is a large-sized display device relative to the first terminal. For example, the first terminal is a mobile small-sized display device such as a mobile phone or tablet computer, and the second terminal is a large-sized display device suitable for public display in places such as conference rooms or exhibition halls.

[0162] For example, after determining that the user's intention is to project the target file from the first terminal to the second terminal, the target file for projection is determined based on the user's daily usage habits and preferences or based on the specific environment of the first terminal.

[0163] For example, after determining that the user's intention is to project a target file from the first terminal to the second terminal, the system on the first terminal can predict the target file the user needs to project in different scenarios by analyzing the user's daily usage habits and preferences, and thus intelligently recommend the target file. For instance, if a user frequently holds meetings at 9 a.m. and projects daily reports or the last saved document to the meeting room's large screen, then when the user opens the file manager application on the first terminal in the morning and selects a file, the daily report or the last saved document can be identified as the target file for projection. The system on the first terminal can automatically push the identified target file to the user as an option, such as displaying a pop-up option for the target file, to improve the convenience of projecting the target file.

[0164] For example, the system on the first terminal can analyze the user's current environment (such as time, location, and the status of surrounding devices) to predict the target file the user needs to project in that environment, and then intelligently recommend the target file. For instance, when a user enters a meeting room and connects to a large screen device (the second terminal), the system on the first terminal can use a recently edited PPT or meeting materials as the target file for projection, automatically recommending the target file to the user as an option, such as displaying a pop-up option for the target file, to improve the convenience of projecting the target file.

[0165] Figure 3 is a flowchart of a method for projecting a target file from a first terminal to a second terminal in an interactive method provided by an embodiment of this disclosure. Referring to Figure 3, projecting a target file from a first terminal to a second terminal includes steps S31 to S32.

[0166] S31: Upload the target file to the cloud relay station via the first terminal.

[0167] S32: Obtain and display the target file from the cloud relay station via a second terminal.

[0168] The target file mentioned in step S31 refers to the file that needs to be projected from the first terminal to the second terminal. For example, it may include any content that the user has browsed on the first terminal and that can be displayed on the first terminal, such as documents, pictures, or videos.

[0169] [Corrected according to Rule 91, 04.03.2025] Figure 4 is a schematic diagram illustrating the relationship between a first terminal, a second terminal, and a server involved in the interaction method provided in at least one embodiment of this disclosure. Referring to Figure 4, the cloud relay station includes a server, and the first terminal and the second terminal respectively establish connections with the server of the cloud relay station. In this case, for example, the first terminal and the second terminal are connected to the same local area network so that both can establish connections with the server of the cloud relay station respectively.

[0170] A cloud server is needed to receive files uploaded by the first terminal, store those files, and distribute files to registered second terminals. For ease of use, the second terminal needs to maintain a persistent connection with the server to receive files uploaded by the first terminal in real time. Depending on the use case, the server can be a Network File System (NAS) or a cloud storage service.

[0171] Specifically, a cloud relay station is first established. This station includes a server that allows second terminals to register, enabling them to connect and access the server. The server also receives files uploaded by the first terminal. The cloud relay station includes cloud storage to store these files. When a second terminal first accesses the server, it needs to register relevant hardware information, etc., to facilitate subsequent file downloads from the server's cloud relay station. This allows the second terminal to retrieve files uploaded by the first terminal from the cloud relay station. Furthermore, once the second terminal logs in with this registration information, it maintains a persistent connection with the server. Therefore, when the server's cloud relay station receives a file uploaded by the first terminal, it can immediately download it to the second terminal, achieving real-time file reception. This allows both the first and second terminals to establish connections with the cloud to enable screen mirroring from the first terminal to the second terminal, which also falls under the category of establishing a signal connection between the first and second terminals.

[0172] For example, the first terminal communicates with the cloud relay server via a protocol (such as TCP, HTTP, etc.). Then, based on the information of the corresponding registered second terminal returned by the server, the corresponding second terminal is selected for file transfer (using protocols such as FTP, SCP, etc.).

[0173] The cloud relay server needs to verify the information of the first terminal, receive the file uploaded by the first terminal, and then send the file uploaded by the first terminal to the second terminal. There are two solutions for this.

[0174] Referring to Figure 5, the first approach is as follows: The file uploaded by the first terminal is first stored in cloud storage. Once the file transfer is complete, the system checks the online status of the registered second terminal based on its information, and then sends the file uploaded by the first terminal to the corresponding second terminal. In this scenario, for example, the cloud relay station includes a file receiving server, a file sending server, and cloud storage. The file receiving server receives the file uploaded by the first terminal, and the second terminal maintains a long connection with the file sending server, which then sends the file uploaded by the first terminal to the second terminal.

[0175] Referring to Figure 6, the second approach is as follows: First, check if the corresponding second terminal is online. If the second terminal is offline, the first approach is used: first, store the file uploaded by the first terminal. Once the second terminal is online, the cloud relay station distributes the file to the second terminal via the file distribution server, allowing the second terminal to retrieve the file uploaded by the first terminal from the cloud relay station. If the corresponding second terminal is found to be online, the file stream uploaded by the first terminal is directly forwarded to the second terminal. The first method allows for file backup, making it more secure and reliable. The second approach offers faster transmission speeds.

[0176] The cloud relay station function enables rapid file sharing and transfer between a first terminal and a second terminal. When the first terminal is a small-screen display device and the second terminal is a large-screen display device, it allows for rapid file sharing and transfer between small-screen devices such as mobile phones, tablets, or PCs and large-screen devices. Figures 7 and 8 are partial display interface diagrams illustrating the process of uploading a target file from the first terminal to the cloud relay station. Referring to Figures 7 and 8, for example, in a meeting scenario, when a participant needs to project a file from their mobile phone (first terminal) onto a large-screen device (second terminal) in the meeting room, they can drag and drop the target file into the cloud relay station window on their device. When the large-screen device needs to access these files, it can automatically download them from the cloud relay station or open and preview them directly.

[0177] For example, projecting the target file from the first terminal to the second terminal also includes the following steps S33 to S35.

[0178] Step S33: During the process of the first terminal uploading the target file to the cloud transfer station, the format of the target file is detected and the target file is encrypted.

[0179] Step S34: Establish a connection between the second terminal and the cloud relay station.

[0180] Step S35: The second terminal obtains a unique file identifier generated by the system where the cloud relay station is located after the target file is uploaded to the cloud relay station, and accesses the target file uploaded to the cloud relay station based on the file identifier, wherein the file identifier is bound to the first terminal; or, the second terminal obtains the information of the first terminal bound to the file identifier, and accesses the target file uploaded to the cloud relay station based on the information of the first terminal.

[0181] For example, the specific operation of projecting the target file from the first terminal to the second terminal is as follows.

[0182] 1. Uploading: Users select the file to be projected on their first terminal and upload it to the cloud relay station via simple drag-and-drop operations. During the upload process, the cloud system hosting the relay station automatically detects the file format and encrypts the file to ensure its security and integrity. For example, the cloud system may perform necessary format conversions or optimizations based on the display characteristics of the second terminal and user needs to ensure optimal display on the second terminal. After upload, the system generates a unique file identifier (ID) and binds it to the user's first terminal information for subsequent file access and download. For example, files from multiple first terminals can be uploaded to the cloud relay station, generating a unique file identifier for each terminal. Thus, in a meeting scenario, multiple participants can upload the target file to be projected from their mobile phones to the cloud relay station, generating a unique file identifier for each phone.

[0183] 2. The second terminal establishes a connection with the cloud relay station via built-in sharing software or applications. Once connected, the system automatically transmits the file selected by the user on the smaller screen device to the larger screen device for display. Users can access and download files uploaded by the first terminal by entering a unique file identifier corresponding to the target file uploaded to the cloud relay station or by selecting information from the bound first terminal through the second terminal's interface. For example, in a meeting scenario, the cloud system can directly send a unique file identifier or information from the bound first terminal to the second device. This first terminal information could include its attributes, such as its device name. The cloud system supports previewing and playing various file formats, allowing users to directly view the content of the target file on the second terminal as needed, thus enabling the projection of the target file from the first terminal to the second terminal in response to user intent.

[0184] It should be noted that the order of steps S33 and S34 can be interchanged.

[0185] For example, projecting the target file from the first terminal to the second terminal also includes the following steps S36 and S37.

[0186] S36: Processing target files in the cloud transfer station via the first terminal; and

[0187] S37: Update the target file after the processing operation is performed to the second terminal, and the second terminal displays the target file after the processing operation is performed.

[0188] In step S37, for example, in response to the first terminal performing a processing operation on the target file in the cloud transfer station, the target file after the processing operation can be updated to the second terminal in real time, and the second terminal displays the target file after the processing operation in real time.

[0189] For example, users can manage and manipulate files in the cloud transfer station on their first device, such as deleting, renaming, and sharing them. The system will automatically synchronize these operations to the second device, ensuring file consistency and real-time performance. Users can also set access permissions and expiration dates for files to protect their privacy and security.

[0190] For example, cloud systems can intelligently recommend relevant files and materials based on users' file usage habits and meeting topics, improving meeting efficiency. Users can quickly find the files they need by searching using keywords in the cloud transfer station, reducing search time.

[0191] The interaction method provided in this disclosure supports file sharing and transmission between terminal devices using various operating systems, including Android, iOS, and Windows.

[0192] The following section describes how to determine the user's intent when the user's intent is to project a target file from the first terminal to the second terminal.

[0193] For example, step S1 above may include determining the user's intent based on analyzing user actions.

[0194] For example, in one embodiment, the user's intent can be determined by identifying that the content viewed or selected by the user on the first terminal is of a specific type, thus determining that the user's intent is to cast the target file from the first terminal to the second terminal. For instance, in response to recognizing the user's intent, the system can automatically prompt the user whether they wish to initiate casting to the second terminal. Therefore, based on intent recognition, the system can automatically remind the user whether to cast, eliminating the need for the user to manually initiate the casting operation and improving the user experience.

[0195] When a user browses content on a primary device—for example, files such as documents, images, or videos—or selects text on the primary device (where the selected content is the text selected on the primary device), the system on the primary device can recognize that the content viewed or selected by the user is of a specific type. This specific type of content may include images, documents in formats frequently used for screen sharing (such as PPT, Word, or PDF documents), or the selected text. This allows the system to recognize the user's intention to share the content to another device. For example, in response to recognizing the user's intention, the system can automatically prompt the user whether they wish to share the content to the second device. A pop-up reminder could be displayed on the primary device's screen. Thus, the system can automatically remind the user whether to share the content based on their intention, eliminating the need for manual screen sharing and improving the user experience.

[0196] For example, when a user selects a file in the file manager of the first terminal, the system of the first terminal recognizes that the user intends to project the file onto another terminal device, such as the second terminal, and prompts the user whether they wish to project the file onto the display screen of the conference room so that everyone in the conference room can view it.

[0197] For example, in another embodiment, the user intent can be determined by analyzing the user's daily usage habits and preferences to predict the user's screen-casting needs in a specific scenario at a specific time, thereby determining that the user's intent is to cast the target file from the first terminal to the second terminal.

[0198] For example, by analyzing users' daily habits and preferences, the system on the first terminal can predict users' screen-sharing needs in different scenarios. For instance, if a user frequently holds meetings at 9 a.m. and projects daily reports onto the meeting room's large screen, the system can automatically pop up screen-sharing options when the user opens the file manager application on the first terminal and selects a file in the morning.

[0199] For example, in another embodiment, the user intent can be determined by detecting that a first terminal and a second terminal operated by the user are connected to the same network or have established a Bluetooth or wireless network connection with each other.

[0200] For example, when the first and second terminals are on the same local area network or have established a Bluetooth / Wi-Fi direct connection, the system can recognize the screen mirroring intention through the collaborative work between the devices. For instance, the user only needs to tap a "Accept Screen Mirroring" icon on the second terminal, and the specific content on the first terminal will automatically begin the screen mirroring process without any additional operation on the first terminal.

[0201] For example, in another embodiment, the user's intent can be determined by recognizing the user's specific gestures to determine that the user's intent is to project the target file from the first terminal to the second terminal.

[0202] Using sensors (such as accelerometers and gyroscopes) and cameras on a first terminal (such as a mobile phone or tablet), the system of the first terminal can recognize specific gestures or actions of the user as trigger signals for screen mirroring. For example, a user can initiate the screen mirroring function to a second terminal by shaking the phone, making a specific gesture, or pointing at the second terminal in the environment.

[0203] For example, in another embodiment, the user's intent can be determined by analyzing the user's language commands through speech recognition.

[0204] For example, based on speech recognition, Natural Language Processing (NLP) technology can be combined to enable the first terminal system to more accurately understand the user's complex commands and intentions. For instance, a user can say, "Cast this document onto the TV in the living room (second terminal) and switch to presentation mode." The first terminal system can then parse this command and automatically execute the corresponding casting and settings operations.

[0205] For example, in another embodiment, the user's intent can be determined by detecting that the first terminal operated by the user is in a specific environment, and thus determining that the user's intent is to project the target file of the first terminal to the second terminal. The first terminal being in a specific environment includes the first terminal being in a specific location and / or the first terminal being connected to the second terminal.

[0206] For example, after determining that the user's intention is to project a target file from the first terminal to the second terminal, the system on the first terminal can intelligently recommend projection content or methods by analyzing the user's current environment (such as time, location, and the status of surrounding devices). For instance, when a user enters a meeting room and connects to a large-screen device (the second terminal), the system on the first terminal can automatically recommend recently edited PPT slides or meeting materials as candidate projection files.

[0207] For example, in at least another embodiment, the user intends to distribute files from a second terminal to multiple first terminals, and the interactive operation described in step S3 includes sending files from the second terminal to multiple first terminals.

[0208] For example, the files on the second terminal include documents, pictures, videos, or text content.

[0209] For example, the first terminal is a first display device, and the second terminal is a second display device. The screen size of the first display device is smaller than that of the second display device; that is, the first terminal is a small-sized display device, and the second terminal is a large-sized display device relative to the first terminal. For example, the first terminal is a small-sized mobile display device such as a mobile phone or tablet, while the second terminal is a large-sized display device suitable for public display in places such as conference rooms or exhibition halls. Therefore, for example, in a meeting setting, a function can be initiated more intelligently and automatically to distribute files from the second terminal to the first terminal in response to intent recognition. This allows for convenient real-time distribution of files from the large screen device in the meeting room to the mobile phones or tablets of various participants for sharing, either after discussion or during the meeting.

[0210] Figure 9 is a flowchart of a method for projecting a target file from a first terminal to a second terminal in an interactive method provided by an embodiment of this disclosure. Referring to Figure 9, distributing files from the second terminal to multiple first terminals includes steps S41 to S42.

[0211] S41: In response to determining that the user's intention is to distribute files from a second terminal to multiple first terminals, the second terminal automatically collects and organizes the files to be distributed to generate a file list.

[0212] S42: Send the files in the file list to multiple first terminals and display a file receiving prompt on each first terminal device.

[0213] For example, after determining that the user's intention is to distribute files from a second terminal to multiple first terminals, the system prompts the user whether to distribute files from the second terminal to the multiple first terminals. In response to the user's confirmation to distribute files from the second terminal to the multiple first terminals, the conference system automatically organizes the file list and distributes the files to the multiple first terminals.

[0214] Specifically, in one example, distributing files from a second terminal to multiple first terminals includes the following operations.

[0215] 1. After the meeting, the management system of the large-screen device (e.g., a cloud-based system) recognizes that the user intends to distribute files from the large-screen device (second terminal) in the meeting room to the participants' smaller screen devices (first terminals). The management system of the large-screen device automatically identifies and organizes a list of files to be distributed, such as annotated files identified through the specific intent recognition method described below, or files opened or edited during the preset meeting time.

[0216] 2. The management system for the large screen device identifies and connects to the small screen devices of the participants. This establishes a connection between both the large and small screen devices and the management system, ensuring that documents are accurately distributed to each participant's small screen device. For this to work, both the large and small screen devices need to be connected to the same local area network beforehand.

[0217] 3. The system on the large screen device or the cloud system will automatically distribute the collected file list to the small screen devices of the participants and display file receipt prompts on each small screen device.

[0218] During the distribution process, for example, only the second terminal is allowed to send files to the first terminal device whose signal is connected to the second terminal; or only the first terminal with the correct key can connect to the second terminal. The method of signal connection between the first and second terminals will be described in detail later. Thus, the system can ensure the security and integrity of files, preventing file loss or corruption.

[0219] The following describes how to determine the user intent when the user intent is to distribute files from a second terminal to multiple first terminals.

[0220] For example, in one embodiment, determining the user's intent can be achieved by: in response to detecting changes in the content displayed on the second terminal that meet preset conditions, analyzing the changed content, and determining, based on the analysis results, that the user's intent is to distribute files from the second terminal to multiple first terminals. This improves the convenience and efficiency of file distribution.

[0221] For example, determining that the user's intention is to distribute files from the second terminal to multiple first terminals based on the analysis results of the changed content includes: in response to recognizing that the changed content displayed on the second terminal is a meeting minutes and determining that the meeting is about to end, determining that the user's intention is to distribute files from the second terminal to multiple first terminals.

[0222] "The meeting is about to end" means that there is less than 1 / 6 or 1 / 10 of the total meeting time remaining, or that there are 10 minutes or 5 minutes left in the meeting. This is not limited to the time ratios or time ranges listed here; any time range that can express a similar degree of proximity to the end of the meeting is acceptable.

[0223] For example, user intent can be determined based on context analysis and content recognition displayed on the second terminal. The management system for the second terminal (i.e., the management system of the second terminal) continuously monitors changes in the content displayed on the screen, especially manual input. This management system is, for example, a cloud-based system; in a conference scenario, the second terminal is a large-screen device in the conference room, and the management system is the conference system. For example, a preset condition for changes in the content displayed on the second terminal can be that the amount of manually entered content (also known as manually entered annotations) reaches or exceeds a preset threshold. For example, in response to detecting that changes in the content displayed on the second terminal have reached the preset condition, the management system analyzes the content of these annotations, including text information and text structure. Here, annotations can refer to any text content entered in the displayed document or annotations added to images. For example, the changed content includes content manually entered by the user, and the management system of the second terminal determines that the manually entered content is meeting minutes by analyzing the manually entered content.

[0224] For example, methods for analyzing the content and structure of these annotations may include: the conferencing system using natural language processing (NLP) and image recognition technologies to extract key information from manually entered annotations, such as titles, dates, attendees, discussion points, etc., to determine whether the user intends to distribute files to a first terminal (e.g., multiple first terminals) based on the extracted key information.

[0225] If the extracted key information, including title, date, attendees, and discussion points, determines that the input annotations constitute meeting minutes, then the system determines that the user intends to distribute the file to multiple primary terminals. In this case, the system can prompt the user whether to distribute the file to the primary terminals, for example, by displaying a pop-up message on the screen. If this key information is not extracted, the system continues to monitor changes in the content displayed on the secondary terminals.

[0226] Furthermore, in response to extracting any of the aforementioned key information, the conferencing system determines that these annotations constitute meeting minutes and automatically generates meeting minutes using these annotations. When a user confirms the distribution of files to a first terminal, the system adds the generated meeting minutes to the collected file list and distributes the files in the file list to multiple first terminals.

[0227] For example, in another embodiment, the user's intent can be determined by analyzing the set meeting time information to predict that the meeting is about to end and thus determining that the user's intent is to distribute files from a second terminal to multiple first terminals.

[0228] Taking a conference system as an example, the management system for the second terminal might combine the conference schedule and current time to determine if the conference is nearing its end. This is estimated using a preset conference duration within the system. If the conference is nearing its end, it's determined that the user's intention is to distribute files from the second terminal to multiple first terminals.

[0229] For example, in another embodiment, the user intent can be determined by detecting that the user's operation behavior on the file on the second terminal is an act with the intent to distribute the file, and thus determining that the user's intent is to distribute the file from the second terminal to multiple first terminals. The acts with the intent to distribute the file include at least one of viewing the handwritten annotations displayed on the second terminal more than a preset frequency, saving the file, and exporting the file.

[0230] For example, the conferencing system detects user actions, such as whether the user frequently views or edits annotations on the large screen. If it detects that the number of times the user views (e.g., clicks) or edits annotations on a second terminal (e.g., the large screen device in the conference room) exceeds a set threshold, it determines that the user's intention is to distribute files from the second terminal to multiple first terminals. Alternatively, it detects whether the user has a tendency to save (or save as) or export files (e.g., take screenshots). Exporting files includes operations such as taking screenshots and saving screen recordings. If any of these behaviors are detected, it determines that the user's intention is to distribute files from the second terminal to multiple first terminals.

[0231] The management system can prompt users to distribute files to multiple primary terminals in various ways, such as displaying a confirmation button on the display screen of the secondary terminal, pop-up prompts, sending notifications to the participants' devices (i.e., primary terminals), or prompting through a voice assistant.

[0232] After a user confirms the distribution of files to multiple primary terminals, the management system will convert the files in the file list to shareable formats (such as PDF, Word, etc.) and distribute them to participants via email, cloud storage services, or instant messaging tools. Files for distribution include, but are not limited to: files displayed on secondary terminals during the meeting (such as documents, images, videos, etc.) and automatically generated meeting minutes.

[0233] For example, in this interaction method, after determining that the user's intention is to distribute files from the second terminal to multiple first terminals, the files in the file list are distributed to the multiple first terminals in real time, or distributed to the multiple first terminals at a predetermined time, such as at the end of the meeting. This reduces manual operations such as initiating file distribution to multiple first terminals and organizing the file list, improving the convenience of file distribution and meeting efficiency.

[0234] For example, in at least another embodiment, the user's intention is to remotely annotate the second terminal, and the interactive operation described in step S3 includes remotely annotating the second terminal through the first terminal.

[0235] Remote annotation via a first terminal to a second terminal refers to a user editing content displayed on the second terminal from the first terminal, such as modifying document content or editing images, with the edited content being simultaneously displayed on the second terminal.

[0236] For example, in one example, a first terminal A is signal-connected to a second terminal. When the first terminal A is projecting its screen onto the second terminal, the first terminal A can identify that the user's intention is to remotely annotate the second terminal. In response to the intention recognition result, the first terminal A can remotely annotate the second terminal.

[0237] For example, in another example, first terminal A and first terminal B are respectively connected to second terminal. When first terminal A is projecting its screen onto second terminal, first terminal B can recognize that the user's intention is to remotely annotate the second terminal, and can remotely annotate the second terminal through first terminal B in response to the intention recognition result.

[0238] For example, in another example, a first terminal A is signal-connected to a second terminal, the second terminal displays local files, the first terminal A can recognize that the user's intention is to remotely annotate the second terminal, and can remotely annotate the second terminal through the first terminal A in response to the intention recognition result.

[0239] For example, after triggering a remote annotation operation from the first terminal to the second terminal in response to a user's intent to remotely annotate the second terminal, the remote annotation function can be implemented by loading a remote annotation function into the screen projection software. For instance, the content displayed on the second terminal is shown on the interface of the first terminal, which allows remote annotation. The first terminal's interface displays a toolbar for remote annotation, and the user can use the editing tools in the toolbar to edit the content on the first terminal's interface. These edits can be simultaneously displayed on the second terminal's display interface. For example, if the second terminal is a large-screen device, the edited content can be simultaneously shared with viewers. As for the specific method of remote annotation using screen projection software, those skilled in the art can design it as needed using conventional techniques in the field.

[0240] For example, performing remote annotation on a second terminal via a first terminal according to user intent includes: in the state where the target file of the first terminal has been projected onto the second terminal, in response to determining that the user intent is to perform remote annotation on the second terminal, projecting the target file of the first terminal onto the second terminal, and updating the content displayed on the second terminal based on the user's editing of the content displayed on the first terminal, so as to synchronously display the content edited on the first terminal on the second terminal.

[0241] Alternatively, performing remote annotation on the second terminal via the first terminal according to the user's intent includes: in response to determining that the user's intent is to remotely annotate the second terminal, casting the target file from the first terminal to the second terminal, and updating the content displayed on the second terminal based on the user's editing of the content displayed on the first terminal, so as to synchronously display the edited content on the second terminal on the first terminal.

[0242] The following section describes how to determine user intent when the user intent is to remotely annotate a second terminal.

[0243] For example, in one embodiment, the user intent is determined by identifying the remote annotation command issued by the user to determine that the user intent is to remotely annotate a second terminal.

[0244] For example, annotation instructions include a user's intention to remotely annotate a second terminal via a specific operation or voice command on the first terminal. For instance, the specific operation might involve initiating a trigger command on the application of the first terminal, such as clicking a control button to trigger remote annotation.

[0245] Alternatively, the annotation instruction can include a voice command from the user to remotely annotate an instruction initiated by the first terminal. For example, the user could use a voice assistant or built-in microphone to issue the voice command "Remotely annotate device A (second terminal) in the conference room." The intent recognition module includes a voice recognition unit that can use Natural Language Processing (NLP) technology to parse the voice content and determine that the user's intent is to remotely annotate the second terminal. This approach provides a quick and convenient way to trigger remote annotation on the second terminal, especially in situations requiring rapid response or where the user's hands are limited.

[0246] For example, in another embodiment, the user intent is determined by identifying changes in the device state of the first terminal caused by the user's operation, thus determining that the user intent is to remotely annotate the second terminal.

[0247] For example, device status change recognition can be performed. If the first terminal is a tablet computer, the tablet's intent recognition module can detect when the user removes the stylus from the tablet to identify the user's potential intention to annotate the current screen. The intent recognition module of the first terminal can include an intent recognition circuit and a sensor connected to the intent recognition circuit. The device status of the first terminal is monitored through the cooperation of the intent recognition circuit and the sensor.

[0248] For example, in another embodiment, the user intent is determined by analyzing the touch or gesture operations performed by the user on the first terminal to determine that the user intent is to remotely annotate the second terminal.

[0249] For example, when the target content of the first terminal is projected onto the second terminal, the intent recognition module of the first terminal analyzes the user's touch trajectory, gesture operations (such as swiping, clicking, long pressing, etc.) on the small screen, as well as the frequency and pattern of these operations. For example, if the user clicks on a certain area continuously, it may indicate that the user wants to zoom in or focus on the content of that area. If the user draws a line in a certain area, it may indicate that the user wants to make annotations in that area. Thus, the module can determine that the user has the intention to make remote annotations on the second terminal.

[0250] For example, in another embodiment, the user's intent is to remotely annotate the second terminal by analyzing the real-time meeting content displayed on the second terminal.

[0251] For example, in the aforementioned meeting scenario, the management system of the second terminal can acquire and analyze contextual information such as the current meeting agenda, discussion topics, and displayed content on the second terminal to predict the user's potential actions. For instance, when discussing a key chart or data, the user may be more inclined to annotate, mark, or zoom in, thus indicating the user's intention to remotely annotate on the second terminal.

[0252] For example, the management system of the second terminal can learn users' operating habits and historical behavior patterns to more accurately predict users' operational intentions in specific situations. This approach requires the system to have a certain level of machine learning and data analysis capabilities.

[0253] Specifically, the intent recognition module can be constructed in the following manner.

[0254] 1. Rule-based approach

[0255] Expert-written rule templates: Experts manually create a series of rule templates based on their understanding of a specific domain or task to match user input and thus identify their intent. For example, intent identification can be achieved by matching templates containing specific keywords or sentence structures. This method is simple to implement and may have high accuracy for specific domains or tasks.

[0256] 2. Statistical methods

[0257] Intent dictionary and word frequency statistics: The intent dictionary is used to perform word frequency statistics on the user-input text, and the intent with the highest word frequency is taken as the recognition result. This method has a wider coverage compared to rule templates.

[0258] 3. Machine learning-based methods

[0259] Data labeling and preprocessing: First, the user input data is labeled to clarify the intent category of each sample. Then, the data is preprocessed, including word segmentation, stop word removal, and adding synonym entries.

[0260] Feature extraction: Extracting features from text, such as bag-of-words model, TF-IDF, word embedding, etc., to represent text information.

[0261] Model training: Traditional machine learning algorithms such as Support Vector Machine (SVM), Naive Bayes, and Logistic Regression are used to train the labeled data to obtain the intent recognition model.

[0262] Machine learning-based methods are highly automated, capable of handling large-scale data, and typically achieve higher accuracy than rule-based methods.

[0263] 4. Deep learning-based methods

[0264] Intent recognition is performed using neural network models. Pre-trained language models such as Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), Long Short-Term Memory Networks (LSTM), Gated Recurrent Modules (GRU), and BERT are employed for intent recognition. These models can automatically learn feature representations from large amounts of text data and perform intent classification.

[0265] Deep learning-based methods are highly automated, capable of handling complex linguistic phenomena and contextual information, and typically achieve higher accuracy than traditional machine learning methods.

[0266] For example, the specific steps for constructing an intent recognition module based on deep learning methods are as follows.

[0267] 1. Data preparation: Collect and label the text data entered by users to ensure that the data covers various intent categories and contextual situations.

[0268] 2. Data preprocessing: Perform preprocessing operations such as word segmentation, stop word removal, and word embedding on the text data to convert the text into a format acceptable to the model.

[0269] 3. Model selection: Select a suitable deep learning model according to the task requirements and available resources, such as BERT, TextCNN, etc.

[0270] 4. Model training: Train the model using the labeled data and adjust the model parameters to optimize the performance.

[0271] 5. Model evaluation: Evaluate the trained model using the test set to verify its accuracy and generalization ability.

[0272] 6. Deployment and application: Deploy the trained model to the actual application scenario for real-time intent recognition.

[0273] The specific process is introduced in the following machine learning-based manner.

[0274] 1. Data preparation

[0275] Data collection: Collect the text data input by users from various sources (such as user logs, online forums, customer service conversations, etc.).

[0276] Data annotation: Manually annotate the collected data to clarify the intent category to which each sample belongs. The annotation process needs to ensure accuracy and consistency, and usually needs to be completed by experts with domain knowledge.

[0277] 2. Data preprocessing

[0278] Text cleaning: Remove the noise in the text, such as HTML tags, special characters, extra spaces, etc.

[0279] Word segmentation: Split the text into words or phrases for subsequent processing. Tools such as jieba are often used in Chinese text processing.

[0280] Stop word removal: Remove the stop words in the text, such as high-frequency but meaningless words like "de", "le", etc.

[0281] Word embedding: Convert the words in the text into numerical vectors. Common word embedding methods include Word2Vec, GloVe, etc.

[0282] 3. Feature extraction

[0283] Statistical features: Extract the statistical features in the text, such as word frequency, TF-IDF value, etc.

[0284] Syntactic features: Perform syntactic analysis on the text to extract syntactic features such as part-of-speech tagging and dependency relations.

[0285] Semantic features: Extract semantic features of text using pre-trained language models (such as BERT).

[0286] 4. Model Selection and Training

[0287] Model selection: Choose a suitable machine learning model based on task requirements and data characteristics, such as Support Vector Machine (SVM), Random Forest, Gradient Boosting Tree (GBDT), or deep learning models (such as TextCNN, LSTM, BERT, etc.).

[0288] Model training: The selected model is trained using labeled training data. During training, model parameters need to be adjusted to optimize performance. Common optimization algorithms include gradient descent and the Adam optimizer.

[0289] 5. Model Evaluation

[0290] Test set evaluation: The trained model is evaluated using an independent test set to verify its accuracy and generalization ability. Evaluation metrics typically include accuracy, precision, recall, and F1 score.

[0291] Cross-validation: To more comprehensively evaluate model performance, cross-validation methods, such as K-fold cross-validation, can be used.

[0292] 6. Deployment and Application

[0293] Model deployment: Deploying the trained model to real-world application scenarios, such as chatbots, customer service systems, and search engines.

[0294] Real-time monitoring: Monitor the model's performance in real-time to identify and resolve problems promptly.

[0295] Continuous optimization: Based on user feedback and actual application results, continuously optimize model performance to improve the accuracy and efficiency of intent recognition.

[0296] At least one embodiment of this disclosure provides an interaction method, which includes: determining a user's intention through a first terminal, wherein the first terminal is signal-connected to a second terminal; and the first terminal performing an interaction operation with the second terminal according to the user's intention. At least one embodiment of this disclosure also provides an interaction method, which includes: determining a user's intention through a second terminal, wherein the first terminal is signal-connected to the second terminal; and the second terminal performing an interaction operation with the first terminal according to the user's intention. That is, depending on the different user intentions in different scenarios, the first terminal can act as the execution subject of the step "determining the user's intention" and the step "performing an interaction operation with the first terminal according to the user's intention"; or, the second terminal can act as the execution subject of the step "determining the user's intention" and the step "performing an interaction operation with the second terminal according to the user's intention". Specific execution methods can be referred to in the embodiments of the above interaction method for the specific operations performed by the first terminal (including the hardware and software of the first terminal and / or the management system signal-connected to the first terminal) and the second terminal (including the hardware and software of the first terminal and / or the management system signal-connected to the first terminal).

[0297] Figure 10a is a schematic block diagram of an interactive device according to an embodiment of this disclosure. Referring to Figure 10a, an interactive device 100 according to an embodiment of this disclosure includes: a first intent analysis module 110 and a first execution module 120. The first intent analysis module 110 is configured to analyze user operations of a first terminal to identify user intent, wherein the first terminal is connected to a second terminal via a signal connection; the first execution module 120 is configured to execute interactive operations between the first terminal and the second terminal according to the user intent. For example, the interactive device shown in Figure 10a includes a first terminal and may also include a cloud server for the first terminal; the first intent analysis module 110 and the first execution module 120 may be built-in modules of the first terminal or modules of the cloud server of the first terminal.

[0298] Figure 10b is a schematic block diagram of another interactive device provided in an embodiment of this disclosure. Referring to Figure 10b, another interactive device 100a provided in an embodiment of the disclosure includes: a second intent analysis module 110a and a second execution module 120a. The second intent analysis module 110a is configured to analyze user operations of a second terminal to identify user intent, and a first terminal and a second terminal are connected by a signal; the second execution module 120a is configured to execute interactive operations between the second terminal and the first terminal according to the user intent. For example, the interactive device shown in Figure 10b includes a second terminal, and may also include a cloud server of the second terminal (e.g., a management system including the aforementioned second terminal), and the intent analysis module 110a and the second execution module 120a may be built-in modules of the first terminal or modules of the cloud server of the first terminal.

[0299] The specific methods, steps, and functions executed by each module can be found in the embodiments of the above-mentioned interaction methods, and will not be repeated here.

[0300] For example, these modules can be implemented using hardware (e.g., circuit) modules or software modules, as illustrated in the following examples, which will not be repeated here. For instance, these units can be implemented using a central processing unit (CPU), a general-purpose graphics processing unit (GPGPU), a graphics processing unit (GPU), a tensor processor (TPU), a field-programmable gate array (FPGA), or other processing units with data processing and / or instruction execution capabilities, along with corresponding computer instructions. These modules can be located in a first terminal or a second terminal to cooperate with each other to achieve the aforementioned corresponding functions.

[0301] Figure 11 is a schematic block diagram of an electronic device provided in at least one embodiment of the present disclosure. For example, as shown in Figure 11, the electronic device 200 includes a processor 210, a memory 220, and one or more computer program modules 221. The one or more computer program modules 221 are stored in the memory and configured to be executed by the processor, and the one or more computer program modules include instructions for performing an interactive method that implements any of the interactive methods provided in the embodiments of the present disclosure.

[0302] For example, processor 210 is connected to memory 220 via bus system 230. For example, one or more computer program modules 221 are stored in memory 220. For example, one or more computer program modules 221 include instructions for performing the interactive methods provided in any embodiment of this disclosure. For example, the instructions in one or more computer program modules 221 can be executed by processor 210. For example, bus system 230 can be a commonly used serial or parallel communication bus, etc., and the embodiments of this disclosure are not limited thereto.

[0303] For example, the processor 210 may be a central processing unit (CPU), a digital signal processor (DSP), a graphics processing unit (GPU), a general-purpose graphics processing unit (GPGPU), or other processing units with data processing capabilities and / or instruction execution capabilities. It may be a general-purpose processor or a dedicated processor, and may control other components in the interactive device 100 to perform desired functions. Embodiments of this disclosure are described using a general-purpose graphics processing unit (GPGPU) as an example.

[0304] The memory 220 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, which the processor 210 may execute to implement the functions (implemented by the processor 210) in this embodiment of the disclosure and / or other desired functions, such as interactive methods. Various application programs and various data, such as capability parameters, control information, and various data used and / or generated by the application programs, may also be stored in the computer-readable storage medium.

[0305] It should be noted that, for clarity and brevity, this disclosure does not show all the constituent units of the electronic device 200. To achieve the necessary functions of the electronic device 200, those skilled in the art can provide and set other constituent units (not shown) according to specific needs, and this disclosure does not limit this.

[0306] The interaction method or device according to the embodiments of this disclosure can also be implemented using the architecture of the exemplary electronic device 3000 shown in FIG12. As shown in FIG12, the electronic device 3000 may include a bus 3010, one or more central processing units (CPUs) or graphics processing units (GPUs) or GPGPUs 3020, read-only memory (ROM) 3030, random access memory (RAM) 3040, a communication port 3050 connected to a network, input / output components 3060, a hard disk 3070, etc. The storage devices in the electronic device 3000, such as the ROM 3030, the hard disk 3070, or the RAM memory (i.e., video memory) inside the GPGPU itself, can store various data or files required for the processing and / or communication of the methods provided in this disclosure, as well as program instructions executed by the CPU, GPU, or GPGPU. The electronic device 3000 may also include a user interface 3080. Of course, the architectures shown in Figures 10a and 10b are merely exemplary. When implementing different devices, one or more components in the electronic devices shown in Figures 10a and 10b may be omitted as needed.

[0307] At least one embodiment of this disclosure also provides a storage medium. FIG13 is a schematic diagram of a storage medium provided in at least one embodiment of this disclosure. For example, as shown in FIG13, the storage medium 400 non-transitoryly stores computer-readable instructions 401, which can execute any of the interactive methods provided in the embodiments of this disclosure when executed by a computer (including a processor).

[0308] For example, the storage medium can be any combination of one or more computer-readable storage media. For instance, when the program code is read by a computer, the computer can execute the program code stored in the computer storage medium to perform, for example, the interactive method provided in any embodiment of this disclosure.

[0309] For example, the storage medium may include a memory card for a smartphone, a storage component for a tablet computer, a hard disk for a personal computer, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), portable compact disc read-only memory (CD-ROM), flash memory, or any combination of the above storage media, or other suitable storage media.

[0310] The following points also need to be explained:

[0311] (1) The accompanying drawings of the embodiments of this disclosure only involve the structures involved in the embodiments of this disclosure. Other structures can be referred to the general design.

[0312] (2) For clarity, the thickness of layers or regions in the drawings used to describe embodiments of the present disclosure is enlarged or reduced, i.e., these drawings are not drawn to actual scale.

[0313] (3) Where there is no conflict, the embodiments of this disclosure and the features in the embodiments can be combined with each other to obtain new embodiments.

[0314] The above description is merely an exemplary embodiment of this disclosure and is not intended to limit the scope of protection of this disclosure. The scope of protection of this disclosure is determined by the scope defined in the claims.

Claims

1. An interaction method, comprising: determining a user intention; signal connecting a first terminal with a second terminal; and performing an interaction operation between the first terminal and the second terminal according to the user intention. The user intention is to cast a target file of the first terminal to the second terminal, and the interaction operation comprises casting the target file of the first terminal to the second terminal.

2. The interaction method of claim 1, wherein, The manner of determining the user intention comprises at least one of the following manners:

3. The interaction method of claim 2, wherein, judging the user intention by recognizing that the user views or selects a content on the first terminal as a specific type of content; judging the user intention by analyzing the user's daily use habits and preferences to predict the user's casting demand in a specific scenario at a specific time; judging the user intention in response to detecting that the first terminal and the second terminal access the same network or establish Bluetooth connection or wireless network connection with each other; judging the user intention by recognizing a specific gesture of the user; judging the user intention by analyzing the user's language instruction through voice recognition; and judging the user intention by detecting that the first terminal operated by the user is in a specific environment, wherein the first terminal being in a specific environment comprises that the first terminal is in a specific location and / or the first terminal is connected to the second terminal. After judging that the user intention is to cast the target file of the first terminal to the second terminal, the target file is determined based on the user's daily use habits and preferences or based on the specific environment in which the first terminal is located. Casting the target file of the first terminal to the second terminal comprises:

4. The interaction method according to claim 2 or 3, wherein, uploading the target file to a cloud relay station through the first terminal; and 5. The interaction method according to any of claims 2-4, wherein, acquiring and displaying the target file from the cloud relay station through the second terminal. Casting the target file of the first terminal to the second terminal further comprises: detecting the format of the target file and performing encryption processing on the target file during the process of uploading the target file to the cloud relay station through the first terminal; 6. The interaction method of claim 5, wherein, establishing a connection between the second terminal and the cloud relay station; the second terminal acquires a unique file identifier generated by a system in which the cloud relay station is located after the target file is uploaded to the cloud relay station, and accesses the target file uploaded to the cloud relay station based on the file identifier, wherein the file identifier is bound to the first terminal; or the second terminal acquires information of the first terminal bound to the file identifier, and accesses the target file uploaded to the cloud relay station based on the information of the first terminal. Casting the target file of the first terminal to the second terminal further comprises: performing a processing operation on the target file in the cloud relay station through the first terminal; and 7. The interaction method according to claim 5 or 6, wherein, updating the target file after the processing operation is performed to the second terminal, and the second terminal displays the target file after the processing operation is performed. ​ ​ 8. The interaction method of claim 1, wherein, The user intention is to distribute files from the second terminal to a plurality of the first terminals, and the interactive operation includes sending files of the second terminal to a plurality of the first terminals.

9. The interaction method of claim 8, wherein, The manner of determining the user intention includes at least one of the following manners: In response to monitoring that the content displayed by the second terminal changes to reach a preset condition, the changed content is analyzed, and it is determined from the analysis result of the changed content that the user intention is to distribute files from the second terminal to a plurality of the first terminals. It is determined that the user intention is to distribute files from the second terminal to a plurality of the first terminals by predicting that a meeting is about to end through analysis of set meeting time information. It is determined that the user intention is to distribute files from the second terminal to a plurality of the first terminals by monitoring that the user's operation behavior on the second terminal is a behavior with a file distribution intention, wherein the behavior with the file distribution intention includes at least one of the following: a frequency of viewing handwritten notes displayed by the second terminal exceeds a preset frequency, saving a file, and exporting a file.

10. The interaction method of claim 9, wherein, The determination of the user intention from the analysis result of the changed content includes: In response to identifying that the changed content displayed by the second terminal is a meeting minutes, it is determined that a meeting is about to end, and it is determined that the user intention is to distribute files from the second terminal to a plurality of the first terminals, wherein the changed content includes manually input content of a user, and it is determined that the manually input content is a meeting minutes by automatically analyzing the manually input content.

11. The interaction method of claim 8 or 9, wherein, The distribution of files from the second terminal to a plurality of the first terminals includes: In response to determining that the user intention is to distribute files from the second terminal to a plurality of the first terminals, files to be distributed are automatically collected and sorted on the second terminal to generate a file list; and Files in the file list are sent to a plurality of the first terminals, and a file receiving prompt is displayed on each of the first terminal devices.

12. The interaction method of claim 1, wherein, The user intention is to remotely annotate the second terminal, and the interactive operation includes remotely annotating the second terminal through the first terminal.

13. The interaction method of claim 12, wherein, The manner of determining the user intention includes at least one of the following manners: It is determined that the user intention is to remotely annotate the second terminal by identifying a remote annotation instruction issued by a user; It is determined that the user intention is to remotely annotate the second terminal by identifying that a device state of the first terminal changes due to a user operation; It is determined that the user intention is to remotely annotate the second terminal by analyzing a touch operation or a gesture operation performed by a user on the first terminal; and It is determined that the user intention is to remotely annotate the second terminal by analyzing real-time meeting content displayed by the second terminal.

14. The interactive method of any one of claims 1-13, further comprising: After determining the user intention, automatically prompting a user whether to perform the interactive operation between the first terminal and the second terminal. ​ 15. The interaction method according to any of claims 1-14, wherein, The signal connection between the first terminal and the second terminal comprises: The second terminal generates a unique identifier indicating the identity information of the second terminal, and sends the unique identifier signal; The first terminal receives and identifies the unique identifier signal, and parses the unique identifier signal; and The first terminal is automatically signal connected to the second terminal according to the parsing result of the unique identifier signal, wherein after the first terminal is signal connected to the second terminal, the interactive operation between the first terminal and the second terminal is allowed to be performed.

16. The interaction method of claim 15, wherein, The second terminal sends network information accessed by the second terminal, or generates and transmits wireless network information or hotspot information; The signal connection between the first terminal and the second terminal further comprises: The first terminal acquires network information associated with the second terminal, wherein the network information associated with the second terminal comprises one of network information accessed by the second terminal, wireless network information transmitted by the second terminal, and hotspot information transmitted by the second terminal; The first terminal is connected to the network associated with the second terminal according to the network information associated with the second terminal; and After the first terminal is connected to the network associated with the second terminal, the first terminal is automatically signal connected to the second terminal according to the parsing result of the unique identifier signal.

17. The interaction method of claim 15 or 16, wherein, The signal connection between the first terminal and the second terminal further comprises: The unique identifier is encrypted; and The first terminal is allowed to acquire the key for the encryption of the unique identifier, wherein the first terminal acquires the network information associated with the second terminal according to the key.

18. The interaction method according to any of claims 1-17, wherein, The first terminal is a first display device, and the second terminal is a second display device, and the size of the display screen of the first display device is smaller than the size of the display screen of the second display device.

19. An interactive method, comprising: determining a user intention by a first terminal, wherein the first terminal is signal connected to a second terminal; and the first terminal performs an interactive operation with the second terminal according to the user intention.

20. The interactive method of claim 19, wherein, The user intention is to cast a target file of the first terminal to the second terminal, and the interactive operation comprises casting the target file of the first terminal to the second terminal.

21. The interactive method of claim 20, wherein, The way of determining the user intention by the first terminal comprises at least one of the following ways: The user intention is determined by recognizing that the content viewed or selected by the user on the first terminal is a specific type of content; The user intention is determined by analyzing the daily use habits and preferences of the user to predict the casting needs of the user in a specific scenario at a specific time; The user intention is determined in response to detecting that the first terminal and the second terminal operated by the user access the same network or establish Bluetooth connection or wireless network connection with each other; The user intention is determined by recognizing a specific gesture of the user; The user intention is determined by analyzing the language instruction of the user through voice recognition; and ​ The user intention is determined by detecting that the first terminal operated by the user is in a specific environment, wherein the first terminal being in a specific environment includes the first terminal being in a specific location and / or the first terminal being connected to the second terminal.

22. The method of any of claims 19-21, wherein, The user intention is remote annotation of the second terminal, and the interaction operation includes remote annotation of the second terminal by the first terminal.

23. The interactive method of claim 22, wherein, The manner of determining the user intention by the first terminal includes at least one of the following manners: The user intention is determined by recognizing a remote annotation instruction issued by the user; The user intention is determined by recognizing that the user operation causes a device state change of the first terminal; and The user intention is determined by analyzing a touch operation or a gesture operation performed by the user on the first terminal.

24. An interaction method, comprising: determining a user intention by a second terminal, wherein the first terminal is in signal connection with the second terminal; and the second terminal performing an interaction operation with the first terminal according to the user intention.

25. The interaction method of claim 24, wherein, The user intention is file distribution from the second terminal to a plurality of first terminals, and the interaction operation includes sending files of the second terminal to a plurality of first terminals.

26. The interactive method of claim 25, wherein, The manner of determining the user intention includes at least one of the following manners: In response to a management system of the second terminal monitoring that a content displayed by the second terminal changes to reach a preset condition, the management system analyzes the changed content, and determines the user intention to be file distribution from the second terminal to a plurality of first terminals according to an analysis result of the changed content; The management system analyzes set meeting time information to predict that a meeting is about to end, and determines the user intention to be file distribution from the second terminal to a plurality of first terminals; The management system monitors that an operation behavior of a user on the second terminal on a file is a behavior with a file distribution intention, and determines the user intention to be file distribution from the second terminal to a plurality of first terminals, wherein the behavior with the file distribution intention includes at least one of a frequency of viewing handwritten annotations displayed by the second terminal exceeding a preset frequency, saving a file, and exporting a file.

27. The interactive method of claim 24, wherein, The user intention is remote annotation of the second terminal, and the interaction operation includes remote annotation of the second terminal by the first terminal, The manner of determining the user intention by the second terminal includes: The management system of the second terminal analyzes real-time meeting content displayed by the second terminal to determine the user intention to be remote annotation of the second terminal.

28. An interaction apparatus, comprising: a first intention analysis module configured to analyze user operation of a first terminal to identify a user intention, wherein the first terminal is in signal connection with a second terminal; and a first execution module configured to perform an interaction operation between the first terminal and the second terminal according to the user intention. 29.An interactive device, comprising: a second intention analyzing module configured to analyze a user operation of a second terminal to identify a user intention, wherein the first terminal is in signal connection with the second terminal; and a second executing module configured to execute an interactive operation between the second terminal and the first terminal according to the user intention. 30.An electronic device, comprising: a processor; a memory; one or more computer program modules stored in the memory and configured to be executed by the processor, the one or more computer program modules comprising instructions for performing an interactive method according to any one of claims 1-27. 31.A storage medium, non-transitorily storing computer readable instructions which, when executed by a computer, can perform an interactive method according to any one of claims 1-27.

Images