Processing method and electronic equipment

By monitoring the cursor input track, the functional module is automatically enabled, and the complex user operation problems in the existing technology are solved, convenient cross-device control and functional module enablement are realized, and user experience is improved.

CN120447804APending Publication Date: 2025-08-08LENOVO (BEIJING) LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202510541304.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-27
Publication Date
2025-08-08

AI Technical Summary

Technical Problem

In the prior art, users need to perform complex operations in the control interface of the electronic device to enable specific functions, resulting in high operational complexity.

Method used

By monitoring the input track of the cursor, the functional module is automatically enabled. When the cursor exceeds the edge of the display area or meets certain conditions, the control functional module enters the enable state and interacts with the terminal device through the connection channel.

Benefits of technology

It reduces the operation complexity of the user-enabled functional module, improves the user experience, and realizes convenient control of cross-device cursor travel and webcam sharing functions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120447804A_ABST
    Figure CN120447804A_ABST
Patent Text Reader

Abstract

The invention discloses a processing method and electronic equipment. The method comprises the following steps: obtaining a first input track; if the first input track meets a first configuration condition, controlling a first function module to be in an enabled state; wherein the first function module in the enabled state responds to the second input track based on the first configuration condition.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of electronic equipment, and in particular to a processing method and electronic equipment. Background Art

[0002] Currently, a user can enable a specific function of an electronic device so that the electronic device can enter an enabled state of the corresponding function.

[0003] However, in this solution, the user needs to first operate the electronic device to enter the control interface, and then enable the function in the control interface before the electronic device can enter the enabled state of the function. Therefore, there is a problem of high user operation complexity. Summary of the Invention

[0004] In view of this, the present application provides a processing method and an electronic device as follows:

[0005] A processing method comprising:

[0006] Obtaining a first input trajectory;

[0007] If the first input trajectory meets a first configuration condition, controlling the first functional module to be in an enabled state;

[0008] The first functional module in the enabled state responds to the second input trace based on the first configuration condition.

[0009] In the above method, preferably, the first functional module belongs to a functional module set of an application, the first configuration condition is a configuration condition for the first functional module, and each functional module in the functional module set of the application is used to implement interactive operations with the terminal device based on establishing a connection channel with the terminal device;

[0010] Among them, different functional modules correspond to different interactive operations, and different functional modules correspond to different configuration conditions.

[0011] In the above method, preferably, obtaining the first input trajectory includes:

[0012] If the application is in a running state, monitoring a first movement trajectory of the cursor;

[0013] If the first input trajectory satisfies a first configuration condition, controlling the first functional module to be in an enabled state includes:

[0014] If the first movement track exceeds a first edge of a display area of the first display screen, controlling the first functional module to be in an enabled state;

[0015] The first functional module in the enabled state responding to the second input trace based on the first configuration condition includes:

[0016] The first functional module in the enabled state responds to the first movement trajectory based on the first configuration condition and notifies the terminal device through the connection channel to display a mapping cursor of the cursor.

[0017] In the above method, preferably, the first functional module in the enabled state responds to the first movement trajectory based on the first configuration condition and notifies the terminal device through the connection channel to display a mapping cursor of the cursor, including:

[0018] Creating a virtual screen based on the connection channel, where the virtual screen is a virtual screen corresponding to the second display screen of the terminal device;

[0019] Determine position information of a second movement trajectory on the virtual screen where the first movement trajectory exceeds a display area of a first display screen of the electronic device;

[0020] The terminal device is notified of the location information based on the connection channel, so that the terminal device displays a mapping cursor of the cursor on a second display screen.

[0021] In the above method, preferably, obtaining the first input trajectory includes:

[0022] If the application is in a running state, monitoring a first movement trajectory of the cursor;

[0023] If the first input trajectory satisfies a first configuration condition, controlling the first functional module to be in an enabled state includes:

[0024] If the first movement track exceeds a first edge of a display area of the first display screen, controlling the first functional module to be in an enabled state;

[0025] The first functional module in the enabled state responding to the second input trace based on the first configuration condition includes:

[0026] The first functional module in the enabled state obtains a second captured image obtained by the second camera of the terminal device through the connection channel, and the second captured image is used to provide the target program with the first captured image of the first camera of the electronic device for displaying in a graphical interface of the target program;

[0027] If the second movement track exceeds the first edge of the display area of the first display screen, the terminal device is notified through the connection channel to turn off the collection of the second camera.

[0028] In the above method, preferably, if the first input trajectory satisfies the first configuration condition, controlling the first functional module to be in an enabled state includes:

[0029] Obtaining the number of times the first movement trajectory satisfies a first configuration condition; if the number of times satisfies a first threshold condition, controlling the first functional module to be in an enabled state;

[0030] Alternatively, if the first movement track exceeds the first edge of the display area of the first display screen by a first distance and then exceeds the second distance, the first functional module is controlled to be in an enabled state.

[0031] In the above method, preferably, if the first input trajectory satisfies the first configuration condition, controlling the first functional module to be in an enabled state includes:

[0032] If the first movement trajectory meets a first configuration condition and the first camera is in a working state, the first functional module is controlled to be in an enabled state.

[0033] In the above method, preferably, when there are multiple to-be-selected devices corresponding to the electronic device, the terminal device corresponding to the first functional module is a device that meets the first screening condition among the multiple to-be-selected devices;

[0034] The first screening condition includes at least one of the following:

[0035] The marked orientation of the terminal device relative to the electronic device matches the trajectory direction of the first input trajectory;

[0036] The terminal device has a second display screen and is capable of responding to the second input trajectory;

[0037] The interconnection priority of the terminal device is the highest among the multiple devices to be selected;

[0038] The function type that the terminal device can implement matches the first function module.

[0039] The above method is preferably wherein:

[0040] The marked orientation of the terminal device relative to the electronic device is obtained in response to an orientation setting operation for the terminal device;

[0041] Or, the marked orientation of the terminal device relative to the electronic device is determined based on configuration information of the electronic device;

[0042] Alternatively, the marked orientation of the terminal device relative to the electronic device is obtained by positioning the terminal device through the connection channel;

[0043] Alternatively, the marked position of the terminal device relative to the electronic device is the most recently updated deployment position.

[0044] An electronic device, comprising:

[0045] An input device for obtaining a first input trajectory;

[0046] a processor, configured to control a first functional module to be in an enabled state if the first input trajectory satisfies a first configuration condition;

[0047] The first functional module in the enabled state responds to the second input trace based on the first configuration condition. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0049] Figure 1 A flowchart of a processing method provided in an embodiment of the present application;

[0050] Figure 2 This is an example diagram of controlling the cursor by a mouse in an embodiment of the present application;

[0051] Figure 3 An example diagram of a control interface for an application in an electronic device;

[0052] Figure 4 This is an example diagram of a cursor transitioning from a laptop computer to a tablet device in an embodiment of the present application;

[0053] Figure 5 This is another example diagram of a cursor transitioning from a laptop computer to a tablet device in an embodiment of the present application;

[0054] Figure 6 This is an example diagram of a cursor moving from a laptop computer to a tablet device and then back to the laptop computer in an embodiment of the present application;

[0055] Figure 7 This is an example diagram of calling the camera of a tablet device in an embodiment of the present application;

[0056] Figure 8 This is an example diagram of calling the camera of a tablet device and then turning off the camera in an embodiment of the present application;

[0057] Figure 9 This is another example diagram of a cursor transitioning from a laptop computer to a tablet device in an embodiment of the present application;

[0058] Figure 10 This is another example diagram of calling the camera of a tablet device in an embodiment of the present application;

[0059] Figure 11 This is another example diagram of a cursor transitioning from a laptop computer to a tablet device in an embodiment of the present application;

[0060] Figure 12 This is another example diagram of calling the camera of a tablet device in an embodiment of the present application;

[0061] Figure 13 This is an example diagram of selecting a terminal device in a scenario where the cursor spans from a laptop computer to a tablet device in an embodiment of the present application;

[0062] Figure 14 This is another example diagram of selecting a terminal device in a scenario where the cursor moves from a laptop computer to a tablet device in an embodiment of the present application;

[0063] Figure 15 This is another example diagram of selecting a terminal device in a scenario where the cursor spans from a laptop computer to a tablet device in an embodiment of the present application;

[0064] Figure 16 This is an example diagram of selecting a terminal device in a scenario of calling a camera of a tablet device in an embodiment of the present application;

[0065] Figure 17 A schematic diagram of the structure of a processing device provided in an embodiment of the present application;

[0066] Figure 18 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0067] Figure 19 An example diagram for implementing cross-device control for this application. DETAILED DESCRIPTION

[0068] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0069] refer to Figure 1 The figure shows a flowchart of a processing method provided in an embodiment of the present application. The method can be applied to electronic devices equipped with functional modules, such as mobile phones, laptops, or tablet devices. The technical solution in this embodiment is mainly used to reduce the operational complexity of user-enabled functional modules to improve the user experience.

[0070] Specifically, the method in this embodiment may include the following steps:

[0071] Step 101: Obtain a first input trajectory.

[0072] The electronic device has a first display screen, and the first input track may be an input track of a cursor in a display area of the first display screen.

[0073] For example, Figure 2 As shown in , taking the electronic device as a laptop computer as an example, the user moves the mouse to make the cursor slide in the display area of the laptop computer display screen. In this embodiment, the input trajectory of the cursor sliding in the display area is collected.

[0074] Step 102 : Detect whether the first input trajectory meets the first configuration condition. If yes, execute step 103 .

[0075] The first configuration condition is a configuration condition for enabling the first functional module. When the first input trace satisfies the first configuration condition, it is determined that the user needs to enable the first functional module.

[0076] Step 103: Control the first functional module to be in an enabled state.

[0077] The first functional module in the enabled state responds to the second input trace based on the first configuration condition. The first functional module responds to the second input trace so that the electronic device can implement the function corresponding to the first functional module.

[0078] For example, taking the first functional module as an example, when the first input trajectory meets the first configuration condition, the first functional module is enabled so that the first functional module can respond to the second input trajectory and call the network camera to capture images for the electronic device.

[0079] For another example, taking the first functional module as a functional module for realizing keyboard and mouse crossing, when the first input trajectory meets the first configuration condition, the first functional module is enabled so that the first functional module can respond to the second input trajectory, and the mapped cursor corresponding to the cursor is displayed on other devices, and other devices can respond to the input operation of the mapped cursor.

[0080] For another example, taking the first functional module as a functional module that calls the interconnected clipboard, when the first input trajectory meets the first configuration condition, the first functional module is enabled so that the first functional module can respond to the second input trajectory, and then copy and paste text and pictures between the electronic device and other devices.

[0081] As can be seen from the above scheme, in a processing method provided by an embodiment of the present application, whether the corresponding first functional module is in an enabled state is controlled by whether the first input trajectory satisfies the first configuration condition. In this way, after the first input trajectory satisfies the first configuration condition and thus enables the first functional module, the first functional module in the enabled state can respond to the second input trajectory based on the first configuration condition. It can be seen that in this embodiment, the user does not need to start the control interface corresponding to the first functional module, nor does it need to enable the first functional module on the control interface. Instead, the enabling trigger of the first functional module can be achieved by monitoring the user's first input trajectory, thereby reducing the operational complexity of the user enabling the first functional module and improving the user experience.

[0082] Based on the above embodiment, in one implementation, the first functional module belongs to a functional module set of an application. For example, Figure 3 The figure shows a control interface of an application. The application has a function module set, which includes multiple function modules. The function module corresponding to the first configuration condition satisfied by the first input trajectory is the first function module, such as the function module of a webcam or the function module of keyboard and mouse traversal.

[0083] The first configuration condition is a configuration condition for the first functional module, and each functional module in the functional module set of the application is used to establish a connection channel with the terminal device, thereby realizing interactive operations with the terminal device.

[0084] For example, the application program may be an interconnected application deployed in an electronic device, which contains a plurality of functional modules that can realize interactive operations with other devices, such as a functional module for calling a network camera, a functional module for realizing keyboard and mouse crossing (i.e., cross-device control), a functional module for calling an interconnected clipboard, etc. Each functional module establishes a connection channel with the corresponding terminal device, and based on the connection channel, the functional module realizes interactive operations with the terminal device. For example, the functional module for calling a network camera realizes interactive operations between the electronic device and the network camera based on the connection channel between the electronic device and the network camera; the functional module for realizing keyboard and mouse crossing, based on the connection channel between the electronic device and the terminal device, moves the cursor on the display screen of the electronic device to the display screen of the terminal device to realize cross-device control between the electronic device and the terminal device; the functional module for calling an interconnected clipboard, based on the connection channel between the electronic device and the terminal device, copies and pastes text and / or pictures between the electronic device and the terminal device.

[0085] Among them, different functional modules correspond to different interactive operations, and different functional modules correspond to different configuration conditions.

[0086] For example, taking interconnected applications as an example, the configuration conditions of the functional module enabling the webcam may be: the cursor slides in a "Z" shape in the display area, and the corresponding interactive operation may be to use the webcam to capture images and transmit them to the interconnected application; the configuration conditions of the functional module enabling keyboard and mouse crossing may be: the cursor slides in the display area of the electronic device and exceeds a certain side edge, and the corresponding interactive operation may be that the terminal device to which the cursor crosses responds to the cursor input trajectory and displays the cursor movement trajectory in the display area of the terminal device; the configuration conditions of the functional module enabling application cross-screen may be: the cursor slides in a circle in the display area, and the corresponding interactive operation may be that the window of a certain application spans to the interconnected device; the configuration conditions of the functional module enabling screen projection may be: the cursor draws a spiral line in the display area, and the corresponding interactive operation may be: projecting the contents of the display area to the interconnected device.

[0087] It can be seen that in this embodiment, corresponding configuration conditions can be set for each functional module in the application program, thereby eliminating the need for the user to open the control interface (such as Figure 3 The control interface shown in the figure does not require the user to perform enabling operations on the control interface. The user can enable the corresponding functional module by moving the mouse to change the input trajectory of the cursor, thereby reducing the operational complexity of the user enabling any functional module and improving the user experience.

[0088] based on Figure 1 In the illustrated embodiment, in one implementation, in step 101 , the first movement trajectory of the cursor may be monitored while the application is in a running state.

[0089] Among them, if the application is in running state, it means that the user is using the application and may need to enable one of the functional modules. At this time, the first movement trajectory of the cursor, that is, the first input trajectory, can be monitored to determine whether there is a first functional module that meets the corresponding first configuration condition.

[0090] Based on this, the first configuration condition may be: the first movement track exceeds the first edge of the display area of the first display screen. The first edge is the area edge of the display area, such as the left edge, the right edge, the upper edge, etc. For example, Figure 4 As shown in , the first display screen is a display screen of an electronic device, such as a display screen of a laptop computer. The user moves the mouse so that a first movement track of the cursor slides toward a first edge of the display area and exceeds the first edge. Figure 4 The first edge in the step 103 is the right edge of the display area. Accordingly, if the first movement track exceeds the first edge of the display area of the first display screen in step 103, the first functional module can be controlled to be in an enabled state, and the first functional module at this time can be a keyboard and mouse traversal functional module.

[0091] Based on this, the first functional module in the enabled state responds to the first movement trajectory, i.e., the second input trajectory, based on the first configuration condition, and notifies the terminal device through the connection channel of the mapped cursor of the displayed cursor. Thus, in this embodiment, cursor traversal between the electronic device and the terminal device can be achieved, thereby realizing cross-device control from the electronic device to the terminal device.

[0092] For example, Figure 4 As shown in , when a first cursor movement trajectory is detected exceeding a first edge of a display area of a first display screen, a keyboard and mouse crossover function module is enabled, and a connection channel is established between the laptop computer and the tablet device, thereby achieving interconnection between the laptop computer and the tablet device. The keyboard and mouse crossover function module in the laptop computer, in response to the first cursor movement trajectory, notifies the tablet device to display a mapped cursor. The mapped cursor on the tablet device moves based on the movement trajectory of the cursor in the laptop computer, thereby achieving cursor crossover from the laptop computer to the tablet device.

[0093] In a specific implementation, in this embodiment, a virtual screen can be created on the electronic device based on the connection channel between the electronic device and the terminal device. The virtual screen is not displayed on the electronic device, but the virtual screen is a virtual screen corresponding to the second display screen of the terminal device. Subsequently, the position information of the second movement trajectory on the virtual screen is determined when the first movement trajectory exceeds the display area of the first display screen of the electronic device. The second movement trajectory is a portion of the first movement trajectory. For example, the first movement trajectory includes: a third movement trajectory that does not exceed the display area of the first display screen and a second movement trajectory that exceeds the display area of the first display screen. The second movement trajectory corresponds to the virtual screen, that is, the cursor moves on the virtual screen after exceeding the display area of the first display screen, and the movement of the cursor on the virtual screen generates the second movement trajectory. Finally, the terminal device is notified of the above position information based on the connection channel between the electronic device and the terminal device, so that the terminal device displays a mapped cursor of the cursor on the second display screen according to the position information. As a result, in this embodiment, the cursor can be crossed between the electronic device and the terminal device through the creation of a virtual screen, thereby realizing cross-device control from the electronic device to the terminal device.

[0094] For example, Figure 5As shown in , a virtual screen is created on a laptop computer, which corresponds to the display screen of a tablet device. The cursor moves in the physical display screen and the virtual screen of the laptop computer to generate a first movement trajectory, wherein the movement trajectory on the virtual screen, which exceeds the display area of the laptop computer's display screen, is a second movement trajectory. In this embodiment, the position information of the second movement trajectory on the virtual screen is determined, and the position information is notified to the tablet device based on the connection channel between the tablet device, so that the tablet device displays a mapping cursor of the cursor on the tablet display screen, thereby realizing the passage of the cursor from the laptop computer to the tablet device.

[0095] Based on the above implementation, after controlling the first functional module to be in an enabled state, the user can control the mouse to move the cursor so that it exceeds the display area of the first display screen and then moves to the virtual screen, where the mapped cursor is displayed on the second display screen of the terminal device. Based on this, the terminal device can respond to input operations of the mapped cursor. Afterwards, the user can control the mouse to move the cursor so that it moves from the virtual screen to the display area of the first display screen, where the cursor is displayed on the first display screen of the electronic device. Based on this, the electronic device can respond to input operations of the cursor.

[0096] For example, Figure 6 As shown in , the tablet device displays a mapping cursor of the cursor on the tablet display screen. When the mapping cursor exceeds the virtual screen and passes over the first edge of the laptop display screen, such as the right edge, the cursor is displayed on the laptop, thereby achieving the cursor crossing between the laptop and the tablet device.

[0097] based on Figure 1 In another implementation of the embodiment shown, in step 101 , the first movement trajectory of the cursor may be monitored while the application is in a running state.

[0098] Among them, if the application is in running state, it means that the user is using the application and may need to enable one of the functional modules. At this time, the first movement trajectory of the cursor, i.e. the first input trajectory, can be monitored to determine whether there is a first functional module that meets the first configuration condition.

[0099] Based on this, the first configuration condition may be that the first movement trajectory exceeds the first edge of the display area of the first display screen. Accordingly, in step 103, if the first movement trajectory exceeds the first edge of the display area of the first display screen, the first functional module may be controlled to be enabled. In this case, the first functional module may be a functional module for calling a network camera.

[0100] Based on this, the first functional module in the enabled state obtains the second captured image obtained by the second camera of the terminal device through the connection channel. The second captured image is used to provide the target program with the first captured image of the first camera of the electronic device to be displayed in the graphical interface of the target program. Therefore, in this embodiment, the camera of the terminal device can be called on the electronic device, thereby realizing network camera sharing.

[0101] For example, Figure 7 As shown in , taking the target application as a conferencing application on a laptop computer as an example, when the interconnected application on the laptop computer is running, when the first movement trajectory of the cursor is monitored to exceed the first edge of the display area of the first display screen, the function module of the webcam is enabled to be called, and a connection channel is established between the laptop computer and the tablet device, thereby realizing the interconnection between the laptop computer and the tablet device. The function module of calling the webcam in the laptop computer notifies the tablet device's camera to start and perform image acquisition through the connection channel, and further transmits the acquired image, i.e., the second acquired image, back to the laptop computer. The conferencing application on the laptop computer displays the image acquired by the tablet device's camera as the image acquired by the laptop computer's camera in the graphical interface, thereby realizing the laptop computer's function of calling the webcam.

[0102] Based on the above implementation, after the second captured image is displayed in the graphical interface of the target program, if the second movement trajectory of the cursor exceeds the first edge of the display area of the first display screen, the terminal device is notified through the connection channel to turn off the capture of the second camera.

[0103] Among them, the second movement trajectory is different from the first movement trajectory. The first movement trajectory is the movement trajectory of enabling the first functional module, and the second movement trajectory is the movement trajectory of the cursor in the display area of the first display screen after enabling the first functional module. That is to say, the movement trajectory of the cursor is continuously monitored on the electronic device. When the first movement trajectory of the cursor exceeds the first edge of the display area of the first display screen, the first functional module is controlled to be in an enabled state. At this time, the first functional module obtains the second captured image obtained by the second camera of the terminal device through the connection channel and displays it as the first captured image of the first camera of the electronic device on the image interface of the target application. At the same time, the movement trajectory of the cursor continues to be monitored. When the second movement trajectory of the cursor (the movement trajectory of the cursor after enabling the first functional module) exceeds the first edge of the display area of the first display screen, the terminal device is notified through the connection channel to turn off the capture of the second camera. In this way, the electronic device can realize the call control of the network camera (i.e., the camera of the tablet device).

[0104] It should be noted that when the first functional module is a module that calls a network camera, it is necessary to determine that the first camera is in an operational state before controlling the first functional module to be in an enabled state. That is, in this embodiment, if the first motion trajectory satisfies the first configuration condition and the first camera is in an operational state, the first functional module is controlled to be in an enabled state. If it is determined that the first camera is in an operational state and the first motion trajectory satisfies the first configuration condition, it can be determined that the user needs to call the network camera, thereby enabling the first functional module.

[0105] It can be seen that in this embodiment, the working status of the first camera can be determined to avoid the false triggering caused by triggering the calling of the first functional module of the network camera when the first configuration condition is met.

[0106] For example, Figure 8 As shown in , the laptop computer conference application is using its own camera to capture images. When the movement trajectory of the cursor on the laptop exceeds the left edge of the display screen for the first time, the electronic device determines that the user needs to call the webcam. At this time, the function module for calling the webcam is enabled. The function module of the webcam is called, and the tablet device is notified to start the camera through the connection channel between the electronic device and the tablet device, so that the camera on the tablet device captures images and transmits them back to the laptop computer for display on the graphical interface of the conference application. When the movement trajectory of the cursor on the laptop computer exceeds the left edge of the display screen again, the electronic device notifies the tablet device through the connection channel to turn off the camera, or directly turns off the function module for calling the webcam. As a result, the image captured by the camera of the tablet device is no longer displayed on the graphical interface of the conference application of the laptop computer.

[0107] Based on the above implementation scheme, in this embodiment, the number of times the first movement trajectory meets the first configuration condition can be obtained. If the number meets the first threshold condition, the first functional module is controlled to be in an enabled state.

[0108] The first threshold condition may be: the number of times the first configuration condition is satisfied is greater than or equal to a target threshold. The target threshold is a positive integer greater than or equal to 2. Based on this, in this embodiment, the first movement trajectory of the cursor is monitored. If the number of times the first movement trajectory of the cursor exceeds the first edge of the display area of the first display screen reaches the target threshold, the first functional module may be controlled to be enabled. Thus, in this embodiment, the setting of the target threshold can avoid false triggering of the first functional module caused by the first configuration condition being satisfied only once.

[0109] For example, Figure 9As shown in the figure, if the cursor on the laptop exceeds the right edge twice in a row as the user operates the mouse, it indicates that the user needs to pass through the keyboard and mouse to the tablet device. In this case, the keyboard and mouse pass-through function module in the connected application on the laptop is enabled. This function module can notify the tablet device of the displayed cursor through the connection channel with the tablet device. This can avoid the situation where the keyboard and mouse pass-through is mistakenly triggered by the user operating the mouse so that the cursor exceeds the right edge once.

[0110] For example, Figure 10 As shown in , the movement trajectory of the cursor on the laptop computer exceeds the left edge three times in a row as the user operates the mouse, indicating that the user needs to use the webcam. At this time, the function module of calling the webcam in the interconnected application on the laptop is enabled. In this way, the function module of calling the webcam can notify the tablet device through the connection channel between the tablet device to start the camera and transmit the collected images back to the laptop computer. The laptop computer displays these images in the graphical interface of the conference application, thereby avoiding the false triggering of the webcam when the user operates the mouse and uses the cursor to exceed the left edge once.

[0111] Based on the above implementation scheme, the first movement trajectory can be detected in this embodiment. If the first movement trajectory exceeds the first edge of the display area of the first display screen by a first distance and then exceeds a second distance, the first functional module is controlled to be in an enabled state.

[0112] The values of the first distance and the second distance can be set based on the business scenario. Based on this, in this embodiment, the first movement trajectory of the cursor is monitored. If the first movement trajectory of the cursor exceeds the first edge of the display area of the first display screen by a first distance and continues to move beyond the second distance, the first functional module can be controlled to be in an enabled state. Therefore, in this embodiment, the second distance can be set to avoid the false triggering of the first functional module caused by the first movement trajectory exceeding the first edge by the first distance.

[0113] For example, Figure 11 As shown in , the movement trajectory of the cursor on the laptop computer exceeds the right edge by 3 cm as the user operates the mouse, and then continues to exceed 5 cm, indicating that the user needs to cross the keyboard and mouse to the tablet device. At this time, the keyboard and mouse cross-over function module in the interconnected application on the laptop is enabled, so that the keyboard and mouse cross-over function module can notify the tablet device to display the mapped cursor of the cursor through the connection channel between the tablet device, thereby avoiding the false triggering of the keyboard and mouse cross-over when the user operates the mouse so that the cursor exceeds 3 cm from the right edge.

[0114] For example, Figure 12As shown in the figure, if the cursor on the laptop continues to move beyond the left edge by 2 cm and then 3 cm as the user operates the mouse, it indicates that the user needs to use the webcam. In this case, the webcam call function module in the connected application on the laptop is enabled. This module can then notify the tablet device through the connection channel to start the camera and transmit the captured images back to the laptop, which then displays these images in the graphical interface of the conference application. This can prevent the webcam from being triggered by the user operating the mouse and moving the cursor beyond the left edge by 2 cm.

[0115] In a specific implementation, the electronic device corresponds to multiple devices to be selected, such as a mobile phone, tablet device, or other laptop computer that can establish a connection channel with the laptop computer. In this embodiment, when the electronic device corresponds to multiple devices to be selected, the terminal device corresponding to the first functional module is a device that meets the first screening condition among the multiple devices to be selected.

[0116] The first screening condition may include at least one of the following:

[0117] In one implementation, the first screening condition may be that the marked orientation of the terminal device relative to the electronic device matches the trajectory direction of the first input trajectory.

[0118] Based on this, after the first functional module is enabled, when the electronic device implements the interactive operation corresponding to the first functional module, it selects one of the selected devices from multiple selected devices as the terminal device (that is, its marking orientation matches the first input trajectory) to establish a connection channel, thereby performing corresponding interactive operations between the electronic device and the terminal device based on the connection channel, such as keyboard and mouse crossing or application split screen.

[0119] For example, Figure 13 As shown in the figure, tablet device 1 is in the left position relative to the laptop computer, and tablet device 2 is in the right position relative to the laptop computer. Since the first input trajectory is a trajectory toward the right edge and beyond the right edge, the keyboard and mouse cross-over function module on the laptop computer enables the tablet device 2 in the right position as the terminal device to establish a connection channel, and the mapped cursor is displayed on the display screen of tablet device 2, thereby realizing keyboard and mouse cross-over between the laptop computer and tablet device 2.

[0120] The marked orientation of the terminal device relative to the electronic device is obtained in response to an orientation setting operation for the terminal device. Specifically, on the control interface of the electronic device, the user can set the orientation of each terminal device connected to the electronic device relative to the electronic device. In this embodiment, the marked orientation of the terminal device relative to the electronic device is obtained based on the generated orientation setting operation. For example, the user sets the mobile phone to the lower side relative to the laptop; for another example, the user sets the tablet device to the right side relative to the laptop.

[0121] Alternatively, the marked orientation of the terminal device relative to the electronic device can be determined based on the configuration information of the electronic device. The configuration information of the electronic device is the default configuration information after the electronic device is started, and the default marked orientation of each terminal device relative to the electronic device is specified in the configuration information. For example, in a laptop computer, a tablet device is positioned to the right relative to the laptop computer by default; in another example, a mobile phone is positioned to the bottom relative to the laptop computer by default.

[0122] Alternatively, the marked position of the terminal device relative to the electronic device can be obtained by locating the terminal device through a connection channel. The connection channel can be a connection channel established based on Bluetooth or WiFi. In this embodiment, communication can be carried out between the electronic device and the terminal device through the connection channel to locate the real-time position of the terminal device relative to the electronic device in real time, thereby obtaining the marked position of the terminal device relative to the electronic device. For example, on a laptop computer, a positioning request is broadcast through a Bluetooth channel, and the real-time position of these terminal devices relative to the laptop computer, i.e., the marked position, is determined based on the information fed back by terminal devices such as mobile phones and tablet devices.

[0123] Alternatively, the marked orientation of the terminal device relative to the electronic device is the deployment orientation that was most recently updated. The terminal device may move relative to the electronic device, for example, a mobile phone moves from the left side to the right side relative to a laptop computer. Based on this, the deployment orientation can be updated regularly or irregularly between the terminal device and the electronic device, and the method of updating the deployment orientation can be achieved by positioning the terminal device through a connection channel. Based on this, a terminal device can have multiple deployment orientations relative to the electronic device, and these deployment orientations are sorted in the update list according to the update time, and the deployment orientations in the update list are the orientations obtained by historical positioning between the terminal device and the electronic device. Therefore, in this embodiment, when determining the marked orientation of the terminal device relative to the electronic device, the update time corresponding to each deployment orientation can be searched in the update list, and then the deployment orientation with the largest update time, that is, the most recently updated one, is determined as the marked orientation of the terminal device relative to the electronic device.

[0124] It can be seen that in this embodiment, the marked position of the terminal device relative to the electronic device can be obtained in multiple ways, and then the terminal device can be screened out from multiple candidate devices based on the obtained position.

[0125] In one implementation, the terminal device has a second display screen and is capable of responding to a second input trajectory, wherein the second display screen indicates that the terminal device can output a mapped cursor, and the ability of the terminal device to respond to the second input trajectory indicates that the terminal device can respond to the movement trajectory of the mapped cursor.

[0126] For example, a tablet device can have a display screen and can respond to the movement of a cursor. Based on this, after the first functional module is enabled, when the laptop computer implements the interactive operation corresponding to the first functional module, it selects the tablet device (which has a display screen and can respond to the movement of a cursor) from the mobile phone and tablet devices to establish a connection channel. The laptop computer and the tablet device can then perform corresponding interactive operations based on the connection channel, such as keyboard and mouse traversal or application split-screen.

[0127] Based on this, after the first functional module is enabled, when the electronic device implements the interactive operation corresponding to the first functional module, it selects one of the selected devices from multiple selected devices as the terminal device (that is, it has a second display screen and can respond to a second input trajectory) to establish a connection channel, thereby performing corresponding interactive operations between the electronic device and the terminal device based on the connection channel, such as keyboard and mouse crossing or application split screen.

[0128] For example, Figure 14 As shown in the figure, tablet device 1 has a display screen and can respond to the input trajectory of the cursor but is located on the left side of the laptop computer, while the speaker is located on the right side of the laptop computer but has no display screen. Tablet device 2 has a display screen and can respond to the input trajectory of the cursor but is located on the right side of the laptop computer. Since the first input trajectory is a trajectory toward the right edge and beyond the right edge, based on this, the functional module that enables keyboard and mouse cross-over on the laptop computer will establish a connection channel with the tablet device 2 that has a display screen and can respond to the input trajectory of the cursor and is located on the right side of the laptop computer as a terminal device, and display the mapped cursor on the display screen of tablet device 2. Tablet device 2 can respond to the input trajectory of the cursor, thereby realizing keyboard and mouse cross-over between the laptop computer and tablet device 2.

[0129] In another implementation, the interconnection priority of the terminal device is the highest among multiple devices to be selected.

[0130] Based on this, after the first functional module is enabled, when the electronic device implements the interactive operation corresponding to the first functional module, it selects one of the multiple candidate devices as the terminal device (i.e., the one with the highest interconnection priority) to establish a connection channel. As a result, the electronic device and the terminal device perform corresponding interactive operations based on the connection channel, such as keyboard and mouse traversal or application split screen.

[0131] For example, Figure 15 As shown in the figure, tablet device 1 has a display screen and can respond to the input trajectory of the cursor but is located on the left side of the laptop computer. Tablet device 2 and tablet device 3 both have display screens and can respond to the input trajectory of the cursor and are both located on the right side of the laptop computer. The interconnection priority of tablet device 2 is higher than that of tablet device 3. Since the first input trajectory is a trajectory toward the right edge and beyond the right edge, based on this, the keyboard and mouse crossing function module is enabled on the laptop computer and tablet device 2 (which has a display screen and can respond to the input trajectory of the cursor and is located on the right side of the laptop computer and has a higher priority) is used as a terminal device to establish a connection channel, and the mapped cursor of the cursor is displayed on the display screen of tablet device 2. Tablet device 2 can respond to the input trajectory of the cursor, thereby realizing keyboard and mouse crossing between the laptop computer and tablet device 2.

[0132] In another implementation, the function type that the terminal device can implement matches the first function module.

[0133] Based on this, after the first functional module is enabled, when the electronic device implements the interactive operation corresponding to the first functional module, it selects one of the selected devices from multiple selected devices as the terminal device (that is, the functional type matches the first functional module) to establish a connection channel, thereby performing corresponding interactive operations between the electronic device and the terminal device based on the connection channel, such as keyboard and mouse crossing or application split screen.

[0134] For example, Figure 16 As shown in , tablet device 1 has a display screen and can respond to the input trajectory of the cursor but is located on the left side of the laptop computer. Tablet device 2 and tablet device 3 both have display screens and can respond to the input trajectory of the cursor and are both located on the right side of the laptop computer, and tablet device 3 has a camera that can realize image acquisition, because the first input trajectory is a trajectory toward the right edge and beyond the right edge. Based on this, the laptop computer enables the function module of calling the webcam and establishes a connection channel with tablet device 3 (which has a display screen and can respond to the input trajectory of the cursor and is located on the right side of the laptop computer and has a camera) as a terminal device, and accordingly notifies tablet device 3 to start the camera for image acquisition and transmit it back to the graphical interface of the laptop computer's conference application for display. In this way, the laptop computer can call the webcam of tablet device 3.

[0135] It can be seen that in this embodiment, by setting a plurality of first screening conditions, a more suitable terminal device can be screened out from a plurality of devices to be selected, so that the first functional module of the electronic device can realize the corresponding function.

[0136] refer to Figure 17 , is a schematic diagram of the structure of a processing device provided in an embodiment of the present application, which may include the following units:

[0137] The trajectory obtaining unit 1701 is configured to obtain a first input trajectory;

[0138] An enabling control unit 1702, configured to control the first functional module to be in an enabled state if the first input trajectory satisfies a first configuration condition;

[0139] The first functional module in the enabled state responds to the second input trace based on the first configuration condition.

[0140] As can be seen from the above scheme, in a processing device provided by an embodiment of the present application, whether the corresponding first functional module is in an enabled state is controlled by whether the first input trajectory satisfies the first configuration condition. In this way, after the first input trajectory satisfies the first configuration condition and thus enables the first functional module, the first functional module in the enabled state can respond to the second input trajectory based on the first configuration condition. It can be seen that in this embodiment, there is no need for the user to launch the control interface corresponding to the first functional module, nor is there a need to enable the first functional module on the control interface. Instead, the enabling trigger of the first functional module can be achieved by monitoring the user's first input trajectory, thereby reducing the complexity of the user's operation to enable the first functional module and improving the user experience.

[0141] In one implementation, the first functional module belongs to a functional module set of an application, the first configuration condition is a configuration condition for the first functional module, and each functional module in the functional module set of the application is used to implement interactive operations with the terminal device based on establishing a connection channel with the terminal device; wherein different functional modules correspond to different interactive operations, and different functional modules correspond to different configuration conditions.

[0142] In one implementation, the trajectory obtaining unit 1701 is specifically configured to: if the application is in a running state, monitor a first movement trajectory of the cursor;

[0143] Accordingly, the enabling control unit 1702 is specifically configured to: if the first movement track exceeds the first edge of the display area of the first display screen, control the first functional module to be in an enabled state;

[0144] The first functional module in the enabled state responding to the second input trace based on the first configuration condition includes:

[0145] The first functional module in the enabled state responds to the first movement trajectory based on the first configuration condition and notifies the terminal device through the connection channel to display the mapping cursor of the cursor. Specifically:

[0146] A virtual screen is created based on the connection channel, where the virtual screen is a virtual screen corresponding to the second display screen of the terminal device; position information of the second movement trajectory where the first movement trajectory exceeds the display area of the first display screen of the electronic device is determined on the virtual screen; and the terminal device is notified of the position information based on the connection channel so that the terminal device displays a mapping cursor of the cursor on the second display screen.

[0147] In one implementation, the trajectory obtaining unit 1701 is specifically configured to: if the application is in a running state, monitor a first movement trajectory of the cursor; accordingly, the enabling control unit 1702 is specifically configured to: if the first movement trajectory exceeds a first edge of a display area of the first display screen, control the first functional module to be in an enabled state;

[0148] The first functional module in the enabled state responding to the second input trace based on the first configuration condition includes:

[0149] The first functional module in the enabled state obtains a second captured image obtained by the second camera of the terminal device through the connection channel, and the second captured image is used to provide the target program with the first captured image of the first camera of the electronic device for displaying in a graphical interface of the target program;

[0150] If the second movement track exceeds the first edge of the display area of the first display screen, the terminal device is notified through the connection channel to turn off the collection of the second camera.

[0151] In one implementation, the enabling control unit 1702 is specifically configured to:

[0152] Obtaining the number of times the first movement trajectory satisfies a first configuration condition; if the number of times satisfies a first threshold condition, controlling the first functional module to be in an enabled state;

[0153] Alternatively, if the first movement track exceeds the first edge of the display area of the first display screen by a first distance and then exceeds the second distance, the first functional module is controlled to be in an enabled state.

[0154] In one implementation, the enabling control unit 1702 is specifically configured to:

[0155] If the first movement trajectory meets a first configuration condition and the first camera is in a working state, the first functional module is controlled to be in an enabled state.

[0156] In one implementation, when there are multiple to-be-selected devices corresponding to the electronic device, the terminal device corresponding to the first functional module is a device that satisfies a first screening condition among the multiple to-be-selected devices;

[0157] The first screening condition includes at least one of the following:

[0158] The marked orientation of the terminal device relative to the electronic device matches the trajectory direction of the first input trajectory;

[0159] The terminal device has a second display screen and is capable of responding to the second input trajectory;

[0160] The interconnection priority of the terminal device is the highest among the multiple devices to be selected;

[0161] The function type that the terminal device can implement matches the first function module.

[0162] In a specific implementation, the marked orientation of the terminal device relative to the electronic device is obtained in response to an orientation setting operation for the terminal device;

[0163] Or, the marked orientation of the terminal device relative to the electronic device is determined based on configuration information of the electronic device;

[0164] Alternatively, the marked orientation of the terminal device relative to the electronic device is obtained by positioning the terminal device through the connection channel;

[0165] Alternatively, the marked position of the terminal device relative to the electronic device is the most recently updated deployment position.

[0166] It should be noted that the specific implementation of each unit in this embodiment can refer to the corresponding content in the previous text and will not be described in detail here.

[0167] refer to Figure 18 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, and the electronic device may include the following structure:

[0168] Input device 1801, for obtaining a first input trajectory;

[0169] Processor 1802, configured to control a first functional module to be in an enabled state if the first input trajectory satisfies a first configuration condition;

[0170] The first functional module in the enabled state responds to the second input trace based on the first configuration condition.

[0171] As can be seen from the above scheme, in an electronic device provided by an embodiment of the present application, whether the corresponding first functional module is in an enabled state is controlled by whether the first input trajectory satisfies the first configuration condition. In this way, after the first input trajectory satisfies the first configuration condition and thus enables the first functional module, the first functional module in the enabled state can respond to the second input trajectory based on the first configuration condition. It can be seen that in this embodiment, the user does not need to start the control interface corresponding to the first functional module, nor does it need to enable the first functional module on the control interface. Instead, the enabling trigger of the first functional module can be achieved by monitoring the user's first input trajectory, thereby reducing the complexity of the user's operation to enable the first functional module and improving the user experience.

[0172] Taking the first functional module as an example, the cross-device control functional module, the following describes the keyboard and mouse traversal between a mobile phone and a laptop:

[0173] When the paired devices, i.e. the mobile phone and laptop, are online, even if the two are not connected, if the user continues to move the mouse towards the left virtual screen that has been connected and displayed, a virtual screen can be automatically created, a correspondence between the virtual screen and the other device can be established, and the mapped cursor is displayed on the other device, facilitating quick cross-screen control.

[0174] like Figure 19 As shown in , a pairing relationship can be established between a first device (such as a laptop) and a second device (such as a mobile phone). The following describes the process of automatically triggering the cross-device control function between the two devices:

[0175] First, the second device is online and supports cross-screen control. The second device has been connected to the first device before and is stored in the left position (i.e., the marked position mentioned above) on the first device, or the second device has not been connected to the first device but is in the right position by default on the first device.

[0176] When the mouse is used to control the edge of the first device, if the second device has not yet established the cross-screen control function, then the first device continues to move outward at the edge, that is, the configuration conditions corresponding to the cross-device control function module are met, so as to automatically trigger the establishment of the cross-device control function of the second device. The mapped cursor corresponding to the cursor of the first device is displayed on the second device, and the second device can respond to the input trajectory of the mapped cursor. As the mouse moves, the cursor moves between the display screen of the first device and the display screen of the second device, thereby realizing cross-device control between the first device and the second device.

[0177] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Reference can be made to the common and similar parts between the various embodiments. For the devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the method description.

[0178] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the components and steps of each example according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0179] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0180] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present application. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A processing method comprising: Obtaining a first input trajectory; If the first input trajectory meets a first configuration condition, controlling the first functional module to be in an enabled state; The first functional module in the enabled state responds to the second input trace based on the first configuration condition.

2. The method according to claim 1, wherein the first functional module belongs to a functional module set of an application, the first configuration condition is a configuration condition for the first functional module, and each functional module in the functional module set of the application is configured to implement an interactive operation with the terminal device based on establishing a connection channel with the terminal device; in, Different functional modules correspond to different interactive operations, and different functional modules correspond to different configuration conditions.

3. The method according to claim 1, wherein obtaining the first input trajectory comprises: If the application is in a running state, monitoring a first movement trajectory of the cursor; If the first input trajectory satisfies a first configuration condition, controlling the first functional module to be in an enabled state includes: If the first movement track exceeds a first edge of a display area of the first display screen, controlling the first functional module to be in an enabled state; The first functional module in the enabled state responding to the second input trace based on the first configuration condition includes: The first functional module in the enabled state responds to the first movement trajectory based on the first configuration condition and notifies the terminal device through the connection channel to display a mapping cursor of the cursor.

4. The method according to claim 3, wherein the first functional module in the enabled state notifies the terminal device to display a mapped cursor of the cursor through the connection channel in response to the first movement trajectory based on the first configuration condition, comprising: Creating a virtual screen based on the connection channel, where the virtual screen is a virtual screen corresponding to the second display screen of the terminal device; Determine position information of a second movement trajectory on the virtual screen where the first movement trajectory exceeds a display area of a first display screen of the electronic device; The terminal device is notified of the location information based on the connection channel, so that the terminal device displays a mapping cursor of the cursor on a second display screen.

5. The method according to claim 1, obtaining the first input trajectory comprises: If the application is in a running state, monitoring a first movement trajectory of the cursor; If the first input trajectory satisfies a first configuration condition, controlling the first functional module to be in an enabled state includes: If the first movement track exceeds a first edge of a display area of the first display screen, controlling the first functional module to be in an enabled state; The first functional module in the enabled state responding to the second input trace based on the first configuration condition includes: The first functional module in the enabled state obtains a second captured image obtained by the second camera of the terminal device through the connection channel, and the second captured image is used to provide the target program with the first captured image of the first camera of the electronic device for displaying in a graphical interface of the target program; If the second movement track exceeds the first edge of the display area of the first display screen, the terminal device is notified through the connection channel to turn off the collection of the second camera.

6. The method according to claim 3 or 5, wherein if the first input trajectory satisfies a first configuration condition, controlling the first functional module to be in an enabled state comprises: Obtaining the number of times the first movement trajectory satisfies a first configuration condition; If the number of times meets the first threshold condition, controlling the first functional module to be in an enabled state; Alternatively, if the first movement track exceeds the first edge of the display area of the first display screen by a first distance and then exceeds the second distance, the first functional module is controlled to be in an enabled state.

7. The method according to claim 5, wherein if the first input trace satisfies a first configuration condition, controlling the first functional module to be in an enabled state comprises: If the first movement trajectory meets a first configuration condition and the first camera is in a working state, the first functional module is controlled to be in an enabled state.

8. The method according to claim 2, wherein, when there are multiple to-be-selected devices corresponding to the electronic device, the terminal device corresponding to the first functional module is a device among the multiple to-be-selected devices that meets a first screening condition; in, The first screening condition includes at least one of the following: The marked orientation of the terminal device relative to the electronic device matches the trajectory direction of the first input trajectory; The terminal device has a second display screen and is capable of responding to the second input trajectory; The interconnection priority of the terminal device is the highest among the multiple devices to be selected; The function type that the terminal device can implement matches the first function module.

9. The method according to claim 8, wherein: The marked orientation of the terminal device relative to the electronic device is obtained in response to an orientation setting operation for the terminal device; Or, the marked orientation of the terminal device relative to the electronic device is determined based on configuration information of the electronic device; Alternatively, the marked orientation of the terminal device relative to the electronic device is obtained by positioning the terminal device through the connection channel; Alternatively, the marked position of the terminal device relative to the electronic device is the most recently updated deployment position.

10. An electronic device comprising: An input device for obtaining a first input trajectory; a processor, configured to control a first functional module to be in an enabled state if the first input trajectory satisfies a first configuration condition; The first functional module in the enabled state responds to the second input trace based on the first configuration condition.

Citation Information

Cited By

  • Method for editing pdf page text on web page

    US12518084B2

  • Method for editing pdf page text on web page

    US20240028817A1