Control method and device, electronic equipment and storage medium
By realizing operation event conversion and distribution control of external devices in touch screen electronic devices, the problem of insufficient equipment compatibility and flexibility is solved, the operation efficiency and user experience are improved, and the reliability of the system is enhanced.
Patent Information
- Application Number
- CN202410957054.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-16
- Publication Date
- 2024-11-12
AI Technical Summary
When using external devices for control, existing touch screen electronic devices lack compatibility and flexibility, making it difficult to effectively support complex external device control, affecting user experience and operation efficiency.
By implementing a control method and device in an electronic device, a controllable information list is requested after the device is started, configured into the operating system, and the original operation event of the external device is converted into a target operation event according to the configuration information, and sent to the current one The page is used to control the second application and supports the use of external devices such as mouse and keyboard.
It improves the compatibility and flexibility of electronic devices, improves the operation efficiency and comfort of users on touch screen devices, supports high-precision input, reduces dependence on external servers, and enhances the reliability and user experience of the system.
Smart Images

Figure CN118939168A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of terminal technology, and in particular to control technology fields such as operation conversion and intelligent matching. Background Art
[0002] In the related art, touch screen electronic devices support touch control, however, some applications on such electronic devices require external devices for control. Summary of the invention
[0003] The present disclosure provides a control method, device, electronic device and storage medium.
[0004] According to a first aspect of the present disclosure, a control method is provided, which is applied to a touch screen electronic device, comprising:
[0005] In response to detecting that the electronic device is started, requesting a controllable information list from the server through the first application:
[0006] When the controllable information list is obtained from the server, configuring the controllable information list into the operating system of the electronic device;
[0007] In response to detecting that a page of the second application is started, if it is determined that the current page of the second application is a controllable page, reading configuration information of the current page from a controllable information list; wherein the controllable page is a page that accepts control of an external device;
[0008] Converting the original operation event from the external device into the target operation event according to the configuration information;
[0009] Send the target operation event to the current page to apply the target operation event to the current page.
[0010] According to a second aspect of the present disclosure, a control device is provided, which is applied to a touch screen electronic device, comprising:
[0011] A request module, configured to request a controllable information list from a server through a first application in response to detecting that the electronic device is started;
[0012] A configuration module, configured to configure the controllable information list into the operating system of the electronic device when the controllable information list is obtained from the server;
[0013] A reading module, configured to respond to detecting that a page of the second application is started, and in the case where it is determined that the current page of the second application is a controllable page, read the configuration information of the current page from the controllable information list; wherein the controllable page is a page that accepts control of an external device;
[0014] A conversion module, used for converting an original operation event from an external device into a target operation event according to configuration information;
[0015] The distribution module is used to send the target operation event to the current page so as to act on the target operation event on the current page.
[0016] According to a third aspect of the present disclosure, there is provided an electronic device, including:
[0017] at least one processor;
[0018] a memory communicatively coupled to the at least one processor;
[0019] The memory stores instructions that can be executed by at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any embodiment of the present disclosure.
[0020] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to implement the method according to any embodiment of the present disclosure when executed by a computer.
[0021] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program stored on a storage medium, and when the computer program is executed by a processor, the method according to any embodiment of the present disclosure is implemented.
[0022] According to the solution of the present disclosure, it is possible to implement at least partial control of the second application in the electronic device by the external device, thereby improving the compatibility and flexibility of the electronic device.
[0023] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 is a flow chart of a control method according to an embodiment of the present disclosure;
[0025] Figure 2 is a schematic diagram of a controllable information list according to an embodiment of the present disclosure;
[0026] Figure 3 is a schematic diagram of a process of supporting mouse control of a touch screen electronic device according to an embodiment of the present disclosure;
[0027] Figure 4 is a schematic structural diagram of a control device according to an embodiment of the present disclosure;
[0028] Figure 5 is a schematic diagram of a scenario of a control method according to an embodiment of the present disclosure;
[0029] Figure 6 It is a schematic diagram of the structure of an electronic device used to implement the control method of the embodiment of the present disclosure. DETAILED DESCRIPTION
[0030] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.
[0031] The terms "first", "second", and "third", etc. in the specification embodiments and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, including a series of steps or units. The method, system, product, or device is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.
[0032] An embodiment of the present disclosure provides a control method. Figure 1 is a flow chart of a control method according to an embodiment of the present disclosure, and the control method can be applied to a control device. The control device is located in an electronic device with a touch screen. The electronic device includes but is not limited to a mobile phone, a tablet computer, a laptop computer, a wearable device, etc. In some possible implementations, the control method can also be implemented by a processor calling a computer-readable instruction stored in a memory. Figure 1 As shown, the control method includes:
[0033] S101: in response to detecting that the electronic device is started, requesting a controllable information list from a server through a first application;
[0034] S102: When the controllable information list is obtained from the server, the controllable information list is configured in the operating system of the electronic device;
[0035] S103: In response to detecting that a page of the second application is started, if it is determined that the current page of the second application is a controllable page, reading configuration information of the current page from a controllable information list; wherein the controllable page is a page that accepts control of an external device;
[0036] S104: converting the original operation event from the external device into a target operation event according to the configuration information;
[0037] S105: Send the target operation event to the current page to apply the target operation event to the current page.
[0038] In some implementations, the controllable information list includes a list of all pages of the second application controllable by the external device and their configuration information. For example, the controllable information list includes information such as a unique identifier of the page, supported operation types, and operation parameters.
[0039] In some embodiments, an external device refers to a device that can communicate with an electronic device through a network or physical interface and control its functions, such as a mouse, keyboard, etc. Here, the external device is used to provide an additional input method for the electronic device. The above is only an exemplary description and is not intended to limit all possible types of external devices, but it is not exhaustive here.
[0040] In some implementations, the first application may be a launcher application for managing an application list on the electronic device and providing a user interface to launch these applications.
[0041] In some implementations, the second application is a non-system-level application used for a specific purpose, such as a game application, an office application, and the like.
[0042] In some implementations, the original operation event is an operation instruction or event generated by an external device, such as a mouse click, a keyboard key press, etc. Here, the original operation can be an operation mapped to the second application, or an operation mapped to a system function.
[0043] In some implementations, the target operation event is a touch operation event obtained by converting the original operation event.
[0044] In some embodiments, when an external device such as a mouse or keyboard is connected to an electronic device such as a touch screen tablet computer via Bluetooth, Universal Serial Bus (USB), or other means, the system will identify and configure these external devices. The first application may monitor the connection of the external device and prepare corresponding configurations.
[0045] In some implementations, the system-level service or the first application monitors operation events from an external device, such as mouse movement, clicks, scrolling, and keyboard key presses. When the user uses the mouse or keyboard in the Launcher interface, the system performs corresponding operations according to the event type, such as using the mouse to select an application icon, using keyboard shortcuts to quickly start an application, etc.
[0046] In some embodiments, when the electronic device is started, the first application in the system (such as a system service application or a dedicated remote control service application) runs automatically. The first application sends a request to the remote server via a network connection, requesting to obtain a list of currently available controllable information. If the server responds and returns a list of controllable information, the first application will parse the information and configure it into the operating system of the electronic device. The configuration process may involve storing the information in a local database or memory of the device for quick access. When the user starts a second application (such as a video playback application, a smart home control application, a game application, etc.) and jumps to a page, the system identifies whether the page is a controllable page by listening to events or querying the current application status. If the current page is identified as a controllable page, the system will retrieve the specific configuration information of the page from the previously configured list of controllable information.
[0047] In some embodiments, if it is detected that a second application such as a game application is started, the second application will take over event processing. The game application may specially handle mouse and keyboard input to provide game control functions. For example, the game may map the four control keys on the keyboard to mobile control and map the mouse movement to perspective control. On an electronic device, when using a mouse, the system needs to determine which user interface (UI) element (such as a button, text box) currently receives the mouse event. This is usually indicated by the visibility and position of the mouse pointer. The system ensures that mouse and keyboard events are correctly distributed to the currently active application or specific UI elements in the application. When the user exits the application or turns off the tablet, the system may prompt the user to disconnect the external device, or automatically update the UI state when the external device loses connection.
[0048] For example, a user connects a mouse and keyboard to a touch screen tablet computer. The tablet computer uses the Launcher application to obtain a list of controllable information from the server and configures the list of controllable information into the tablet computer's operating system. If the user selects and starts a game application. In the game application, the user begins to use the mouse and keyboard to operate the game, such as using the mouse to control the perspective and using the four keys W, A, S, and D on the keyboard to move the character. In this way, the complex control logic is encapsulated in the system, and the user only needs to simply operate the external device to complete the complex control task. Using a mouse to control the input of a touch screen tablet computer can improve input efficiency.
[0049] The technical solution of the disclosed embodiment configures a controllable information list into the operating system of the electronic device; in response to detecting the page startup of the second application, when judging that the current page of the second application is a controllable page, reads the configuration information of the current page from the controllable information list; converts the original operation event from the external device into a target operation event according to the configuration information; sends the target operation event to the current page to act on the target operation event on the current page. In this way, at least partial control of the second application in the electronic device by the external device can be achieved, thereby improving the compatibility and flexibility of the electronic device. Supporting users to use more familiar external devices such as mouse and keyboard as input methods on touch screen electronic devices can improve operating efficiency and comfort. For the second application that requires high-precision input, external devices such as mouse and keyboard provide a better control experience than touch screens.
[0050] In the embodiment of the present disclosure, the control method may further include: in the case where the controllable information list fails to be obtained from the server, obtaining the controllable information list locally, and configuring the controllable information list into the operating system of the electronic device.
[0051] In some embodiments, when the electronic device (such as a touch screen tablet) is started, the first application automatically runs. The first application attempts to send a request to the remote server through a network connection to obtain a currently available list of controllable information. If the list of controllable information is successfully obtained from the server, it is configured into the operating system of the electronic device according to the original process. If the list of controllable information fails to be obtained from the server (for example, due to network problems, server failures, etc.), the first application will attempt to obtain the list of controllable information from local storage.
[0052] In some embodiments, the first application checks whether there is the latest controllable information list in the local storage (such as a database, file system, etc.). If it exists and is not expired (judged by a preset timestamp or version number), the controllable information list is read from the local. If it does not exist or has expired, the first application can try to roll back to an earlier local backup or perform other recovery measures, or prompt the user to manually update the controllable information list.
[0053] In some implementations, regardless of whether the controllable information list is from a server or local storage, once the acquisition is successful, the first application will configure it into the operating system of the electronic device so that the subsequent second application can use the information. After the configuration is completed, the first application continues to execute the original process, including monitoring the page startup of the second application, identifying the controllable page, converting the operation event, etc.
[0054] For example, a user is using a touch screen tablet in an area with unstable network signals. When the Launcher application tries to obtain a list of controllable information from a remote server, the request fails due to network problems. The Launcher application automatically detects this situation and retrieves the list of controllable information from local storage instead. Since the latest list has been successfully synchronized from the server and stored locally, the Launcher application is able to successfully obtain the list locally and configure it into the operating system. The user then launches a second application, such as a game application. Because the game application can use the list of controllable information that has been configured into the operating system to identify and process these input events, the user can use an external mouse and keyboard to play the game.
[0055] The technical solution of the disclosed embodiment can reduce the reliance on external servers and the risk of service interruption due to network problems or server failures by obtaining a list of controllable information from local storage as an alternative solution. Even if the server cannot be connected, the user can still continue to use the external device to control the second application in the electronic device, thereby improving the reliability of the system and the user experience.
[0056] In the embodiment of the present disclosure, configuring the controllable information list into the operating system of the electronic device includes: setting the controllable information list into the operating system by calling an interface of the first application.
[0057] In some embodiments, one or more interfaces are defined in the first application for receiving and processing configuration requests for the controllable information list. These interfaces can be public application program interfaces (Application ProgramInterface, API), allowing other applications or system services to interact with them. When it is necessary to obtain the controllable information list from the server or locally and configure it in the operating system, a configuration request is initiated. This request can be initiated by the first application itself, or it can be triggered by other system services or applications. After the configuration request is accepted, the controllable information list is passed to the interface as a parameter by calling the interface provided by the first application. A series of operations will be performed inside the interface, including verifying the validity of the controllable information list, converting it into a format recognizable by the operating system, and storing it in an appropriate location of the operating system. Inside the interface, the incoming controllable information list is verified to ensure that it conforms to the expected format and rules. After the verification is passed, the list is converted and stored in the global configuration file of the operating system, or it is made available system-wide through other mechanisms. After the configuration is completed, the first application can notify other applications or system services about the update of the controllable information list through broadcasting, callback or other mechanisms. In this way, newly started applications or already running applications can obtain the latest controllable information list when needed. The definition and use of the interface provide flexibility for the system, so that without modifying the core code of the operating system, a new controllable information list format or configuration method can be supported by updating the first application or extending its interface.
[0058] In this way, the configuration of the controllable information list is realized through interface calls, making the interaction between the first application and other parts of the operating system more modular and clear, helping to reduce the coupling between the components of the system and improve the scalability and maintainability of the system. By defining a clear interface to handle the configuration request of the controllable information list, the verification and filtering of the input data can be strengthened, preventing malicious data or data that does not meet the specifications from being configured into the system, thereby improving the security of the system.
[0059] In an embodiment of the present disclosure, an original operation event from an external device is converted into a target operation event according to configuration information, including: obtaining a category range of non-touch operations supported by the current page according to the configuration information; and when the original operation belongs to the category range, converting the original operation event into a target operation event, wherein the target operation is a touch operation and the original operation is a non-touch operation.
[0060] In some implementations, the category range may include mouse clicks, movements, scrolling of a scroll wheel, key operations on a keyboard, direction keys and selection keys on a remote control, etc.
[0061] In some embodiments, the conversion process may include coordinate conversion (such as converting mouse coordinates into touch coordinates on the screen), event type conversion (such as converting mouse clicks into touch press and lift events on the screen), parameter adjustment (such as adjusting the duration, pressure, etc. of touch events), etc.
[0062] In some implementations, in order to convert original operation events from external devices (such as operations of devices such as a mouse, keyboard, and remote control) into touch events (i.e., simulating finger operations on a touch screen), the system performs conversion processing based on configuration information.
[0063] In some embodiments, the system needs to read and parse configuration information, which includes the category range of non-touch operation events supported by the current page (or application) and the rules for how to map these operations to touch events. The configuration information can be stored in a local file or dynamically obtained through the network. The system captures the original operation events from the external device. After capturing the original operation event, the system will determine whether the event belongs to the non-touch operation category supported by the current page based on the category range in the configuration information. If the original operation belongs to the supported category range, the system will convert the original operation event into a corresponding touch event according to the mapping rules in the configuration information. The converted touch event will be distributed to the event processing system of the operating system and processed by the system or application. This usually involves passing the event to the currently active application or window and triggering the corresponding touch event processing logic.
[0064] Figure 2 A schematic diagram of a controllable information list is shown, such as Figure 2 As shown, the controllable information list includes the second application-1 and the second application-x; wherein, page-1 of the second application-1 supports mouse click control, page-3 of the second application-1 supports mouse wheel scrolling control, and page-5 of the second application-1 supports mouse wheel scrolling control and mouse click control; wherein, page-1 of the second application-x supports mouse click control, page-4 of the second application-x supports keyboard control, page-8 of the second application-x supports mouse wheel scrolling control, and page-10 of the second application-x supports mouse click control and keyboard control.
[0065] In some implementations, the customizability of the configuration information enables the system to flexibly adjust the mapping rules of non-touch operations to touch events according to the requirements of different applications or pages.
[0066] For example, suppose a user is using a remote control to control a video player application on a touchscreen TV. The "up, down, left, and right" arrow keys on the remote control are used to navigate videos in the playlist. The system configuration information defines the range of operation categories for these arrow keys and specifies how to map them to touch events. For example, the "up" arrow key is mapped to a touch event of sliding up on the screen. When the user presses the "up" arrow key on the remote control, the system captures this raw operation event and converts it into an upward sliding touch event on the screen according to the configuration information. The converted touch event is distributed to the video player application, which uses this touch event to scroll up the playlist to display the previous video option.
[0067] The technical solution of the disclosed embodiment converts non-touch operations into touch operation events. This conversion mechanism enables external devices to work in more applications or interfaces, thereby enhancing the compatibility and scalability of the system. Users can use external devices to operate in applications or interfaces that do not support traditional input devices, thereby improving user convenience.
[0068] In an embodiment of the present disclosure, an original operation event from an external device is converted into a target operation event according to configuration information, including: obtaining the specific type of the original operation event and the location information of the original operation event on a controllable page; and converting the original operation event into a target operation event according to the specific type and location information of the original operation event.
[0069] In some embodiments, the system first captures the original operation events from the external device, which may include key presses, mouse movements, clicks, wheel scrolling, etc. For each captured event, the system parses its specific type (such as key code, mouse action type) and the position information on the screen when the event occurs (for mouse events). The system searches for corresponding configuration information based on the currently active controllable page (or application interface). These configuration information define which types of original operation events are supported and how they are mapped to target operation events. The configuration information may also contain layout information specific to the page or application for more accurate interpretation of the position information. Based on the specific type and position information of the original operation event, the system applies conversion logic to generate the target operation event. For mouse events, this may involve converting mouse coordinates into touch coordinates and generating corresponding touch press, move or lift events. For keyboard events, the system may need to generate corresponding touch events or perform other operations (such as triggering specific functions within the page) based on the key code and the context of the current page.
[0070] In some embodiments, after generating target operation events, the system simulates the occurrence of these events on the touch device and distributes them to the event processing system of the operating system. This usually involves simulating touch input at the operating system level so that the currently active application or window can handle these simulated events like real touch events.
[0071] For example, suppose a user is using a mouse to control a game application, and the game interface contains multiple interactive elements (such as buttons, sliders, etc.). The user moves the mouse pointer over a button on the interface and clicks the left mouse button. The system captures this mouse click event and parses out the specific type of event (left-click) and location information (coordinates of the mouse pointer on the screen). Based on the configuration information of the current game interface, the system knows that the click at this location should be mapped to a touch press event. The system generates a touch press event, simulating a finger pressing at that location on the screen, and distributes this event to the game application. After receiving the touch press event, the game application executes the corresponding logic (such as activating a button) to respond to the user's operation.
[0072] The technical solution of the disclosed embodiment can more accurately simulate touch events by parsing the specific type and location information of the original operation event, thereby providing a more accurate and intuitive control experience.
[0073] In the disclosed embodiment, the original operation event from the external device is converted into a target operation event according to the configuration information, including: when the position information exceeds the boundary of the controllable page, the position information is adjusted or the original operation event is ignored.
[0074] In some embodiments, when the system captures a raw operation event, it first parses the event's location information (such as mouse coordinates, touch position, etc.). Then, the system verifies whether the location information is within the effective boundary of the controllable page. For example, the location information is compared with the size and location data of the page.
[0075] In some embodiments, if the position information exceeds the boundary of the controllable page, the system adjusts the position information. The system can adjust the position information that exceeds the boundary to a certain point on the boundary of the page to ensure that the operation event is processed within the visible range. For example, if the mouse pointer moves out of the right boundary of the page, the system can adjust its position to a fixed position on the right edge of the page.
[0076] In some implementations, if the location information exceeds the boundary of the controllable page, the system ignores the original operation event. If the operation beyond the boundary is considered irrelevant or may have a negative impact on the user experience, the system may choose not to generate any target operation events.
[0077] In some embodiments, if the location information exceeds the boundary of the controllable page, the boundary handling strategy adopted by the system may vary from application to application, so the system determines which specific strategy to adopt based on the configuration information. The configuration information may include detailed rules on when and how to adjust the location information or ignore the event. The system can flexibly adjust the boundary handling strategy according to the specific needs of the application, thereby enhancing the adaptability and usability of the application.
[0078] In some implementations, after making necessary adjustments to the location information or deciding to ignore the event, the system continues to execute the event conversion logic. If the event is retained and converted to a target operation event, it is distributed to the event processing system of the operating system or application according to the normal process.
[0079] For example, suppose a user is using a graphics editing software whose canvas area is the main part of the controllable page. The user uses the mouse to draw on the canvas, but accidentally moves the mouse pointer outside the right boundary of the canvas. The system captures this mouse move event and verifies whether its position information exceeds the canvas boundary. According to the boundary processing strategy in the configuration information, the system decides to adjust the position information of the mouse pointer to limit it to a preset point on the right edge of the canvas. Then, the system generates an adjusted mouse move event and distributes it to the graphics editing software as a target operation event. After receiving this event, the graphics editing software continues to draw graphics at the user's desired position without being interrupted by the mouse pointer exceeding the canvas boundary.
[0080] The technical solution of the disclosed embodiment can reduce the occurrence of misoperation by ignoring or adjusting operation events beyond the boundary, so that users can control applications or interfaces more accurately. By intelligently processing location information beyond the page boundary, users can also be prevented from triggering operations at unexpected locations, thereby improving the continuity and rationality of the user experience.
[0081] In the disclosed embodiment, the control method further includes: updating the number of second applications and configuration information of the second applications in the controllable information list according to the popularity value corresponding to each second application installed on the electronic device.
[0082] In some implementations, the content and configuration in the list are dynamically adjusted according to the popularity value of each second application (such as an independent application, a plug-in, a small program, etc.) installed on the electronic device.
[0083] In some embodiments, the system monitors the usage of each second application on the electronic device periodically or in real time, including the number of times it is opened, the usage time, the frequency of user interaction, etc. Based on these data, the system calculates a heat value for each second application, which reflects the popularity or importance of the application in the current time period.
[0084] In some embodiments, when the system detects that the heat value of a second application has changed, it checks whether the change has reached a preset threshold (such as an increase or decrease in percentage). If the threshold is reached, the system updates the number of second applications in the controllable information list according to the new heat value. For example, if the heat value of an application increases significantly, the system may add the application to the list (if it was not in the list before); conversely, if the heat value drops significantly, the system may remove the application from the list. At the same time, the system will also update the configuration information of each second application in the list, which may include adjusting event mapping rules, optimizing touch sensitivity, updating interface layout, etc., to better adapt to user habits and needs.
[0085] In some embodiments, the updated controllable information list and configuration information need to be synchronized to related system components or applications to ensure that they can correctly handle the original operation events from the external device. For example, the updated information is written to local storage, sent to a cloud server via the network for backup, or synchronized to other users' devices.
[0086] For example, suppose that a user often uses an application called "Quick Notes" to record inspirations and ideas. Over time, the popularity value of this application gradually increases. After the system detects that the popularity value of the "Quick Notes" application has reached the preset increase threshold, it automatically adds it to the controllable information list (if it was not in the list before). At the same time, the system also adjusts the priority and configuration information of the "Quick Notes" application in the list according to the user's usage habits. For example, it may optimize the touch event mapping rules of the application, allowing users to more conveniently create and edit notes in the application through external devices (such as a mouse or stylus). These updates are synchronized to related system components to ensure that users can enjoy a smoother and more personalized operating experience when using external devices.
[0087] The technical solution of the disclosed embodiment can ensure better control support and optimization of the applications that users use most frequently or are most interested in by dynamically adjusting the controllable information list and configuration information according to the popularity value of the application, thereby improving user input efficiency. The system can automatically adapt to changes in user behavior and complete the update and optimization of configuration information without manual intervention by the user, reducing the configuration and management overhead of infrequently used or low-popularity applications, and making more efficient use of system resources.
[0088] Figure 3 A schematic diagram of the process of supporting mouse control of a touch screen device is shown, such as Figure 3 As shown, the process includes:
[0089] S301: After the device is turned on, the first application of the device will request a list of controllable page information from the cloud. If the request fails, the local page list will be obtained.
[0090] Here, the first application may be a Launcher application.
[0091] S302: The first application configures the acquired cloud controllable page information into the operating system of the device;
[0092] S303: When the second application page of the device is started, the system determines whether the page is a controllable page;
[0093] S304: After the system determines that the page is a controllable page, it reads the configuration information of the page of the second application;
[0094] S305: according to the configuration information, convert the mouse click event for the controllable page into a finger touch event, and then execute S307;
[0095] S306: according to the configuration information, convert the mouse wheel event for the controllable page into a finger sliding event, and then execute S307;
[0096] S307: Distribute the converted event to the current page for processing.
[0097] Thus, for a touch screen device that does not support external device control, the external device can control at least part of the second application in such a touch screen device through the controllable information list. By inputting control to the touch screen device through external devices such as a mouse and a keyboard, the user can control the touch screen device in a more natural and intuitive way, thereby improving input efficiency.
[0098] It should be understood that Figure 2 and Figure 3 The schematic diagram shown is only exemplary and not restrictive, and it is scalable, and those skilled in the art can Figure 2 and Figure 3 Various obvious changes and / or substitutions can be made to the examples, and the resulting technical solutions still fall within the scope of the disclosure of the embodiments of the present disclosure.
[0099] The present disclosure provides a control device, such as Figure 4 As shown, the control device is applied to a touch screen electronic device, and the control device includes:
[0100] A request module 401, configured to request a controllable information list from a server through a first application in response to detecting that the electronic device is started;
[0101] A configuration module 402, configured to configure the controllable information list into the operating system of the electronic device when the controllable information list is obtained from the server;
[0102] The reading module 403 is used for, in response to detecting that the page of the second application is started, reading the configuration information of the current page from the controllable information list when determining that the current page of the second application is a controllable page; wherein the controllable page is a page that accepts control of an external device;
[0103] A conversion module 404, configured to convert an original operation event from an external device into a target operation event according to the configuration information;
[0104] The distribution module 405 is used to send the target operation event to the current page so as to act on the current page.
[0105] In some embodiments, the control device may further include:
[0106] Get Module( Figure 4 (not shown) is used to obtain the controllable information list from the local when the controllable information list fails to be obtained from the server, and configure the controllable information list into the operating system of the electronic device.
[0107] In some embodiments, the configuration module 402 is further used to: set the controllable information list into the operating system by calling the interface of the first application.
[0108] In some embodiments, the conversion module 404 is used to:
[0109] Get the category range of non-touch operations supported by the current page according to the configuration information;
[0110] In the case where the original operation belongs to the category range, the original operation event is converted into a target operation event, the target operation is a touch operation, and the original operation is a non-touch operation.
[0111] In some embodiments, the conversion module 404 is used to:
[0112] Obtain the specific type of the original operation event and the location information of the original operation event on the controllable page;
[0113] The original operation event is converted into a target operation event according to the specific type and location information of the original operation event.
[0114] In some embodiments, the conversion module 404 is further configured to:
[0115] When the position information exceeds the boundary of the controllable page, the position information is adjusted or the original operation event is ignored.
[0116] In some embodiments, the control device further comprises:
[0117] Update Module( Figure 4 (not shown) is used to update the number of second applications and configuration information of the second applications in the controllable information list according to the heat value corresponding to each second application installed by the electronic device.
[0118] Those skilled in the art should understand that the functions of each processing module in the control device of the embodiment of the present disclosure can be understood with reference to the relevant description of the aforementioned control method, and each processing module in the control device of the embodiment of the present disclosure can be realized by a generation circuit that realizes the function of the embodiment of the present disclosure, or can be realized by running software that executes the function of the embodiment of the present disclosure on an electronic device.
[0119] The control device of the disclosed embodiment can realize at least partial control of the second application in the touch screen electronic device by an external device, thereby improving the compatibility and flexibility of the touch screen electronic device.
[0120] The present disclosure provides a scene diagram of a control method, such as Figure 5 shown.
[0121] As mentioned above, the control method provided by the embodiment of the present disclosure is applied to an electronic device. The electronic device may also refer to various forms of mobile devices, such as a tablet computer, a touch-screen TV, a wearable device, and other similar devices with a touch screen.
[0122] Specifically, the electronic device can perform the following operations:
[0123] In response to detecting that the electronic device is started, requesting a controllable information list from a server through the first application;
[0124] When the controllable information list is obtained from the server, configuring the controllable information list into the operating system of the electronic device;
[0125] In response to detecting that a page of the second application is started, if it is determined that the current page of the second application is a controllable page, reading configuration information of the current page from a controllable information list; wherein the controllable page is a page that accepts control of an external device;
[0126] Converting the original operation event from the external device into the target operation event according to the configuration information;
[0127] Send the target operation event to the current page to apply the target operation event to the current page.
[0128] It should be understood that Figure 5 The scene diagram shown is only illustrative and not restrictive. Those skilled in the art can Figure 5Various obvious changes and / or substitutions can be made to the examples, and the resulting technical solutions still fall within the scope of the disclosure of the embodiments of the present disclosure.
[0129] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.
[0130] It should be noted that the acquisition, storage and application of user personal information involved in the technical solution of the present disclosure are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.
[0131] Figure 6 A schematic block diagram of an example electronic device 600 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.
[0132] like Figure 6 As shown, the device 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 602 or a computer program loaded from a storage unit 608 to a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 can also be stored. The computing unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.
[0133] A number of components in the device 600 are connected to the I / O interface 605, including: an input unit 606, such as a keyboard, a mouse, etc.; an output unit 607, such as various types of displays, speakers, etc.; a storage unit 608, such as a disk, an optical disk, etc.; and a communication unit 609, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0134] The computing unit 601 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a central processing unit CPU, a graphics processing unit (Graphics Processing Unit, GPU), various dedicated artificial intelligence (Artificial Intelligence, AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (Digital Signal Processor, DSP), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 601 performs the various methods and processes described above, such as control methods. For example, in some embodiments, the control method may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 608. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 600 via the ROM 602 and / or the communication unit 609. When the computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the control method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to execute the control method in any other appropriate manner (eg, by means of firmware).
[0135] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a dedicated or general-purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0136] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0137] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories, read-only memories, erasable programmable read-only memories (EPROM), flash memories, optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0138] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0139] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
[0140] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on the respective computers and having a client and server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.
[0141] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.
[0142] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the principles of the present disclosure shall be included in the protection scope of the present disclosure.
Claims
1. A control method, applied to a touch screen electronic device, the method comprising: In response to detecting that the electronic device is started, requesting a controllable information list from a server through a first application; In case the controllable information list is acquired from the server, configuring the controllable information list into the operating system of the electronic device; In response to detecting that a page of a second application is started, if it is determined that the current page of the second application is a controllable page, reading configuration information of the current page from the controllable information list; wherein the controllable page is a page that accepts control of an external device; Converting an original operation event from the external device into a target operation event according to the configuration information; The target operation event is sent to the current page to apply the target operation event to the current page.
2. The method according to claim 1, further comprising: In the case that the controllable information list fails to be obtained from the server, the controllable information list is obtained locally, and the controllable information list is configured into the operating system of the electronic device.
3. The method according to claim 1 or 2, wherein: The configuring the controllable information list into the operating system of the electronic device comprises: The controllable information list is set in the operating system by calling the interface of the first application.
4. The method according to claim 1, wherein: The converting the original operation event from the external device into a target operation event according to the configuration information includes: Acquire the category range of the non-touch operation supported by the current page according to the configuration information; In a case where the original operation belongs to the category range, the original operation event is converted into the target operation event, wherein the target operation is a touch operation and the original operation is a non-touch operation.
5. The method according to claim 1, wherein: The converting the original operation event from the external device into a target operation event according to the configuration information includes: Acquire the specific type of the original operation event and the location information of the original operation event on the controllable page; The original operation event is converted into the target operation event according to the specific type of the original operation event and the position information.
6. The method according to claim 5, wherein: The converting the original operation event from the external device into a target operation event according to the configuration information further includes: In the case where the position information exceeds the boundary of the controllable page, the position information is adjusted or the original operation event is ignored.
7. The method according to claim 1, further comprising: According to the popularity value corresponding to each second application installed on the electronic device, the number of second applications and the configuration information of the second applications in the controllable information list are updated.
8. A control device, applied to a touch screen electronic device, comprising: a request module, configured to request a controllable information list from a server through a first application in response to detecting that the electronic device is started; a configuration module, configured to configure the controllable information list into the operating system of the electronic device when the controllable information list is acquired from the server; A reading module, configured to, in response to detecting that a page of a second application is started, read configuration information of the current page from the controllable information list when determining that the current page of the second application is a controllable page; wherein the controllable page is a page that accepts control of an external device; A conversion module, used for converting an original operation event from the external device into a target operation event according to the configuration information; The distribution module is used to send the target operation event to the current page so as to act on the current page with the target operation event.
9. The apparatus according to claim 8, further comprising: The acquisition module is used to acquire the controllable information list locally when the acquisition of the controllable information list from the server fails, and configure the controllable information list into the operating system of the electronic device.
10. The device according to claim 8 or 9, wherein: The configuration module is also used for: The controllable information list is set in the operating system by calling the interface of the first application.
11. The device according to claim 8, wherein: The conversion module is used for: Acquire the category range of the non-touch operation supported by the current page according to the configuration information; In a case where the original operation belongs to the category range, the original operation event is converted into the target operation event, wherein the target operation is a touch operation and the original operation is a non-touch operation.
12. The device according to claim 8, wherein: The conversion module is used for: Acquire the specific type of the original operation event and the location information of the original operation event on the controllable page; The original operation event is converted into the target operation event according to the specific type of the original operation event and the position information.
13. The device according to claim 12, wherein: The conversion module is further used for: In the case where the position information exceeds the boundary of the controllable page, the position information is adjusted or the original operation event is ignored.
14. The apparatus according to claim 8, further comprising: An updating module is used to update the number of second applications and configuration information of the second applications in the controllable information list according to the popularity value corresponding to each second application installed by the electronic device.
15. An electronic device, comprising: at least one processor; as well as a memory communicatively connected to at least one processor; wherein, The memory stores instructions that can be executed by at least one processor, and the instructions are executed by at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 7.
16. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are for causing a computer to execute a method according to any one of claims 1-7.
17. A computer program product comprising a computer program stored on a storage medium, the computer program implementing the method according to any one of claims 1 to 7 when executed by a processor.
