Device Control Method, Device, System and Storage Medium
By detecting the current environment of the terminal device and determining the corresponding touch control strategy, the problem of terminal touch screen drifting or failure during the environment changes, realizing temporary use and recovery of the device.
Patent Information
- Application Number
- CN202211559791.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-06
- Publication Date
- 2025-06-17
- Estimated Expiration
- 2042-12-06
AI Technical Summary
The terminal touch screen is prone to drift when the ambient temperature and electric field change, resulting in inaccurate touch position detection or damage to the touch screen, which in turn makes users unable to use computer equipment.
By obtaining the current environment information of the target device, detecting whether it is an abnormal environment. When an abnormal environment is detected, a corresponding touch control policy is determined, and based on the policy, the device display is controlled to solve the problem of touch screen drift or failure.
It effectively solves the problem of equipment inability to use caused by terminal touch screen drift or operation failure. In an emergency, the equipment can be temporarily maintained until the equipment is repaired.
Smart Images

Figure CN115756293B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of communications, and in particular, to a device control method, apparatus, system, and storage medium. Background Art
[0002] Devices with touch functions have been widely used in daily life. Devices that can utilize touch functions include the following devices, such as smartphones, tablets, electronic kiosks, gaming devices, personal computers, and any other type of electronic device that can be configured to receive input through an interface including a touch function.
[0003] Currently, most intelligent terminals adopt touch screen technology. By means of a user's finger clicking or swiping on the touch screen, various trigger commands are generated to achieve control functions. However, when the ambient temperature or ambient electric field changes, it will cause the drift of the touch screen, resulting in inaccurate detection of the touch position, and even damage to the touch screen, causing the user to be unable to use the computer device. Summary of the Invention
[0004] In view of the above technical problems, this application provides a device control method, apparatus, system, and storage medium, which can solve the problem that the computer device cannot be used due to the drift of the terminal touch screen or the failure of the terminal touch screen operation.
[0005] To solve the above technical problems, this application provides a device control method, including:
[0006] Obtain the current environment of the target device;
[0007] Detect whether the current environment is an abnormal environment;
[0008] When it is detected that the current environment is an abnormal environment, determine the touch control strategy corresponding to the current environment;
[0009] In response to a touch operation on the target device, control the device display of the target device based on the touch control strategy and the touch operation.
[0010] Optionally, in some embodiments of this application, the step of determining the touch control strategy corresponding to the current environment when it is detected that the current environment is an abnormal environment includes:
[0011] When it is detected that the current environment is an abnormal environment, obtain the environment information of the current environment and the touch function information of the target device;
[0012] Determine the touch control strategy corresponding to the current environment according to the environment information and the touch function information.
[0013] Optionally, in some embodiments of the present application, determining the touch control strategy corresponding to the current environment according to the environment information and the touch function information includes:
[0014] Extracting the acceleration data of the target device from the environment information;
[0015] Based on the acceleration data, determining the device usage scenario corresponding to the target device;
[0016] When the device usage scenario is the first scenario and the touch function information indicates that the touch function of the target device is normal, determining the touch control strategy corresponding to the current environment as the linkage control strategy;
[0017] When the device usage scenario is the second scenario and the touch function information indicates that the touch function of the target device is abnormal, determining the touch control strategy corresponding to the current environment as the single-point control strategy;
[0018] Responding to a touch operation on the target device, and controlling the device display of the target device based on the touch control strategy and the touch operation includes: responding to a touch operation on the target device, and controlling the device display of the target device based on the linkage control strategy and the touch operation, or; responding to a touch operation on the target device, and controlling the device display of the target device based on the single-point control strategy and the touch operation.
[0019] Optionally, in some embodiments of the present application, responding to a touch operation on the target device, and controlling the device display of the target device based on the linkage control strategy and the touch operation includes:
[0020] Responding to a touch operation on the target device, and determining the touch point corresponding to the touch operation;
[0021] Obtaining the control sequence corresponding to the linkage control strategy;
[0022] Based on the touch point and the control sequence, controlling the device display of the target device.
[0023] Optionally, in some embodiments of the present application, based on the touch point and the control sequence, controlling the device display of the target device includes:
[0024] Taking the touch point as a reference, and controlling the device display of the target device according to the position and order of each control point in the control sequence.
[0025] Optionally, in some embodiments of the present application, the controlling the device display of the target device based on the single-point control strategy and the touch operation in response to the touch operation on the target device includes:
[0026] According to the single-point touch strategy, reduce the touch sensitivity of the target device;
[0027] In the state where the touch sensitivity is reduced, in response to the touch operation on the target device, control the device display of the target device.
[0028] Optionally, in some embodiments of the present application, the reducing the touch sensitivity of the target device according to the single-point touch strategy includes:
[0029] Obtain the disabled points disabled from the single-point touch strategy;
[0030] According to the disabled points, reduce the touch sensitivity of the target device.
[0031] Correspondingly, the present application further provides a device control device, including:
[0032] An acquisition module, configured to acquire the current environment of the target device;
[0033] A detection module, configured to detect whether the current environment is an abnormal environment;
[0034] A determination module, configured to determine the touch control strategy corresponding to the current environment when it is detected that the current environment is an abnormal environment;
[0035] A control module, configured to control the device display of the target device based on the touch control strategy and the touch operation in response to the touch operation on the target device.
[0036] The present application further provides a computer device, including a memory and a processor, where the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.
[0037] The present application further provides a computer storage medium, where the computer storage medium stores a computer program, and the computer program implements the steps of the above method when executed by a processor.
[0038] As described above, the present application provides a device control method, apparatus, computer device, and readable storage medium. The device control method includes: obtaining the current environment of a target device, detecting whether the current environment is an abnormal environment, when it is detected that the current environment is an abnormal environment, determining a touch control strategy corresponding to the current environment, and in response to a touch operation on the target device, controlling the device display of the target device based on the touch control strategy and the touch operation. In the device control solution provided by the present application, in an abnormal environment, a corresponding touch control strategy can be output, and the device display of the target device can be controlled based on the touch control strategy and the touch operation. Thus, the problem that the terminal touch screen drifts or the touch screen operation of the terminal fails, resulting in the terminal being unusable, can be solved, and the terminal that cannot be repaired in time can be temporarily maintained for use in an emergency. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. To more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0040] Figure 1 is a schematic diagram of the scenario of the device control method provided by the embodiment of the present application;
[0041] Figure 2 is a schematic flowchart of the device control method provided by the embodiment of the present application;
[0042] Figure 3 is a schematic structural diagram of the device control apparatus provided by the embodiment of the present application;
[0043] Figure 4 is a schematic structural diagram of the intelligent terminal provided by the embodiment of the present application.
[0044] The implementation, functional features, and advantages of the objectives of the present application will be further described in conjunction with the embodiments with reference to the drawings. Through the above drawings, the clear embodiments of the present application have been shown, and there will be more detailed descriptions later. These drawings and text descriptions are not intended to limit the scope of the concept of the present application in any way, but to explain the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0045] Exemplary embodiments will be described in detail herein, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0046] It should be noted that in this document, the term "including", "comprising", or any other variation thereof is intended to cover a non-exclusive inclusion, such that a process, method, article, or device including a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or device. Without further limitation, an element defined by the phrase "including a..." does not exclude the presence of additional identical elements in the process, method, article, or device including that element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined based on their explanations in the specific embodiments or further in combination with the context of the specific embodiments.
[0047] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0048] In the following description, the suffixes such as "module", "component", or "unit" used to represent elements are only for the convenience of describing the present application and have no specific meaning in themselves. Therefore, "module", "component", or "unit" can be used interchangeably.
[0049] The following provides a specific description of the embodiments related to the present application. It should be noted that the order of description of the embodiments in the present application does not limit the priority order of the embodiments.
[0050] Embodiments of the present application provide a device control method, device, computer device, and readable storage medium.
[0051] Among them, the device control device can be specifically integrated in the terminal. The terminal can be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited thereto. The terminal and the server can be directly or indirectly connected through wired or wireless communication means. The server can be an independent physical server, or a server cluster or a distributed system composed of multiple physical servers. It can also be a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. This application does not make any restrictions here.
[0052] For example, please refer to Figure 1 , this application provides a device control device integrated in the mobile phone 10. When the user 20 uses the mobile phone 10, the mobile phone 10 can obtain the current environment and detect whether the current environment is an abnormal environment; when the mobile phone 10 detects that the current environment is an abnormal environment, it determines the touch control strategy corresponding to the current environment; the mobile phone 10 responds to the touch operation triggered by the user and controls the display of the mobile phone 10 based on the touch control strategy and the touch operation.
[0053] The device control solution provided by this application can output the corresponding touch control strategy in an abnormal environment and control the device display of the target device based on the touch control strategy and the touch operation. Therefore, it can solve the problem that the terminal touch screen drifts or the terminal touch screen operation fails, resulting in the terminal being unable to be used, and can temporarily maintain the use of the terminal that cannot be repaired in time in an emergency.
[0054] The following will be described in detail respectively. It should be noted that the description order of the following embodiments does not limit the priority order of the embodiments.
[0055] A device control method includes: obtaining the current environment of the target device; detecting whether the current environment is an abnormal environment; when it is detected that the current environment is an abnormal environment, determining the touch control strategy corresponding to the current environment; and in response to a touch operation on the target device, controlling the device display of the target device based on the touch control strategy and the touch operation.
[0056] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of the device control method provided by the embodiment of this application. The specific process of this device control method can be as follows:
[0057] 101. Obtain the current environment of the target device.
[0058] For example, specifically, the current environment of the target device can be obtained through at least one sensor such as the microphone, camera, and gyroscope sensor of the target device. For example, sound information can be collected through the microphone, image information can be collected through the camera, and acceleration information can be collected through the gyroscope sensor. Further, the current environment can be described based on the sound information, image information, and / or acceleration information, and specific selection can be made according to the actual situation, which will not be elaborated here.
[0059] 102. Detect whether the current environment is an abnormal environment.
[0060] Optionally, a neural network can be used to detect whether the current environment is an abnormal environment, or it can be determined whether the current environment is an abnormal environment based on the information corresponding to the current environment (such as image information, sound information, and acceleration information).
[0061] For example, specifically, the neural network can be a convolutional neural network, and the convolutional neural network can be pre-trained so that the trained convolutional neural network can be directly used to detect whether the current environment is an abnormal environment in the future; or, it can be detected whether the image information matches the preset image information, and then, based on the matching preset image information, it can be determined whether the current environment is an abnormal environment. Similar methods can also be used for sound information and acceleration information, and specific selection can be made according to the actual situation, which will not be elaborated here.
[0062] 103. When it is detected that the current environment is an abnormal environment, determine the touch control strategy corresponding to the current environment.
[0063] Optionally, the corresponding touch control strategy can be determined according to the environmental information of the current environment and the touch function information of the target device, that is, the step "When it is detected that the current environment is an abnormal environment, determine the touch control strategy corresponding to the current environment" can specifically include:
[0064] (11) When it is detected that the current environment is an abnormal environment, obtain the environmental information of the current environment and the touch function information of the target device;
[0065] (12) Determine the touch control strategy corresponding to the current environment according to the environmental information and the touch function information.
[0066] For example, after obtaining the environmental information of the current environment and the touch function information of the target device, the touch control strategy corresponding to the current environment is determined by detecting the touch function of the target device and the current usage scenario, that is, optionally, in some embodiments, the step "Determine the touch control strategy corresponding to the current environment according to the environmental information and the touch function information" can specifically include:
[0067] (21) Extract the acceleration data of the target device from the environmental information;
[0068] (22) Determine the device usage scenario corresponding to the target device based on the acceleration data;
[0069] (23) When the device usage scenario is the first scenario and the touch function information indicates that the touch function of the target device is normal, determine the touch control strategy corresponding to the current environment as the linkage control strategy;
[0070] (24) When the device usage scenario is the second scenario and the touch function information indicates that the touch function of the target device is abnormal, determine the touch control strategy corresponding to the current environment as the single-point control strategy.
[0071] Optionally, in some embodiments, the first scenario may be a vibration scenario, and the second scenario may be a non-vibration scenario. Among them, the judgment basis for the vibration scenario is: if the vibration frequency of the device is greater than the preset value, it is determined as the vibration scenario; except for the vibration scenario, the rest of the scenarios are determined as non-vibration scenarios.
[0072] Optionally, in some embodiments, image data of the target device may also be extracted from the environmental information, and the device usage scenario corresponding to the target device is determined according to the image data. For example, if it can be determined from the image data that the number of images collected by the camera of the target device within the preset time is greater than the preset number, it can be determined that the target device is in the vibration scenario. Specifically, it can be selected according to the actual situation and will not be elaborated here.
[0073] It should be noted that current computer devices (such as mobile phones) often use capacitive multi-touch screens. A capacitive multi-touch screen includes a capacitive touch sensor and a touch controller connected thereto. The touch controller control chip periodically generates a driving signal, and the actions of generating the driving signal and measuring are called scanning. When there is no finger operation, the sampling data of the touch sensor is used as the reference benchmark, and this reference benchmark is simply referred to as Base; when a finger is pressed, the magnitude of the charge passing through the touch sensor will change, and the change in the magnitude of the charge is calculated by subtracting Base from the sampling data at this time to sense the touch action, and this change in the magnitude of the charge is simply referred to as Diff; in order to detect multiple touch points, multiple touch detection nodes arranged vertically and horizontally are configured on the touch sensor. If these detection nodes are distributed in an m-row and n-column arrangement form on the touch sensor plane, an m*n detection node matrix is formed. The touch controller can obtain the corresponding m*n sampling data matrix by sampling this detection node matrix. Conventionally, the sampling data of a matrix collected by one scan is called one frame of sampling data. The touch screen can detect multiple fingers (points) simultaneously each time it scans. Therefore, in some embodiments of the present application, the abnormal touch function of the target device is: the touch screen can only detect one finger (point) or no finger (point) each time it scans.
[0074] 104. In response to a touch operation on a target device, control the device display of the target device based on a touch control policy and the touch operation.
[0075] Optionally, in some embodiments, the step of "in response to a touch operation on a target device, control the device display of the target device based on a touch control policy and the touch operation" may specifically include: in response to a touch operation on a target device, control the device display of the target device based on an association control policy and the touch operation, or; in response to a touch operation on a target device, control the device display of the target device based on a single-point control policy and the touch operation.
[0076] Regarding the association control policy, a control sequence corresponding to the association control policy may be established in advance, and this control sequence is used to control the display change of the target device. For example, it is preset that this control sequence is to open Application A. When the application interface of Application B is displayed on the target device, then exit the application interface of Application B, and determine Application A in the main interface, and then open Application A. In addition, according to the touch point of the touch operation, the target control sequence may be determined from multiple control sequences according to the position of the touch point, so as to control the device display of the target device. That is, optionally, in some embodiments, the step of "in response to a touch operation on a target device, control the device display of the target device based on an association control policy and the touch operation" may specifically include:
[0077] (31) In response to a touch operation on a target device, determine the touch point corresponding to the touch operation;
[0078] (32) Obtain the control sequence corresponding to the association control policy;
[0079] (33) Based on the touch point and the control sequence, control the device display of the target device.
[0080] Optionally, in some embodiments, it may be preset that when the association control policy is started, the control sequence corresponding to the position of each touch point, such as the screen is divided into N regions in advance, region N1 corresponds to control sequence A1, region N2 corresponds to control sequence A2, and so on. Specifically, it can be set according to the actual situation, where N is a positive integer greater than 2; it is also possible to obtain the application closest to the touch, so as to determine the control sequence corresponding to the touch point. That is, optionally, in some embodiments, the step of "based on the touch point and the control sequence, control the device display of the target device" may specifically include: taking the touch point as a reference, according to the position and order of each control point in the control sequence, control the device display of the target device.
[0081] It should be noted that the control points correspond to applications, menus, system settings, etc. displayed on the control screen. For example, for the control sequence S, the control sequence S includes control point S1 - control point S2 - control point S3, and its execution order is S1 - S2 - S3. Among them, control point S1 corresponds to application A, control point S2 corresponds to the position of the menu in application A, and control point S3 corresponds to the menu item q in the menu. Thus, under the linkage control strategy, the user can control the target device with one key.
[0082] Regarding the single-point control strategy, when the single-point control strategy is triggered, the touch function of the target device is in a malfunction or damaged state. Therefore, for the convenience of users, the touch sensitivity of the target device can be reduced so that the user can control the target device when the target device cannot be sent for repair. That is, optionally, in some embodiments, the step "responding to a touch operation on the target device, controlling the device display of the target device based on the single-point control strategy and the touch operation" may specifically include:
[0083] (41) According to the single-touch control strategy, reduce the touch sensitivity of the target device;
[0084] (42) In the state where the touch sensitivity is reduced, respond to a touch operation on the target device and control the device display of the target device.
[0085] Optionally, in some embodiments, the single-point control strategy may indicate disabled control points and non-disabled control points. That is, the step "according to the single-touch control strategy, reduce the touch sensitivity of the target device" may specifically include:
[0086] (51) Obtain the disabled points from the single-touch control strategy;
[0087] (52) According to the disabled points, reduce the touch sensitivity of the target device.
[0088] It should be noted that, in some embodiments, under the single-touch control strategy, only the user is supported to control the target device with a single finger, so that when the touch function of the target device malfunctions or is damaged, the user can perform corresponding operations. At the same time, when the single-touch control strategy is triggered, a certain area can also be set to correspond to certain applications or functions, etc. For example, area A is set to correspond to the emergency call function, area B is set to correspond to the restart function, and both area C and area D can be set as disabled points, so that when the touch function of the target device malfunctions or is damaged, the user can perform corresponding operations.
[0089] The above completes the device control process of this application.
[0090] As can be seen from the above, the present application provides a device control method. After obtaining the current environment of the target device, it detects whether the current environment is an abnormal environment. When it detects that the current environment is an abnormal environment, it determines the touch control strategy corresponding to the current environment. Finally, in response to a touch operation on the target device, it controls the device display of the target device based on the touch control strategy and the touch operation. In the device control solution provided by the present application, in an abnormal environment, the corresponding touch control strategy can be output, and the device display of the target device can be controlled based on the touch control strategy and the touch operation. Thus, the problem that the terminal touch screen drifts or the terminal touch screen operation fails, resulting in the terminal being unable to be used, can be solved, and the terminal that cannot be repaired in time can be temporarily maintained for use in an emergency.
[0091] To facilitate better implementation of the device control method of the present application, the present application also provides a device control device based on the above. The meanings of the nouns are the same as those in the above device control method, and the specific implementation details can be referred to the description in the method embodiments.
[0092] Please refer to Figure 3 , Figure 3 which is a schematic structural diagram of the device control device provided by the present application. The device control device may include an acquisition module 201, a detection module 202, a determination module 203, and a control module 204, specifically as follows:
[0093] The acquisition module 201 is configured to acquire the current environment of the target device.
[0094] For example, specifically, the acquisition module 201 may acquire the current environment of the target device through at least one sensor such as a microphone, a camera, and a gyroscope sensor of the target device.
[0095] The detection module 202 is configured to detect whether the current environment is an abnormal environment.
[0096] Optionally, the detection module 202 may detect whether the current environment is an abnormal environment through a neural network, and the detection module 202 may also determine whether the current environment is an abnormal environment based on the information corresponding to the current environment (such as image information, sound information, and acceleration information).
[0097] The determination module 203 is configured to determine the touch control strategy corresponding to the current environment when it detects that the current environment is an abnormal environment.
[0098] Optionally, in some embodiments, the determination module 203 may determine the corresponding touch control strategy according to the environmental information of the current environment and the touch function information of the target device.
[0099] Optionally, in some embodiments, the determination module 203 may specifically include:
[0100] A first acquisition unit, configured to obtain environmental information of the current environment and touch function information of a target device when it is detected that the current environment is an abnormal environment;
[0101] A first determination unit, configured to determine a touch control policy corresponding to the current environment according to the environmental information and the touch function information.
[0102] Optionally, in some embodiments, the first determination unit may specifically be configured to: extract acceleration data of the target device from the environmental information; determine a device usage scenario corresponding to the target device based on the acceleration data; when the device usage scenario is a first scenario and the touch function information indicates that the touch function of the target device is normal, determine the touch control policy corresponding to the current environment as a linkage control policy; when the device usage scenario is a second scenario and the touch function information indicates that the touch function of the target device is abnormal, determine the touch control policy corresponding to the current environment as a single-point control policy.
[0103] A control module 204, configured to, in response to a touch operation on the target device, control the device display of the target device based on the touch control policy and the touch operation.
[0104] Optionally, in some embodiments, the control module 204 may specifically be configured to: in response to a touch operation on the target device, control the device display of the target device based on the linkage control policy and the touch operation, or; in response to a touch operation on the target device, control the device display of the target device based on the single-point control policy and the touch operation.
[0105] Optionally, in some embodiments, the control module 204 may specifically include:
[0106] A second determination unit, configured to determine a touch point corresponding to the touch operation in response to a touch operation on the target device;
[0107] A second acquisition unit, configured to obtain a control sequence corresponding to the linkage control policy;
[0108] A first control unit, configured to control the device display of the target device based on the touch point and the control sequence.
[0109] Optionally, in some embodiments, the first control unit may specifically be configured to: based on the touch point, control the device display of the target device according to the positions and orders of each control point in the control sequence..
[0110] Optionally, in some embodiments, the control module 204 may specifically include:
[0111] A reduction unit, configured to reduce the touch sensitivity of the target device according to the single-touch policy;
[0112] A second control unit, configured to, in a state of reducing touch sensitivity, control the device display of the target device in response to a touch operation on the target device.
[0113] Optionally, in some embodiments, the second control unit may specifically be configured to: obtain disabled points from a single-point touch policy; and reduce the touch sensitivity of the target device according to the disabled points.
[0114] As can be seen from the above, the present application provides a device control apparatus. After the acquisition module 201 acquires the current environment of the target device, the detection module 202 detects whether the current environment is an abnormal environment. When the determination module 203 detects that the current environment is an abnormal environment, it determines the touch control policy corresponding to the current environment. Finally, the control module 204 controls the device display of the target device in response to a touch operation on the target device, based on the touch control policy and the touch operation. In the device control solution provided by the present application, in an abnormal environment, a corresponding touch control policy can be output, and the device display of the target device can be controlled based on the touch control policy and the touch operation. Thus, the problem that the terminal cannot be used due to touch screen drift or touch screen operation failure of the terminal can be solved, and the terminal that cannot be repaired in time can be temporarily maintained for use in an emergency.
[0115] Those of ordinary skill in the art can understand that all or part of the steps in the above-described methods of the embodiments can be completed by instructions, or by instructions controlling related hardware. The instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.
[0116] The embodiments of the present application further provide a computer device 400, as Figure 4 shown. The computer device 400 may integrate the above-described device control apparatus, and may further include a radio frequency (RF) circuit 401, a memory 402 including one or more computer-readable storage media, an input unit 403, a display unit 404, a sensor 405, an audio circuit 406, a wireless fidelity (WiFi) module 407, a processor 408 including one or more processing cores, and a power supply 409 and other components. Those skilled in the art can understand that Figure 4 the structure of the computer device 400 shown in
[0117] The RF circuit 401 can be used for receiving and transmitting information or signals during communication. Specifically, after receiving the downlink information from the base station, it is handed over to one or more processors 408 for processing. Additionally, the data related to the uplink is sent to the base station. Generally, the RF circuit 401 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, etc. Moreover, the RF circuit 401 can also communicate with the network and other devices via wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to the Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.
[0118] The memory 402 can be used to store software programs and modules. The processor 408 executes various functional applications and information processing by running the software programs and modules stored in the memory 402. The memory 402 mainly includes a program storage area and a data storage area. Among them, the program storage area can store an operating system, applications required for at least one function (such as a sound playback function, a target data playback function, etc.), etc.; the data storage area can store data created according to the use of the computer device 400 (such as audio data, a phone book, etc.). In addition, the memory 402 can include a high-speed random access memory and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices. Correspondingly, the memory 402 can also include a memory controller to provide access to the memory 402 for the processor 408 and the input unit 403.
[0119] The input unit 403 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. Specifically, in a specific embodiment, the input unit 403 may include a touch-sensitive surface and other input devices. The touch-sensitive surface, also known as a touch display screen or a touchpad, can collect touch operations of the user on or near it (such as operations of the user using any suitable object or accessory such as a finger or a stylus on or near the touch-sensitive surface), and drive the corresponding connection device according to a preset program. Optionally, the touch-sensitive surface may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the touch orientation of the user, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the processor 408, and can receive and execute the commands sent by the processor 408. In addition, various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch-sensitive surface. In addition to the touch-sensitive surface, the input unit 403 may further include other input devices. Specifically, the other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, joysticks, etc.
[0120] The display unit 404 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the computer device 400. These graphical user interfaces can be composed of graphics, text, icons, videos, and any combination thereof. The display unit 404 may include a display panel. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch-sensitive surface can cover the display panel. When the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor 408 to determine the type of touch event. Subsequently, the processor 408 provides a corresponding visual output on the display panel according to the type of touch event. Although in Figure 4 it, the touch-sensitive surface and the display panel are implemented as two independent components to realize the input and input functions, but in some embodiments, the touch-sensitive surface and the display panel can be integrated to realize the input and output functions.
[0121] The computer device 400 may further include at least one sensor 405, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. Among them, the ambient light sensor can adjust the brightness of the display panel according to the brightness of the ambient light, and the proximity sensor can turn off the display panel and / or the backlight when the computer device 400 is moved to the ear. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of the acceleration in each direction (generally three axes). When stationary, it can detect the magnitude and direction of gravity, and can be used in applications for identifying the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors that the computer device 400 may also be configured with, they will not be elaborated here.
[0122] The audio circuit 406, the speaker, and the microphone can provide an audio interface between the user and the computer device 400. The audio circuit 406 can transmit the electrical signal converted from the received audio data to the speaker, and the speaker converts it into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 406 and then converted into audio data. After the audio data is output to the processor 408 for processing, it is sent through the RF circuit 401 to, for example, another computer device 400, or the audio data is output to the memory 402 for further processing. The audio circuit 406 may also include an earphone jack to provide communication between the peripheral earphone and the computer device 400.
[0123] WiFi belongs to short - range wireless transmission technology. The computer device 400 can help users send and receive emails, browse the web, and access streaming media through the WiFi module 407. It provides users with wireless broadband Internet access. Although Figure 4 the WiFi module 407 is shown, it can be understood that it does not belong to an essential component of the computer device 400 and can be omitted completely within the scope of not changing the essence of the application as needed.
[0124] The processor 408 is the control center of the computer device 400, connecting various parts of the entire mobile phone through various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 402, and by calling the data stored in the memory 402, it executes various functions of the computer device 400 and processes data, thereby monitoring the mobile phone as a whole. Optionally, the processor 408 may include one or more processing cores; preferably, the processor 408 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 408 either.
[0125] The computer device 400 also includes a power supply 409 (such as a battery) for powering each component. Preferably, the power supply can be logically connected to the processor 408 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The power supply 409 may also include any components such as one or more DC or AC power supplies, a recharge system, a power failure detection circuit, a power converter or inverter, and a power data indicator.
[0126] Although not shown, the computer device 400 may also include a camera, a Bluetooth module, etc., which will not be elaborated here. Specifically, in this embodiment, the processor 408 in the computer device 400 will, according to the following instructions, load the executable files corresponding to the processes of one or more application programs into the memory 402, and the processor 408 will run the application programs stored in the memory 402 to realize various functions:
[0127] Obtain the current environment of the target device; detect whether the current environment is an abnormal environment; when it is detected that the current environment is an abnormal environment, determine the touch control strategy corresponding to the current environment; in response to a touch operation on the target device, control the device display of the target device based on the touch control strategy and the touch operation.
[0128] In the above embodiments, the descriptions of the various embodiments have their own emphases. For the parts not elaborated in a certain embodiment, reference can be made to the detailed description of the device control method above, which will not be elaborated here.
[0129] As can be seen from the above, the computer device 400 in the embodiment of the present application can output the corresponding touch control strategy in an abnormal environment, and control the device display of the target device based on the touch control strategy and the touch operation. Thus, the problem that the terminal touch screen drifts or the terminal touch screen operation fails, resulting in the terminal being unusable, can be solved, and the terminal that cannot be repaired in time can be temporarily maintained for use in an emergency.
[0130] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions or by controlling relevant hardware through instructions. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.
[0131] Therefore, an embodiment of this application also provides a storage medium on which multiple instructions are stored. The instructions are suitable for being loaded by a processor to execute the steps in the above device control method.
[0132] For the specific implementation of each of the above operations, reference can be made to the previous embodiments and will not be elaborated here.
[0133] Among them, the storage medium may include: read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.
[0134] Since the instructions stored in the storage medium can execute the steps in any of the device control methods provided by the embodiments of this application, the beneficial effects achievable by any of the device control methods provided by the embodiments of this application can be realized. For details, refer to the previous embodiments and will not be elaborated here.
[0135] The above has introduced in detail the device control method, device, system and storage medium provided by the embodiments of this application. Specific examples are used in this article to elaborate on the principle and implementation manner of this application. The description of the above embodiments is only used to help understand the method and its core idea of this application; at the same time, for those skilled in the art, according to the idea of this application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to this application.
Claims
1. A device control method, characterized in that, Including: Obtain the current environment of the target device; Detect whether the current environment is an abnormal environment; When it is detected that the current environment is an abnormal environment, determine the touch control strategy corresponding to the current environment, including: obtaining the environment information of the current environment and the touch function information of the target device, extracting the acceleration data of the target device from the environment information, and based on the acceleration data, determining the device usage scenario corresponding to the target device. When the device usage scenario is the first scenario and the touch function information indicates that the touch function of the target device is normal, then determine the touch control strategy corresponding to the current environment as the linkage control strategy; and when the device usage scenario is the second scenario and the touch function information indicates that the touch function of the target device is abnormal, then determine the touch control strategy corresponding to the current environment as the single-point control strategy; In response to a touch operation on the target device, control the device display of the target device based on the touch control strategy and the touch operation, including: controlling the device display of the target device based on the linkage control strategy and the touch operation, or; controlling the device display of the target device based on the single-point control strategy and the touch operation.
2. The method according to claim 1, characterized in that, The controlling the device display of the target device based on the linkage control strategy and the touch operation in response to a touch operation on the target device includes: In response to a touch operation on the target device, determine the touch point corresponding to the touch operation; Obtain the control sequence corresponding to the linkage control strategy; Based on the touch point and the control sequence, control the device display of the target device.
3. The method according to claim 2, characterized in that, The controlling the device display of the target device based on the touch point and the control sequence includes: Taking the touch point as a reference, control the device display of the target device according to the position and order of each control point in the control sequence.
4. The method according to claim 1, characterized in that, The controlling the device display of the target device based on the single-point control strategy and the touch operation in response to a touch operation on the target device includes: According to the single-point control strategy, reduce the touch sensitivity of the target device; In the state of reduced touch sensitivity, in response to a touch operation on the target device, control the device display of the target device.
5. The method according to claim 4, characterized in that, The reducing the touch sensitivity of the target device according to the single-point control strategy includes: Obtain the disabled points disabled from the single-point control strategy; According to the disabled points, reduce the touch sensitivity of the target device.
6. A device control device, characterized in that, Including: An obtaining module, configured to obtain the current environment of the target device; A detecting module, configured to detect whether the current environment is an abnormal environment; A determination module, configured to determine a touch control policy corresponding to the current environment when it is detected that the current environment is an abnormal environment, including: obtaining environment information of the current environment and touch function information of the target device, extracting acceleration data of the target device from the environment information, and determining a device usage scenario corresponding to the target device based on the acceleration data. When the device usage scenario is a first scenario and the touch function information indicates that the touch function of the target device is normal, the touch control policy corresponding to the current environment is determined as an interlock control policy; and when the device usage scenario is a second scenario and the touch function information indicates that the touch function of the target device is abnormal, the touch control policy corresponding to the current environment is determined as a single-point control policy. A control module, configured to control the device display of the target device based on the touch control policy and a touch operation in response to the touch operation on the target device, including: controlling the device display of the target device based on the interlock control policy and the touch operation, or; controlling the device display of the target device based on the single-point control policy and the touch operation.
7. A computer device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, the steps of the device control method according to any one of claims 1 to 5 are implemented.
8. A readable storage medium, characterized in that, A computer program is stored on the readable storage medium, and when the computer program is executed by the processor, the steps of the device control method according to any one of claims 1 to 5 are implemented.
Citation Information
Patent Citations
Interactive control position adjusting method and device, equipment and medium
CN111782103A