Barrier-free interaction method, system and equipment based on mobile phone shell gesture input and medium

Abstract

The invention provides a barrier-free interaction method, a barrier-free interaction system and barrier-free interaction equipment based on gesture input of a mobile phone shell and a medium. The barrier-free interaction method comprises the following steps: acquiring data acquired by an I MU sensor; acquiring data acquired by the capacitive sensor; fusing the data acquired by the I MU sensor with the data acquired by the capacitance sensor; a first action monitoring model is adopted to recognize data collected by the I MU sensor, and user actions are obtained; a second action monitoring model is adopted to recognize data collected by the capacitive sensor, and finger quick actions are obtained; and triggering a target event in combination with the user action and the finger shortcut action. According to the invention, visually impaired people are allowed to interact with the mobile phone by clicking, sliding or drawing gestures on the back of the mobile phone. The lightweight sensor is embedded into the mobile phone shell, so that low-cost control can be realized, various mobile phone systems can be quickly adapted, the original hardware layout of the mobile phone does not need to be changed, and the market prospect is wide.

Description

Technical Field

[0001] The present invention relates to the field of intelligent interaction technologies, and particularly to a barrier-free interaction method, system, device, and medium based on gesture input on a mobile phone case. Background Art

[0002] Visually impaired people currently mainly rely on screen readers to interact with mobile phones. However, in travel or public scenarios, the methods of interacting with mobile phones using touch and voice have great limitations for visually impaired users. Firstly, in public places, the quality of voice is affected by environmental noise and privacy and social problems will be brought. Secondly, because the input method of touching the mobile phone screen usually requires one hand to hold the mobile phone and the other hand to click on the screen, but visually impaired users often have one hand occupied, and the operation is very inconvenient.

[0003] In view of the above problems, there is an urgent need for a one-handed interaction technology that allows visually impaired people to interact with mobile phones by clicking, swiping, or drawing gestures on the back of the mobile phone. Summary of the Invention

[0004] To achieve the above and other advantages of the present invention, a first object of the present invention is to provide a barrier-free interaction method based on gesture input on a mobile phone case. The mobile phone case is configured with a capacitance sensor, and the mobile phone is built-in with an IMU sensor, including the following steps:

[0005] Obtain the data collected by the IMU sensor;

[0006] Obtain the data collected by the capacitance sensor;

[0007] Fuse the data collected by the IMU sensor and the data collected by the capacitance sensor;

[0008] Use a first motion monitoring model to identify the data collected by the IMU sensor to obtain a user motion;

[0009] Use a second motion monitoring model to identify the data collected by the capacitance sensor to obtain a finger quick action;

[0010] Trigger a target event in combination with the user motion and the finger quick action.

[0011] Further, the step of fusing the data collected by the IMU sensor and the data collected by the capacitance sensor includes:

[0012] Perform data fusion using a time window.

[0013] Further, the first motion monitoring model uses a decision tree model.

[0014] Further, it further includes a model training step:

[0015] Obtain the original collected data;

[0016] Crop the original data to obtain valid data;

[0017] Divide the valid data into a training set and a test set;

[0018] Train the model with the training set;

[0019] Evaluate the generalization ability of the model with the test set.

[0020] Furthermore, a timestamp for the start of the action operation is configured in the original data.

[0021] Furthermore, the finger quick actions include clicking, swiping, and drawing gestures.

[0022] The second object of the present invention is to provide a barrier-free interaction system based on gesture input of a mobile phone case. Applying the above method, it includes a mobile phone case and a capacitive sensor. The capacitive sensor is arranged on the mobile phone case, and an IMU sensor is built in the mobile phone.

[0023] Furthermore, the capacitive sensor uses a lightweight sensor.

[0024] The third object of the present invention is to provide a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the steps of the above method are implemented.

[0025] The fourth object of the present invention is to provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above method are implemented.

[0026] Compared with the prior art, the beneficial effects of the embodiments of the present invention are:

[0027] The present invention provides a barrier-free interaction method, system, device, and medium based on gesture input of a mobile phone case, allowing visually impaired people to interact with the mobile phone by clicking, swiping, or drawing gestures on the back of the mobile phone. Using a lightweight sensor embedded in the mobile phone case can not only achieve low-cost control, but also quickly adapt to major mobile phone systems, and there is no need to change the original hardware layout of the mobile phone, so it has a broad market prospect.

[0028] The above description is only an overview of the technical solution of the present invention. In order to be able to understand the technical means of the present invention more clearly and implement it in accordance with the content of the specification, the following will be described in detail with reference to the preferred embodiments of the present invention and the accompanying drawings. The specific implementation manners of the present invention are given in detail by the following embodiments and their accompanying drawings. Brief Description of the Drawings

[0029] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0030] Figure 1 This is the schematic diagram of the barrier-free interactive system based on mobile phone case gesture input;

[0031] Figure 2 This is a schematic diagram of the scene of answering an incoming call;

[0032] Figure 3 This is a schematic diagram of the C4.5 decision tree model;

[0033] Figure 4 This is the back touch gesture interaction architecture diagram;

[0034] Figure 5 This is a flow chart of an accessible interaction method based on mobile phone case gesture input;

[0035] Figure 6 It is a schematic diagram of computer equipment;

[0036] Figure 7 A schematic diagram of a computer-readable storage medium. DETAILED DESCRIPTION

[0037] The present invention is further described below in conjunction with the accompanying drawings and specific implementation methods. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. It should be noted that, under the premise of no conflict, the embodiments or technical features described below can be arbitrarily combined to form a new embodiment.

[0038] Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in the field without making any creative work shall fall within the scope of protection of the present invention.

[0039] The figure numbers in this application are only used to distinguish the various steps in the scheme, and are not used to limit the execution order of the various steps. The specific execution order is subject to the description in the specification.

[0040] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art of the present invention. The terms used in the specification of the present invention herein are only for the purpose of describing specific embodiments and are not intended to limit the present invention.

[0041] Example 1

[0042] A barrier-free interactive system based on mobile phone case gesture input, such as Figure 1As shown, the system 100 includes a mobile phone case 110 and a capacitive sensor 120. The capacitive sensor is disposed on the mobile phone case, and an IMU sensor 140 is built into the mobile phone 130.

[0043] This system uses the mobile phone case as a carrier, with an external capacitive touch point, and at the same time combines the built-in IMU device of the mobile phone to detect the back gesture as a natural control instruction.

[0044] In this embodiment, the action is set as the gesture behind the mobile phone. In a noisy environment, this interaction method can be naturally close to the ear, with a comfortable posture, without attracting the attention of others, and without the need for the speaker to play externally. This can not only relieve the privacy problem, but also not attract too much attention from others due to strange behaviors. In addition, this embodiment selects an external mobile phone case instead of only using the data directly obtained by the mobile phone because the built-in sensors of the mobile phone can only detect simple vibration actions, such as "tapping on the back", etc. Due to easy accidental touch, this operation method is often set to "tap twice" or "tap three times". And "tapping on the back" as a convenient entry for quickly entering an application has been widely praised by users, thus showing the practicality of the back gesture. However, for various daily high-frequency applications, obviously simple tapping actions are not enough. Inspired by this, this embodiment not only wants to enjoy the naturalness of the back gesture, but also needs to carry out diversified designs for visually impaired users. More importantly, because the design principle of this system is to be natural and portable, the solution proposed in this embodiment uses the mobile phone case as a carrier, with an external capacitive touch point, and at the same time combines the external capacitive screen and the built-in IMU device of the mobile phone to detect the back gesture.

[0045] As Figure 2 shown, taking the scenario of answering an incoming call as an example, the specific implementation steps are as follows:

[0046] After an incoming call event occurs, detect whether there is a hand-raising action;

[0047] After detecting the hand-raising action, detect whether there is a back-tapping action or a hand-lowering action;

[0048] If there is a back-tapping action, answer the call;

[0049] After detecting the hand-raising action, if the hand-lowering action is detected, hang up the call.

[0050] The above actions include but are not limited to raising the hand, lowering the hand after raising it, and tapping on the back. For different scenarios, different action options are required. The gesture design of this embodiment needs to be based on the following principles: ① Easy to execute, in line with people's natural interaction cognition, not conflicting with the ergonomic form of the human body, so that it is comfortable and simple to execute and will not cause physical fatigue; ② Will not affect daily behaviors, has specific coding ability, and has a low accidental touch rate. For example, the back tap gesture is simple to operate, but it is very easy to be accidentally touched during daily use. In this case, this embodiment draws on the solution ideas of existing mainstream operating systems and repeats the operation on the basis of balancing the operation difficulty, such as "tapping on the back twice". ③ Has natural mapping semantics. For example, in the object recognition sub-project, the "touch" gesture is selected as the trigger and start switch. Because in the corresponding scenario context, this action has a strong suggestive effect on the target focus. If other gestures are selected, such as the above-mentioned "back tap", it is difficult to establish a direct association with the corresponding task and does not conform to the user's expected cognition, so it is not "natural" enough.

[0051] In addition, for cost control and portability considerations, lightweight sensors are preferred. Therefore, when designing actions, it is also necessary to consider whether lightweight sensors can capture enough features to achieve accurate and reliable recognition of actions. Moreover, the action design of this embodiment cannot be restricted by environmental conditions and needs to be reliably recognized in different environments.

[0052] After clarifying the action set, it is necessary to develop an action recognition algorithm. In this embodiment, there are two data sources: one is the capacitance data from the rear touchpad of the mobile phone case, and the other is the data transmitted by the built-in IMU of the mobile phone. For power consumption considerations, this embodiment uses the acc sensor as an always-on device, and other sensors, such as the gyroscope or proximity light sensor, can be turned on as the target state of the trigger event when necessary. Thus, the data of this embodiment consists of 2D data of capacitance images and the timing data of the IMU. It should be noted that during the data fusion process, the issue of time synchronization needs to be noted. To reduce latency, this embodiment plans to use a 100ms time window (the specific number of frames needs to refer to the sampling frequency of the specific device. Generally, the sampling frequency of the touchpad is 30HZ, and the sampling frequency of the IMU is 100HZ). Because it is facing timing data, this embodiment plans to use the C4.5 decision tree model for classification, as Figure 3 shown.

[0053] Specifically, in this embodiment, specific tasks are designed, experimental personnel are recruited, and preset gestures are made, including a set of determined actions and common actions involved in daily life. To reduce redundant data, specifically during the execution process, a start or stop switch is added to the data collection tool, or a staff member observes beside to determine the timestamp of the start of the action operation. Therefore, the collected raw data is first cropped to obtain valid data. Then, the data is divided into a training set and a test set in a ratio of 7:3. To avoid contamination of the test data, the operation subjects of the test data and the training data must not overlap at all. After the model is trained, a corresponding algorithm prototype (software architecture as shown in Figure 4 is developed based on the device, enabling end-to-end testing and experience. The development of the online prototype also involves issues such as data transmission, operation latency, and memory occupancy.

[0054] This embodiment provides a barrier-free interaction system based on gesture input of a mobile phone case, which uses a low-cost mobile phone case to implement a fast operation system for natural gesture response on the back of the mobile phone. By externally mounting a capacitive sensor on the mobile phone case, finger fast actions are recognized to quickly enable the functions of the mobile phone.

[0055] Embodiment 2

[0056] A barrier-free interaction method based on gesture input of a mobile phone case, based on the above barrier-free interaction system. For a detailed description of the system, reference can be made to the corresponding description in the above system embodiment, which will not be elaborated here. A capacitive sensor is configured on the mobile phone case, and an IMU sensor is built into the mobile phone, as shown in Figure 5 . This method includes the following steps:

[0057] S200. Obtain the data collected by the IMU sensor;

[0058] S210. Obtain the data collected by the capacitive sensor;

[0059] S220. Fuse the data collected by the IMU sensor and the data collected by the capacitive sensor;

[0060] S230. Use a first action monitoring model to identify the data collected by the IMU sensor to obtain the user action;

[0061] S240. Use a second action monitoring model to identify the data collected by the capacitive sensor to obtain finger fast actions;

[0062] Further, the finger fast actions include clicking, swiping, and drawing gestures.

[0063] S250. Combine the user action and the finger fast actions to trigger a target event.

[0064] This method uses the mobile phone case as a carrier, with external capacitive touch points, and combines the mobile phone's built-in IMU device to detect gestures behind the back as natural control instructions.

[0065] In this embodiment, the action is set as a gesture behind the phone. In a noisy environment, this interactive method can be close to the ear, the posture is natural and comfortable, and it does not attract the attention of others. There is no need for a speaker to be played externally, which can alleviate privacy issues and will not attract too much attention from others due to strange behavior. In addition, this embodiment chooses an external mobile phone case instead of just using the data directly obtained by the mobile phone because the built-in sensor of the mobile phone can only detect simple vibration actions, such as "knocking behind the back". Due to the easy accidental touch, this operation mode is often set to "knocking twice" or "knocking three times". "Knocking behind the back" has been widely praised by users as a convenient entrance to quickly enter the application, which shows the practicality of the gesture behind the back. However, for a variety of high-frequency applications in daily life, it is obvious that a simple tapping action is not enough. Inspired by this, this embodiment wants to enjoy the naturalness of the gesture behind the back, and needs to carry out diversified design for visually impaired users. Moreover, because the design principle of the system is to be natural and portable, the solution proposed in this embodiment is to use the mobile phone case as a carrier, external capacitive touch points, and combine the external capacitive screen with the built-in I MU device of the mobile phone to detect the gesture behind the back.

[0066] like Figure 2 As shown, taking the call confirmation scenario as an example, the specific implementation steps are as follows:

[0067] After a phone call event occurs, detect whether there is a hand-raising action;

[0068] After detecting the hand-raising action, detect whether there is a tapping action behind the back or a hand-lowering action;

[0069] If there is a back-knocking action, answer the call;

[0070] After detecting the hand raising action, if the hand lowering action is detected, the call will be hung up.

[0071] The above actions include but are not limited to raising the hand, lowering the hand after raising it, and tapping on the back. For different scenarios, different action options are required. The gesture design of this embodiment needs to be based on the following principles: ① Easy to execute, conforming to people's natural interaction cognition and not conflicting with the ergonomic form of the human body, so that it is comfortable and simple to execute without causing physical fatigue; ② Not affecting daily behaviors, having specific coding capabilities and a low false touch rate. For example, the tapping-on-the-back gesture is simple to operate, but it is very easy to be accidentally touched during daily use. In this case, this embodiment draws on the solution ideas of existing mainstream operating systems and repeats the operation on the basis of balancing the operation difficulty, such as "tapping on the back twice". ③ Having natural mapping semantics. For example, in the object recognition sub-project, the "touch" gesture is selected as the trigger and start switch. Because in the corresponding scenario context, this action has a strong suggestive effect on the target focus. If other gestures are selected, such as the above-mentioned "tapping on the back", it is very difficult to establish a direct association with the corresponding task, which does not conform to the user's expected cognition and is thus not "natural".

[0072] In addition, considering cost control and portability, lightweight sensors are preferred. Therefore, when designing actions, it is also necessary to consider whether lightweight sensors can capture enough features to achieve accurate and reliable recognition of actions. Moreover, the action design of this embodiment cannot be restricted by environmental conditions and needs to be reliably recognized in different environments.

[0073] After determining the action set, it is necessary to develop an action recognition algorithm. In this embodiment, there are two data sources: one is the capacitance data from the rear touchpad of the mobile phone case, and the other is the data transmitted by the built-in IMU of the mobile phone. Considering power consumption, this embodiment uses the acc sensor as an always-on device, and other sensors, such as the gyroscope or proximity light sensor, can be turned on as the target state of the trigger event when necessary. Thus, the data of this embodiment consists of the 2D data of the capacitance image and the timing data of the IMU. It should be noted that during the data fusion process, attention needs to be paid to the problem of time synchronization. To reduce latency, this embodiment plans to use a 100ms time window (the specific number of frames needs to refer to the sampling frequency of the specific device. Generally, the sampling frequency of the touchpad is 30HZ, and the sampling frequency of the IMU is 100HZ). Because it is dealing with timing data, this embodiment plans to use the C4.5 decision tree model for classification, as Figure 3 shown.

[0074] Specifically, in this embodiment, specific tasks are designed, and experimental personnel are recruited to perform preset gestures, including a set of determined actions and common actions involved in daily life. To reduce redundant data, specifically during the execution process, a start or stop switch is added to the data collection tool, or a staff member observes beside to determine the timestamp of the start of the action operation. Therefore, the collected raw data is first cropped to obtain valid data. Then, the data is divided into a training set and a test set at a ratio of 7:3. To avoid contamination of the test data, the operation subjects of the test data and the training data must not overlap at all. After the model is trained, a corresponding algorithm prototype (software architecture as shown in Figure 4 is enabled for end-to-end testing and experience. The development of the online prototype also involves issues such as data transmission, operation latency, and memory occupancy.

[0075] This embodiment provides a single-handed interaction technology that allows visually impaired people to interact with a mobile phone by clicking, swiping, or drawing gestures on the back of the phone.

[0076] Embodiment 3

[0077] A computer device 300, as shown in Figure 6 , includes a memory 310, a processor 320, and a computer program 330 stored on the memory and executable on the processor. When the processor executes the computer program, it implements the steps of a barrier-free interaction method based on gesture input on a phone case. For a detailed description of the method, reference can be made to the corresponding description in the above method embodiments, which will not be repeated here.

[0078] Embodiment 4

[0079] A computer-readable storage medium, as shown in Figure 7 , stores a computer program thereon. When the computer program is executed by a processor, it implements the steps of a barrier-free interaction method based on gesture input on a phone case. For a detailed description of the method, reference can be made to the corresponding description in the above method embodiments, which will not be repeated here.

[0080] The number of devices and the processing scale described here are used to simplify the description of the present invention. The applications, modifications, and changes to the present invention are obvious to those skilled in the art.

[0081] Although the embodiments of the present invention have been disclosed as above, it is not limited to the applications listed in the specification and embodiments. It can be fully applied to various fields suitable for the present invention. For those familiar with the field, additional modifications can be easily made. Therefore, without departing from the general concept defined by the claims and the equivalent scope, the present invention is not limited to specific details and the examples shown and described here.

[0082] The device, computer device, non-volatile computer storage medium, and method provided by the embodiments of this specification are corresponding. Therefore, the device, computer device, and non-volatile computer storage medium also have beneficial technical effects similar to those of the corresponding method. Since the beneficial technical effects of the method have been described in detail above, the beneficial technical effects of the corresponding device, computer device, and non-volatile computer storage medium will not be elaborated here.

[0083] Those skilled in the art also know that in addition to implementing the controller in the form of pure computer-readable program code, the method steps can be logically programmed to enable the controller to implement the same function in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, embedded microcontrollers, etc. Therefore, such a controller can be regarded as a hardware component, and the devices included therein for implementing various functions can also be regarded as the structures within the hardware component. Or even, the devices for implementing various functions can be regarded as either software units for implementing the method or structures within the hardware component.

[0084] The systems, devices, or units illustrated in the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions. For the convenience of description, the above devices are described by dividing them into various units according to their functions. Of course, when implementing one or more embodiments of this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0085] Those skilled in the art should understand that the embodiments of this specification can be provided as a method, system, or computer program product. Therefore, the embodiments of this specification can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of this specification can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0086] This specification is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each flow and / or block in the flowchart and / or block diagram, as well as the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0087] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to work in a particular manner, such that the instructions stored in the computer-readable memory produce a manufacture including an instruction device that implements the functions specified in one or more processes and / or one or more blocks of the process Figure 1 one or more processes and / or blocks Figure 1 specified in one or more blocks or more blocks.

[0088] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus, such that a series of operational steps are performed on the computer or other programmable apparatus to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable apparatus provide steps for implementing the functions specified in one or more processes and / or one or more blocks of the process Figure 1 one or more processes and / or blocks Figure 1 specified in one or more blocks or more blocks.

[0089] It should also be noted that the term "comprising", "including" or any other variation thereof is intended to cover a non-exclusive inclusion, such that a process, method, article or apparatus comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or apparatus. Without further limitation, an element qualified by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising the element.

[0090] This specification can be described in the general context of computer-executable instructions executed by a computer, such as program units. Generally, program units include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The specification can also be practiced in a distributed computing environment where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program units can be located in local and remote computer storage media including storage devices.

[0091] Each embodiment in this specification is described in a progressive manner. For parts that are the same or similar among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for system embodiments, since they are basically similar to method embodiments, they are described relatively simply, and for related parts, reference can be made to the description of the method embodiments.

[0092] The above is only for the embodiments of this specification and is not intended to limit one or more embodiments of this specification. For those skilled in the art, one or more embodiments of this specification may have various changes and modifications. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of one or more embodiments of this specification shall be included within the scope of the claims of one or more embodiments of this specification.

Claims

1. An accessible interaction method based on gesture input of a mobile phone case, where a capacitance sensor is configured on the mobile phone case and an IMU sensor is built into the mobile phone, characterized in that, Including the following steps: Obtain the data collected by the IMU sensor; Obtain the data collected by the capacitance sensor; Fuse the data collected by the IMU sensor and the data collected by the capacitance sensor; Use the first action monitoring model to identify the data collected by the IMU sensor to obtain the user action; Use the second action monitoring model to identify the data collected by the capacitance sensor to obtain the finger quick action; Trigger the target event by combining the user action and the finger quick action.

2. The barrier-free interaction method based on gesture input of a mobile phone case according to claim 1, wherein The step of fusing the data collected by the IMU sensor and the data collected by the capacitance sensor includes: Perform data fusion using a time window.

3. The barrier-free interaction method based on gesture input of a mobile phone case according to claim 1, characterized in that: The first action monitoring model uses a decision tree model.

4. The barrier-free interaction method based on gesture input of a mobile phone case according to claim 1, characterized in that, It also includes a model training step: Obtain the collected original data; Crop the original data to obtain valid data; Divide the valid data into a training set and a test set; Train the model through the training set; Evaluate the generalization ability of the model through the test set.

5. The barrier-free interaction method based on gesture input of a mobile phone case according to claim 4, wherein: The original data is configured with a time stamp at the start of the action operation.

6. The barrier-free interaction method based on gesture input of a mobile phone case according to claim 1, wherein: The finger quick actions include clicking, swiping, and drawing gestures.

7. An accessible interaction system based on gesture input of a mobile phone case, applying the method according to any one of claims 1 to 6, characterized in that: It includes a phone case and a capacitance sensor. The capacitance sensor is arranged on the phone case, and the phone is built-in with an IMU sensor.

8. The barrier-free interaction system based on gesture input of a mobile phone case according to claim 7, wherein: The capacitance sensor uses a lightweight sensor.

9. A computer device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 6.

Images