Method and device for operating electronic equipment, and electronic equipment

Abstract

The present application discloses an operation method, device and electronic device of an electronic device, belonging to the field of communication technology. The method comprises: when the electronic device is in an air-to-air operation mode, obtaining information of an operation object; when the information of the operation object obtained satisfies a preset condition, receiving a first input of the operation object; in response to the first input, determining that the spatial plane where the operation object is located is a target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle with the plane where the electronic device screen is located is less than a preset angle. In this way, the user can perform contactless operation on the electronic device in space, thereby reducing the risk of disease transmission caused by contact, and can lock the target spatial operation plane for the user based on the information of the operation object obtained in the air-to-air operation mode and the user input, thereby improving the user's air-to-air operation experience.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to an operation method and device of an electronic device and the electronic device. Background Art

[0002] At present, electronic devices are basically operated by users through touch screens, which require users to touch the screen with their fingers. However, viruses, bacteria and other pathogenic organisms are easily retained on the screens of electronic devices, thus posing the problem of the risk of disease transmission due to contact operations. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide an electronic device operation method, device and electronic device, which can overcome the disease transmission risk problem existing in existing contact operations.

[0004] In order to solve the above technical problems, this application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides an operating method of an electronic device, the method comprising:

[0006] When the electronic device is in an airborne operation mode, obtaining information of an operation object;

[0007] When the acquired information of the operation object meets a preset condition, receiving a first input of the operation object;

[0008] In response to the first input, the spatial plane where the operation object is located is determined to be a target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle between the target spatial operation plane and the plane where the electronic device screen is located is less than a preset angle.

[0009] In a second aspect, an embodiment of the present application provides an operating device for an electronic device, including:

[0010] A first acquisition module, used for acquiring information of an operation object when the electronic device is in an air-free operation mode;

[0011] A first receiving module, configured to receive a first input of the operation object when the acquired information of the operation object meets a preset condition;

[0012] An execution module is used to determine, in response to the first input, that the spatial plane where the operation object is located is a target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle between the target spatial operation plane and the plane where the electronic device screen is located is less than a preset angle.

[0013] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the operating method of the electronic device as described in the first aspect.

[0014] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the operating method of the electronic device as described in the first aspect are implemented.

[0015] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0016] In an embodiment of the present application, when the electronic device is in the air-to-air operation mode, the information of the operation object is obtained; when the information of the operation object obtained satisfies a preset condition, the first input of the operation object is received; in response to the first input, the spatial plane where the operation object is located is determined to be the target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle between the target spatial operation plane and the plane where the electronic device screen is located is less than a preset angle. In this way, the user can perform contactless operation on the electronic device in space, thereby reducing the risk of disease transmission caused by contact, and based on the information of the operation object obtained in the air-to-air operation mode and the user input, the target spatial operation plane can be locked for the user, thereby improving the user's air-to-air operation experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a flow chart of an operating method of an electronic device provided by an embodiment of the present application;

[0018] Figure 2 is a schematic diagram of the movement trajectory of the mobile camera in the process of collecting finger information provided by an embodiment of the present application;

[0019] Figure 3a is a schematic diagram of the operation process of locking the space operation plane provided in an embodiment of the present application;

[0020] Figure 3b is a schematic diagram of an operation interface of a locking space operation plane provided in an embodiment of the present application;

[0021] Figure 4 is a schematic diagram of the structure of an operating device of an electronic device provided in an embodiment of the present application;

[0022] Figure 5It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0023] Figure 6 It is a schematic diagram of the structure of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0025] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0026] The following describes in detail the operating method of the electronic device provided by the embodiment of the present application through specific embodiments and application scenarios in conjunction with the accompanying drawings.

[0027] See also Figure 1 , Figure 1 A flowchart of an operating method of an electronic device provided in an embodiment of the present application, such as Figure 1 As shown, the method comprises the following steps:

[0028] Step 101: When the electronic device is in an air operation mode, obtain information of an operation object.

[0029] In the embodiment of the present application, the above-mentioned operation object may include objects such as fingers and styluses that can be used for spatial operations. Of course, in order to ensure safety and prevent misoperation, the operation object may be a pre-designated specific operation object that can be used for spatial operations, such as a finger, or a pre-recorded designated finger with a fingerprint. For ease of understanding, the following text mainly uses fingers as the operation object to illustrate the specific implementation of the embodiment of the present application, but does not limit the operation object to only fingers.

[0030] The above-mentioned air operation mode can be a mode configured by the electronic device that can perform air operation. The above-mentioned electronic device is in the air operation mode. The electronic device can start the air operation mode based on the user's trigger operation, or it can start the air operation mode based on a specific event trigger.

[0031] The information of the operation object mentioned above may include an image of the operation object, biometrics and other information, and may specifically be specific information required to be used, such as a finger image, fingerprint information and the like.

[0032] The above-mentioned acquisition of information on the operation object may be acquisition of information on the operation object currently collected by the electronic device. Specifically, the electronic device may be configured with a photoelectric module for collecting information on the operation object. The above-mentioned photoelectric module may be a front camera, a mobile camera, an under-screen mobile camera, or the like that can collect information on the operation object or can follow the collection of information on the operation object.

[0033] Step 102: When the acquired information of the operation object meets a preset condition, receive a first input of the operation object.

[0034] That is to say, in order to determine the target spatial operation plane expected by the user based on user needs, when information of the operation object is collected, such as finger information, it can be further determined whether the information of the currently collected operation object meets the preset conditions for locking the spatial operation plane. Only when the preset conditions are met can the first input performed by the user through the operation object be received and responded to, and the spatial plane where the operation object is located can be locked.

[0035] Specifically, after obtaining the information of the operation object, it is possible to analyze whether the current information can reflect that the user's finger is placed within the effective collection range of the electronic device, that is, whether the electronic device can currently collect the complete information of the operation object, or further match the biometric features of the current operation object, such as finger fingerprints, and by matching the finger fingerprint with the identified air-operation finger fingerprint, it is determined whether the user's current operating finger is the identified air-operation finger, and whether the currently acquired information of the operation object meets the preset conditions.

[0036] That is, the preset condition may include any of the following:

[0037] The information of the operation object obtained is a complete image of the operation object;

[0038] The information obtained about the operation object is complete biometric features;

[0039] The acquired information of the operation object is a complete biometric feature that matches the preset biometric feature.

[0040] Specifically, when the preset condition includes that the information of the operation object obtained is a complete operation object, the information of the operation object may include an operation object image, and whether the obtained operation object image is complete can be analyzed. For example, taking a finger as an example, it can be determined whether the finger image includes a complete fingertip image to determine whether the preset condition is currently met.

[0041] When the preset condition includes that the information of the operation object obtained is a complete biometric feature, the information of the operation object may include the biometric feature of the operation object, and whether the obtained biometric feature of the operation object is complete can be analyzed. Taking fingers as an example, whether the preset condition is currently met can be determined by judging whether the collected finger fingerprint is complete.

[0042] When the preset condition includes that the acquired information of the operation object is a complete biometric feature, the information of the operation object may include an operation object image and the operation object's biometric feature, and whether the preset condition is currently met can be determined by separately analyzing whether the operation object image is complete and whether the operation object's biometric feature is complete.

[0043] In this way, the preset condition may include any one of the above three, and under different preset conditions, different methods may be used to identify whether the information of the operation object meets the preset condition, and it may be applicable to different user demand scenarios and ensure the effectiveness of the user's remote operation. In addition, the determination of the preset conditions may help determine the target space operation plane that meets the user's expectations, so as to meet the user's actual operation needs.

[0044] In this step, when the information of the operation object obtained meets the preset conditions, it indicates that the current operation object is in a valid operation position, or the information of the operation object is valid operation object information, so that the user can execute a first input for triggering locking the spatial plane where the operation object is located, and accordingly, the electronic device can receive the first input of the operation object.

[0045] Among them, the first input can be a user input for locking the current spatial operation plane, for example, receiving a specific gesture input by the user, a specific voice command, or moving the finger to the spatial position corresponding to the lock key, etc., or it can be an input of receiving the user's finger staying at the current position for more than a preset time. For example, when the user moves the finger to a suitable spatial position for operation and keeps the finger there for 3 seconds, it can trigger the locking of the corresponding spatial operation plane where the current finger position is located.

[0046] Optionally, after step 101 and before step 102, the method further includes:

[0047] When the acquired information of the operation object does not satisfy the preset condition, the optoelectronic module of the electronic device is controlled to move to a target position, wherein the acquired information of the operation object at the target position satisfies the preset condition.

[0048] That is, in an optional implementation, the electronic device can be configured with a movable optoelectronic module, for example, the optoelectronic module can be a module that can follow and collect information of the operation object, such as a mobile camera or an under-screen mobile camera. In this way, in this implementation, the movable characteristics of the optoelectronic module can be combined to further improve the convenience of remote operation.

[0049] Specifically, taking the operation object as a finger as an example, when the electronic device is in the air-to-air operation mode, the user's finger information can be first collected through the photoelectric module, and it is determined whether the collected finger information meets the aforementioned preset conditions, that is, whether the collected finger information is valid. The finger information can be a finger image or a fingerprint image. The determination of whether the collected finger information is valid can be a determination of whether a complete finger image or fingerprint image is collected. The completeness of the finger image or fingerprint image can help determine whether the current user's finger is completely within the collection range of the photoelectric module. If it is complete, it means that valid finger information is collected, that is, the current user's finger is completely within the collection range. Otherwise, it means that no valid finger information is collected, that is, the current user's finger is not completely within the collection range.

[0050] In this embodiment, when valid finger information is not collected, that is, the information of the operation object does not meet the preset conditions, the user does not need to move and adjust the finger position. Instead, the movable characteristic of the photoelectric module can be used to control the movement of the photoelectric module so that the photoelectric module moves to a target position where finger information that meets the preset conditions can be obtained. In other words, when the photoelectric module is at the target position, complete and valid finger information can be collected.

[0051] The above control of the movement of the photoelectric module may be specifically to control the photoelectric module to move in a direction close to the center of the user's finger by determining the position offset of the photoelectric module relative to the user's finger, so that the photoelectric module can collect more and more complete finger information, and the photoelectric module may stop controlling the movement of the photoelectric module when the photoelectric module collects valid finger information, i.e., a complete finger image or a complete fingerprint image. More specifically, based on the finger information currently collected by the photoelectric module, the position offset of the photoelectric module relative to the user's finger may be determined, and then the direction in which the photoelectric module needs to move may be determined, and after the movement, the latest finger information currently collected may be compared with the finger information collected before the movement in real time to determine whether more and more complete finger information is currently collected. If so, the movement may continue in this direction until the complete finger information is collected. Otherwise, once it is found that the collected finger information is reduced, the movement may immediately move in the opposite direction until the complete finger information is collected.

[0052] For example, if only the right half of the fingerprint of the finger is collected at the beginning, it means that the current photoelectric module is located on the right side of the finger, and it is necessary to control the photoelectric module to move to the left side. During the movement, the size of the fingerprint image is compared in real time to determine whether the currently collected fingerprint image is more complete. If so, it can continue to move and stop when it is determined that the complete fingerprint image is collected. If it is found that the currently collected fingerprint image becomes smaller during the movement, it can move in the opposite direction until it moves to a suitable position where the complete fingerprint image can be collected.

[0053] Finally, when finger information satisfying the preset condition is collected, the first input of the operation object is received and responded to, and the target space operation plane where the current finger position is located is locked.

[0054] In this way, through this implementation, when locking the spatial operation plane, the user does not need to move and adjust the position of the finger, thereby improving the convenience of user operation.

[0055] Furthermore, the optoelectronic module is a mobile camera under the screen. That is, the mobile camera is arranged under the screen of the electronic device. The principle of the mobile camera under the screen is that the camera can replace part of the upper screen when needed through the slide rail under the screen. In this way, by applying the solution in the embodiment of the present application to an electronic device equipped with a mobile camera under the screen, it can be ensured that the position adjustment range of the mobile camera is wider and the position adjustment is more flexible. Moreover, since the mobile camera under the screen can be adjusted to a position that is more aligned with the user's operating finger, it is more conducive to the user to conveniently perform remote operation.

[0056] Combine the following Figure 2, an example is given of an implementation method of helping to collect finger information that meets preset conditions by controlling the moving trajectory of a mobile camera:

[0057] like Figure 2 As shown, the mobile camera 21 of the electronic device 20 is located at the initial position A. When the complete finger information is not collected at this position, the mobile camera 21 can be controlled to move in the corresponding direction based on the position offset information of the mobile camera 21 relative to the finger, so that it reaches the adjusted position B. At position B, the mobile camera 21 can collect complete finger information.

[0058] It should be noted that during the movement of the mobile camera, under the premise that the finger remains in unchanged position, the distance between the operation space plane determined by the user's finger position and the electronic device screen should remain unchanged, but the effective operation area on the operation space plane can move horizontally accordingly with the movement direction of the mobile camera.

[0059] Step 103: In response to the first input, determine that the spatial plane where the operation object is located is a target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle between the target spatial operation plane and the plane where the electronic device screen is located is less than a preset angle.

[0060] In this step, the first input can be responded to, and the spatial plane where the operation object is located can be locked, that is, the spatial plane where the operation object is located is determined to be the target spatial operation plane, so that subsequent users can perform air operations in the target spatial operation plane, and the electronic device can also receive and respond to the user's air operations in the target spatial operation plane.

[0061] The target space operation plane is a spatial plane parallel to the plane where the electronic device screen is located, or the angle between the target space operation plane and the plane where the electronic device screen is located is less than a preset angle, that is, the target space operation plane can be substantially parallel to the plane where the electronic device screen is located, so that a certain range of operation position error can be allowed during remote operation. The preset angle can be set based on the operation accuracy requirements, and generally should not be set too large, for example, it can be about 5 degrees.

[0062] Optionally, a first interface is displayed on the screen of the electronic device, the first interface includes a first control, and the operation object includes a target finger;

[0063] Before step 103, the method further includes:

[0064] Acquire a first position of the target finger, where the target finger is a finger that establishes a mapping relationship with the first control;

[0065] The receiving a first input of the operation object includes:

[0066] Receive input that the target finger stays at the first position for a first time period;

[0067] The determining the spatial plane where the operation object is located as the target spatial operation plane includes:

[0068] In the case where the first duration exceeds a preset duration, determining the spatial plane where the target finger is located as a target spatial operation plane, and locking the position of a first operation area in the target spatial operation plane, wherein a mapping area of ​​the first interface in the target spatial operation plane is the first operation area;

[0069] After step 103, the method further includes:

[0070] The mapping relationship between the target finger and the first control is cancelled.

[0071] That is, in an optional implementation, when a first interface is displayed on the screen of the electronic device and the first interface includes a first control, when a user uses a target finger that has a mapping relationship with the first control to perform an air operation, and the target space operation plane is locked, the target finger is always mapped to the first control, that is, any position of the target finger in the space corresponds to pointing to the first control.

[0072] The first interface may be any interface, or a preset interface supporting air operation, or an operation area interface in the entire interface displayed on the screen of the electronic device, such as the interface where the keyboard is located, and the first control may be a specific control on the first interface, for example, a specific control for triggering and locking the spatial operation plane where the current finger position is located. Moreover, in this embodiment, a mapping relationship between the target finger and the first control may be established in advance, that is, the target finger may be set in advance, and the first control may be specified in advance, so as to establish a mapping relationship between the target finger and the first control.

[0073] The mapping relationship is illustrated below with the help of an example. For example, when the target finger is the right index finger and the first control is the character key Y in the keyboard displayed on the screen of the electronic device, as the position of the right index finger moves, the position of the entire spatial keyboard also moves accordingly, but the character key Y is always associated with the position of the right index finger.

[0074] In this embodiment, the position information of the target finger can be obtained before the target spatial operation plane is locked. For example, if it is obtained that the target finger is located at a first position, when the user believes that the spatial plane where the first position is located is suitable as a remote operation plane, the target finger can be kept at the first position for a certain period of time, such as a first period of time. The first period of time exceeds a preset period of time. The preset period of time can be set according to needs, such as being set to 3 seconds, so that the electronic device can receive the input that the target finger stays at the first position for the first period of time, and can respond to the input to lock the spatial plane where the target finger is located, that is, determine that the spatial plane where the target finger is located is the target spatial operation plane.

[0075] Moreover, in this embodiment, a valid operating area can be further determined on the target space operating plane. The valid operating area can be an operating area that can receive and respond. Specifically, the position and size of the valid operating area can be determined according to the acquisition range of the electronic device, or it can be determined based on the default setting of the valid operating area size and the position relative to the electronic device. It can also be based on the size of the operating area on the screen of the electronic device, such as the size of the keyboard, to determine an effective operating area of ​​equal proportion or preset proportion on the target space operating plane.

[0076] That is to say, when it is detected that the target finger stays at the first position for more than a preset time, the spatial plane where the target finger is located can be determined as the target spatial operation plane, and the position of the first operation area in the target spatial operation plane can be locked, so that subsequent users can perform air operations in the first operation area, and the electronic device can also receive and respond to the user's air operations in the first operation area. Among them, the first operation area is also the mapping area of ​​the first interface in the target spatial operation plane, and the first operation area and the first interface are in a mutual mapping relationship.

[0077] Furthermore, after the spatial plane where the operation object is located is locked, that is, after the spatial plane where the operation object is located is determined to be the target spatial operation plane, the mapping relationship between the target finger and the first control can also be released, so that the user can start moving the target finger in the first operation area to perform air operation on the electronic device. That is to say, after the mapping relationship between the target finger and the first control is released, the moved target finger no longer always points to the first control, but the relative movement position of the target finger in the first operation area can be converted into a relative movement position corresponding to the first interface, and then the air operation position of the target finger in the first operation area can be responded to. As described in the above example, after the contact mapping relationship, the right index finger no longer always points to control Y.

[0078] Furthermore, the first interface also includes a second control;

[0079] After step 103, the method further includes:

[0080] Receiving a second input of the target finger at a second position, wherein the second position is a position mapped to the second control on the target space operation plane;

[0081] In response to the second input, the target space operation plane is canceled and the mapping relationship is restored; wherein the second control is used to cancel the locking of the target space operation plane.

[0082] That is, in this embodiment, a second control for cancelling the lock of the spatial operation plane may also be displayed in the first interface. For example, the first control is a confirmation key for locking the spatial plane where the target finger is located, and the second control is a cancel key for cancelling the lock of the currently determined target spatial operation plane.

[0083] After locking the spatial plane where the target finger is located, if the user needs to re-lock the spatial operation plane, the target finger can be moved to a second position pointing to the second control, such as the cancel key, to perform an air touch operation on the cancel key, that is, to perform a second input at the second position through the target finger, and the target finger can also be kept at the second position for a certain period of time to avoid misoperation, thereby triggering the electronic device to cancel the lock of the current spatial operation plane, that is, to cancel the determination of the target spatial operation plane. Furthermore, when the determination of the target spatial operation plane is canceled, the mapping relationship between the target finger and the first control can be restored, so that the target finger can always point to the first control no matter where it moves.

[0084] It should be noted that after unlocking the target space operation plane, the user can select a suitable operation position again and re-lock the space plane where the selected operation position is located. The locking method is similar to the above method and will not be repeated here.

[0085] Combine the following Figure 3a and Figure 3b , the implementation methods of locking the target space operation plane and cancelling the locking of the target space operation plane are described by way of example:

[0086] like Figure 3aAs shown, a confirmation key 31 and a cancel key 32 are displayed on the screen of the electronic device 30. The positions of fingers C, D, and E in the figure are all valid positions, that is, they are all within the acquisition range of the photoelectric module of the electronic device 30. A mapping relationship is established between the user's right index finger and the confirmation key 31. The user moves the right index finger from the valid position C to the valid position D, and then from the valid position D to the final locking position E. Before the locking condition is met, the cursor on the screen of the electronic device 30 can be in focus and always point to the confirmation key 31. When the locking condition is met, if the user keeps the right index finger at the final locking position E for more than 3 seconds, it can be Figure 3b As shown, according to the final locking position E, the corresponding target space operation plane 32 is locked, and the mapping relationship between the right hand finger and the confirmation key 31 is released. The user can subsequently operate on the target space operation plane 32 to achieve the same touch operation effect as on the screen of the electronic device 30.

[0087] After locking the corresponding target space operation plane 33, if the user needs to cancel the target space operation plane 33, the user can move the right index finger to another spatial position pointing to the cancel key 32 and stay at this position for a certain period of time. The electronic device 30 responds to the operation at this position, cancels the target space operation plane 33, and restores the mapping relationship between the right hand finger and the confirmation key 31.

[0088] Optionally, after step 103, the method further includes:

[0089] Collecting the moving position information of the operation object on the target space operation plane, and converting the moving position information into the input position information corresponding to the screen of the electronic device;

[0090] Based on the input position information, the electronic device is operated.

[0091] In an embodiment of the present application, after locking the target space operation plane, the user can perform air operations on the electronic device on the target space operation plane. Specifically, the user can move his finger on the target space operation plane according to actual operation needs, and the electronic device collects the movement position information of the finger in real time, and converts the movement position information into input position information corresponding to the screen of the electronic device. More specifically, the relative distance of each movement can be converted into the relative movement distance corresponding to the screen of the electronic device, and then combined with the preset reference position or the last input position corresponding to the screen, it can be determined that the spatial operation position of the user's finger corresponds to the specific input position on the screen of the electronic device.

[0092] After converting the user's spatial operation position into input position information corresponding to the screen of the electronic device, the electronic device can be operated based on the input position information, which may include a variety of different air operation scenarios. For example, the specific information of the air input, such as characters on the input method keyboard, can be determined based on the input position information, or the specific air operation object, such as a specific button, control, etc. can be determined based on the input position information. Alternatively, the specific operation gesture or operation trajectory can be determined based on the input position information, and the electronic device can be controlled to respond to these operations.

[0093] In this way, through this implementation, the user's remote operation on the target space operation plane can be received and responded to.

[0094] Optionally, before determining that the spatial plane where the operation object is located is the target spatial operation plane, the method further includes:

[0095] In the process of acquiring the information of the operation object, the position of the operation object is aligned with the preset reference position in real time.

[0096] That is, in the above-mentioned embodiment, when obtaining information of the operation object, such as collecting finger information, the collected finger position can be further aligned with the preset reference position on the screen of the electronic device in real time, so that the user's finger position always points to the preset reference position. When the preset reference position is the position of the confirmation key for locking the operation space plane, it is equivalent to binding the user's current operating finger position to the confirmation key, and the entire effective operation space plane can move along with the movement of the user's current operating finger.

[0097] The preset reference position may be a specific reference position that is preset, for example, the position of a specific virtual key (such as the confirmation key) displayed on the screen is preset as the preset reference position, or a fixed point on the screen (such as the center of the screen) is preset as the preset reference position, etc. In the embodiment of the present application, the user's finger position may be aligned with the preset reference position in real time before the target space operation plane is locked, so that when the target space operation plane is locked, the user's finger position is aligned with the preset reference position, or the user's finger position may be aligned with the preset reference position under the condition that the target space operation plane is locked.

[0098] In this way, not only can the position of the operation space plane be determined in real time, but the user can also adjust the appropriate finger position based on reference to find a space plane suitable for operation.

[0099] Optionally, before step 101, the method further includes:

[0100] When the electronic device enters a preset page, the photoelectric module of the electronic device is started to collect information of the operation object.

[0101] The preset page can be a pre-set page that can enable air operation, for example, a message editing page, an instant messaging page, or other pages that require the activation of an input method keyboard, or other pages where the user needs to enable air operation. The preset page can be automatically set by the system or customized by the user.

[0102] In this implementation, when the electronic device enters a preset page, the photoelectric module can be triggered to start, and finger information can be collected through the photoelectric module, that is, the electronic device enters an air-to-air operation mode.

[0103] In this way, the air operation mode can be automatically enabled for users on certain specific pages without the need for users to manually enable it.

[0104] Optionally, before receiving the first input of the operation object, the method further includes:

[0105] When the acquired information of the operation object meets a preset condition, a prompt message for prompting the user to lock the spatial operation plane is output.

[0106] In an optional implementation, in order to make the interaction more friendly, when the information of the operation object obtained satisfies the preset conditions, it can be determined that the conditions for locking the spatial operation plane are currently met, so that in this case, a prompt message for prompting the user to lock the spatial operation plane can be output, for example, displaying the corresponding prompt information on the screen, outputting the corresponding voice prompt, etc. In this way, when the user receives the prompt message, he can make the corresponding operation as soon as possible and determine the finger position, for example, place the finger at a certain position and stay for 3 seconds to trigger the electronic device to lock the corresponding spatial plane where the current finger position is located.

[0107] The method for operating an electronic device in an embodiment of the present application, when the electronic device is in an air-to-air operation mode, obtains information of an operation object; when the information of the operation object obtained satisfies a preset condition, receives a first input of the operation object; in response to the first input, determines that the spatial plane where the operation object is located is a target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle between the target spatial operation plane and the plane where the electronic device screen is located is less than a preset angle. In this way, the user can perform contactless operation on the electronic device in space, thereby reducing the risk of disease transmission caused by contact, and can lock the target spatial operation plane for the user based on the information of the operation object obtained in the air-to-air operation mode and the user input, thereby improving the user's air-to-air operation experience.

[0108] It should be noted that the operating method of the electronic device provided in the embodiment of the present application can be executed by an operating device of the electronic device, or a control module in the operating device of the electronic device for executing the operating method of the electronic device. In the embodiment of the present application, the operating device of the electronic device executing the operating method of the electronic device is taken as an example to illustrate the operating device of the electronic device provided in the embodiment of the present application.

[0109] See also Figure 4 , Figure 4 A schematic diagram of the structure of an operating device of an electronic device provided in an embodiment of the present application, such as Figure 4 As shown, the operating device 400 of the electronic device includes:

[0110] A first acquisition module 401 is used to acquire information of an operation object when the electronic device is in an air operation mode;

[0111] A first receiving module 402, configured to receive a first input of the operation object when the acquired information of the operation object meets a preset condition;

[0112] The execution module 403 is used to respond to the first input and determine that the spatial plane where the operation object is located is the target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle between the target spatial operation plane and the plane where the electronic device screen is located is less than a preset angle.

[0113] Optionally, the operating device 400 of the electronic device further includes:

[0114] The control module is used to control the optoelectronic module of the electronic device to move to a target position when the information of the operation object obtained does not meet the preset condition, wherein the information of the operation object obtained at the target position meets the preset condition.

[0115] Optionally, the acquired information of the operation object satisfies a preset condition including any one of the following:

[0116] The information of the operation object obtained is a complete image of the operation object;

[0117] The information obtained about the operation object is complete biometric features;

[0118] The acquired information of the operation object is a complete biometric feature that matches the preset biometric feature.

[0119] Optionally, a first interface is displayed on the screen of the electronic device, the first interface includes a first control, and the operation object includes a target finger;

[0120] The operating device 400 of the electronic device further includes:

[0121] A second acquisition module, configured to acquire a first position of the target finger, where the target finger is a finger that establishes a mapping relationship with the first control;

[0122] The first receiving module 402 is used to receive an input that the target finger stays at the first position for a first time period;

[0123] The execution module 403 is used for determining, when the first duration exceeds a preset duration, the space plane where the target finger is located as a target space operation plane, and locking the position of a first operation area in the target space operation plane, wherein the mapping area of ​​the first interface in the target space operation plane is the first operation area;

[0124] The operating device 400 of the electronic device further includes:

[0125] The first processing module is used to release the mapping relationship between the target finger and the first control.

[0126] Optionally, the first interface also includes a second control;

[0127] The operating device 400 of the electronic device further includes:

[0128] A second receiving module, configured to receive a second input of the target finger at a second position, wherein the second position is a position mapped to the second control on the target space operation plane;

[0129] A second processing module, configured to cancel the determination of the target space operation plane and restore the mapping relationship in response to the second input;

[0130] Wherein, the second control is used to unlock the target space operation plane.

[0131] The operating device of the electronic device in the embodiment of the present application, when the information of the operating object is collected by the photoelectric module of the electronic device, locks the spatial plane where the operating object is located as the target spatial operating plane, wherein the spatial plane is a plane parallel to the screen of the electronic device, and the position of the operating object is aligned with the preset reference position on the screen of the electronic device; the moving position information of the operating object on the target spatial operating plane is collected by the photoelectric module, and the moving position information is converted into the input position information corresponding to the screen of the electronic device; based on the input position information, the electronic device is operated. In this way, the user can perform contactless operation on the electronic device in space, thereby reducing the risk of disease transmission caused by contact.

[0132] The operating device of the electronic device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0133] The operating device of the electronic device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0134] The operating device of the electronic device provided in the embodiment of the present application can achieve Figure 1 To avoid repetition, the various processes implemented in the method embodiment of FIG. 3 are not described again here.

[0135] Optional, such as Figure 5As shown, an embodiment of the present application also provides an electronic device 500, including a processor 501, a memory 502, and a program or instruction stored in the memory 502 and executable on the processor 501. When the program or instruction is executed by the processor 501, each process of the operating method embodiment of the above-mentioned electronic device is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0136] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0137] Figure 6 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0138] The electronic device 600 includes but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, and a processor 610.

[0139] Those skilled in the art will appreciate that the electronic device 600 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 610 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0140] The processor 610 is used to obtain information of the operation object when the electronic device 600 is in the air operation mode;

[0141] When the acquired information of the operation object meets a preset condition, receiving a first input of the operation object;

[0142] In response to the first input, the spatial plane where the operation object is located is determined to be the target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the screen of the electronic device 600 is located, or the angle between the target spatial operation plane and the plane where the screen of the electronic device 600 is located is less than a preset angle.

[0143] Optionally, the processor 610 is also used to control the optoelectronic module of the electronic device 600 to move to a target position when the information of the operation object obtained does not meet the preset condition, wherein the information of the operation object obtained at the target position meets the preset condition.

[0144] Optionally, the acquired information of the operation object satisfies a preset condition including any one of the following:

[0145] The information of the operation object obtained is a complete image of the operation object;

[0146] The information obtained about the operation object is complete biometric features;

[0147] The acquired information of the operation object is a complete biometric feature that matches the preset biometric feature.

[0148] Optionally, a first interface is displayed on the screen of the electronic device 600, the first interface includes a first control, and the operation object includes a target finger;

[0149] The processor 610 is further configured to obtain a first position of the target finger, where the target finger is a finger that establishes a mapping relationship with the first control;

[0150] Receive input that the target finger stays at the first position for a first time period;

[0151] In the case where the first duration exceeds a preset duration, determining the spatial plane where the target finger is located as a target spatial operation plane, and locking the position of a first operation area in the target spatial operation plane, wherein a mapping area of ​​the first interface in the target spatial operation plane is the first operation area;

[0152] The mapping relationship between the target finger and the first control is cancelled.

[0153] Optionally, the first interface also includes a second control;

[0154] The processor 610 is further configured to receive a second input of the target finger at a second position, wherein the second position is a position mapped to the second control on the target space operation plane;

[0155] In response to the second input, the target space operation plane is cancelled and the mapping relationship is restored.

[0156] The electronic device in the embodiment of the present application, when in the air-to-air operation mode, obtains the information of the operation object; when the information of the operation object obtained satisfies the preset conditions, receives the first input of the operation object; in response to the first input, determines that the spatial plane where the operation object is located is the target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle with the plane where the electronic device screen is located is less than the preset angle. In this way, the user can perform contactless operation on the electronic device in space, thereby reducing the risk of disease transmission caused by contact, and based on the information of the operation object obtained in the air-to-air operation mode and the user input, the target spatial operation plane can be locked for the user, thereby improving the user's air-to-air operation experience.

[0157] It should be understood that in the embodiment of the present application, the input unit 604 may include a graphics processor (GPU) 6041 and a microphone 6042, and the graphics processor 6041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 607 includes a touch panel 6071 and other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 may include two parts: a touch detection device and a touch controller. Other input devices 6072 may include but are not limited to a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 609 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 610 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, the user interface, and the application program, and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 610.

[0158] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the operating method embodiment of the above-mentioned electronic device is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0159] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a disk or an optical disk.

[0160] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned electronic device operation method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0161] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0162] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0163] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, disk, CD), and includes a number of instructions for a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0164] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for operating an electronic device, characterized in that: include: When the electronic device is in an airborne operation mode, obtaining information of an operation object; A first interface is displayed on the screen of the electronic device, the first interface includes a first control, and the operation object includes a target finger; In a case where the acquired information of the operation object meets a preset condition, receiving a first input of the operation object, where the first input is used to lock the spatial plane where the operation object is located; Acquire a first position of the target finger, where the target finger is a finger that establishes a mapping relationship with the first control; In response to the first input, determining the spatial plane where the target finger is located as the target spatial operation plane, and releasing the mapping relationship between the target finger and the first control; wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle between the target spatial operation plane and the plane where the electronic device screen is located is less than a preset angle; The acquired information of the operation object satisfies a preset condition including any one of the following: the acquired information of the operation object is a complete operation object image; the acquired information of the operation object is a complete biometric feature; the acquired information of the operation object is a complete biometric feature that matches a preset biometric feature.

2. The method according to claim 1, characterized in that After acquiring the information of the operation object, and if the acquired information of the operation object meets a preset condition, before receiving the first input of the operation object, the method further includes: When the acquired information of the operation object does not satisfy the preset condition, the optoelectronic module of the electronic device is controlled to move to a target position, wherein the acquired information of the operation object at the target position satisfies the preset condition.

3. The method according to claim 1 or 2, characterized in that: The receiving a first input of the operation object includes: Receive input that the target finger stays at the first position for a first time period; The determining the spatial plane where the target finger is located as the target spatial operation plane includes: When the first duration exceeds the preset duration, the spatial plane where the target finger is located is determined to be the target spatial operation plane, and the position of the first operation area in the target spatial operation plane is locked, wherein the mapping area of ​​the first interface in the target spatial operation plane is the first operation area.

4. The method according to claim 3, characterized in that The first interface also includes a second control; After determining that the spatial plane where the target finger is located is the target spatial operation plane, the method further includes: Receiving a second input of the target finger at a second position, wherein the second position is a position mapped to the second control on the target space operation plane; In response to the second input, cancel determining the target space operation plane and restore the mapping relationship; Wherein, the second control is used to unlock the target space operation plane.

5. An operating device for an electronic device, characterized in that: include: A first acquisition module, used for acquiring information of an operation object when the electronic device is in an air-free operation mode; A first interface is displayed on the screen of the electronic device, the first interface includes a first control, and the operation object includes a target finger; A first receiving module, configured to receive a first input of the operation object when the acquired information of the operation object meets a preset condition, wherein the first input is used to lock the spatial plane where the operation object is located; A second acquisition module, configured to acquire a first position of the target finger, where the target finger is a finger that establishes a mapping relationship with the first control; an execution module, configured to, in response to the first input, determine that the spatial plane where the target finger is located is a target spatial operation plane, wherein the target spatial operation plane is parallel to the plane where the electronic device screen is located, or the angle between the target spatial operation plane and the plane where the electronic device screen is located is less than a preset angle; A first processing module, configured to release the mapping relationship between the target finger and the first control when determining that the spatial plane where the target finger is located is the target spatial operation plane; The acquired information of the operation object satisfies a preset condition including any one of the following: the acquired information of the operation object is a complete operation object image; the acquired information of the operation object is a complete biometric feature; the acquired information of the operation object is a complete biometric feature that matches a preset biometric feature.

6. The operating device for an electronic device according to claim 5, characterized in that: The operating device of the electronic device also includes: The control module is used to control the optoelectronic module of the electronic device to move to a target position when the information of the operation object obtained does not meet the preset condition, wherein the information of the operation object obtained at the target position meets the preset condition.

7. The operating device for an electronic device according to claim 5 or 6, characterized in that: The first receiving module is used to receive input that the target finger stays at the first position for a first time length; The execution module is used to determine that the spatial plane where the target finger is located is the target spatial operation plane and lock the position of the first operation area in the target spatial operation plane when the first time duration exceeds the preset time duration, wherein the mapping area of ​​the first interface in the target spatial operation plane is the first operation area.

8. The operating device of an electronic device according to claim 7, characterized in that: The first interface also includes a second control; The operating device of the electronic device also includes: A second receiving module, configured to receive a second input of the target finger at a second position, wherein the second position is a position mapped to the second control on the target space operation plane; A second processing module, configured to cancel the determination of the target space operation plane and restore the mapping relationship in response to the second input; Wherein, the second control is used to unlock the target space operation plane.

9. An electronic device, characterized in that: The electronic device comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the operating method of the electronic device as claimed in any one of claims 1 to 4.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by the processor, the steps of the operating method of the electronic device according to any one of claims 1 to 4 are implemented.

Images